Software Engineering Daily-logo

Software Engineering Daily

Business


Episodes

Slack Frontend Architecture with Anuj Nair

2/27/2020
Slack is a messaging application with millions of users. The desktop application is an Electron app, which is effectively a web browser dedicated to running Slack. This frontend is built with ReactJS and other JavaScript code, and the application is incredibly smooth and reliable, despite its complexity. When a user boots up Slack, the application The post Slack Frontend Architecture with Anuj Nair appeared first on Software Engineering Daily.

Duration:01:07:52

Makerpad: Low Code Tools with Ben Tossell

2/27/2020
Low code tools can be used to build an increasing number of applications. Knowledge workers within a large corporation can use low code tools to augment their usage of spreadsheets. Entrepreneurs can use low code tools to start businesses even without knowing how to code. Modern low code tools have benefited from steady improvements in The post Makerpad: Low Code Tools with Ben Tossell appeared first on Software Engineering Daily.

Duration:00:57:59

Parabola: No-Code Data Workflows with Alex Yaseen

2/26/2020
Every company has a large number of routine data workflows. These data workflows involve spreadsheets, CSV files, and tedious manual work to be done by a knowledge worker. For example, data might need to be taken from Salesforce, filtered for new customers, and piped into Mailchimp. Or perhaps you need to sort all your customers The post Parabola: No-Code Data Workflows with Alex Yaseen appeared first on Software Engineering Daily.

Duration:01:02:59

Decentralized Finance with Tom Schmidt

2/25/2020
Cryptocurrencies today serve two purposes: store of value and speculation. The application infrastructure that has been built around cryptocurrency is mostly to support these use cases. At some point in the future, perhaps cryptocurrencies can be used as a global medium of exchange that is accepted at the grocery store. Perhaps we will use the The post Decentralized Finance with Tom Schmidt appeared first on Software Engineering Daily.

Duration:01:24:02

Infrastructure Management with Joey Parsons

2/24/2020
At Airbnb, infrastructure management is standardized across the organization. Platform engineering teams build tools that allow the other teams throughout the organization to work more effectively. A platform engineering team handles problems such as continuous integration, observability, and service discovery. Other teams throughout a company use the tools that a platform engineering team builds. For The post Infrastructure Management with Joey Parsons appeared first on Software...

Duration:01:14:38

Courier with Troy Goode

2/21/2020
A gig economy application generates lots of notifications. There is SMS, mobile phone updates, emails, and native application updates. If you order a ride from Uber, you might receive a text message and a push notification at the same time. If an app overloads the user with notifications, the user might end up annoyed and The post Courier with Troy Goode appeared first on Software Engineering Daily.

Duration:01:16:13

Data Infrastructure Investing with Eric Anderson

2/20/2020
In a modern data platform, distributed streaming systems are used to read data coming off of an application in real-time. There are a wide variety of streaming systems, including Kafka Streams, Apache Samza, Apache Flink, Spark Streaming, and more. When Eric Anderson joined the show back in 2016, he was working at Google on Google The post Data Infrastructure Investing with Eric Anderson appeared first on Software Engineering Daily.

Duration:01:12:06

Materialize: Streaming SQL on Timely Data with Arjun Narayan and Frank McSherry

2/19/2020
Distributed stream processing frameworks are used to rapidly ingest and aggregate large volumes of incoming data. These frameworks often require the application developer to write imperative logic describing how that data should be processed. For example, a high volume of clickstream data that is getting buffered to Kafka needs to have a stream processing system The post Materialize: Streaming SQL on Timely Data with Arjun Narayan and Frank McSherry appeared first on Software Engineering...

Duration:01:11:09

Go Networking with Sneha Inguva

2/18/2020
A cloud provider gives developers access to virtualized server infrastructure. When a developer rents this infrastructure via an API call, a virtual server is instantiated on physical machines. That virtual server needs to be made addressable through the allocation of an IP address to make it reachable from the open Internet. When the virtual server The post Go Networking with Sneha Inguva appeared first on Software Engineering Daily.

Duration:00:58:18

Great Expectations: Data Pipeline Testing with Abe Gong

2/17/2020
A data pipeline is a series of steps that takes large data sets and creates usable results from them. At the beginning of a data pipeline, a data set might be pulled from a database, a distributed file system, or a Kafka topic. Throughout a data pipeline, different data sets are joined, filtered, and statistically The post Great Expectations: Data Pipeline Testing with Abe Gong appeared first on Software Engineering Daily.

Duration:01:08:49

Data Warehouse ETL with Matthew Scullion

2/14/2020
A data warehouse provides low latency access to large volumes of data. A data warehouse is a crucial piece of infrastructure for a large company, because it can be used to answer complex questions involving a large number of data points. But a data warehouse usually cannot hold all of a company’s data at any The post Data Warehouse ETL with Matthew Scullion appeared first on Software Engineering Daily.

Duration:00:57:53

Anyscale with Ion Stoica

2/13/2020
Machine learning applications are widely deployed across the software industry. Most of these applications used supervised learning, a process in which labeled data sets are used to find correlations between the labels and the trends in that underlying data. But supervised learning is only one application of machine learning. Another broad set of machine learning The post Anyscale with Ion Stoica appeared first on Software Engineering Daily.

Duration:00:56:51

Flink and BEAM Stream Processing with Maximilian Michels

2/12/2020
Distributed stream processing systems are used to read large volumes of data and perform operations across those data streams. These stream processing systems often build off of the MapReduce algorithm for collecting and aggregating large volumes of data, but instead of processing a calculation over a single large batch of data, they process data on The post Flink and BEAM Stream Processing with Maximilian Michels appeared first on Software Engineering Daily.

Duration:00:51:14

Druid Analytics with Jad Naous

2/11/2020
Large companies generate large volumes of data. This data gets dumped into a data lake for long-term storage, then pulled into memory for processing and analysis. Once it is in memory, it is often read into a dashboard, which presents a human with a visualization of the data. The end-user who is consuming this data The post Druid Analytics with Jad Naous appeared first on Software Engineering Daily.

Duration:00:56:50

The Data Exchange with Ben Lorica

2/10/2020
Data infrastructure has been transformed over the last fifteen years. The open source Hadoop project led to the creation of multiple companies based around commercializing the MapReduce algorithm and Hadoop distributed file system. Cheap cloud storage popularized the usage of data lakes. Cheap cloud servers led to wide experimentation for data tools. Apache Spark emerged The post The Data Exchange with Ben Lorica appeared first on Software Engineering Daily.

Duration:01:08:35

Presto with Justin Borgman

2/7/2020
A data platform contains all of the data that a company has accumulated over the years. Across a data platform, there is a multitude of data sources: databases, a data lake, data warehouses, a distributed queue like Kafka, and external data sources like Salesforce and Zendesk. A user of the data platform often has a The post Presto with Justin Borgman appeared first on Software Engineering Daily.

Duration:01:16:18

Nubank Data Engineering with Sujith Nair

2/6/2020
Nubank is a popular bank that is based in Brazil. Nubank has more than 20 million customers, and has accumulated a high volume of data over the six years since it was started. Mobile computing and cloud computing have given rise to “challenger banks” that operate more like software companies. When a software company reaches The post Nubank Data Engineering with Sujith Nair appeared first on Software Engineering Daily.

Duration:01:04:55

Changelog Podcasting with Adam Stacoviak and Jerod Santo

2/5/2020
The Changelog is a podcast about the world of open source. As open source has become closely tied with the entire software development lifecycle, The Changelog has expanded its coverage to the broader software industry. Since starting the podcast ten years ago, Adam Stacoviak and Jerod Santo have become full-time podcasters, and they have started The post Changelog Podcasting with Adam Stacoviak and Jerod Santo appeared first on Software Engineering Daily.

Duration:01:15:44

Rive: Animation Tooling with Guido and Luigi Rosso

2/4/2020
Animations can be used to create games, app tutorials, and user interface components. Animations can be seen in messaging apps, where animated reactions can convey rich feelings over a text interface. Loading screens can become less boring through animation, and voice assistant products can feel more alive through animation. But we still don’t see much The post Rive: Animation Tooling with Guido and Luigi Rosso appeared first on Software Engineering Daily.

Duration:01:22:09

John Deere: Farm Software with Ryan Bergman

2/3/2020
Robotics has changed modern agriculture. Autonomous systems are powering the tractors, cotton pickers, and corn cutters that yield plants at industrial scale. John Deere is a company that has been making farm equipment for 183 years. Over that period, the planting and harvesting process has become increasingly mechanized, and John Deere has been at the The post John Deere: Farm Software with Ryan Bergman appeared first on Software Engineering Daily.

Duration:01:02:34