article thumbnail

Data Engineers of Netflix?—?Interview with Samuel Setegne

The Netflix TechBlog

Data Engineers of Netflix?—?Interview Interview with Samuel Setegne Samuel Setegne This post is part of our “Data Engineers of Netflix” interview series, where our very own data engineers talk about their journeys to Data Engineering @ Netflix. What drew you to Netflix?

article thumbnail

Bringing Software Engineering Rigor to Data

DZone

This talk covers ways to leverage software engineering practices for data engineering and demonstrates how measuring key performance metrics could help build more robust and reliable data pipelines.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

Ready-to-go sample data pipelines with Dataflow

The Netflix TechBlog

The most commonly used one is dataflow project , which helps folks in managing their data pipeline repositories through creation, testing, deployment and few other activities. It lets you create YAML formatted mock data files based on selected tables, columns and a few rows of data from the Netflix data warehouse.

article thumbnail

Data pipeline asset management with Dataflow

The Netflix TechBlog

any business logic code in a raw (e.g. JAR) form to be executed as part of the user defined data pipeline. data pipeline ?—?a DAG) for the purpose of transforming data using some business logic. Or what if Alice wanted to add new backup functionality and she accidentally broke existing code while updating it?

Storage 201
article thumbnail

Experimentation is a major focus of Data Science across Netflix

The Netflix TechBlog

Here we describe the role of Experimentation and A/B testing within the larger Data Science and Engineering organization at Netflix, including how our platform investments support running tests at scale while enabling innovation. Curious to learn about what it’s like to be a Data Engineer at Netflix?

article thumbnail

What is IT automation?

Dynatrace

IT automation is the practice of using coded instructions to carry out IT tasks without human intervention. At its most basic, automating IT processes works by executing scripts or procedures either on a schedule or in response to particular events, such as checking a file into a code repository. Testing automation can be painstaking.

article thumbnail

Reimagining Experimentation Analysis at Netflix

The Netflix TechBlog

Toby Mao , Sri Sri Perangur , Colin McFarland Another day, another custom script to analyze an A/B test. You can look at ABlaze (our centralized A/B testing platform) and take a quick look at how it’s performing. At any point a Netflix user is in many different A/B tests orchestrated through ABlaze. Not at Netflix.

Metrics 215