The Netflix TechBlog

SEPTEMBER 22, 2021

Martin Tingley with Wenjing Zheng , Simon Ejdemyr , Stephanie Lane , and Colin McFarland This is the second post in a multi-part series on how Netflix uses A/B tests to inform decisions and continuously innovate on our products. An A/B test is a simple controlled experiment. Figure 2: A simple A/B test. Let’s say?—?this

Testing 245

Testing Entertainment Metrics Social Media 245

Dynatrace

OCTOBER 28, 2021

Testing for mishaps you can predict is essential. Chaos engineering is a method of testing distributed software that deliberately introduces failure and faulty scenarios to verify its resilience in the face of random disruptions. Practitioners subject software to a controlled, simulated crisis to test for unstable behavior.

Engineering 221

Engineering Entertainment Cloud Infrastructure 221

All Things Distributed

NOVEMBER 13, 2018

Currently we have 57 Availability Zones across 19 technology infrastructure Regions. We needed to serve our growing base of startup, government, and enterprise customers across many vertical industries, including automotive, financial services, media and entertainment, high technology, education, and energy.

AWS 167

AWS Energy Automotive Traffic 167

The Netflix TechBlog

MARCH 2, 2021

We use A/B tests to introduce new product features, such as our daily Top 10 row that help our members discover their next favorite show. Our experimentation and causal inference focused data scientists help shape business decisions, product innovations, and engineering improvements across our service.

Analytics 207

Analytics C++ Innovation Engineering 207

The Netflix TechBlog

FEBRUARY 16, 2021

By Budhaditya Das , Wallace Wang , and Scott Yao At Netflix, we aspire to entertain the world. However, with our rapid product innovation speed, the whole approach experienced significant challenges: Business Complexity: The existing SKU management solution was designed years ago when the engagement rules were simple?

Mobile 209

Mobile Engineering Infrastructure Scalability 209

The Netflix TechBlog

NOVEMBER 12, 2019

While a diverse set of algorithms working together can produce a great outcome, innovating on such a complex system can be difficult. One way to do this is by running A/B tests. Netflix typically A/B tests all changes before rolling them out to all members. Some examples of stratification types are: Country?

Metrics 124

Metrics Government Systems Testing 124

The Netflix TechBlog

NOVEMBER 12, 2019

While a diverse set of algorithms working together can produce a great outcome, innovating on such a complex system can be difficult. One way to do this is by running A/B tests. Netflix typically A/B tests all changes before rolling them out to all members. Some examples of stratification types are: Country?

Metrics 100

Metrics Government Systems Testing 100