article thumbnail

What is an A/B Test?

The Netflix TechBlog

Martin Tingley with Wenjing Zheng , Simon Ejdemyr , Stephanie Lane , and Colin McFarland This is the second post in a multi-part series on how Netflix uses A/B tests to inform decisions and continuously innovate on our products. We wait, and we then compare the values of a variety of metrics from Group A to those from Group B.

Testing 245
article thumbnail

Experimentation is a major focus of Data Science across Netflix

The Netflix TechBlog

Here we describe the role of Experimentation and A/B testing within the larger Data Science and Engineering organization at Netflix, including how our platform investments support running tests at scale while enabling innovation. Growth Advertising At Netflix, we want to entertain the world ! Curious to learn more?

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

Rising Tide Rents and Robber Baron Rents

O'Reilly

Patents—exclusive, government-granted rights intended to encourage innovation—protect pharmaceutical companies from competition and allow them to charge high prices. They are a price that we pay for a rising tide of innovation. What Is Economic Rent? For example, consider drug pricing. But not all rents represent abuse of power.

article thumbnail

Supporting content decision makers with machine learning

The Netflix TechBlog

To mitigate this uncertainty, executives throughout the entertainment industry have always consulted historical data to help characterize the potential audience of a title using comparable titles, if they exist. These considerations are key in informing subsequent lines of research and innovation. box office, Nielsen ratings).

article thumbnail

A Day in the Life of an Experimentation and Causal Inference Scientist @ Netflix

The Netflix TechBlog

Our experimentation and causal inference focused data scientists help shape business decisions, product innovations, and engineering improvements across our service. We worked in different industries before joining Netflix, including tech, entertainment, retail, science policy, and research. Roxy Du (Product Innovation) [Roxy D.]

Analytics 207
article thumbnail

Page Simulator

The Netflix TechBlog

Page Simulation for Better Offline Metrics at Netflix by David Gevorkyan , Mehmet Yilmaz , Ajinkya More , Gaurav Agrawal , Richard Wellington , Vivek Kaushal , Prasanna Padmanabhan , Justin Basilico At Netflix, we spend a lot of effort to make it easy for our members to find content they will love.

Metrics 124
article thumbnail

Page Simulator

The Netflix TechBlog

Page Simulation for Better Offline Metrics at Netflix by David Gevorkyan , Mehmet Yilmaz , Ajinkya More , Gaurav Agrawal , Richard Wellington , Vivek Kaushal , Prasanna Padmanabhan , Justin Basilico At Netflix, we spend a lot of effort to make it easy for our members to find content they will love.

Metrics 100