article thumbnail

What is an A/B Test?

The Netflix TechBlog

Martin Tingley with Wenjing Zheng , Simon Ejdemyr , Stephanie Lane , and Colin McFarland This is the second post in a multi-part series on how Netflix uses A/B tests to inform decisions and continuously innovate on our products. An A/B test is a simple controlled experiment. Figure 2: A simple A/B test. Let’s say?—?this

Testing 245
article thumbnail

A Survey of Causal Inference Applications at Netflix

The Netflix TechBlog

At Netflix, we want to entertain the world through creating engaging content and helping members discover the titles they will love. To measure causal effects we rely heavily on AB testing , but we also leverage quasi-experimentation in cases where AB testing is limited.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

What is chaos engineering?

Dynatrace

Testing for mishaps you can predict is essential. Chaos engineering is a method of testing distributed software that deliberately introduces failure and faulty scenarios to verify its resilience in the face of random disruptions. Practitioners subject software to a controlled, simulated crisis to test for unstable behavior.

article thumbnail

What is web application security? Everything you need to know.

Dynatrace

Then I will describe various types of security products that can be used for web application security including some innovations that Dynatrace has recently introduced. Examples range from online banking to personal entertainment delivery and e-commerce. WAF appliances have seen little innovation during the past four years.”.

article thumbnail

A Day in the Life of an Experimentation and Causal Inference Scientist @ Netflix

The Netflix TechBlog

We use A/B tests to introduce new product features, such as our daily Top 10 row that help our members discover their next favorite show. Our experimentation and causal inference focused data scientists help shape business decisions, product innovations, and engineering improvements across our service.

Analytics 207
article thumbnail

Native Frame Rate Playback

The Netflix TechBlog

by Akshay Garg , Roger Quero Introduction Maximizing immersion for our members is an important goal for the Netflix product and engineering teams to keep our members entertained and fully engaged in our content.

article thumbnail

Ciao Milano! – An AWS Region is coming to Italy!

All Things Distributed

We needed to serve our growing base of startup, government, and enterprise customers across many vertical industries, including automotive, financial services, media and entertainment, high technology, education, and energy. By moving to AWS, Lamborghini was able to prepare the development and test environment in a couple of days.

AWS 167