article thumbnail

What is an A/B Test?

The Netflix TechBlog

Martin Tingley with Wenjing Zheng , Simon Ejdemyr , Stephanie Lane , and Colin McFarland This is the second post in a multi-part series on how Netflix uses A/B tests to inform decisions and continuously innovate on our products. An A/B test is a simple controlled experiment. Figure 2: A simple A/B test. Let’s say?—?this

Testing 245
article thumbnail

What is chaos engineering?

Dynatrace

Testing for mishaps you can predict is essential. Chaos engineering is a method of testing distributed software that deliberately introduces failure and faulty scenarios to verify its resilience in the face of random disruptions. Practitioners subject software to a controlled, simulated crisis to test for unstable behavior.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

A Survey of Causal Inference Applications at Netflix

The Netflix TechBlog

At Netflix, we want to entertain the world through creating engaging content and helping members discover the titles they will love. To measure causal effects we rely heavily on AB testing , but we also leverage quasi-experimentation in cases where AB testing is limited.

article thumbnail

Native Frame Rate Playback

The Netflix TechBlog

by Akshay Garg , Roger Quero Introduction Maximizing immersion for our members is an important goal for the Netflix product and engineering teams to keep our members entertained and fully engaged in our content.

article thumbnail

Netflix Public Bug Bounty, 1 year later

The Netflix TechBlog

by Astha Singhal (Netflix Application Security) As Netflix continues to create entertainment people love, the security team continues to keep our members, partners, and employees secure. The system had significant issues that we were grateful to hear about so we could retire the system.

article thumbnail

Designing Human-Machine Interfaces For Vehicles Of The Future

Smashing Magazine

A human-machine interface (HMI) is an interface that allows us to interact with a digital system. No matter what HMI we design, we need to allow users to take advantage of all that a system has to offer. One of the earliest examples of such systems was introduced in the 1986 Buick Riviera. Nick Babich & Gleb Kuznetsov.

Design 106
article thumbnail

HDMI?—?Scaling Netflix Certification

The Netflix TechBlog

Our first step towards addressing this challenge is to actively engineer the removal of manual and subjective testing approaches across different functional touch points of the Netflix application on a streaming device. Why test High Definition Multimedia Interface (HDMI) ?

Media 163