article thumbnail

Interpreting A/B test results: false negatives and power

The Netflix TechBlog

We then used simple thought exercises based on flipping coins to build intuition around false positives and related concepts such as statistical significance, p-values, and confidence intervals. As a result, if the test treatment results in a small reduction in the latency metric, it’s hard to successfully identify?

Testing 202
article thumbnail

Seamlessly Swapping the API backend of the Netflix Android app

The Netflix TechBlog

How we migrated our Android endpoints out of a monolith into a new microservice by Rohan Dhruva , Ed Ballot As Android developers, we usually have the luxury of treating our backends as magic boxes running in the cloud, faithfully returning us JSON. It was a Node.js Java…Script?

Latency 233
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

Bring Your Own Cloud (BYOC) vs. Dedicated Hosting at ScaleGrid

Scalegrid

Deploying your application and database on the same VPC also provides the lowest possible latency path. This is especially apparent in the enterprise space, as these organizations have teams of database administrators managing their deployments and require the freedom to exercise their internal expertise over their clusters.

Cloud 242
article thumbnail

COVID-19 Hazard Analysis using STPA

Adrian Cockcroft

There are many possible failure modes, and each exercises a different aspect of resilience. They could do things in the wrong order, like developing a custom test for the virus rather than using the one that’s already available. Memorial at Hawaiian native burial ground, Kapalua, Maui. What Happens Next?

article thumbnail

Service level objective examples: 5 SLO examples for faster, more reliable apps

Dynatrace

Five SLO examples for faster, more reliable apps Once you get started with these service-level objective examples, you can branch out to develop more targeted SLOs suited for your business. Fitness app : The fitness app should offer a response time of less than 500 milliseconds for exercise tracking and data recording.

Traffic 174
article thumbnail

Real user monitoring vs. synthetic monitoring: Understanding best practices

Dynatrace

These development and testing practices ensure the performance of critical applications and resources to deliver loyalty-building user experiences. This includes development, user acceptance testing, beta testing, and general availability. connectivity, access, user count, latency) of geographic regions. The bottom line?

article thumbnail

The Agile PMO: Consistent Project Gatekeepers

The Agile Manager

Traditional IT projects are mass economy-of-scale exercises: once development begins, armies of developers are unleashed. So in Traditional IT we stage large volumes of work to keep the largest and most expensive pool of people – developers – busy in the hopes of maximizing their productive effort.

Latency 40