article thumbnail

Interpreting A/B test results: false negatives and power

The Netflix TechBlog

Martin Tingley with Wenjing Zheng , Simon Ejdemyr , Stephanie Lane , and Colin McFarland This is the fourth post in a multi-part series on how Netflix uses A/B tests to inform decisions and continuously innovate on our products. the difference in metric values between Groups A and B?—?the Need to catch up? Sample size.

Testing 202
article thumbnail

Service level objectives: 5 SLOs to get started

Dynatrace

Certain SLOs can help organizations get started on measuring and delivering metrics that matter. But the pressure on CIOs to innovate faster comes at a cost. Fitness app : The fitness app should offer a response time of less than 500 milliseconds for exercise tracking and data recording.

Latency 177
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

Interpreting A/B test results: false positives and statistical significance

The Netflix TechBlog

Martin Tingley with Wenjing Zheng , Simon Ejdemyr , Stephanie Lane , and Colin McFarland This is the third post in a multi-part series on how Netflix uses A/B tests to inform decisions and continuously innovate on our products. To build intuition, let’s run through a thought exercise. Need to catch up?

Testing 226
article thumbnail

Seven benefits of AIOps to transform your business operations

Dynatrace

Increased business innovation. If IT teams spend the bulk of their time responding to alerts and dealing with false positives, there’s little time for innovation. But AIOps also improves metrics that matter to the bottom line. million per year by automating key processes. Expanded collaboration.

article thumbnail

Service level objective examples: 5 SLO examples for faster, more reliable apps

Dynatrace

Certain service-level objective examples can help organizations get started on measuring and delivering metrics that matter. But the pressure on CIOs to innovate faster comes at a cost. Fitness app : The fitness app should offer a response time of less than 500 milliseconds for exercise tracking and data recording.

Traffic 170
article thumbnail

AWS and Dynatrace automation hit the jackpot at Perform Las Vegas

Dynatrace

Across the two days, there were sixteen new sessions – delivered for the first time – based on content derived from lab exercises developed and delivered by working with Dynatrace experts and our Partner communicate to showcase Dynatrace’s newest features. Dynatrace AWS monitoring with CloudWatch metrics and metadata.

AWS 164
article thumbnail

PMM Is Getting a Modernized Enterprise-Grade Foundation

Percona

or higher for a client, metrics will accumulate on the client automatically up to 1GB before any gaps in metrics appear once complete. or higher for a client, metrics will accumulate on the client automatically up to 1GB before any gaps in metrics appear once complete. If you’re running PMM 2.32.0