The Netflix TechBlog

JUNE 14, 2023

So, we relied on higher-level metrics-based testing: AB Testing and Sticky Canaries. To determine customer impact, we could compare various metrics such as error rates, latencies, and time to render. Wins High-Level Health Metrics: AB Testing provided the assurance we needed in our overall client-side GraphQL implementation.

Traffic 353

Traffic Latency Cache Metrics 353

The Netflix TechBlog

NOVEMBER 9, 2022

At Netflix, we periodically reevaluate our workloads to optimize utilization of available capacity. to a larger AWS instance size, from m5.4xl (16 vCPUs) to m5.12xl (48 vCPUs). What’s worse, average latency degraded by more than 50%, with both CPU and latency patterns becoming more “choppy.” let’s call it GS2?—?to

Hardware 363

Hardware Cache Performance Latency 363

Dynatrace

SEPTEMBER 29, 2020

At Dynatrace we host most of our Dynatrace SaaS clusters for paying customers as well as trial users in the Amazon Web Services (AWS) cloud. Since we moved to AWS in May 2014 we have had an availability of 99.95%! Sydney, we have a disk write latency problem!

Infrastructure 182

Infrastructure Cloud Monitoring AWS 182

Dynatrace

JANUARY 26, 2021

AWS Lambda functions are an example of how a serverless framework works: Developers write a function in a supported language or platform. Every time the trigger executes, the function runs on an available resource. When an application is triggered, it can cause latency as the application starts. Pay Per Use.

Serverless 245

Serverless Efficiency Lambda Azure 245

The Netflix TechBlog

NOVEMBER 22, 2019

by Shefali Vyas Dalal AWS re:Invent is a couple weeks away and our engineers & leaders are thrilled to be in attendance yet again this year! To sustain this data growth at Netflix, it has deployed open-source software Ceph using AWS services to achieve the required SLOs of some of the post-production workflows.

AWS 100

AWS Entertainment Open Source Benchmarking 100

The Netflix TechBlog

NOVEMBER 22, 2019

by Shefali Vyas Dalal AWS re:Invent is a couple weeks away and our engineers & leaders are thrilled to be in attendance yet again this year! To sustain this data growth at Netflix, it has deployed open-source software Ceph using AWS services to achieve the required SLOs of some of the post-production workflows.

AWS 100

AWS Entertainment Open Source Benchmarking 100

The Netflix TechBlog

MARCH 7, 2024

These integrations are implemented through Metaflow’s extension mechanism which is publicly available but subject to change, and hence not a part of Metaflow’s stable API yet. Compute: Titus Whereas open-source users of Metaflow rely on AWS Batch or Kubernetes as the compute backend , we rely on our centralized compute-platform, Titus.

Systems 226

Systems Media Cache Open Source 226

Scalegrid

DECEMBER 16, 2019

While you may assume a great majority of the cloud database deployments are run on AWS, Azure, or Google Cloud Platform, small to medium-sized businesses in particular are gravitating towards the developer-friendly cloud provider, DigitalOcean , for their hosting for MongoDB® needs. DigitalOcean Advantages for MongoDB. DigitalOcean Droplets.

Azure 187

Azure AWS Latency Database 187

Scalegrid

APRIL 16, 2020

Each of these models is suitable for production deployments and high traffic applications, and are available for all of our supported databases, including MySQL , PostgreSQL , Redis™ and MongoDB® database ( Greenplum® database coming soon). AWS , Azure. AWS , Azure. AWS , Azure. AWS , Azure. AWS , Azure.

Cloud 242

Cloud Azure AWS Database 242

Dynatrace

MAY 17, 2023

Making applications observable—relying on metrics, logs, and traces to understand what software is doing and how it’s performing—has become increasingly important as workloads are shifting to multicloud environments. We also introduced our demo app and explained how to define the metrics and traces it uses. What is OneAgent?

Metrics 176

Metrics Monitoring Database Network 176

The Netflix TechBlog

FEBRUARY 20, 2019

by Jason Koch , with Martin Spier , Brendan Gregg , Ed Hunter Improving the tools available to our engineers to help them diagnose, triage, and work through software performance challenges in the cloud is a key goal for the cloud performance engineering team at Netflix. 10–20 MB/sec (it is, unsurprisingly, receiving lots of data).

Performance 211

Performance Latency Open Source Metrics 211

Percona

JULY 1, 2023

Now that Database-as-a-service (DBaaS) is in high demand, there are multiple questions regarding AWS services that cannot always be answered easily: When should I use Aurora and when should I use RDS MySQL ? These may be performance, high availability, operational cost, management, capacity planning, scalability, security, monitoring, etc.

AWS 52

AWS Database Serverless Storage 52

Percona

NOVEMBER 3, 2023

Rather than listing the concepts, function calls, etc, available in Citus, which frankly is a bit boring, I’m going to explore scaling out a database system starting with a single host. I won’t cover all the features but show just enough that you’ll want to see more of what you can learn to accomplish for yourself.

Database 102

Database Benchmarking Latency C++ 102

The Netflix TechBlog

AUGUST 16, 2023

It seems like a minor change, but it had to be seamlessly integrated into our existing metrics and connection bookkeeping. Service mesh being available on many services made testing and rolling out this feature very easy because it enables ALPN by default. Subsetting Success The results were outstanding.

Traffic 170

Traffic Servers Google Metrics 170

The Netflix TechBlog

FEBRUARY 18, 2022

Scaling Policies To address the thundering herd problem and to keep latencies under acceptable thresholds, the cluster scale-up policies are configured to be more aggressive than the scale-down policies. Event Priority Based Clusters AWS Instance Clusters that subscribe to the corresponding queues with the same priority.

Systems 334

Systems Traffic Architecture Mobile 334

The Netflix TechBlog

AUGUST 22, 2019

Once the instance was available, the engineer would use a remote administration tool like RDP to login to the instance to install software and customize settings. Packer requires specific information for your baking environment and extensive AWS IAM permissions. This means changes can be tracked and reviewed like any other code change.

DevOps 207

DevOps AWS Tuning Infrastructure 207

Scalegrid

MARCH 14, 2024

Providers such as AWS Outposts, Microsoft Azure Stack, Google Anthos, and VMware Cloud on AWS offer compatible private clouds that integrate seamlessly with established public cloud platforms — a key feature for constructing hybrid cloud systems.

Strategy 130

Strategy Cloud Artificial Intelligence Infrastructure 130

The Netflix TechBlog

AUGUST 13, 2020

A metric crossed a threshold. Metrics are a key part of understanding application health. But sometimes you can have too many metrics, too many graphs, and too many dashboards. It usually has dependencies, talks to other services, and lives in different AWS regions. Client metrics and QoE changes. By Andrei U.,

Monitoring 210

Monitoring Tuning Traffic Metrics 210

Adrian Cockcroft

AUGUST 1, 2022

photo by Adrian I gave a talk at Monitorama in Portland Oregon in June, which set out the idea that carbon is just another metric to monitor, and that in a few years most of the monitoring and performance tuning tools are going to be reporting and optimizing for carbon alongside latency, throughput, availability and cost.

AWS 52

AWS Virtualization DevOps Latency 52

Dynatrace

JULY 10, 2019

Dynatrace monitors your full stack and offers you thousands of metrics with almost zero configuration. This article we help distinguish between process metrics, external metrics and PurePaths (traces). OneAgent & application metrics. OneAgent & cloud metrics. Dynatrace news.

Java 140

Java Best Practices Metrics Azure 140

Speed Curve

FEBRUARY 5, 2024

However, that pesky 20% on the back end can have a big impact on downstream metrics like First Contentful Paint (FCP), Largest Contentful Paint (LCP), and any other 'loading' metric you can think of. Latency – How much time does it take to deliver a packet from A to B. That performance golden rule still holds true today.

Servers 57

Servers Cache Retail Benchmarking 57

All Things Distributed

JUNE 21, 2018

As I have talked about before, one of the reasons why we built Amazon DynamoDB was that Amazon was pushing the limits of what was a leading commercial database at the time and we were unable to sustain the availability, scalability, and performance needs that our growing Amazon.com business demanded. The opposite is true.

Database 167

Database AWS Games Latency 167

The Netflix TechBlog

NOVEMBER 22, 2019

by Shefali Vyas Dalal AWS re:Invent is a couple weeks away and our engineers & leaders are thrilled to be in attendance yet again this year! To sustain this data growth at Netflix, it has deployed open-source software Ceph using AWS services to achieve the required SLOs of some of the post-production workflows.

AWS 37

AWS Entertainment Open Source Benchmarking 37

Smashing Magazine

AUGUST 3, 2023

Google’s Core Web Vitals is a set of performance metrics that site owners can use to evaluate performance and diagnose performance issues. These metrics provide a different perspective on user experience: Largest Contentful Paint (LCP) Measures the time it takes for the main content on a webpage to load. One of the key Next.js

Performance 74

Performance Cache Traffic Metrics 74

All Things Distributed

JULY 20, 2015

A cluster is just a pool of compute resources available to a customer’s applications. The agent is written in Go, has a minimal footprint, and is available on GitHub under an Apache license. This architecture affords Amazon ECS high availability, low latency, and high throughput because the data store is never pessimistically locked.

Latency 166

Latency Architecture AWS Open Source 166

All Things Distributed

NOVEMBER 26, 2013

As I discussed in my re:Invent keynote earlier this month, I am now happy to announce the immediate availability of Amazon RDS Cross Region Read Replicas , which is another important enhancement for our customers using or planning to use multiple AWS Regions to deploy their applications.

Cloud 145

Cloud AWS Traffic Latency 145

Adrian Cockcroft

APRIL 5, 2023

This proposal seeks to define a standard for real-time carbon and energy data as time-series data that would be accessed alongside and synchronized with the existing throughput, utilization and latency metrics that are provided for the components and applications in computing environments.

Energy 52

Energy Metrics Cloud Operating System 52

All Things Distributed

APRIL 9, 2015

Amazon ML uses powerful algorithms that can help you create machine learning models by finding patterns in existing data, and using these patterns to make predictions from new data as it becomes available. Details on the AWS Blog. AWS has been offering a range of storage solutions: objects, block storage, databases, archiving, etc.

Lambda 122

Lambda Cloud IoT AWS 122

All Things Distributed

JANUARY 18, 2012

It is very gratifying to see all of our learning and experience become available to our customers in the form of an easy-to-use managed service. Amazon DynamoDB offers low, predictable latencies at any scale. It provides multi-data center replication, high availability, and offers rock-solid durability.

Scalability 167

Scalability Database Ecommerce Latency 167

All Things Distributed

SEPTEMBER 3, 2013

Choosing your database architecture may be the most critical decision you’ll make and has a disproportionate impact on the performance, scalability, and availability of your app. Get it right and your application will seamlessly scale from hundreds to tens of millions of users without difficulty, while remaining performant and available.

Cache 129

Cache Cloud Performance Retail 129

Adrian Cockcroft

APRIL 18, 2018

In reality, in any non-trivial installation, there are multiple tools collecting, storing and displaying overlapping sets of metrics from many types of systems and different levels of abstraction. What happens if you have several monitoring systems and they disagree on a critical metric like CPU load or Network throughput?

Monitoring 40

Monitoring Systems Virtualization Metrics 40

Adrian Cockcroft

NOVEMBER 11, 2019

Collecting some critical metrics at one second intervals, with a total observability latency of ten seconds or less matches the human attention span much better. This is why most AWS regions have three availability zones. Try to measure your mean time to respond (MTTR) for incidents.

Latency 52

Latency Engineering Systems Hardware 52

Adrian Cockcroft

NOVEMBER 11, 2019

Collecting some critical metrics at one second intervals, with a total observability latency of ten seconds or less matches the human attention span much better. This is why most AWS regions have three availability zones. Try to measure your mean time to respond (MTTR) for incidents.

Latency 53

Latency Engineering Systems Hardware 53

Smashing Magazine

JANUARY 11, 2021

LogRocket tracks key metrics, incl. Getting Ready: Planning And Metrics Performance culture, Core Web Vitals, performance profiles, CrUX, Lighthouse, FID, TTI, CLS, devices. Getting Ready: Planning And Metrics. DOM complete, time to first byte, first input delay, client CPU and memory usage. Get a free trial of LogRocket today.

Performance 145

Performance Cache Media Metrics 145

Smashing Magazine

JANUARY 6, 2020

Getting Ready: Planning And Metrics. Getting Ready: Planning And Metrics. You need a business stakeholder buy-in, and to get it, you need to establish a case study, or a proof of concept using the Performance API on how speed benefits metrics and Key Performance Indicators ( KPIs ) they care about. Table Of Contents. Quick Wins.

Performance 145

Performance Cache Network Metrics 145

The Morning Paper

MAY 28, 2019

We don’t talk about energy as often as we probably should on this blog, but it’s certainly true that our data centres and various IT systems consume an awful lot of it. So it’s interesting to see a paper using nano-Joules per prediction as an evaluation metric. Introducing race logic. Race logic encodes values by delaying signals.

Energy 52

Energy Hardware Efficiency Architecture 52

Smashing Magazine

JANUARY 7, 2019

Getting Ready: Planning And Metrics. Getting Ready: Planning And Metrics. You need a business stakeholder buy-in, and to get it, you need to establish a case study on how speed benefits metrics and Key Performance Indicators ( KPIs ) they care about. Table Of Contents. Setting Realistic Goals. Defining The Environment.

Performance 104

Performance Cache Network Metrics 104