The Netflix TechBlog

MARCH 7, 2024

Example use case: Content Knowledge Graph Our knowledge graph of the entertainment world encodes relationships between titles, actors and other attributes of a film or series, supporting all aspects of business at Netflix. In other cases, it is more convenient to share the results via a low-latency API.

Systems 226

Systems Media Cache Open Source 226

Scalegrid

APRIL 16, 2020

Each of these models is suitable for production deployments and high traffic applications, and are available for all of our supported databases, including MySQL , PostgreSQL , Redis™ and MongoDB® database ( Greenplum® database coming soon). AWS , Azure. AWS , Azure. AWS , Azure. AWS , Azure. AWS , Azure.

Cloud 242

Cloud Azure AWS Database 242

Dynatrace

MAY 17, 2023

Think about items such as general system metrics (for example, CPU utilization, free memory, number of services), the connectivity status, details of our web server, or even more granular in-application tasks like database queries. Let’s take our previous screenshot as an example.

Metrics 168

Metrics Monitoring Database Network 168

Dynatrace

SEPTEMBER 30, 2021

Cloud services platforms like AWS, Azure, and GCP are reshaping how organizations deliver value to their customers, making cloud migration an increasingly attractive option for running applications. In case of a spike in traffic, you can automatically spin up more resources, often in a matter of seconds.

Cloud 163

Cloud Traffic Best Practices Strategy 163

Percona

JULY 1, 2023

Now that Database-as-a-service (DBaaS) is in high demand, there are multiple questions regarding AWS services that cannot always be answered easily: When should I use Aurora and when should I use RDS MySQL ? Amazon Aurora is a proprietary, cloud-native, fully managed relational database service developed by Amazon Web Services (AWS).

AWS 52

AWS Database Serverless Storage 52

The Netflix TechBlog

OCTOBER 19, 2020

a Netflix member via Twitter This is an example of a question our on-call engineers need to answer to help resolve a member issue?—?which Using simple lookup indices in Cassandra gives us the ability to maintain acceptable read latencies while doing heavy writes. which is difficult when troubleshooting distributed systems.

Infrastructure 233

Infrastructure Transportation Storage Open Source 233

Smashing Magazine

AUGUST 3, 2023

It increases our visibility and enables us to draw a steady stream of organic (or “free”) traffic to our site. While paid marketing strategies like Google Ads play a part in our approach as well, enhancing our organic traffic remains a major priority. The higher our organic traffic, the more profitable we become as a company.

Performance 74

Performance Cache Traffic Metrics 74

The Netflix TechBlog

NOVEMBER 22, 2019

by Shefali Vyas Dalal AWS re:Invent is a couple weeks away and our engineers & leaders are thrilled to be in attendance yet again this year! Netflix shares how Amazon EC2 Auto Scaling allows its infrastructure to automatically adapt to changing traffic patterns in order to keep its audience entertained and its costs on target.

AWS 37

AWS Entertainment Open Source Benchmarking 37

Speed Curve

FEBRUARY 5, 2024

Latency – How much time does it take to deliver a packet from A to B. For example, processing of web application firewall (WAF) rules, detecting bots or other malicious traffic though security services, and growing in popularity, edge compute. Below are some examples from the major CDN providers that you can leverage.

Servers 57

Servers Cache Retail Benchmarking 57

All Things Distributed

NOVEMBER 26, 2013

As I discussed in my re:Invent keynote earlier this month, I am now happy to announce the immediate availability of Amazon RDS Cross Region Read Replicas , which is another important enhancement for our customers using or planning to use multiple AWS Regions to deploy their applications. Cross Region Read Replicas are available for MySQL 5.6

Cloud 145

Cloud AWS Traffic Latency 145

All Things Distributed

AUGUST 16, 2011

Expanding the Cloud - The AWS GovCloud (US) Region. Today AWS announced the launch of the AWS GovCloud (US) Region. The concept of regions gives AWS customers control over the placement of their resources and services. All Things Distributed. Werner Vogels weblog on building scalable and robust distributed systems.

AWS 111

AWS Government Big Data Cloud 111

High Scalability

JULY 20, 2018

And if you know anyone looking for a simple book that uses lots of pictures and lots of examples to explain the cloud, then please recommend my new book: Explain the Cloud Like I'm 10. Do you like this sort of Stuff? Please lend me your support on Patreon. It would mean a great deal to me. They'll love you even more.

Internet 121

Internet Internet Scalability Automotive 121

Scalegrid

JANUARY 12, 2024

Various forms can take shape when discussing workloads within the realm of cloud computing environments – examples include order management databases, collaboration tools, videoconferencing systems, virtual desktops, and disaster recovery mechanisms. What is an example of a workload? What is meant by the workload in computers?

Cloud 130

Cloud Virtualization Storage Efficiency 130

Dotcom-Montior

NOVEMBER 11, 2020

those resources now belong to cloud providers, such as AWS Lambda, Google Cloud Platform, Microsoft Azure, and others. However, when the time comes for resources to be requested, there can be latency in the time it takes to for that code to start back up. The time it takes between an action and a response is latency.

Serverless 57

Serverless Monitoring Lambda Latency 57

All Things Distributed

MARCH 11, 2013

I spent a lot of time talking to AWS developers, many working in the gaming and mobile space, and most of them have been finding Node.js allows these developers to handle a large number of concurrent connections with low latencies. Today, AWS Elastic Beanstalk just added support for Node.js Who is using Elastic Beanstalk?

AWS 102

AWS Mobile Games Java 102

The Netflix TechBlog

NOVEMBER 9, 2022

to a larger AWS instance size, from m5.4xl (16 vCPUs) to m5.12xl (48 vCPUs). A quick canary test was free of errors and showed lower latency, which is expected given that our standard canary setup routes an equal amount of traffic to both the baseline running on 4xl and the canary on 12xl. let’s call it GS2?—?to

Hardware 363

Hardware Cache Performance Latency 363

The Netflix TechBlog

JUNE 14, 2023

The control group’s traffic utilized the legacy Falcor stack, while the experiment population leveraged the new GraphQL client and was directed to the GraphQL Shim. To determine customer impact, we could compare various metrics such as error rates, latencies, and time to render.

Traffic 353

Traffic Latency Cache Metrics 353

Percona

APRIL 17, 2023

The CFQ works well for many general use cases but lacks latency guarantees. The deadline excels at latency-sensitive use cases ( like databases ), and noop is closer to no schedule at all. For example, on a 128GB memory host, this can allow up to 38.4GB of dirty pages. Two other schedulers are deadline and noop.

Best Practices 52

Best Practices Design Tuning Database 52

Percona

MAY 2, 2023

Especially if going into or out of storage types that may throttle bandwidth/network traffic. This is an example of the Backup Progress Logging mentioned above. It also supports storing the backups on filesystem and AWS S3 buckets. Many people don’t realize how long it takes to back up very large data sets. mongodb-27017.sock

Best Practices 52

Best Practices Database Storage Servers 52

Adrian Cockcroft

APRIL 18, 2018

Then also setup an external SaaS provider that’s not hosted in the same datacenter or region, and is monitoring a subset of metrics with a shorter retention period, to keep costs and traffic overheads under control. I’ve seen problematic examples in the past. The SaaS provider can then also act as a monitor for the in-house systems.

Monitoring 40

Monitoring Systems Virtualization Metrics 40

Adrian Cockcroft

NOVEMBER 11, 2019

Collecting some critical metrics at one second intervals, with a total observability latency of ten seconds or less matches the human attention span much better. Systems that have an identifiable capacity trend, for example are filling up disk space at a predictable rate, have a “time to live” (TTL) that can be calculated.

Latency 52

Latency Engineering Systems Hardware 52

Adrian Cockcroft

NOVEMBER 11, 2019

Collecting some critical metrics at one second intervals, with a total observability latency of ten seconds or less matches the human attention span much better. Systems that have an identifiable capacity trend, for example are filling up disk space at a predictable rate, have a “time to live” (TTL) that can be calculated.

Latency 53

Latency Engineering Systems Hardware 53

All Things Distributed

MARCH 26, 2018

At AWS, we don't mark many anniversaries. A concept that has changed infrastructure architecture is now at the core of both AWS and customer reliability and operations. Powering the virtual instances and other resources that make up the AWS Cloud are real physical data centers with AWS servers in them.

AWS 132

AWS Latency Lambda Architecture 132

The Symphonia

MAY 22, 2018

In the first example section I added a couple of paragraphs on “choreography over orchestration”. I also rewrote the section on Startup Latency since Cold Starts are one of the big “FUD” areas of Serverless. and products like AWS Fargate have made this distinction murkier still. Because of course it did.

Serverless 40

Serverless Architecture Lambda Azure 40

The Netflix TechBlog

NOVEMBER 3, 2022

For example, it is OK to send writes through one instance, and do reads from another one with full data read consistency guarantees. For example, a batch workflow orchestration system may create multiple jobs which are part of a single workflow execution. Kubernetes is a good example here.

Cache 224

Cache Latency Traffic Systems 224

The Netflix TechBlog

AUGUST 16, 2023

For example, a 16-core box connecting to an 800-server origin would have 12,800 connections. That’s a significant amount and certainly more than is necessary relative to the traffic on most clusters. More acutely, if a traffic spike occurs and Zuul instances scale up, it exponentially increases connections open to origins.

Traffic 170

Traffic Servers Google Metrics 170

Dynatrace

AUGUST 5, 2019

In this role, I am leading a global team that works closely with our strategic partners such as AWS, Microsoft, Google, Pivotal, Red Hat and others. Resource consumption & traffic analysis. What is the network traffic going to be between services we migrate and those that have to stay in the current data center?

Cloud 31

Cloud Traffic Database Network 31

Brendan Gregg

SEPTEMBER 5, 2017

Here's some output from my zfsdist tool, in bcc/BPF, which measures ZFS latency as a histogram on Linux: # zfsdist. Tracing ZFS operation latency. For example, although it's very minor, the /dev/*random devices were faster on Solaris last time I checked, as Linux was spending more effort on entropy for improving security. (Or,

Virtualization 76

Virtualization AWS Engineering Hardware 76

The Netflix TechBlog

FEBRUARY 18, 2022

For example, a member-triggered event such as “ change in a profile’s maturity level” should have a much higher priority than a “ system diagnostic signal”. We thus assigned a priority to each use case and sharded event traffic by routing to priority-specific queues and the corresponding event processing clusters.

Systems 334

Systems Traffic Architecture Mobile 334

Smashing Magazine

JANUARY 11, 2021

For example, to make performance more tangible, you could expose the revenue performance impact by showing the correlation between the conversion rate and time to application load, as well as rendering performance. Run performance experiments and measure outcomes — both on mobile and on desktop (for example, with Google Analytics ).

Performance 145

Performance Cache Media Metrics 145

The Netflix TechBlog

AUGUST 13, 2020

We also highlight interesting broader events such as regional traffic evacuations and nearby deployments , information that is vital to understanding health holistically. It usually has dependencies, talks to other services, and lives in different AWS regions. Regional traffic evacuations. Especially during an incident.

Monitoring 210

Monitoring Tuning Traffic Metrics 210

The Netflix TechBlog

DECEMBER 17, 2019

Nonetheless, we found a number of limitations that could not satisfy our requirements e.g. stalling the processing of log events until a dump is complete, missing ability to trigger dumps on demand, or implementations that block write traffic by using table locks. Blocking write traffic by locking tables. Writing events to any output.

Database 197

Database Traffic Transportation Open Source 197

The Netflix TechBlog

DECEMBER 17, 2019

Nonetheless, we found a number of limitations that could not satisfy our requirements e.g. stalling the processing of log events until a dump is complete, missing ability to trigger dumps on demand, or implementations that block write traffic by using table locks. Blocking write traffic by locking tables. Writing events to any output.

Database 212

Database Traffic Transportation Open Source 212

All Things Distributed

MARCH 11, 2016

The epoch of AWS is the launch of Amazon S3 on March 14, 2006, now almost 10 years ago. Given that AWS is a pioneer in building and operating these services world-wide, these lessons have been of crucial importance to our business. AWS helps its customers do this too. Build security in from the ground up.

AWS 144

AWS Hardware Retail Virtualization 144

Smashing Magazine

JANUARY 7, 2019

One way or another, rather than focusing on full page loading time (via onLoad and DOMContentLoaded timings, for example), prioritize page loading as perceived by your customers. For Mac OS, we can use Network Link Conditioner , for Windows Windows Traffic Shaper , for Linux netem , and for FreeBSD dummynet. Large preview ).

Performance 103

Performance Cache Metrics Network 103

Smashing Magazine

JANUARY 6, 2020

Run performance experiments and measure outcomes — both on mobile and on desktop (for example, with Google Analytics ). Rather than focusing on full page loading time (via onLoad and DOMContentLoaded timings, for example), prioritize page loading as perceived by your customers. What does it mean? Large preview ).

Performance 145

Performance Cache Network Metrics 145

The Netflix TechBlog

FEBRUARY 9, 2021

Server-generated assets, since client-side generation would require the retrieval of many individual images, which would increase latency and time-to-render. To reduce latency, assets should be generated in an offline fashion and not in real time. We can leverage high performance VMs in AWS to generate the assets.

Engineering 165

Engineering Storage Latency Entertainment 165