Speed Curve

FEBRUARY 5, 2024

The use of server-timing headers by content delivery networks closes a big gap. Latency – How much time does it take to deliver a packet from A to B. For example, processing of web application firewall (WAF) rules, detecting bots or other malicious traffic though security services, and growing in popularity, edge compute.

Servers 57

Servers Cache Retail Benchmarking 57

The Netflix TechBlog

NOVEMBER 22, 2019

by Shefali Vyas Dalal AWS re:Invent is a couple weeks away and our engineers & leaders are thrilled to be in attendance yet again this year! Netflix shares how Amazon EC2 Auto Scaling allows its infrastructure to automatically adapt to changing traffic patterns in order to keep its audience entertained and its costs on target.

AWS 37

AWS Entertainment Open Source Benchmarking 37

All Things Distributed

NOVEMBER 26, 2013

As I discussed in my re:Invent keynote earlier this month, I am now happy to announce the immediate availability of Amazon RDS Cross Region Read Replicas , which is another important enhancement for our customers using or planning to use multiple AWS Regions to deploy their applications. Cross Region Read Replicas are available for MySQL 5.6

Cloud 145

Cloud AWS Traffic Latency 145

Scalegrid

JANUARY 8, 2024

Infrastructure Excellence ScaleGrid’s infrastructure is designed to facilitate hosting in your cloud account and provides cost-saving options with AWS or Azure Reserved Instances or GCP. This results in faster response times and reduced network traffic, enhancing the overall efficiency and effectiveness of cloud services.

Artificial Intelligence 147

Artificial Intelligence Cloud Scalability Analytics 147

All Things Distributed

AUGUST 16, 2011

Expanding the Cloud - The AWS GovCloud (US) Region. Today AWS announced the launch of the AWS GovCloud (US) Region. The concept of regions gives AWS customers control over the placement of their resources and services. All Things Distributed. Werner Vogels weblog on building scalable and robust distributed systems.

AWS 111

AWS Government Big Data Cloud 111

O'Reilly

DECEMBER 2, 2019

The most obvious change 5G might bring about isn’t to cell phones but to local networks, whether at home or in the office. High-speed networks through 5G may represent the next generation of cord cutting. Those waits can be significant, even if you’re on a corporate network. What will 5G mean in practice? I don’t, do you?

Wireless 53

Wireless Serverless IoT Artificial Intelligence 53

The Netflix TechBlog

JUNE 14, 2023

The control group’s traffic utilized the legacy Falcor stack, while the experiment population leveraged the new GraphQL client and was directed to the GraphQL Shim. To determine customer impact, we could compare various metrics such as error rates, latencies, and time to render.

Traffic 353

Traffic Latency Cache Metrics 353

Adrian Cockcroft

APRIL 18, 2018

This is true for CPU, network, memory and storage, and also for bare metal, virtual machines, containers, processes, functions and threads. What happens if you have several monitoring systems and they disagree on a critical metric like CPU load or Network throughput? This can cause confusion and delay resolution of an incident.

Monitoring 40

Monitoring Systems Virtualization Metrics 40

VoltDB

JUNE 1, 2017

An opening scene involving a traffic jam of Viking boats and a musical number (“Love Can’t Afjord to wait”). Latency Optimizers” – need support for very large federated deployments. They want to compete with AWS or Azure, and want to use OpenStack as a foundation for a commercial offering. Vikings fight zombies.

Hardware 56

Hardware Latency Virtualization Cloud 56

All Things Distributed

MARCH 26, 2018

At AWS, we don't mark many anniversaries. A concept that has changed infrastructure architecture is now at the core of both AWS and customer reliability and operations. Powering the virtual instances and other resources that make up the AWS Cloud are real physical data centers with AWS servers in them.

AWS 132

AWS Latency Lambda Architecture 132

VoltDB

JUNE 1, 2017

An opening scene involving a traffic jam of Viking boats and a musical number (“Love Can’t Afjord to wait”). Latency Optimizers” – need support for very large federated deployments. They want to compete with AWS or Azure, and want to use OpenStack as a foundation for a commercial offering. Vikings fight zombies.

Hardware 40

Hardware Latency Virtualization Cloud 40

Dynatrace

MAY 17, 2023

It is available for the major OS and cloud platforms (for example, Windows, Linux, Solaris, AWS, Azure, and more) and only requires the deployment of a single service to monitor its environment. This allows us to quickly tell whether the network link may be saturated or the processor is running at its limit.

Metrics 173

Metrics Monitoring Database Network 173

All Things Distributed

DECEMBER 12, 2018

In April 2017, Amazon Web Services announced that it would launch a new AWS infrastructure region Region in Sweden. Today, I'm happy to announce that the AWS Europe (Stockholm) Region, our 20th Region globally, is now generally available for use by customers. Public sector.

AWS 124

AWS Cloud Games Serverless 124

The Netflix TechBlog

NOVEMBER 3, 2022

In that scenario, the system would need to deal with the data propagation latency directly, for example, by use of timeouts or client-originated update tracking mechanisms. With traffic growth, a single leader node handling all request volume started becoming overloaded. The cache is kept in sync with the current leader process.

Cache 224

Cache Latency Traffic Systems 224

All Things Distributed

APRIL 4, 2017

Today, I am very excited to announce our plans to open a new AWS Region in the Nordics! The new region will give Nordic-based businesses, government organisations, non-profits, and global companies with customers in the Nordics, the ability to leverage the AWS technology infrastructure from data centers in Sweden.

AWS 116

AWS Airlines Latency Games 116

Smashing Magazine

AUGUST 3, 2023

It increases our visibility and enables us to draw a steady stream of organic (or “free”) traffic to our site. While paid marketing strategies like Google Ads play a part in our approach as well, enhancing our organic traffic remains a major priority. The higher our organic traffic, the more profitable we become as a company.

Performance 74

Performance Cache Traffic Metrics 74

The Netflix TechBlog

FEBRUARY 18, 2022

We thus assigned a priority to each use case and sharded event traffic by routing to priority-specific queues and the corresponding event processing clusters. This separation allows us to tune system configuration and scaling policies independently for different event priorities and traffic patterns.

Systems 334

Systems Traffic Architecture Mobile 334

Scalegrid

JANUARY 12, 2024

This is sometimes referred to as using an “over-cloud” model that involves a centrally managed resource pool that spans all parts of a connected global network with internal connections between regional borders, such as two instances in IAD-ORD for NYC-JS webpage DNS routing. This also aids scalability down the line.

Cloud 130

Cloud Virtualization Storage Efficiency 130

All Things Distributed

MARCH 11, 2016

The epoch of AWS is the launch of Amazon S3 on March 14, 2006, now almost 10 years ago. Given that AWS is a pioneer in building and operating these services world-wide, these lessons have been of crucial importance to our business. AWS helps its customers do this too. Build security in from the ground up.

AWS 144

AWS Hardware Retail Virtualization 144

The Netflix TechBlog

FEBRUARY 9, 2021

The homepage needs to load in a reasonable amount of time, even in poor network conditions. Server-generated assets, since client-side generation would require the retrieval of many individual images, which would increase latency and time-to-render. We can leverage high performance VMs in AWS to generate the assets.

Engineering 165

Engineering Storage Latency Entertainment 165

All Things Distributed

JUNE 21, 2018

In fact, this is been proven by our customers as Amazon Aurora remains the fastest growing service in AWS history. Use cases such as gaming, ad tech, and IoT lend themselves particularly well to the key-value data model where the access patterns require low-latency Gets/Puts for known key values. The opposite is true.

Database 167

Database AWS Games Latency 167

Percona

MAY 2, 2023

Especially if going into or out of storage types that may throttle bandwidth/network traffic. It also supports storing the backups on filesystem and AWS S3 buckets. root@ip-172-31-37-92 ~]# aws ec2 describe-snapshots --query "sort_by(Snapshots, &StartTime)[-1].{SnapshotId:SnapshotId,StartTime:StartTime}"

Best Practices 52

Best Practices Database Storage Servers 52

All Things Distributed

OCTOBER 2, 2017

As we began growing the AWS business, we realized that external customers might find our Dynamo database just as useful as we found it within Amazon.com. So, we set out to build a fully hosted AWS database service based upon the original Dynamo design.

Internet 128

Internet Internet AWS Performance 128

Adrian Cockcroft

APRIL 5, 2023

This proposal seeks to define a standard for real-time carbon and energy data as time-series data that would be accessed alongside and synchronized with the existing throughput, utilization and latency metrics that are provided for the components and applications in computing environments.

Energy 52

Energy Metrics Cloud Operating System 52

Percona

APRIL 17, 2023

The CFQ works well for many general use cases but lacks latency guarantees. The deadline excels at latency-sensitive use cases ( like databases ), and noop is closer to no schedule at all. Embedding further simplifies database operations, reduces network overhead, and boosts read and query performance.

Best Practices 52

Best Practices Design Tuning Database 52

Adrian Cockcroft

NOVEMBER 11, 2019

Collecting some critical metrics at one second intervals, with a total observability latency of ten seconds or less matches the human attention span much better. This is why most AWS regions have three availability zones. Try to measure your mean time to respond (MTTR) for incidents. The rows are shown split below for readability.

Latency 52

Latency Engineering Systems Hardware 52

Dynatrace

AUGUST 5, 2019

In this role, I am leading a global team that works closely with our strategic partners such as AWS, Microsoft, Google, Pivotal, Red Hat and others. Resource consumption & traffic analysis. What is the network traffic going to be between services we migrate and those that have to stay in the current data center?

Cloud 31

Cloud Traffic Database Network 31

Adrian Cockcroft

NOVEMBER 11, 2019

Collecting some critical metrics at one second intervals, with a total observability latency of ten seconds or less matches the human attention span much better. This is why most AWS regions have three availability zones. Try to measure your mean time to respond (MTTR) for incidents. The rows are shown split below for readability.

Latency 53

Latency Engineering Systems Hardware 53

Brendan Gregg

SEPTEMBER 5, 2017

Here's some output from my zfsdist tool, in bcc/BPF, which measures ZFS latency as a histogram on Linux: # zfsdist. Tracing ZFS operation latency. At my employer we sometimes use SR-IOV for direct network interface access, and NVMe for direct disk access. Hit Ctrl-C to end. ^C

Virtualization 76

Virtualization AWS Engineering Hardware 76

Smashing Magazine

JANUARY 11, 2021

Networking, HTTP/2, HTTP/3 OCSP stapling, EV/DV certificates, packaging, IPv6, QUIC, HTTP/3. CrUX generates an overview of performance distributions over time, with traffic collected from Google Chrome users. If you don’t have a device at hand, emulate mobile experience on desktop by testing on a throttled 3G network (e.g.

Performance 145

Performance Cache Media Metrics 145

Smashing Magazine

JANUARY 6, 2020

If you don’t have a device at hand, emulate mobile experience on desktop by testing on a throttled 3G network (e.g. To make the performance impact more visible, you could even introduce 2G Tuesdays or set up a throttled 3G/4G network in your office for faster testing. 300ms RTT, 1.6 Mbps down, 0.8

Performance 145

Performance Cache Network Metrics 145

Smashing Magazine

JANUARY 7, 2019

If you don’t have a device at hand, emulate mobile experience on desktop by testing on a throttled network (e.g. To make the performance impact more visible, you could even introduce 2G Tuesdays or set up a throttled 3G network in your office for faster testing. 150ms RTT, 1.5 Mbps down, 0.7 Mbps up) with a throttled CPU (5× slowdown).

Performance 103

Performance Cache Metrics Network 103