The Netflix TechBlog

NOVEMBER 22, 2019

by Shefali Vyas Dalal AWS re:Invent is a couple weeks away and our engineers & leaders are thrilled to be in attendance yet again this year! Technology advancements in content creation and consumption have also increased its data footprint. In order to maintain performance, benchmarking is a vital part of our system’s lifecycle.

AWS 100

AWS Entertainment Open Source Benchmarking 100

The Netflix TechBlog

NOVEMBER 22, 2019

by Shefali Vyas Dalal AWS re:Invent is a couple weeks away and our engineers & leaders are thrilled to be in attendance yet again this year! Technology advancements in content creation and consumption have also increased its data footprint. In order to maintain performance, benchmarking is a vital part of our system’s lifecycle.

AWS 100

AWS Entertainment Open Source Benchmarking 100

Brendan Gregg

JULY 4, 2021

It's an exciting time for developments in computer performance, not just for the BPF technology (which I often [write about]) but also for processors with 3D stacking and cloud vendor CPUs (e.g., This was a chance to talk about other things I've been working on, such as the present and future of hardware performance.

Performance 140

Performance Latency Hardware Storage 140

All Things Distributed

NOVEMBER 13, 2018

Today, I am happy to announce our plans to open a new AWS Region in Italy! The AWS Europe (Milan) Region is the 25th AWS Region that we've announced globally. It's the sixth AWS Region in Europe, joining existing regions in France, Germany, Ireland, the UK, and the new Region that we recently announced in Sweden.

AWS 167

AWS Energy Automotive Traffic 167

Dynatrace

MAY 17, 2023

Validation tasks are then extended left to cover performance testing and release validation in a pre-production environment. More precisely, this team uses AWS Fault Injection Simulator (FIS) to run fault injection to improve the application’s performance and resiliency.

DevOps 180

DevOps Traffic Latency Best Practices 180

Brendan Gregg

FEBRUARY 28, 2023

At USENIX SREcon22 APAC I gave the opening keynote on the future of computer performance, rounding up the latest developments and making predictions of where I see things heading. This talk originated from my updates to [Systems Performance 2nd Edition], and this was the first time I've given this talk in person! Or even on a plane.

Performance 110

Performance Latency Cache Virtualization 110

Scalegrid

APRIL 16, 2020

AWS , Azure. AWS , Azure. AWS , Azure. AWS , Azure. AWS , Azure. AWS , Azure. AWS , Azure. AWS , Azure , DigitalOcean. Are you a startup that has free AWS or Azure hosting credits you’d like to use for your database hosting? Do you want to deploy in an AWS VPC or Azure VNET?

Cloud 242

Cloud Azure AWS Database 242

InfoQ

JUNE 16, 2023

Datadog created a dedicated data ingestion architecture offering exactly-once semantics for their third-generation event store, Husky. The event-driven architecture (EDA) can accommodate bursts in traffic in the multi-tenant platform with reasonable ingestion latency and acceptable operational costs. By Rafal Gancarz

Architecture 55

Architecture Scalability Latency Traffic 55

Dynatrace

OCTOBER 10, 2022

Popular examples include AWS Lambda and Microsoft Azure Functions , but new providers are constantly emerging as this model becomes more mainstream. Reduced latency. By using cloud providers with multiple server sites, organizations can reduce function latency for end users. Optimizes resources. No infrastructure to maintain.

Serverless 160

Serverless Infrastructure Lambda Latency 160

Scalegrid

JANUARY 8, 2024

By analyzing real-time data, AI-based models can: Adjust the allocation of resources in response to demand Boost business performance Reduce unnecessary expenditures Lead to significant cost savings Improve scalability Operational Efficiency through Automation Automation is a significant way AI enhances cloud operations.

Artificial Intelligence 147

Artificial Intelligence Cloud Scalability Analytics 147

The Netflix TechBlog

OCTOBER 19, 2020

If we had an ID for each streaming session then distributed tracing could easily reconstruct session failure by providing service topology, retry and error tags, and latency measurements for all service calls. Traces collected from various microservices are ingested in a stream processing manner into the data store.

Infrastructure 233

Infrastructure Transportation Storage Open Source 233

All Things Distributed

NOVEMBER 13, 2014

When AWS launched, it changed how developers thought about IT services: What used to take weeks or months of purchasing and provisioning turned into minutes with Amazon EC2. Our answer is a new compute service called AWS Lambda. You can go from code to service in three clicks and then let AWS Lambda take care of the rest.

Lambda 136

Lambda AWS Cloud Scalability 136

Dynatrace

AUGUST 27, 2019

The Dynatrace all-in-one software intelligence platform gives your team real-time visibility into your underlying infrastructure —be it on bare metal, VMware, OpenStack, AWS, Azure, or a hybrid solution. Step 2 – xMatters passes Dynatrace data to alerts that provide actionable responses. Dynatrace problem notification: Low disk space.

Systems 176

Systems Latency DevOps Azure 176

Brendan Gregg

JULY 4, 2021

It's an exciting time for developments in computer performance, not just for the BPF technology (which I often [write about]) but also for processors with 3D stacking and cloud vendor CPUs (e.g., This was a chance to talk about other things I've been working on, such as the present and future of hardware performance.

Performance 52

Performance Latency Hardware Storage 52

Brendan Gregg

FEBRUARY 28, 2023

At USENIX SREcon22 APAC I gave the opening keynote on the future of computer performance, rounding up the latest developments and making predictions of where I see things heading. This talk originated from my updates to Systems Performance 2nd Edition , and this was the first time I've given this talk in person!

Performance 52

Performance Latency Cache Virtualization 52

All Things Distributed

DECEMBER 14, 2011

Introducing the AWS South America (Sao Paulo) Region. Today, Amazon Web Services is expanding its worldwide coverage with the launch of a new AWS Region in Sao Paulo, Brazil. Several prominent South American customers have been using AWS since the early days. Additionally, it allows them to keep their data inside of Brazil.

AWS 114

AWS Latency Storage Big Data 114

The Netflix TechBlog

NOVEMBER 22, 2019

by Shefali Vyas Dalal AWS re:Invent is a couple weeks away and our engineers & leaders are thrilled to be in attendance yet again this year! Technology advancements in content creation and consumption have also increased its data footprint. In order to maintain performance, benchmarking is a vital part of our system’s lifecycle.

AWS 37

AWS Entertainment Open Source Benchmarking 37

Speed Curve

FEBRUARY 5, 2024

That performance golden rule still holds true today. Server Timing is a specification that allows communication of data from the server to the client through the use of a server-timing header. SpeedCurve's RUM collection library – lux.js – accesses this interface to collect custom data from the user agent.

Servers 57

Servers Cache Retail Benchmarking 57

Dynatrace

SEPTEMBER 30, 2021

Cloud services platforms like AWS, Azure, and GCP are reshaping how organizations deliver value to their customers, making cloud migration an increasingly attractive option for running applications. With an on-prem data center, the organization bears the burden of securing the physical infrastructure and its digital assets.

Cloud 160

Cloud Traffic Best Practices Strategy 160

The Netflix TechBlog

NOVEMBER 9, 2022

to a larger AWS instance size, from m5.4xl (16 vCPUs) to m5.12xl (48 vCPUs). A quick canary test was free of errors and showed lower latency, which is expected given that our standard canary setup routes an equal amount of traffic to both the baseline running on 4xl and the canary on 12xl. let’s call it GS2?—?to

Hardware 363

Hardware Cache Performance Latency 363

All Things Distributed

NOVEMBER 26, 2013

As I discussed in my re:Invent keynote earlier this month, I am now happy to announce the immediate availability of Amazon RDS Cross Region Read Replicas , which is another important enhancement for our customers using or planning to use multiple AWS Regions to deploy their applications. Cross Region Read Replicas are available for MySQL 5.6

Cloud 145

Cloud AWS Traffic Latency 145

VoltDB

JUNE 29, 2017

Most existing adtech infrastructure simply can not achieve the required latency. VoltDB provides the necessary technology to achieve the latency required by header bidding. This surge in impressions will strain or break existing infrastructure, which wasn’t architected to handle data at this scale. Switching to VoltDB will.

Performance 40

Performance Hardware Latency Infrastructure 40

VoltDB

JUNE 29, 2017

Most existing adtech infrastructure simply can not achieve the required latency. VoltDB provides the necessary technology to achieve the latency required by header bidding. This surge in impressions will strain or break existing infrastructure, which wasn’t architected to handle data at this scale. Switching to VoltDB will.

Performance 40

Performance Hardware Latency Infrastructure 40

Percona

DECEMBER 11, 2023

A quick configuration change may do the trick in improving the performance of your AWS RDS for MySQL instance. Here, we will discuss a notable new feature in Amazon RDS, the Dedicated Log Volume (DLV), that has been introduced to boost database performance. Who can benefit from DLV? and later v10 versions MySQL: 8.0.28

AWS 98

AWS Benchmarking Performance Traffic 98

ScaleOut Software

APRIL 6, 2021

This new software model enables applications to easily analyze telemetry from individual data sources in 1-3 milliseconds while maintaining state information about data sources that deepens introspection. Scaleout StreamServer® DT was created to meet this need.

IoT 52

IoT Azure Analytics Healthcare 52

All Things Distributed

APRIL 17, 2013

While DynamoDB already allows you to perform low-latency queries based on your tableâ??s s primary key, even at tremendous scale, LSI will now give you the ability to perform fast queries against other attributes (or columns) in your table. Each item is a collection of data attributes. This is a natural fit for DynamoDB.

Cloud 114

Cloud Latency Games Scalability 114

The Morning Paper

AUGUST 29, 2019

If you’re moving an OLAP workload to the cloud (AWS in the context of this paper), what DBMS setup should you go with? There’s a broad set of choices including where you store the data, whether you run your own DBMS nodes or use a service, the kinds of instance types to go for if you do run your own, and so forth. VLDB’19.

Architecture 76

Architecture Cloud Storage Serverless 76

All Things Distributed

DECEMBER 3, 2009

Expanding the Cloud - New AWS Region: US-West (Northern California). We have expanded the AWS footprint in the US and starting today a new AWS Region is available for use: US-West (Northern California). AWS is committed to making its services available at low cost. Driving Storage Costs Down for AWS Customers.

AWS 60

AWS Cloud Latency Storage 60

All Things Distributed

APRIL 28, 2010

Expanding the Cloud - Opening the AWS Asia Pacific (Singapore) Region. Today Amazon Web Services has taken another important step in serving customers worldwide: the AWS Asia Pacific (Singapore) Region is now launched. The new Singapore Region offers customers in APAC lower-latency access to AWS services. Comments ().

AWS 61

AWS Cloud Latency Storage 61

Dynatrace

NOVEMBER 10, 2022

As companies accelerate digital transformation, cloud services such as AWS Lambda help companies to modernize their application architectures to quickly adapt to the needs of their customers while offloading the operational complexity to their cloud vendor. A new Telemetry API as an extension to AWS Lambda for all telemetry signals.

Lambda 228

Lambda Serverless AWS Latency 228

All Things Distributed

FEBRUARY 22, 2012

Today AWS launched an exciting new service for developers: the Amazon Simple Workflow Service. Often an application consists of several different tasks to be performed in particular sequence driven by a set of dynamic conditions. They must deal with the increased latency and unreliability inherent in remote communication.

Cloud 130

Cloud AWS Java Scalability 130

Scalegrid

NOVEMBER 25, 2019

ScyllaDB is an open-source distributed NoSQL data store, reimplemented from the popular Apache Cassandra database. ScyllaDB offers significantly lower latency which allows you to process a high volume of data with minimal delay. In fact, according to ScyllaDB’s performance benchmark report, their 99.9 We found that 39.1%

Big Data 187

Big Data Database Open Source Azure 187

The Netflix TechBlog

DECEMBER 21, 2020

By Anupom Syam Background At Netflix, our current data warehouse contains hundreds of Petabytes of data stored in AWS S3 , and each day we ingest and create additional Petabytes. Some of the optimizations are prerequisites for a high-performance data warehouse.

Storage 203

Storage Latency Efficiency Data Engineering 203

All Things Distributed

SEPTEMBER 25, 2012

Following the huge success of being able to provision a consistent, user-requested I/O rate for DynamoDB and Elastic Block Store (EBS), the AWS Database Services team has now released Provisioned IOPS, a new high performance storage option for the Amazon Relational Database Service (Amazon RDS). High Performance I/O.

Cloud 117

Cloud AWS Storage Database 117

Dynatrace

MAY 17, 2023

Making applications observable—relying on metrics, logs, and traces to understand what software is doing and how it’s performing—has become increasingly important as workloads are shifting to multicloud environments. However, this method limited us to instrumenting the code manually and collecting specific sets of data we defined upfront.

Metrics 166

Metrics Monitoring Database Network 166

All Things Distributed

JULY 13, 2010

Cluster Computer Instances for Amazon EC2 are a new instance type specifically designed for High Performance Computing applications. In those days, my main goal was to take the advances in building the highly dedicated High Performance Cluster environments and turn them into commodity technologies for the enterprise to use.

Cloud 118

Cloud AWS Automotive Latency 118

The Netflix TechBlog

OCTOBER 27, 2020

By Tianlong Chen and Ioannis Papapanagiotou Netflix has more than 195 million subscribers that generate petabytes of data everyday. Data scientists and engineers collect this data from our subscribers and videos, and implement data analytics models to discover customer behaviour with the goal of maximizing user joy.

Latency 243

Latency Storage Big Data Tuning 243