The Netflix TechBlog

NOVEMBER 22, 2019

by Shefali Vyas Dalal AWS re:Invent is a couple weeks away and our engineers & leaders are thrilled to be in attendance yet again this year! Netflix shares how Amazon EC2 Auto Scaling allows its infrastructure to automatically adapt to changing traffic patterns in order to keep its audience entertained and its costs on target.

AWS 100

AWS Entertainment Open Source Benchmarking 100

All Things Distributed

JUNE 20, 2017

Today, I am very excited to announce our plans to open a new AWS Region in Hong Kong! The new region will give Hong Kong-based businesses, government organizations, non-profits, and global companies with customers in Hong Kong, the ability to leverage AWS technologies from data centers in Hong Kong.

AWS 146

AWS Logistics Cloud Social Media 146

All Things Distributed

NOVEMBER 13, 2018

Today, I am happy to announce our plans to open a new AWS Region in Italy! The AWS Europe (Milan) Region is the 25th AWS Region that we've announced globally. It's the sixth AWS Region in Europe, joining existing regions in France, Germany, Ireland, the UK, and the new Region that we recently announced in Sweden.

AWS 167

AWS Energy Automotive Traffic 167

All Things Distributed

NOVEMBER 26, 2013

As I discussed in my re:Invent keynote earlier this month, I am now happy to announce the immediate availability of Amazon RDS Cross Region Read Replicas , which is another important enhancement for our customers using or planning to use multiple AWS Regions to deploy their applications. Cross Region Read Replicas are available for MySQL 5.6

Cloud 145

Cloud AWS Traffic Latency 145

All Things Distributed

NOVEMBER 12, 2012

Expanding the Cloud â?? Today, Amazon Web Services has greater worldwide coverage with the launch of a new AWS Region in Sydney, Australia. I have visited Australia at least twice every year for the past four years and I have seen first-hand evidence of the tremendous interest there is in the AWS service. Comments ().

Cloud 117

Cloud AWS Ecommerce Latency 117

The Netflix TechBlog

OCTOBER 19, 2020

If we had an ID for each streaming session then distributed tracing could easily reconstruct session failure by providing service topology, retry and error tags, and latency measurements for all service calls. Using simple lookup indices in Cassandra gives us the ability to maintain acceptable read latencies while doing heavy writes.

Infrastructure 233

Infrastructure Transportation Storage Open Source 233

The Netflix TechBlog

NOVEMBER 22, 2019

by Shefali Vyas Dalal AWS re:Invent is a couple weeks away and our engineers & leaders are thrilled to be in attendance yet again this year! Netflix shares how Amazon EC2 Auto Scaling allows its infrastructure to automatically adapt to changing traffic patterns in order to keep its audience entertained and its costs on target.

AWS 37

AWS Entertainment Open Source Benchmarking 37

All Things Distributed

AUGUST 16, 2011

Expanding the Cloud - The AWS GovCloud (US) Region. Today AWS announced the launch of the AWS GovCloud (US) Region. The concept of regions gives AWS customers control over the placement of their resources and services. Cloud First. The US Federal Cloud Computing Strategy lays out a â??Cloud

AWS 111

AWS Government Big Data Cloud 111

Dotcom-Montior

NOVEMBER 11, 2020

those resources now belong to cloud providers, such as AWS Lambda, Google Cloud Platform, Microsoft Azure, and others. Again, the benefit being that the code within your containers or virtual machines is managed by the cloud provider. When code isn’t in use, the cloud providers typically throttle it all the way down.

Serverless 57

Serverless Monitoring Lambda Latency 57

Percona

DECEMBER 11, 2023

A quick configuration change may do the trick in improving the performance of your AWS RDS for MySQL instance. DLVs are particularly advantageous for databases with large allocated storage, high I/O per second (IOPS) requirements, or latency-sensitive workloads. Who can benefit from DLV? and later v10 versions MySQL: 8.0.28

AWS 101

AWS Benchmarking Performance Traffic 101

The Netflix TechBlog

NOVEMBER 9, 2022

to a larger AWS instance size, from m5.4xl (16 vCPUs) to m5.12xl (48 vCPUs). A quick canary test was free of errors and showed lower latency, which is expected given that our standard canary setup routes an equal amount of traffic to both the baseline running on 4xl and the canary on 12xl. let’s call it GS2?—?to

Hardware 363

Hardware Cache Performance Latency 363

VoltDB

JUNE 1, 2017

An opening scene involving a traffic jam of Viking boats and a musical number (“Love Can’t Afjord to wait”). Private Clouds made of commodity hardware are perceived as the logical solution to this problem. Latency Optimizers” – need support for very large federated deployments. The “Public Private Cloud” folks.

Hardware 56

Hardware Latency Virtualization Cloud 56

VoltDB

JUNE 29, 2017

Most existing adtech infrastructure simply can not achieve the required latency. VoltDB provides the necessary technology to achieve the latency required by header bidding. And while it’s easy to say “spin up more AWS servers”, you’re only adding to your cloud provider bill.

Performance 40

Performance Hardware Latency Infrastructure 40

VoltDB

JUNE 29, 2017

Most existing adtech infrastructure simply can not achieve the required latency. VoltDB provides the necessary technology to achieve the latency required by header bidding. And while it’s easy to say “spin up more AWS servers”, you’re only adding to your cloud provider bill.

Performance 40

Performance Hardware Latency Infrastructure 40

Scalegrid

JANUARY 12, 2024

What is workload in cloud computing? Simply put, it’s the set of computational tasks that cloud systems perform, such as hosting databases, enabling collaboration tools, or running compute-intensive algorithms. The environments, which were previously isolated, are now working seamlessly under central control.

Cloud 130

Cloud Virtualization Storage Efficiency 130

Adrian Cockcroft

APRIL 18, 2018

In addition, for cloud native applications, a feedback loop is used to auto-scale the application resources based on metrics that report the utilization of current capacity. One approach is to use an integrated monitoring system to efficiently gather bulk metrics and maintain the long term archive as part of the same infrastructure.

Monitoring 40

Monitoring Systems Virtualization Metrics 40

All Things Distributed

DECEMBER 12, 2018

In April 2017, Amazon Web Services announced that it would launch a new AWS infrastructure region Region in Sweden. Today, I'm happy to announce that the AWS Europe (Stockholm) Region, our 20th Region globally, is now generally available for use by customers. Public sector.

AWS 124

AWS Cloud Games Serverless 124

O'Reilly

DECEMBER 2, 2019

5G enthusiasts frequently say it’s an enabling technology for autonomous vehicles (AV), which will need high bandwidth to download maps and images, and perhaps even to communicate with each other: AV heaven is a world in which all vehicles are autonomous and can therefore collaboratively plan traffic. We won’t need to worry about backups.

Wireless 53

Wireless Serverless IoT Artificial Intelligence 53

VoltDB

JUNE 1, 2017

An opening scene involving a traffic jam of Viking boats and a musical number (“Love Can’t Afjord to wait”). Private Clouds made of commodity hardware are perceived as the logical solution to this problem. Latency Optimizers” – need support for very large federated deployments. The “Public Private Cloud” folks.

Hardware 40

Hardware Latency Virtualization Cloud 40

Scalegrid

DECEMBER 16, 2019

While you may assume a great majority of the cloud database deployments are run on AWS, Azure, or Google Cloud Platform, small to medium-sized businesses in particular are gravitating towards the developer-friendly cloud provider, DigitalOcean , for their hosting for MongoDB® needs. DigitalOcean Droplets.

Azure 187

Azure AWS Latency Database 187

Adrian Cockcroft

MAY 6, 2023

Then they tried to scale it to cope with high traffic and discovered that some of the state transitions in their step functions were too frequent, and they had some overly chatty calls between AWS lambda functions and S3. When you are exploring how to construct something, building a prototype in a few days or weeks is a good approach.

Serverless 145

Serverless Lambda Best Practices Traffic 145

The Symphonia

MAY 22, 2018

I also rewrote the section on Startup Latency since Cold Starts are one of the big “FUD” areas of Serverless. and products like AWS Fargate have made this distinction murkier still. Finally in this first overall section it was good to be able to talk about AWS SAM and SAR?—?“Serverless Because of course it did.

Serverless 40

Serverless Architecture Lambda Azure 40

All Things Distributed

MARCH 26, 2018

At AWS, we don't mark many anniversaries. A concept that has changed infrastructure architecture is now at the core of both AWS and customer reliability and operations. Powering the virtual instances and other resources that make up the AWS Cloud are real physical data centers with AWS servers in them.

AWS 132

AWS Latency Lambda Architecture 132

All Things Distributed

APRIL 4, 2017

Today, I am very excited to announce our plans to open a new AWS Region in the Nordics! The new region will give Nordic-based businesses, government organisations, non-profits, and global companies with customers in the Nordics, the ability to leverage the AWS technology infrastructure from data centers in Sweden.

AWS 116

AWS Airlines Latency Games 116

The Netflix TechBlog

AUGUST 29, 2023

A brief history of IPC at Netflix Netflix was early to the cloud, particularly for large-scale companies: we began the migration in 2008, and by 2010, Netflix streaming was fully run on AWS. Today we have a wealth of tools, both OSS and commercial, all designed for cloud-native environments.

Traffic 220

Traffic Latency Cloud C++ 220

Percona

JULY 1, 2023

Now that Database-as-a-service (DBaaS) is in high demand, there are multiple questions regarding AWS services that cannot always be answered easily: When should I use Aurora and when should I use RDS MySQL ? Amazon Aurora is a proprietary, cloud-native, fully managed relational database service developed by Amazon Web Services (AWS).

AWS 52

AWS Database Serverless Storage 52

The Netflix TechBlog

NOVEMBER 3, 2022

by Tomasz Bak and Fabio Kung Introduction Titus is the Netflix cloud container runtime that runs and manages containers at scale. In that scenario, the system would need to deal with the data propagation latency directly, for example, by use of timeouts or client-originated update tracking mechanisms.

Cache 224

Cache Latency Traffic Systems 224

Dynatrace

MAY 17, 2023

It is available for the major OS and cloud platforms (for example, Windows, Linux, Solaris, AWS, Azure, and more) and only requires the deployment of a single service to monitor its environment. And that’s where Dynatrace OneAgent comes in. What is OneAgent? On the other hand, if we checked out the process page for our Node.js

Metrics 173

Metrics Monitoring Database Network 173

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. Since instances of both CentOS and Ubuntu were running in parallel, I could collect flame graphs at the same time (same time-of-day traffic mix) and compare them side by side. At least AWS have now included it in their recommendations.

Speed 126

Speed Java AWS Virtualization 126

The Netflix TechBlog

AUGUST 16, 2023

That’s a significant amount and certainly more than is necessary relative to the traffic on most clusters. More acutely, if a traffic spike occurs and Zuul instances scale up, it exponentially increases connections open to origins. There is effectively no churn of connections, even at peak traffic.

Traffic 170

Traffic Servers Google Metrics 170

The Netflix TechBlog

FEBRUARY 18, 2022

We thus assigned a priority to each use case and sharded event traffic by routing to priority-specific queues and the corresponding event processing clusters. This separation allows us to tune system configuration and scaling policies independently for different event priorities and traffic patterns.

Systems 334

Systems Traffic Architecture Mobile 334

High Scalability

JULY 20, 2018

And if you know anyone looking for a simple book that uses lots of pictures and lots of examples to explain the cloud, then please recommend my new book: Explain the Cloud Like I'm 10. It would mean a great deal to me. They'll love you even more. It doesn't scale down to the point that is ridiculous and painful.

Internet 121

Internet Internet Scalability Automotive 121

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. Since instances of both CentOS and Ubuntu were running in parallel, I could collect flame graphs at the same time (same time-of-day traffic mix) and compare them side by side. At least AWS have now included it in their recommendations.

Speed 52

Speed Java AWS Virtualization 52

Percona

MAY 2, 2023

Back up anywhere – to the cloud (use any S3-compatible storage) or on-premise with a locally-mounted remote file system It allows you to choose which compression algorithms to use. Especially if going into or out of storage types that may throttle bandwidth/network traffic. root@ip-172-31-37-92 tmp]# time mongo < hot.js

Best Practices 52

Best Practices Database Storage Servers 52

O'Reilly

NOVEMBER 12, 2019

Given that Amazon’s AWS Lambda functions are only five years old this November, anyone with more than three years of experience is a very early adopter. This scaling takes away the worry from random and unexpected traffic spikes or big seasonal traffic. latency, startup, mocking, etc.) 1 reported benefit.

Serverless 88

Serverless Architecture FinTech Infrastructure 88

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. Since instances of both CentOS and Ubuntu were running in parallel, I could collect flame graphs at the same time (same time-of-day traffic mix) and compare them side by side. At least AWS have now included it in their recommendations.

Speed 40

Speed Java AWS Virtualization 40

All Things Distributed

OCTOBER 2, 2017

" Of course, no technology change happens in isolation, and at the same time NoSQL was evolving, so was cloud computing. As we began growing the AWS business, we realized that external customers might find our Dynamo database just as useful as we found it within Amazon.com.

Internet 128

Internet Internet AWS Performance 128