The Netflix TechBlog

FEBRUARY 18, 2022

While a mobile device is almost always connected to the internet and reachable, a smart TV is only online while in use. Scaling Policies To address the thundering herd problem and to keep latencies under acceptable thresholds, the cluster scale-up policies are configured to be more aggressive than the scale-down policies.

Systems 334

Systems Traffic Architecture Mobile 334

All Things Distributed

DECEMBER 14, 2011

Introducing the AWS South America (Sao Paulo) Region. Today, Amazon Web Services is expanding its worldwide coverage with the launch of a new AWS Region in Sao Paulo, Brazil. Several prominent South American customers have been using AWS since the early days. RAMA , a Brazilian financial services firm and AWS customer : â??The

AWS 114

AWS Latency Storage Big Data 114

Brendan Gregg

FEBRUARY 28, 2023

My personal opinion is that I don't see a widespread need for more capacity given horizontal scaling and servers that can already exceed 1 Tbyte of DRAM; bandwidth is also helpful, but I'd be concerned about the increased latency for adding a hop to more memory. Ford, et al., “TCP

Performance 110

Performance Latency Cache Virtualization 110

All Things Distributed

MARCH 2, 2011

Expanding the Cloud - Introducing the AWS Asia Pacific (Tokyo) Region. Today Amazon Web Services is expanding its world-wide coverage with the launch of a new AWS Region located in Tokyo, Japan. The advanced Asia Pacific network infrastructure also makes the AWS Tokyo Region a viable low-latency option for customers from South Korea.

AWS 112

AWS Cloud Games Latency 112

All Things Distributed

JUNE 21, 2018

Further, with the growth and scale of Amazon.com, boundless horizontal scale needed to be a key design point--scaling up simply wasn't an option. In fact, this is been proven by our customers as Amazon Aurora remains the fastest growing service in AWS history. The opposite is true. Purpose-built databases.

Database 167

Database AWS Games Latency 167

All Things Distributed

AUGUST 16, 2011

Expanding the Cloud - The AWS GovCloud (US) Region. Today AWS announced the launch of the AWS GovCloud (US) Region. The concept of regions gives AWS customers control over the placement of their resources and services. The Cloud First strategy is most visible with new Federal IT programs, which are all designed to be â??Cloud

AWS 111

AWS Government Big Data Cloud 111

All Things Distributed

JANUARY 18, 2012

a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Today is a very exciting day as we release Amazon DynamoDB , a fast, highly reliable and cost-effective NoSQL database service designed for internet scale applications. Amazon DynamoDB offers low, predictable latencies at any scale.

Scalability 167

Scalability Database Ecommerce Latency 167

All Things Distributed

JUNE 21, 2017

You can add DAX to your existing DynamoDB applications with just a few clicks in the AWS Management Console – no application rewrites required. Based on this experience and learning, we built DynamoDB to be a fast, highly scalable NoSQL database to meet the needs of Internet-scale applications. Saving crucial milliseconds.

Speed 121

Speed Cache Latency AWS 121

All Things Distributed

JULY 14, 2015

In just three short years, Amazon DynamoDB has emerged as the backbone for many powerful Internet applications such as AdRoll , Druva , DeviceScape , and Battlecamp. DynamoDB Streams simplifies and improves this design pattern with a distributed systems approach. Let me expand on each one of them. DynamoDB Streams.

Database 167

Database Lambda AWS IoT 167

Brendan Gregg

JULY 4, 2021

It's an exciting time for developments in computer performance, not just for the BPF technology (which I often [write about]) but also for processors with 3D stacking and cloud vendor CPUs (e.g., Ford, et al., “TCP on Upcoming Sapphire Rapids CPUs,” [link] Oct 2020 - [Liu 20] Linda Liu, “Samsung QVO vs EVO vs PRO: What’s the Difference?

Performance 52

Performance Latency Hardware Storage 52

Brendan Gregg

FEBRUARY 28, 2023

My personal opinion is that I don't see a widespread need for more capacity given horizontal scaling and servers that can already exceed 1 Tbyte of DRAM; bandwidth is also helpful, but I'd be concerned about the increased latency for adding a hop to more memory. Ford, et al., “TCP

Performance 52

Performance Latency Cache Virtualization 52

Scalegrid

JANUARY 12, 2024

High availability storage options within the context of cloud computing involve highly adaptable storage solutions specifically designed for storing vast amounts of data while providing easy access to it. Storage is a critical aspect to consider when working with cloud workloads. Additionally.

Cloud 130

Cloud Virtualization Storage Efficiency 130

All Things Distributed

DECEMBER 3, 2009

Expanding the Cloud - New AWS Region: US-West (Northern California). We have expanded the AWS footprint in the US and starting today a new AWS Region is available for use: US-West (Northern California). AWS is committed to making its services available at low cost. Driving Storage Costs Down for AWS Customers.

AWS 60

AWS Cloud Latency Storage 60

All Things Distributed

DECEMBER 5, 2010

DNS is one of the fundamental building blocks of internet applications and was high on the wish list of our customers for some time already. Route 53 has the business properties that you have come to expect from an AWS service: fully self-service and programmable, with transparent pay-as-you-go pricing and no minimum usage commitments.

Cloud 117

Cloud Internet Internet AWS 117

All Things Distributed

APRIL 9, 2015

Details on the AWS Blog. AWS has been offering a range of storage solutions: objects, block storage, databases, archiving, etc. When we designed Amazon EFS we decided to build along the AWS principles: Elastic, scalable, highly available, consistent performance, secure, and cost-effective. Details on the AWS Blog.

Lambda 122

Lambda Cloud IoT AWS 122

All Things Distributed

APRIL 28, 2010

Expanding the Cloud - Opening the AWS Asia Pacific (Singapore) Region. Today Amazon Web Services has taken another important step in serving customers worldwide: the AWS Asia Pacific (Singapore) Region is now launched. Quite often "The Cloud" is portrayed as something magically transparent that lives somewhere in the internet.

AWS 61

AWS Cloud Latency Storage 61

Smashing Magazine

AUGUST 20, 2021

Piecing together a website using a WYSIWYG editor and seeing the code it generated was a fascinating and educational experience that sparked an initial interest in web design. I had my website with funny photos and links to favorite websites live on the internet, and better yet, I could edit directly on the server. More after jump!

Ecommerce 139

Ecommerce Website Government Internet 139

All Things Distributed

NOVEMBER 15, 2010

For example, the most fundamental abstraction trade-off has always been latency versus throughput. These trade-offs have even impacted the way the lowest level building blocks in our computer architectures have been designed. The throughput of this pipeline is more important than the latency of the individual operations.

AWS 136

AWS Latency Programming Architecture 136

All Things Distributed

JULY 13, 2010

Cluster Computer Instances for Amazon EC2 are a new instance type specifically designed for High Performance Computing applications. Other industries using Amazon EC2 for HPC-style workloads include pharmaceuticals, oil exploration, industrial and automotive design, media and entertainment, and more. Countdown to What is Next in AWS.

Cloud 118

Cloud AWS Automotive Latency 118

All Things Distributed

JULY 11, 2011

As a part of that process, we also realized that there were a number of latency sensitive or location specific use cases like Hadoop, HPC, and testing that would be ideal for Spot. To get started using Spot or for more details visit the Amazon EC2 Spot Instance web page, the AWS developer blog , and the EC2 Release Notes. Contact Info.

AWS 85

AWS Storage Cloud Big Data 85

VoltDB

JUNE 1, 2017

These systems were designed to have a lifetime of half a decade or more, and rapidly changing hardware meant that the initial deployment had to be sized for 5-7 years out. Latency Optimizers” – need support for very large federated deployments. Bear in mind that the internet currently takes 4ms from New York to Philadelphia.

Hardware 56

Hardware Latency Virtualization Cloud 56

All Things Distributed

FEBRUARY 24, 2010

These new features will make it easier to transition those applications to SimpleDB that are designed with traditional database tools in mind. Achieving strict consistency can come at a cost in update or read latency, and may result in lower throughput. Lowest read latency. Higher read latency. Consistent read.

AWS 69

AWS Latency Database Scalability 69

All Things Distributed

NOVEMBER 19, 2010

Understanding Throughput-Oriented Architectures - background article in CACM on massively parallel and throughput vs latency oriented architectures. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications.

AWS 67

AWS Cloud Benchmarking Storage 67

VoltDB

JUNE 1, 2017

These systems were designed to have a lifetime of half a decade or more, and rapidly changing hardware meant that the initial deployment had to be sized for 5-7 years out. Latency Optimizers” – need support for very large federated deployments. Bear in mind that the internet currently takes 4ms from New York to Philadelphia.

Hardware 40

Hardware Latency Virtualization Cloud 40

All Things Distributed

DECEMBER 12, 2013

Moreover, a GSI''s performance is designed to meet DynamoDB''s single digit millisecond latency - you can add items to a Users table for a gaming app with tens of millions of users with UserId as the primary key, but retrieve them based on their home city, with no reduction in query performance. Start with DynamoDB.

Games 130

Games Scalability Database Retail 130

Smashing Magazine

JANUARY 7, 2019

Performance isn’t just a technical concern: it matters, and when baking it into the workflow, design decisions have to be informed by their performance implications. Without a strong alignment between dev/design and business/marketing teams, performance isn’t going to sustain long-term. Setting Realistic Goals.

Performance 104

Performance Cache Network Metrics 104

Smashing Magazine

JANUARY 6, 2020

Performance isn’t just a technical concern: it affects everything from accessibility to usability to search engine optimization, and when baking it into the workflow, design decisions have to be informed by their performance implications. Map design decisions against performance budget and the priorities defined early on.

Performance 145

Performance Cache Network Metrics 145

Smashing Magazine

JANUARY 11, 2021

Performance isn’t just a technical concern: it affects everything from accessibility to usability to search engine optimization, and when baking it into the workflow, design decisions have to be informed by their performance implications. It’s designed to capture delays that result from the main thread being busy, especially during page load.

Performance 145

Performance Cache Media Metrics 145