The Netflix TechBlog

NOVEMBER 9, 2022

to a larger AWS instance size, from m5.4xl (16 vCPUs) to m5.12xl (48 vCPUs). A quick canary test was free of errors and showed lower latency, which is expected given that our standard canary setup routes an equal amount of traffic to both the baseline running on 4xl and the canary on 12xl. let’s call it GS2?—?to

Hardware 363

Hardware Cache Performance Latency 363

All Things Distributed

DECEMBER 5, 2010

Route 53 has the business properties that you have come to expect from an AWS service: fully self-service and programmable, with transparent pay-as-you-go pricing and no minimum usage commitments. There are two main types of DNS servers: authoritative servers and caching resolvers. Some fundamentals on Naming. No lock-in.

Cloud 117

Cloud Internet Internet AWS 117

The Netflix TechBlog

SEPTEMBER 24, 2021

Uploading and downloading data always come with a penalty, namely latency. Figure 2: Cloud Resource and Job Sizes This initial architecture was designed at a time when packaging from a list of chunks was not possible and terabyte-sized files were not considered. For write operations, those challenges do not apply.

Cloud 237

Cloud Media Storage Cache 237

Percona

APRIL 17, 2023

The CFQ works well for many general use cases but lacks latency guarantees. The deadline excels at latency-sensitive use cases ( like databases ), and noop is closer to no schedule at all. Make sure the drives are mounted with noatime and also if the drives are behind a RAID controller with appropriate battery-backed cache.

Best Practices 52

Best Practices Design Tuning Database 52

Smashing Magazine

AUGUST 3, 2023

These pages serve as a pivotal tool in our digital marketing strategy, not only providing valuable information about our services but also designed to be easily discoverable through search engines. It also opens up the possibility for more effective use of caching strategies, potentially enhancing load times further.

Performance 74

Performance Cache Traffic Metrics 74

The Morning Paper

FEBRUARY 6, 2020

.’ Stateless is fine until you need state, at which point the coarse-grained solutions offered by current platforms limit the kinds of application designs that work well. On the Cloudburst design teams’ wish list: A running function’s ‘hot’ data should be kept physically nearby for low-latency access.

Lambda 98

Lambda Serverless Cache Latency 98

All Things Distributed

SEPTEMBER 3, 2013

AWS offers its customers a choice of different database services, each optimized for different workloads. Amazon ElastiCache is a fully managed, in-memory caching service for customers to optimize the latency, performance and cost of their read workloads.

Cache 129

Cache Cloud Performance Retail 129

High Scalability

JULY 20, 2018

That means multiple data indirections mean multiple cache misses. DonHopkins : NeWS differs from the current technology stack in that it was all coherently designed at once by James Gosling and David Rosenthal, by taking several steps back and thinking deeply about all the different problems it was trying to solve together.

Internet 121

Internet Internet Scalability Automotive 121

Adrian Cockcroft

JANUARY 20, 2023

Clouds using Ethernet that are multipath optimized using libfabric and features like EFA on AWS are going to be increasingly competitive, and Ethernet will replace other interconnects between racks. The emergence of chiplet technology also allows higher performance and integration without having to design every chip from scratch.

Architecture 52

Architecture Latency Benchmarking AWS 52

All Things Distributed

JUNE 21, 2017

Today, I'm excited to announce the general availability of Amazon DynamoDB Accelerator (DAX) , a fully managed, highly available, in-memory cache that can speed up DynamoDB response times from milliseconds to microseconds, even at millions of requests per second. DynamoDB was the first service at AWS to use SSD storage.

Speed 121

Speed Cache Latency AWS 121

All Things Distributed

JULY 14, 2015

Streams provide you with the underlying infrastructure to create new applications, such as continuously updated free-text search indexes, caches, or other creative extensions requiring up-to-date table changes. DynamoDB Streams simplifies and improves this design pattern with a distributed systems approach.

Database 167

Database Lambda AWS IoT 167

The Morning Paper

JUNE 23, 2019

Why are developers using RInK systems as part of their design? Generally to cache data (including non-persistent data that never sees a backing store), to share non-persistent data across application services (e.g. The network latency of fetching data over the network, even considering fast data center networks. Who knew! ;).

Cache 79

Cache Latency Google Lambda 79

Dynatrace

OCTOBER 4, 2022

Data lakehouses take advantage of low-cost object stores like AWS S3 or Microsoft Azure Blob Storage to store and manage data cost-effectively. Data lakehouses deliver the query response with minimal latency. Agent and open technologies make it easy to ingest large volumes of observability, security, and business data. Data management.

Artificial Intelligence 209

Artificial Intelligence Storage Analytics Government 209

Smashing Magazine

AUGUST 20, 2021

Piecing together a website using a WYSIWYG editor and seeing the code it generated was a fascinating and educational experience that sparked an initial interest in web design. In Designing The Perfect Navigation , Vitaly will explore 100s of practical examples of better mega-dropdowns , hamburgers, carousels, modals and filters.

Ecommerce 139

Ecommerce Website Government Internet 139

All Things Distributed

JUNE 21, 2018

Further, with the growth and scale of Amazon.com, boundless horizontal scale needed to be a key design point--scaling up simply wasn't an option. In fact, this is been proven by our customers as Amazon Aurora remains the fastest growing service in AWS history. The opposite is true. Take Expedia, for example.

Database 167

Database AWS Games Latency 167

All Things Distributed

OCTOBER 2, 2017

With these requirements in mind, and a willingness to question the status quo, a small group of distributed systems experts came together and designed a horizontally scalable distributed database that would scale out for both reads and writes to meet the long-term needs of our business. This was the genesis of the Amazon Dynamo database.

Internet 128

Internet Internet AWS Performance 128

All Things Distributed

NOVEMBER 21, 2017

Redis's microsecond latency has made it a de facto choice for caching. Four years ago, as part of our AWS fast data journey, we introduced Amazon ElastiCache for Redis , a fully managed, in-memory data store that operates at microsecond latency. TB of in-memory capacity in a single cluster.

Games 112

Games Retail Latency Education 112

All Things Distributed

JANUARY 18, 2012

a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Today is a very exciting day as we release Amazon DynamoDB , a fast, highly reliable and cost-effective NoSQL database service designed for internet scale applications. Amazon DynamoDB offers low, predictable latencies at any scale. Comments ().

Scalability 167

Scalability Database Ecommerce Latency 167

Percona

MAY 2, 2023

Cons of logical backups As it reads all data, it can be slow and will require disk reads too for databases that are larger than the RAM available for the WT cache—the WT cache pressure increases, which slows down the performance. It also supports storing the backups on filesystem and AWS S3 buckets. mongodb-27017.sock

Best Practices 52

Best Practices Database Storage Servers 52

The Morning Paper

MAY 12, 2019

Microservices fundamentally change a lot of assumptions current cloud systems are designed with, and present both opportunities and challenges when optimizing for quality of service (QoS) and utilization. Smaller microservices demonstrated much better instruction-cache locality than their monolithic counterparts.

Open Source 61

Open Source Hardware Benchmarking Systems 61

The Netflix TechBlog

DECEMBER 17, 2019

Designed with High Availability in mind. There are services at Netflix that use RDBMS kind of databases such as MySQL or PostgreSQL via AWS RDS. We designed the framework to minimize database impact. No locks on tables are ever acquired, which prevent impacting write traffic on the source database.

Database 197

Database Traffic Transportation Open Source 197

The Netflix TechBlog

DECEMBER 17, 2019

Designed with High Availability in mind. There are services at Netflix that use RDBMS kind of databases such as MySQL or PostgreSQL via AWS RDS. We designed the framework to minimize database impact. No locks on tables are ever acquired, which prevent impacting write traffic on the source database.

Database 212

Database Traffic Transportation Open Source 212

The Morning Paper

NOVEMBER 17, 2019

For example, to reduce latency, serverless platforms try to reuse the same function instance to process multiple requests. Serverless functions are stateless , but can opportunistically reuse cached state across invocations to speed up start times. AWS Step Functions, or OpenWhisk Conductor). Don’t do that!

Serverless 58

Serverless Lambda Programming Cache 58

CSS - Tricks

MAY 3, 2021

For one thing, the design of WebPageTest is now quite nice. An amazing achievement, to be sure, but it also feels good to me that WebPageTest is now owned by Catchpoint with Patrick being there himself on the project. A welcome upgrade, let’s say. So yes, WebPageTest is still here. It’s still free. Linux; Android 6.0.1;

Transportation 86

Transportation Cache Google Mobile 86

The Netflix TechBlog

MARCH 6, 2019

Video encoding is what MezzFS was originally designed for and remains one of its canonical use cases, so we’ll focus on video encoding to describe the problem that MezzFS solves. Disk Caching? — ? MezzFS can be configured to cache objects on the local disk. Regional caching? —?Netflix What problem are we solving?

Media 214

Media Storage Processing Cache 214

Smashing Magazine

JANUARY 11, 2021

Performance isn’t just a technical concern: it affects everything from accessibility to usability to search engine optimization, and when baking it into the workflow, design decisions have to be informed by their performance implications. Looking back now, things seem to have changed quite significantly.

Performance 145

Performance Cache Media Metrics 145

Smashing Magazine

JANUARY 6, 2020

Performance isn’t just a technical concern: it affects everything from accessibility to usability to search engine optimization, and when baking it into the workflow, design decisions have to be informed by their performance implications. Map design decisions against performance budget and the priorities defined early on.

Performance 145

Performance Cache Network Metrics 145

Smashing Magazine

JANUARY 7, 2019

Performance isn’t just a technical concern: it matters, and when baking it into the workflow, design decisions have to be informed by their performance implications. Without a strong alignment between dev/design and business/marketing teams, performance isn’t going to sustain long-term. Setting Realistic Goals.

Performance 104

Performance Cache Metrics Network 104