The Netflix TechBlog

MARCH 5, 2019

the order of the rows on your Netflix home page, issuing content licenses when you click play, finding the Open Connect cache closest to you with the content you requested, and many more). All these micro-services are currently operated in AWS cloud infrastructure.

Infrastructure 182

Infrastructure Cloud Scalability AWS 182

The Netflix TechBlog

OCTOBER 15, 2019

caching (Memcached etc.), Delta is an eventual consistent, event driven, data synchronization and enrichment platform. Another thread or process is constantly polling events from the log table and writes them to one or multiple datastores, optionally removing events from the log table after acknowledged by all datastores.

Transportation 192

Transportation Architecture Processing Storage 192

Percona

DECEMBER 23, 2022

The use case is the TPC-C benchmark but executed not on a high-end server but on a lower-spec virtual machine that is I/O limited like for example, with AWS EBS volumes. The storage device has performance characteristics pretty similar to an AWS gp2 EBS volume of about 330 GB in size. The following figure illustrates the impacts.

Storage 55

Storage Cache C++ Virtualization 55

The Symphonia

JANUARY 21, 2019

Since we use so many AWS services in our work, it makes sense that we also consider AWS tools for CI/CD. What are the AWS Continuous Integration / Continuous Delivery tools? AWS have a bunch of different products in this area grouped into their “CodeSuite” developer tools : CodeCommit is their managed Git service.

AWS 40

AWS Open Source Lambda Serverless 40

Dynatrace

OCTOBER 7, 2021

Amazon Web Services (AWS), offers a wide range of serverless solutions. To get a better understanding of AWS serverless, we’ll first explore the basics of serverless architectures, review AWS serverless offerings, and explore common use cases. AWS serverless offerings. Common use cases for AWS serverless services.

Serverless 280

Serverless AWS Lambda Storage 280

The Netflix TechBlog

NOVEMBER 3, 2022

We introduce a caching mechanism in the API gateway layer, allowing us to offload processing from singleton leader elected controllers without giving up strict data consistency and guarantees clients observe. The cache is kept in sync with the current leader process. How do I know that my cache is up to date? of the data.

Cache 224

Cache Latency Traffic Systems 224

CSS - Tricks

SEPTEMBER 2, 2021

HTTP Caching is a Superpower — Hugh Haworth covers how the Cache-Control header is an awfully potent ingredient in web performance. I mis-read the title at first and was waiting to read about HTML caching. I only do it now because Cloudflare handles it. Shipping 350KB of CSS instead of the 10KB you need is not OK. Why Not Both!

Performance 53

Performance Cache AWS Technology 53

All Things Distributed

SEPTEMBER 28, 2012

I am in India for the AWS Summits in Mumbai, Chennai and Bangalore (next week). As always in India I have an amazing time, the events are packed, the participants are extremely enthusiastic and eager to learn, the customers very appreciative and the food is just amazing. Back-to-Basics Weekend Reading - Counting Bloom Filters.

Cache 84

Cache AWS Scalability Network 84

All Things Distributed

NOVEMBER 26, 2013

As I discussed in my re:Invent keynote earlier this month, I am now happy to announce the immediate availability of Amazon RDS Cross Region Read Replicas , which is another important enhancement for our customers using or planning to use multiple AWS Regions to deploy their applications. Cross Region Read Replicas are available for MySQL 5.6

Cloud 145

Cloud AWS Traffic Latency 145

The Netflix TechBlog

NOVEMBER 9, 2022

to a larger AWS instance size, from m5.4xl (16 vCPUs) to m5.12xl (48 vCPUs). As GS2 relies on AWS EC2 Auto Scaling to target-track CPU utilization, we thought we just had to redeploy the service on the larger instance type and wait for the ASG (Auto Scaling Group) to settle on the CPU target. Thread 0’s cache in this example.

Hardware 363

Hardware Cache Performance Latency 363

The Netflix TechBlog

OCTOBER 18, 2019

In particular, he talked about the misattribution potential in a complex microservice architecture where often intermediary results are cached. For example, a ranking team would ingest live user traffic and subject it to a number of ranking configurations and simulate the event outcomes using predictive models running on canary rankers.

Infrastructure 126

Infrastructure Metrics Architecture Efficiency 126

The Netflix TechBlog

OCTOBER 18, 2019

In particular, he talked about the misattribution potential in a complex microservice architecture where often intermediary results are cached. For example, a ranking team would ingest live user traffic and subject it to a number of ranking configurations and simulate the event outcomes using predictive models running on canary rankers.

Infrastructure 100

Infrastructure Metrics Architecture Efficiency 100

All Things Distributed

JULY 14, 2015

Streams provide you with the underlying infrastructure to create new applications, such as continuously updated free-text search indexes, caches, or other creative extensions requiring up-to-date table changes. An AWS Lambda function is a simpler option that you can use, as it only requires you to code the logic, set it, and forget it.

Database 167

Database Lambda AWS IoT 167

The Netflix TechBlog

JUNE 14, 2023

The GraphQL shim enabled client engineers to move quickly onto GraphQL, figure out client-side concerns like cache normalization, experiment with different GraphQL clients, and investigate client performance without being blocked by server-side migrations. Watch our Chaos Engineering talk from AWS Reinvent to learn more about Sticky Canaries.

Traffic 353

Traffic Latency Cache Metrics 353

The Symphonia

MAY 22, 2018

I was a little restricted in my thinking the first time around and I’ve come to see FaaS as something not quite stateless, since caching state in a Lambda instance that might stick around for 5 hours is a perfectly reasonable idea. and products like AWS Fargate have made this distinction murkier still. Because of course it did.

Serverless 40

Serverless Architecture Lambda Azure 40

Smashing Magazine

AUGUST 3, 2023

It also opens up the possibility for more effective use of caching strategies, potentially enhancing load times further. Their primary role is to store (or “cache”) copies of web content — like HTML pages, JavaScript files, and multimedia content — and deliver it to users based on their geographic location.

Performance 74

Performance Cache Traffic Metrics 74

The Netflix TechBlog

DECEMBER 17, 2019

In databases like MySQL and PostgreSQL, transaction logs are the source of CDC events. Some of DBLog’s features are: Processes captured log events in-order. Interleaves log with dump events, by taking dumps in chunks. Hence, downstream consumers have confidence to receive change events as they occur on a source.

Database 212

Database Traffic Transportation Open Source 212

The Netflix TechBlog

DECEMBER 17, 2019

In databases like MySQL and PostgreSQL, transaction logs are the source of CDC events. Some of DBLog’s features are: Processes captured log events in-order. Interleaves log with dump events, by taking dumps in chunks. Hence, downstream consumers receive change events as they occur on a source.

Database 197

Database Traffic Transportation Open Source 197

IO River

NOVEMBER 2, 2023

It’s not just limited to cloud resources like AWS and Azure; Terraform is versatile, extending its capabilities to key performance areas like Content Delivery Network (CDN) management, ensuring efficient content delivery and optimal user experience.‍Started ‍Terraform is a revolution in the way we handle infrastructure.

Open Source 52

Open Source DevOps AWS Azure 52

The Netflix TechBlog

OCTOBER 16, 2019

Often the data is held in memory by consumers and used as a “total cache”, where it is accessed at runtime by client code and atomically swapped out under the hood. for example Open Connect Appliance cache configuration, supported device type IDs, supported payment method metadata, and A/B test configuration.

Cache 187

Cache Architecture Metrics Java 187

Percona

MAY 2, 2023

As a MongoDB user, it’s crucial to ensure that your data is safe and secure in the event of a disaster or system failure. It also supports storing the backups on filesystem and AWS S3 buckets. In today’s data-driven world, losing critical data can be catastrophic for any organization. mongodump --host=mongodb1.example.net

Best Practices 52

Best Practices Database Storage Servers 52

IO River

NOVEMBER 2, 2023

In fact, Amazon Web Services (AWS) paved the way with its service, CloudFormation, which introduced the concept of Infrastructure as Code (IaC). Taking inspiration from AWS's CloudFormation, HashiCorp introduced Terraform with a broader vision. Terraform is a revolution in the way we handle infrastructure.

Open Source 40

Open Source DevOps AWS Azure 40

Adrian Cockcroft

JANUARY 20, 2023

Clouds using Ethernet that are multipath optimized using libfabric and features like EFA on AWS are going to be increasingly competitive, and Ethernet will replace other interconnects between racks. AWS has invested in optimizing Ethernet for HPC via the Elastic Fabric Adaptor (EFA) option, and the l ibfabric library. of peak capacity.

Architecture 52

Architecture Latency Benchmarking AWS 52

All Things Distributed

OCTOBER 12, 2016

Three years ago, as part of our AWS Fast Data journey we introduced Amazon ElastiCache for Redis , a fully managed in-memory data store that operates at sub-millisecond latency. While caching continues to be a dominant use of ElastiCache for Redis, we see customers increasingly use it as an in-memory NoSQL database.

Scalability 130

Scalability Analytics Cache AWS 130

The Morning Paper

JUNE 23, 2019

Generally to cache data (including non-persistent data that never sees a backing store), to share non-persistent data across application services (e.g. ” Even re-reading that today, the letter of the law there is surprisingly strict to me: you can use the local memory space or filesystem as a brief single transaction cache, but no more.

Cache 79

Cache Latency Google Lambda 79

All Things Distributed

OCTOBER 2, 2017

As we began growing the AWS business, we realized that external customers might find our Dynamo database just as useful as we found it within Amazon.com. So, we set out to build a fully hosted AWS database service based upon the original Dynamo design. Durable and Highly-Available – DynamoDB maintains data durability and 99.99

Internet 128

Internet Internet AWS Performance 128

The Morning Paper

NOVEMBER 17, 2019

Serverless functions are stateless , but can opportunistically reuse cached state across invocations to speed up start times. events may be retried, depending on how you have configured your retry policy). If your function is not naturally idempotent, you may need to resort to tactics such as remembering previously seen event ids.

Serverless 58

Serverless Lambda Programming Cache 58

All Things Distributed

NOVEMBER 21, 2017

Redis's microsecond latency has made it a de facto choice for caching. Four years ago, as part of our AWS fast data journey, we introduced Amazon ElastiCache for Redis , a fully managed, in-memory data store that operates at microsecond latency.

Games 112

Games Retail Latency Education 112

CSS - Tricks

MAY 3, 2021

Linux; Android 6.0.1; Moto G (4)) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.85 Mobile Safari/537.36 PTST/210419.211328", "accept: text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.9", image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.9",

Transportation 86

Transportation Cache Google Mobile 86

The Morning Paper

MAY 12, 2019

Smaller microservices demonstrated much better instruction-cache locality than their monolithic counterparts. In section 7, the authors evaluate the performance and cost of running each of the five microservices systems on AWS Lambda instead of EC2. The most prominent source of misses, especially in the kernel, was Thrift.

Open Source 61

Open Source Hardware Benchmarking Systems 61

Smashing Magazine

NOVEMBER 30, 2021

You don’t need to write any JS for it, but if you wanted to extend the behavior in some way you can, because it also exposes a JavaScript event that fires whenever it’s toggled open or closed. That was awful to develop for. You can even change what the icons that display when it’s expanded and collapsed are, just with CSS.

Technology 94

Technology Technology Servers Code 94

Smashing Magazine

JANUARY 11, 2021

Build Optimizations JavaScript modules, module/nomodule pattern, tree-shaking, code-splitting, scope-hoisting, Webpack, differential serving, web worker, WebAssembly, JavaScript bundles, React, SPA, partial hydration, import on interaction, 3rd-parties, cache. This knowledge will give you the best optimization target for ongoing efforts.

Performance 145

Performance Cache Media Metrics 145

Smashing Magazine

JANUARY 6, 2020

In the end, it’s not the load events or server response times that define the experience, but the perception of how snappy the interface feels. Custom metrics measure a particular, custom event for the user, e.g. Twitter’s Time To First Tweet and Pinterest’s PinnerWaitTime. What does it mean?

Performance 145

Performance Cache Network Metrics 145

Smashing Magazine

JANUARY 7, 2019

Custom metrics measure a particular, custom event for the user, e.g. Twitter’s Time To First Tweet and Pinterest’s PinnerWaitTime. For that one, you can monitor Hero Rendering Times , or use Performance API , marking particular timestaps for events that are important for your business.

Performance 104

Performance Cache Metrics Network 104

High Scalability

NOVEMBER 25, 2019

Egnyte is a secure Content Collaboration and Data Governance platform, founded in 2007 when Google drive wasn't born and AWS S3 was cost-prohibitive. Edge caching. In general, Egnyte connect architecture shards and caches data at different levels based on: Amount of data. Nginx for disk based caching. Disk based caching.

Architecture 52

Architecture Cache Azure Storage 52