The Netflix TechBlog

OCTOBER 19, 2020

Now let’s look at how we designed the tracing infrastructure that powers Edgar. If we had an ID for each streaming session then distributed tracing could easily reconstruct session failure by providing service topology, retry and error tags, and latency measurements for all service calls.

Infrastructure 238

Infrastructure Transportation Storage Open Source 238

Dynatrace

APRIL 5, 2021

You can eliminate the latency issues caused by cold starts — an increase in normal response time when a new instance receives its first request — by using edge-optimized functions that run code closer to users and other projects. AWS continues to improve how it handles latency issues. It helps SRE teams automate responses.

Lambda 198

Lambda AWS Serverless Hardware 198

The Netflix TechBlog

JUNE 4, 2019

Because microprocessors are so fast, computer architecture design has evolved towards adding various levels of caching between compute units and the main memory, in order to hide the latency of bringing the bits to the brains. This avoids thrashing caches too much for B and evens out the pressure on the L3 caches of the machine.

Cache 258

Cache Latency Airlines Logistics 258

InfoQ

DECEMBER 27, 2023

LinkedIn announced that it would be moving to gRPC with Protocol Buffers for the inter-service communication in its microservices platform, where previously an open-source Rest.li framework was used with JSON as a primary serialization format.

Open Source 141

Open Source Latency Tuning Scalability 141

Brendan Gregg

FEBRUARY 28, 2023

My personal opinion is that I don't see a widespread need for more capacity given horizontal scaling and servers that can already exceed 1 Tbyte of DRAM; bandwidth is also helpful, but I'd be concerned about the increased latency for adding a hop to more memory. Ford, et al., “TCP

Performance 107

Performance Latency Cache Virtualization 107

Scalegrid

MARCH 22, 2024

They can also bolster uptime and limit latency issues or potential downtimes. Achieving Interoperability Among Providers Achieving interoperability between providers is possible through using open source standards, employing AI-driven systems, and enabling safe data transfer across various cloud services.

Strategy 130

Strategy Cloud Government Innovation 130

InfoQ

JANUARY 29, 2024

The team at RevenueCat created an open-source memcache client that provides several advanced features. RevenueCat extensively uses caching to improve the availability and performance of its product API while ensuring consistency. The company shared its techniques to deliver the platform, which can handle over 1.2 By Rafal Gancarz

Cache 107

Cache Open Source Availability Performance 107

Scalegrid

JUNE 7, 2024

RabbitMQ is an open-source message broker that simplifies inter-service communication by ensuring messages are effectively queued, delivered, and processed across diverse applications. Queues designated as durable maintain their configuration and stored messages even after the broker restarts.

IoT 130

IoT Software Architecture Architecture Scalability 130

VoltDB

MARCH 13, 2024

Keep it simple Thanks to the magic of open-source and hyperscalers, it’s very easy to rapidly assemble a system from a large number of third-party components. Maintain control This may sound a bit crazy, but if you’re going to own the latency/availability SLA, then you need to ‘own’ as much of the call path as possible.

Availability 52

Availability Latency DevOps Systems 52

The Netflix TechBlog

MARCH 13, 2020

SVT-AV1: open-source AV1 encoder and decoder by Andrey Norkin , Joel Sole , Mariana Afonso , Kyle Swanson, Agata Opalach , Anush Moorthy , Anne Aaron SVT-AV1 is an open-source AV1 codec implementation hosted on GitHub [link] under a BSD + patent license. We welcome more contributors to the project.

Open Source 159

Open Source Efficiency C++ Speed 159

Brendan Gregg

FEBRUARY 28, 2023

My personal opinion is that I don't see a widespread need for more capacity given horizontal scaling and servers that can already exceed 1 Tbyte of DRAM; bandwidth is also helpful, but I'd be concerned about the increased latency for adding a hop to more memory. Ford, et al., “TCP

Performance 52

Performance Latency Cache Virtualization 52

Brendan Gregg

JULY 4, 2021

## References I've reproduced the talk references below, so you can click on links: - [Gregg 08] Brendan Gregg, “ZFS L2ARC,” [link] Jul 2008 - [Gregg 10] Brendan Gregg, “Visualizations for Performance Analysis (and More),” [link] 2010 - [Greenberg 11] Marc Greenberg, “DDR4: Double the speed, double the latency? Ford, et al., “TCP

Performance 52

Performance Latency Hardware Storage 52

Testsigma

AUGUST 24, 2020

If products are not designed, keeping testability in mind, achieving continuous testing may become a distant dream. Maintaining test data in a central repository and then accessing it from different test environments may ease this problem but may introduce other issues like network latency in tests. Not always!

Testing 69

Testing Open Source Scalability Latency 69

Brendan Gregg

AUGUST 18, 2019

bpftrace is a new open source tracer for Linux for analyzing production performance problems and troubleshooting software. For example, iostat(1), or a monitoring agent, may tell you your average disk latency, but not the distribution of this latency. Block I/O latency as a histogram. 1 /* 2 * biolatency.bt

Latency 57

Latency C++ Cache Programming 57

The Netflix TechBlog

NOVEMBER 22, 2019

This entertaining romp through the tech stack serves as an introduction to how we think about and design systems, the Netflix approach to operational challenges, and how other organizations can apply our thought processes and technologies. Technology advancements in content creation and consumption have also increased its data footprint.

AWS 38

AWS Entertainment Open Source Benchmarking 38

The Netflix TechBlog

SEPTEMBER 10, 2024

To support this growth, we’ve revisited Pushy’s past assumptions and design decisions with an eye towards both Pushy’s future role and future stability. In our case, we value low latency — the faster we can read from KeyValue, the faster these messages can get delivered.

Latency 231

Latency Cache Tuning Efficiency 231

O'Reilly

JANUARY 16, 2024

I’m personally interested in this topic since I am a professor who researches human-computer interaction, user experience design, and cognitive science , so AI voice interfaces are fascinating to me. I’ve recently been brainstorming ideas for how to design such a system and how to deal with the practical challenges of scaling and maintenance.

Entertainment 76

Entertainment Internet Internet Design 76

The Morning Paper

NOVEMBER 5, 2019

Ceph is a widely-used, open-source distributed file system that followed this convention [of building on top of a local file system] for a decade. The zone interface… manages the disk as a sequence of 256 MiB regions that must be written sequentially, encouraging a log-structured, copy-on-write design.

Storage 64

Storage Systems Hardware Efficiency 64

HammerDB

DECEMBER 5, 2020

Additionally both commercial and open source tools based on the specifications also continued to use TPC-C and TPC-H to describe these workloads. For TPC-C this meant enough available spindles to reduce I/O latency and for TPC-H enough bandwidth for data throughput. But why is this important?

C++ 40

C++ Benchmarking Virtualization Open Source 40

Abhishek Tiwari

JULY 12, 2018

Here are 8 fallacies of data pipeline The pipeline is reliable Topology is stateless Pipeline is infinitely scalable Processing latency is minimum Everything is observable There is no domino effect Pipeline is cost­-effective Data is homogeneous The pipeline is reliable The inconvenient truth is that pipeline is not reliable.

Latency 63

Latency Analytics Scalability Engineering 63

Scalegrid

MARCH 28, 2024

Redis Revealed: An Overview Redis, a renowned open-source, in-memory remote dictionary server, stands out for its diverse data structures and advanced features. Redis Data Types and Structures The design of Redis’s data structures emphasizes versatility. Memcached’s primary strength lies in its simplicity.

Cache 130

Cache Storage Architecture Scalability 130

The Morning Paper

MARCH 10, 2020

So if you want to design a system that will offer good real-world performance, it’s really useful to have benchmarks that accurately represent real-world workloads. Characterizing, modeling, and benchmarking RocksDB key-value workloads at Facebook , Cao et al., FAST’20. You get good at what you practice.

Benchmarking 59

Benchmarking Storage Cache Open Source 59

The Morning Paper

MAY 12, 2019

An open-source benchmark suite for microservices and their hardware-software implications for cloud & edge systems Gan et al., It’s a pretty impressive effort to pull together and make available in open source (not yet available as I write this) such a suite, and I’m sure explains much of the long list of 24 authors on this paper.

Open Source 61

Open Source Hardware Benchmarking Systems 61

Scalegrid

AUGUST 27, 2024

These advanced functionalities earmark RabbitMQ as a capable and dominant open-source message broker suited to handle sophisticated needs spanning diverse application landscapes. RabbitMQ excels at managing asynchronous processing and reducing latency while distributing workloads effectively across the system.

Ecommerce 130

Ecommerce IoT Games Scalability 130

Percona

APRIL 17, 2023

The CFQ works well for many general use cases but lacks latency guarantees. The deadline excels at latency-sensitive use cases ( like databases ), and noop is closer to no schedule at all. On the other hand, MongoDB schema design takes a document-oriented approach. Two other schedulers are deadline and noop.

Best Practices 52

Best Practices Design Tuning Database 52

Percona

APRIL 13, 2023

PostgreSQL is a popular open source relational database management system that is widely used for storing and managing data. In PostgreSQL, replication lag can occur due to various reasons such as network latency, slow disk I/O, long-running transactions, etc. What is replication lag?

Latency 86

Latency Tuning Open Source Network 86

Percona

MARCH 29, 2023

Snappy compression is designed to be fast and efficient regarding memory usage, making it a good fit for MongoDB workloads. You can learn more about it in the blog MongoDB: Why Pay for Enterprise When Open Source Has You Covered? Block compression can improve performance by allowing data to be read and written in smaller chunks.

Storage 113

Storage Network Open Source Latency 113

Percona

JULY 17, 2023

Instead of the table-based structure of relational databases, MongoDB stores data in documents and collections, a design for handling large amounts of unstructured data and for real-time web applications. Organizations have access to the source code, allowing them to make changes and enhancements as needed. It ranks No.

Open Source 80

Open Source Database Scalability Software 80

The Netflix TechBlog

NOVEMBER 2, 2021

It has become a de facto standard for perceptual quality measurements within Netflix and, thanks to its open-source nature , throughout the video industry. For example, when we design a new version of VMAF, we need to effectively roll it out throughout the entire Netflix catalog of movies and TV shows. The workflow is initiated.

Media 179

Media Innovation Metrics Latency 179

Dynatrace

OCTOBER 1, 2021

In these modern environments, every hardware, software, and cloud infrastructure component and every container, open-source tool, and microservice generates records of every activity. The architects and developers who create the software must design it to be observed. Benefits of observability.

Metrics 363

Metrics Open Source Monitoring Cloud 363

Adrian Cockcroft

JULY 4, 2023

The rest of this blog post is an edited version of the conversation I had with ChatGPT, that also acts as documentation of the code I’ve open sourced. This time I got code that worked, that used constructs and packages that I hadn’t used before, and got more coding done much more than ten times faster than usual.

Development 52

Development Latency C++ Open Source 52

Scalegrid

DECEMBER 16, 2019

MongoDB is the #3 open source database and the #1 NoSQL database in the world. We ran performance tests for MongoDB on DigitalOcean vs. AWS vs. Azure and found that DigitalOcean performance was in line with, if not better, on both high throughput and low latency in the deployment. DigitalOcean Droplets.

Azure 187

Azure AWS Database Latency 187

Percona

DECEMBER 11, 2023

A Dedicated Log Volume (DLV) is a specialized storage volume designed to house database transaction logs separately from the volume containing the database tables. DLVs are particularly advantageous for databases with large allocated storage, high I/O per second (IOPS) requirements, or latency-sensitive workloads. Get in touch

AWS 101

AWS Benchmarking Performance Traffic 101

Testsigma

DECEMBER 18, 2019

Complete test coverage should include scenarios on latency, speed, security, and usability. The tool is chosen just because it’s open-source. Nowadays, Open source tools are being widely accepted in the market. Open-source tools require you to be well versed with technical skills.

Testing 73

Testing Open Source Strategy Processing 73

High Scalability

DECEMBER 21, 2018

kellabyte : “Open source” infrastructure companies are a giant s**t show right now. Tim Bray : How to talk about [Serverless Latency] · To start with, don’t just say “I need 120ms. And if you know someone with hearing problems they might find Live CC useful. 202,157 flights tracked!

Internet 137

Internet Internet Scalability Serverless 137

High Scalability

SEPTEMBER 8, 2018

To meet user-defined goals for performance (request latency) and cost, the monitoring service tracks and adjusts resources to workload changes. In order to implement these mechanisms, we had to make two significant changes to the design of Anna. Our monitoring engine automatically moves data between tiers based on access patterns.

Storage 199

Storage Performance AWS Media 199

The Netflix TechBlog

DECEMBER 17, 2019

Therefore, dumps are needed to capture the full state of a source. There are several open source CDC projects, often using the same underlying libraries, database APIs, and protocols. No locks on tables are ever acquired, which prevent impacting write traffic on the source database.

Database 207

Database Traffic Transportation Open Source 207