The Netflix TechBlog

AUGUST 29, 2023

Since there were no existing solutions available, we needed to build them ourselves. To improve availability, we designed systems where components could fail separately and avoid single points of failure. Eureka and Ribbon presented a simple but powerful interface, which made adopting them easy.

Traffic 220

Traffic Latency Cloud C++ 220

The Netflix TechBlog

MARCH 1, 2021

It supports both high throughput services that consume hundreds of thousands of CPUs at a time, and latency-sensitive workloads where humans are waiting for the results of a computation. The subsystems all communicate with each other asynchronously via Timestone, a high-scale, low-latency priority queuing system. Warm capacity.

Serverless 228

Serverless Media Latency Social Media 228

The Netflix TechBlog

OCTOBER 27, 2020

The data warehouse is not designed to serve point requests from microservices with low latency. Therefore, we must efficiently move data from the data warehouse to a global, low-latency and highly-reliable key-value store. How Bulldozer leverages Spark, Protobuf and KV DAL for moving the data.

Latency 243

Latency Storage Big Data Tuning 243

The Netflix TechBlog

DECEMBER 21, 2020

This article will list some of the use cases of AutoOptimize, discuss the design principles that help enhance efficiency, and present the high-level architecture. These principles reduce resource usage by being more efficient and effective while lowering the end-to-end latency in data processing. More processing resources.

Storage 203

Storage Latency Efficiency Data Engineering 203

Dynatrace

DECEMBER 22, 2019

After being available in an Early Adopter Release, we’re happy to announce that AWS supporting services are now Generally Available (GA). Supporting services include every service that isn’t available with out-of-the-box Dynatrace monitoring. Stay tuned for updates in Q1 2020. You can also create custom charts.

AWS 136

AWS Metrics IoT Storage 136

Dynatrace

DECEMBER 22, 2019

After being available in an Early Adopter Release, we’re happy to announce that AWS supporting services are now Generally Available (GA). Supporting services include every service that isn’t available with out-of-the-box Dynatrace monitoring. Stay tuned for updates in Q1 2020. You can also create custom charts.

AWS 133

AWS Metrics IoT Storage 133

The Netflix TechBlog

FEBRUARY 9, 2021

When we merge these two concepts together and present them to the customer, we have the plan selection page (shown above). This implies that the presentation layer should be void of any business logic and should simply be responsible for rendering data that is passed to it. The database contains the plans, prices and offers.

Engineering 142

Engineering Scalability Architecture Innovation 142

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. Checking those available: $ cat /sys/devices/system/clocksource/clocksource0/available_clocksource. I've shared many posts about superpower observability tools, but often humble hacking is just as effective. in total.

Speed 126

Speed Java AWS Virtualization 126

Percona

APRIL 17, 2023

The main objective of this post is to share my experience over the past years tuning MongoDB and centralize the diverse sources that I crossed in this journey in a unique place. There is an issue with this, which causes the OS to swap even with memory available. Spoiler alert: This post focuses on MongoDB 3.6.X 25.84 - Total 21.04

Best Practices 52

Best Practices Design Tuning Database 52

The Morning Paper

JULY 7, 2019

The success of ML-centric projects depends heavily on data availability, quality, and management. ML-centric software also sees frequent revisions initiated by model changes, parameter tuning, and data updates, the combination of which can have a significant impact on system performance. The big three.

Software Engineering 92

Software Engineering Engineering Software Software 92

The Morning Paper

MARCH 17, 2020

One thing they all had in common is an evaluation using some kind of simulation of the expected behaviour of NVDIMMs, because the real thing wasn’t yet available. Based on these findings, the authors present four guidelines to get the best performance out of this memory today. But now it is! Optane DIMMs are here!

Scalability 59

Scalability Latency Cache Media 59

The Netflix TechBlog

DECEMBER 17, 2019

In order to be supported, a database is required to fulfill a set of features that are commonly available in systems like MySQL, PostgreSQL, MariaDB, and others. Designed with High Availability in mind. Providing high availability for real-time events. Some of DBLog’s features are: Processes captured log events in-order.

Database 212

Database Traffic Transportation Open Source 212

The Netflix TechBlog

DECEMBER 17, 2019

In order to be supported, a database is required to fulfill a set of features that are commonly available in systems like MySQL, PostgreSQL, MariaDB, and others. Designed with High Availability in mind. Providing high availability for real-time events. Go to step 1 if more chunks present. Figure 3?—?DBLog

Database 197

Database Traffic Transportation Open Source 197

All Things Distributed

NOVEMBER 29, 2017

As there are few individuals with this expertise, an easier process presents a significant opportunity for companies who want to accelerate their ML usage. After this, there is often a long process of training that includes tuning the knobs and levers, called hyperparameters, that control the different aspects of the training algorithm.

Tuning 96

Tuning AWS Scalability Infrastructure 96

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. The change was obvious in the production graphs, showing a drop in write latencies: Once tested more broadly, it showed the write latencies dropped by 43%, delivering slightly better performance than on CentOS. in total.

Speed 40

Speed Java AWS Virtualization 40

All Things Distributed

DECEMBER 12, 2013

We launched DynamoDB last year to address the need for a cloud database that provides seamless scalability, irrespective of whether you are doing ten transactions or ten million transactions, while providing rock solid durability and availability. Now you can run queries on any item attributes (columns) in your DynamoDB table.

Games 130

Games Scalability Database Retail 130

Smashing Magazine

AUGUST 22, 2021

Because we are dealing with network protocols here, we will mainly look at network aspects, of which two are most important: latency and bandwidth. Latency can be roughly defined as the time it takes to send a packet from point A (say, the client) to point B (the server). Two-way latency is often called round-trip time (RTT).

Performance 105

Performance Network Latency Servers 105

HammerDB

OCTOBER 18, 2019

cpupower frequency-info analyzing CPU 0: driver: intel_pstate CPUs which run at the same hardware frequency: 0 CPUs which need to have their frequency coordinated by software: 0 maximum transition latency: Cannot determine or is not supported. hardware limits: 1000 MHz - 4.00 bin/pgbench -c 1 -S -T 60 pgbench starting vacuum.end.

Benchmarking 63

Benchmarking Performance Hardware C++ 63

O'Reilly Software

APRIL 4, 2018

Fast forward to the present day and we find ourselves in a world where the number of connected devices is constantly increasing. The data shape will dictate capacity planning, tuning of the backbone, and scalability analysis for individual components. What message process warranty level do we require? At least once? At most once?

Architecture 80

Architecture Scalability Google Operating System 80

John McCalpin

JANUARY 22, 2018

Dr. Damon McDougall gave a short presentation on this study at the IXPUG 2018 Fall Conference ( pdf ) — I originally wrote these notes to help organize my thoughts as we were preparing the IXPUG presentation, and later decided that the extra details contained here are interesting enough for me to post it.

Latency 40

Latency Hardware Code Testing 40

Brendan Gregg

SEPTEMBER 5, 2017

What follows are topics that may be of interest to anyone looking to migrate their systems and skillset: scan these to find topics that interest you. ## ZFS ZFS is available for Linux via the [zfsonlinux] and [OpenZFS] projects, and more recently was included in Canonical's Ubuntu Linux distribution: Ubuntu Xenial 16.04 LTS (April 2016).

Virtualization 76

Virtualization AWS Engineering Hardware 76

HammerDB

OCTOBER 12, 2018

For this reason sysbench presents a vastly more simplified workload than HammerDB. . Therefore if you are testing MySQL or MariaDB’s ability to support web-based applications that use SQL statements with minimal contention then sysbench is likely to present the best assessment of the system for this type of workload.

Best Practices 40

Best Practices Scalability Performance C++ 40

Percona

NOVEMBER 3, 2023

Rather than listing the concepts, function calls, etc, available in Citus, which frankly is a bit boring, I’m going to explore scaling out a database system starting with a single host. I won’t cover all the features but show just enough that you’ll want to see more of what you can learn to accomplish for yourself.

Database 102

Database Benchmarking Latency C++ 102

Smashing Magazine

AUGUST 9, 2021

You’ve probably heard things like: “HTTP/3 is much faster than HTTP/2 when there is packet loss”, or “HTTP/3 connections have less latency and take less time to set up”, and probably “HTTP/3 can send data more quickly and can send more resources in parallel”. Stay tuned! (vf, QUIC has a higher encryption overhead. Large preview ).

Transportation 145

Transportation Internet Internet Network 145

SQL Server According to Bob

JANUARY 11, 2020

​​ Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information presented after the date of publication. The SQL Server 2000 High Availability Series expounds upon remote mirroring.

Servers 40

Servers Cache Media Hardware 40

SQL Server According to Bob

JANUARY 11, 2020

​​ Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information presented after the date of publication. This White Paper is for informational purposes only.

Servers 40

Servers Cache Database Media 40

Smashing Magazine

SEPTEMBER 29, 2021

Tip: When evaluating quality, compression and fine-tuning of modern formats, Squoosh.app ’s ability to perform a visual side-by-side comparison is helpful. Additional format vs quality comparisons are available for photography and illustrations. The biggest drawback for AVIF at present is that it lacks uniform support across browsers.

Open Source 144

Open Source Speed Website Google 144