The Netflix TechBlog

OCTOBER 19, 2020

If we had an ID for each streaming session then distributed tracing could easily reconstruct session failure by providing service topology, retry and error tags, and latency measurements for all service calls. Our engineering teams tuned their services for performance after factoring in increased resource utilization due to tracing.

Infrastructure 233

Infrastructure Transportation Storage Open Source 233

InfoQ

DECEMBER 27, 2023

LinkedIn announced that it would be moving to gRPC with Protocol Buffers for the inter-service communication in its microservices platform, where previously an open-source Rest.li framework was used with JSON as a primary serialization format.

Open Source 142

Open Source Latency Tuning Scalability 142

Scalegrid

MARCH 22, 2024

They can also bolster uptime and limit latency issues or potential downtimes. Consistently evaluating and tuning resource allocations based on use patterns helps prevent overprovisioning and reduces unnecessary expenses.

Strategy 130

Strategy Cloud Government Innovation 130

Percona

MARCH 23, 2023

Nowadays, solid-state drives (SSDs) or non-volatile memory express (NVMe) drives are preferred over traditional hard disk drives (HDDs) for database servers due to their faster read and write speeds, lower latency, and improved reliability. If you see concurrency issues, you can tune this variable. I hope this helps! and MariaDB 10.5.4

Performance 125

Performance Hardware Tuning Storage 125

Dynatrace

MAY 17, 2023

OpenTelemetry , the open source observability tool, has become the go-to standard for instrumenting custom applications to collect observability telemetry data. Monitoring DNS query time is important for understanding network latency, ensuring that services are available, troubleshooting issues, and optimizing application performance.

Metrics 166

Metrics Monitoring Database Network 166

Percona

APRIL 17, 2023

The main objective of this post is to share my experience over the past years tuning MongoDB and centralize the diverse sources that I crossed in this journey in a unique place. The CFQ works well for many general use cases but lacks latency guarantees. Spoiler alert: This post focuses on MongoDB 3.6.X

Best Practices 52

Best Practices Design Tuning Database 52

HammerDB

MAY 5, 2019

Note that the main developer of HammerDB is Intel employee (#IAMINTEL) however HammerDB is a personal open source project and HammerDB has no optimization whatsoever for a database running on any particular architecture. In the recent MySQL 8.0.16 In the recent MySQL 8.0.16 model name : Intel(R) Xeon(R) Platinum 8180 CPU @ 2.50GHz.

Testing 48

Testing Tuning Latency Storage 48

HammerDB

OCTOBER 18, 2019

As noted previously the main developer of HammerDB is an Intel employee (#IAMINTEL) however HammerDB is a personal open source project and any opinions are my own, specific to the context of HammerDB as an independent personal project and not representing Intel. hardware limits: 1000 MHz - 4.00 hardware limits: 1000 MHz - 4.00

Benchmarking 63

Benchmarking Performance Hardware C++ 63

Abhishek Tiwari

JULY 12, 2018

Here are 8 fallacies of data pipeline The pipeline is reliable Topology is stateless Pipeline is infinitely scalable Processing latency is minimum Everything is observable There is no domino effect Pipeline is cost­-effective Data is homogeneous The pipeline is reliable The inconvenient truth is that pipeline is not reliable.

Latency 63

Latency Analytics Scalability Engineering 63

O'Reilly

JANUARY 16, 2024

Unpredictable wait times : Wait times (latency) for ChatGPT’s responses are unpredictable, and there aren’t audio cues to help me establish an expectation for how long I need to wait before it responds. What’s stranger is that sometimes it thinks I said something when I didn’t, maybe because it picked up on background rumbles in my car.

Entertainment 73

Entertainment Internet Internet Design 73

KeyCDN

AUGUST 15, 2019

Before you begin tuning your website or application, you must first figure out which metrics matter most to your users and establish some achievable benchmarks. Wait time: Sometimes called average latency, wait time refers the amount of time a request spends in a queue before it gets processed. What is Performance Testing?

Testing Tools 55

Testing Tools Best Practices Performance Testing Testing 55

The Morning Paper

MARCH 10, 2020

The tracing, replay, and analysis tools developed for this work are released in open source as part of the latest RocksDB release , and the new benchmark is now part of the db_bench benchmarking tool. YCSB lets you tune the query type ratio, KV-pair hotness distribution, and value size distribution. Does that matter?

Benchmarking 59

Benchmarking Storage Cache Open Source 59

Brendan Gregg

OCTOBER 8, 2018

Created by Alastair Robertson , bpftrace is an open source high-level tracing front-end that lets you analyze systems in custom ways. Back then I could already tell if disks were seeking by interpreting iostat(1) output: seeing high disk latency but small I/O. It's shaping up to be a DTrace version 2.0:

C++ 110

C++ Virtualization Programming Latency 110

Brendan Gregg

OCTOBER 7, 2018

Created by Alastair Robertson , bpftrace is an open source high-level tracing front-end that lets you analyze systems in custom ways. Back then I could already tell if disks were seeking by interpreting iostat(1) output: seeing high disk latency but small I/O. It's shaping up to be a DTrace version 2.0:

C++ 40

C++ Virtualization Programming Latency 40

The Netflix TechBlog

AUGUST 13, 2020

You’re half awake and wondering, “Is there really a problem or is this just an alert that needs tuning? This is a critical application so you drag yourself out of bed, open your laptop, and start poring through dashboards for more info. Telltale combines a variety of data sources to create a holistic view of an application’s health.

Monitoring 210

Monitoring Tuning Traffic Metrics 210

The Netflix TechBlog

JULY 26, 2021

Operational Reporting is a reporting paradigm specialized in covering high-resolution, low-latency data sets, serving detailed day-to-day activities¹ and processes of a business domain. Operational Reporting Pipeline Example Iceberg Sink Apache Iceberg is an open source table format for huge analytics datasets. Dehghani, Zhamak.

Big Data 253

Big Data Government Analytics Processing 253

The Netflix TechBlog

NOVEMBER 2, 2021

It has become a de facto standard for perceptual quality measurements within Netflix and, thanks to its open-source nature , throughout the video industry. This enables us to use our scale to increase throughput and reduce latencies. Here, based on the video length, the throughput and latency requirements, available scale etc.,

Media 171

Media Innovation Metrics Latency 171

The Netflix TechBlog

DECEMBER 17, 2019

Therefore, dumps are needed to capture the full state of a source. There are several open source CDC projects, often using the same underlying libraries, database APIs, and protocols. We want to support these systems as a source so that they can provide their data for further consumption. Figure 4— Delta Connector.

Database 197

Database Traffic Transportation Open Source 197

The Netflix TechBlog

DECEMBER 17, 2019

Therefore, dumps are needed to capture the full state of a source. There are several open source CDC projects, often using the same underlying libraries, database APIs, and protocols. We want to support these systems as a source so that they can provide their data for further consumption. Figure 4— Delta Connector.

Database 212

Database Traffic Transportation Open Source 212

Smashing Magazine

AUGUST 22, 2021

Because we are dealing with network protocols here, we will mainly look at network aspects, of which two are most important: latency and bandwidth. Latency can be roughly defined as the time it takes to send a packet from point A (say, the client) to point B (the server). Two-way latency is often called round-trip time (RTT).

Performance 105

Performance Network Latency Servers 105

Smashing Magazine

SEPTEMBER 6, 2021

Finally, not inlining resources has an added latency cost because the file needs to be requested. As such, a micro-optimization is, again, how you probably need to fine-tune things on a low level to really benefit from it. In our own early tests , I found seriously diminishing returns at about 40 files. What Does It All Mean?

Network 104

Network Servers Cache Traffic 104

Smashing Magazine

SEPTEMBER 29, 2021

Tip: When evaluating quality, compression and fine-tuning of modern formats, Squoosh.app ’s ability to perform a visual side-by-side comparison is helpful. The AV1 image file format (AVIF) is an open-source image format for storing still and animated images. Large preview ). Jump to table of contents ?. Large preview ).

Open Source 144

Open Source Speed Website Google 144