The Netflix TechBlog

NOVEMBER 22, 2019

To sustain this data growth at Netflix, it has deployed open-source software Ceph using AWS services to achieve the required SLOs of some of the post-production workflows. Netflix runs dozens of stateful services on AWS under strict sub-millisecond tail-latency requirements, which brings unique challenges.

AWS 100

AWS Entertainment Open Source Benchmarking 100

The Netflix TechBlog

JUNE 4, 2019

Because microprocessors are so fast, computer architecture design has evolved towards adding various levels of caching between compute units and the main memory, in order to hide the latency of bringing the bits to the brains. This avoids thrashing caches too much for B and evens out the pressure on the L3 caches of the machine.

Cache 251

Cache Latency Airlines Logistics 251

Dynatrace

APRIL 5, 2021

You will likely need to write code to integrate systems and handle complex tasks or incoming network requests. You can eliminate the latency issues caused by cold starts — an increase in normal response time when a new instance receives its first request — by using edge-optimized functions that run code closer to users and other projects.

Lambda 179

Lambda AWS Serverless Hardware 179

Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on. Ford, et al., “TCP

Performance 140

Performance Latency Hardware Storage 140

Scalegrid

MARCH 22, 2024

They can also bolster uptime and limit latency issues or potential downtimes. Achieving Interoperability Among Providers Achieving interoperability between providers is possible through using open source standards, employing AI-driven systems, and enabling safe data transfer across various cloud services.

Strategy 130

Strategy Cloud Government Innovation 130

Percona

JUNE 22, 2023

A monitoring tool like Percona Monitoring and Management (PMM) is a popular choice among open source options for effectively monitoring MySQL performance. Replication lag can occur due to various factors such as network latency, system resource limitations, complex transactions, or heavy write loads on the primary/master database.

Performance 103

Performance Monitoring Traffic Database 103

Dynatrace

JULY 6, 2020

Azure Virtual Network Gateways. Our customers have frequently requested support for this first new batch of services, which cover databases, big data, networks, and computing. It enables you to use popular open-source frameworks such as Hadoop, Spark, and Kafka in Azure cloud environments. Azure DB for PostgreSQL.

Azure 147

Azure Cloud Big Data Virtualization 147

Brendan Gregg

FEBRUARY 28, 2023

My personal opinion is that I don't see a widespread need for more capacity given horizontal scaling and servers that can already exceed 1 Tbyte of DRAM; bandwidth is also helpful, but I'd be concerned about the increased latency for adding a hop to more memory. Ford, et al., “TCP

Performance 110

Performance Latency Cache Virtualization 110

Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on. Ford, et al., “TCP

Performance 52

Performance Latency Hardware Storage 52

Brendan Gregg

FEBRUARY 28, 2023

My personal opinion is that I don't see a widespread need for more capacity given horizontal scaling and servers that can already exceed 1 Tbyte of DRAM; bandwidth is also helpful, but I'd be concerned about the increased latency for adding a hop to more memory. Ford, et al., “TCP

Performance 52

Performance Latency Cache Virtualization 52

The Morning Paper

FEBRUARY 23, 2020

There are five different types of member in an AnyLog system, and any network node can join without restriction as any type of member. Publishers are the producers of the actual data to be served by the network. Given their position of power in the network, such caching seems to be highly incentivised in the absence of such mechanisms.

Blockchain 94

Blockchain Internet Internet IoT 94

Testsigma

AUGUST 24, 2020

Maintaining test data in a central repository and then accessing it from different test environments may ease this problem but may introduce other issues like network latency in tests. The right combination of open source and paid test frameworks/tools can be used rather than relying solely on open-source test frameworks/tools.

Testing 69

Testing Open Source Scalability Latency 69

Brendan Gregg

AUGUST 18, 2019

bpftrace is a new open source tracer for Linux for analyzing production performance problems and troubleshooting software. For example, iostat(1), or a monitoring agent, may tell you your average disk latency, but not the distribution of this latency. Block I/O latency as a histogram. 1 /* 2 * biolatency.bt

Latency 68

Latency C++ Cache Programming 68

The Netflix TechBlog

NOVEMBER 22, 2019

To sustain this data growth at Netflix, it has deployed open-source software Ceph using AWS services to achieve the required SLOs of some of the post-production workflows. Netflix runs dozens of stateful services on AWS under strict sub-millisecond tail-latency requirements, which brings unique challenges.

AWS 37

AWS Entertainment Open Source Benchmarking 37

The Morning Paper

SEPTEMBER 5, 2019

For response times (latencies) reporting a simple metric such as ‘average’ is next to useless. Instead we want to understand what’s happening at different latency percentiles (e.g A characteristic of latency distributions is that they have a long tail. Why do we need a new sketch? At the 50th percentile, an accuracy within 0.5%

Latency 52

Latency Metrics Open Source Java 52

Scalegrid

MARCH 28, 2024

Redis Revealed: An Overview Redis, a renowned open-source, in-memory remote dictionary server, stands out for its diverse data structures and advanced features. Memcached Explained: The Simplicity of Caching Alternatively, Memcached, a high-performance, open-source caching solution, prides itself on its simplicity.

Cache 130

Cache Storage Scalability Architecture 130

Adrian Cockcroft

NOVEMBER 18, 2019

We’re excited to let you know that we have an Open Source track at re:Invent this year! Brendan Gregg tours BPF tracing, with open source tools & examples for EC2 instance analysis. OPN304 Learnings from migrating a service from JDK 8 to JDK 11 AWS Lambda improved latency by migrating to JDK 11 with Amazon Corretto.

Open Source 40

Open Source AWS Lambda Serverless 40

Adrian Cockcroft

NOVEMBER 18, 2019

We’re excited to let you know that we have an Open Source track at re:Invent this year! Brendan Gregg tours BPF tracing, with open source tools & examples for EC2 instance analysis. OPN304 Learnings from migrating a service from JDK 8 to JDK 11 AWS Lambda improved latency by migrating to JDK 11 with Amazon Corretto.

Open Source 40

Open Source AWS Lambda Serverless 40

CSS - Tricks

JULY 25, 2019

Lighthouse is an open source project run by a dedicated team from Google Chrome. Estimated Input Latency. Estimated Input Latency. Now that we know where the PageSpeed score comes from, let’s dive into how it’s calculated, and how we can make meaningful improvements. What is Google Lighthouse? Speed Index. First CPU Idle.

Google 71

Google Engineering Speed Mobile 71

Abhishek Tiwari

JULY 12, 2018

Here are 8 fallacies of data pipeline The pipeline is reliable Topology is stateless Pipeline is infinitely scalable Processing latency is minimum Everything is observable There is no domino effect Pipeline is cost­-effective Data is homogeneous The pipeline is reliable The inconvenient truth is that pipeline is not reliable.

Latency 63

Latency Analytics Scalability Engineering 63

Brendan Gregg

OCTOBER 8, 2018

Created by Alastair Robertson , bpftrace is an open source high-level tracing front-end that lets you analyze systems in custom ways. eBPF was created by Alexei Starovoitov while at PLUMgrid (he's now at Facebook) as a generic in-kernel virtual machine, with software defined networks as the primary use case. eBPF does more.

C++ 110

C++ Virtualization Programming Latency 110

KeyCDN

AUGUST 15, 2019

Wait time: Sometimes called average latency, wait time refers the amount of time a request spends in a queue before it gets processed. Google Lighthouse Google Lighthouse is a free and open source tool that is part of the Google Chrome DevTools family. Peak response time: The longest response time.

Testing Tools 55

Testing Tools Best Practices Performance Testing Testing 55

Percona

JULY 20, 2023

We often forget or take for granted the network hops involved and the additional overhead it creates on the overall performance. TCP/IP connection, triggered me to write about other aspects of network impact on performance. How to detect and measure the impact There is no easy mechanism for measuring the impact of network overhead.

Network 61

Network Performance Latency Servers 61

Percona

MARCH 29, 2023

In this blog, we will discuss both data and network-level compression offered in MongoDB. We will discuss snappy and zstd for data block and zstd compression in a network. By default, MongoDB provides a snappy block compression method for storage and network communication. I am using PSMDB 6.0.4

Storage 106

Storage Network Open Source Latency 106

Percona

APRIL 13, 2023

PostgreSQL is a popular open source relational database management system that is widely used for storing and managing data. In PostgreSQL, replication lag can occur due to various reasons such as network latency, slow disk I/O, long-running transactions, etc. What is replication lag?

Latency 79

Latency Tuning Open Source Network 79

Dynatrace

MAY 17, 2023

OpenTelemetry , the open source observability tool, has become the go-to standard for instrumenting custom applications to collect observability telemetry data. This allows us to quickly tell whether the network link may be saturated or the processor is running at its limit.

Metrics 171

Metrics Database Monitoring Network 171

The Morning Paper

MAY 12, 2019

An open-source benchmark suite for microservices and their hardware-software implications for cloud & edge systems Gan et al., It’s a pretty impressive effort to pull together and make available in open source (not yet available as I write this) such a suite, and I’m sure explains much of the long list of 24 authors on this paper.

Open Source 61

Open Source Hardware Benchmarking Systems 61

Abhishek Tiwari

DECEMBER 27, 2017

optimised container networking and security. To address this, the open source community is now trying to develop Kubernetes custom schedulers specifically optimised for big data workloads. Some of these challenges [6] includes, lack of smart schedulers for optimal resource utilization.

Big Data 63

Big Data Storage Benchmarking Hardware 63

The Netflix TechBlog

FEBRUARY 20, 2019

Today we are excited to announce latency heatmaps and improved container support for our on-host monitoring solution?—?Vector?—?to Vector is open source and in use by multiple companies. Remotely view real-time process scheduler latency and tcp throughput with Vector and eBPF What is Vector? to the broader community.

Performance 211

Performance Latency Open Source Metrics 211

Percona

NOVEMBER 9, 2023

At its core, Kubernetes (often abbreviated as K8s) is an open source tool that automates the deployment, scaling, and management of containerized applications. Kubernetes manages and orchestrates these containers, handling tasks such as deployment, scaling, load balancing, and networking.

Efficiency 100

Efficiency Cloud Healthcare Open Source 100

Brendan Gregg

OCTOBER 7, 2018

Created by Alastair Robertson , bpftrace is an open source high-level tracing front-end that lets you analyze systems in custom ways. eBPF was created by Alexei Starovoitov while at PLUMgrid (he's now at Facebook) as a generic in-kernel virtual machine, with software defined networks as the primary use case. eBPF does more.

C++ 40

C++ Virtualization Programming Latency 40

Dynatrace

APRIL 6, 2022

Endpoints include on-premises servers, Kubernetes infrastructure, cloud-hosted infrastructure and services, and open-source technologies. Not just infrastructure connections, but the relationships and dependencies between containers, microservices , and code at all network layers.

DevOps 230

DevOps Innovation Infrastructure Analytics 230

Smashing Magazine

AUGUST 3, 2023

You need to beware that slow server response times can significantly increase TTFB, often due to server overload, network issues, or un-optimized logic on the server side. You need to beware of large HTML files or slow network connections because they can lead to longer download times. Here’s how we do it at Bookaway.

Performance 74

Performance Cache Traffic Metrics 74

All Things Distributed

JULY 20, 2015

The pool of resources, at this time, is the CPU, memory, and networking resources of Amazon EC2 instances as partitioned by containers. networks ports, memory, CPU, etc). This key/value store acts as the single source of truth for all information on the cluster (state, and all changes to state transitions) are entered and stored here.

Latency 166

Latency Architecture AWS Open Source 166

Percona

DECEMBER 26, 2023

This allows for much better data accuracy, especially in the case of high-resolution or unreliable networks. Percona Distribution for PostgreSQL provides the best and most critical enterprise components from the open-source community, in a single distribution, designed and tested to work together. Happy monitoring!

Benchmarking 120

Benchmarking Metrics C++ Database 120

High Scalability

SEPTEMBER 8, 2018

To meet user-defined goals for performance (request latency) and cost, the monitoring service tracks and adjusts resources to workload changes. This increases the cores and network bandwidth available to serve common requests. Each storage server collects statistics about the requests it serves, the data it stores, etc.

Storage 199

Storage Performance AWS Efficiency 199

Smashing Magazine

AUGUST 22, 2021

As we will see, QUIC and HTTP/3 indeed have great web performance potential, but mainly for users on slow networks. If your average visitor is on a fast cabled or cellular network, they probably won’t benefit from the new protocols all that much. Two-way latency is often called round-trip time (RTT). Congestion Control.

Performance 105

Performance Network Latency Servers 105