The Netflix TechBlog

NOVEMBER 22, 2019

4:45pm-5:45pm NFX 202 A day in the life of a Netflix Engineer Dave Hahn , SRE Engineering Manager Abstract : Netflix is a large, ever-changing ecosystem serving millions of customers across the globe through cloud-based systems and a globally distributed CDN. We explore all the systems necessary to make and stream content from Netflix.

AWS 100

AWS Entertainment Open Source Benchmarking 100

Percona

JUNE 22, 2023

Indexing efficiency Monitoring indexing efficiency in MySQL involves analyzing query performance, using EXPLAIN statements, utilizing performance monitoring tools, reviewing error logs, performing regular index maintenance, and benchmarking/testing. This KPI is also directly related to Query Performance and helps improve it.

Performance 102

Performance Monitoring Traffic Database 102

The Morning Paper

AUGUST 29, 2019

use the TPC-H benchmark to assess Redshift, Redshift Spectrum, Athena, Presto, Hive, and Vertica to find out what works best and the trade-offs involved. We focused on OLAP-oriented parallel data warehouse products available for AWS and restricted our attention to commercially available systems. Key findings. Query restrictions.

Architecture 76

Architecture Cloud Storage Serverless 76

HammerDB

DECEMBER 5, 2020

The HammerDB TPROC-C workload by design intended as CPU and memory intensive workload derived from TPC-C – so that we get to benchmark at maximum CPU performance at a much smaller database footprint. For TPC-C this meant enough available spindles to reduce I/O latency and for TPC-H enough bandwidth for data throughput.

C++ 40

C++ Benchmarking Virtualization Open Source 40

Percona

SEPTEMBER 1, 2023

A finely tuned database processes queries more efficiently, leading to swifter results. This reduction in latency ensures that applications and websites provide a more rapid and responsive user experience. Resource contention emerges when multiple database operations vie for the same system resources simultaneously.

Tuning 52

Tuning Database Performance Hardware 52

The Netflix TechBlog

NOVEMBER 22, 2019

4:45pm-5:45pm NFX 202 A day in the life of a Netflix Engineer Dave Hahn , SRE Engineering Manager Abstract : Netflix is a large, ever-changing ecosystem serving millions of customers across the globe through cloud-based systems and a globally distributed CDN. We explore all the systems necessary to make and stream content from Netflix.

AWS 37

AWS Entertainment Open Source Benchmarking 37

Abhishek Tiwari

DECEMBER 27, 2017

In 2018, a widespread adaptation of Kubernetes for big data processing is anitcipated. A recent performance benchmark completed by Intel and BlueData using the BigBench benchmarking kit has shown that the performance ratios for container-based Hadoop workloads on BlueData EPIC are equal to and in some cases, better than bare-metal Hadoop [7].

Big Data 63

Big Data Storage Benchmarking Hardware 63

Scalegrid

MARCH 28, 2024

Redis can be configured to optimally utilize both RDB and AOF persistence methods optimally, achieving a balance between speed and data safety while minimizing the impact on response times due to its child process handling for disk writes. Scalable reads across multiple instances are possible. step in to simplify this task.

Cache 130

Cache Storage Scalability Architecture 130

Smashing Magazine

SEPTEMBER 28, 2022

Every unnecessary bit of JavaScript code you bundle and serve will be more code the client has to load and process. On your first try, you can use it as a benchmark for optimizations later. On design systems, UX, web performance and CSS/JS. The rule of thumb is the less, the better. Jump to online workshops ?. Caching Schemes.

Cache 125

Cache Performance Servers Social Media 125

Percona

DECEMBER 26, 2023

This simplifies debugging and analysis processes by enabling users to execute the same query. A script executing a benchmarking run: #!/bin/bash Capture Actual Parameters in the Queries : pg_stat_monitor allows you to choose if you want to see queries with placeholders for parameters or actual parameter data.

Benchmarking 119

Benchmarking Metrics C++ Database 119

The Morning Paper

MAY 12, 2019

An open-source benchmark suite for microservices and their hardware-software implications for cloud & edge systems Gan et al., Systems built with lots of microservices have different operational characteristics to those built from a small number of monoliths, we’d like to study and better understand those differences.

Open Source 61

Open Source Hardware Benchmarking Systems 61

Scalegrid

JULY 29, 2020

It uses only one process which makes it very lightweight. If we require N parallel connections, this forks N child processes. By default, there are 32 child processes that are forked. Pgpool-II defines one process per child process. We cannot control which child process a client connects to. Not supported.

Benchmarking 246

Benchmarking Database Performance Testing Availability 246

The Netflix TechBlog

SEPTEMBER 2, 2020

Edgar helps Netflix teams troubleshoot distributed systems efficiently with the help of a summarized presentation of request tracing, logs, analysis, and metadata. When a problem occurs, we put on our detective hats and start our mystery-solving process by gathering evidence. by Elizabeth Carretto Everyone loves Unsolved Mysteries.

Latency 296

Latency Transportation Engineering Traffic 296

The Morning Paper

SEPTEMBER 3, 2019

SLOG: serializable, low-latency, geo-replicated transactions Ren et al., SLOG is another research system motivated by the needs of the application developer (aka, user!). Building correct applications is much easier when the system provides strict serializability guarantees. VLDB’19.

Latency 70

Latency Processing Benchmarking Systems 70

HammerDB

OCTOBER 18, 2019

HammerDB doesn’t publish competitive database benchmarks, instead we always encourage people to be better informed by running their own. So over at Phoronix some database benchmarks were published showing PostgreSQL 12 Performance With AMD EPYC 7742 vs. Intel Xeon Platinum 8280 Benchmarks . uname -a Linux ubuntu19 5.3.0-rc3-custom

Benchmarking 63

Benchmarking Performance Hardware C++ 63

Dynatrace

JUNE 27, 2022

However, not all user monitoring systems are created equal. Real user monitoring (RUM) is a performance monitoring process that collects detailed data about users’ interactions with an application. In some cases, you will lack benchmarking capabilities. connectivity, access, user count, latency) of geographic regions.

Best Practices 177

Best Practices Monitoring Wireless Traffic 177

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. CLI tools The Cassandra systems were EC2 virtual machine (Xen) instances. What about short-lived processes, like a service restarting in a loop? Microbenchmark os::javaTimeMillis() on both systems.

Speed 126

Speed Java AWS Virtualization 126

Scalegrid

JANUARY 12, 2024

Simply put, it’s the set of computational tasks that cloud systems perform, such as hosting databases, enabling collaboration tools, or running compute-intensive algorithms. In the realm of cloud-based business operations, there is an increasing dependence on complex information processing patterns. What is workload in cloud computing?

Cloud 130

Cloud Virtualization Storage Efficiency 130

Particular Software

SEPTEMBER 20, 2021

Some will claim that any type of RPC communication ends up being faster (meaning it has lower latency) than any equivalent invocation using asynchronous messaging. But to be fair, we also have to process the messages on the server before we can consider the messaging case to be complete. But the answer isn’t that simple.

Benchmarking 97

Benchmarking Latency Servers Systems 97

John McCalpin

APRIL 2, 2020

The presentation discusses a family of simple performance models that I developed over the last 20 years — originally in support of processor and system design at SGI (1996-1999), IBM (1999-2005), and AMD (2006-2008), but more recently in support of system procurements at The Texas Advanced Computing Center (TACC) (2009-present).

Benchmarking 59

Benchmarking Performance Latency Architecture 59

Adrian Cockcroft

JANUARY 20, 2023

on Myths and Legends of High Performance Computing  — it’s a somewhat light-hearted look at some of the same issues by the leader of the team that built the Fugaku system I mention below. switches to connect processing nodes, pooled memory and I/O resources into very large coherent fabrics within a rack, and use Ethernet between racks.

Architecture 52

Architecture Latency Benchmarking AWS 52

Percona

MARCH 23, 2023

As datasets continue to grow in size, the amount of RAM required to store and process these datasets also increases. Operating system Linux is the most common operating system for high-performance MySQL servers. Benchmark before you decide. Transparent huge pages (THP) disabled. Refer to innodb_redo_log_capacity below.

Performance 123

Performance Hardware Tuning Storage 123

The Morning Paper

NOVEMBER 8, 2020

While ultimately this new system should be able to take advantage of the latest advances in consensus for improved performance, that’s not realistic given a 6-9 month in-production target. It’s such a powerful idea that I can imagine distributed systems implementers everywhere adopting it from now on. What does the VirtualLog give us?

Virtualization 126

Virtualization Latency Storage Systems 126

HammerDB

NOVEMBER 5, 2018

This post at an entry-level discusses the options you have to improve log throughput in your benchmark environment. . Additionally for the log disk component it is latency for an individual write that is crucial rather than the total I/O bandwidth. SQL> alter system flush buffer_cache; System altered.

Benchmarking 40

Benchmarking Database C++ Virtualization 40

Percona

JANUARY 24, 2023

This will be clearly visible in PostgreSQL performance benchmarks as a “ Sawtooth wave ” pattern observed by Vadim in his tests: As we can see, the throughput suddenly drops after every checkpoint due to heavy WAL writing and gradually picks up until the next checkpoint. But this comes with a considerable performance implication.

Database 114

Database Benchmarking Open Source Latency 114

Percona

APRIL 7, 2023

To illustrate this, I ran the Sysbench-TPCC synthetic benchmark against two different GCP instances running a freshly installed Percona Server for MySQL version 8.0.31 on CentOS 7, both of them spec’d with four vCPUs but with the second one (server B) having a tad over twice as much memory than the reference one (server A).

Tuning 133

Tuning Cache Servers Benchmarking 133

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. CLI tools The Cassandra systems were EC2 virtual machine (Xen) instances. What about short-lived processes, like a service restarting in a loop? Microbenchmark os::javaTimeMillis() on both systems.

Speed 52

Speed Java AWS Virtualization 52

Alex Russell

MAY 9, 2022

This is a complex topic, but to borrow from a recent post , web performance expands access to information and services by reducing latency and variance across interactions in a session, with a particular focus on the tail of the distribution (P75+). Only teams that master their systems can make intentional trade-offs.

Performance 86

Performance Latency Metrics Engineering 86

High Scalability

DECEMBER 3, 2019

During this time, you are also likely to experience a degraded performance of queries as your system resources are busy in index-creation work as well. In this blog post, we discuss an approach to optimize the MySQL index creation process in such a way that your regular workload is not impacted. MySQL Rolling Index Creation.

Best Practices 21

Best Practices Performance Systems Processing 21

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. CLI tools The Cassandra systems were EC2 virtual machine (Xen) instances. What about short-lived processes, like a service restarting in a loop? Microbenchmark os::javaTimeMillis() on both systems.

Speed 40

Speed Java AWS Virtualization 40

Particular Software

OCTOBER 26, 2020

Backed by Cosmos DB, a fully managed, globally distributed, elastically scaled, pay-as-you-go service, your NServiceBus-based systems can benefit from guaranteed single-digit-millisecond latency with 99.999% availability. CosmosClient(new CosmosClient("ConnectionString")).DefaultContainer(

Azure 52

Azure Storage Benchmarking Latency 52

Alex Russell

APRIL 29, 2021

As an engineer on a browser team, I'm privy to the blow-by-blow of various performance projects, benchmark fire drills, and the ways performance marketing (deeply) impacts engineering priorities. With each team, benchmarks lost are understood as bugs. All modern browsers are fast, Chromium and Safari/WebKit included. Media Session API.

Media 145

Media Games Education Engineering 145

Percona

JULY 1, 2023

It efficiently manages read and write operations, optimizes data access, and minimizes contention, resulting in high throughput and low latency to ensure that applications perform at their best. This capability is valuable for reverting to a previous state, whether to recover from data corruption or any other incident.

AWS 52

AWS Database Serverless Storage 52

IO River

NOVEMBER 15, 2023

It's an ongoing, iterative process. This involves:Threat Intelligence: Keeping an eye on the latest types of attacks, whether it's a novel form of SQL injection or a new phishing tactic.Internal Audits: Regularly scanning your own system for vulnerabilities. WAFs can rate-limit incoming requests, creating a sort of queue system.

Traffic 52

Traffic Network Logistics Architecture 52

Alex Russell

OCTOBER 22, 2017

Budgets are scaled to a benchmark network & device. Tools and CI systems help them monitor progress & prevent regressions. Answering it requires an understanding of how browsers process resources (which differs by type) and the concept of the critical path. Some systems show median RTTs near ~100ms for 3G users.

Performance 68

Performance Benchmarking Network Mobile 68

Alex Russell

MARCH 6, 2021

Advances in browser content processing. Using a global ASP as a benchmark can further mislead thanks to the distorting effect of ultra-high-end prices rising while shipment volumes stagnate. Instead, experience teaches that it's the process of taking care to attend to those least-well-off that changes outcomes.

Performance 124

Performance Network Cache Metrics 124

Alex Russell

JANUARY 30, 2024

Put another way, the performance gap between what devices the wealthy carry and what budget shoppers carry grew more this year (252 points) than the year-over-year gains from process and architecture at the volume price point (174 points). GHz Cortex-A53) on a 10nm process : Geekbench 6 scores for the Galaxy A51 versus today's leading device.

Performance 90

Performance Network Mobile Speed 90