The Netflix TechBlog

NOVEMBER 22, 2019

4:45pm-5:45pm NFX 209 File system as a service at Netflix Kishore Kasi , Senior Software Engineer Abstract : As Netflix grows in original content creation, its need for storage is also increasing at a rapid pace. In order to maintain performance, benchmarking is a vital part of our system’s lifecycle. Thursday?—?December

AWS 100

AWS Entertainment Open Source Benchmarking 100

The Netflix TechBlog

NOVEMBER 22, 2019

4:45pm-5:45pm NFX 209 File system as a service at Netflix Kishore Kasi , Senior Software Engineer Abstract : As Netflix grows in original content creation, its need for storage is also increasing at a rapid pace. In order to maintain performance, benchmarking is a vital part of our system’s lifecycle. Thursday?—?December

AWS 100

AWS Entertainment Open Source Benchmarking 100

Percona

JUNE 22, 2023

Let’s dive in and learn how (and what) to effectively monitor MySQL performance, along with examples from PMM, by understanding the critical KPIs to watch for. This is not an exhaustive list but an example of what we can watch for. This KPI is also directly related to Query Performance and helps improve it.

Performance 105

Performance Monitoring Traffic Database 105

Percona

MARCH 23, 2023

Storage The type of storage and disk used for database servers can have a significant impact on performance and reliability. Each of them has its own limits and advantages: for example, XFS is fast in deleting large files, while EXT4 can provide better performance on fast SSD drives, and ZFS on Linux has progressed a lot.

Performance 127

Performance Hardware Tuning Storage 127

The Morning Paper

NOVEMBER 8, 2020

The initial version of Delos went into production after eight months using a ZooKeeper-backed Loglet implementation, and then four months later it was swapped out for a new custom-built NativeLoglet that gave a 10x improvement in end-to-end latency. replacing Paxos with Raft), or they could be shims over external storage systems.

Virtualization 126

Virtualization Latency Storage Systems 126

Percona

APRIL 7, 2023

To illustrate this, I ran the Sysbench-TPCC synthetic benchmark against two different GCP instances running a freshly installed Percona Server for MySQL version 8.0.31 In MySQL, considering the standard storage engine, InnoDB , the data cache is called Buffer Pool. MySQL (B) 2517529 2610323 389048 5516900 194140 11523.48

Tuning 137

Tuning Cache Servers Benchmarking 137

n0derunner

SEPTEMBER 17, 2018

Creating a HCI benchmark to simulate multi-tennent workloads. As with traditional storage, applications are writing to a shared storage environment which is necessary to support VM movement. As with traditional storage, applications are writing to a shared storage environment which is necessary to support VM movement.

Performance Testing 40

Performance Testing Benchmarking Testing Performance 40

Percona

JANUARY 24, 2023

For example, MySQL/InnoDB deals with this problem using a Doublewrite buffer from where a copy of the non-corrupt page can be obtained during the recovery. Lz4 is a good example. Individual processes generate WAL records, and latency is very crucial for transactions. PostgreSQL’s approach to the problem is slightly different.

Database 118

Database Benchmarking Open Source Latency 118

HammerDB

NOVEMBER 5, 2018

This post at an entry-level discusses the options you have to improve log throughput in your benchmark environment. . Additionally for the log disk component it is latency for an individual write that is crucial rather than the total I/O bandwidth. A good example of how tuning is an iterative process. Oracle Log File Sync.

Benchmarking 40

Benchmarking Database C++ Virtualization 40

Percona

JULY 1, 2023

It efficiently manages read and write operations, optimizes data access, and minimizes contention, resulting in high throughput and low latency to ensure that applications perform at their best. While RDS MySQL supports multiple storage engines with varying capabilities, not all of them are optimized for crash recovery and data durability.

AWS 52

AWS Database Serverless Storage 52

SQL Performance

APRIL 8, 2019

Back on December 5, 2017, Microsoft announced that they were using AMD EPYC 7551 processors in their storage-optimized Lv2-Series virtual machines. The pricing details for the East US region are here , as an example. I wrote about using CPU-Z to benchmark the Intel Xeon E5-2673 v3 processor in an Azure VM in this article.

Azure 42

Azure Virtualization Storage Benchmarking 42

HammerDB

DECEMBER 5, 2020

For example HammerDB has not used tpmC terminology to report TPC-C based metrics instead using TPM and NOPM nomenclature. The HammerDB TPROC-C workload by design intended as CPU and memory intensive workload derived from TPC-C – so that we get to benchmark at maximum CPU performance at a much smaller database footprint.

C++ 40

C++ Benchmarking Virtualization Open Source 40

Smashing Magazine

SEPTEMBER 28, 2022

On your first try, you can use it as a benchmark for optimizations later. Jamstack files usually use Markdown before being compiled to HTML, for example: author: Agustinus Theodorus title: ‘Title’ description: Description. Caching partially stores your data and is not used as permanent storage. Hello World. Caching Schemes.

Cache 125

Cache Performance Servers Social Media 125

Abhishek Tiwari

DECEMBER 27, 2017

faster access to external storage and data locality (I/O, bandwidth). A recent performance benchmark completed by Intel and BlueData using the BigBench benchmarking kit has shown that the performance ratios for container-based Hadoop workloads on BlueData EPIC are equal to and in some cases, better than bare-metal Hadoop [7].

Big Data 63

Big Data Storage Benchmarking Hardware 63

Percona

SEPTEMBER 1, 2023

This reduction in latency ensures that applications and websites provide a more rapid and responsive user experience. High CPU usage, for example, can indicate that your server is under heavy processing load, possibly due to poorly optimized queries or increased user activity. This does not apply to read (SELECT) traffic.

Tuning 52

Tuning Database Performance Hardware 52

The Netflix TechBlog

NOVEMBER 22, 2019

4:45pm-5:45pm NFX 209 File system as a service at Netflix Kishore Kasi , Senior Software Engineer Abstract : As Netflix grows in original content creation, its need for storage is also increasing at a rapid pace. In order to maintain performance, benchmarking is a vital part of our system’s lifecycle. Thursday?—?December

AWS 37

AWS Entertainment Open Source Benchmarking 37

Alex Russell

MARCH 6, 2021

A then-representative $200USD device had 4-8 slow (in-order, low-cache) cores, ~2GiB of RAM, and relatively slow MLC NAND flash storage. The Moto G4 , for example. Using a global ASP as a benchmark can further mislead thanks to the distorting effect of ultra-high-end prices rising while shipment volumes stagnate.

Performance 124

Performance Network Cache Metrics 124

Alex Russell

OCTOBER 22, 2017

Budgets are scaled to a benchmark network & device. If our example document wasn’t reliant on JavaScript to construct the <my-app> custom element, the contents of the document would likely be interactive as soon as enough CSS and content was available to render meaningfully. Construction of DOM. Global Ground-Truth.

Performance 68

Performance Benchmarking Network Mobile 68

HammerDB

OCTOBER 12, 2018

As with the previous guides as an Intel employee (#IAMINTEL) the examples are taken from a MySQL 8 on Linux on Intel system and the approach is the same for whatever system you are testing although some of the settings you see may be different. an example is shown of the shortest of these: . HammerDB difference from Sysbench.

Best Practices 40

Best Practices Scalability Performance C++ 40

Alex Russell

APRIL 29, 2021

As an engineer on a browser team, I'm privy to the blow-by-blow of various performance projects, benchmark fire drills, and the ways performance marketing (deeply) impacts engineering priorities. With each team, benchmarks lost are understood as bugs. Chrome has missed several APIs for 3+ years: Storage Access API.

Media 145

Media Games Education Engineering 145

The Netflix TechBlog

SEPTEMBER 2, 2020

Example call graph in Edgar In some cases, the question we’re answering is, “What’s happening right now??” This difference has substantial technological implications, from the classification of what’s interesting to transport to cost-effective storage (keep an eye out for later Netflix Tech Blog posts addressing these topics).

Latency 296

Latency Transportation Engineering Traffic 296

SQL Server According to Bob

JANUARY 11, 2020

Stable Media Stable media is often confused with physical storage. SQL Server defines stable media as storage that can survive system restart or common failure. Stable media is commonly physical disk storage, but other devices and certain caching facilities qualify as well.

Servers 40

Servers Cache Media Hardware 40

ScaleOut Software

MAY 15, 2014

For example, the IMDG must be able to efficiently create millions of objects in each server to make use of its huge storage capacity. Likewise, object access paths must be heavily multi-threaded and avoid lock contention to minimize access latency and maximize throughput. Testing Scale-Up Performance.

Cache 40

Cache Servers Network Design 40

SQL Server According to Bob

JANUARY 11, 2020

As ​​ a ​​ simple ​​ example, ​​ take the following ​​ 2-byte string value of “AB” and apply a formula to it (Value = Position + ASCII value). ​​ Checksum ​​ is ​​ the sum of the values.

Servers 40

Servers Cache Database Media 40

Smashing Magazine

JANUARY 6, 2020

Run performance experiments and measure outcomes — both on mobile and on desktop (for example, with Google Analytics ). Rather than focusing on full page loading time (via onLoad and DOMContentLoaded timings, for example), prioritize page loading as perceived by your customers. What does it mean?

Performance 145

Performance Cache Network Metrics 145

Smashing Magazine

JANUARY 11, 2021

For example, to make performance more tangible, you could expose the revenue performance impact by showing the correlation between the conversion rate and time to application load, as well as rendering performance. Run performance experiments and measure outcomes — both on mobile and on desktop (for example, with Google Analytics ).

Performance 145

Performance Cache Media Metrics 145