Brendan Gregg

JUNE 29, 2018

These have inspired me to summarize another performance activity: evaluating benchmark accuracy. Accurate benchmarking rewards engineering investment that actually improves performance, but, unfortunately, inaccurate benchmarking is more common. If the benchmark reported 20k ops/sec, you should ask: why not 40k ops/sec?

Benchmarking 40

Benchmarking Latency Cache Network 40

Percona

NOVEMBER 3, 2023

xlarge 4vCPU 8GB-RAM Storage: EBS volume (root) 80GB gp2 (IOPS 240/3000) As well, high availability will be integrated, guaranteeing cluster viability in the case that one worker node goes down. And now, execute the benchmark: -- execute the following on the coordinator node pgbench -c 20 -j 3 -T 60 -P 3 pgbench The results are not pretty.

Database 102

Database Benchmarking Latency C++ 102

The Netflix TechBlog

OCTOBER 19, 2020

Our distributed tracing infrastructure is grouped into three sections: tracer library instrumentation, stream processing, and storage. We earned the trust of our engineers by developing empathy for their operational burden and by focusing on providing efficient tracer library integrations in runtime environments.

Infrastructure 233

Infrastructure Transportation Storage Open Source 233

HammerDB

JANUARY 5, 2019

Some opinions claim that “Benchmarks are meaningless”, “benchmarks are irrelevant” or “benchmarks are nothing like your real applications” However for others “Benchmarks matter,” as they “account for the processing architecture and speed, memory, storage subsystems and the database engine.”

Benchmarking 40

Benchmarking Database Social Media Scalability 40

Scalegrid

JANUARY 12, 2024

Storage is a critical aspect to consider when working with cloud workloads. High availability storage options within the context of cloud computing involve highly adaptable storage solutions specifically designed for storing vast amounts of data while providing easy access to it.

Cloud 130

Cloud Virtualization Storage Efficiency 130

Scalegrid

DECEMBER 6, 2023

This model offers hassle-free database management as well as access to an extensive suite of services that reduce developer workloads and enhance security while providing operational agility. Understanding the Database as a Service Model With DBaaS, businesses can enjoy a comprehensive and fully managed cruise experience.

Database 130

Database Cloud Hardware Storage 130

n0derunner

OCTOBER 5, 2020

How to speed up your X-ray benchmark development cycle by re-using/re-cycling benchmark VMs and more importantly data-sets. Assuming we have enough storage bandwidth, the throughput. Problem: For large datasets, creating the data on-disk can be time consuming.

Benchmarking 52

Benchmarking Storage Speed Development 52

HammerDB

JUNE 27, 2022

HammerDB is a software application for database benchmarking. Why HammerDB was developed. Databases are highly sophisticated software, and to design and run a fair benchmark workload is a complex undertaking. HammerDB development. Usage and industry adoption. Derived Workloads.

Benchmarking 62

Benchmarking Open Source C++ Cache 62

The Netflix TechBlog

NOVEMBER 22, 2019

4:45pm-5:45pm NFX 209 File system as a service at Netflix Kishore Kasi , Senior Software Engineer Abstract : As Netflix grows in original content creation, its need for storage is also increasing at a rapid pace. In order to maintain performance, benchmarking is a vital part of our system’s lifecycle.

AWS 100

AWS Entertainment Open Source Benchmarking 100

The Netflix TechBlog

NOVEMBER 22, 2019

4:45pm-5:45pm NFX 209 File system as a service at Netflix Kishore Kasi , Senior Software Engineer Abstract : As Netflix grows in original content creation, its need for storage is also increasing at a rapid pace. In order to maintain performance, benchmarking is a vital part of our system’s lifecycle.

AWS 100

AWS Entertainment Open Source Benchmarking 100

n0derunner

MAY 6, 2019

A 2007 paper, that still has lots to say on the subject of benchmarking storage and filesystems. Primarily aimed at researchers and developers, but is relevant to anyone about to embark on a benchmarking effort. A Nine year study of filesystem and storage benchmarking Download. The post New (Old) Paper.

Benchmarking 40

Benchmarking Storage Cache Testing 40

Particular Software

SEPTEMBER 20, 2021

Sometimes developers only care about speed. Why RPC is “faster” It’s tempting to simply write a micro-benchmark test where we issue 1000 requests to a server over HTTP and then repeat the same test with asynchronous messages. But that’s just a micro-benchmark and doesn’t tell you the whole story. Messaging doesn’t do that.

Benchmarking 97

Benchmarking Latency Servers Systems 97

Percona

JULY 1, 2023

Download our eBook, “ Enterprise Guide to Cloud Databases ” to help you make more informed decisions and avoid costly mistakes as you develop and execute your cloud strategy. Amazon Aurora is a proprietary, cloud-native, fully managed relational database service developed by Amazon Web Services (AWS).

AWS 52

AWS Database Serverless Storage 52

Percona

JANUARY 19, 2023

It can help us to save costs on storage and backup times. While MySQL can handle large data sets, it is always recommended to keep only the used data in the databases, as this will make data access more efficient, and also will help to save costs on storage and backups. 1 mysql mysql 704M Dec 30 02:28 employees.ibd -rw-r --.

Open Source 85

Open Source Storage Database Big Data 85

Percona

JULY 25, 2023

After the “data dictionary” (DD) engine and DD cache are initialized on a server, the Storage Engines can ask for a table definition. Benchmarks xtrabackup –prepare on backup directory of other sizes like 10K, 50K, 100K, and 250K tables. This search tuple (key) is used to find the record to perform the undo operation.

Cache 83

Cache Benchmarking Servers Design 83

Percona

JANUARY 24, 2023

This will be clearly visible in PostgreSQL performance benchmarks as a “ Sawtooth wave ” pattern observed by Vadim in his tests: As we can see, the throughput suddenly drops after every checkpoint due to heavy WAL writing and gradually picks up until the next checkpoint. But this comes with a considerable performance implication.

Database 114

Database Benchmarking Open Source Latency 114

Abhishek Tiwari

DECEMBER 27, 2017

faster development and deployment cycles. faster access to external storage and data locality (I/O, bandwidth). The good news is all of these challenges including performance can be tackled and in several cases, there are new developments to overcome them. Storage provisioning. better cluster resource utilization.

Big Data 63

Big Data Storage Benchmarking Hardware 63

Adrian Cockcroft

JUNE 21, 2022

Another big jump, but now it was my job to run benchmarks in the lab, and write white papers that explained the new products to the world, as they were launched. I was mostly coding in C, tuning FORTRAN, and when I needed to do a lot of data analysis of benchmark results used the S-PLUS statistics language, that is the predecessor to R.

Tuning 52

Tuning Benchmarking Engineering C++ 52

Percona

MAY 1, 2023

It is primarily the responsibility of the database administrator or developer to tune PostgreSQL according to their system’s workload. Hardware optimization : You need to ensure that the CPU, memory, and storage components meet the performance requirements of the database workload. Why is PostgreSQL performance tuning important?

Tuning 52

Tuning Efficiency Database Performance 52

Smashing Magazine

SEPTEMBER 28, 2022

On your first try, you can use it as a benchmark for optimizations later. Developing software is becoming easier as frameworks like React, Vue, or Angular become the go-to solution for creating even the simplest applications. Because of this, Jamstack apps usually load faster, but it’s harder for developers to make dynamic content.

Cache 125

Cache Performance Servers Social Media 125

SQL Performance

APRIL 8, 2019

Back on December 5, 2017, Microsoft announced that they were using AMD EPYC 7551 processors in their storage-optimized Lv2-Series virtual machines. I wrote about using CPU-Z to benchmark the Intel Xeon E5-2673 v3 processor in an Azure VM in this article. Figure 1: CPU-Z Benchmark Results for LS16v2. Memory (GiB).

Azure 42

Azure Virtualization Storage Benchmarking 42

HammerDB

DECEMBER 1, 2022

Jobs Configuration and Storage. The base configuration for the jobs storage can be found in the generic.xml file in the commandline section. <commandline> If the storage of job related data is not desired, then it is possible to disable/enable this feature with the jobs disable command. Use a different Browser.

Virtualization 57

Virtualization C++ Storage Database 57

The Morning Paper

NOVEMBER 26, 2019

Quark has three main components: A library of MRDT modules for basic data structures such as lists and binary trees, and a collection of signatures and functions that help in the development of new MRDTs. ” The authors also implemented four large application benchmarks (TPC-C, TPC-E, RUBiS, and Twissandra) as a collection of MRDTs.

C++ 98

C++ Storage Benchmarking Efficiency 98

Scalegrid

JULY 13, 2020

In this article, we compare Oracle vs. PostgreSQL, outlining the differences in these SQL database costs, features, and ease of use for both developers and database administrators (DBA’s) alike. PostgreSQL is an open source object-relational database system with over 30 years of active development. At a glance – TLDR.

Open Source 244

Open Source Tuning C++ Database 244

The Morning Paper

SEPTEMBER 15, 2019

If the smart chain developer doesn’t provide an implementation, then the default behaviour is to make all identifiers in the read set of the transaction be dependencies of every write in the write set. My biggest question here is what guarantees we can have on provenance when the developer does provide their own implementation.

Blockchain 55

Blockchain Efficiency Systems Storage 55

Percona

DECEMBER 20, 2018

As the MyRocks storage engine (based on the RocksDB key-value store [link] ) is now available as part of Percona Server for MySQL 5.7 , I wanted to take a look at how it performs on a relatively high-end server and SSD storage. MySQL stored procedures, functions and triggers are tempting constructs for application developers.

Database 40

Database Tuning Performance AWS 40

Percona

AUGUST 30, 2018

Let’s examine the TPC-C Benchmark from this point of view, or more specifically its implementation in Sysbench. The illustrations below are taken from Percona Monitoring and Management (PMM) while running this benchmark. Analyzing read/write workload by counts.

Benchmarking 46

Benchmarking Database Operating System Architecture 46

Alex Russell

APRIL 29, 2021

Apple forces developers of competing browsers to use their engine for all browsers on iOS , restricting their ability to deliver a better version of the web platform. They are, pound for pound, some of the best engine developers globally and genuinely want good things for the web. With each team, benchmarks lost are understood as bugs.

Media 145

Media Games Education Engineering 145

The Netflix TechBlog

MAY 21, 2019

Netflix engineers run a series of tests and benchmarks to validate the device across multiple dimensions including compatibility of the device with the Netflix SDK, device performance, audio-video playback quality, license handling, encryption and security. It could help us design and implement more targeted reward functions.

Testing 163

Testing AWS Lambda Network 163

The Netflix TechBlog

NOVEMBER 22, 2019

4:45pm-5:45pm NFX 209 File system as a service at Netflix Kishore Kasi , Senior Software Engineer Abstract : As Netflix grows in original content creation, its need for storage is also increasing at a rapid pace. In order to maintain performance, benchmarking is a vital part of our system’s lifecycle.

AWS 37

AWS Entertainment Open Source Benchmarking 37

Percona

JUNE 22, 2023

” Here are additional metrics used to determine the reliability of a database, make adjustments that minimize downtime, and set benchmarks for meeting business continuity requirements. Depending on your setup, costs can include: Hardware devices (servers, storage devices, network switches, etc.)

Availability 104

Availability Database Open Source Hardware 104

The Morning Paper

JUNE 16, 2019

If we do that naively though, we’re going to end up with a lot of universes to store and maintain and the storage requirements alone will be prohibitive. A Piazza-style class forum discussion application with 1M posts, 1,000 classes, and a privacy policy allowing TAs to see anonymous posts is used as the basis for benchmarking.

Database 90

Database Cache Benchmarking Efficiency 90

Alex Russell

MARCH 6, 2021

A then-representative $200USD device had 4-8 slow (in-order, low-cache) cores, ~2GiB of RAM, and relatively slow MLC NAND flash storage. Meanwhile, developer behaviour offers little hope: Median mobile JavaScript payloads have only grown since 2016, now hovering above 400KiB of script transferred, or nearly 2.5MiB of uncompressed JS.

Performance 124

Performance Network Cache Metrics 124

CSS - Tricks

JUNE 5, 2020

The HBO sitcom Silicon Valley hilariously followed Pied Piper, a team of developers with startup dreams to create a compression algorithm so powerful that high-quality streaming and file storage concerns would become a thing of the past. Brotli’s beginning…. It costs significantly more in terms of CPU time.

Cache 79

Cache Website Servers Open Source 79

High Scalability

NOVEMBER 25, 2019

It is limited by the disk space; it can’t expand storage elastically; it chokes if you run few I/O intensive processes or try collaborating with 100 other users. Over time, costs for S3 and GCS became reasonable and with Egnyte’s storage plugin architecture, our customers can now bring in any storage backend of their choice.

Architecture 52

Architecture Cache Azure Storage 52

Alex Russell

OCTOBER 22, 2017

One of the most surprising results has been the frequent occurrence of “ambush by JavaScript” : We need a new term for the business-opportunity wastage that modern front-end development has created. Budgets are scaled to a benchmark network & device. Deciding what benchmark to use for a performance budget is crucial.

Performance 68

Performance Benchmarking Network Mobile 68

The Netflix TechBlog

MARCH 14, 2023

As we developed more media understanding algos and wanted to expand to additional use cases, we needed to invest in system architecture redesign to enable researchers and engineers from different teams to innovate independently and collaboratively. Having diversity in the interfaces is essential to meet the app-developers where they are.

Media 291

Media Innovation Energy Architecture 291