Brendan Gregg

JUNE 30, 2018

These have inspired me to summarize another performance activity: evaluating benchmark accuracy. Accurate benchmarking rewards engineering investment that actually improves performance, but, unfortunately, inaccurate benchmarking is more common. If the benchmark reported 20k ops/sec, you should ask: why not 40k ops/sec?

Benchmarking 54

Benchmarking Latency Cache Network 54

Speed Curve

FEBRUARY 5, 2024

Looking at the industry benchmarks for US retailers , four well-known sites have backend times that are approaching – or well beyond – that threshold. Pagespeed Benchmarks - US Retail - LCP When you examine a waterfall, it's pretty obvious that TTFB is the long pole in the tent, pushing out render times for the page.

Servers 58

Servers Cache Retail Benchmarking 58

John McCalpin

APRIL 25, 2023

For most high-end processors these values have remained in the range of 75% to 85% of the peak DRAM bandwidth of the system over the past 15-20 years — an amazing accomplishment given the increase in core count (with its associated cache coherence issues), number of DRAM channels, and ever-increasing pipelining of the DRAMs themselves.

Benchmarking 97

Benchmarking Cache Latency Tuning 97

CSS Wizardry

AUGUST 24, 2022

Improving each of these should hopefully chip away at the timings of more granular events that precede the LCP milestone, but whenever we’re making these kinds of indirect optimisation, we need to think much more carefully about how we measure and benchmark ourselves as we work. It’s vital to measure what you impact, not what you influence.

Benchmarking 212

Benchmarking Metrics Cache Network 212

The Morning Paper

MAY 23, 2019

Compress objects, not cache lines: an object-based compressed memory hierarchy Tsai & Sanchez, ASPLOS’19. Existing cache and main memory compression techniques compress data in small fixed-size blocks, typically cache lines. ” The big idea.

Cache 61

Cache Benchmarking Hardware Java 61

n0derunner

JUNE 28, 2019

pgbench with DB size 50% of Linux buffer cache. The post Benchmarking with Postgres PT2 appeared first on n0derunner. As expected the write pattern to the log disk (sda) is quite constant, while the write pattern to the database files (sdb) is bursty. I had to tune the parameter checkpoint_completion_target from 0.5

Benchmarking 40

Benchmarking Tuning Cache Database 40

Randon ASCII

JANUARY 12, 2022

The Xbox 360 CPU had three PowerPC cores and a 1 MB L2 cache and these features are clearly visible on the wafer. In the die picture to the right (which looks to be about 14 mm by 12 mm) you can see the regular pattern of small black rectangles in the bottom right corner – that’s the L2 cache. I wrote a lot of benchmarks.

Cache 126

Cache Latency Benchmarking Hardware 126

Brendan Gregg

JUNE 29, 2018

These have inspired me to summarize another performance activity: evaluating benchmark accuracy. Accurate benchmarking rewards engineering investment that actually improves performance, but, unfortunately, inaccurate benchmarking is more common. If the benchmark reported 20k ops/sec, you should ask: why not 40k ops/sec?

Benchmarking 40

Benchmarking Latency Cache Network 40

Percona

APRIL 6, 2023

Query caching Pgpool-II can cache frequently used queries in memory, reducing the load on your PostgreSQL servers and improving response times. This means that when a query is executed, pgpool-II can check the cache first to see if the results are already available rather than sending the query to the database server.

Cache 113

Cache Open Source Benchmarking Database 113

Brendan Gregg

MARCH 16, 2024

Only in extreme circumstances does the cost (in processor time and I-cache footprint) translate to a tangible benefit - circumstances which usually resort to hand-coded assembly anyway. It shouldn't be 10%, unless it's cache effects. And for leaf routines (which never establish a frame), this is a non-issue.

Java 145

Java Cache Google Hardware 145

The Morning Paper

SEPTEMBER 24, 2020

Static analysis of Java enterprise applications: frameworks and caches, the elephants in the room , Antoniadis et al., However, collecting a set of sizable, realistic benchmarks, showing that their analysis is feasible, and making progress in its precision are good ways to ensure further research in this high-value area.

Java 80

Java Cache Benchmarking Programming 80

Percona

APRIL 7, 2023

To illustrate this, I ran the Sysbench-TPCC synthetic benchmark against two different GCP instances running a freshly installed Percona Server for MySQL version 8.0.31 In MySQL, considering the standard storage engine, InnoDB , the data cache is called Buffer Pool. In PostgreSQL, it is called shared buffers.

Tuning 134

Tuning Cache Servers Benchmarking 134

Scalegrid

JULY 29, 2020

So, we pitted the two connection poolers head-to-head, using the standard pgbench tool, to see which one provides better transactions per second throughput through a benchmark test. All of the PostgreSQL benchmark tests were run under the following conditions: Initialized pgbench using a scale factor of 100. Throughput Benchmark.

Benchmarking 246

Benchmarking Database Performance Testing Availability 246

HammerDB

JUNE 27, 2022

HammerDB is a software application for database benchmarking. Databases are highly sophisticated software, and to design and run a fair benchmark workload is a complex undertaking. The Transaction Processing Performance Council (TPC) was founded to bring standards to database benchmarking, and the history of the TPC can be found here.

Benchmarking 62

Benchmarking Open Source C++ Cache 62

HammerDB

APRIL 19, 2023

GHz 4th Generation Intel Xeon Scalable processors (code-named Sapphire Rapids) Up to 20% higher compute performance than z1d instances Up to 50 Gbps of networking speed Up to 40 Gbps of bandwidth to the Amazon Elastic Block Store (EBS) We can also verify these capabilities by running some simple benchmarks on the different subsystems.

Performance 54

Performance Benchmarking Cache Storage 54

Percona

MARCH 27, 2023

Disclaimer : This blog post is meant to show a less-known problem but is not meant to be a serious benchmark. having to open each table.frm (and in which my test runs, I have purposely read a very high number of tables compared to “Table-open-cache” variable). Results for Percona Server for MySQL 8.0

Cache 101

Cache Hardware Servers Benchmarking 101

Percona

JULY 25, 2023

After the “data dictionary” (DD) engine and DD cache are initialized on a server, the Storage Engines can ask for a table definition. Initializing a DD engine and the cache adds complexity and other server dependencies. Essentially LRU cache is disabled by loading the tables as non-evictable. ibd2sdi data/test/t1.ibd

Cache 84

Cache Benchmarking Servers Design 84

Smashing Magazine

SEPTEMBER 28, 2022

On your first try, you can use it as a benchmark for optimizations later. Active Memory Caching. When you want to get data that you already had quickly, you need to do caching — caching stores data that a user recently retrieved. Caching partially stores your data and is not used as permanent storage.

Cache 125

Cache Performance Servers Social Media 125

Percona

SEPTEMBER 1, 2023

Testing and Benchmarking : Thoroughly test triggers in a staging environment to evaluate their impact on performance. Benchmark different trigger implementations to identify the most efficient option. These table cache instances could be accessed concurrently, allowing DML to use cached table descriptors without locking each other.

Cache 59

Cache Database Games Healthcare 59

The Morning Paper

MAY 12, 2019

An open-source benchmark suite for microservices and their hardware-software implications for cloud & edge systems Gan et al., A typical architecture diagram for one of these services looks like this: Suitably armed with a set of benchmark microservices applications, the investigation can begin! ASPLOS’19.

Open Source 61

Open Source Hardware Benchmarking Systems 61

ScaleOut Software

MAY 15, 2014

Given all this, we thought it would be a good opportunity to see how we are doing relative to the competition, and in particular, relative to Microsoft’s AppFabric caching for Windows on-premise servers. One or more specified cache servers are unavailable, which could be caused by busy network or servers. …). Please retry later.

Cache 40

Cache Servers Network Design 40

Percona

MAY 1, 2023

Connection pooling: Minimizing connection overhead and improving response times for frequently accessed data by implementing mechanisms for connection pooling and caching strategies. PostgreSQL performance optimization is an ongoing process involving monitoring, benchmarking, and adjustments to maintain high-performing PostgreSQL databases.

Tuning 52

Tuning Efficiency Database Performance 52

John McCalpin

SEPTEMBER 11, 2014

The High Performance LINPACK (HPL) benchmark is well known for delivering a high fraction of peak floating-point performance. The (historically) excellent scaling of performance as the number of processors is increased and as the frequency is increased suggests that memory bandwidth has not been a performance limiter.

Benchmarking 40

Benchmarking Cache Performance Systems 40

John McCalpin

APRIL 2, 2020

To show that I can criticize my own work as well, here I show that sustained memory bandwidth (using an approximation to the STREAM Benchmark ) is also inadequate as a single figure of metric. (It Here I assumed a particular analytical function for the amount of memory traffic as a function of cache size to scale the bandwidth time.

Benchmarking 59

Benchmarking Performance Latency Architecture 59

n0derunner

JULY 23, 2019

In this video I migrate a Postgres DB running PGbench benchmark. The variation in the transaction rate is due to the benchmark itself, the transaction rate is not expected to be uniform. Many different queries are executing in parallel, some hitting RAM cache, some hitting storage.

Benchmarking 76

Benchmarking Storage Tuning Cache 76

Percona

MARCH 17, 2023

Please note that the focus of these tests was around standard metrics gathering and display, we’ll use a future blog post to benchmark some of the more intensive query analytics (QAN) performance numbers. VictoriaMetrics maintains an in-memory cache for mapping active time series into internal series IDs.

Monitoring 98

Monitoring Scalability Cache Database 98

Percona

DECEMBER 23, 2022

The use case is the TPC-C benchmark but executed not on a high-end server but on a lower-spec virtual machine that is I/O limited like for example, with AWS EBS volumes. I wanted most of the memory to be available for the file cache, where the compressed SST files will be cached. The following figure illustrates the impacts.

Storage 56

Storage Cache C++ Virtualization 56

Speed Curve

DECEMBER 13, 2023

We track LEGO.com, along with a handful of other leading ecommerce sites, in our public-facing Retail Benchmarks dashboard , which I encourage you to check out. Are you compressing and caching the right things? Optimizing the critical rendering path could make this page a star on the Retail Benchmarks leaderboard.

Performance 69

Performance Retail Benchmarking Ecommerce 69

Percona

JUNE 22, 2023

This includes metrics such as query execution time, the number of queries executed per second, and the utilization of query cache and adaptive hash index. query cache: Disable (query_cache_size: 0, query_cache_type:OFF) innodb_adaptive_hash_index: Check adaptive hash index usage to determine its efficiency.

Performance 104

Performance Monitoring Traffic Database 104

ACM Sigarch

OCTOBER 12, 2020

I suggest it’s long past time to move beyond C and SPEC benchmarks and our exclusive focus on “metal” languages. There are already standard benchmark suites for JavaScript performance in the browser, and we can include applications written in node.js (server-side JavaScript), Python web servers, and more.

C++ 108

C++ Benchmarking Hardware Architecture 108

SQL Performance

NOVEMBER 18, 2019

Memory optimized – High memory-to-CPU ratio, relational database servers, medium to large caches, and in-memory analytics. The common trend is to choose a VM based exclusively on vCPU, memory, and storage capacity without benchmarking the current IO and throughput requirements. Benchmark Test. Generation. Conclusion.

Azure 76

Azure Benchmarking Storage Virtualization 76

n0derunner

MAY 6, 2019

A 2007 paper, that still has lots to say on the subject of benchmarking storage and filesystems. Primarily aimed at researchers and developers, but is relevant to anyone about to embark on a benchmarking effort. A Nine year study of filesystem and storage benchmarking Download. The post New (Old) Paper.

Benchmarking 40

Benchmarking Storage Cache Testing 40

KeyCDN

AUGUST 29, 2019

Take these statistics from Google’s industry benchmarks for mobile page speed guide: We’ve said it before but it’s worth reiterating that as web page load times increase, so does the likelihood of your visitors. Leverage Browser Caching Files We are now receiving a warning about leveraging browser caching.

Google 103

Google Cache Speed Analytics 103

Smashing Magazine

AUGUST 9, 2022

PageSpeed Compare is a page speed evaluation and benchmarking tool. It also lists cached resources and identifies unused Javascript. With Treo Site Speed, you can also benchmark a website against competitors. While most of the tools covered below only rely on field metrics, others use a mix of both field and lab metrics.

Performance 130

Performance Benchmarking Website Metrics 130

HammerDB

NOVEMBER 5, 2018

This post at an entry-level discusses the options you have to improve log throughput in your benchmark environment. . To illustrate the data reads on Oracle we can flush the buffer cache. Consequently we now need to increase the buffer cache in size if we are to see more CPU activity. so what are your options?

Benchmarking 40

Benchmarking Database C++ Virtualization 40

Dotcom-Montior

AUGUST 5, 2020

Browser Caching: Although it may seem commonplace, caching is sometimes overlooked. Depending on how often you change content, you may want to set a long expiration time for your cache. Caching can ensure your browser doesn’t have to load all those elements if a visitor returns to your pages.

Website 92

Website Speed Cache Traffic 92

KeyCDN

DECEMBER 8, 2022

Many factors affect the speed of your WordPress website; some of them are: Your web host Server-side optimizations (PHP version, compression, caching, etc.) Configure cache to optimize your website Caching is a complex technology with many layers. Traditionally, most WordPress hosts manage the caching.

Cache 52

Cache Website Speed Website Performance 52