The Morning Paper

MAY 12, 2019

An open-source benchmark suite for microservices and their hardware-software implications for cloud & edge systems Gan et al., Systems built with lots of microservices have different operational characteristics to those built from a small number of monoliths, we’d like to study and better understand those differences.

Open Source 61

Open Source Hardware Benchmarking Systems 61

The Morning Paper

MAY 23, 2019

Compress objects, not cache lines: an object-based compressed memory hierarchy Tsai & Sanchez, ASPLOS’19. Existing cache and main memory compression techniques compress data in small fixed-size blocks, typically cache lines. ” The big idea.

Cache 61

Cache Benchmarking Hardware Java 61

Percona

APRIL 6, 2023

PostgreSQL is a popular open source relational database management system many organizations use to store and manage their data. Query caching Pgpool-II can cache frequently used queries in memory, reducing the load on your PostgreSQL servers and improving response times. Two benchmarks from users can be found here: [1] [2] 4.

Cache 111

Cache Open Source Benchmarking Database 111

Brendan Gregg

JUNE 29, 2018

These have inspired me to summarize another performance activity: evaluating benchmark accuracy. Accurate benchmarking rewards engineering investment that actually improves performance, but, unfortunately, inaccurate benchmarking is more common. If the benchmark reported 20k ops/sec, you should ask: why not 40k ops/sec?

Benchmarking 40

Benchmarking Latency Cache Network 40

Brendan Gregg

MARCH 16, 2024

The problem is that this system has a default libc that has been compiled without frame pointers, so any stack walking stops at the libc layer, producing a partial stack that's missing the application frames. It shouldn't be 10%, unless it's cache effects. Don't blame the straw, in this case, don't blame the frame pointers.

Java 145

Java Cache Google Hardware 145

Percona

APRIL 7, 2023

To illustrate this, I ran the Sysbench-TPCC synthetic benchmark against two different GCP instances running a freshly installed Percona Server for MySQL version 8.0.31 In MySQL, considering the standard storage engine, InnoDB , the data cache is called Buffer Pool. In PostgreSQL, it is called shared buffers.

Tuning 133

Tuning Cache Servers Benchmarking 133

Scalegrid

JULY 29, 2020

However, these must be set up outside the PostgreSQL system, while PgBouncer can offload this to the PostgreSQL server. So, we pitted the two connection poolers head-to-head, using the standard pgbench tool, to see which one provides better transactions per second throughput through a benchmark test. Throughput Benchmark.

Benchmarking 246

Benchmarking Database Performance Testing Availability 246

HammerDB

APRIL 19, 2023

Therefore, before we attempt to measure our database performance, we should know the system or cloud instance to be tested in detail. Benchmarking the target Two of the more popular database benchmarks for MySQL are HammerDB and sysbench. Operating System: Ubuntu 22.04 Operating System: Ubuntu 22.04

Performance 54

Performance Benchmarking Cache Storage 54

HammerDB

JUNE 27, 2022

HammerDB is a software application for database benchmarking. HammerDB has graphical and command line interfaces for the Windows and Linux operating systems. Databases are highly sophisticated software, and to design and run a fair benchmark workload is a complex undertaking. Why HammerDB was developed. HammerDB Licensing.

Benchmarking 62

Benchmarking Open Source C++ Cache 62

Percona

JULY 25, 2023

After the “data dictionary” (DD) engine and DD cache are initialized on a server, the Storage Engines can ask for a table definition. Initializing a DD engine and the cache adds complexity and other server dependencies. Essentially LRU cache is disabled by loading the tables as non-evictable. ibd2sdi data/test/t1.ibd

Cache 83

Cache Benchmarking Servers Design 83

Percona

JUNE 22, 2023

This includes metrics such as query execution time, the number of queries executed per second, and the utilization of query cache and adaptive hash index. query cache: Disable (query_cache_size: 0, query_cache_type:OFF) innodb_adaptive_hash_index: Check adaptive hash index usage to determine its efficiency.

Performance 102

Performance Monitoring Traffic Database 102

Percona

MAY 1, 2023

It is primarily the responsibility of the database administrator or developer to tune PostgreSQL according to their system’s workload. Connection pooling: Minimizing connection overhead and improving response times for frequently accessed data by implementing mechanisms for connection pooling and caching strategies.

Tuning 52

Tuning Efficiency Database Performance 52

Percona

MARCH 17, 2023

Please note that the focus of these tests was around standard metrics gathering and display, we’ll use a future blog post to benchmark some of the more intensive query analytics (QAN) performance numbers. VictoriaMetrics maintains an in-memory cache for mapping active time series into internal series IDs.

Monitoring 95

Monitoring Scalability Cache Database 95

John McCalpin

APRIL 2, 2020

The presentation discusses a family of simple performance models that I developed over the last 20 years — originally in support of processor and system design at SGI (1996-1999), IBM (1999-2005), and AMD (2006-2008), but more recently in support of system procurements at The Texas Advanced Computing Center (TACC) (2009-present).

Benchmarking 59

Benchmarking Performance Latency Architecture 59

Percona

SEPTEMBER 1, 2023

This can affect the overall performance of your database system, potentially leading to slower response times. This can introduce maintenance overhead, particularly in large and complex database systems. Testing and Benchmarking : Thoroughly test triggers in a staging environment to evaluate their impact on performance.

Cache 59

Cache Database Games Healthcare 59

Smashing Magazine

SEPTEMBER 28, 2022

On your first try, you can use it as a benchmark for optimizations later. On design systems, UX, web performance and CSS/JS. Active Memory Caching. When you want to get data that you already had quickly, you need to do caching — caching stores data that a user recently retrieved. Caching Schemes.

Cache 125

Cache Performance Servers Social Media 125

ScaleOut Software

MAY 15, 2014

Given all this, we thought it would be a good opportunity to see how we are doing relative to the competition, and in particular, relative to Microsoft’s AppFabric caching for Windows on-premise servers. One or more specified cache servers are unavailable, which could be caused by busy network or servers. …). Please retry later.

Cache 40

Cache Servers Network Design 40

ACM Sigarch

OCTOBER 12, 2020

I suggest it’s long past time to move beyond C and SPEC benchmarks and our exclusive focus on “metal” languages. There are already standard benchmark suites for JavaScript performance in the browser, and we can include applications written in node.js (server-side JavaScript), Python web servers, and more.

C++ 108

C++ Benchmarking Hardware Architecture 108

John McCalpin

SEPTEMBER 11, 2014

The High Performance LINPACK (HPL) benchmark is well known for delivering a high fraction of peak floating-point performance. A colleague here at TACC ran into this while testing on a 2-socket Haswell EP system. But this does not mean that memory bandwidth will *never* be a performance limiter.

Benchmarking 40

Benchmarking Cache Performance Systems 40

Percona

MARCH 23, 2023

By caching hot datasets, indexes, and ongoing changes, InnoDB can provide faster response times and utilize disk IO in a much more optimal way. Operating system Linux is the most common operating system for high-performance MySQL servers. Benchmark before you decide. Transparent huge pages (THP) disabled.

Performance 123

Performance Hardware Tuning Storage 123

n0derunner

MAY 6, 2019

A 2007 paper, that still has lots to say on the subject of benchmarking storage and filesystems. Primarily aimed at researchers and developers, but is relevant to anyone about to embark on a benchmarking effort. A Nine year study of filesystem and storage benchmarking Download.

Benchmarking 40

Benchmarking Storage Cache Testing 40

Percona

SEPTEMBER 1, 2023

Enhanced User Experience Whether you operate an e-commerce platform, a content management system, or any other application reliant on MySQL, users will notice and appreciate the improved speed and responsiveness. Resource contention emerges when multiple database operations vie for the same system resources simultaneously.

Tuning 52

Tuning Database Performance Hardware 52

Adrian Cockcroft

JANUARY 20, 2023

on Myths and Legends of High Performance Computing  — it’s a somewhat light-hearted look at some of the same issues by the leader of the team that built the Fugaku system I mention below. HPCG is led by Japan’s RIKEN Fugaku system at 16 petaflops, which is 3% of it’s peak capacity. Next generation architectures will use CXL3.0

Architecture 52

Architecture Latency Benchmarking AWS 52

The Morning Paper

AUGUST 29, 2019

use the TPC-H benchmark to assess Redshift, Redshift Spectrum, Athena, Presto, Hive, and Vertica to find out what works best and the trade-offs involved. We focused on OLAP-oriented parallel data warehouse products available for AWS and restricted our attention to commercially available systems. Key findings. Query restrictions.

Architecture 76

Architecture Cloud Storage Serverless 76

HammerDB

NOVEMBER 5, 2018

This post at an entry-level discusses the options you have to improve log throughput in your benchmark environment. . To illustrate the data reads on Oracle we can flush the buffer cache. SQL> alter system flush buffer_cache; System altered. SQL> alter system set commit_wait='NOWAIT' scope=spfile; System altered.

Benchmarking 40

Benchmarking Database C++ Virtualization 40

Brendan Gregg

FEBRUARY 9, 2018

This overhead can be reduced by A) pcid, fully available in Linux 4.14, and B) Huge pages. - **Cache access pattern**: the overheads are exacerbated by certain access patterns that switch from caching well to caching a little less well. Also microbenchmarks, which often stress-test the system, will suffer the largest losses.

Performance 75

Performance Benchmarking Cache Tuning 75

Percona

AUGUST 31, 2018

If queries perform full table scans where an index could be used or perform heavy joins or expensive aggregate operations, then the system can still perform poorly even if the database parameters are tuned. The PostgreSQL buffer is called shared_buffer which is the most effective tunable parameter for most operating systems.

Tuning 54

Tuning Database Performance Benchmarking 54

MachMetrics

DECEMBER 14, 2019

It is typically reduced via server-side optimizations, such as enabling caching and database indexes. However, we really want to strive to be under the benchmarks that Google sets as a best practice. Even better if you’re under Google’s best practice benchmark. seconds on desktop and 2.59 seconds on mobile.

Best Practices 105

Best Practices Speed Mobile Google 105

The Morning Paper

JUNE 16, 2019

Specifically, scalable, parallel streaming dataflow computing systems now support partially-stateful and dynamically-changing dataflows. The amount of computation required on a base update can be reduced by sharing computation and cached data between universes. Recent research has provided this missing key primitive.

Database 90

Database Cache Benchmarking Efficiency 90

Percona

JUNE 22, 2023

Defining high availability In general terms, high availability refers to the continuous operation of a system with little to no interruption to end users in the event of hardware or software failures, power outages, or other disruptions. Some disruption might occur, but it will be minimal. Fault tolerance aims for zero downtime and data loss.

Availability 104

Availability Database Open Source Hardware 104

Smashing Magazine

JUNE 2, 2021

The project consisted of upgrading the shop software to our own open-source system and redoing the shop’s front end from scratch. Today, the website is much faster and ranks highly in various showcases and benchmarks. And while you can usually cache the full page of an article, the same is not true of many shop pages and elements.

Performance 115

Performance Cache Website Mobile 115

Alex Russell

APRIL 29, 2021

As an engineer on a browser team, I'm privy to the blow-by-blow of various performance projects, benchmark fire drills, and the ways performance marketing (deeply) impacts engineering priorities. With each team, benchmarks lost are understood as bugs. All modern browsers are fast, Chromium and Safari/WebKit included. Media Session API.

Media 145

Media Games Education Engineering 145

SQL Performance

DECEMBER 17, 2019

You will still have to maintain your operating system, SQL Server and databases just like you would in an on-premises scenario. Microsoft's Mine Tokus has a good article where she ran a series of scaled down TPC-E benchmarks against an E64s_v3 VM that was using the older Broadwell processor. GHz, 128MB of L3 cache, 128 PCIe 4.0

Azure 72

Azure Virtualization Servers Storage 72

Alex Russell

MARCH 6, 2021

A then-representative $200USD device had 4-8 slow (in-order, low-cache) cores, ~2GiB of RAM, and relatively slow MLC NAND flash storage. Using a global ASP as a benchmark can further mislead thanks to the distorting effect of ultra-high-end prices rising while shipment volumes stagnate. The Moto G4 , for example.

Performance 124

Performance Network Cache Metrics 124

Brendan Gregg

FEBRUARY 8, 2018

This overhead can be reduced by A) pcid, fully available in Linux 4.14, and B) Huge pages. - **Cache access pattern**: the overheads are exacerbated by certain access patterns that switch from caching well to caching a little less well. Also microbenchmarks, which often stress-test the system, will suffer the largest losses.

Performance 40

Performance Benchmarking Cache Tuning 40

SQL Performance

APRIL 8, 2019

The L3 cache size is 64MB. I wrote about using CPU-Z to benchmark the Intel Xeon E5-2673 v3 processor in an Azure VM in this article. Figure 1: CPU-Z Benchmark Results for LS16v2. The L3 cache size is 64MB. Like all AMD EPYC 7000 series processors, this particular SKU supports 128 PCIe 3.0 lanes for I/O connectivity.

Azure 42

Azure Virtualization Storage Benchmarking 42

The Morning Paper

MAY 14, 2019

Last time around we looked at the DeathStarBench suite of microservices-based benchmark applications and learned that microservices systems can be especially latency sensitive, and that hotspots can propagate through a microservices architecture in interesting ways. Distributed tracing and instrumentation. Seer in action.

Big Data 45

Big Data Cloud Performance Hardware 45