HammerDB

JANUARY 5, 2019

Some opinions claim that “Benchmarks are meaningless”, “benchmarks are irrelevant” or “benchmarks are nothing like your real applications” However for others “Benchmarks matter,” as they “account for the processing architecture and speed, memory, storage subsystems and the database engine.”

Benchmarking 40

Benchmarking Database Social Media Scalability 40

Dynatrace

OCTOBER 2, 2023

Limits of a lift-and-shift approach A traditional lift-and-shift approach, where teams migrate a monolithic application directly onto hardware hosted in the cloud, may seem like the logical first step toward application transformation. Use SLAs, SLOs, and SLIs as performance benchmarks for newly migrated microservices.

Architecture 231

Architecture Artificial Intelligence Cloud Open Source 231

Dynatrace

NOVEMBER 22, 2022

Five-nines availability: The ultimate benchmark of system availability. Cloud service providers, such as Amazon Web Services (AWS) , can offer infrastructure with five-nines availability by deploying in multiple availability zones and replicating data between regions. Gather observability data from all digital touchpoints.

Infrastructure 182

Infrastructure Availability Systems Retail 182

John McCalpin

APRIL 25, 2023

With that in mind, I decided to mine some historical data (and run a few new experiments) to see how single-thread/single-core memory bandwidth has evolved over the last 10-15 years. GHz, 1530 GB/s peak BW from 6 HBM stacks), I see single-thread sustained memory bandwidth of 304 GB/s on the ReadOnly benchmark used here. Stay tuned!

Benchmarking 97

Benchmarking Cache Latency Tuning 97

Brendan Gregg

MARCH 16, 2024

It fails because of a compiler optimization where the frame pointer register is used to store data instead of the frame pointer, but it's just a number so the profiler is unaware this happened and tries to match that address to a function symbol and fails (it is therefore an unknown symbol). You usually get an extra junk frame.

Java 145

Java Cache Google Hardware 145

Percona

MARCH 23, 2023

Hardware Memory The amount of RAM to be provisioned for database servers can vary greatly depending on the size of the database and the specific requirements of the company. Benchmark before you decide. have been released since then with some major changes. Transparent huge pages (THP) disabled.

Performance 123

Performance Hardware Tuning Storage 123

HammerDB

JUNE 27, 2022

HammerDB is a software application for database benchmarking. It enables the user to measure database performance and make comparative judgements about database hardware and software. Databases are highly sophisticated software, and to design and run a fair benchmark workload is a complex undertaking. Derived Workloads.

Benchmarking 62

Benchmarking Open Source C++ Cache 62

The Morning Paper

JUNE 11, 2019

Beyond data and model parallelism for deep neural networks Jia et al., Traditional approaches to training exploit either data parallelism (dividing up the training samples), model parallelism (dividing up the model parameters), or expert-designed hybrids for particular situations. SysML’2019. Expanding the search space.

Network 81

Network Strategy Hardware Benchmarking 81

Abhishek Tiwari

DECEMBER 27, 2017

Kubernetes has emerged as go to container orchestration platform for data engineering teams. In 2018, a widespread adaptation of Kubernetes for big data processing is anitcipated. Organisations are already using Kubernetes for a variety of workloads [1] [2] and data workloads are up next. better cluster resource utilization.

Big Data 63

Big Data Storage Benchmarking Hardware 63

Percona

JUNE 22, 2023

To make data count and to ensure cloud computing is unabated, companies and organizations must have highly available databases. Fault tolerance aims for zero downtime and data loss. Data replication : Data is continually copied from one database to another to ensure that the system remains operational even if one database fails.

Availability 104

Availability Database Open Source Hardware 104

Percona

AUGUST 22, 2023

We’ll also look at the differences, as it’s important to know what architecture(s) will help you best meet your unique requirements for maximizing data assets and achieving continuous uptime. Redundancy: The system stores multiple copies of data on separate devices. there cannot be high availability.

Availability 77

Availability Hardware Open Source Database 77

Percona

MARCH 27, 2023

Disclaimer : This blog post is meant to show a less-known problem but is not meant to be a serious benchmark. The percentage in degradation will vary depending on many factors {hardware, workload, number of tables, configuration, etc.}. Setup The setup consists of creating 10K tables with sysbench and adding 20 FKs to 20 tables.

Cache 98

Cache Hardware Servers Benchmarking 98

ACM Sigarch

OCTOBER 12, 2020

An inte ger in Python consumes 24 bytes instead of 4 bytes (because every object carries around type information, reference counts, and more), while the overhead for data structures like lists or dictionaries can be 4x that of their C++ counterparts. There’s some work on hardware proposals for these systems, like Zhu et al.,

C++ 108

C++ Benchmarking Hardware Architecture 108

The Morning Paper

NOVEMBER 3, 2019

Google’s data center kernel is carefully performance tuned for their workloads. For the rest of us, if you really need that extra performance (maybe what you get out-of-the-box or with minimal tuning is good enough for your use case) then you can upgrade hardware and/or pay for a commercial license of a tuned distributed (RHEL).

Performance 108

Performance Benchmarking Tuning Hardware 108

HammerDB

APRIL 19, 2023

GHz 4th Generation Intel Xeon Scalable processors (code-named Sapphire Rapids) Up to 20% higher compute performance than z1d instances Up to 50 Gbps of networking speed Up to 40 Gbps of bandwidth to the Amazon Elastic Block Store (EBS) We can also verify these capabilities by running some simple benchmarks on the different subsystems.

Performance 54

Performance Benchmarking Cache Storage 54

Dynatrace

NOVEMBER 11, 2020

Dynatrace OneAgent deployment and life-cycle management are already widely considered to be industry benchmarks for reliability and efficiency. We’re now allowing for even easier OneAgent rollout by freeing up the /opt mount point from any runtime data that’s produced by OneAgents. Dynatrace news.

Best Practices 196

Best Practices Storage Java Benchmarking 196

Percona

MAY 1, 2023

Key areas include: Configuration parameter tuning : This tuning involves altering variables such as memory allocation, disk I/O settings, and concurrent connections based on specific hardware and requirements. Slow queries and data retrieval can lead to frustrating delays that impact the user experience. Nobody has time for that!

Tuning 52

Tuning Efficiency Database Performance 52

Percona

SEPTEMBER 1, 2023

This results in expedited query execution, reduced resource utilization, and more efficient exploitation of the available hardware resources. This not only enhances performance but also enables you to make more efficient use of your hardware resources, potentially resulting in cost savings on infrastructure.

Tuning 52

Tuning Database Performance Hardware 52

The Morning Paper

MAY 23, 2019

Existing cache and main memory compression techniques compress data in small fixed-size blocks, typically cache lines. Looking across a set of eight Java benchmarks, we find that only two of them are array dominated, the rest having between 40% to 75% of the heap footprint allocated to objects, the vast majority of which are small.

Cache 61

Cache Benchmarking Hardware Java 61

Percona

JUNE 22, 2023

Database uptime and availability Monitoring database uptime and availability is crucial as it directly impacts the availability of critical data and the performance of applications or websites that rely on the MySQL database. Disk space usage Monitor the disk space usage of MySQL data files, log files, and temporary files.

Performance 102

Performance Monitoring Traffic Database 102

Abhishek Tiwari

DECEMBER 13, 2017

Can machine learning-based data structures i.e. learned data structures replace traditional data structures? The initial results show that learned data structures can outperform existing data structures. This has far-reaching implications how future data systems and algorithms will be designed. p = F(Key) ?

Artificial Intelligence 40

Artificial Intelligence Hardware Google Benchmarking 40

HammerDB

FEBRUARY 25, 2021

HammerDB is a load testing and benchmarking application for relational databases. This helps to minimise locking allowing multiple sessions to access the same data at the same time. However, it is crucial that the benchmarking application does not have inherent bottlenecks that artificially limits the scalability of the database.

Programming 67

Programming Benchmarking Virtualization C++ 67

Speed Curve

MARCH 7, 2022

Size matters especially to mobile users who have limited and/or metered data. It's important to mention that there have been changes to how the Archive collects data over the years. Having said that, looking at data over the past ten years, it's safe to make the observation that pages are definitely trending bigger.

Mobile 145

Mobile Benchmarking Google Metrics 145

The Morning Paper

MAY 14, 2019

Seer: leveraging big data to navigate the complexity of performance debugging in cloud microservices Gan et al., When a QoS violation is predicted to occur and a culprit microservice located, Seer uses a lower level tracing infrastructure with hardware monitoring primitives to identify the reason behind the QoS violation.

Big Data 45

Big Data Cloud Performance Hardware 45

The Morning Paper

MAY 27, 2019

Last week we saw the benefits of rethinking memory and pointer models at the hardware level when it came to object storage and compression ( Zippads ). The protections are hardware implemented and cannot be forged in software. At hardware reset the boot code is granted maximally permissive architectural capabilities.

C++ 61

C++ Hardware Virtualization Benchmarking 61

Alex Russell

APRIL 29, 2021

This post mines publicly available data on the pace of compatibility fixes and feature additions to assess the claim. As an engineer on a browser team, I'm privy to the blow-by-blow of various performance projects, benchmark fire drills, and the ways performance marketing (deeply) impacts engineering priorities. Converging Views.

Media 145

Media Games Education Engineering 145

Adrian Cockcroft

JUNE 21, 2022

I became the Sun UK local specialist in performance and hardware, and as Sun transitioned from a desktop workstation company to sell high end multiprocessor servers I was helping customers find and fix scalability problems. We had specializations in hardware, operating systems, databases, graphics, etc. that a lot of people used.

Tuning 52

Tuning Benchmarking Engineering C++ 52

Scalegrid

JULY 13, 2020

Oracle requires more complex ongoing administration, as all database configurations must evolve in conjunction with the data schemas and custom code. Data encryption can be achieved with advanced security plugins like pgcrypto which are available for free. CitusDB – distributes data and queries horizontally across nodes.

Open Source 244

Open Source Tuning C++ Database 244

Percona

AUGUST 5, 2023

Partitioning is a way in which a database (MySQL in this case) splits its actual data down into separate tables but still gets treated as a single table by the SQL layer. Each partition holds data that falls within a specific range, optimizing data handling and query speed. Each type caters to different data distribution needs.

Strategy 40

Strategy Storage Database Best Practices 40

Percona

JANUARY 19, 2023

With disks being faster nowadays and CPU and memory resources being cheaper, we could easily say MySQL can handle TBs of data with good performance. For instance, in Percona Managed Services , we have many clients with TBs worth of data that are well performant. There are many compression tools and algorithms for data out there.

Open Source 85

Open Source Storage Database Big Data 85

Percona

JULY 1, 2023

Understanding DBaaS DBaaS cloud services allow users to use databases without configuring physical hardware and infrastructure or installing software. Automated Backups and Point-in-Time Recovery Aurora provides automated backup and point-in-time recovery, simplifying backup management and data protection.

AWS 52

AWS Database Serverless Storage 52

Alex Russell

MARCH 6, 2021

Before Jio's disruptive pricing and aggressive rollout, data services in India were among the most expensive in the world relative to income and heavily reliant on 3G outside wealthier "tier 1" cities. In 2016, Jio swept over the subcontinent like a monsoon dropping a torrent of 4G infrastructure and free data rather than rain.

Performance 124

Performance Network Cache Metrics 124

Percona

AUGUST 30, 2018

Because recognizing if the workload is read intensive or write intensive will impact your hardware choices, database configuration as well as what techniques you can apply for performance optimization and scalability. Let’s examine the TPC-C Benchmark from this point of view, or more specifically its implementation in Sysbench.

Benchmarking 46

Benchmarking Database Operating System Architecture 46

HammerDB

DECEMBER 5, 2020

A full understanding of why this is important requires some knowledge of the evolution of database hardware and software. The HammerDB TPROC-C workload by design intended as CPU and memory intensive workload derived from TPC-C – so that we get to benchmark at maximum CPU performance at a much smaller database footprint.

C++ 40

C++ Benchmarking Virtualization Open Source 40

VoltDB

JUNE 1, 2017

Hardware Optimizers” want to get the maximum utilization out of hardware. These systems were designed to have a lifetime of half a decade or more, and rapidly changing hardware meant that the initial deployment had to be sized for 5-7 years out. Attendees could be broken down into several distinct groups.

Hardware 56

Hardware Latency Virtualization Cloud 56

SQL Performance

JULY 16, 2019

A close monitoring of the hardware enthusiast community, including many of the most respected hardware analysts and reviewers paints an even more dire picture about Intel in the server processor space. This made it easier for database professionals to make the case for a hardware upgrade, and made the typical upgrade more worthwhile.

Servers 46

Servers Hardware Architecture Retail 46

SQL Server According to Bob

SEPTEMBER 26, 2016

When we released Always On Availability Groups in SQL Server 2012 as a new and powerful way to achieve high availability, hardware environments included NUMA machines with low-end multi-core processors and SATA and SAN drives for storage (some SSDs). As we moved towards SQL Server 2014, the pace of hardware accelerated.

Availability 40

Availability Servers Hardware Benchmarking 40