HammerDB

APRIL 19, 2023

Therefore, before we attempt to measure our database performance, we should know the system or cloud instance to be tested in detail. In the context of MySQL performance evaluation, it simulates a typical online transaction processing (OLTP) workload on your MySQL database. For the experiments in this blog, we did not tune the system.

Performance 54

Performance Benchmarking Cache Storage 54

KeyCDN

AUGUST 15, 2019

Web performance is a broad subject, and you’ll find no shortage of performance testing tips and tutorials all over the web. Before you begin tuning your website or application, you must first figure out which metrics matter most to your users and establish some achievable benchmarks. What is Performance Testing?

Testing Tools 55

Testing Tools Best Practices Performance Testing Testing 55

Adrian Cockcroft

JUNE 21, 2022

I became the Sun UK local specialist in performance and hardware, and as Sun transitioned from a desktop workstation company to sell high end multiprocessor servers I was helping customers find and fix scalability problems. We had specializations in hardware, operating systems, databases, graphics, etc. that a lot of people used.

Tuning 52

Tuning Benchmarking Engineering C++ 52

Percona

JANUARY 19, 2023

Example: Creating four simple tables to store strings but using different data types: db1 test> CREATE TABLE tb1 (id int auto_increment primary key, test_text char(200)); Query OK, 0 rows affected (0.11 sec) db1 test> CREATE TABLE tb2 (id int auto_increment primary key, test_text varchar(200)); Query OK, 0 rows affected (0.05

Open Source 93

Open Source Storage Database Big Data 93

SQL Performance

MARCH 17, 2020

Back in 2014, I wrote an article called Performance Tuning the Whole Query Plan. Test Environment. Each test result represents the best of ten runs, with all required data and index pages in memory. The Sort only has 19 rows to process, so it consumes only 1ms or so. The cost threshold for parallelism is set to 50.

Servers 86

Servers Tuning Database Efficiency 86

Abhishek Tiwari

JULY 12, 2018

These data pipelines can process data at petabytes scale and to some extent, their success can be attributed to an army of engineers devoted to build and maintain internal data pipelines. Depending on frameworks, data processing units (a.k.a A data pipeline is a software which runs on hardware.

Latency 63

Latency Analytics Scalability Engineering 63

KeyCDN

SEPTEMBER 20, 2018

Error tracking is the process of proactively identifying issues and fixing them as quickly as possible. Not all back-end errors affect the user experience, but keeping track of them can prove helpful when tuning your app. That being said, here are some of the best tools for tracking web application errors in 2018 Automated Testing 1.

Strategy 67

Strategy Monitoring Website Google 67

O'Reilly

JANUARY 16, 2024

These long solo drives were the perfect opportunity to test out ChatGPT’s voice feature because I couldn’t interact with the app using my hands for safety reasons. software” rather than “hardware” in our brains). Whenever I paused for too long, ChatGPT would interpret what I said so far as my request and start processing it.

Entertainment 73

Entertainment Internet Internet Design 73

Percona

OCTOBER 18, 2023

It’s a complex process involving various factors and meticulous planning. Today, we’ll be taking a deep dive into the intricacies of database migration, along with specific solutions to help make the process easier. Evaluating your hardware requirements is another vital aspect of resource allocation.

Open Source 97

Open Source Database Hardware Strategy 97

Percona

MARCH 23, 2023

Hardware Memory The amount of RAM to be provisioned for database servers can vary greatly depending on the size of the database and the specific requirements of the company. As datasets continue to grow in size, the amount of RAM required to store and process these datasets also increases. Refer to innodb_redo_log_capacity below.

Performance 129

Performance Hardware Tuning Storage 129

Dynatrace

OCTOBER 2, 2023

Limits of a lift-and-shift approach A traditional lift-and-shift approach, where teams migrate a monolithic application directly onto hardware hosted in the cloud, may seem like the logical first step toward application transformation. remove the dependency on the monolith after all testing is successful. create a microservice; 2.

Architecture 228

Architecture Artificial Intelligence Cloud Open Source 228

O'Reilly

NOVEMBER 28, 2023

Unexpected outcomes, security, safety, fairness and bias, and privacy are the biggest risks for which adopters are testing. Users and Nonusers AI adoption is in the process of becoming widespread, but it’s still not universal. Until AI reaches 100%, it’s still in the process of adoption. Only 4% pointed to lower head counts.

Open Source 108

Open Source Artificial Intelligence Google Infrastructure 108

Dynatrace

MAY 1, 2020

This is especially the case with microservices and applications created around multiple tiers, where cheaper hardware alternatives play a significant role in the infrastructure footprint. The initial release of OneAgent for the ARM platform with OneAgent version 1.191 is certified and tested to work on SUSE Enterprise Linux 15.x,

Java 132

Java Hardware Tuning Metrics 132

O'Reilly

SEPTEMBER 19, 2023

Doubly so as hardware improved, eating away at the lower end of Hadoop-worthy work. Google goes a step further in offering compute instances with its specialized TPU hardware. You can download these models to use out of the box, or employ minimal compute resources to fine-tune them for your particular task.

Hardware 99

Hardware Storage Big Data Blockchain 99

Percona

AUGUST 27, 2018

assigning to a specific CPU) is a manageable resource, represented by the concept of “virtual CPU” as a term that includes CPU cores, hyperthreads, hardware threads, and so forth. Good examples are: ETL processes for data archiving, reporting, data consolidation and so on. Currently, CPU affinity (i.e., What is the possible usage?

Tuning 46

Tuning Virtualization Testing Servers 46

Dynatrace

NOVEMBER 15, 2021

Logs can include data about user inputs, system processes, and hardware states. Log monitoring is a process by which developers and administrators continuously observe logs as they’re being recorded. Log analytics is the process of evaluating and interpreting log data so teams can quickly detect and resolve issues.

Analytics 205

Analytics Monitoring Artificial Intelligence DevOps 205

All Things Distributed

MARCH 19, 2018

Bill Simmons, CTO of Dataxu, states, "We process 3 million ad requests a second - 100,000 features per request. In other words, processing the 10th gigabyte and 1000th gigabyte is conceptually the same. To seamlessly switch between CPU and GPU machines, we use Apache MXNet to interface with the underlying hardware.

Scalability 159

Scalability Hardware AWS Tuning 159

Brendan Gregg

SEPTEMBER 25, 2021

What about short-lived processes, like a service restarting in a loop? As a Xen guest, this profile was gathered using perf(1) and the kernel's software cpu-clock soft interrupts, not the hardware NMI. There's also a test and println() in the loop to, hopefully, convince the compiler not to optimize-out an otherwise empty loop.

Speed 126

Speed Java AWS Virtualization 126

Percona

APRIL 17, 2023

The main objective of this post is to share my experience over the past years tuning MongoDB and centralize the diverse sources that I crossed in this journey in a unique place. systemctl stop tuned $ systemctl disable tuned Dirty ratio The dirty_ratio is the percentage of total system memory that can hold dirty pages.

Best Practices 52

Best Practices Design Tuning Database 52

Percona

AUGUST 5, 2023

This means that multiple partitions can be processed simultaneously, making better use of available hardware resources and further enhancing query performance. Special considerations are needed to ensure these processes still work seamlessly after partitioning. Documentation : Always be documenting! Migrating to MySQL 8.0

Strategy 40

Strategy Storage Database Best Practices 40

Dynatrace

OCTOBER 26, 2020

Christian Inzko , Performance Engineer out of our Klagenfurt Lab, is running a lot of performance tests to validate performance and scalability of our Dynatrace clusters. For some of these tests, he’s using the open source tool Apache JMeter. So stay tuned. Goal: sending metrics to Dynatrace. Raspberry Pi Model 3 B.

Innovation 152

Innovation Metrics Hardware Games 152

The Morning Paper

MAY 21, 2019

Using zswap means that no new hardware solutions are required, enabling rapid deployment across clusters. From extensive A/B testing, P was empirically determined to be 0.2%/minute. ML-based auto-tuning. The following chart shows an A/B test result for Bigtable with and without zswap enabled. min promotion rate though?

Software 78

Software Software Google Hardware 78

DZone

AUGUST 16, 2019

It’s not just a simple tweak you can turn on/off; it’s a long-time process that touches almost every single item in your stack, including both hardware and software sides of the system. Application scalability is the potential of an application to grow in time, being able to efficiently handle more and more requests per minute (RPM).

Scalability 145

Scalability Efficiency Hardware Software 145

O'Reilly

OCTOBER 11, 2022

There seems to be broad agreement that hyperautomation is the combination of Robotic Process Automation with AI. We’ll see it in the processing of the thousands of documents businesses handle every day. We can certainly apply the slogan to many, if not all, clerical tasks–and even to the automation process itself.

Games 116

Games Healthcare Processing Retail 116

Dynatrace

OCTOBER 22, 2019

Ultimately, it leads to a state where your system won’t be able to process more data even if you add more hardware. Based on this, you can go back and test different ways to write this code. Now, let’s look at a Cassandra process group and see if we can find any CPU-hungry threads and thread groups.

Java 102

Java Scalability Hardware Architecture 102

HammerDB

FEBRUARY 25, 2021

HammerDB is a load testing and benchmarking application for relational databases. All the databases that HammerDB tests implement a form of MVCC (multi-version concurrency control). For HammerDB both TPROC-C and TPROC-H run all of their workloads on the database being tested in SQL. Top 10 Processes. select top 100.

Programming 67

Programming Benchmarking Virtualization C++ 67

SQL Performance

JUNE 21, 2019

Prior to SQL Server 2012, the maximum server memory value only applied to the bufferpool, so customers needed to limit the amount of memory the bufferpool could use to save memory for the operating system and other processes. Part of that process is his Index Optimize procedure, which can take additional parameters to update statistics.

Servers 49

Servers Azure Hardware Database 49

HammerDB

OCTOBER 18, 2019

Well its difficult to be entirely sure however the tests have all the characteristics of tests observed previously where the CPUs are running in powersave mode. So lets take an Ubuntu system with Platinum 8280 CPUs with the following Ubuntu OS, reboot and check the CPU configuration before running any tests.

Benchmarking 63

Benchmarking Performance Hardware C++ 63

HammerDB

JANUARY 5, 2019

Some opinions claim that “Benchmarks are meaningless”, “benchmarks are irrelevant” or “benchmarks are nothing like your real applications” However for others “Benchmarks matter,” as they “account for the processing architecture and speed, memory, storage subsystems and the database engine.”

Benchmarking 40

Benchmarking Database Social Media Scalability 40

Dynatrace

NOVEMBER 20, 2019

The IBM Z platform is a range of mainframe hardware solutions that are quite frequently used in large computing shops. Typically, these shops run the z/OS operating system, but more recently, it’s not uncommon to see the Z hardware running special versions of Linux distributions. Stay tuned for more announcements on this topic.

Availability 31

Availability Hardware Java Tuning 31

Brendan Gregg

SEPTEMBER 5, 2017

There's also a ZFS send/recv code path that should try to use the TASK_INTERRUPTIBLE flag (as suggested by a coworker), to avoid a kernel hang (can't kill -9 the process). We're now testing container hosts in production on btrfs, instead of ZFS. Both of those should be easy fixes. It's the official profiler.

Virtualization 76

Virtualization AWS Engineering Hardware 76

Dynatrace

AUGUST 8, 2019

The IBM Z platform is a range of mainframe hardware solutions that are quite frequently used in large computing shops. Typically, these shops run the z/OS operating system, but more recently, it’s not uncommon to see the Z hardware running special versions of Linux distributions. Stay tuned for more announcements on this topic.

Availability 25

Availability Hardware Java Tuning 25

HammerDB

OCTOBER 12, 2018

This post complements the previous best practice guides this time with the focus on MySQL and MariaDB and achieving top levels of performance with the HammerDB MySQL TPC-C test. As is also the case this limitation is at the database level (especially the storage engine) rather than the hardware level. hardware limits: 1000 MHz - 3.80

Best Practices 40

Best Practices Scalability Performance C++ 40

SQL Server According to Bob

JANUARY 11, 2020

Example 1: ​​ Hardware failure (CPU board) Battery backup on the caching controller maintained the data. Important Always consult with your hardware manufacturer for proper stable media strategies. For specific information on I/O tuning and balancing, you will find more details in the following document.

Servers 40

Servers Cache Media Hardware 40

Brendan Gregg

SEPTEMBER 25, 2021

What about short-lived processes, like a service restarting in a loop? As a Xen guest, this profile was gathered using perf(1) and the kernel's software cpu-clock soft interrupts, not the hardware NMI. There's also a test and println() in the loop to, hopefully, convince the compiler not to optimize-out an otherwise empty loop.

Speed 40

Speed Java AWS Virtualization 40

O'Reilly Software

APRIL 4, 2018

We live in the era of the connected experience, where our daily interactions with the world can be digitized, collected, processed, and analyzed to generate valuable insights. Accumulating all this data to process overnight is not an option anymore. Do we need to process each record individually? Process tolerance.

Architecture 80

Architecture Scalability Google Operating System 80

Smashing Magazine

AUGUST 22, 2021

This explains the challenges involved in deploying and testing HTTP/3 yourself. This is because, as we said, each network link has only a certain amount of data it can (physically) process every second. As such, tuning congestion logic is usually only done by a select few developers, and evolution is slow. A Primer on Speed.

Performance 105

Performance Network Latency Servers 105