Cache, Database, Testing and Tuning - Technology Performance Pulse

PostgreSQL Performance Tuning: Optimizing Database Parameters for Maximum Efficiency

Percona

MAY 1, 2023

Out of the box, the default PostgreSQL configuration is not tuned for any particular workload. It has default settings for all of the database parameters. It is primarily the responsibility of the database administrator or developer to tune PostgreSQL according to their system’s workload.

Tuning

Tuning Efficiency Database Performance

An approach to index tuning – Part 2

SQL Performance

APRIL 13, 2020

In my last post , I started to outline the process I go through when tuning queries – specifically when I discover that I need to add a new index, or modify an existing one. His version can be used for the plan cache – the only challenge there is the information is transient, so you may not capture every query that uses a particular index.

Tuning

Tuning Cache Metrics Testing

The Most Important MySQL Setting

Percona

APRIL 7, 2023

If we were to select the most important MySQL setting, if we were given a freshly installed MySQL or Percona Server for MySQL and could only tune a single MySQL variable, which one would it be? That’s a heritage of the LAMP model when the same server would host both the database and the web server. Are these results good enough?

Tuning

Tuning Cache Servers Benchmarking

Crucial Redis Monitoring Metrics You Must Watch

Scalegrid

JANUARY 25, 2024

Redis® is an in-memory database that provides blazingly fast performance. This makes it a compelling alternative to disk-based databases when performance is a concern. Redis returns a big list of database metrics when you run the info command on the Redis shell. This blog post lists the important database metrics to monitor.

Metrics

Metrics Monitoring Latency Cache

Tuning PostgreSQL Database Parameters to Optimize Performance

Percona

AUGUST 31, 2018

Out of the box, the default PostgreSQL configuration is not tuned for any particular workload. It has default settings for all of the database parameters. It is primarily the responsibility of the database administrator or developer to tune PostgreSQL according to their system’s workload. This is called double buffering.

Tuning

Tuning Database Performance Benchmarking

PostgreSQL Indexes Can Hurt You: Negative Effects and the Costs Involved

Percona

APRIL 24, 2023

Indexes are generally considered to be the panacea when it comes to SQL performance tuning, and PostgreSQL supports different types of indexes catering to different use cases. I keep seeing many articles and talks on “tuning” discussing how creating new indexes speeds up SQL but rarely ones discussing removing them.

Tuning

Tuning Cache Storage Database

PostgreSQL Connection Pooling: Part 3 – Pgpool-II

Scalegrid

MARCH 23, 2020

Once authentication succeeds, it checks if it already has a cached connection for this database+user combination. Once the client disconnects, Pgpool-II has to decide whether to cache the connection: If it has an empty slot, it caches it. Stay tuned! If it does, it returns the connection to the client.

Cache

Cache Servers Architecture Processing

Impact of Querying Table Information From information_schema

Percona

MARCH 27, 2023

On MySQL and Percona Server for MySQL , there is a schema called information_schema (I_S) which provides information about database tables, views, indexes, and more. The same tests have been executed in Percona Server for MySQL 5.7

Cache

Cache Hardware Servers Benchmarking

InnoDB Performance Optimization Basics

Percona

MARCH 23, 2023

Hardware Memory The amount of RAM to be provisioned for database servers can vary greatly depending on the size of the database and the specific requirements of the company. By caching hot datasets, indexes, and ongoing changes, InnoDB can provide faster response times and utilize disk IO in a much more optimal way.

Performance

Performance Hardware Tuning Storage

How to Assess MySQL Performance

HammerDB

APRIL 19, 2023

Among the different components of modern software solutions, the database is one of the most critical. There are many times we get asked why some cloud instance performed poorly for their database application and almost always turned out to be some configuration error. TB)) for storage of database tablespaces and logging.

Performance

Performance Benchmarking Cache Storage

PostgreSQL Checkpoints, Buffers, and WAL Usage with Percona Monitoring and Management

Percona

NOVEMBER 9, 2023

With this data, we’ll be able to better understand and tune our Postgres servers. The main idea is to be able to easily detect what the server is doing at any point in time so we can better understand how it reacts to the workload and tune accordingly. You can search the blog for more information on this if needed.

Monitoring

Monitoring Tuning Metrics Servers

AB Testing?—?So You Know What Really Works

Adrian Cockcroft

MARCH 21, 2020

AB Testing?—?So The first thing I found was that every user visible change we made went through an A/B test. An oft-quoted study by Microsoft Bing found that of the changes they test, one-third prove effective, one-third have neutral results, and one-third have negative results. You need an “abtest” database service.

Testing

Testing Tuning Database Cache

MongoDB Best Practices: Security, Data Modeling, & Schema Design

Percona

APRIL 17, 2023

The main objective of this post is to share my experience over the past years tuning MongoDB and centralize the diverse sources that I crossed in this journey in a unique place. The Linux default is usually 60 , which is not ideal for database usage. Spoiler alert: This post focuses on MongoDB 3.6.X

Best Practices

Best Practices Design Tuning Database

Code-level observability for Flutter apps drives great user experience

Dynatrace

NOVEMBER 13, 2020

With Dynatrace, you get end-to-end visibility into each user action, from the user interaction triggered on the mobile device, through the maze of cloud and on-premises services, down to the database statement. Test Flutter monitoring with our demo app. As a developer, you might want to quickly find and analyze errors and crashes.

Code

Code Mobile Monitoring Infrastructure

A Quick Peek at MySQL 8.0.34 and MySQL 8.1.0

Percona

JULY 27, 2023

While this is a great idea for security reasons, there will be many more posts on websites like Stackoverflow bemoaning that their old code and connector can not connect to the new version of the database. This could be handy for tracking query tuning and performance auditing. For those wondering when Percona’s 8.0.34

Servers

Servers Open Source Tuning Cache

Impact of Data locality on DB workloads.

n0derunner

JULY 23, 2019

Many different queries are executing in parallel, some hitting RAM cache, some hitting storage. The Postgres DB is totally un-tuned and contains purely default settings. The aim of the experiment was to see how data-locality might affect a running database workload, not to generate the maximum TPS.

Benchmarking

Benchmarking Storage Tuning Cache

One Index, Three Different PostgreSQL Scan Types: Bitmap, Index, and Index Only

Percona

JULY 6, 2023

Performance is one of the essential aspects of a database management system. then true else false end FROM generate_series(1, 10000000); Now we have our test table with some dummy data so we can practice. then true else false end FROM generate_series(1, 10000000); Now we have our test table with some dummy data so we can practice.

Best Practices

Best Practices Tuning Database Testing

A use case for sp_prepare / sp_prepexec

SQL Performance

JANUARY 11, 2021

So when their compiled application sends ad hoc queries to SQL Server, particularly as a prepared statement, and when we don't have the freedom to add or change indexes, several tuning opportunities are immediately off the table. In this case, we had a table with a couple million rows. A simplified and sanitized version: CREATE TABLE dbo.

Cache

Cache Tuning Database Performance

KPTI/KAISER Meltdown Initial Performance Regressions

Brendan Gregg

FEBRUARY 9, 2018

In this post I'll look at the Linux kernel page table isolation (KPTI) patches that workaround Meltdown: what overheads to expect, and ways to tune them. Much of my testing was on Linux 4.14.11 Also microbenchmarks, which often stress-test the system, will suffer the largest losses. and 4.14.12 DTLB and 4.4% DTLB and 1.1%

Performance

Performance Benchmarking Cache Tuning

Scale Your Liferay Application by Clustering

Enprowess

MARCH 4, 2018

Here are some basics/rules : All nodes should be pointing to same Liferay database. Enable cluster link for cache replication. 1) Database configuration: Each node should be configured with a data source or JNDI connection that points to one Liferay database (or a database cluster) which all the nodes will share.

Cache

Cache Transportation Media Traffic

Egnyte Architecture: Lessons learned in building and scaling a multi petabyte content platform

High Scalability

NOVEMBER 25, 2019

Edge caching. In general, Egnyte connect architecture shards and caches data at different levels based on: Amount of data. Nginx for disk based caching. Chokepoint : Even sharded Berkeley DB was choking under the stress and there was a database crash with recovery taking hours, it had to be replaced. Disk based caching.

Architecture

Architecture Cache Azure Storage

Common SQL Server Mishaps

SQL Performance

JUNE 21, 2019

This article will expand on my previous article and point out how these apply to SQL Server , Azure SQL Database , and Azure SQL Managed Instance. When looking at backups, I check for recovery model and the current history of backups for each database. Azure SQL Database and Azure Managed Instance have managed backups.

Servers

Servers Azure Hardware Database

How to improve Redo, Transaction Log and WAL throughput for HammerDB benchmarks

HammerDB

NOVEMBER 5, 2018

If you are new to running Oracle, SQL Server, MySQL and PostgreSQL TPC-C workloads with HammerDB and have needed to investigate I/O performance the chances are that you have experienced waits on writing to the Redo, Transaction Log or WAL depending on the database you are testing.

Benchmarking

Benchmarking Database C++ Virtualization

KPTI/KAISER Meltdown Initial Performance Regressions

Brendan Gregg

FEBRUARY 8, 2018

In this post I'll look at the Linux kernel page table isolation (KPTI) patches that workaround Meltdown: what overheads to expect, and ways to tune them. Much of my testing was on Linux 4.14.11 Also microbenchmarks, which often stress-test the system, will suffer the largest losses. and 4.14.12 DTLB and 4.4% DTLB and 1.1%

Performance

Performance Benchmarking Cache Tuning

SQL Server I/O Basics Chapter #1

SQL Server According to Bob

JANUARY 11, 2020

Microsoft SQL Server I/O Basics Author: Bob Dorr, Microsoft SQL Server Escalation Published: December, 2004 SUMMARY: Learn the I/O requirements for Microsoft SQL Server database file operations. This cache is often supported by a battery-powered backup facility.

Servers

Servers Cache Media Hardware

SQL Server I/O Basics Chapter #2

SQL Server According to Bob

JANUARY 11, 2020

KB sectors run on smaller sectors 14 System and sample databases 15 Determining the formatted sector size of database 15 What sector sizes does SQL Server support? The names of actual companies and products mentioned herein may be the trademarks of their respective owners.

Servers

Servers Cache Database Media

Using Parallel Query with Amazon Aurora for MySQL

Percona

JANUARY 17, 2019

Aurora Parallel Query response time (for queries which can not use indexes) can be 5x-10x better compared to the non-parallel fully cached operations. Test data and versions. For my test, I need to choose: Aurora instance type and comparison. The second and third run used the cached data. This query is 100% cached.

Cache

Cache C++ AWS Airlines

Understanding Execution Plan Operator Timings

SQL Performance

MARCH 8, 2021

This can make it difficult to draw sound performance-tuning conclusions. The following examples use the public Stack Overflow 2013 database ( download details ), with a single index added: CREATE INDEX PP ON dbo. Total elapsed time is 933ms with 6,673ms of CPU time with a warm cache. A final example.

Servers

Servers Tuning Architecture Processing

Technology Performance Pulse

PostgreSQL Performance Tuning: Optimizing Database Parameters for Maximum Efficiency

An approach to index tuning – Part 2

Trending Sources

The Most Important MySQL Setting

Crucial Redis Monitoring Metrics You Must Watch

Tuning PostgreSQL Database Parameters to Optimize Performance

PostgreSQL Indexes Can Hurt You: Negative Effects and the Costs Involved

PostgreSQL Connection Pooling: Part 3 – Pgpool-II

Impact of Querying Table Information From information_schema

InnoDB Performance Optimization Basics

How to Assess MySQL Performance

PostgreSQL Checkpoints, Buffers, and WAL Usage with Percona Monitoring and Management

AB Testing?—?So You Know What Really Works

MongoDB Best Practices: Security, Data Modeling, & Schema Design

Code-level observability for Flutter apps drives great user experience

A Quick Peek at MySQL 8.0.34 and MySQL 8.1.0

Impact of Data locality on DB workloads.

One Index, Three Different PostgreSQL Scan Types: Bitmap, Index, and Index Only

A use case for sp_prepare / sp_prepexec

KPTI/KAISER Meltdown Initial Performance Regressions

Scale Your Liferay Application by Clustering

Egnyte Architecture: Lessons learned in building and scaling a multi petabyte content platform

Common SQL Server Mishaps

How to improve Redo, Transaction Log and WAL throughput for HammerDB benchmarks

KPTI/KAISER Meltdown Initial Performance Regressions

SQL Server I/O Basics Chapter #1

SQL Server I/O Basics Chapter #2

Using Parallel Query with Amazon Aurora for MySQL

Understanding Execution Plan Operator Timings

Stay Connected