Percona

OCTOBER 18, 2023

Migrating a proprietary database to open source is a major decision that can significantly affect your organization. Today, we’ll be taking a deep dive into the intricacies of database migration, along with specific solutions to help make the process easier.

Open Source 95

Open Source Database Hardware Strategy 95

Percona

JANUARY 19, 2023

Some startups adopted MySQL in its early days such as Facebook, Uber, Pinterest, and many more, which are now big and successful companies that prove that MySQL can run on large databases and on heavily used sites. Some of them are: MySQL Cluster: MySQL NDB Cluster is an in-memory database clustering solution developed by Oracle for MySQL.

Open Source 91

Open Source Storage Database Big Data 91

SQL Performance

MARCH 17, 2020

Back in 2014, I wrote an article called Performance Tuning the Whole Query Plan. I will be using the 50GB Stack Overflow 2013 database , but any large table with a low number of distinct values would do. The Stack Overflow 2013 database comes without nonclustered indexes to minimize download time. Test Environment.

Servers 86

Servers Tuning Database Efficiency 86

Percona

MARCH 23, 2023

Hardware Memory The amount of RAM to be provisioned for database servers can vary greatly depending on the size of the database and the specific requirements of the company. Storage The type of storage and disk used for database servers can have a significant impact on performance and reliability.

Performance 129

Performance Hardware Tuning Storage 129

VoltDB

MAY 2, 2017

This has always been a supported configuration of VoltDB database replication. Here’s how we explain it in our Documentation: Support for different cluster sizes in passive Database Replication (DR). because they want to use a lower k- factor (even 0) on the replica cluster to lower hardware costs. Replica: 1 or 2 nodes, k=0.

Hardware 40

Hardware Database Servers Tuning 40

Percona

AUGUST 29, 2018

For optimum performance, a PostgreSQL database depends on the operating system parameters being defined correctly. Poorly configured OS kernel parameters can cause degradation in database server performance. Therefore, it is imperative that these parameters are configured according to the database server and its workload.

Tuning 58

Tuning Database Servers Processing 58

Dynatrace

JANUARY 26, 2021

This allows teams to sidestep much of the cost and time associated with managing hardware, platforms, and operating systems on-premises, while also gaining the flexibility to scale rapidly and efficiently. REST APIs, authentication, databases, email, and video processing all have a home on serverless platforms.

Serverless 243

Serverless Efficiency Lambda Azure 243

SQL Performance

APRIL 27, 2020

Azure SQL Database is Microsoft's database-as-a-service offering that provides a tremendous amount of flexibility. Microsoft is continually working on improving their products and Azure SQL Database is no different. Gen 5 is the primary hardware option now for most regions since Gen 4 is aging out. HyperScale Database.

Azure 55

Azure Database Serverless Hardware 55

Percona

JANUARY 4, 2024

Managing storage and performance efficiently in your MySQL database is crucial, and general tablespaces offer flexibility in achieving this. Flexible location : Data files can reside within the MySQL data directory or an independent location, enabling finer control over storage management and performance tuning.

Storage 91

Storage Engineering Database Hardware 91

Dynatrace

SEPTEMBER 29, 2021

Container technology is very powerful as small teams can develop and package their application on laptops and then deploy it anywhere into staging or production environments without having to worry about dependencies, configurations, OS, hardware, and so on. The time and effort saved with testing and deployment are a game-changer for DevOps.

Open Source 300

Open Source Traffic DevOps Cloud 300

O'Reilly

NOVEMBER 28, 2023

If we asked whether their companies were using databases or web servers, no doubt 100% of the respondents would have said “yes.” A year after the first web servers became available, how many companies had websites or were experimenting with building them? And only 33% report that their companies aren’t using AI at all.

Open Source 108

Open Source Artificial Intelligence Google Infrastructure 108

SQL Performance

JANUARY 23, 2020

Tom Davidson, Opening Microsoft's Performance-Tuning Toolbox SQL Server Pro Magazine, December 2003. Waits and Queues has been used as a SQL Server performance tuning methodology since Tom Davidson published the above article as well as the well-known SQL Server 2005 Waits and Queues whitepaper in 2006. The Top Queries That Weren't.

Tuning 115

Tuning Servers Monitoring Hardware 115

All Things Distributed

OCTOBER 8, 2014

We designed DynamoDB to operate with at least 99.999% availability. We started with Amazon Dynamo, a simple key-value store that was built to be highly available and scalable to power various mission-critical applications in Amazon’s e-commerce platform. In 2012, we launched Amazon DynamoDB, the successor to Amazon Dynamo.

Availability 145

Availability Performance Scalability AWS 145

Percona

APRIL 17, 2023

The main objective of this post is to share my experience over the past years tuning MongoDB and centralize the diverse sources that I crossed in this journey in a unique place. The Linux default is usually 60 , which is not ideal for database usage. There is an issue with this, which causes the OS to swap even with memory available.

Best Practices 52

Best Practices Design Tuning Database 52

Percona

AUGUST 27, 2018

Resource groups permit assigning threads running within MySQL to particular groups so that threads execute according to the resources available to this group. assigning to a specific CPU) is a manageable resource, represented by the concept of “virtual CPU” as a term that includes CPU cores, hyperthreads, hardware threads, and so forth.

Tuning 46

Tuning Virtualization Testing Servers 46

HammerDB

JANUARY 5, 2019

Some opinions claim that “Benchmarks are meaningless”, “benchmarks are irrelevant” or “benchmarks are nothing like your real applications” However for others “Benchmarks matter,” as they “account for the processing architecture and speed, memory, storage subsystems and the database engine.”

Benchmarking 40

Benchmarking Database Social Media Scalability 40

All Things Distributed

MARCH 19, 2018

Streaming algorithms also natively consume ephemeral data sources such as Amazon Kinesis streams, pipes, database query results, and almost any other data source. To seamlessly switch between CPU and GPU machines, we use Apache MXNet to interface with the underlying hardware. Post-training model tuning and rich states.

Scalability 159

Scalability Hardware AWS Tuning 159

All Things Distributed

MARCH 7, 2013

As I sat down with the DynamoDB team to review our progress over the last year, I realized that DynamoDB had surpassed even my own expectations for how easily applications could achieve massive scale and high availability with DynamoDB. I am often asked: When is it appropriate to use DynamoDB instead of a relational database?

Ecommerce 139

Ecommerce Storage Scalability Hardware 139

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. top(1) showed that only the Cassandra database was consuming CPU. As a Xen guest, this profile was gathered using perf(1) and the kernel's software cpu-clock soft interrupts, not the hardware NMI. But I'm not completely sure.

Speed 126

Speed Java AWS Virtualization 126

Percona

AUGUST 5, 2023

Partitioning is a way in which a database (MySQL in this case) splits its actual data down into separate tables but still gets treated as a single table by the SQL layer. As the data is distributed into smaller partitions, the database engine only needs to scan relevant partitions, leading to faster query responses.

Strategy 40

Strategy Storage Database Best Practices 40

Percona

AUGUST 29, 2023

Data redundancy, a database version of a RAID Pondering the case of high availability and redundancy, one replicates data by creating a replica via streaming replication. Now let’s stretch our imagination and consider a second method of high availability, ala Citus. Extension citus has been created in database db01.

C++ 83

C++ Database Storage Testing 83

HammerDB

FEBRUARY 25, 2021

HammerDB is a load testing and benchmarking application for relational databases. All the databases that HammerDB tests implement a form of MVCC (multi-version concurrency control). On high-performance multi-core systems all the supported databases can return performance in the many millions of transactions per minute.

Programming 67

Programming Benchmarking Virtualization C++ 67

HammerDB

OCTOBER 18, 2019

HammerDB doesn’t publish competitive database benchmarks, instead we always encourage people to be better informed by running their own. hardware limits: 1000 MHz - 4.00 GHz available cpufreq governors: performance powersave current policy: frequency should be within 1000 MHz and 4.00 hardware limits: 1000 MHz - 4.00

Benchmarking 63

Benchmarking Performance Hardware C++ 63

SQL Server According to Bob

JANUARY 11, 2020

Microsoft SQL Server I/O Basics Author: ​​ Bob Dorr, Microsoft SQL Server Escalation Published: ​​ December, 2004 SUMMARY: ​​ Learn the I/O requirements for Microsoft SQL Server database file operations. This will help you increase system performance and avoid I/O environment errors.

Servers 40

Servers Cache Media Hardware 40

HammerDB

OCTOBER 12, 2018

Similarly for this guide MySQL can be swapped for a mySQL based databases such as MariaDB. As is also the case this limitation is at the database level (especially the storage engine) rather than the hardware level. As is exactly the same with PostgreSQL for system choice a 2 socket system is optimal for MySQL OLTP performance.

Best Practices 40

Best Practices Scalability Performance C++ 40

O'Reilly

OCTOBER 11, 2022

However, one thing should be obvious: to fill a prescription, you need to access many different kinds of data, in many different databases. Andrew Ng , Christopher Ré , and others have pointed out that in the past decade, we’ve made a lot of progress with algorithms and hardware for running AI. Most are subject to privacy regulations.

Games 116

Games Healthcare Processing Retail 116

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. top(1) showed that only the Cassandra database was consuming CPU. As a Xen guest, this profile was gathered using perf(1) and the kernel's software cpu-clock soft interrupts, not the hardware NMI. But I'm not completely sure.

Speed 40

Speed Java AWS Virtualization 40

SQL Server According to Bob

JANUARY 11, 2020

KB sectors run on smaller sectors   14 System and sample databases   15 Determining the formatted sector size of database   15 What sector sizes does SQL Server support? SQL Server 2005 introduces the snapshot database feature for point-in-time databases ​​ and online DBCC operations.

Servers 40

Servers Cache Database Media 40

O'Reilly Software

APRIL 4, 2018

Google was among the pioneers that created “web scale” architectures to analyze the massive data sets that resulted from “crawling” the web that gave birth to Apache Hadoop, MapReduce, and NoSQL databases. The data shape will dictate capacity planning, tuning of the backbone, and scalability analysis for individual components.

Architecture 80

Architecture Scalability Google Operating System 80

Percona

NOVEMBER 3, 2023

Rather than listing the concepts, function calls, etc, available in Citus, which frankly is a bit boring, I’m going to explore scaling out a database system starting with a single host. I won’t cover all the features but show just enough that you’ll want to see more of what you can learn to accomplish for yourself.

Database 107

Database Benchmarking Latency C++ 107

SQL Performance

MARCH 8, 2021

This can make it difficult to draw sound performance-tuning conclusions. The following examples use the public Stack Overflow 2013 database ( download details ), with a single index added: CREATE INDEX PP ON dbo. The yellow consumer times are short because it is quick to retrieve a row from the exchange when data is available.

Servers 95

Servers Tuning Architecture Processing 95

Scalegrid

JULY 13, 2020

Oracle Database is a commercial, proprietary multi-model database management system produced by Oracle Corporation, and the largest relational database management system (RDBMS) in the world. While Oracle remains the #1 database on the market, its popularity has steadily declined by over 18% since 2013.

Open Source 244

Open Source Tuning C++ Database 244

Percona

JANUARY 17, 2019

On multi-core machines – which is the majority of the hardware nowadays – and in the cloud, we have multiple cores available for use. I’m using the “Airlines On-Time Performance” database from [link] (You can find the scripts I used here: [link] ). With faster disks (i.e. AWS Aurora (based on MySQL 5.6) MySQL on ec2.

Cache 48

Cache C++ AWS Airlines 48

High Scalability

NOVEMBER 25, 2019

Chokepoint : Even sharded Berkeley DB was choking under the stress and there was a database crash with recovery taking hours, it had to be replaced. Always be available: Have a service level circuit breaker and a circuit breaker by customer. Automate schema management for some remaining databases. Cloud Platform. Google cloud.

Architecture 52

Architecture Cache Azure Storage 52