Percona

JANUARY 19, 2023

It can help us to save costs on storage and backup times. While MySQL can handle large data sets, it is always recommended to keep only the used data in the databases, as this will make data access more efficient, and also will help to save costs on storage and backups. MyRocks is shipped in Percona Server for MySQL.

Open Source 87

Open Source Storage Database Big Data 87

Brendan Gregg

FEBRUARY 28, 2023

My personal opinion is that I don't see a widespread need for more capacity given horizontal scaling and servers that can already exceed 1 Tbyte of DRAM; bandwidth is also helpful, but I'd be concerned about the increased latency for adding a hop to more memory.

Performance 110

Performance Latency Cache Virtualization 110

HammerDB

APRIL 19, 2023

As database performance is heavily influenced by the performance of storage, network, memory, and processors, we must understand the upper limit of these key components. For storage, FIO is generally used. Storage: The system has a SATA drive for the operating system and one NVMe (Intel SSD D7-P5510 (3.84 Database: MySQL 8.0.31

Performance 54

Performance Benchmarking Cache Storage 54

Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on. I also wrote about these topics in detail for my recent [Systems Performance 2nd Edition] book.

Performance 52

Performance Latency Hardware Storage 52

Brendan Gregg

FEBRUARY 28, 2023

My personal opinion is that I don't see a widespread need for more capacity given horizontal scaling and servers that can already exceed 1 Tbyte of DRAM; bandwidth is also helpful, but I'd be concerned about the increased latency for adding a hop to more memory.

Performance 52

Performance Latency Cache Virtualization 52

Percona

MAY 1, 2023

Key areas include: Configuration parameter tuning : This tuning involves altering variables such as memory allocation, disk I/O settings, and concurrent connections based on specific hardware and requirements. This not only results in cost savings by minimizing hardware requirements but also has the potential to decrease cloud expenses.

Tuning 52

Tuning Efficiency Database Performance 52

Percona

AUGUST 30, 2023

In general terms, here are potential trouble spots: Hardware failure: Manufacturing defects, wear and tear, physical damage, and other factors can cause hardware to fail. heat) can damage hardware components and prompt data loss. Human mistakes: Incorrect configuration is an all-too-common cause of hardware and software failure.

Database 87

Database Hardware Open Source Strategy 87

HammerDB

DECEMBER 5, 2020

Additionally both commercial and open source tools based on the specifications also continued to use TPC-C and TPC-H to describe these workloads. A full understanding of why this is important requires some knowledge of the evolution of database hardware and software. But why is this important?

C++ 40

C++ Benchmarking Virtualization Open Source 40

Percona

JANUARY 4, 2024

Managing storage and performance efficiently in your MySQL database is crucial, and general tablespaces offer flexibility in achieving this. In contrast to the single system tablespace that holds system tables by default, general tablespaces are user-defined storage containers for multiple InnoDB tables.

Storage 87

Storage Engineering Database Hardware 87

Scalegrid

FEBRUARY 1, 2024

MySQL is a popular open-source relational database management system for online applications and data warehousing. However, data loss is always possible due to hardware malfunction, software defects, or other unforeseen circumstances, just like with any computer system.

Best Practices 130

Best Practices Storage Strategy Database 130

Scalegrid

MAY 13, 2020

It can scale towards a multi-petabyte level data workload without a single issue, and it allows access to a cluster of powerful servers that will work together within a single SQL interface where you can view all of the data. High performance, query optimization, open source and polymorphic data storage are the major Greenplum advantages.

Big Data 321

Big Data Database Artificial Intelligence Open Source 321

Percona

MARCH 23, 2023

Hardware Memory The amount of RAM to be provisioned for database servers can vary greatly depending on the size of the database and the specific requirements of the company. Some servers may need a few GBs of RAM, while others may need hundreds of GBs or even terabytes of RAM. Benchmark before you decide.

Performance 124

Performance Hardware Tuning Storage 124

Percona

AUGUST 22, 2023

We’ll wrap it up by suggesting high availability open source solutions, and we’ll introduce you to support options for ensuring continuous high performance from your systems. Load balancing: Traffic is distributed across multiple servers to prevent any one component from becoming overloaded. What is fault tolerance?

Availability 78

Availability Hardware Open Source Database 78

Abhishek Tiwari

JULY 12, 2018

These nodes and edges require a good amount of compute and storage which is typically distributed across a large number servers either running in the cloud or your own data center. A data pipeline is a software which runs on hardware. The software is error-prone and hardware failures are inevitable.

Latency 63

Latency Analytics Scalability Engineering 63

Percona

JULY 7, 2023

Unfortunately, using certain open source database software as part of an HA architecture can present significant challenges. Therefore, DBAs must take a piecemeal approach to achieve HA with PostgreSQL, bringing together open source extensions and tools from multiple sources. there cannot be high availability.

Availability 83

Availability Open Source Architecture Database 83

Percona

FEBRUARY 24, 2023

In the Home Dashboard of PMM, a low CPU utilization on any of the database services that are being monitored could mean that the server is inactive or over-provisioned. Marked in red in Figure 1 is a server with less than 30% of CPU usage. Amazon Elastic Block Store (EBS) is your good-to-go option for disk space.

Cloud 118

Cloud Serverless AWS Storage 118

Percona

JUNE 22, 2023

Defining high availability In general terms, high availability refers to the continuous operation of a system with little to no interruption to end users in the event of hardware or software failures, power outages, or other disruptions. Load balancers can detect when a component is not responding and put traffic redirection in motion.

Availability 107

Availability Database Open Source Hardware 107

High Scalability

OCTOBER 24, 2022

Each cloud-native evolution is about using the hardware more efficiently. Maybe start investing into open source alternatives rather than complaining they don't already exist? Nitro is a revolutionary combination of purpose-built hardware and software designed to provide performance and security. So why bother innovating?

Cloud 187

Cloud Hardware Infrastructure Innovation 187

KeyCDN

FEBRUARY 22, 2023

The goal of WebAssembly is to execute at native speeds by taking advantage of common hardware features available on a variety of platforms. With cloud-based infrastructure, organizations can easily scale their web applications to handle increased traffic or demand without the need for expensive hardware upgrades.

Artificial Intelligence 111

Artificial Intelligence Development Serverless Website 111

HammerDB

JUNE 27, 2022

It enables the user to measure database performance and make comparative judgements about database hardware and software. These factors meant that often when looking for database performance information, the results for a particular combination of software and hardware were not available. How to build HammerDB from source.

Benchmarking 62

Benchmarking Open Source C++ Cache 62

Percona

NOVEMBER 1, 2023

MySQL backups play a pivotal role in safeguarding the integrity of your data, providing defense against various unforeseen calamities, hardware malfunctions, data loss, corruption, and inadvertent deletions. on, you can use mysqlbinlog to stream binary logs from a remote server. 30 days of binlog backups locally on the backup server.

Best Practices 79

Best Practices Storage Strategy Database 79

Percona

JULY 26, 2023

MongoDB is a non-relational document database that provides support for JSON-like storage. When you have multiple copies of your data on different database servers — or even better, in different data centers worldwide — replication provides a high level of fault tolerance in case of a disaster.

Database 79

Database Servers Storage Strategy 79

Percona

AUGUST 18, 2023

Why do you need multiple instances on the same server? You can have a host with two or three instances configured as a delayed replica of the source server with SQL Delay of, let’s say, 24hr, 12hr, and 6/3hrs. You can run multiple instances on a server to test your backups with the correct version and configs.

Programming 84

Programming Servers Database Hardware 84

Percona

JULY 1, 2023

Understanding DBaaS DBaaS cloud services allow users to use databases without configuring physical hardware and infrastructure or installing software. It also supports auto-scaling of compute and storage resources, dynamically adjusting capacity based on chosen utilization thresholds to optimize performance and costs.

AWS 52

AWS Database Serverless Storage 52

Percona

APRIL 17, 2023

It is common to see a value of “ 0″ ( or sometimes “10” ) on database servers, telling the kernel to prefer to swap to memory for better response times. 20-30% is a good general default for “dirty_ratio,” but on large-memory database servers, this can be a lot of memory.

Best Practices 52

Best Practices Design Tuning Database 52

HammerDB

JANUARY 5, 2019

Some opinions claim that “Benchmarks are meaningless”, “benchmarks are irrelevant” or “benchmarks are nothing like your real applications” However for others “Benchmarks matter,” as they “account for the processing architecture and speed, memory, storage subsystems and the database engine.”

Benchmarking 40

Benchmarking Database Social Media Scalability 40

Percona

AUGUST 30, 2018

Because recognizing if the workload is read intensive or write intensive will impact your hardware choices, database configuration as well as what techniques you can apply for performance optimization and scalability. In other words, whether the workload is dominated by reads or writes. Why should you care?

Benchmarking 47

Benchmarking Database Operating System Architecture 47

Scalegrid

JULY 13, 2020

The unstoppable rise of open source databases. One database in particular is causing a huge dent in Oracle’s market share – open source PostgreSQL. See how open source PostgreSQL Community version costs compare to Oracle Standard Edition and Oracle Enterprise Edition. What’s causing this massive shift?

Open Source 244

Open Source Tuning C++ Database 244

Percona

NOVEMBER 3, 2023

PostgreSQL Cluster One coordinator node citus-coord-01 Three worker nodes citus1 citus2 citus3 Hardware AWS Instance Ubuntu Server 20.04, SSD volume type 64-bit (x86) c5.xlarge Steps Provisioning The first step is to provision the four nodes with both PostgreSQL and Citus.

Database 104

Database Benchmarking Latency C++ 104

Smashing Magazine

JANUARY 11, 2021

dashboard (open source), SpeedCurve and Calibre are just a few of them, and you can find more tools on perf.rocks. In the end, it’s not the load events or server response times that define the experience, but the perception of how snappy the interface feels. There are many tools allowing you to achieve that: SiteSpeed.io

Performance 145

Performance Cache Media Metrics 145

Smashing Magazine

JANUARY 6, 2020

Is it worth exploring tree-shaking, scope hoisting, code-splitting, and all the fancy loading patterns with intersection observer, server push, clients hints, HTTP/2, service workers and — oh my — edge workers? dashboard (open source), SpeedCurve and Calibre are just a few of them, and you can find more tools on perf.rocks.

Performance 145

Performance Cache Network Metrics 145

Smashing Magazine

JANUARY 7, 2019

Is it worth exploring tree-shaking, scope hoisting, code-splitting, and all the fancy loading patterns with intersection observer, server push, clients hints, HTTP/2, service workers and — oh my — edge workers? dashboard (open source), SpeedCurve and Calibre are just a few of them, and you can find more tools on perf.rocks.

Performance 104

Performance Cache Metrics Network 104