The Morning Paper

MARCH 3, 2020

Millions of tiny databases , Brooker et al., It takes you through the thinking processes and engineering practices behind the design of a key part of the control plane for AWS Elastic Block Storage (EBS): the Physalia database that stores configuration information. Engineering decisions involve making lots of trade-offs.

Database 106

Database AWS Network Design 106

Scalegrid

DECEMBER 21, 2023

Redis® Monitoring Essentials Ensuring the performance, reliability, and safety of a Redis® database requires active monitoring. With these essential support systems in place, you can effectively monitor your databases with up-to-date data about their health and functioning status at all times.

Strategy 130

Strategy Monitoring Latency DevOps 130

Dynatrace

APRIL 15, 2022

The agency executed one of the largest email migrations from on-premises Exchange servers to Microsoft Office 365 — moving almost 480,000 mailboxes to the cloud. “We used Dynatrace to monitor that large increase in servers. We started out by instrumenting 2,000 servers overnight.

Cloud 171

Cloud Infrastructure Innovation Monitoring 171

Percona

MAY 2, 2023

At the same time that I see database engineers relying on the tool, sites such as StackOverflow are banning ChatGPT. Questions Q: I have a MySQL server with 500 GB of RAM; my data set is 100 GB. It is also important to monitor your server’s memory usage regularly to ensure that it is not being exhausted by the buffer pool.

Social Media 121

Social Media Database Servers Cache 121

Percona

JUNE 22, 2023

As a MySQL database administrator, keeping a close eye on the performance of your MySQL server is crucial to ensure optimal database operations. PMM monitors the MySQL uptime: show global status like 'uptime'; Indicates the amount of time (seconds) the MySQL server has been running since the last restart.

Performance 104

Performance Monitoring Traffic Database 104

Percona

FEBRUARY 24, 2023

In the Home Dashboard of PMM, a low CPU utilization on any of the database services that are being monitored could mean that the server is inactive or over-provisioned. Marked in red in Figure 1 is a server with less than 30% of CPU usage. Amazon RDS replicates all databases in the source DB instance.

Cloud 118

Cloud Serverless AWS Storage 118

Dynatrace

APRIL 5, 2021

The 2014 launch of AWS Lambda marked a milestone in how organizations use cloud services to deliver their applications more efficiently, by running functions at the edge of the cloud without the cost and operational overhead of on-premises servers. A new record entering a database table. What is AWS Lambda? How does AWS Lambda work?

Lambda 175

Lambda AWS Serverless Hardware 175

Percona

JULY 7, 2023

Unfortunately, using certain open source database software as part of an HA architecture can present significant challenges. This blog highlights considerations for keeping your own PostgreSQL databases highly available and healthy. The same changes made in the primary database are made in the replicas.

Availability 83

Availability Open Source Architecture Database 83

Scalegrid

JULY 13, 2020

Oracle Database is a commercial, proprietary multi-model database management system produced by Oracle Corporation, and the largest relational database management system (RDBMS) in the world. While Oracle remains the #1 database on the market, its popularity has steadily declined by over 18% since 2013. Not available.

Open Source 244

Open Source Tuning C++ Database 244

Percona

JANUARY 4, 2024

Managing storage and performance efficiently in your MySQL database is crucial, and general tablespaces offer flexibility in achieving this. Convenient table management : General tablespaces allow you to group multiple tables together, making it easier to manage and organize your database objects. What are MySQL general tablespaces?

Storage 87

Storage Engineering Database Hardware 87

SQL Server According to Bob

DECEMBER 18, 2018

SQL Server relies on Forced-Unit-Access (Fua) I/O subsystem capabilities to provide data durability, detailed in the following documents: SQL Server 2000 I/O Basic and SQL Server I/O Basics, Chapter 2. Be sure to deploy SQL Server 2017 CU6 or newer for best data durability and performance results. “. The Back Story.

Servers 90

Servers Media Cache Storage 90

Percona

DECEMBER 27, 2023

The field of Platform Engineering has witnessed significant advancements, as evidenced by the publication of the CNCF platform whitepaper and the introduction of a dedicated Platform Engineering day at the upcoming KubeCon event. of respondents are currently utilizing databases in Kubernetes (k8s).

Cloud 79

Cloud Open Source Strategy Best Practices 79

SQL Performance

JUNE 21, 2019

I've been teaching and writing about common SQL Server mistakes for many years. This article will expand on my previous article and point out how these apply to SQL Server , Azure SQL Database , and Azure SQL Managed Instance. SQL Server Agent alerts. This situation applies to on-premises SQL Server and IaaS.

Servers 49

Servers Azure Hardware Database 49

Percona

SEPTEMBER 1, 2023

Database architects working with MongoDB encounter specific challenges related to database systems and system growth. Scalability is a significant concern, as databases must handle growing data volumes and user demands while maintaining peak performance.

Best Practices 71

Best Practices Traffic Database Servers 71

Dynatrace

SEPTEMBER 29, 2021

A standard Docker container can run anywhere, on a personal computer (for example, PC, Mac, Linux), in the cloud, on local servers, and even on edge devices. Running containers : Docker Engine is a container runtime that runs in almost any environment: Mac and Windows PCs, Linux and Windows servers, the cloud, and on edge devices.

Open Source 294

Open Source Traffic DevOps Cloud 294

Dynatrace

SEPTEMBER 30, 2021

It requires purchasing, powering, and configuring physical hardware, training and retaining the staff capable of servicing and securing the machines, operating a data center, and so on. They need enough hardware to serve their anticipated volume and keep things running smoothly without buying too much or too little. Reduced cost.

Cloud 160

Cloud Traffic Best Practices Strategy 160

Scalegrid

JUNE 11, 2019

Ready to transition from a commercial database to open source, and want to know which databases are most popular in 2019? Wondering whether an on-premise vs. public cloud vs. hybrid cloud infrastructure is best for your database strategy? Polyglot Persistence Trends : Number of Databases Used & Top Combinations.

Open Source 55

Open Source Database Cloud Infrastructure 55

Dotcom-Montior

NOVEMBER 24, 2021

Do you have a database? Do you have a web server? Was the database running? Is the web server running? The last item to check was if the web server was able to talk to the database? The last item to check was if the web server was able to talk to the database? Onto the next project.

Systems 74

Systems Monitoring Hardware Network 74

HammerDB

JUNE 27, 2022

HammerDB is a software application for database benchmarking. It enables the user to measure database performance and make comparative judgements about database hardware and software. Databases are highly sophisticated software, and to design and run a fair benchmark workload is a complex undertaking.

Benchmarking 62

Benchmarking Open Source C++ Cache 62

Percona

JANUARY 19, 2023

Some startups adopted MySQL in its early days such as Facebook, Uber, Pinterest, and many more, which are now big and successful companies that prove that MySQL can run on large databases and on heavily used sites. This can help to split large data sets into smaller ones stored in multiple servers.

Open Source 87

Open Source Storage Database Big Data 87

HammerDB

JANUARY 5, 2019

Some opinions claim that “Benchmarks are meaningless”, “benchmarks are irrelevant” or “benchmarks are nothing like your real applications” However for others “Benchmarks matter,” as they “account for the processing architecture and speed, memory, storage subsystems and the database engine.”

Benchmarking 40

Benchmarking Database Social Media Scalability 40

Percona

AUGUST 15, 2023

In this blog post, I provide an in-depth introduction to MySQL Replication, answering what it is, how it works , its benefits and challenges, as well as reviewing some of the MySQL replication concepts that are part of the MySQL environment (and Percona Server for MySQL specifically). Set the server-id to a unique value.

Servers 52

Servers Database Availability Traffic 52

Percona

AUGUST 8, 2023

Unfortunately, this topic is more of an art than a science, given that there is really no foolproof algorithm or approach that can tell you exactly where you might hit a bottleneck with server performance. Hardware considerations The first thing we have to consider here is the resources that the underlying host provides to the database.

Traffic 89

Traffic Cache Monitoring Database 89

Percona

NOVEMBER 1, 2023

As businesses and applications increasingly rely on MySQL databases to manage their critical data, ensuring data reliability and availability becomes paramount. Learn more: Discover six of the most common causes of poor database performance in our free eBook. Why Do MySQL Backups Matter? What is the Recovery Time Objective?

Best Practices 79

Best Practices Storage Strategy Database 79

SQL Server According to Bob

JANUARY 11, 2020

Microsoft, ​​ Windows, ​​ Windows NT, ​​ and Windows Server ​​ are registered trademarks of Microsoft Corporation in the United States and/or other countries. The names of actual companies and products mentioned herein may be the trademarks of their respective owners.

Servers 40

Servers Cache Database Media 40

The Morning Paper

FEBRUARY 20, 2020

The motivation is not that inference will perform better inside the database, but that the database is the best place to take advantage of enterprise features (transactions, security, auditing, HA, and so on). These pipelines are stored directly in the database. End-to-end the picture looks like this: ( Enlarge ).

Processing 72

Processing Hardware Database Azure 72

SQL Performance

JANUARY 23, 2020

Tom Davidson, Opening Microsoft's Performance-Tuning Toolbox SQL Server Pro Magazine, December 2003. Waits and Queues has been used as a SQL Server performance tuning methodology since Tom Davidson published the above article as well as the well-known SQL Server 2005 Waits and Queues whitepaper in 2006.

Tuning 115

Tuning Servers Monitoring Hardware 115

J. Paul Reed

AUGUST 7, 2023

If we accept Sidney Dekker’s assertion in Just Culture that “No professional comes to work to do a bad job,” then we should assume an engineer working on an action item, of any size and effort, has a justification for doing so. The “root cause” [sic] was eventually identified and it was related subtle differences in server provisioning.

Engineering 52

Engineering Hardware Games Infrastructure 52

Adrian Cockcroft

JUNE 21, 2022

So in 1988 I joined the Sun sales force and became a Systems Engineer (nowadays we would say Solutions Architect). I became the Sun UK local specialist in performance and hardware, and as Sun transitioned from a desktop workstation company to sell high end multiprocessor servers I was helping customers find and fix scalability problems.

Tuning 52

Tuning Benchmarking Engineering C++ 52

Percona

APRIL 17, 2023

Note that the intent of tuning the settings is not exclusively about improving performance but also enhancing the high availability and resilience of the MongoDB database. The Linux default is usually 60 , which is not ideal for database usage. Spoiler alert: This post focuses on MongoDB 3.6.X

Best Practices 52

Best Practices Design Tuning Database 52

Percona

AUGUST 5, 2023

Partitioning is a way in which a database (MySQL in this case) splits its actual data down into separate tables but still gets treated as a single table by the SQL layer. Otherwise, the storage engine does a scatter-gather and queries ALL partitions in a UNION that is not concurrent. So, What is MySQL Partitioning?

Strategy 40

Strategy Storage Database Best Practices 40

HammerDB

APRIL 19, 2023

Among the different components of modern software solutions, the database is one of the most critical. There are many times we get asked why some cloud instance performed poorly for their database application and almost always turned out to be some configuration error. TB)) for storage of database tablespaces and logging.

Performance 54

Performance Benchmarking Cache Storage 54

SQL Performance

JULY 3, 2019

A recent consulting engagement was focused on blocking issues inside of SQL Server that were causing delays in processing user requests from the application. Depending on which DMV you look at for SQL Server, a session can have a few different statuses. So, we had to dig in further. Understanding Session Status.

Servers 64

Servers Hardware Code Virtualization 64

Brendan Gregg

NOVEMBER 29, 2017

Hardware virtualization for cloud computing has come a long way, improving performance using technologies such as VT-x, SR-IOV, VT-d, NVMe, and APICv. The latest AWS hypervisor, Nitro, uses everything to provide a new hardware-assisted hypervisor that is easy to use and has near bare-metal performance. I'd expect between 0.1%

Virtualization 111

Virtualization AWS Hardware Storage 111

Percona

DECEMBER 14, 2022

In the database world there are essentially two types of database operations: Online Transaction Processing , OLTP : Online transaction processing applications have high throughput and are insert- or update-intensive in database management. Distributed query engine routes and parallelizes SELECT, DML, and operations.

Database 92

Database Analytics Storage Processing 92

O'Reilly

JULY 15, 2020

Software engineers comprise the survey audience’s single largest cluster, over one quarter (27%) of respondents (Figure 1). Adding architects and engineers, we see that roughly 55% of the respondents are directly involved in software development. Technical roles dominate, but management roles are represented, too.

Database 135

Database Architecture Education Systems 135

SQL Server According to Bob

JULY 13, 2016

20+ years ago when I joined Microsoft I was handed a diskette (maybe it was two), and was told “Here is SQL Server. So I proceeded to install SQL Server 4.20 desktop machine (I won’t tell you the hardware details. There was a GUI as part of setup but within just a few clicks, SQL Server was installed and ready for use.

Servers 40

Servers Media Engineering Virtualization 40