SQL Performance

APRIL 15, 2020

SQL Server has always provided the ability to capture actual queries in an easily-consumable rowset format – first with legacy SQL Server Profiler, later via Extended Events, and now with a combination of those two concepts in Azure SQL Database. Unfortunately, my excitement was short lived for a couple of reasons.

Azure 96

Azure Database Tuning Network 96

The Netflix TechBlog

MAY 21, 2019

using RL agents for test case scheduling By: Stanislav Kirdey , Kevin Cureton , Scott Rick , Sankar Ramanathan Introduction Netflix brings delightful customer experiences to homes on a variety of devices that continues to grow each day. Detect a regression in a test case.

Testing 163

Testing AWS Lambda Network 163

Testsigma

DECEMBER 4, 2020

To ensure quality, mobile app testing is essential. In this blog, we will discuss a step-by-step mobile app testing checklist. This is where cross-platform testing comes into the picture. Since the mobile apps have limited storage space and power supply, test for memory utilization as well as battery usage.

Mobile 65

Mobile Testing Operating System Storage 65

Scalegrid

FEBRUARY 8, 2024

A distributed storage system is foundational in today’s data-driven landscape, ensuring data spread over multiple servers is reliable, accessible, and manageable. Understanding distributed storage is imperative as data volumes and the need for robust storage solutions rise.

Storage 130

Storage Systems Big Data Azure 130

Dynatrace

AUGUST 5, 2022

In a distributed processing environment, message queuing is similar, although the speed and volume of messages are much greater. A producer creates the message, and a consumer processes it. Consumers store messages in a queue — usually in a buffer or on a storage medium — until they can process and delete them.

Monitoring 193

Monitoring Serverless Programming Speed 193

Dynatrace

AUGUST 5, 2022

In a distributed processing environment, message queuing is similar, although the speed and volume of messages are much greater. A producer creates the message, and a consumer processes it. Consumers store messages in a queue — usually in a buffer or on a storage medium — until they can process and delete them.

Monitoring 192

Monitoring Serverless Programming Speed 192

Testsigma

MAY 7, 2020

IBM Big Data and Analytics Hub website cited a case study, where a US insurance company was estimating 15% of their testing efforts to be just test data collection for the backend system and the frontend system. The test data management for the company had become a big problem and had to be solved. What is test data?

Testing 60

Testing Storage Database Processing 60

Scalegrid

JANUARY 25, 2024

Redis® is an in-memory database that provides blazingly fast performance. This makes it a compelling alternative to disk-based databases when performance is a concern. Redis returns a big list of database metrics when you run the info command on the Redis shell. This blog post lists the important database metrics to monitor.

Metrics 130

Metrics Monitoring Latency Cache 130

Percona

AUGUST 1, 2023

In the world of database management, ALTER TABLE operations are a crucial part of modifying database structures. MySQL, a popular database management system, offers online operations since version 5.6, After changing the VARCHAR column size to 200, the following is the storage requirement. However, there are caveats.

Storage 78

Storage Database Open Source Engineering 78

Percona

JUNE 22, 2023

As a MySQL database administrator, keeping a close eye on the performance of your MySQL server is crucial to ensure optimal database operations. A monitoring tool like Percona Monitoring and Management (PMM) is a popular choice among open source options for effectively monitoring MySQL performance.

Performance 102

Performance Monitoring Traffic Database 102

Percona

MARCH 21, 2023

The replica doesn’t have checking capabilities when processing replicated transactions as of MySQL 8.0.18. In that situation, implementing the upstream changes in a more constrained security context is beneficial to organizations needing privilege-controlled aggregate data from multiple separate databases.

Storage 84

Storage Open Source Database Engineering 84

Dynatrace

AUGUST 26, 2020

Optimal metric storage management strategy. Dynatrace Managed metric storage management is reliable and delivers high performance. Unlike our competition, Dynatrace Managed processes all the data sent by OneAgent without sampling. Our new solution for managing metric storage doesn’t reclaim disk space by data compaction.

Performance 149

Performance Hardware Java Storage 149

Percona

AUGUST 17, 2023

PostgreSQL is open source relational database management software. Most recently, in StackOverflow’s 2022 Stack Developer Survey , PostgreSQL took a slight lead over MySQL (46.48% to 45.68%) as the most popular database platform among professional developers. What is PostgreSQL used for? Is PostgreSQL enterprise-ready?

Open Source 77

Open Source Healthcare Social Media Database 77

HammerDB

APRIL 19, 2023

Among the different components of modern software solutions, the database is one of the most critical. There are many times we get asked why some cloud instance performed poorly for their database application and almost always turned out to be some configuration error. For storage, FIO is generally used. Database: MySQL 8.0.31

Performance 54

Performance Benchmarking Cache Storage 54

O'Reilly Software

JUNE 12, 2018

This meant a lot of time was spent on things like cycle time analysis, build pipeline design, test automation, and infrastructure automation. Back then, the most common pattern I saw for service-based systems was sharing a database among multiple services. But I kept hitting up against some fundamental issues.

Database 72

Database Cache Architecture Latency 72

Percona

JANUARY 19, 2023

Some startups adopted MySQL in its early days such as Facebook, Uber, Pinterest, and many more, which are now big and successful companies that prove that MySQL can run on large databases and on heavily used sites. sec) db1 test> CREATE TABLE tb3 (id int auto_increment primary key, test_text tinytext); Query OK, 0 rows affected (0.13

Open Source 85

Open Source Storage Database Big Data 85

Percona

SEPTEMBER 19, 2023

This type of backup is suitable for large, important databases that need to be recovered quickly when problems occur. Physical backups are the backups that consist of raw copies of the directories and files that store database contents. PXB runs a background process that watches the transaction log files and copies changes from them.

C++ 101

C++ Servers Storage Speed 101

Percona

AUGUST 18, 2023

This blog will explore the hurdles encountered during the upgrade process and the innovative solution that saved the day. I tried the in-place upgrade on my test VM for my own curiosity and got some redo log format errors/Data Dictionary errors. to test the binlog compatibility. to MySQL 8.0, to MySQL 8.x to MySQL 5.7

Open Source 65

Open Source Database Storage Engineering 65

Testsigma

JULY 14, 2020

According to Wikipedia, Data-Driven Testing(DDT) is a software testing methodology that is used in the testing of computer software to describe testing done using a table of conditions directly as test inputs and verifiable outputs as well as the process where test environment settings and control are not hard-coded.

Testing 63

Testing Artificial Intelligence DevOps Big Data 63

Dynatrace

SEPTEMBER 30, 2021

AWS Certified Database – Specialty: Database specialists with deep knowledge of relational and non-relational databases and some AWS experience might want to check out this certification. Take a trial test at Linux Academy if it’s applicable to the cert you have in mind. Machine learning.

AWS 202

AWS Best Practices Analytics Cloud 202

Percona

JULY 25, 2023

Percona XtraBackup performs crash recovery on the files to make a consistent, usable database again. The redo apply phase wouldn’t make the database consistent with respect to a transaction. ibd in the test directory. For example, mysql datadir/test/t1.ibd. ibd2sdi data/test/t1.ibd CREATE TABLE test.t1(a

Cache 84

Cache Benchmarking Servers Design 84

Percona

MAY 9, 2023

Many MongoDB clusters use storage-level snapshots to provide fast and reliable backups. Background story I recently worked with a company running a large four-shard MongoDB Enterprise Server database cluster on VMs on premises that decided to migrate to the Google Cloud Platform.

Storage 101

Storage Cloud Servers Google 101

Percona

JUNE 4, 2023

Introduction: MariaDB vs. MySQL The goal of this blog post is to evaluate, at a higher level, MariaDB vs. MySQL vs. Percona Server for MySQL side-by-side to better inform the decision making process. It is largely an unofficial response to published comments from the MariaDB Corporation. What is MariaDB?

Open Source 52

Open Source Servers Storage Scalability 52

Percona

AUGUST 30, 2023

Data powers everything, and unlike coal and coal combustion, data and databases aren’t going away. In this blog, we’ll focus on the elements of database backup and disaster recovery, and we’ll introduce proven solutions for maintaining business continuity, even amid otherwise dire circumstances.

Database 85

Database Hardware Open Source Strategy 85

The Netflix TechBlog

JULY 30, 2019

Many of the Netflix Content and Studio Engineering services rely on Conductor for efficient processing of their business flows. The Netflix Media Database (NMDB) is one such example. This allows us to proactively push changes to the open source version while ensuring that the changes are fully functional and well-tested.

Lambda 189

Lambda Media Open Source Metrics 189

SQL Server According to Bob

SEPTEMBER 9, 2019

A handful of lock types (Database, Metadata, LOGIN_STATS, …) are eligible for lock partitioning. For example: When ‘use database’ takes place the session acquires a shared lock on database. Only distinct changes require an exclusive database lock, for example a drop database.

Servers 103

Servers Database Scalability Tuning 103

Percona

OCTOBER 18, 2023

Migrating a proprietary database to open source is a major decision that can significantly affect your organization. It’s a complex process involving various factors and meticulous planning. Flexibility and scalability Open source databases provide much greater flexibility regarding customization and configuration.

Open Source 89

Open Source Database Hardware Strategy 89

The Morning Paper

AUGUST 29, 2019

As it is infeasible to test every OLAP system runnable on AWS, we chose widely-used systems that represented a variety of architectures and cost models. My key takeaways as a TL;DR: Store your data in S3 Use portable data format that gives you future flexibility to process it with multiple different systems (e.g. Key findings.

Architecture 76

Architecture Cloud Storage Serverless 76

Scalegrid

MARCH 8, 2024

With MySQL point-in-time recovery , you can restore your database to the moment before the problem occurs. Preparation for PITR is crucial and involves enabling binary logging and creating a full database backup. Through this meticulous process, commits are accurately logged in their respective sequences.

Database 162

Database Strategy Servers Best Practices 162

Scalegrid

FEBRUARY 1, 2024

MySQL is a popular open-source relational database management system for online applications and data warehousing. Because of this, preserving the availability and integrity of the data stored in MySQL databases requires regular backups. Having MySQL backups for your database can speed up and simplify the recovery process.

Best Practices 130

Best Practices Storage Strategy Database 130

SQL Performance

AUGUST 27, 2021

The instance-wide versioning timestamp is incremented whenever a new statement or batch begins, or a new version of a record is created, in any database where either form of snapshot isolation is enabled. This timestamp is used to make sure a query processes the correct version of a record.

Database 56

Database Storage Availability Servers 56

Tasktop

JANUARY 9, 2020

Given that most large-scale organizations use at least three main tools in their software delivery toolchains (for development, testing and support), the cost of data extraction and storage begins to stack up and fast. Furthermore, many SaaS vendors purge data periodically to save on storage, limiting your access to historical data.

Software 59

Software Software Metrics Database 59

SQL Performance

MARCH 17, 2020

Test Environment. I will be using the 50GB Stack Overflow 2013 database , but any large table with a low number of distinct values would do. The Stack Overflow 2013 database comes without nonclustered indexes to minimize download time. The Sort only has 19 rows to process, so it consumes only 1ms or so. BountyAmount.

Servers 86

Servers Tuning Database Efficiency 86

Percona

MARCH 13, 2023

In my lab, we have two test nodes: PRIMARY: mysql57 (192.168.56.111) with Percona Server 5.7 First, let’s try streaming copy from mysql57 to mysql8 server as this does not need additional storage. for this database. When we need to upgrade from MySQL 5.7 server with Percona XtraBackup. and xtrabackup 2.4 installed 0.

Servers 100

Servers C++ Storage Systems 100

HammerDB

DECEMBER 5, 2020

A full understanding of why this is important requires some knowledge of the evolution of database hardware and software. A full understanding of why this is important requires some knowledge of the evolution of database hardware and software. I.e. if system A generated 1.5X Why would this be the case?

C++ 40

C++ Benchmarking Virtualization Open Source 40

Scalegrid

JULY 17, 2020

Why should a relational database even care about unstructured data? JSON database in 9.2 It is useful to validate incoming JSON and store in the database. JSON is faster to ingest vs. JSONB – however, if you do any further processing, JSONB will be faster. JSONB storage results in a larger storage footprint.

Storage 321

Storage Database Efficiency Processing 321

Dynatrace

SEPTEMBER 17, 2019

PostgreSQL & Elastic for data storage. In order to filter these dashboards by tenant all they need is a Dynatrace Management Zone , which is based on meta data extracted by Dynatrace from e.g. k8s tags, container labels or process environment variables. Their technology stack looks like this: Spring Boot-based Microservices.

AWS 127

AWS Monitoring Ecommerce Lambda 127