Percona

APRIL 12, 2023

They came up with a horizontally scalable NoSQL database. Instead of relational (SQL) databases defined primarily through a hierarchy of related sets via tables and columns, their non-relational structure used a system of collections and documents. 2016: The company adds service-loaded MongoDB Professional to its mix.

Open Source 82

Open Source Programming Database Servers 82

Adrian Cockcroft

JANUARY 31, 2023

I’d helped eBay recover from capacity related outages in 1999 and had setup their capacity planning processes. Many years later I re-wrote the simulator in Go and had some more fun with the concepts at Gophercon 2016. At the time eBay was one of the largest online businesses and was developing patterns that later became widely adopted.

Google 52

Google Transportation Programming Innovation 52

SQL Performance

DECEMBER 9, 2020

I mainly experimented with different table value constructor cardinalities, with serial versus parallel processing, and with row mode versus batch mode processing. You can create supporting tables in the user database if needed. The plan is serial, and all operators in the plan use row mode processing by default.

C++ 114

C++ Servers Testing Processing 114

SQL Performance

AUGUST 14, 2019

In my examples I'll use a sample database called TSQLV5. You can find the script that creates and populates this database here , and its ER diagram here. The performance penalty is relevant only when the window function is optimized with row-mode processing operators. Figure 1: Plan for Query 1, row-mode processing.

Best Practices 108

Best Practices Servers Database Azure 108

Alex Podelko

OCTOBER 20, 2016

I am looking forward to share my thoughts on ‘Reinventing Performance Testing’ at the imPACt performance and capacity conference by CMG held on November 7-10, 2016 in La Jolla, CA. I decided to publish a few parts here to see if anything triggers a discussion. It would be published as separate posts: – Introduction (a short teaser).

Performance Testing 100

Performance Testing Architecture Testing Performance 100

SQL Server According to Bob

NOVEMBER 8, 2016

SQL Server 2016 Service Pack 1 (all SKUs) , in combination with Windows Server 2016 (All SKUs) or Windows 10 Client introduces non-volatile memory support for the tail of the log file (LDF) which can significantly increase transaction throughput. Create / Alter Database … LOG ON. Tail Of Log Caching.

Cache 40

Cache Servers Media Storage 40

Percona

JUNE 4, 2023

Introduction: MariaDB vs. MySQL The goal of this blog post is to evaluate, at a higher level, MariaDB vs. MySQL vs. Percona Server for MySQL side-by-side to better inform the decision making process. It is largely an unofficial response to published comments from the MariaDB Corporation. What is MariaDB?

Open Source 52

Open Source Servers Storage Scalability 52

Adrian Cockcroft

JANUARY 29, 2023

I presented this analysis of response time distributions talk in 2016 — at Microxchg in Berlin ( video ). For high traffic systems, processing the individual response times for each request may be too much work. I’ve been thinking about this for a long time. > system.time(wait1 <- normalmixEM(waiting, mu=c(50,80), lambda=.5,

Lambda 98

Lambda Latency Cache Traffic 98

SQL Performance

FEBRUARY 22, 2021

Our first warnings are usually spotted on a dashboard that plots log reader latency against transaction duration (I'll explain the points in time I labeled t 0 and t 1 shortly): They determined, let's say at time t 0 , that a certain session had an open transaction blocking the log reader process.

Latency 57

Latency Servers Monitoring Systems 57

SQL Server According to Bob

JANUARY 26, 2017

Transparent Data Encryption (TDE) is a feature that was introduced in SQL Server 2008 (and is also available for Azure SQL Database, Azure SQL Data Warehouse, and Parallel Data Warehouse) with the purpose of encrypting your data at rest. That is to ensure your database is encrypted at the file level.

Servers 40

Servers Database Azure Cache 40

SQL Server According to Bob

APRIL 25, 2017

I recently visited a customer onsite and presented to them topics on SQL Server 2016. One question I got went like this “I’ve tried to restore a database on SQL Server using the WITH STATS option. We now have a new way of instrumenting the backup/restore process for any database or transaction log. 10 percent processed.

Servers 40

Servers Database Processing Virtualization 40

SQL Server According to Bob

APRIL 21, 2017

I recently visited a customer onsite and presented to them topics on SQL Server 2016. One question I got went like this “I’ve tried to restore a database on SQL Server using the WITH STATS option. We now have a new way of instrumenting the backup/restore process for any database or transaction log. 10 percent processed.

Servers 40

Servers Database Processing Virtualization 40

SQL Performance

DECEMBER 9, 2020

I mainly experimented with different table value constructor cardinalities, with serial versus parallel processing, and with row mode versus batch mode processing. You can create supporting tables in the user database if needed. The plan is serial, and all operators in the plan use row mode processing by default.

C++ 61

C++ Servers Testing Processing 61

SQL Server According to Bob

JUNE 3, 2016

SQL Server 2016 ‘It Just Runs Faster’ A bold statement that any SQL Server professional can stand behind with confidence. Try SQL Server 2016 Today. You can take advantage of this effort packaged in SQL Server 2016. SQL 2016 supports 3X more physical memory than previous versions. – [link].

Hardware 40

Hardware Software Engineering Transportation Scalability 40

SQL Performance

OCTOBER 14, 2020

In my examples I’ll continue using the sample databases TSQLV5 and PerformanceV5. In Part 4 of the series, which focused on optimization of derived tables, I described a process of unnesting/substitution of table expressions. You can find the script that creates and populates TSQLV5 here , and its ER diagram here. Employees ; GO.

C++ 140

C++ Servers Code Efficiency 140

Scalegrid

JULY 17, 2020

Why should a relational database even care about unstructured data? JSON database in 9.2 It is useful to validate incoming JSON and store in the database. JSON is faster to ingest vs. JSONB – however, if you do any further processing, JSONB will be faster. JSONB Patterns & Antipatterns. JSONB Data Structures.

Storage 321

Storage Database Efficiency Processing 321

SQL Server According to Bob

FEBRUARY 10, 2019

This means we are reading database pages from the master, acquiring locks, and making calls to the domain controller (DC/KDC.). The lack of wait_info* events is revealing because if we are waiting for a database read, lock or preemptive, external call for more than 5 seconds an event would have been logged. wait_info*. Network Trace.

Servers 40

Servers Network Database Systems 40

Smashing Magazine

JANUARY 15, 2019

The Green Web Foundation maintains an ever-growing database of web hosts who are either wholly powered by renewable energy or are at least committed to being carbon neutral. For the more adventurous/technical, the top (table of processes) command provides similar metrics on most Unix-like operating systems such as macOS and Ubuntu.

Website Performance 73

Website Performance Website Energy Performance 73

Percona

JANUARY 24, 2023

Some of the built-in features ( wal_compression ) have been there since 2016, and almost all backup tools do the WAL compression before taking it to the backup repository. Such “torn pages” are corruptions from the database point of view. Individual processes generate WAL records, and latency is very crucial for transactions.

Database 117

Database Benchmarking Open Source Latency 117

Percona

AUGUST 18, 2023

Why not just create another database on the same instance? We split databases by function/team to give each team full autonomy over their schema, And if someone screws up, it breaks their cluster, not all databases. So you put multiple MySQL servers on a single machine instead of multiple databases inside one MySQL instance.

Programming 85

Programming Servers Database Hardware 85

SQL Performance

OCTOBER 14, 2020

In my examples I’ll continue using the sample databases TSQLV5 and PerformanceV5. In Part 4 of the series, which focused on optimization of derived tables, I described a process of unnesting/substitution of table expressions. You can find the script that creates and populates TSQLV5 here , and its ER diagram here. Employees ; GO.

C++ 52

C++ Servers Code Efficiency 52

Percona

FEBRUARY 2, 2023

Recall that logical replication works by using the PUB/SUB mode, where individual tables are published and are then subscribed by remotely connected databases/tables. The challenge, of course, is reconstituting the logical replication process as quickly as possible, ideally without any data loss.

Games 90

Games Open Source Tuning Speed 90

SQL Performance

JUNE 9, 2021

That is, ones that are created as an object in the database, and stay there permanently unless dropped. In my examples I’ll use a sample database called TSQLV5. A table could be a base table defined as an object in the database, or it could be a table returned by an expression—more specifically, a table expression.

Database 140

Database Code Design Development 140

SQL Performance

JUNE 21, 2019

This article will expand on my previous article and point out how these apply to SQL Server , Azure SQL Database , and Azure SQL Managed Instance. When looking at backups, I check for recovery model and the current history of backups for each database. Azure SQL Database and Azure Managed Instance have managed backups.

Servers 49

Servers Azure Hardware Database 49

SQL Performance

MARCH 20, 2020

In SQL Server 2016, STRING_SPLIT solved a long-missing gap in a language that, admittedly, was not intended for complicated string processing. For years before SQL Server 2016 (and for years since), we've written our own versions, improved them over time, and even argued about whose was fastest. Thanks for listening!

Database 109

Database Servers C++ AWS 109

Alex Russell

MARCH 6, 2021

Back in 2016, I gave a talk outlining the causes and effects of the terrible performance of web apps built using popular tools on the fastest-growing device segment: low-end to mid-range Android phones. Advances in browser content processing. The cheapest (high volume) Androids perform like 2012/2013 iPhones, respectively.

Performance 124

Performance Network Cache Metrics 124

SQL Server According to Bob

JANUARY 28, 2018

Resource Manager – Database, File System, with ACID capabilities. The import process establishes communication between MSTDC (B) and MSDTC (A), creating the proper superior to subordinate relationship, adding DTC voting endpoints and returning an ITransaction to SQL Server. Microsoft specific implementation for DTC using (OLE-TX).

Servers 40

Servers Azure Engineering Java 40

SQL Performance

JULY 9, 2019

The ISO/IEC 9075:2016 standard (SQL:2016) defines a feature called nested window functions. For example, suppose that you want to query the Sales.OrderValues view in the TSQLV5 sample database, and return for each customer and order date, the daily total of the order values, and the running total until the current day.

Servers 83

Servers Availability Database Code 83

SQL Server According to Bob

DECEMBER 18, 2018

Durability: “In database systems , durability is the ACID property which guarantees transactions that have committed will survive permanently. Microsoft SQL Server Database Engine Input/Output Requirements. The data storage always uses the multi-step flush process. The Back Story. Fua (Forced Unit Access).

Servers 90

Servers Media Cache Storage 90

SQL Performance

JULY 16, 2019

From 2007 until 2016, Intel was able to successfully execute their Tick-Tock release strategy, where they would introduce a new processor microarchitecture roughly every two years (a Tock release). This made it easier for database professionals to make the case for a hardware upgrade, and made the typical upgrade more worthwhile.

Servers 46

Servers Hardware Architecture Retail 46

Particular Software

OCTOBER 3, 2017

This article was originally published on the NDC 2016 Blog. These events can then be used to trigger other downstream business processes. In this model, the software system follows the natural business process. Repeat this process until you've captured all the important actions as events your monolith is performing.

Architecture 49

Architecture Database Code Systems 49

O'Reilly Software

APRIL 4, 2018

We live in the era of the connected experience, where our daily interactions with the world can be digitized, collected, processed, and analyzed to generate valuable insights. Accumulating all this data to process overnight is not an option anymore. Do we need to process each record individually? Process tolerance.

Architecture 80

Architecture Scalability Google Operating System 80

Brendan Gregg

NOVEMBER 29, 2017

AWS EC2 uses a different image type and boot process for PV and HVM, as described on the [Linux AMI Virtualization Types] page. But not all workloads: some are network bound (proxies) and storage bound (databases). ## 5. This was extended to instance storage devices for the x1.32xlarge in 2016. The first was c3.

Virtualization 111

Virtualization AWS Hardware Storage 111

SQL Performance

SEPTEMBER 2, 2021

A lot of things change over the course of a few major versions of our favorite database platform. SQL Server 2016 brought us STRING_SPLIT , a native function that eliminates the need for many of the custom solutions we’ve needed before. STRING_SPLIT() in SQL Server 2016 : Follow-Up #1. It’s fast, too, but it’s not perfect.

C++ 59

C++ Servers Testing Database 59

Alex Russell

MAY 9, 2022

Effective managers understand that products require processes to manage, yet front-end discourse assumes that switching frameworks will introduce a golden age. When sibling teams are brought in to integrate late in the process, attention to the cumulative experience may suffer. How did it get away from the team so quickly?

Performance 86

Performance Latency Metrics Engineering 86

Smashing Magazine

OCTOBER 26, 2018

It’s an all-in-one system that is equipped with a working admin interface; it manages database connection, and has a bunch of useful APIs exposed that handle user authentication, routing, and more. Recommended reading : WordPress Security As A Process. on December 6th, 2016. Shortcomings Of Using The Decoupled Approach.

Cache 79

Cache Website Speed Database 79

SQL Performance

APRIL 23, 2019

This eliminated unnecessary row-mode processing, and removed the need for an exchange. SQL Server 2016 introduced serial batch mode processing and aggregate pushdown. The execution plan shows the result of fast-path pushdown processing as ‘locally aggregated rows’ with no corresponding row output from the scan.

Servers 67

Servers Testing Metrics Storage 67