Brendan Gregg

JULY 4, 2021

I summarized these topics and more as a plenary conference talk, including my own predictions (as a senior performance engineer) for the future of computing performance, with a focus on back-end servers. I also wrote about these topics in detail for my recent [Systems Performance 2nd Edition] book. Ford, et al., “TCP

Performance 140

Performance Latency Hardware Storage 140

Brendan Gregg

FEBRUARY 28, 2023

This talk originated from my updates to [Systems Performance 2nd Edition], and this was the first time I've given this talk in person! CXL in a way allows a custom memory controller to be added to a system, to increase memory capacity, bandwidth, and overall performance. Ford, et al., “TCP

Performance 110

Performance Latency Cache Virtualization 110

The Netflix TechBlog

OCTOBER 27, 2023

These orphaned pods represent real pain for our users, even if they are a small percentage of the total pods in the system. When this happens, usually a k8s cloud-controller provided by the cloud vendor will detect that the actual server, in our case an EC2 Instance, has actually gone away, and will in turn delete the k8s node object.

Hardware 228

Hardware Cloud Google Servers 228

SQL Performance

AUGUST 27, 2019

On August 7, 2019, AMD finally unveiled their new 7nm EPYC 7002 Series of server processors, formerly code-named "Rome" at the AMD EPYC Horizon Event in San Francisco. This is the second generation EPYC server processor that uses the same Zen 2 architecture as the AMD Ryzen 3000 Series desktop processors.

Servers 52

Servers Benchmarking Virtualization Architecture 52

The Morning Paper

JUNE 6, 2019

Towards federated learning at scale: system design Bonawitz et al., This is a high level paper describing Google’s production system for federated learning. The FL system contains a number of privacy-enhancing building blocks, but the privacy guarantees of any end-to-end system will always depend on how they are used.

Systems 71

Systems Design Google Servers 71

SQL Server According to Bob

MAY 19, 2019

SQL Server will ship Azure SQL Database Edge: [link]. With the announcement I can tell you more about one of the things we have been working on; SQL Server running on IoT Edge and Developer machines in under 500MB of memory. The effort focuses attention on memory usage and disk space requirements of SQL Server.

IoT 61

IoT Servers Development Cache 61

SQL Server According to Bob

FEBRUARY 11, 2019

SQL Server 2017 leverages up to 4 log writer workers, on hidden schedulers, to assist in transaction log processing activities. You may find the number of log write workers has been increased to 8 when running newer releases of SQL Server to accommodate larger systems.

Servers 40

Servers Availability Software Software 40

SQL Server According to Bob

FEBRUARY 10, 2019

SQL Server 2017 introduced a small change to SQL Server’s default worker thread calculation, accounting for smaller environments. When running on smaller environments SQL Server reduces the worker target. On small environments SQL Server always uses 256 as the target. Bob Dorr.

Servers 40

Servers Design Systems 40

Brendan Gregg

NOVEMBER 28, 2017

In this configuration, the AMI and boot is paravirt (PV), the kernel is making hypercalls instead of privileged instructions, and the system is using paravirt network and storage drivers. Xen AWS 2017 In 2015, AWS launched c4, which used hardware virtualization for EBS volumes. 0% performance overhead.

Virtualization 40

Virtualization AWS Hardware Storage 40

Brendan Gregg

SEPTEMBER 5, 2017

What follows are topics that may be of interest to anyone looking to migrate their systems and skillset: scan these to find topics that interest you. ## ZFS ZFS is available for Linux via the [zfsonlinux] and [OpenZFS] projects, and more recently was included in Canonical's Ubuntu Linux distribution: Ubuntu Xenial 16.04 LTS (April 2016).

Virtualization 76

Virtualization AWS Engineering Hardware 76

SQL Server According to Bob

APRIL 24, 2018

I also started my career developing on UNIX systems with C++ and databases like Ingres. As I moved to other jobs, the PC was becoming very popular as was the Windows Operating System. When I joined Microsoft in 1993, I would embark on a 25 year journey working only on Windows laptops and Windows Server computers.

Servers 40

Servers Internet Internet Open Source 40

SQL Performance

SEPTEMBER 17, 2019

Many database administrators find themselves having to support instances of SQL Server Reporting Services (SSRS), or at least the backend databases that are required for SSRS. These topics apply to both SQL Server Reporting Services as well as Power BI Report Server. Installation and support of SSRS can be confusing.

Tuning 67

Tuning Servers Database Best Practices 67

Scalegrid

JULY 13, 2020

Oracle Database is a commercial, proprietary multi-model database management system produced by Oracle Corporation, and the largest relational database management system (RDBMS) in the world. Compare ease of use across compatibility, extensions, tuning, operating systems, languages and support providers. Comparison Overview.

Open Source 244

Open Source Tuning C++ Database 244

The Netflix TechBlog

DECEMBER 14, 2020

The mystery begins Towards the end of 2017, I was on a conference call to discuss an issue with the Netflix application on a new set top box. Figure 2: Visualizing Audio Throughput and Thread Handler Timing The orange line is the rate that data moved from the streaming buffer into the Android audio system, in bytes/millisecond.

Engineering 352

Engineering Code Hardware Open Source 352

Brendan Gregg

FEBRUARY 28, 2023

This talk originated from my updates to Systems Performance 2nd Edition , and this was the first time I've given this talk in person! CXL in a way allows a custom memory controller to be added to a system, to increase memory capacity, bandwidth, and overall performance. Ford, et al., “TCP

Performance 52

Performance Latency Cache Virtualization 52

SQL Server According to Bob

FEBRUARY 10, 2019

. · Failures occur from remote clients or sqlcmd executed directory on the server (/opt/mssql-tools/bin). SQL Server 2017 CU10 does not show behavior. · SQL Server 2017 CU12 exhibits the behavior. Server is a Superdome with lots of CPUs and RAM. Here is an example of a valid SQL Server login.

Servers 40

Servers Network Database Systems 40

Brendan Gregg

JULY 4, 2021

I summarized these topics and more as a plenary conference talk, including my own predictions (as a senior performance engineer) for the future of computing performance, with a focus on back-end servers. I also wrote about these topics in detail for my recent [Systems Performance 2nd Edition] book. Ford, et al., “TCP

Performance 52

Performance Latency Hardware Storage 52

Percona

JUNE 4, 2023

This blog post was originally published in November 2017 and was updated in June 2023. In this blog, we’ll provide a comparison between MariaDB vs. MySQL (including Percona Server for MySQL ). MariaDB Server, on the other hand, is a fork of MySQL 5.5. What is MariaDB? What is MySQL?

Open Source 52

Open Source Servers Storage Scalability 52

SQL Server According to Bob

FEBRUARY 22, 2018

Prior to SQL Server 2017 CU4 for Linux (Linux only) the generation of a sequential UUID may not function as expected. SQL Server’s NewSequentialId () calls the Windows API UuidCreateSequential , which is limited in SQLPAL, prior to the CU 4 update. Question: What if I change the time of the system clock?

Servers 40

Servers Software Engineering Database Network 40

SQL Performance

JANUARY 23, 2020

The queues component of our methodology comes from Performance Monitor counters, which provide a view of system performance from a resource standpoint.". Tom Davidson, Opening Microsoft's Performance-Tuning Toolbox SQL Server Pro Magazine, December 2003. Waiting queries mean waiting applications and users, and no one likes to wait!

Tuning 115

Tuning Servers Monitoring Hardware 115

SQL Performance

JULY 16, 2019

A close monitoring of the hardware enthusiast community, including many of the most respected hardware analysts and reviewers paints an even more dire picture about Intel in the server processor space. Despite all of this, Intel is not going to lose their entire server processor business any time soon. So, what has changed my mind?

Servers 46

Servers Hardware Architecture Retail 46

Dynatrace

JUNE 15, 2023

If your application runs on servers you manage, either on-premises or on a private cloud, you’re responsible for securing the application as well as the operating system, network infrastructure, and physical hardware. What are some key characteristics of securing cloud applications?

Cloud 168

Cloud Open Source Architecture Monitoring 168

SQL Performance

JULY 8, 2020

I should stress that in practice, there’s no actual process in which SQL Server converts the original query string with the nested logic to a new query string without the nesting. As mentioned, SQL Server will attempt to unnest table expressions, but will avoid the unnesting if it stumbles into an unnesting inhibitor.

Servers 110

Servers Code Processing Performance 110

Percona

AUGUST 17, 2023

StackOverflow statistics show that 26% of developers preferred it in 2017, 34% in 2019, and 40% in 2021. In another survey, using multiple metrics for overall popularity, PostgreSQL ranks as the fourth most popular database management system ( DB-Engines, March 2023 ).

Open Source 77

Open Source Healthcare Social Media Database 77

Percona

JULY 7, 2023

In general terms, to achieve HA in PostgreSQL, there must be: Redundancy: To ensure data redundancy and provide continuous performance when a primary server fails, multiple copies of the database reside in replica servers. When the primary server fails, a standby server takes over as the new primary.

Availability 82

Availability Open Source Architecture Database 82

The Morning Paper

NOVEMBER 8, 2020

Back in 2017 the engineering team at Facebook had a problem. While ultimately this new system should be able to take advantage of the latest advances in consensus for improved performance, that’s not realistic given a 6-9 month in-production target. replacing Paxos with Raft), or they could be shims over external storage systems.

Virtualization 126

Virtualization Latency Storage Systems 126

SQL Server According to Bob

DECEMBER 18, 2018

I was asked to validate the SQL Server behavior in light of the error condition involving fsync/fdatasync outlined in this article. This means data can be stored in file system cache, non-stable media. ) Assume the database application opens the backup file, allowing file system caching (~_O_DIRECT.)

Servers 40

Servers Media Cache Software Engineering 40

SQL Server According to Bob

JANUARY 28, 2018

Resource Manager – Database, File System, with ACID capabilities. Note: SQL Server can be a client using a linked server, allowing SQL Server to become an APP and/or an RM ). Once the connection to SQL Server is established the APP executes the odbc! Microsoft specific implementation for DTC using (OLE-TX).

Servers 40

Servers Azure Engineering Java 40

SQL Server According to Bob

JULY 17, 2018

When starting SQL Server on Linux why are there two (2) sqlservr processes? systemctl status mssql-server mssql-server.service – Microsoft SQL Server Database Engine … CGroup: /system.slice/mssql-server.service ??85829 Bob Dorr – Principle SQL Server Software Engineer.

Servers 40

Servers Processing Software Engineering Traffic 40

Percona

AUGUST 15, 2023

This blog was originally published in February 2017 and was updated in August 2023. The idea is to use secondary servers on your infrastructure for either reads or other administrative solutions. Network Connectivity: Establish a reliable network connection between the primary and replica servers. Restart the MySQL service.

Servers 52

Servers Database Availability Traffic 52

Brendan Gregg

SEPTEMBER 25, 2021

CLI tools The Cassandra systems were EC2 virtual machine (Xen) instances. This server is spending about a third of its CPU cycles just checking the time! Microbenchmark os::javaTimeMillis() on both systems. Running this on the two systems saw similar results. 30.14% in the middle of the flame graph.

Speed 126

Speed Java AWS Virtualization 126

Percona

SEPTEMBER 1, 2023

This blog was originally published in October 2017 and was updated in September 2023. Database architects working with MongoDB encounter specific challenges related to database systems and system growth. Sharding is a preferred approach for database systems facing substantial growth and needing high availability.

Best Practices 71

Best Practices Traffic Database Servers 71

SQL Server According to Bob

DECEMBER 10, 2018

SQL Server Books Online documents Instant File Initialization and the associated security considerations. This blog highlights the underlying file system implementations and differences in behavior between Windows and Linux. SQL Server performs the following API calls when creating or extending (growing) data and log files.

Servers 40

Servers Speed Database Software Engineering 40

Scalegrid

APRIL 2, 2019

PostgreSQL is an open source relational database system that has soared in popularity over the past 30 years from its active, loyal, and growing community. use between respondents (either using in production or currently migrating to), followed by Oracle at 43.59%, SQL Server at 32.05%, and MySQL at 28.21%. using SQL Server, 17.3%

Database 185

Database Cloud Open Source Azure 185

Percona

APRIL 12, 2023

Whereas many open source software offerings — like the community version of MySQL — use the GNU General Public License ( GPL ), MongoDB has been under the GNU Affero General Public License ( AGPL ) and more recently under the Server Side Public License ( SSPL ), introduced by MongoDB itself. Is MongoDB free to use?

Open Source 81

Open Source Programming Database Servers 81

Alex Russell

MARCH 6, 2021

TL;DR: A lot has changed since 2017 when we last estimated a global baseline resource per-page resource budget of 130-170KiB. To update our global baseline from 2017, we want to update our priors on a few dimensions: The evolved device landscape. The Moto G4 , for example. Here begins our 2021 adventure. Hard Reset.

Performance 124

Performance Network Cache Metrics 124

SQL Server According to Bob

JULY 31, 2018

The unlink or remove syscall makes changes to the file system so searching for the file by name returns no entries and when the file descriptor is closed the file is deleted. Update Oct 2018 – SQL Server 2019 CTP 2.0. SQL Server 2019 changes the DELTE On CLOSE behavior used on Linux installations. Restart the VM.

Servers 40

Servers Software Engineering Systems Monitoring 40