Dynatrace

OCTOBER 15, 2021

Loosely defined, observability is the ability to understand what’s happening inside a system from the knowledge of the external data it produces, which are usually logs, metrics, and traces. Logs are important because you’ll naturally want an event-based record of any notable anomalies across the system. Watch webinar now!

Open Source 221

Open Source Metrics Cloud Transportation 221

Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on. I also wrote about these topics in detail for my recent [Systems Performance 2nd Edition] book.

Performance 52

Performance Latency Hardware Storage 52

Scalegrid

JANUARY 19, 2024

When a MongoDB rollback happens, it can cause trouble to your data integrity and system consistency. Data-bearing members face a higher risk of encountering issues caused by rollbacks, compared to others who utilize different storage methods.

Database 130

Database Network Servers Monitoring 130

All Things Distributed

MAY 19, 2017

We decided to use our inventive powers to design and build a new database engine that would give database systems such as MySQL and PostgreSQL reliability and performance at scale, at a level that could serve even the most demanding OLTP applications.

Database 120

Database Design Cloud Storage 120

Brendan Gregg

FEBRUARY 28, 2023

This talk originated from my updates to Systems Performance 2nd Edition , and this was the first time I've given this talk in person! CXL in a way allows a custom memory controller to be added to a system, to increase memory capacity, bandwidth, and overall performance. Ford, et al., “TCP

Performance 52

Performance Latency Cache Virtualization 52

Percona

SEPTEMBER 19, 2023

This blog post will walk you through how MySQL’s InnoDB redo log archiving uses PXB to manage the redo log files on the busiest systems and look at how a new feature released in PXB version 8.0.34-29 Enabling redo log archiving on the server requires setting a value for the innodb_redo_log_archive_dirs system variable.

C++ 101

C++ Servers Storage Speed 101

SQL Performance

MAY 1, 2020

In a recent tip , I described a scenario where a SQL Server 2016 instance seemed to be struggling with checkpoint times. I was a bit perplexed by this issue, since the system was certainly no slouch — plenty of cores, 3TB of memory, and XtremIO storage. SQL 2016 – It Just Runs Faster: Indirect Checkpoint Default.

C++ 58

C++ Database Servers Storage 58

Percona

JUNE 4, 2023

Before we dive into the differences between MariaDB and MySQL, we will provide a thorough examination of each relational database management system (RDBMS). While originally designed to be a drop-in replacement for MySQL, it evolved into its own distinct database management system and is now maintained and supported by the MariaDB Foundation.

Open Source 52

Open Source Servers Storage Scalability 52

SQL Server According to Bob

NOVEMBER 8, 2016

SQL Server 2016 Service Pack 1 (all SKUs) , in combination with Windows Server 2016 (All SKUs) or Windows 10 Client introduces non-volatile memory support for the tail of the log file (LDF) which can significantly increase transaction throughput. Block storage is what you think of today as disk access.

Cache 40

Cache Servers Media Storage 40

Scalegrid

JULY 17, 2020

Often times an external system is providing data as JSON, so it might be a temporary store before data is ingested into other parts of the system. JSONB storage has some drawbacks vs. traditional columns: PostreSQL does not store column statistics for JSONB columns. JSONB storage results in a larger storage footprint.

Storage 321

Storage Database Efficiency Processing 321

Smashing Magazine

JANUARY 15, 2019

An obvious metric here is CPU usage, but memory usage and other forms of data storage also play their part. For the more adventurous/technical, the top (table of processes) command provides similar metrics on most Unix-like operating systems such as macOS and Ubuntu. These include data transfer (i.e.

Website Performance 73

Website Performance Website Energy Performance 73

SQL Server According to Bob

DECEMBER 18, 2018

Durability: “In database systems , durability is the ACID property which guarantees transactions that have committed will survive permanently. For example, if a flight booking reports that a seat has successfully been booked, then the seat will remain booked even if the system crashes.” – [link]. The Back Story.

Servers 90

Servers Media Cache Storage 90

Percona

JANUARY 24, 2023

Some of the built-in features ( wal_compression ) have been there since 2016, and almost all backup tools do the WAL compression before taking it to the backup repository. In a system already on the brink of too much WAL generation, the uncompressed WAL can trigger many more checkpoints, resulting in even more WAL generation.

Database 114

Database Benchmarking Open Source Latency 114

Brendan Gregg

NOVEMBER 29, 2017

In this configuration, the AMI and boot is paravirt (PV), the kernel is making hypercalls instead of privileged instructions, and the system is using paravirt network and storage drivers. But not all workloads: some are network bound (proxies) and storage bound (databases). ## 5. The AMI and boot are now HVM.

Virtualization 111

Virtualization AWS Hardware Storage 111

Percona

AUGUST 18, 2023

And I agree that in the modern age of cloud and huge flash storage, the vast majority of companies will never need to consider doing this in prod, but there is always a chance of its need. root@ip-172-31-128-38 share]# cat /usr/lib/systemd/system/mysqld@.service 10-Linux.x86_64.ssl101.tar.gz ln -s /usr/local/Percona-Server-8.0.19-10-Linux.x86_64.ssl101/

Programming 82

Programming Servers Database Hardware 82

All Things Distributed

DECEMBER 13, 2016

In just this past month we've had HSBC , ARM , Missguided , and most recently at re:Invent 2016 , Trainline , talking with us about how they are using AWS to transform and scale their businesses. I have been humbled by just how much our UK customers have been able to achieve using AWS technology so far.

AWS 166

AWS Cloud Artificial Intelligence IoT 166

Brendan Gregg

NOVEMBER 28, 2017

In this configuration, the AMI and boot is paravirt (PV), the kernel is making hypercalls instead of privileged instructions, and the system is using paravirt network and storage drivers. But not all workloads: some are network bound (proxies) and storage bound (databases). ## 5. The AMI and boot are now HVM.

Virtualization 40

Virtualization AWS Hardware Storage 40

Alex Russell

MARCH 6, 2021

Back in 2016, I gave a talk outlining the causes and effects of the terrible performance of web apps built using popular tools on the fastest-growing device segment: low-end to mid-range Android phones. A then-representative $200USD device had 4-8 slow (in-order, low-cache) cores, ~2GiB of RAM, and relatively slow MLC NAND flash storage.

Performance 124

Performance Network Cache Metrics 124

All Things Distributed

DECEMBER 12, 2018

We help Supercell to quickly develop, deploy, and scale their games to cope with varying numbers of gamers accessing the system throughout the course of the day. The second platform is a managed IoT cloud with customer-facing applications and data management, which went live in 2016.

AWS 124

AWS Cloud Games Serverless 124

Brendan Gregg

SEPTEMBER 5, 2017

What follows are topics that may be of interest to anyone looking to migrate their systems and skillset: scan these to find topics that interest you. ## ZFS ZFS is available for Linux via the [zfsonlinux] and [OpenZFS] projects, and more recently was included in Canonical's Ubuntu Linux distribution: Ubuntu Xenial 16.04 LTS (April 2016).

Virtualization 76

Virtualization AWS Engineering Hardware 76

Smashing Magazine

FEBRUARY 8, 2022

In 2016, I released the first version of the tool, then called not Statoscope, but Webpack Runtime Analyzer. It might not be completely efficient if we use modules in raw form, as they are in the file system: there might be some doubles, some modules could be combined, and others are only partially used. Sergey Melukov.

Storage 79

Storage Code Metrics C++ 79

SQL Performance

APRIL 8, 2019

Back on December 5, 2017, Microsoft announced that they were using AMD EPYC 7551 processors in their storage-optimized Lv2-Series virtual machines. The slightly newer Intel Xeon E5-26xx v4 (Broadwell) series which was introduced in Q1 of 2016, increased that to 2400MHz. They also only have 40 PCIe 3.0 lanes per processor. Memory (GiB).

Azure 42

Azure Virtualization Storage Benchmarking 42

Alex Russell

APRIL 29, 2021

After 20 years of neck-in-neck competition, often starting from common code lineages, there just isn't that much left to wring out of the system. Consistent improvement is the name of the game, and it can still have positive impacts, particularly as users lean on the system more heavily over time. Some relatively minor additions (e.g.

Media 145

Media Games Education Engineering 145

Particular Software

OCTOBER 3, 2017

This article was originally published on the NDC 2016 Blog. What if you still have to support the existing system? As you're rewriting the system, how are you going to deal with these new feature requests for customers? A New Hope As part of supporting existing customers, it's likely you add new features to your system.

Architecture 49

Architecture Database Code Systems 49

SQL Performance

APRIL 23, 2019

SQL Server 2016 introduced serial batch mode processing and aggregate pushdown. Columnstore storage. To understand this, it is necessary to first review how columnstore storage works at a high level: A compressed row group contains a column segment for each column. to give {11, 12, 13}, then rebasing at 11 to give {0, 1, 2}.

Servers 67

Servers Testing Metrics Storage 67

Alex Russell

OCTOBER 22, 2017

Tools and CI systems help them monitor progress & prevent regressions. Some systems show median RTTs near ~100ms for 3G users. Given the conflicted data we see across our other systems, this seems about right as a baseline. The true median device from 2016 sold at about ~$200 unlocked. The router you added?

Performance 68

Performance Benchmarking Network Mobile 68

Testsigma

FEBRUARY 12, 2021

The Internet of Things is generally referred to as IoT which encompasses computers, cars, houses or some other technological system related. billion in 2016. Millions of different mobile apps are listed in various play stores of different operating systems. Better and quicker services are urgently needed today.

Artificial Intelligence 92

Artificial Intelligence Software Software IoT 92

Percona

JANUARY 14, 2019

In a partitioned massively parallel database system, the storage format and sorting algorithm may not be optimized for that operation as we are reading multiple partitions in parallel. ClickHouse is a great massively parallel analytical system. voting','maven'] ? ? compose','xamarin','markdown','scrum','comic'] ? ? Conclusion.

Database 40

Database Analytics Blockchain Healthcare 40