Brendan Gregg

APRIL 14, 2022

On the Netflix Java/Linux/EC2 stack there were no working mixed-mode flame graphs, no production safe dynamic tracer, and no PMCs: All tools I used extensively for advanced performance analysis. Apart from developing tools, much of my time has been spent helping teams with performance issues and evaluations. How would I do my job?

Java 145

Java Cloud Cache AWS 145

All Things Distributed

MAY 19, 2017

In many, high-throughput, OLTP style applications the database plays a crucial role to achieve scale, reliability, high-performance and cost efficiency. That database engine is now known as Amazon Aurora and launched in 2014 for MySQL and in 2016 for PostgreSQL.

Database 117

Database Design Cloud Storage 117

Scalegrid

JANUARY 19, 2024

Data-bearing members face a higher risk of encountering issues caused by rollbacks, compared to others who utilize different storage methods. Therefore, companies must carefully consider key performance metrics and methodologies to stay relevant and successful in timely and trend-oriented markets.

Database 130

Database Network Servers Monitoring 130

Dynatrace

OCTOBER 15, 2021

OpenTelemetry (also referred to as OTel) is an open-source observability framework made up of a collection of tools, APIs, and SDKs, that enables IT teams to instrument, generate, collect, and export telemetry data for analysis and understand software performance and behavior. Monitoring begins here. Read eBook now!

Open Source 219

Open Source Metrics Cloud Transportation 219

All Things Distributed

DECEMBER 8, 2016

It relies on the scale and power of Amazon Simple Storage Service (Amazon S3) to deliver in-region storage options to businesses and organizations across the world in Canada, Japan, Singapore, Australia, Ireland, Germany, and the U.S., Performance. Par Werner Vogels, le 8 décembre 2016. Performance.

AWS 155

AWS Cloud Lambda Innovation 155

Percona

SEPTEMBER 19, 2023

29 will let you set up redo log directory while performing a backup. This issue most often occurs when there is significant MySQL server activity during the backup operation, and the redo log file storage media operates faster than the backup storage media. Copyright (c) 2016, 2023, Oracle and/or its affiliates.

C++ 104

C++ Servers Storage Speed 104

SQL Performance

MAY 1, 2020

In a recent tip , I described a scenario where a SQL Server 2016 instance seemed to be struggling with checkpoint times. I was a bit perplexed by this issue, since the system was certainly no slouch — plenty of cores, 3TB of memory, and XtremIO storage. SQL 2016 – It Just Runs Faster: Indirect Checkpoint Default.

C++ 58

C++ Database Servers Storage 58

SQL Server According to Bob

NOVEMBER 8, 2016

SQL Server 2016 Service Pack 1 (all SKUs) , in combination with Windows Server 2016 (All SKUs) or Windows 10 Client introduces non-volatile memory support for the tail of the log file (LDF) which can significantly increase transaction throughput. Block storage is what you think of today as disk access. Tail Of Log Caching.

Cache 40

Cache Servers Media Storage 40

Percona

JUNE 4, 2023

MariaDB retains compatibility with MySQL, offers support for different programming languages, including Python, PHP, Java, and Perl, and works with all major open source storage engines such as MyRocks, Aria, and InnoDB. Elevate your MariaDB environment with Percona Support for MariaDB. Contact us to learn more!

Open Source 52

Open Source Servers Storage Scalability 52

Smashing Magazine

JANUARY 15, 2019

How Improving Website Performance Can Help Save The Planet. How Improving Website Performance Can Help Save The Planet. Perhaps the biggest win when it comes to making websites more sustainable is that performance, user experience and sustainability are all neatly intertwined. Jack Lenox. 2019-01-15T13:30:32+01:00.

Website Performance 73

Website Performance Website Energy Performance 73

Scalegrid

JULY 17, 2020

JSONB storage has some drawbacks vs. traditional columns: PostreSQL does not store column statistics for JSONB columns. JSONB storage results in a larger storage footprint. JSONB storage does not deduplicate the key names in the JSON. If that doesn’t work, the data is moved to out-of-line storage.

Storage 321

Storage Database Efficiency Processing 321

SQL Performance

MAY 16, 2019

Achieving minimal logging using INSERT.SELECT into an empty clustered index target is not quite as simple as described in the Data Performance Loading Guide. The Data Loading Performance Guide contains a high-level summary of the conditions required for minimal logging into clustered tables: This post is concerned with the top row only.

Cache 67

Cache Servers Testing Storage 67

Alex Russell

MARCH 6, 2021

Back in 2016, I gave a talk outlining the causes and effects of the terrible performance of web apps built using popular tools on the fastest-growing device segment: low-end to mid-range Android phones. Poor performance has a compound effect on user expectations at an ecosystem level. Live by the link, die by the link.

Performance 124

Performance Network Cache Metrics 124

SQL Performance

SEPTEMBER 5, 2019

This article explores the batch data normalized representation, explains why not all eight-byte data types can fit within 64 bits, and shows an example of how all this affects batch-mode performance. You will need SQL Server 2016 (or later) and Developer Edition (or equivalent) to reproduce the results shown here. c1 = @Start + N.

Performance 81

Performance C++ Storage Servers 81

SQL Server According to Bob

SEPTEMBER 26, 2016

When we released Always On Availability Groups in SQL Server 2012 as a new and powerful way to achieve high availability, hardware environments included NUMA machines with low-end multi-core processors and SATA and SAN drives for storage (some SSDs). As we moved towards SQL Server 2014, the pace of hardware accelerated.

Availability 40

Availability Servers Hardware Benchmarking 40

Tim Kadlec

JANUARY 9, 2019

One question I’ve seen posed a few times in the past several months is whether performance really is a moral or ethical concern, or if that’s all heavy-handed exaggeration. When you stop to consider all the implications of poor performance, it’s hard not to come to the conclusion that poor performance is an ethical issue.

Performance 111

Performance Energy Internet Internet 111

Brendan Gregg

NOVEMBER 29, 2017

Hardware virtualization for cloud computing has come a long way, improving performance using technologies such as VT-x, SR-IOV, VT-d, NVMe, and APICv. The latest AWS hypervisor, Nitro, uses everything to provide a new hardware-assisted hypervisor that is easy to use and has near bare-metal performance.

Virtualization 111

Virtualization AWS Hardware Storage 111

SQL Server According to Bob

DECEMBER 18, 2018

Be sure to deploy SQL Server 2017 CU6 or newer for best data durability and performance results. “. Device level flushing may have an impact on your I/O caching, read ahead or other behaviors of the storage system. Performance points of reference: The following charts highlight the increase in performance. The Back Story.

Servers 90

Servers Media Cache Storage 90

Percona

JANUARY 24, 2023

Some of the built-in features ( wal_compression ) have been there since 2016, and almost all backup tools do the WAL compression before taking it to the backup repository. But this comes with a considerable performance implication. But this comes with a considerable performance implication.

Database 116

Database Benchmarking Open Source Latency 116

All Things Distributed

DECEMBER 13, 2016

In just this past month we've had HSBC , ARM , Missguided , and most recently at re:Invent 2016 , Trainline , talking with us about how they are using AWS to transform and scale their businesses. Real-time monitoring and evaluation of events have led to a positive impact on performance or operations.

AWS 166

AWS Cloud Artificial Intelligence IoT 166

Percona

AUGUST 18, 2023

Cases where (in very large sharded deployments) a user will install multiple mysqlds per server to reduce contention, i.e., they get more performance per 2-socket server with four or eight mysqlds than one. That said, other performance motivations mentioned above did play into it, especially before the days of multi-threaded replication.

Programming 84

Programming Servers Database Hardware 84

SQL Performance

MAY 1, 2019

This is reflected in the summary tables included in the Data Loading Performance Guide and the Tiger Team post. The summary rows for heap tables without indexes are the same in both documents (no changes for SQL Server 2016): An explicit TABLOCK hint is not the only way to meet the requirement for table-level locking.

Servers 47

Servers Database Testing Performance 47

Percona

JANUARY 17, 2019

now has a version which will support parallelism for SELECT queries (utilizing the read capacity of storage nodes underneath the Aurora cluster). In this article, we will look at how this can improve the reporting/analytical query performance in MySQL. Result: ~10x performance gain, no index used. MySQL on ec2.

Cache 46

Cache C++ AWS Airlines 46

SQL Performance

MAY 29, 2019

From SQL Server 2016 onward, FastLoadContext is enabled by default ; the trace flag is not required. For more background, see the Data Performance Loading Guide and the Tiger Team notes on the behaviour changes for SQL Server 2016. FastLoadContext can be disabled on SQL Server 2016 using documented trace flag 692.

Cache 64

Cache Testing Servers Code 64

Alex Russell

OCTOBER 22, 2017

TL;DR: performance budgets are an essential but under-appreciated part of product success and team health. Nobody is trying to do a poor job, and yet the results of a “completed” PWA project often require weeks or months of painstaking rework to deliver minimally acceptable performance. Partner meetings are illuminating.

Performance 68

Performance Benchmarking Network Mobile 68

Brendan Gregg

NOVEMBER 28, 2017

Hardware virtualization for cloud computing has come a long way, improving performance using technologies such as VT-x, SR-IOV, VT-d, NVMe, and APICv. The latest AWS hypervisor, Nitro, uses everything to provide a new hardware-assisted hypervisor that is easy to use and has near bare-metal performance.

Virtualization 40

Virtualization AWS Hardware Storage 40

SQL Performance

APRIL 8, 2019

Back on December 5, 2017, Microsoft announced that they were using AMD EPYC 7551 processors in their storage-optimized Lv2-Series virtual machines. The AMD EPYC 7551 processor has slightly lower single-threaded CPU performance when compared to the older 2.3 Since then, Microsoft has changed the naming of this series to Lsv2.

Azure 42

Azure Virtualization Storage Benchmarking 42

Brendan Gregg

SEPTEMBER 5, 2017

LTS (April 2016). I wrote about it in a previous post, [DTrace for Linux 2016]. I wrote a page on it: [perf]. - **eBPF**: tracing features completed in 2016, this provides efficient programmatic tracing to existing kernel frameworks. The hardest part on Linux is now done: kernel support. It's the official profiler.

Virtualization 76

Virtualization AWS Engineering Hardware 76

Smashing Magazine

FEBRUARY 8, 2022

In 2016, I released the first version of the tool, then called not Statoscope, but Webpack Runtime Analyzer. Statoscope processes the stats, performs analysis and provides a visual representation to interpret the results in a convenient form: ( Large preview ). We can import information from our metric storage into data.

Storage 80

Storage Code Metrics C++ 80

Alex Russell

APRIL 29, 2021

Classics of the genre include: Apple's just focused on performance! The Performance Argument. As an engineer on a browser team, I'm privy to the blow-by-blow of various performance projects, benchmark fire drills, and the ways performance marketing (deeply) impacts engineering priorities. Steve & Tim's Close-up Magic.

Media 145

Media Games Education Engineering 145

SQL Performance

AUGUST 23, 2019

In traditional row-mode execution plans, SQL Server may introduce a Bitmap operator as part of performing early semi join reduction before a parallel hash or merge join. Once all batches of hash table data have been processed into the range table, a final bucket merge is performed, then an in-place quicksort puts the buckets in value order.

Servers 75

Servers Engineering Efficiency Retail 75

SQL Performance

APRIL 23, 2019

SQL Server 2014 added the ability to perform parallel batch-mode grouped aggregation within a single Hash Match Aggregate operator. SQL Server 2016 introduced serial batch mode processing and aggregate pushdown. The performance improvements possible with aggregate pushdown can be very substantial. Columnstore storage.

Servers 67

Servers Testing Metrics Storage 67

Particular Software

OCTOBER 3, 2017

This article was originally published on the NDC 2016 Blog. Repeat this process until you've captured all the important actions as events your monolith is performing. Once you've shoveled enough data from the monolith database to different storages, you can activate your new feature and remove those redundant parts of the code.

Architecture 49

Architecture Database Code Systems 49

Testsigma

FEBRUARY 12, 2021

The latest trend in hyperautomation – Gartner projects that by the year 2023, 25% of tasks by the organisations will be able to perform autonomously and hence reducing the cost. billion in 2016. Around 2020 and 2021, hyperautomation is accelerating for 2021 and even beyond. Better and quicker services are urgently needed today.

Artificial Intelligence 92

Artificial Intelligence Software Software IoT 92

Percona

JANUARY 14, 2019

With the latest ClickHouse version, all of these features are available, but some of them may not perform fast enough. In a partitioned massively parallel database system, the storage format and sorting algorithm may not be optimized for that operation as we are reading multiple partitions in parallel. Deleting messages. Text search.

Database 40

Database Analytics Blockchain Healthcare 40