Brendan Gregg

SEPTEMBER 5, 2021

They claimed that the ZFS file system was consuming 30% of CPU capacity. I summarized this case study at [Kernel Recipes] in 2017 and have shared the full story here. ## 1. These included a breakdown of CPU time into percentages for "usr" (user: applications) and "sys" (system: the kernel). contending for the same locks).

Cache 145

Cache Cloud Java Tuning 145

The Netflix TechBlog

OCTOBER 19, 2020

which is difficult when troubleshooting distributed systems. Troubleshooting a session in Edgar When we started building Edgar four years ago, there were very few open-source distributed tracing systems that satisfied our needs. Investigating a video streaming failure consists of inspecting all aspects of a member account.

Infrastructure 233

Infrastructure Transportation Storage Open Source 233

Percona

AUGUST 17, 2023

StackOverflow statistics show that 26% of developers preferred it in 2017, 34% in 2019, and 40% in 2021. In another survey, using multiple metrics for overall popularity, PostgreSQL ranks as the fourth most popular database management system ( DB-Engines, March 2023 ).

Open Source 76

Open Source Healthcare Social Media Database 76

Brendan Gregg

SEPTEMBER 25, 2021

CLI tools The Cassandra systems were EC2 virtual machine (Xen) instances. Microbenchmark os::javaTimeMillis() on both systems. Running this on the two systems saw similar results. Checking those available: $ cat /sys/devices/system/clocksource/clocksource0/available_clocksource. Try changing the kernel clocksource.

Speed 126

Speed Java AWS Virtualization 126

Dynatrace

FEBRUARY 25, 2021

since 2017, and many customers have used it with great success while we collected requirements for the next iteration of our Lambda extension. Lambda functions often serve as a gluing tier or a gateway from on-premises systems to AWS services; they’re almost never standalone. Stay tuned?for Why metrics alone aren’t enough.

Lambda 224

Lambda AWS Monitoring Serverless 224

The Netflix TechBlog

MAY 1, 2019

In late 2017, we received some critical feedback from the brothers on the Stranger Things 2 audio mix: in some scenes, there was a reduced sense of where sounds are located in the 5.1-channel We want your experience to be brilliant even if you aren’t listening with a state-of-the-art home theater system. We began streaming 5.1

Engineering 274

Engineering Network Media Entertainment 274

Brendan Gregg

SEPTEMBER 5, 2021

They claimed that the ZFS file system was consuming 30% of CPU capacity. I summarized this case study at Kernel Recipes in 2017; it is an old story that's worth resharing here. These included a breakdown of CPU time into percentages for "usr" (user: applications) and "sys" (system: the kernel).

Cache 52

Cache Cloud Java Tuning 52

Particular Software

DECEMBER 14, 2020

ServiceControl is the nerve center of your distributed system, storing the data and providing the APIs that allow ServicePulse and ServiceInsight to function. When enabling saga audits in an existing system make sure to provision enough resources as the Saga Audit plugin sends one additional message for each message processed by a saga.

Azure 52

Azure Transportation Tuning Processing 52

SQL Performance

MARCH 17, 2020

Back in 2014, I wrote an article called Performance Tuning the Whole Query Plan. The optimizer chooses this plan without any hints on my system configuration because the estimated cost of the plan is below the cost threshold for parallelism. Cost" column shows the optimizer's cost estimate for each query as reported on the test system.

Servers 86

Servers Tuning Database Efficiency 86

Percona

APRIL 12, 2023

Instead of relational (SQL) databases defined primarily through a hierarchy of related sets via tables and columns, their non-relational structure used a system of collections and documents. 2017: MongoDB goes public, trading as MDB. They came up with a horizontally scalable NoSQL database.

Open Source 79

Open Source Programming Database Servers 79

Brendan Gregg

SEPTEMBER 5, 2021

They claimed that the ZFS file system was consuming 30% of CPU capacity. I summarized this case study at [Kernel Recipes] in 2017; it is an old story that's worth resharing here. ## 1. These included a breakdown of CPU time into percentages for "usr" (user: applications) and "sys" (system: the kernel). Ahh, it makes sense now.

Cache 40

Cache Cloud Java Tuning 40

Brendan Gregg

SEPTEMBER 25, 2021

CLI tools The Cassandra systems were EC2 virtual machine (Xen) instances. Microbenchmark os::javaTimeMillis() on both systems. Running this on the two systems saw similar results. A quick check of basic performance statistics showed over 30% higher CPU consumption. Try changing the kernel clocksource. include <sys/time.h>

Speed 40

Speed Java AWS Virtualization 40

SQL Performance

MAY 7, 2019

Understanding what these mean and how to investigate them is critical so you don’t succumb to what I call ‘knee-jerk performance tuning’ and waste time and effort trying to fix a problem that isn’t actually a problem. Someone complained about a sluggish system yesterday afternoon or a report that timed out last Tuesday? No problem.

Servers 40

Servers Azure Metrics Tuning 40

O'Reilly Software

APRIL 4, 2018

Are there inherent time relationships in the messages that need to be preserved as they travel across the system? The data shape will dictate capacity planning, tuning of the backbone, and scalability analysis for individual components. What message process warranty level do we require? At least once? At most once? Exactly once?

Architecture 80

Architecture Scalability Google Operating System 80

Rigor

SEPTEMBER 11, 2019

Rachel is also one of the people behind Perch , a PHP content management system (CMS). His keynote address from O’Reilly Fluent 2017, Reflecting on 20 years on the web , is a must-see. He served as the Editor-in-Chief of Smashing Magazine until October 2017 when he passed the baton to the remarkable Rachel Andrew.

Performance 89

Performance Education Google Website 89

Percona

JANUARY 14, 2019

To simulate text messages I have used ~3 billion of reddit comments (10 years from 2007 to 2017), downloaded from pushshift.io. In a partitioned massively parallel database system, the storage format and sorting algorithm may not be optimized for that operation as we are reading multiple partitions in parallel. Conclusion.

Database 40

Database Analytics Blockchain Healthcare 40

Smashing Magazine

JUNE 3, 2022

These compiled systems for letters and symbols, which are representations of sounds and information, get a lot of use and are a large part of graphic communication. Fast forward to the early 1960s, phototypesetting systems appeared. Instead, we need to address multiple factors within the design system. Stay tuned!

Performance 110

Performance Design Best Practices Testing 110

The Netflix TechBlog

FEBRUARY 13, 2024

Safe software deployment, canary testing, and play-delay Software engineering readers of this blog are likely familiar with unit, integration and load testing, as well as other testing practices that aim to prevent bugs from reaching production systems. Rationale : This system is part of a semi-automated process for all client deployments.

Testing 239

Testing Software Software Metrics 239

Alex Russell

MARCH 31, 2022

Like every other successful platform, the web operates on a finely tuned understanding of risk and trust , and deprecations are particularly explosive. [2] Shared caches must make sense within this value system. Systems that externalise governance and administrative costs to browser vendors are also unattractive. Trust Falls #.

Cache 82

Cache Government Traffic Network 82

Randon ASCII

APRIL 17, 2018

When you own all of the code then this may involve some back of the envelope estimates, competitive benchmarking, or intuition tuned by experience. When dealing with a closed box like Microsoft’s NTFS file system it’s trickier to know if things could be running faster than they are. I then worked with the tool’s author to get a fix.

Monitoring 43

Monitoring C++ Code Processing 43

John McCalpin

JANUARY 22, 2018

Introduction: In December 2017, my colleague Damon McDougall (now at AMD) asked for help in porting the fused multiply-add example code from a Colfax report ( [link] ) to the Xeon Phi x200 (Knights Landing) processors here at TACC. of the “adjusted peak performance”, there is no longer a significant upside to performance tuning.

Latency 40

Latency Hardware Code Testing 40

SQL Performance

SEPTEMBER 2, 2021

I’ve written several articles about this function (and STRING_AGG, which arrived in SQL Server 2017) since this post was written: Performance Surprises and Assumptions : STRING_SPLIT(). He spent a lot of time fine-tuning this CLR function to efficiently parse a string. STRING_SPLIT() in SQL Server 2016 : Follow-Up #1. Sanity checking.

C++ 59

C++ Servers Testing Database 59

The Netflix TechBlog

JULY 1, 2019

Surface Cache Surface cache is a reserved pool in main memory (or separate graphics memory on a minority of systems) that the Netflix app uses for storing textures (decoded images and cached resources). those running the 2017 SDK?—?also The SNG files have a relatively large download size at ~1.5MB each.

Cache 166

Cache Design Testing Development 166

All Things Distributed

OCTOBER 2, 2017

With these requirements in mind, and a willingness to question the status quo, a small group of distributed systems experts came together and designed a horizontally scalable distributed database that would scale out for both reads and writes to meet the long-term needs of our business. This was the genesis of the Amazon Dynamo database.

Internet 130

Internet Internet AWS Performance 130

O'Reilly

JULY 25, 2023

To provide some coherence to the music, I decided to use Taylor Swift songs since her discography covers the time span of most papers that I typically read: Her main albums were released in 2006, 2008, 2010, 2012, 2014, 2017, 2019, 2020, and 2022. This choice also inspired me to call my project Swift Papers.

Programming 98

Programming Code Design Benchmarking 98