Brendan Gregg

JUNE 30, 2018

A co-worker introduced me to Craig Hanson and Pat Crain's performance mantras, which neatly summarize much of what we do in performance analysis and tuning. These have inspired me to summarize another performance activity: evaluating benchmark accuracy. If the benchmark reported 20k ops/sec, you should ask: why not 40k ops/sec?

Benchmarking 54

Benchmarking Latency Cache Network 54

Percona

DECEMBER 11, 2023

DLVs are particularly advantageous for databases with large allocated storage, high I/O per second (IOPS) requirements, or latency-sensitive workloads. We performed a standard benchmarking test using the sysbench tool to compare the performance of a DLV instance vs a standard RDS MySQL instance, as shared in the following section.

AWS 93

AWS Benchmarking Performance Traffic 93

Scalegrid

OCTOBER 24, 2019

As organizations continue to migrate to the cloud, it’s important to get in front of performance issues, such as high latency, low throughput, and replication lag with higher distances between your users and cloud infrastructure. MySQL Performance Benchmark Configuration. MySQL on AWS Performance Test. Amazon RDS. Instance Type.

AWS 183

AWS Latency Performance Benchmarking 183

Brendan Gregg

JUNE 29, 2018

A co-worker introduced me to Craig Hanson and Pat Crain's performance mantras, which neatly summarize much of what we do in performance analysis and tuning. These have inspired me to summarize another performance activity: evaluating benchmark accuracy. If the benchmark reported 20k ops/sec, you should ask: why not 40k ops/sec?

Benchmarking 40

Benchmarking Latency Cache Network 40

Dynatrace

MAY 5, 2021

Quality gates are benchmarks in the software delivery lifecycle that define specific, measurable, and achievable success criteria a service must meet before moving to the next phase of the software delivery pipeline. For example, improving latency by as little as 0.1 latency is the number one reason consumers abandon mobile sites.

Benchmarking 188

Benchmarking Latency Speed Software 188

The Morning Paper

MARCH 10, 2020

Characterizing, modeling, and benchmarking RocksDB key-value workloads at Facebook , Cao et al., Or in the case of key-value stores, what you benchmark. So if you want to design a system that will offer good real-world performance, it’s really useful to have benchmarks that accurately represent real-world workloads.

Benchmarking 59

Benchmarking Storage Cache Open Source 59

Randon ASCII

JANUARY 12, 2022

Back in the day I wrote a lot of benchmarks in order to look for places where the actual performance of the CPU didn’t match what we expected. I wrote a lot of benchmarks. One benchmark I wrote measured the L2 cache latency. So, anyway. Standard stuff. So that’s interesting. Since the Xbox 360 CPU ran at 3.2 mm distance!

Cache 126

Cache Latency Benchmarking Hardware 126

The Netflix TechBlog

SEPTEMBER 2, 2020

Edgar helps Netflix teams troubleshoot distributed systems efficiently with the help of a summarized presentation of request tracing, logs, analysis, and metadata. With request tracing and additional data from logs, events, metadata, and analysis, Edgar is able to show the flow of a request through our distributed system?

Latency 296

Latency Transportation Engineering Traffic 296

The Morning Paper

MAY 12, 2019

An open-source benchmark suite for microservices and their hardware-software implications for cloud & edge systems Gan et al., A typical architecture diagram for one of these services looks like this: Suitably armed with a set of benchmark microservices applications, the investigation can begin! ASPLOS’19.

Open Source 61

Open Source Hardware Benchmarking Systems 61

The Netflix TechBlog

NOVEMBER 22, 2019

In this talk, we share how Netflix deploys systems to meet its demands, Ceph’s design for high availability, and results from our benchmarking. Netflix runs dozens of stateful services on AWS under strict sub-millisecond tail-latency requirements, which brings unique challenges.

AWS 100

AWS Entertainment Open Source Benchmarking 100

The Netflix TechBlog

NOVEMBER 22, 2019

In this talk, we share how Netflix deploys systems to meet its demands, Ceph’s design for high availability, and results from our benchmarking. Netflix runs dozens of stateful services on AWS under strict sub-millisecond tail-latency requirements, which brings unique challenges.

AWS 100

AWS Entertainment Open Source Benchmarking 100

Scalegrid

NOVEMBER 25, 2019

ScyllaDB offers significantly lower latency which allows you to process a high volume of data with minimal delay. In fact, according to ScyllaDB’s performance benchmark report, their 99.9 percentile latency is up to 11X better than Cassandra on AWS EC2 bare metal. So this type of performance has to come at a cost, right?

Big Data 187

Big Data Database Open Source Azure 187

John McCalpin

APRIL 2, 2020

With a staff of slightly over 175 full-time employees (less than 1/2 in consulting roles), we must therefore focus on highly-leveraged performance analysis projects, rather than labor-intensive ones. Bounds on overlap are discussed near the end of the presentation, in the slides titled “Analysis” The approach is opportunistic.

Benchmarking 59

Benchmarking Performance Latency Architecture 59

Adrian Cockcroft

JANUARY 20, 2023

Here’s some predictions I’m making: Jack Dongarra’s efforts to highlight the low efficiency of the HPCG benchmark as an issue will influence the next generation of supercomputer architectures to optimize for sparse matrix computations. In early January a related paper was published by Satoshi Matsuoka et. petaflops, which is 0.8%

Architecture 52

Architecture Latency Benchmarking AWS 52

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. This was a weird problem to think about: Time itself had now become a resource and target of performance analysis. I'm including this step as a reminder for anyone following this kind of analysis. include <sys/time.h>

Speed 126

Speed Java AWS Virtualization 126

Percona

JUNE 22, 2023

long_query_time: Defines the threshold for query execution time, and queries taking longer than this threshold are considered slow and logged for further analysis innodb_buffer_pool_size: Sets the size of the InnoDB buffer pool. This KPI is also directly related to Query Performance and helps improve it.

Performance 102

Performance Monitoring Traffic Database 102

Scalegrid

JANUARY 12, 2024

Key Takeaways A cloud workload encompasses any application or service running on a cloud infrastructure, facilitating tasks ranging from basic functions to advanced data analysis with the help of resources like databases, collaboration tools, and disaster recovery systems. Additionally.

Cloud 130

Cloud Virtualization Storage Efficiency 130

Percona

MARCH 20, 2023

Instead, an analysis needs to be done. Let us take a look also the latency: Here the situation starts to be a little bit more complicated. MySQL Router is the one that has the higher latency no matter what. Given that, there never was a single straight answer. That allows it to go a bit further. and ProxySQL 6.6k.

Games 118

Games Latency Traffic Cache 118

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. This was a weird problem to think about: Time itself had now become a resource and target of performance analysis. I'm including this step as a reminder for anyone following this kind of analysis. in total.

Speed 52

Speed Java AWS Virtualization 52

The Netflix TechBlog

NOVEMBER 22, 2019

In this talk, we share how Netflix deploys systems to meet its demands, Ceph’s design for high availability, and results from our benchmarking. This talk explores the journey, learnings, and improvements to performance analysis, efficiency, reliability, and security. In 2019, Netflix moved thousands of container hosts to bare metal.

AWS 37

AWS Entertainment Open Source Benchmarking 37

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. This was a weird problem to think about: Time itself had now become a resource and target of performance analysis. I'm including this step as a reminder for anyone following this kind of analysis. include <sys/time.h>

Speed 40

Speed Java AWS Virtualization 40

IO River

NOVEMBER 15, 2023

Aggregating this data into a single, coherent view for analysis becomes an additional hurdle. Bot Detection uses a combination of heuristic analysis, behavior patterns, and known bot signatures to identify the type of bot interacting with your application. You'll have logs and analytics scattered across different CDNs.

Traffic 52

Traffic Network Logistics Architecture 52

IO River

NOVEMBER 2, 2023

Aggregating this data into a single, coherent view for analysis becomes an additional hurdle. Bot Detection helps you differentiate the saints from the sinners.‍Bot Detection uses a combination of heuristic analysis, behavior patterns, and known bot signatures to identify the type of bot interacting with your application.

Traffic 40

Traffic Network Logistics Architecture 40

Alex Russell

MARCH 6, 2021

Using a global ASP as a benchmark can further mislead thanks to the distorting effect of ultra-high-end prices rising while shipment volumes stagnate. Sadly, data on latency is harder to get, even from Google's perch, so progress there is somewhat more difficult to judge. Today, either method returns a similar answer.

Performance 124

Performance Network Cache Metrics 124

KeyCDN

AUGUST 15, 2019

Before you begin tuning your website or application, you must first figure out which metrics matter most to your users and establish some achievable benchmarks. Wait time: Sometimes called average latency, wait time refers the amount of time a request spends in a queue before it gets processed. What is Performance Testing?

Testing Tools 55

Testing Tools Best Practices Performance Testing Testing 55

The Morning Paper

MAY 14, 2019

Last time around we looked at the DeathStarBench suite of microservices-based benchmark applications and learned that microservices systems can be especially latency sensitive, and that hotspots can propagate through a microservices architecture in interesting ways. on end-to-end latency) and less than 0.15% on throughput.

Big Data 45

Big Data Cloud Performance Hardware 45

Alex Russell

OCTOBER 22, 2017

Budgets are scaled to a benchmark network & device. Deciding what benchmark to use for a performance budget is crucial. It simulates a link with a 400ms RTT and 400-600Kbps of throughput (plus latency variability and simulated packet loss). Performance budgets are set early in the life of the project. Global Ground-Truth.

Performance 68

Performance Benchmarking Network Mobile 68

Alex Russell

JANUARY 30, 2024

2] Data on mobile network evolution is sketchy, [3] and the largest error bars in this series' analysis continue to reside in this section. If you or your company are able to generate a credible worldwide latency estimate in the higher percentiles for next year's update, please get in touch.

Performance 90

Performance Network Mobile Speed 90

Percona

SEPTEMBER 1, 2023

This reduction in latency ensures that applications and websites provide a more rapid and responsive user experience. Query plan analysis can also provide valuable insights. It is a good idea to run sysbench or another benchmark tool to determine your storage throughput. This does not apply to read (SELECT) traffic.

Tuning 52

Tuning Database Performance Hardware 52

John McCalpin

JANUARY 22, 2018

Each of the two vector units can issue one FMA instruction per cycle, assuming that there are enough independent accumulators to tolerate the 6-cycle dependent-operation latency. The throughput limitation can be observed on a single core, so the following tests and analysis will be limited to this case. cmpl $1000000000, %eax.

Latency 40

Latency Hardware Code Testing 40

Alex Russell

APRIL 29, 2021

As an engineer on a browser team, I'm privy to the blow-by-blow of various performance projects, benchmark fire drills, and the ways performance marketing (deeply) impacts engineering priorities. With each team, benchmarks lost are understood as bugs. All modern browsers are fast, Chromium and Safari/WebKit included. Offscreen Canvas.

Media 145

Media Games Education Engineering 145

Rigor

OCTOBER 30, 2019

The Lighthouse Performance score is based on some of the most important performance metrics : First Contentful Paint, First Meaningful Paint, Speed Index, Time to Interactive, First CPU Idle, and Estimated Input Latency. Google Lighthouse is a great place to start for performance analysis. webperf #perfmatters Click To Tweet.

Google 51

Google Best Practices Energy Website 51

ScaleOut Software

MAY 15, 2014

Likewise, object access paths must be heavily multi-threaded and avoid lock contention to minimize access latency and maximize throughput. For example, the IMDG must be able to efficiently create millions of objects in each server to make use of its huge storage capacity. Testing Scale-Up Performance.

Cache 40

Cache Servers Network Design 40

Smashing Magazine

JANUARY 6, 2020

Treo Sites provides competitive analysis based on real-world data. Estimated Input Latency tells us if we are hitting that threshold, and ideally, it should be below 50ms. Geekbench CPU performance benchmarks for the highest selling smartphones globally in 2019. Large preview ).

Performance 145

Performance Cache Network Metrics 145

Smashing Magazine

JANUARY 11, 2021

Treo provides competitive analysis based on real-world data. Estimated Input Latency tells us if we are hitting that threshold, and ideally, it should be below 50ms. Geekbench CPU performance benchmarks for the highest selling smartphones globally in 2019. Large preview ). New metrics landed in Lighthouse v6 in early 2020.

Performance 145

Performance Cache Media Metrics 145