Brendan Gregg

JUNE 29, 2018

These have inspired me to summarize another performance activity: evaluating benchmark accuracy. Accurate benchmarking rewards engineering investment that actually improves performance, but, unfortunately, inaccurate benchmarking is more common. If the benchmark reported 20k ops/sec, you should ask: why not 40k ops/sec?

Benchmarking 40

Benchmarking Latency Cache Network 40

Scalegrid

MARCH 28, 2024

Benchmarking Cache Speed Memcached is optimized for high read and write loads, making it highly efficient for rapid data access in a basic key-value store. Redis’s support for pipelining in a Redis server can significantly reduce network latency by batching command executions, making it beneficial for write-heavy applications.

Cache 130

Cache Storage Architecture Scalability 130

Speed Curve

FEBRUARY 5, 2024

Looking at the industry benchmarks for US retailers , four well-known sites have backend times that are approaching – or well beyond – that threshold. Pagespeed Benchmarks - US Retail - LCP When you examine a waterfall, it's pretty obvious that TTFB is the long pole in the tent, pushing out render times for the page.

Servers 58

Servers Cache Benchmarking Retail 58

Tim Kadlec

APRIL 18, 2019

” The fallacy of networks, or new devices for that matter, fixing our performance woes is old and repetitive. To be fair, each new generation of network connectivity does bring some level of change and transformation to how we interact with the internet. The fastest 4G network clocks in around 10 Mbps, and the slowest around 6.3

Network 61

Network Speed Internet Internet 61

The Morning Paper

MAY 12, 2019

An open-source benchmark suite for microservices and their hardware-software implications for cloud & edge systems Gan et al., A typical architecture diagram for one of these services looks like this: Suitably armed with a set of benchmark microservices applications, the investigation can begin! ASPLOS’19.

Open Source 61

Open Source Hardware Benchmarking Systems 61

Adrian Cockcroft

JANUARY 20, 2023

Here’s some predictions I’m making: Jack Dongarra’s efforts to highlight the low efficiency of the HPCG benchmark as an issue will influence the next generation of supercomputer architectures to optimize for sparse matrix computations. In early January a related paper was published by Satoshi Matsuoka et. petaflops, which is 0.8%

Architecture 52

Architecture Latency Benchmarking AWS 52

The Netflix TechBlog

OCTOBER 19, 2020

Reconstructing a streaming session was a tedious and time consuming process that involved tracing all interactions (requests) between the Netflix app, our Content Delivery Network (CDN), and backend microservices. Using simple lookup indices in Cassandra gives us the ability to maintain acceptable read latencies while doing heavy writes.

Infrastructure 233

Infrastructure Storage Transportation Open Source 233

The Netflix TechBlog

NOVEMBER 22, 2019

In this talk, we share how Netflix deploys systems to meet its demands, Ceph’s design for high availability, and results from our benchmarking. Netflix runs dozens of stateful services on AWS under strict sub-millisecond tail-latency requirements, which brings unique challenges.

AWS 100

AWS Entertainment Open Source Benchmarking 100

The Netflix TechBlog

NOVEMBER 22, 2019

In this talk, we share how Netflix deploys systems to meet its demands, Ceph’s design for high availability, and results from our benchmarking. Netflix runs dozens of stateful services on AWS under strict sub-millisecond tail-latency requirements, which brings unique challenges.

AWS 100

AWS Entertainment Open Source Benchmarking 100

Dynatrace

JUNE 27, 2022

In some cases, you will lack benchmarking capabilities. connectivity, access, user count, latency) of geographic regions. Synthetic monitoring is well suited for catching regressions during development lifecycles, especially with network throttling. RUM generates a lot of data. Performance testing based on variable metrics (i.e.,

Best Practices 172

Best Practices Monitoring Wireless Traffic 172

Scalegrid

JANUARY 12, 2024

This is sometimes referred to as using an “over-cloud” model that involves a centrally managed resource pool that spans all parts of a connected global network with internal connections between regional borders, such as two instances in IAD-ORD for NYC-JS webpage DNS routing. This also aids scalability down the line.

Cloud 130

Cloud Storage Virtualization Efficiency 130

Alex Russell

JANUARY 30, 2024

It's time once again to update our priors regarding the global device and network situation. seconds on the target device and network profile, consuming 120KiB of critical path resources to become interactive, only 8KiB of which is script. What's changed since last year? and 75KiB of JavaScript. These are generous targets.

Performance 90

Performance Network Mobile Speed 90

Scalegrid

MARCH 22, 2024

They can also bolster uptime and limit latency issues or potential downtimes. Establishing clear service-level agreements is key as they outline specific responsibilities and performance benchmarks expected from cloud service providers during disaster recovery scenarios.

Strategy 130

Strategy Cloud Government Innovation 130

Percona

JUNE 22, 2023

Indexing efficiency Monitoring indexing efficiency in MySQL involves analyzing query performance, using EXPLAIN statements, utilizing performance monitoring tools, reviewing error logs, performing regular index maintenance, and benchmarking/testing. This KPI is also directly related to Query Performance and helps improve it.

Performance 108

Performance Monitoring Traffic Database 108

Alex Russell

MARCH 6, 2021

Thanks to progress in networks and browsers (but not devices), a more generous global budget cap has emerged for sites constructed the "modern" way: ~100KiB of HTML/CSS/fonts and ~300-350KiB of JS (compressed) is the new rule-of-thumb limit for at least the next year or two. Modern network performance and availability.

Performance 124

Performance Network Cache Metrics 124

IO River

NOVEMBER 15, 2023

The OSI Model is like a layer cake of how data moves through networks. This means it specifically looks at the content of the data (like the writing inside our letters from the analogy) rather than just the envelope.So, what is the difference between a Firewall at the application level and network level?Network-level

Traffic 52

Traffic Network Logistics Architecture 52

CSS - Tricks

APRIL 1, 2021

Google’s industry benchmarks from 2018 also provide a striking breakdown of how each second of loading affects bounce rates. Redirects are often pretty light in terms of the latency that they add to a website, but they are an easy first thing to check, and they can generally be removed with little effort.

Cache 92

Cache Social Media Media Network 92

The Morning Paper

AUGUST 29, 2019

use the TPC-H benchmark to assess Redshift, Redshift Spectrum, Athena, Presto, Hive, and Vertica to find out what works best and the trade-offs involved. For those systems where you provide your own compute instances, the default configuration tested used a 4-node r4.8xlarge cluster with 10Gb/s networking. Key findings.

Architecture 76

Architecture Cloud Storage Serverless 76

Smashing Magazine

SEPTEMBER 28, 2022

The resource loading waterfall is a cascade of files downloaded from the network server to the client to load your website from start to finish. It essentially describes the lifetime of each file you download to load your page from the network. You can see this by opening your browser and looking in the Networking tab.

Performance 125

Performance Cache Servers Social Media 125

Alex Russell

OCTOBER 22, 2017

We constrain ourselves to a real-world baseline device + network configuration to measure progress. Budgets are scaled to a benchmark network & device. JavaScript is the single most expensive part of any page in ways that are a function of both network capacity and device speed. The median user is on a slow network.

Performance 68

Performance Benchmarking Network Mobile 68

Alex Russell

MAY 9, 2022

This is a complex topic, but to borrow from a recent post , web performance expands access to information and services by reducing latency and variance across interactions in a session, with a particular focus on the tail of the distribution (P75+). Consistent performance matters just as much as low average latency.

Performance 86

Performance Latency Metrics Engineering 86

IO River

NOVEMBER 2, 2023

The OSI Model is like a layer cake of how data moves through networks. This means it specifically looks at the content of the data (like the writing inside our letters from the analogy) rather than just the envelope.So, what is the difference between a Firewall at the application level and network level?Network-level

Traffic 40

Traffic Network Logistics Architecture 40

The Netflix TechBlog

NOVEMBER 22, 2019

In this talk, we share how Netflix deploys systems to meet its demands, Ceph’s design for high availability, and results from our benchmarking. Netflix runs dozens of stateful services on AWS under strict sub-millisecond tail-latency requirements, which brings unique challenges.

AWS 37

AWS Entertainment Benchmarking Open Source 37

The Morning Paper

MAY 14, 2019

Last time around we looked at the DeathStarBench suite of microservices-based benchmark applications and learned that microservices systems can be especially latency sensitive, and that hotspots can propagate through a microservices architecture in interesting ways. on end-to-end latency) and less than 0.15% on throughput.

Big Data 45

Big Data Cloud Performance Hardware 45

Rigor

DECEMBER 19, 2019

Synthetic monitoring actively allows users to monitor the performance of their website or application with a set of controlled variables (geography, network, device, browser, cached vs. uncached) over time. Benchmark Against Competitors.

Monitoring 40

Monitoring Benchmarking Website Traffic 40

Speed Curve

SEPTEMBER 4, 2013

The network constraints and what makes the web slow? Bandwidth, latency and it's fundamental impact on the speed of the web. An overview of tools for measuring performance, uptime monitoring, real user monitoring and performance benchmarking. Competitive Benchmarking SpeedCurve. How to make your website faster.

Speed 40

Speed Benchmarking Mobile Website 40

VoltDB

JUNE 1, 2017

It was – like the hypothetical movie I describe above – more than a little bit odd, as you could leave a session discussing ever more abstract layers of virtualization and walk into one where they emphasized the critical importance of pinning a network interface to a specific VM for optimal performance.

Hardware 56

Hardware Latency Virtualization Cloud 56

KeyCDN

AUGUST 15, 2019

Before you begin tuning your website or application, you must first figure out which metrics matter most to your users and establish some achievable benchmarks. Wait time: Sometimes called average latency, wait time refers the amount of time a request spends in a queue before it gets processed. What is Performance Testing?

Testing Tools 55

Testing Tools Best Practices Performance Testing Testing 55

Alex Russell

APRIL 29, 2021

As an engineer on a browser team, I'm privy to the blow-by-blow of various performance projects, benchmark fire drills, and the ways performance marketing (deeply) impacts engineering priorities. With each team, benchmarks lost are understood as bugs. All modern browsers are fast, Chromium and Safari/WebKit included. Gamepad API.

Media 145

Media Games Education Engineering 145

Abhishek Tiwari

DECEMBER 27, 2017

optimised container networking and security. A recent performance benchmark completed by Intel and BlueData using the BigBench benchmarking kit has shown that the performance ratios for container-based Hadoop workloads on BlueData EPIC are equal to and in some cases, better than bare-metal Hadoop [7]. Performance.

Big Data 63

Big Data Storage Benchmarking Hardware 63

SQL Server According to Bob

SEPTEMBER 26, 2016

Performance issues surrounding Availability Groups typically were related to disk I/O or network speeds. Our customers who deployed Availability Groups were now using servers for primary and secondary replicas with 12+ core sockets and flash storage SSD arrays providing microsecond to low millisecond latencies.

Availability 40

Availability Servers Hardware Benchmarking 40

VoltDB

JUNE 1, 2017

It was – like the hypothetical movie I describe above – more than a little bit odd, as you could leave a session discussing ever more abstract layers of virtualization and walk into one where they emphasized the critical importance of pinning a network interface to a specific VM for optimal performance.

Hardware 40

Hardware Latency Virtualization Cloud 40

Smashing Magazine

JANUARY 11, 2021

Networking, HTTP/2, HTTP/3 OCSP stapling, EV/DV certificates, packaging, IPv6, QUIC, HTTP/3. If you don’t have a device at hand, emulate mobile experience on desktop by testing on a throttled 3G network (e.g. Estimated Input Latency tells us if we are hitting that threshold, and ideally, it should be below 50ms. 300ms RTT, 1.6

Performance 145

Performance Cache Media Google 145

Rigor

OCTOBER 30, 2019

The Lighthouse Performance score is based on some of the most important performance metrics : First Contentful Paint, First Meaningful Paint, Speed Index, Time to Interactive, First CPU Idle, and Estimated Input Latency. When it comes to network speed, Lighthouse gives you three options – and no others.

Google 51

Google Best Practices Energy Website 51

Smashing Magazine

JANUARY 6, 2020

If you don’t have a device at hand, emulate mobile experience on desktop by testing on a throttled 3G network (e.g. To make the performance impact more visible, you could even introduce 2G Tuesdays or set up a throttled 3G/4G network in your office for faster testing. 300ms RTT, 1.6 Mbps down, 0.8

Performance 145

Performance Cache Network Servers 145

ScaleOut Software

MAY 15, 2014

Likewise, object access paths must be heavily multi-threaded and avoid lock contention to minimize access latency and maximize throughput. Also, load-balancing after membership changes must be both multi-threaded and pipelined to drive the network at maximum bandwidth. Testing Scale-Up Performance. Please retry later.

Cache 40

Cache Servers Network Storage 40

The Netflix TechBlog

SEPTEMBER 2, 2020

A span: Represents a unit of work, such as a network call from one service to another (a client/server relationship) or a purely internal action (e.g., Telltale provides Edgar with latency benchmarks that indicate if the individual trace’s latency is abnormal for this given service. starting and finishing a method).

Latency 296

Latency Transportation Engineering Traffic 296