Adrian Cockcroft

JANUARY 29, 2023

The mean and percentile measurements hide this structure, but the rest of this post will show how the structure can be measured and analyzed so that you can figure out a useful model of your system, understand what is driving the long tail of latencies and come up with better SLAs and measures of capacity.

Lambda 98

Lambda Latency Cache C++ 98

The Netflix TechBlog

OCTOBER 19, 2020

If we had an ID for each streaming session then distributed tracing could easily reconstruct session failure by providing service topology, retry and error tags, and latency measurements for all service calls. Using simple lookup indices in Cassandra gives us the ability to maintain acceptable read latencies while doing heavy writes.

Infrastructure 233

Infrastructure Transportation Storage Open Source 233

All Things Distributed

NOVEMBER 13, 2018

Since then, AWS has added another PoP in Palermo in 2017. This includes: Enterprises such as Decysion, Docebo, Eataly, Edizioni Conde Nast, ENEL, Ferrero, GEDI Gruppo Editoriale, Imperia & Monferrina, Lamborghini, Mediaset, Navionics, Pirelli, Pixartprinting, SEAT Pagine Gialle, Tagetik Software, and Vodafone Italy.

AWS 167

AWS Energy Automotive Traffic 167

Alex Russell

JANUARY 30, 2024

If you or your company are able to generate a credible worldwide latency estimate in the higher percentiles for next year's update, please get in touch. Lest we assume low-end means "short-lived", recent announcements regarding software support for these devices will considerably extend their impact.

Performance 90

Performance Network Mobile Speed 90

IO River

NOVEMBER 2, 2023

Delta Air Lines experienced a severe system outage in 2017, resulting in flight cancellations and delays across their network. Whether it's an e-commerce platform, a banking system, or a software-as-a-service (SaaS) provider, downtime can result in lost sales, dissatisfied consumers, and financial losses.As

Availability 52

Availability Social Media Traffic Games 52

IO River

NOVEMBER 2, 2023

Delta Air Lines experienced a severe system outage in 2017, resulting in flight cancellations and delays across their network. Whether it's an e-commerce platform, a banking system, or a software-as-a-service (SaaS) provider, downtime can result in lost sales, dissatisfied consumers, and financial losses.As

Availability 52

Availability Social Media Traffic Games 52

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. As a Xen guest, this profile was gathered using perf(1) and the kernel's software cpu-clock soft interrupts, not the hardware NMI. Software-based clocksources could fix those issues and provide accurate monotonically-increasing time.

Speed 40

Speed Java AWS Virtualization 40

O'Reilly Software

APRIL 4, 2018

Here are five considerations every software architect and developer needs to take into account when setting the architectural foundations for a fast data platform. A message-oriented implementation requires an efficient messaging backbone that facilitates the exchange of data in a reliable and secure way with the lowest latency possible.

Architecture 80

Architecture Scalability Google Operating System 80

Brendan Gregg

AUGUST 8, 2017

I generated this using my offcputime tool from [bcc] (this tool needs eBPF features from Linux 4.8+), and my [flame graph] software: #./bcc/tools/offcputime.py rc5-virtual (bgregg-xenial-bpf-i-0b7296777a2585be1) 08/01/2017 _x86_64_ (8 CPU) 10:15:51 PM UID PID %usr %system %guest %CPU CPU Command 10:16:51 PM 0 18468 2.85 termc$ uptime.

Latency 111

Latency Metrics C++ Systems 111

CSS - Tricks

APRIL 1, 2021

A 2017 study by Akamai says as much when it found that even a 100ms delay in page load can decrease conversions by 7% and lose 1% of their sales for every 100ms it takes for their site to load which, at the time of the study, was equivalent to $1.6 But those are things I did in image editing software.

Cache 92

Cache Social Media Media Website 92

John McCalpin

JANUARY 22, 2018

Introduction: In December 2017, my colleague Damon McDougall (now at AMD) asked for help in porting the fused multiply-add example code from a Colfax report ( [link] ) to the Xeon Phi x200 (Knights Landing) processors here at TACC. simple addition instead of FMA) or with fewer registers and shorter pipeline latency (e.g,

Latency 40

Latency Hardware Code Testing 40

Alex Russell

APRIL 29, 2021

WebGL 2 launched for other platforms on Chrome and Firefox in 2017. For heavily latency-sensitive use-cases like WebXR, this is a critical component in delivering a good experience. Provides safe access to USB devices from the web, enabling new classes of applications in the browser from education to software development and debugging.

Media 145

Media Games Education Engineering 145

The Symphonia

MAY 22, 2018

Gojko Adzic has done some great speaking and writing on his experience here, and I included the link to his talk from late 2017. I also rewrote the section on Startup Latency since Cold Starts are one of the big “FUD” areas of Serverless. I also wrote an article on just this area last year.

Serverless 40

Serverless Architecture Lambda Azure 40

All Things Distributed

OCTOBER 25, 2018

The new AWS Africa (Cape Town) Region will have three Availability Zones and provide lower latency to end users across Sub-Saharan Africa. That's where we built many pioneering networking technologies, our next-generation software for customer support, and the technology behind our compute service, Amazon EC2.

AWS 167

AWS Cloud Education Programming 167

Smashing Magazine

JANUARY 7, 2019

Estimated Input Latency tells us if we are hitting that threshold, and ideally, it should be below 50ms. Ah, and don’t use JPEG-XR on the web — "the processing of decoding JPEG-XRs software-side on the CPU nullifies and even outweighs the potentially positive impact of byte size savings, especially in the context of SPAs".

Performance 103

Performance Cache Metrics Network 103

All Things Distributed

OCTOBER 2, 2017

In support of Amazon Prime Day 2017, the biggest day in Amazon retail history, DynamoDB served over 12.9 Performant – DynamoDB consistently delivers single-digit millisecond latencies even as your traffic volume increases. million requests per second.

Internet 130

Internet Internet AWS Performance 130