Brendan Gregg

FEBRUARY 28, 2023

My personal opinion is that I don't see a widespread need for more capacity given horizontal scaling and servers that can already exceed 1 Tbyte of DRAM; bandwidth is also helpful, but I'd be concerned about the increased latency for adding a hop to more memory. Ford, et al., “TCP

Performance 110

Performance Latency Cache Virtualization 110

The Morning Paper

JANUARY 30, 2020

Edge servers are the middle ground – more compute power than a mobile device, but with latency of just a few ms. Since we’re talking about mobile applications, we have to assume a changing environment over time, including the possibility of losing internet connectivity altogether. The Mobile Web Worker (MWW) System.

Mobile 104

Mobile Cloud Latency Games 104

Dotcom-Montior

NOVEMBER 24, 2021

For example, you can think of a cell phone network as a type of distributed system, consisting of a network of internet-connected devices that share resources workload. Software and hardware components are autonomous and execute tasks concurrently. Today, there are a variety of architectures and systems in use. Peer-to-Peer.

Systems 74

Systems Monitoring Hardware Network 74

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. As a Xen guest, this profile was gathered using perf(1) and the kernel's software cpu-clock soft interrupts, not the hardware NMI. Colleagues/Internet I love using [Linux performance tools]. But I'm not completely sure.

Speed 126

Speed Java AWS Virtualization 126

Brendan Gregg

JULY 4, 2021

This was a chance to talk about other things I've been working on, such as the present and future of hardware performance. The video is on [youtube]: The slides are [here] or as a [PDF]: first prev next last / permalink/zoom I work on many areas of performance, but recently I've had a lot of demand to talk about BPF. Ford, et al., “TCP

Performance 52

Performance Latency Hardware Storage 52

Brendan Gregg

FEBRUARY 28, 2023

My personal opinion is that I don't see a widespread need for more capacity given horizontal scaling and servers that can already exceed 1 Tbyte of DRAM; bandwidth is also helpful, but I'd be concerned about the increased latency for adding a hop to more memory. Ford, et al., “TCP

Performance 52

Performance Latency Cache Virtualization 52

VoltDB

JUNE 1, 2017

Hardware Optimizers” want to get the maximum utilization out of hardware. These systems were designed to have a lifetime of half a decade or more, and rapidly changing hardware meant that the initial deployment had to be sized for 5-7 years out. Latency Optimizers” – need support for very large federated deployments.

Hardware 56

Hardware Latency Virtualization Cloud 56

Alex Russell

JANUARY 30, 2024

HTML, CSS, images, and fonts can all be parsed and run at near wire speeds on low-end hardware, but JavaScript is at least three times more expensive, byte-for-byte. Many critiques are possible, both of the target (five seconds for first load), the sample population (worldwide internet users), and of the methodology (informed reckons).

Performance 90

Performance Network Mobile Speed 90

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. As a Xen guest, this profile was gathered using perf(1) and the kernel's software cpu-clock soft interrupts, not the hardware NMI. Colleagues/Internet I love using Linux performance tools. But I'm not completely sure.

Speed 52

Speed Java AWS Virtualization 52

VoltDB

JUNE 1, 2017

Hardware Optimizers” want to get the maximum utilization out of hardware. These systems were designed to have a lifetime of half a decade or more, and rapidly changing hardware meant that the initial deployment had to be sized for 5-7 years out. Latency Optimizers” – need support for very large federated deployments.

Hardware 40

Hardware Latency Virtualization Cloud 40

Testsigma

JANUARY 30, 2021

With the rapidly increasing use of smartphones and ease of access to the internet across the globe, testing has spread across vast platforms. For example, if you are using internet banking via a Mobile Web application, it will not allow you to save cards or mark any transaction as favourite. What are Mobile Web Applications?

Mobile 52

Mobile Testing Website Internet 52

O'Reilly

JANUARY 16, 2024

software” rather than “hardware” in our brains). Unpredictable wait times : Wait times (latency) for ChatGPT’s responses are unpredictable, and there aren’t audio cues to help me establish an expectation for how long I need to wait before it responds.

Entertainment 73

Entertainment Internet Internet Design 73

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. As a Xen guest, this profile was gathered using perf(1) and the kernel's software cpu-clock soft interrupts, not the hardware NMI. Colleagues/Internet I love using [Linux performance tools]. But I'm not completely sure.

Speed 40

Speed Java AWS Virtualization 40

Smashing Magazine

AUGUST 3, 2021

Different browsers running on different platforms and hardware, respecting our user preferences and browsing modes (Safari Reader/ assistive technologies), being served to geo-locations with varying latency and intermittency increase the likeness of something not working as intended. More after jump!

Network 145

Network Engineering Availability Monitoring 145

All Things Distributed

JULY 13, 2010

In particular this has been true for applications based on algorithms - often MPI-based - that depend on frequent low-latency communication and/or require significant cross sectional bandwidth. There is no more need for hardware tinkering to keep the clusters up and running (I spent many nights doing this; there is no glory in it).

Cloud 119

Cloud AWS Automotive Latency 119

KeyCDN

JULY 11, 2019

Using an image CDN, such as KeyCDN, can significantly reduce the latency of your image delivery. This is crucial due to mobile devices requiring additional optimizations because they typically have less powerful hardware and a slower network connection when compared to desktop devices. Mbps ( Opensignal ).

Speed 52

Speed Website Mobile Latency 52

Alex Russell

APRIL 29, 2021

In almost every area, Apple's low-quality implementation of features WebKit already supports requires workarounds not necessary for Firefox (Gecko) or Chrome/Edge/Brave/Samsung Internet (Blink). For heavily latency-sensitive use-cases like WebXR, this is a critical component in delivering a good experience. Converging Views.

Media 145

Media Games Education Engineering 145

Highly Scalable

SEPTEMBER 18, 2012

Historically, NoSQL paid a lot of attention to tradeoffs between consistency, fault-tolerance and performance to serve geographically distributed systems, low-latency or highly available applications. A database should accommodate itself to different data distributions, cluster topologies and hardware configurations. Data Placement.

Database 213

Database Latency C++ Scalability 213

Alex Russell

JULY 14, 2021

Modern browsers like Chrome and Samsung Internet support a long list of features that make web apps more powerful and keep users safer. Hardware access APIs, notably: Geolocation. Samsung Internet set as the default browser and loads web pages from links in the app. PWA Feature Detector. Web OTP (for easier/faster sign-in).

Google 121

Google Mobile Engineering Internet 121

Tim Kadlec

SEPTEMBER 25, 2014

Another interesting note was how significant the impact of hardware has on the timing. Those markets are going to dominate internet growth over the next few years, and affordability is a more necessary feature than a souped up device. Google had a great post a few years back about how they reduced startup latency for Gmail.

Latency 41

Latency Google Hardware Servers 41

Brendan Gregg

SEPTEMBER 5, 2017

Here's some output from my zfsdist tool, in bcc/BPF, which measures ZFS latency as a histogram on Linux: # zfsdist. Tracing ZFS operation latency. The odd time we hit them, we'll take the "oops message" – a dump of the kernel stack trace and other details from the system log – and search the Internet.

Virtualization 76

Virtualization AWS Engineering Hardware 76

Smashing Magazine

MAY 20, 2020

This metric is important, but quite vague because it can include anything — starting from server rendering time and ending up with latency problems. For example, for an internet shop, it may be a page with a product list, product details page, shopping cart, checkout, and so on. So make a competitors list. But how can you do it?

Performance 98

Performance Metrics Best Practices Code 98

All Things Distributed

APRIL 4, 2017

This enables customers to serve content to their end users with low latency, giving them the best application experience. In 2011, AWS opened a Point of Presence (PoP) in Stockholm to enable customers to serve content to their end users with low latency. As well as AWS Regions, we also have 24 AWS Edge Network Locations in Europe.

AWS 117

AWS Airlines Latency Games 117

Highly Scalable

AUGUST 20, 2013

This system has been designed to supplement and succeed the existing Hadoop-based system that had too high latency of data processing and too high maintenance costs. For example, consider a system that calculates average purchase value in the internet shop for each hour. Daily average cannot be obtained from 24 hourly average values.

Big Data 154

Big Data Processing Lambda Database 154

Smashing Magazine

JANUARY 7, 2019

Estimated Input Latency tells us if we are hitting that threshold, and ideally, it should be below 50ms. On the other hand, we have hardware constraints on memory and CPU due to JavaScript parsing times (we’ll talk about them in detail later). Parsing and executing times vary significantly depending on the hardware of a device.

Performance 103

Performance Cache Metrics Network 103

Smashing Magazine

JANUARY 6, 2020

Estimated Input Latency tells us if we are hitting that threshold, and ideally, it should be below 50ms. Designed for the modern web, it responds to actual congestion, rather than packet loss like TCP does, it is significantly faster , with higher throughput and lower latency — and the algorithm works differently.

Performance 145

Performance Cache Network Metrics 145

All Things Distributed

JULY 14, 2015

In just three short years, Amazon DynamoDB has emerged as the backbone for many powerful Internet applications such as AdRoll , Druva , DeviceScape , and Battlecamp. In traditional database architectures, database engines often run a small search engine or data warehouse engines on the same hardware as the database.

Database 167

Database Lambda AWS IoT 167

Smashing Magazine

JANUARY 11, 2021

Estimated Input Latency tells us if we are hitting that threshold, and ideally, it should be below 50ms. Designed for the modern web, it responds to actual congestion, rather than packet loss like TCP does, it is significantly faster , with higher throughput and lower latency — and the algorithm works differently.

Performance 145

Performance Cache Media Metrics 145

High Scalability

SEPTEMBER 14, 2018

SCM slots between DRAM and flash in terms of latency, cost, and density. Thus, despite both quoting 11 nines of durability against hardware failures, S3 is durable against failures that B2 is not, and is thus better. Because of that big servers and other memory systems need to have another kind of memory in the hierarchy.

Internet 30

Internet Internet Scalability Education 30

Smashing Magazine

AUGUST 22, 2021

This is because HTTP/3 and QUIC mainly help deal with the somewhat uncommon yet potentially high-impact problems that can arise on today’s Internet. Because we are dealing with network protocols here, we will mainly look at network aspects, of which two are most important: latency and bandwidth. Congestion Control.

Performance 105

Performance Network Latency Servers 105

All Things Distributed

JANUARY 18, 2012

a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Today is a very exciting day as we release Amazon DynamoDB , a fast, highly reliable and cost-effective NoSQL database service designed for internet scale applications. Amazon DynamoDB offers low, predictable latencies at any scale. Comments ().

Scalability 167

Scalability Database Ecommerce Latency 167

All Things Distributed

NOVEMBER 15, 2010

For example, the most fundamental abstraction trade-off has always been latency versus throughput. Modern CPUs strongly favor lower latency of operations with clock cycles in the nanoseconds and we have built general purpose software architectures that can exploit these low latencies very well. General Purpose GPU programming.

AWS 136

AWS Latency Programming Architecture 136