Brendan Gregg

FEBRUARY 28, 2023

The video is now on YouTube : The slides are online and as a PDF : first prev next last / permalink/zoom In Q&A I was asked about CXL (compute express link) which was fortunate as I had planned to cover it and then forgot, so the question let me talk about it (although Q&A is missing from the video). Ford, et al., “TCP

Performance 52

Performance Latency Cache Virtualization 52

Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on. Ford, et al., “TCP

Performance 52

Performance Latency Hardware Storage 52

O'Reilly

DECEMBER 2, 2019

I don’t need more bandwidth for video conferences or movies, but I would like to be able to download operating system updates and other large items in seconds rather than minutes. There are impressive estimates for latency for 5G, but reality has a tendency to be harsh on such predictions. At a gigabit, you don’t have to think twice.

Wireless 53

Wireless Serverless IoT Artificial Intelligence 53

The Netflix TechBlog

JUNE 14, 2023

We could also swap out the implementation of a field from GraphQL Shim to Video API with federation directives. To determine customer impact, we could compare various metrics such as error rates, latencies, and time to render. To launch Phase 2 safely, we used Replay Testing and Sticky Canaries. How does it work?

Traffic 353

Traffic Latency Cache Metrics 353

VoltDB

JUNE 1, 2017

Latency Optimizers” – need support for very large federated deployments. 5G expects a latency of 1ms , which considering that the speed of light means the data center can’t be more than 186 miles away, or 93 miles for a round trip, assuming an instant response. Watch the Video. The “Public Private Cloud” folks.

Hardware 56

Hardware Latency Virtualization Cloud 56

Brendan Gregg

MAY 8, 2021

An average of 434 ms is awful, and a small queue size (aqu-sz) indicates it's a problem with the disk and not the workload applied. This may be the opposite of my famous [shouting video]: This time I'm suppressing vibration to make a disk work.) I want to see distributions and event logs. But first, about this disk. Hit Ctrl-C to end.

Performance 40

Performance Latency Speed Systems 40

Brendan Gregg

MAY 8, 2021

An average of 434 ms is awful, and a small queue size (aqu-sz) indicates it's a problem with the disk and not the workload applied. This may be the opposite of my famous [shouting video]: This time I'm suppressing vibration to make a disk work.) Note the sdb latencies range from 32 ms to over 2 seconds! Hit Ctrl-C to end.

Performance 40

Performance Latency Speed Systems 40

Dynatrace

DECEMBER 22, 2019

AWS offers a broad set of global, cloud-based services including computing, storage, networking, Internet of Things (IoT), and many others. At Dynatrace, we’re constantly improving our AWS monitoring capabilities. Monitor and understand additional AWS services. Get up to 300 new AWS metrics out of the box. Dynatrace news.

AWS 136

AWS Metrics IoT Storage 136

Dynatrace

DECEMBER 22, 2019

AWS offers a broad set of global, cloud-based services including computing, storage, networking, Internet of Things (IoT), and many others. At Dynatrace, we’re constantly improving our AWS monitoring capabilities. Monitor and understand additional AWS services. Get up to 300 new AWS metrics out of the box. Dynatrace news.

AWS 133

AWS Metrics IoT Storage 133

The Netflix TechBlog

SEPTEMBER 24, 2021

After content ingestion, inspection and encoding, the packaging step encapsulates encoded video and audio in codec agnostic container formats and provides features such as audio video synchronization, random access and DRM protection. Uploading and downloading data always come with a penalty, namely latency.

Cloud 237

Cloud Media Storage Cache 237

Dynatrace

JANUARY 26, 2021

REST APIs, authentication, databases, email, and video processing all have a home on serverless platforms. AWS Lambda functions are an example of how a serverless framework works: Developers write a function in a supported language or platform. When an application is triggered, it can cause latency as the application starts.

Serverless 243

Serverless Efficiency Lambda Azure 243

The Netflix TechBlog

OCTOBER 27, 2020

Data scientists and engineers collect this data from our subscribers and videos, and implement data analytics models to discover customer behaviour with the goal of maximizing user joy. The processed data is typically stored as data warehouse tables in AWS S3. How Bulldozer leverages Spark, Protobuf and KV DAL for moving the data.

Latency 243

Latency Storage Big Data Tuning 243

The Netflix TechBlog

APRIL 26, 2022

Figure 1: Netflix ML Architecture Fact: A fact is data about our members or videos. An example of data about members is the video they had watched or added to their My List. An example of video data is video metadata, like the length of a video. Time is a critical component of Axion?—?When

Storage 187

Storage Design Scalability Latency 187

Smashing Magazine

AUGUST 3, 2023

This could be an image, a block of text, or even an embedded video. While dynamic serving provides simplicity in implementation, it imposes significant time costs due to the computational resources required to generate the pages and the latency involved in serving these pages to users at distant locations. Time to First Byte over time.

Performance 74

Performance Cache Traffic Metrics 74

All Things Distributed

MARCH 11, 2016

The epoch of AWS is the launch of Amazon S3 on March 14, 2006, now almost 10 years ago. Given that AWS is a pioneer in building and operating these services world-wide, these lessons have been of crucial importance to our business. AWS helps its customers do this too. Build security in from the ground up.

AWS 144

AWS Hardware Retail Virtualization 144

All Things Distributed

OCTOBER 12, 2016

Three years ago, as part of our AWS Fast Data journey we introduced Amazon ElastiCache for Redis , a fully managed in-memory data store that operates at sub-millisecond latency. This allows for faster failover times while minimizing latency. Building upon Redis. Redis and Fast Data. “Now

Scalability 130

Scalability Analytics Cache AWS 130

All Things Distributed

OCTOBER 2, 2017

As we began growing the AWS business, we realized that external customers might find our Dynamo database just as useful as we found it within Amazon.com. So, we set out to build a fully hosted AWS database service based upon the original Dynamo design.

Internet 128

Internet Internet AWS Performance 128

All Things Distributed

AUGUST 20, 2015

Social media apps navigate relationships between friends, photos, videos, pages, and followers. When using relational databases, traversing relationships requires expensive table JOIN operations, causing significantly increased latency as table size and query complexity grow. Enter graph databases. Graph databases at Amazon.

Database 134

Database Logistics Availability Social Media 134

Smashing Magazine

AUGUST 20, 2021

Fast-forward 30 years, and website technology has changed significantly — we have images, stylesheets, JavaScript, streaming video, AJAX, animation, WebSockets, WebGL, rounded corners in CSS — the list goes on. Twitch developer documentation hosted on AWS, edited on CloudCannon. The site will load in a snap. Large preview ).

Ecommerce 139

Ecommerce Website Government Internet 139

Sutter's Mill

JUNE 21, 2012

One of the slides I omitted to shorten this version of the talk highlighted that there are actually two issues when you go from “Disjoint (tightly coupled)” to “Disjoint (loosely coupled)”: reliability and latency , and both are important. (I I also mentioned this in the original WttJ article this is based on; just search for “reliability.”).

Latency 40

Latency Transportation Hardware Education 40

Percona

APRIL 17, 2023

The CFQ works well for many general use cases but lacks latency guarantees. The deadline excels at latency-sensitive use cases ( like databases ), and noop is closer to no schedule at all. By default, most Linux installs use the CFQ ( Completely-Fair Queue ) scheduler. Two other schedulers are deadline and noop.

Best Practices 52

Best Practices Design Tuning Database 52

All Things Distributed

DECEMBER 12, 2013

Moreover, a GSI''s performance is designed to meet DynamoDB''s single digit millisecond latency - you can add items to a Users table for a gaming app with tens of millions of users with UserId as the primary key, but retrieve them based on their home city, with no reduction in query performance.

Games 130

Games Scalability Database Retail 130

Brendan Gregg

SEPTEMBER 5, 2017

. ## Observability Here's the big picture of performance observability tools on Linux, from my [Linux performance] page, where I also have diagrams for other tool types, as well as videos and slides of prior Linux performance talks: I also have a USE Method: Linux Performance Checklist , as a different way to navigate and apply the tools.

Virtualization 76

Virtualization AWS Engineering Hardware 76

The Netflix TechBlog

MARCH 6, 2019

It’s used extensively in our media processing platform, which includes services like Archer and runs features like video encoding and title image generation on tens of thousands of Amazon EC2 instances. We are constantly innovating on video encoding technology at Netflix, and we have a lot of content to encode. We have one file?

Media 214

Media Storage Processing Cache 214

CSS - Tricks

MAY 3, 2021

1045-aws", "os_version":"Linux 5.4.0-1045-aws", Linux; Android 6.0.1; Moto G (4)) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.85 Mobile Safari/537.36 PTST/210419.211328", "accept: text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.9",

Transportation 86

Transportation Cache Google Mobile 86

Smashing Magazine

JANUARY 11, 2021

Assets Optimizations Brotli, AVIF, WebP, responsive images, AV1, adaptive media loding, video compression, web fonts, Google fonts. Paddy Ganti’s script constructs two URLs (one normal and one blocking the ads), prompts the generation of a video comparison via WebPageTest and reports a delta.

Performance 145

Performance Cache Media Metrics 145

Smashing Magazine

JANUARY 6, 2020

To get a good first impression of how your competitors perform, you can use Chrome UX Report ( CrUX , a ready-made RUM data set, video introduction by Ilya Grigorik and detailed guide by Rick Viscomi) or Treo Sites , a RUM monitoring tool that is powered by Chrome UX Report. You can then mimic the 90th percentile’s experience for testing.

Performance 145

Performance Cache Network Metrics 145

Smashing Magazine

JANUARY 7, 2019

To get a good first impression of how your competitors perform, you can use Chrome UX Report ( CrUX , a ready-made RUM data set, video introduction by Ilya Grigorik), Speed Scorecard (also provides a revenue impact estimator), Real User Experience Test Comparison or SiteSpeed CI (based on synthetic testing).

Performance 104

Performance Cache Network Metrics 104