Brendan Gregg

FEBRUARY 28, 2023

The video is now on YouTube : The slides are online and as a PDF : first prev next last / permalink/zoom In Q&A I was asked about CXL (compute express link) which was fortunate as I had planned to cover it and then forgot, so the question let me talk about it (although Q&A is missing from the video). Ford, et al., “TCP

Performance 52

Performance Latency Cache Virtualization 52

Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on. Ford, et al., “TCP

Performance 52

Performance Latency Hardware Storage 52

The Netflix TechBlog

NOVEMBER 2, 2021

Moorthy and Zhi Li Introduction Measuring video quality at scale is an essential component of the Netflix streaming pipeline. Perceptual quality measurements are used to drive video encoding optimizations , perform video codec comparisons , carry out A/B testing and optimize streaming QoE decisions to mention a few.

Media 171

Media Innovation Metrics Latency 171

O'Reilly

DECEMBER 2, 2019

I don’t need more bandwidth for video conferences or movies, but I would like to be able to download operating system updates and other large items in seconds rather than minutes. There are impressive estimates for latency for 5G, but reality has a tendency to be harsh on such predictions. At a gigabit, you don’t have to think twice.

Wireless 53

Wireless Serverless IoT Artificial Intelligence 53

IO River

NOVEMBER 2, 2023

Now, with viewers all over the world expecting flawless and high-definition streaming, video providers have their work cut out for them. What Comprises Video Streaming - Traffic CharacteristicsWith the emphasis on a high-quality streaming experience, the optimization starts from the very core. Those days are long gone.

Architecture 52

Architecture Performance Internet Internet 52

IO River

NOVEMBER 2, 2023

Now, with viewers all over the world expecting flawless and high-definition streaming, video providers have their work cut out for them. ‍What Comprises Video Streaming - Traffic CharacteristicsWith the emphasis on a high-quality streaming experience, the optimization starts from the very core. Those days are long gone.

Architecture 52

Architecture Performance Internet Internet 52

Dynatrace

JUNE 1, 2023

Note : you might hear the term latency used instead of response time. Both latency and response time are critical to ensure reliability. Latency typically refers to the time it takes for a single request to travel from its source to its destination. Latency primarily focuses on the time spent in transit.

Latency 179

Latency Website Traffic Virtualization 179

Smashing Magazine

SEPTEMBER 28, 2022

Continue reading below ↓ Meet Smashing Online Workshops on front-end & UX , with practical takeaways, live sessions, video recordings and a friendly Q&A. Caching partially stores your data and is not used as permanent storage. Using the cache as permanent storage is an anti-pattern. More after jump!

Cache 125

Cache Performance Servers Social Media 125

Dynatrace

JUNE 1, 2023

Note : you might hear the term latency used instead of response time. Both latency and response time are critical to ensure reliability. Latency typically refers to the time it takes for a single request to travel from its source to its destination. Latency primarily focuses on the time spent in transit.

Traffic 173

Traffic Latency Website Virtualization 173

The Netflix TechBlog

SEPTEMBER 24, 2021

After content ingestion, inspection and encoding, the packaging step encapsulates encoded video and audio in codec agnostic container formats and provides features such as audio video synchronization, random access and DRM protection. Uploading and downloading data always come with a penalty, namely latency.

Cloud 237

Cloud Media Storage Cache 237

The Netflix TechBlog

SEPTEMBER 2, 2020

This difference has substantial technological implications, from the classification of what’s interesting to transport to cost-effective storage (keep an eye out for later Netflix Tech Blog posts addressing these topics). As you can imagine, this comes with very real storage costs. Is this an anomaly or are we dealing with a pattern?

Latency 296

Latency Transportation Engineering Traffic 296

The Netflix TechBlog

MARCH 7, 2023

in a video file. As described in the above picture During the first run of the algorithm it identified 500 objects in a particular Video file. Now when we re-ran the algorithm on the same video file it created 600 annotations of schema type Objects and stored them in our service. The Algorithm team improved their algorithm.

Media 264

Media Latency Architecture Database 264

The Netflix TechBlog

OCTOBER 27, 2020

Data scientists and engineers collect this data from our subscribers and videos, and implement data analytics models to discover customer behaviour with the goal of maximizing user joy. The data warehouse is not designed to serve point requests from microservices with low latency.

Latency 243

Latency Storage Big Data Tuning 243

The Netflix TechBlog

JUNE 13, 2023

By collecting and analyzing key performance metrics of the service over time, we can assess the impact of the new changes and determine if they meet the availability, latency, and performance requirements. One can perform this comparison live on the request path or offline based on the latency requirements of the particular use case.

Traffic 279

Traffic Metrics Systems Strategy 279

The Netflix TechBlog

APRIL 26, 2022

Figure 1: Netflix ML Architecture Fact: A fact is data about our members or videos. An example of data about members is the video they had watched or added to their My List. An example of video data is video metadata, like the length of a video. Time is a critical component of Axion?—?When

Storage 187

Storage Design Scalability Latency 187

The Netflix TechBlog

MAY 14, 2021

We are expected to process 1,000 watermarks for a single distribution in a minute, with non-linear latency growth as the number of watermarks increases. The watermarking functionality, at the start, was a simple offering with various Google Drive integrations for storage and links.

Traffic 160

Traffic Latency Java Google 160

Dynatrace

DECEMBER 22, 2019

AWS offers a broad set of global, cloud-based services including computing, storage, networking, Internet of Things (IoT), and many others. Amazon Kinesis Video Streams. Amazon Simple Storage Service (S3). The example below visualizes average latency by API name and stage for a specific AWS API Gateway. Dynatrace news.

AWS 136

AWS Metrics IoT Storage 136

Dynatrace

DECEMBER 22, 2019

AWS offers a broad set of global, cloud-based services including computing, storage, networking, Internet of Things (IoT), and many others. Amazon Kinesis Video Streams. Amazon Simple Storage Service (S3). The example below visualizes average latency by API name and stage for a specific AWS API Gateway. Dynatrace news.

AWS 133

AWS Metrics IoT Storage 133

ACM Sigarch

DECEMBER 6, 2018

Each of these categories opens up challenging problems in AI/visual algorithms, high-density computing, bandwidth/latency, distributed systems. One such example is activity recognition in motion video (such as LRCN , Convnets ) which may entail running combinations of both convolutional as well as recurrent neural networks simultaneously.

Wireless 54

Wireless IoT Analytics Architecture 54

The Morning Paper

SEPTEMBER 10, 2019

That’s hard for many reasons, including the differing trade-offs between throughput and latency that need to be made across the use cases. to understand YouTube video performance) drive tens of thousands of canned (known in advance) queries per second, that need to be served with latency in the tens of milliseconds.

Analytics 75

Analytics Latency Cache Google 75

IO River

NOVEMBER 2, 2023

Add-on Services - Special services can include capabilities like security features (WAF, Origin Shield), resource capping (rate limiting), image/video optimization, and more.CDN Pricing Examples1) Amazon Cloudfront’s data routing prices are determined according to amount of traffic and region.

Infrastructure 52

Infrastructure Traffic Cache Strategy 52

Alex Russell

APRIL 29, 2021

Chrome has missed several APIs for 3+ years: Storage Access API. Next-generation video codecs, supported in many modern chips, but also a licensing minefield. Necessary for building competitive video experiences, including messaging and videoconferencing. Fundamentally enabling for video creation apps. getUserMedia().

Media 145

Media Games Education Engineering 145

IO River

NOVEMBER 2, 2023

Some are standard, offering the basic services you need to ensure traffic routing and low latency, while others offer premium services like advanced security capabilities. Capacity CommitmentCommitting to a certain capacity for CDNs saves money by giving you a discounted rate on CDN bandwidth and storage.

Infrastructure 52

Infrastructure Traffic Cache Strategy 52

Dotcom-Montior

MAY 12, 2020

Websites are now more than just the storage and retrieval of information to present content to users. Network latency. Network Latency. With the evolution of cloud technologies, such as Single Page Applications (SPAs), Web APIs, and Model View Controller (MVC), network latency has become a crucial factor to be monitored.

Monitoring 63

Monitoring Entertainment Hardware Latency 63

All Things Distributed

MARCH 11, 2016

This becomes an even more important lesson at scale: for example, as S3 processes trillions and trillions of storage transactions, anything that has even the slightest probability of error will become realistic. If customers have many tiny files, then storage and bandwidth don’t amount to much even if they are making millions of requests.

AWS 144

AWS Hardware Retail Virtualization 144

Percona

APRIL 17, 2023

The CFQ works well for many general use cases but lacks latency guarantees. The deadline excels at latency-sensitive use cases ( like databases ), and noop is closer to no schedule at all. However, it can lead to the storage of redundant data and make it more difficult to maintain data consistency.

Best Practices 52

Best Practices Design Tuning Database 52

All Things Distributed

AUGUST 20, 2015

Today, we are releasing a plugin that allows customers to use the Titan graph engine with Amazon DynamoDB as the backend storage layer. It opens up the possibility to enjoy the value that graph databases bring to relationship-centric use cases, without worrying about managing the underlying storage. The importance of relationships.

Database 134

Database Logistics Availability Social Media 134

All Things Distributed

OCTOBER 12, 2016

Three years ago, as part of our AWS Fast Data journey we introduced Amazon ElastiCache for Redis , a fully managed in-memory data store that operates at sub-millisecond latency. This allows for faster failover times while minimizing latency. Building upon Redis. Redis and Fast Data. “We

Scalability 130

Scalability Analytics Cache AWS 130

All Things Distributed

OCTOBER 2, 2017

Performant – DynamoDB consistently delivers single-digit millisecond latencies even as your traffic volume increases. DynamoDB automatically re-distributes your data to healthy servers to ensure there are always multiple replicas of your data without you needing to intervene.

Internet 128

Internet Internet AWS Performance 128

SQL Server According to Bob

SEPTEMBER 26, 2016

When we released Always On Availability Groups in SQL Server 2012 as a new and powerful way to achieve high availability, hardware environments included NUMA machines with low-end multi-core processors and SATA and SAN drives for storage (some SSDs). As we moved towards SQL Server 2014, the pace of hardware accelerated. Want to dive deeper?

Availability 40

Availability Servers Hardware Benchmarking 40

Dotcom-Montior

MARCH 6, 2022

Users can also watch the actual URL loading video in the browser window. It’s important to mention that within the Dotcom Monitor platform there is a feature that a user can watch the actual URL loading video in the browser window (shown below). This is a good example of a website where efficient caching being used.

Performance 52

Performance Cache Website Speed 52

The Netflix TechBlog

MARCH 6, 2019

Mounting object storage in Netflix’s media processing platform By Barak Alon (on behalf of Netflix’s Media Cloud Engineering team) MezzFS (short for “Mezzanine File System”) is a tool we’ve developed at Netflix that mounts cloud objects as local files via FUSE. What problem are we solving? Encoding is not a one-time process?—?large

Media 214

Media Storage Processing Cache 214

Dotcom-Montior

MAY 6, 2020

Users can also watch the actual URL loading video in the browser window. It’s important to mention that within the Dotcom Monitor platform there is a feature that a user can watch the actual URL loading video in the browser window (shown below). Optimizing Web Performance by Understanding Waterfall Charts. CDN Utilization.

Performance 53

Performance Cache Website Speed 53

Brendan Gregg

SEPTEMBER 5, 2017

. ## Observability Here's the big picture of performance observability tools on Linux, from my [Linux performance] page, where I also have diagrams for other tool types, as well as videos and slides of prior Linux performance talks: I also have a USE Method: Linux Performance Checklist , as a different way to navigate and apply the tools.

Virtualization 76

Virtualization AWS Engineering Hardware 76

Smashing Magazine

JANUARY 11, 2021

Assets Optimizations Brotli, AVIF, WebP, responsive images, AV1, adaptive media loding, video compression, web fonts, Google fonts. Paddy Ganti’s script constructs two URLs (one normal and one blocking the ads), prompts the generation of a video comparison via WebPageTest and reports a delta.

Performance 145

Performance Cache Media Metrics 145

Smashing Magazine

JANUARY 6, 2020

To get a good first impression of how your competitors perform, you can use Chrome UX Report ( CrUX , a ready-made RUM data set, video introduction by Ilya Grigorik and detailed guide by Rick Viscomi) or Treo Sites , a RUM monitoring tool that is powered by Chrome UX Report. You can then mimic the 90th percentile’s experience for testing.

Performance 145

Performance Cache Network Metrics 145

Smashing Magazine

JANUARY 7, 2019

To get a good first impression of how your competitors perform, you can use Chrome UX Report ( CrUX , a ready-made RUM data set, video introduction by Ilya Grigorik), Speed Scorecard (also provides a revenue impact estimator), Real User Experience Test Comparison or SiteSpeed CI (based on synthetic testing).

Performance 103

Performance Cache Metrics Network 103