Brendan Gregg

FEBRUARY 28, 2023

My personal opinion is that I don't see a widespread need for more capacity given horizontal scaling and servers that can already exceed 1 Tbyte of DRAM; bandwidth is also helpful, but I'd be concerned about the increased latency for adding a hop to more memory. Ford, et al., “TCP

Performance 110

Performance Latency Cache Virtualization 110

The Netflix TechBlog

DECEMBER 21, 2020

At this scale, we can gain a significant amount of performance and cost benefits by optimizing the storage layout (records, objects, partitions) as the data lands into our warehouse. We built AutoOptimize to efficiently and transparently optimize the data and metadata storage layout while maximizing their cost and performance benefits.

Storage 203

Storage Latency Efficiency Data Engineering 203

The Netflix TechBlog

NOVEMBER 22, 2019

4:45pm-5:45pm NFX 209 File system as a service at Netflix Kishore Kasi , Senior Software Engineer Abstract : As Netflix grows in original content creation, its need for storage is also increasing at a rapid pace. In this session, we present our human-centric design principles that enable the autonomy our engineers enjoy.

AWS 100

AWS Entertainment Open Source Benchmarking 100

The Netflix TechBlog

NOVEMBER 22, 2019

4:45pm-5:45pm NFX 209 File system as a service at Netflix Kishore Kasi , Senior Software Engineer Abstract : As Netflix grows in original content creation, its need for storage is also increasing at a rapid pace. In this session, we present our human-centric design principles that enable the autonomy our engineers enjoy.

AWS 100

AWS Entertainment Open Source Benchmarking 100

Brendan Gregg

FEBRUARY 28, 2023

My personal opinion is that I don't see a widespread need for more capacity given horizontal scaling and servers that can already exceed 1 Tbyte of DRAM; bandwidth is also helpful, but I'd be concerned about the increased latency for adding a hop to more memory. Ford, et al., “TCP

Performance 52

Performance Latency Cache Virtualization 52

The Morning Paper

JUNE 13, 2019

HotOS’19 is presenting me with something of a problem as there are so many interesting looking papers in the proceedings this year it’s going to be hard to cover them all! The following figure highlights how just one of these variables, batch size, impacts throughput and latency on ResNet50. HotOS’19. Usability expectations.

Hardware 58

Hardware Latency Serverless Energy 58

The Morning Paper

MARCH 17, 2020

most recently ‘ Efficient lock-free durable sets ‘). Based on these findings, the authors present four guidelines to get the best performance out of this memory today. The read latency for Optane is 2x-3x higher than DRAM. An empirical guide to the behavior and use of scalable persistent memory , Yang et al.,

Scalability 59

Scalability Latency Cache Media 59

Percona

MAY 15, 2023

In short, any data that is written must be consistent with the data present. This operation is quite expensive but our database can run it in a few milliseconds or less, thanks to several optimizations that allow the node to execute most of them in memory with no or little access to mass storage. This is it. UUID(), ?, ?,

Traffic 125

Traffic Scalability Database Servers 125

Testsigma

FEBRUARY 12, 2021

Presently we know it is far from easy to forecast the future – all of us have discovered this in 2020 through major ups and downs. 38% of organisations were expected to introduce machine-learning initiatives in 2019, according to the Capgemini World Efficiency survey. This will rise in the coming year, according to industry analysts.

Artificial Intelligence 92

Artificial Intelligence Software Software IoT 92

Adrian Cockcroft

APRIL 5, 2023

This proposal seeks to define a standard for real-time carbon and energy data as time-series data that would be accessed alongside and synchronized with the existing throughput, utilization and latency metrics that are provided for the components and applications in computing environments.

Energy 52

Energy Metrics Cloud Operating System 52

Percona

APRIL 17, 2023

The CFQ works well for many general use cases but lacks latency guarantees. The deadline excels at latency-sensitive use cases ( like databases ), and noop is closer to no schedule at all. However, it can lead to the storage of redundant data and make it more difficult to maintain data consistency.

Best Practices 52

Best Practices Design Tuning Database 52

The Morning Paper

MAY 28, 2019

The resulting system can integrate seamlessly into a scikit-learn based development process, and dramatically reduces the total energy usage required for classification with very low latency. One efficient way of doing that in analog hardware is the use of current-starved inverters. Introducing race logic.

Energy 52

Energy Hardware Efficiency Architecture 52

O'Reilly Software

APRIL 30, 2018

Modern hybrid applications typically utilize public cloud components, including content delivery networks and cloud storage. When a user makes an application request, DNS locates the data records, and determines the best and most efficient location from which to retrieve the data based on the location of the user.

Cloud 68

Cloud Traffic Internet Internet 68

The Netflix TechBlog

JUNE 13, 2023

Our previous blog post presented replay traffic testing — a crucial instrument in our toolkit that allows us to implement these transformations with precision and reliability. One can perform this comparison live on the request path or offline based on the latency requirements of the particular use case.

Traffic 279

Traffic Metrics Systems Strategy 279

The Netflix TechBlog

NOVEMBER 22, 2019

4:45pm-5:45pm NFX 209 File system as a service at Netflix Kishore Kasi , Senior Software Engineer Abstract : As Netflix grows in original content creation, its need for storage is also increasing at a rapid pace. This talk explores the journey, learnings, and improvements to performance analysis, efficiency, reliability, and security.

AWS 37

AWS Entertainment Open Source Benchmarking 37

Alex Russell

APRIL 29, 2021

Chrome has missed several APIs for 3+ years: Storage Access API. Efficiently enables new styles of drawing content on the web , removing many hard tradeoffs between visual richness , accessibility, and performance. For heavily latency-sensitive use-cases like WebXR, this is a critical component in delivering a good experience.

Media 145

Media Games Education Engineering 145

The Netflix TechBlog

SEPTEMBER 2, 2020

Edgar helps Netflix teams troubleshoot distributed systems efficiently with the help of a summarized presentation of request tracing, logs, analysis, and metadata. Telltale provides Edgar with latency benchmarks that indicate if the individual trace’s latency is abnormal for this given service. What is Edgar?

Latency 296

Latency Transportation Engineering Traffic 296

Dotcom-Montior

MARCH 6, 2022

Some of the phases are presented below: Receiving. Cached Mode (Repeat Visit): The user access the website for the second time, emulating a second visit from the user’s perspective, which includes all the files now cached in a local storage. This is a good example of a website where efficient caching being used.

Performance 52

Performance Cache Website Speed 52

The Netflix TechBlog

OCTOBER 27, 2020

The data warehouse is not designed to serve point requests from microservices with low latency. Therefore, we must efficiently move data from the data warehouse to a global, low-latency and highly-reliable key-value store. It leverages Netflix Scheduler for scheduling the Bulldozer Jobs. Moving data with Bulldozer at Netflix.

Latency 243

Latency Storage Big Data Tuning 243

Dotcom-Montior

MAY 6, 2020

Some of the phrases are presented below: Receiving. Cached Mode (Repeat Visit): The user access the website for the second time, emulating a second visit from the user’s perspective, which includes all the files now cached in a local storage. This is a good example of a website where efficient caching being used.

Performance 53

Performance Cache Website Speed 53

Highly Scalable

MAY 1, 2012

This approach often leads to heavyweight high-latency analytical processes and poor applicability to realtime use cases. Let us imagine that we hashed each element in the data set and these hashed values are presented as binary strings. bits per unique value. Let’s denote the number of the leading zeros as a rank.

Analytics 191

Analytics Traffic Big Data Efficiency 191

Alex Russell

JULY 14, 2021

Here, native apps are doing work related to their core function; storage and tracking of user data are squarely within the four corners of the app's natural responsibilities. They are as helpless as users are to understand why an otherwise browser-presenting environment appears subtly, yet profoundly, broken. 10:59 PM · Jul 4, 2021.

Google 121

Google Mobile Engineering Internet 121

SQL Server According to Bob

JANUARY 11, 2020

​​ Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information presented after the date of publication. This White Paper is for informational purposes only.

Servers 40

Servers Cache Database Media 40

SQL Server According to Bob

JANUARY 11, 2020

​​ Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information presented after the date of publication. Stable Media Stable media is often confused with physical storage. SQL Server 7.0

Servers 40

Servers Cache Media Hardware 40

Brendan Gregg

SEPTEMBER 5, 2017

. - **eBPF**: tracing features completed in 2016, this provides efficient programmatic tracing to existing kernel frameworks. Here's some output from my zfsdist tool, in bcc/BPF, which measures ZFS latency as a histogram on Linux: # zfsdist. Tracing ZFS operation latency. Hit Ctrl-C to end. ^C

Virtualization 76

Virtualization AWS Engineering Hardware 76

Smashing Magazine

JANUARY 7, 2019

Estimated Input Latency tells us if we are hitting that threshold, and ideally, it should be below 50ms. In exchange, your team gains maintainability and developer efficiency, of course. To optimize storage interally, you could use Dropbox’s new Lepton format for losslessly compressing JPEGs by an average of 22%.

Performance 103

Performance Cache Metrics Network 103

All Things Distributed

JANUARY 18, 2012

Amazon DynamoDB offers low, predictable latencies at any scale. Each service encapsulates its own data and presents a hardened API for others to use. In response, we began to develop a collection of storage and database technologies to address the demanding scalability and reliability requirements of the Amazon.com ecommerce platform.

Scalability 167

Scalability Database Ecommerce Latency 167

Smashing Magazine

JANUARY 6, 2020

Estimated Input Latency tells us if we are hitting that threshold, and ideally, it should be below 50ms. Designed for the modern web, it responds to actual congestion, rather than packet loss like TCP does, it is significantly faster , with higher throughput and lower latency — and the algorithm works differently.

Performance 145

Performance Cache Network Metrics 145

Abhishek Tiwari

NOVEMBER 3, 2018

When it comes to innovation, most of CMS solutions are constrained by their legacy architecture (read strong coupling between content management and content presentation) which makes it difficult to serve content to new types of emerging channels such as apps and devices. Without knowing we created a JAMstack for our client.

Systems 63

Systems Cache Website Network 63

All Things Distributed

JUNE 21, 2018

This doesn't mean relational databases do not provide utility in present-day development and are not available, scalable, or provide high performance. Use cases such as gaming, ad tech, and IoT lend themselves particularly well to the key-value data model where the access patterns require low-latency Gets/Puts for known key values.

Database 167

Database AWS Games Latency 167

Smashing Magazine

JANUARY 11, 2021

Estimated Input Latency tells us if we are hitting that threshold, and ideally, it should be below 50ms. Designed for the modern web, it responds to actual congestion, rather than packet loss like TCP does, it is significantly faster , with higher throughput and lower latency — and the algorithm works differently.

Performance 145

Performance Cache Media Metrics 145