Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on. Note that my predictions in this talk may be wrong, but they should be thought provoking.

Performance 140

Performance Latency Hardware Storage 140

Scalegrid

JANUARY 8, 2024

Understanding Multi-Cloud and Hybrid Cloud Cloud computing has revolutionized the IT industry, offering a host of advantages including cost-effectiveness, increased agility, and access to cutting-edge hardware. Challenges of Multi-Cloud Although multi-cloud has its benefits, it also presents some obstacles. But what do these entail?

Strategy 147

Strategy Cloud Scalability Artificial Intelligence 147

Percona

FEBRUARY 24, 2023

Let’s take a look at how to get the benefits you need while spending less, based on the recommendations presented by Dani Guzmán Burgos, our Percona Monitoring and Management (PMM) Tech Lead, on this webinar (now available on demand) hosted in November last year. Over-provisioned instances may lead to unnecessary infrastructure costs.

Cloud 123

Cloud Serverless AWS Storage 123

Scalegrid

DECEMBER 21, 2023

This includes latency, which is a major determinant in evaluating the reliability and performance of your Redis® instance, CPU usage to assess how much time it spends on tasks, operations such as reading/writing data from disk or network I/O, and memory utilization (also known as memory metrics).

Strategy 130

Strategy Monitoring Latency DevOps 130

Percona

JULY 7, 2023

Unfortunately, using certain open source database software as part of an HA architecture can present significant challenges. Despite all its upside, PostgreSQL software presents such challenges. Without enough infrastructure (physical or virtualized servers, networking, etc.), there cannot be high availability.

Availability 87

Availability Open Source Architecture Database 87

Percona

JUNE 22, 2023

Defining high availability In general terms, high availability refers to the continuous operation of a system with little to no interruption to end users in the event of hardware or software failures, power outages, or other disruptions. Without enough infrastructure (physical or virtualized servers, networking, etc.),

Availability 112

Availability Database Open Source Hardware 112

Dotcom-Montior

MAY 12, 2020

Websites are now more than just the storage and retrieval of information to present content to users. Network or connection error. Network latency. Hardware resources. Network Latency. Network latency can be affected due to. Network equipment like cable or router. Hardware Resources.

Monitoring 63

Monitoring Entertainment Hardware Latency 63

Percona

OCTOBER 18, 2023

Resource allocation: Personnel, hardware, time, and money The migration to open source requires careful allocation (and knowledge) of the resources available to you. Evaluating your hardware requirements is another vital aspect of resource allocation. Look closely at your current infrastructure (hardware, storage, networks, etc.)

Open Source 96

Open Source Database Hardware Strategy 96

Scalegrid

JANUARY 25, 2024

It’s important to note that recommended throughput levels may vary depending on factors such as operating system type, network bandwidth availability, and hardware quality. A higher value for this metric can indicate issues on the master/slave or some network problems. It further causes the slave to serve stale data.

Metrics 130

Metrics Monitoring Latency Cache 130

Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on. Note that my predictions in this talk may be wrong, but they should be thought-provoking.

Performance 52

Performance Latency Hardware Storage 52

Brendan Gregg

FEBRUARY 28, 2023

Make sure your system can handle next-generation DRAM,” [link] Nov 2011 - [Hruska 12] Joel Hruska, “The future of CPU scaling: Exploring options on the cutting edge,” [link] Feb 2012 - [Gregg 13] Brendan Gregg, “Blazing Performance with Flame Graphs,” [link] 2013 - [Shimpi 13] Anand Lal Shimpi, “Seagate to Ship 5TB HDD in 2014 using Shingled Magnetic (..)

Performance 110

Performance Latency Cache Virtualization 110

ScaleOut Software

APRIL 22, 2020

The solution to this challenge is to use scalable, memory-based data storage for fast-changing data so that web sites can keep up with exploding workloads. This object-oriented approach allows distributed caches to be viewed as more of an extension of an application’s in-memory data storage than as a separate storage tier.

Cache 52

Cache Storage Servers Database 52

ScaleOut Software

APRIL 22, 2020

The solution to this challenge is to use scalable, memory-based data storage for fast-changing data so that web sites can keep up with exploding workloads. This object-oriented approach allows distributed caches to be viewed as more of an extension of an application’s in-memory data storage than as a separate storage tier.

Cache 52

Cache Storage Servers Database 52

The Morning Paper

DECEMBER 8, 2019

On the last morning of the conference Daniel Bittman presented some of the work being done in the context of the Twizzler OS project to explore new programming models for NVM. Traditionally one of the major costs when moving data in and out of memory (be it to persistent media or over the network) is serialisation. What about security?

Hardware 56

Hardware Programming Media Storage 56

Alex Russell

MARCH 6, 2021

Thanks to progress in networks and browsers (but not devices), a more generous global budget cap has emerged for sites constructed the "modern" way: ~100KiB of HTML/CSS/fonts and ~300-350KiB of JS (compressed) is the new rule-of-thumb limit for at least the next year or two. Modern network performance and availability.

Performance 124

Performance Network Cache Metrics 124

The Morning Paper

MAY 28, 2019

The goal is to produce a low-energy hardware classifier for embedded applications doing local processing of sensor data. Race logic has four primary operations that are easy to implement in hardware: MAX, MIN, ADD-CONSTANT, and INHIBIT. One efficient way of doing that in analog hardware is the use of current-starved inverters.

Energy 52

Energy Hardware Efficiency Architecture 52

The Morning Paper

JUNE 13, 2019

HotOS’19 is presenting me with something of a problem as there are so many interesting looking papers in the proceedings this year it’s going to be hard to cover them all! Different hardware architectures (CPUs, GPUs, TPUs, FPGAs, ASICs, …) offer different performance and cost trade-offs. HotOS’19.

Hardware 58

Hardware Latency Serverless Energy 58

Percona

APRIL 17, 2023

For example: UUID=f41e390f-835b-4223-a9bb-9b45984ddf8d / xfs rw,noatime,attr2,inode64,noquota 0 0 Unix ulimit settings Most UNIX-like operating systems, including Linux and macOS, provide ways to limit and control the usage of system resources such as threads, files, and network connections on a per-process and per-user basis.

Best Practices 52

Best Practices Design Tuning Database 52

The Morning Paper

FEBRUARY 20, 2020

… based on interactions with enterprise customers, we expect that storage and inference of ML models will be subject to the same scrutiny and performance requirements of sensitive/mission-critical operational data. Raven is the system that Microsoft built to explore this question, and answer it with a resounding yes. The last word.

Processing 72

Processing Hardware Database Azure 72

Adrian Cockcroft

JUNE 21, 2022

The early days at Sun Cambridge were special, I absorbed a lot about networking and the technical side of the role from my fellow systems engineer Martin Baines, and we were driving all over the region in cool company cars (I had a Citroen BX 16V) selling a really hot product.

Tuning 52

Tuning Benchmarking Engineering C++ 52

Alex Russell

APRIL 29, 2021

Chrome has missed several APIs for 3+ years: Storage Access API. Real-time network protocols for enabling videoconferencing, desktop sharing, and game streaming applications. Modern, asynchronous network APIs that dramatically improve performance in some situations. Where Chrome Has Lagged. Delayed five years. Gamepad API.

Media 145

Media Games Education Engineering 145

Brendan Gregg

FEBRUARY 28, 2023

Make sure your system can handle next-generation DRAM,” [link] , Nov 2011 [Hruska 12] Joel Hruska, “The future of CPU scaling: Exploring options on the cutting edge,” [link] , Feb 2012 [Gregg 13] Brendan Gregg, “Blazing Performance with Flame Graphs,” [link] , 2013 [Shimpi 13] Anand Lal Shimpi, “Seagate to Ship 5TB HDD in 2014 using Shingled Magnetic (..)

Performance 52

Performance Latency Cache Virtualization 52

SQL Server According to Bob

JANUARY 11, 2020

​​ Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information presented after the date of publication. Stable Media Stable media is often confused with physical storage.

Servers 40

Servers Cache Media Hardware 40

Alex Russell

SEPTEMBER 20, 2020

Pre-publication gates were valuable when better answers weren't available, but commentators should update their priors to account for hardware and software progress of the past 13 years. Fast forward a decade, and both the software and hardware situations have changed dramatically. Don't like the consequences?

Hardware 64

Hardware Mobile Programming Java 64

ACM Sigarch

NOVEMBER 1, 2019

This blog post gives a glimpse of the computer systems research papers presented at the USENIX Annual Technical Conference (ATC) 2019, with an emphasis on systems that use new hardware architectures. The second work presented a novel scalable distributed capability mechanism for security and protection in such systems.

Architecture 12

Architecture Hardware Cache Storage 12

Alex Russell

JULY 14, 2021

Because they lean on the system-provided WebView component, they do not need to pay the expense of a heavier app download to support rendering HTML, running JavaScript, decoding images, or loading network resources. Hardware access APIs, notably: Geolocation. Basic navigation and window management features to (e.g. Web Bluetooth.

Google 121

Google Mobile Engineering Internet 121

Adrian Cockcroft

NOVEMBER 11, 2019

This discussion focuses on hardware, software and operational failure modes. When there’s three ways to succeed, we still have two ways to succeed when a failure is present, and if data is corrupted, we can tell which of the three is the odd one out. There is no need to retry and no extra time taken when a failure is present.

Latency 52

Latency Engineering Systems Hardware 52

Adrian Cockcroft

NOVEMBER 11, 2019

This discussion focuses on hardware, software and operational failure modes. When there’s three ways to succeed, we still have two ways to succeed when a failure is present, and if data is corrupted, we can tell which of the three is the odd one out. There is no need to retry and no extra time taken when a failure is present.

Latency 53

Latency Engineering Systems Hardware 53

Smashing Magazine

JANUARY 11, 2021

Networking, HTTP/2, HTTP/3 OCSP stapling, EV/DV certificates, packaging, IPv6, QUIC, HTTP/3. If you don’t have a device at hand, emulate mobile experience on desktop by testing on a throttled 3G network (e.g. Moto G4) on a slow 3G network, emulated at 400ms RTT and 400kbps transfer speed. 300ms RTT, 1.6 Mbps down, 0.8

Performance 145

Performance Cache Media Metrics 145

Smashing Magazine

JANUARY 6, 2020

If you don’t have a device at hand, emulate mobile experience on desktop by testing on a throttled 3G network (e.g. To make the performance impact more visible, you could even introduce 2G Tuesdays or set up a throttled 3G/4G network in your office for faster testing. 300ms RTT, 1.6 Mbps down, 0.8

Performance 145

Performance Cache Network Metrics 145

SQL Server According to Bob

JANUARY 11, 2020

​​ Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information presented after the date of publication. This White Paper is for informational purposes only.

Servers 40

Servers Cache Database Media 40

O'Reilly

SEPTEMBER 19, 2023

It progressed from “raw compute and storage” to “reimplementing key services in push-button fashion” to “becoming the backbone of AI work”—all under the umbrella of “renting time and storage on someone else’s computers.” Cloud computing? ” scenarios at industrial scale.

Hardware 99

Hardware Storage Big Data Blockchain 99

The Morning Paper

JANUARY 19, 2020

But do A and C share the same storage, compute, or network resources for example? Unfortunately our plans don’t often fare so well when they meet with reality: Many aids are developed based on assumptions about how anomalies present themselves and about what will be useful that later turn out to be incorrect.

C++ 50

C++ Systems Software Software 50

Smashing Magazine

JANUARY 7, 2019

If you don’t have a device at hand, emulate mobile experience on desktop by testing on a throttled network (e.g. To make the performance impact more visible, you could even introduce 2G Tuesdays or set up a throttled 3G network in your office for faster testing. 150ms RTT, 1.5 Mbps down, 0.7 Mbps up) with a throttled CPU (5× slowdown).

Performance 103

Performance Cache Metrics Network 103

Brendan Gregg

SEPTEMBER 5, 2017

Linux has been adding tracing technologies over the years: kprobes (kernel dynamic tracing), uprobes (user-level dynamic tracing), tracepoints (static tracing), and perf_events (profiling and hardware counters). At my employer we sometimes use SR-IOV for direct network interface access, and NVMe for direct disk access. x series.

Virtualization 76

Virtualization AWS Engineering Hardware 76

The Netflix TechBlog

FEBRUARY 9, 2021

We need to be able to easily determine what imagery is present for a given platform, region, and language. The homepage needs to load in a reasonable amount of time, even in poor network conditions. This requires an asset storage solution. Asset Storage We refer to asset storage and management simply as asset management.

Engineering 165

Engineering Storage Latency Entertainment 165