Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on. I also wrote about these topics in detail for my recent [Systems Performance 2nd Edition] book.

Performance 140

Performance Latency Hardware Storage 140

The Morning Paper

JUNE 11, 2019

Beyond data and model parallelism for deep neural networks Jia et al., Traditional approaches to training exploit either data parallelism (dividing up the training samples), model parallelism (dividing up the model parameters), or expert-designed hybrids for particular situations. SysML’2019. Expanding the search space.

Network 81

Network Strategy Hardware Benchmarking 81

Scalegrid

JANUARY 25, 2024

Understanding Redis Performance Indicators Redis is designed to handle high traffic and low latency with its in-memory data store and efficient data structures. Effective monitoring of key performance indicators plays a crucial role in maintaining this optimal speed of operation.

Metrics 130

Metrics Monitoring Latency Cache 130

Testlodge

NOVEMBER 12, 2021

Software testers explore the effectiveness of processes that should lead to quality software products to make sure they perform the purpose for which they have been designed. Results may vary because of factors like resolution, internet speed, and different OS versions.

Testing 78

Testing Hardware Operating System Mobile 78

All Things Distributed

MARCH 19, 2018

So, when designing Amazon SageMaker we took on a challenge: to build machine learning algorithms that can handle an infinite amount of data. This post lifts the veil on some of the scientific, system design, and engineering decisions we made along the way. What does that even mean though? This sounds like a pipe dream.

Scalability 159

Scalability Hardware AWS Tuning 159

Percona

AUGUST 30, 2023

In general terms, here are potential trouble spots: Hardware failure: Manufacturing defects, wear and tear, physical damage, and other factors can cause hardware to fail. heat) can damage hardware components and prompt data loss. Human mistakes: Incorrect configuration is an all-too-common cause of hardware and software failure.

Database 84

Database Hardware Open Source Strategy 84

Alex Russell

JANUARY 30, 2024

It's time once again to update our priors regarding the global device and network situation. HTML, CSS, images, and fonts can all be parsed and run at near wire speeds on low-end hardware, but JavaScript is at least three times more expensive, byte-for-byte. What's changed since last year? and 75KiB of JavaScript.

Performance 90

Performance Network Mobile Speed 90

Brendan Gregg

FEBRUARY 28, 2023

## References I've reproduced the references from my SREcon22 keynote below, so you can click on links: - [Gregg 08] Brendan Gregg, “ZFS L2ARC,” [link] Jul 2008 - [Gregg 10] Brendan Gregg, “Visualizations for Performance Analysis (and More),” [link] 2010 - [Greenberg 11] Marc Greenberg, “DDR4: Double the speed, double the latency?

Performance 110

Performance Latency Cache Virtualization 110

Sutter's Mill

NOVEMBER 11, 2023

Instead, you want a library that is tuned for your target hardware architecture and ready for par_unseq vectorized algorithms, for blazing speed. There are a handful of design questions still to decide, norably the semantics of implicit lambda capture, consteval , and multiple declarations. Seeing only the end result of T.[0]

C++ 107

C++ Lambda Network Programming 107

The Morning Paper

MAY 19, 2019

The net result of rapid advancements in the networking world is that inter-tier communications latency will approach the fundamental lower bound of speed-of-light propagation in the foreseeable future. It’s designed for “ emerging architectures featuring fully integrated NIs and hardware-terminated transport protocols.”

Latency 80

Latency Hardware Network Architecture 80

Scalegrid

JANUARY 5, 2024

It was initially designed to mitigate the limitations of file management systems, including slow operations, inadequate security, and substantial data redundancy. Types of DBMS DBMS can be classified into hierarchical, network, relational, and object-oriented types.

Efficiency 147

Efficiency Storage Database Scalability 147

Smashing Magazine

SEPTEMBER 3, 2021

It can be hard to visualize the huge network of hardware that allows you to send a request for a page to a server and then receive a response back. Meet Adam Silver’s Form Design Patterns , a practical guide to designing and building forms for the web. Jump to table of contents ?. Performance And Emissions.

Website 135

Website Energy Internet Internet 135

Alex Russell

MARCH 6, 2021

Thanks to progress in networks and browsers (but not devices), a more generous global budget cap has emerged for sites constructed the "modern" way: ~100KiB of HTML/CSS/fonts and ~300-350KiB of JS (compressed) is the new rule-of-thumb limit for at least the next year or two. Modern network performance and availability.

Performance 124

Performance Network Cache Metrics 124

The Morning Paper

JANUARY 30, 2020

The design of the HTML5 Web Worker interface turns out to be a great match for migration – Workers are already designed to work on a separate thread communicating via message passing, and are typically used to offload expensive computation that you don’t want to do in the main thread with the user waiting.

Mobile 104

Mobile Cloud Latency Games 104

Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on. I also wrote about these topics in detail for my recent [Systems Performance 2nd Edition] book.

Performance 52

Performance Latency Hardware Storage 52

The Morning Paper

MARCH 3, 2020

It takes you through the thinking processes and engineering practices behind the design of a key part of the control plane for AWS Elastic Block Storage (EBS): the Physalia database that stores configuration information. Physalia is designed to offer consistency and high-availability, even under network partitions. Requirements.

Database 106

Database AWS Network Design 106

HammerDB

APRIL 19, 2023

As database performance is heavily influenced by the performance of storage, network, memory, and processors, we must understand the upper limit of these key components. For the network, we can use Iperf to assess the network bandwidth between the client and the database server to ensure it will be enough to meet our peak requirement.

Performance 54

Performance Benchmarking Cache Storage 54

The Morning Paper

SEPTEMBER 19, 2019

Could it be Analyzing efficient stream processing on modern hardware ? I don’t think so in this case, but this paper will take you down into the nitty-gritty of getting the best out of modern processors and networks, with up to two orders of magnitude single node throughput gains to be had. What’s their secret??? Do we want that?

Blockchain 46

Blockchain Hardware Google Analytics 46

SQL Performance

APRIL 27, 2020

Gen 5 is the primary hardware option now for most regions since Gen 4 is aging out. Hyperscale achieves high performance from each compute node having SSD-based caches which helps minimize the network round trips to fetch data. New Hardware Configuration for Provisioned Compute Tier. GB per vCore.

Azure 55

Azure Database Serverless Hardware 55

Smashing Magazine

AUGUST 22, 2021

As we will see, QUIC and HTTP/3 indeed have great web performance potential, but mainly for users on slow networks. If your average visitor is on a fast cabled or cellular network, they probably won’t benefit from the new protocols all that much. A Primer on Speed. Congestion Control.

Performance 106

Performance Network Latency Servers 106

SQL Server According to Bob

SEPTEMBER 26, 2016

When we released Always On Availability Groups in SQL Server 2012 as a new and powerful way to achieve high availability, hardware environments included NUMA machines with low-end multi-core processors and SATA and SAN drives for storage (some SSDs). As we moved towards SQL Server 2014, the pace of hardware accelerated.

Availability 40

Availability Servers Hardware Benchmarking 40

Testsigma

FEBRUARY 5, 2021

If you’re a developer, a web designer, or a QA manager, you would want to ensure that your product delivers as promised. The high tech lab is remotely operational and specifically targets device behaviour in terms of speed, memory usage, and battery consumption. Today’s customers expect the highest standards of user experience.

Mobile 52

Mobile Testing Hardware DevOps 52

O'Reilly

NOVEMBER 28, 2023

Such policies would be designed to mitigate legal problems and require regulatory compliance. That pricing won’t be sustainable, particularly as hardware shortages drive up the cost of building infrastructure. Design tools suitable for professional use don’t exist yet, but they will appear very soon. of users and 3.9%

Open Source 106

Open Source Artificial Intelligence Google Infrastructure 106

The Morning Paper

FEBRUARY 27, 2020

memory leaks that take hours to build up into an issue); and there can be problems that only exhibit themselves with certain user, hardware, or software configurations. Ambient faults due to e.g. hardware faults, network timeouts, and gray failures are occurring all the time, and many of these are unrelated to deployments.

Analytics 68

Analytics Infrastructure Cloud Hardware 68

Brendan Gregg

FEBRUARY 28, 2023

References I've reproduced the references from my SREcon22 keynote below, so you can click on links: [Gregg 08] Brendan Gregg, “ZFS L2ARC,” [link] , Jul 2008 [Gregg 10] Brendan Gregg, “Visualizations for Performance Analysis (and More),” [link] , 2010 [Greenberg 11] Marc Greenberg, “DDR4: Double the speed, double the latency?

Performance 52

Performance Latency Cache Virtualization 52

Testsigma

MAY 3, 2021

Web developers are moving their focus from desktop-first to mobile-first web design which further solidifies our understanding of how important this pocket device has become. What could be the best choice to cut down the costs and gain speed to move the pipeline faster than test automation? Side-By-Side View for multi-tasking.

Mobile 77

Mobile Testing Operating System Hardware 77

Testsigma

JANUARY 30, 2021

The applications are designed using the same code base as Desktop like HTML, Javascript, and CSS. Unlike Native Applications, Mobile web applications do not have to be designed separately for IOS and Android. The reason behind being the speed and convenience of using mobile phones.

Mobile 52

Mobile Testing Website Internet 52

Smashing Magazine

JANUARY 11, 2021

Performance isn’t just a technical concern: it affects everything from accessibility to usability to search engine optimization, and when baking it into the workflow, design decisions have to be informed by their performance implications. Networking, HTTP/2, HTTP/3 OCSP stapling, EV/DV certificates, packaging, IPv6, QUIC, HTTP/3.

Performance 145

Performance Cache Media Metrics 145

SQL Performance

DECEMBER 17, 2019

This removes the burden of purchasing and maintaining your hardware, storage and networking infrastructure, while still giving you a very familiar experience with Windows and SQL Server itself. Microsoft currently has eight main types of virtual machines designed for different types of workloads. Azure VM Types and Series.

Azure 72

Azure Virtualization Servers Storage 72

ACM Sigarch

OCTOBER 25, 2018

The phenomenon of plateauing ST performance is a consequence of design constraints – primarily power. The Thermal Design Power (TDP) of a SOC in a current Ultrabook design is constrained to 15W. In view of this it is perhaps worth pondering why ST performance growth has stalled and some options to revive the growth.

Architecture 67

Architecture Technology Technology Innovation 67

Smashing Magazine

JANUARY 6, 2020

Performance isn’t just a technical concern: it affects everything from accessibility to usability to search engine optimization, and when baking it into the workflow, design decisions have to be informed by their performance implications. Treo Sites provides competitive analysis based on real-world data. Large preview ). Large preview ).

Performance 145

Performance Cache Network Metrics 145

VoltDB

JUNE 1, 2017

It was – like the hypothetical movie I describe above – more than a little bit odd, as you could leave a session discussing ever more abstract layers of virtualization and walk into one where they emphasized the critical importance of pinning a network interface to a specific VM for optimal performance.

Hardware 56

Hardware Latency Virtualization Cloud 56

Smashing Magazine

JANUARY 7, 2019

Performance isn’t just a technical concern: it matters, and when baking it into the workflow, design decisions have to be informed by their performance implications. You need a business stakeholder buy-in, and to get it, you need to establish a case study on how speed benefits metrics and Key Performance Indicators ( KPIs ) they care about.

Performance 104

Performance Cache Network Metrics 104

Abhishek Tiwari

DECEMBER 13, 2017

This has far-reaching implications how future data systems and algorithms will be designed. More importantly, if this works out well, this could lead to a radical improvement in performance by leveraging hardware trends such as GPUs and TPUs. Learned indexes.

Artificial Intelligence 40

Artificial Intelligence Hardware Google Benchmarking 40

VoltDB

JUNE 1, 2017

It was – like the hypothetical movie I describe above – more than a little bit odd, as you could leave a session discussing ever more abstract layers of virtualization and walk into one where they emphasized the critical importance of pinning a network interface to a specific VM for optimal performance.

Hardware 40

Hardware Latency Virtualization Cloud 40

All Things Distributed

DECEMBER 20, 2017

The founders had noticed that in many companies, product designers worked in a very detached manner from the rest of production. In this way, designers are part of an ecosystem in which the functionalities of simulations, data and people come together, enabling them to develop better products faster.

Artificial Intelligence 79

Artificial Intelligence Social Media Logistics AWS 79

All Things Distributed

JULY 13, 2010

Cluster Computer Instances for Amazon EC2 are a new instance type specifically designed for High Performance Computing applications. During my academic career, I spent many years working on HPC technologies such as user-level networking interfaces, large scale high-speed interconnects, HPC software stacks, etc. until today.

Cloud 118

Cloud AWS Automotive Latency 118