Sutter's Mill

FEBRUARY 13, 2017

Tue-Thu Apr 25-27: High-Performance and Low-Latency C++ (Stockholm). On April 25-27, I’ll be in Stockholm (Kista) giving a three-day seminar on “High-Performance and Low-Latency C++.”

Latency 51

Latency C++ Hardware Performance 51

ACM Sigarch

MAY 31, 2023

using Compute Express Link or CXL), organizing memory components for optimal performance, adapting system software traditionally designed for homogeneous memory systems, and developing memory abstractions and programming constructs for HCM management. Figure 2: Latency characteristics of memory technologies (source: Maruf et al.,

Latency 52

Latency Hardware Cache Architecture 52

Brendan Gregg

JULY 4, 2021

It's an exciting time for developments in computer performance, not just for the BPF technology (which I often [write about]) but also for processors with 3D stacking and cloud vendor CPUs (e.g., This was a chance to talk about other things I've been working on, such as the present and future of hardware performance. Ford, et al., “TCP

Performance 140

Performance Latency Hardware Storage 140

Scalegrid

FEBRUARY 8, 2024

Key Takeaways Distributed storage systems benefit organizations by enhancing data availability, fault tolerance, and system scalability, leading to cost savings from reduced hardware needs, energy consumption, and personnel. This process effectively duplicates essential parts of information to safeguard against potential loss.

Storage 130

Storage Systems Big Data Azure 130

Dynatrace

OCTOBER 1, 2021

In these modern environments, every hardware, software, and cloud infrastructure component and every container, open-source tool, and microservice generates records of every activity. The architects and developers who create the software must design it to be observed.

Metrics 363

Metrics Open Source Monitoring Infrastructure 363

The Morning Paper

NOVEMBER 10, 2019

It’s been clear for a while that software designed explicitly for the data center environment will increasingly want/need to make different design trade-offs to e.g. general-purpose systems software that you might install on your own machines. The desire for CPU efficiency and lower latencies is easy to understand. Enter Google!

Network 92

Network Transportation Latency Entertainment 92

All Things Distributed

APRIL 4, 2017

This enables customers to serve content to their end users with low latency, giving them the best application experience. In 2011, AWS opened a Point of Presence (PoP) in Stockholm to enable customers to serve content to their end users with low latency. As well as AWS Regions, we also have 24 AWS Edge Network Locations in Europe.

AWS 116

AWS Airlines Latency Games 116

Dynatrace

SEPTEMBER 30, 2021

Cloud migration is the process of transferring some or all your data, software, and operations to a cloud-based computing environment that offers unlimited scale and high availability. They need enough hardware to serve their anticipated volume and keep things running smoothly without buying too much or too little. Reduced cost.

Cloud 172

Cloud Traffic Best Practices Strategy 172

Brendan Gregg

FEBRUARY 28, 2023

At USENIX SREcon22 APAC I gave the opening keynote on the future of computer performance, rounding up the latest developments and making predictions of where I see things heading. This talk originated from my updates to [Systems Performance 2nd Edition], and this was the first time I've given this talk in person! Ford, et al., “TCP

Performance 110

Performance Latency Cache Virtualization 110

Dotcom-Montior

NOVEMBER 24, 2021

Web developers or administrators did not have to worry or even consider the complexity of distributed systems of today. For basic and simple websites, a developer was able to easily automate these checks and fix any problems before a user encountered them. Software and hardware components are autonomous and execute tasks concurrently.

Systems 74

Systems Monitoring Hardware Network 74

All Things Distributed

MARCH 11, 2016

Almost from day one, we knew that the software we were building would not be the software that would be running a year later. We needed to build such an architecture that we could introduce new software components without taking the service down. Build evolvable systems. Primitives not frameworks. Automation is key.

AWS 144

AWS Hardware Retail Virtualization 144

Brendan Gregg

AUGUST 18, 2019

bpftrace is a new open source tracer for Linux for analyzing production performance problems and troubleshooting software. It was created by Alastair Robertson, a talented UK-based developer who has previously won various coding competitions. For smaller environments, it can be of more use helping eliminate latency outliers.

Latency 68

Latency C++ Cache Programming 68

Percona

NOVEMBER 9, 2023

If you have any experience working with database software, you have undoubtedly heard the term Kubernetes a lot. Your workloads, encapsulated in containers, can be deployed freely across different clouds or your own hardware. You may already be using it daily and find it makes running applications in the cloud much more manageable.

Efficiency 103

Efficiency Cloud Healthcare Open Source 103

Brendan Gregg

JULY 4, 2021

It's an exciting time for developments in computer performance, not just for the BPF technology (which I often [write about]) but also for processors with 3D stacking and cloud vendor CPUs (e.g., This was a chance to talk about other things I've been working on, such as the present and future of hardware performance. Ford, et al., “TCP

Performance 52

Performance Latency Hardware Storage 52

CSS Wizardry

OCTOBER 27, 2018

A lot of companies—even if they are aware that performance is key to their business—are often unsure of how, when, or where performance testing sits within their development lifecycle. A lot of the time I’m auditing client sites, many of the issues and inefficiencies I uncover could have quite easily been discovered by the development team.

Performance Testing 172

Performance Testing Testing Performance Strategy 172

HammerDB

OCTOBER 18, 2019

As noted previously the main developer of HammerDB is an Intel employee (#IAMINTEL) however HammerDB is a personal open source project and any opinions are my own, specific to the context of HammerDB as an independent personal project and not representing Intel. hardware limits: 1000 MHz - 4.00 hardware limits: 1000 MHz - 4.00

Benchmarking 63

Benchmarking Performance Hardware C++ 63

Dotcom-Montior

OCTOBER 6, 2021

A site reliability engineer, or SRE, is a role that that encompasses aspects of both software engineering and operations/infrastructure. At that time, the team was made up of software engineers. Site reliability engineers bridge the gap between operations and software developers. What Does a Site Reliability Engineer Do?

Engineering 67

Engineering DevOps Monitoring Google 67

The Netflix TechBlog

FEBRUARY 9, 2021

Server-generated assets, since client-side generation would require the retrieval of many individual images, which would increase latency and time-to-render. To reduce latency, assets should be generated in an offline fashion and not in real time. Different assets for different device types and screen sizes.

Engineering 165

Engineering Storage Latency Entertainment 165

Brendan Gregg

FEBRUARY 28, 2023

At USENIX SREcon22 APAC I gave the opening keynote on the future of computer performance, rounding up the latest developments and making predictions of where I see things heading. This talk originated from my updates to Systems Performance 2nd Edition , and this was the first time I've given this talk in person! Ford, et al., “TCP

Performance 52

Performance Latency Cache Virtualization 52

VoltDB

JUNE 1, 2017

Hardware Optimizers” want to get the maximum utilization out of hardware. These systems were designed to have a lifetime of half a decade or more, and rapidly changing hardware meant that the initial deployment had to be sized for 5-7 years out. Latency Optimizers” – need support for very large federated deployments.

Hardware 56

Hardware Latency Virtualization Cloud 56

The Morning Paper

MARCH 3, 2020

The core algorithms (chain-replication, Paxos-based consensus) aren’t the stars of the show here, instead the paper focuses on how these algorithms are deployed, and the software engineering practices behind the creation of a mission-critical production system employing them. Larger cells have better tolerance of tail latency (e.g.

Database 106

Database AWS Network Design 106

cdemi

FEBRUARY 20, 2017

Let's talk about the elephant in the room; Serverless doesn't really mean that there are no Software or Hardware servers. It just means that from Software Development perspective, servers are abstracted and outsourced to another entity, so you don't need to worry about it. Advantages and Disadvantages of Serverless.

Serverless 64

Serverless Architecture Lambda Azure 64

Alex Russell

APRIL 29, 2021

Apple forces developers of competing browsers to use their engine for all browsers on iOS , restricting their ability to deliver a better version of the web platform. They are, pound for pound, some of the best engine developers globally and genuinely want good things for the web. The Compatibility Tax.

Media 145

Media Games Education Engineering 145

The Morning Paper

DECEMBER 8, 2019

Byte-addressable non-volatile memory,) NVM will fundamentally change the way hardware interacts, the way operating systems are designed, and the way applications operate on data. Therefore any programming abstraction must be low latency and the kernel needs to be kept off the path of persistent data access as much as possible.

Hardware 56

Hardware Programming Media Storage 56

Abhishek Tiwari

JULY 12, 2018

Data Pipeline A data pipeline is a software that ingests data from multiple sources, transforms it and finally makes it available to internal or external products. In recent times, in order to gain valuable insights or to develop the data-driven products companies such as Netflix, Spotify, Uber, AirBnB have built internal data pipelines.

Latency 63

Latency Analytics Scalability Engineering 63

VoltDB

JUNE 1, 2017

Hardware Optimizers” want to get the maximum utilization out of hardware. These systems were designed to have a lifetime of half a decade or more, and rapidly changing hardware meant that the initial deployment had to be sized for 5-7 years out. Latency Optimizers” – need support for very large federated deployments.

Hardware 40

Hardware Latency Virtualization Cloud 40

The Morning Paper

MAY 14, 2019

Last time around we looked at the DeathStarBench suite of microservices-based benchmark applications and learned that microservices systems can be especially latency sensitive, and that hotspots can propagate through a microservices architecture in interesting ways. on end-to-end latency) and less than 0.15% on throughput.

Big Data 45

Big Data Cloud Performance Hardware 45

The Morning Paper

JULY 4, 2019

degraded hardware, transient networking problem) or, more often, because of some change deployed by Netflix engineers that did not have the intended effect. Two failure modes we focus on are a service becoming slower (increase in response latency) or a service failing outright (returning errors).

Latency 77

Latency Engineering Metrics Traffic 77

All Things Distributed

JANUARY 18, 2012

s Dynamo technology , which was one of the first non-relational databases developed at Amazon. With Amazon DynamoDB, developers scaling cloud-based applications can start small with just the capacity they need and then increase the request capacity of a given table as their app grows in popularity. History of NoSQL at Amazon â??

Scalability 167

Scalability Database Ecommerce Latency 167

Alex Russell

JANUARY 30, 2024

HTML, CSS, images, and fonts can all be parsed and run at near wire speeds on low-end hardware, but JavaScript is at least three times more expensive, byte-for-byte. It's clear that developers are out of touch with market ground-truth , but it's not obvious why.

Performance 90

Performance Network Mobile Speed 90

All Things Distributed

JULY 14, 2015

Many happy developers are using DynamoDB to handle trillions of requests every day. In traditional database architectures, database engines often run a small search engine or data warehouse engines on the same hardware as the database. DynamoDB Streams simplifies and improves this design pattern with a distributed systems approach.

Database 167

Database Lambda AWS IoT 167

Smashing Magazine

AUGUST 22, 2021

This part is a bit more technical than the first, though it offloads most of the really deep stuff to outside sources, focusing on explaining why these things matter to the average web developer. Because we are dealing with network protocols here, we will mainly look at network aspects, of which two are most important: latency and bandwidth.

Performance 106

Performance Network Latency Servers 106

Alex Russell

JUNE 20, 2020

is an open collaboration between Google, Microsoft , Intel , Samsung , and others to safely bring capabilities to the web which native developers have come to expect. 1] Expansions of the web's power can seem by turns scary, capricious, or a distraction from the real problems developers face. [2]. Chromium's Project Fugu ??

Hardware 55

Hardware Games Java Media 55

All Things Distributed

JANUARY 23, 2012

VM Import allows our customers to move virtual machine images from their datacenters to the Cloud and Amazon Direct Connect makes the network latencies and bandwidth between on-premises and AWS more predictable. The AWS Storage Gateway is a service connecting an on-premises software appliance with cloud-based storage. Contact Info.

Storage 115

Storage AWS Virtualization Cloud 115

O'Reilly Software

APRIL 4, 2018

Here are five considerations every software architect and developer needs to take into account when setting the architectural foundations for a fast data platform. In turn, they offer a high-level abstraction to enable developers to focus on delivering business value. Determine requirements first. Conclusion.

Architecture 80

Architecture Scalability Google Operating System 80

John McCalpin

JANUARY 22, 2018

Each of the two vector units can issue one FMA instruction per cycle, assuming that there are enough independent accumulators to tolerate the 6-cycle dependent-operation latency. This is an uninspiring fraction of peak performance that would normally suggest significant inefficiencies in either the hardware or software.

Latency 40

Latency Hardware Code Testing 40

All Things Distributed

NOVEMBER 15, 2010

For example, the most fundamental abstraction trade-off has always been latency versus throughput. Modern CPUs strongly favor lower latency of operations with clock cycles in the nanoseconds and we have built general purpose software architectures that can exploit these low latencies very well.Â

AWS 136

AWS Latency Programming Architecture 136