Brendan Gregg

JULY 4, 2021

This was a chance to talk about other things I've been working on, such as the present and future of hardware performance. The video is on [youtube]: The slides are on [slideshare] or as a [PDF]: I work on many areas of performance, but recently I've had a lot of demand to talk about BPF. Ford, et al., “TCP

Performance 140

Performance Latency Hardware Storage 140

Dynatrace

FEBRUARY 4, 2021

As a discipline, SRE focuses on improving software system reliability across key categories including availability, performance, latency, efficiency, capacity, and incident response. ” According to Google, “SRE is what you get when you treat operations as a software problem.” SRE drives a “shift left” mindset.

Engineering 184

Engineering DevOps Government Latency 184

Adrian Cockcroft

AUGUST 1, 2022

photo by Adrian I gave a talk at Monitorama in Portland Oregon in June, which set out the idea that carbon is just another metric to monitor, and that in a few years most of the monitoring and performance tuning tools are going to be reporting and optimizing for carbon alongside latency, throughput, availability and cost.

AWS 52

AWS Virtualization DevOps Latency 52

Scalegrid

DECEMBER 16, 2019

We ran performance tests for MongoDB on DigitalOcean vs. AWS vs. Azure and found that DigitalOcean performance was in line with, if not better, on both high throughput and low latency in the deployment. DigitalOcean specialized in SSD-based virtual machines called Droplets that are broken down into four simple categories.

Azure 187

Azure AWS Latency Database 187

All Things Distributed

OCTOBER 16, 2019

Already, IoT is delivering deep and precise insights to improve virtually every aspect of our lives. But as the number of IoT devices and use cases grow, people are finding that managing these connected devices presents new challenges. This is the exciting future for IoT, and it's closer than you think.

IoT 126

IoT Healthcare Internet Internet 126

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. CLI tools The Cassandra systems were EC2 virtual machine (Xen) instances. Note that Ubuntu also has a frame to show entry into vDSO (virtual dynamic shared object).

Speed 126

Speed Java AWS Virtualization 126

ACM Sigarch

MAY 31, 2023

However, building and utilizing HCM presents challenges, including interconnecting various memory technologies (e.g., There are three common mechanisms to access remote memory: modifying applications, modifying virtual memory, and hardware-level cache coherence support. The recently announced CXL3.0

Latency 52

Latency Hardware Cache Architecture 52

Dynatrace

DECEMBER 22, 2019

Metrics for each service instance are presented in detailed charts—see the example for ECS below. The example below visualizes average latency by API name and stage for a specific AWS API Gateway. You can observe the metrics across service instances split by region (in this example, API Gateways in us-east-1 and us-east-2 ).

AWS 137

AWS Metrics IoT Storage 137

Dynatrace

DECEMBER 22, 2019

Metrics for each service instance are presented in detailed charts—see the example for ECS below. The example below visualizes average latency by API name and stage for a specific AWS API Gateway. You can observe the metrics across service instances split by region (in this example, API Gateways in us-east-1 and us-east-2 ).

AWS 134

AWS Metrics IoT Storage 134

Scalegrid

FEBRUARY 8, 2024

Durability Availability Fault tolerance These combined outcomes help minimize latency experienced by clients spread across different geographical regions. By leveraging the strengths of both fields, organizations can attain increased efficiency and operational capability within a highly virtualized landscape.

Storage 130

Storage Systems Big Data Azure 130

Brendan Gregg

FEBRUARY 28, 2023

My personal opinion is that I don't see a widespread need for more capacity given horizontal scaling and servers that can already exceed 1 Tbyte of DRAM; bandwidth is also helpful, but I'd be concerned about the increased latency for adding a hop to more memory. Ford, et al., “TCP

Performance 52

Performance Latency Cache Virtualization 52

Brendan Gregg

JULY 4, 2021

This was a chance to talk about other things I've been working on, such as the present and future of hardware performance. The video is on [youtube]: The slides are [here] or as a [PDF]: first prev next last / permalink/zoom I work on many areas of performance, but recently I've had a lot of demand to talk about BPF. Ford, et al., “TCP

Performance 52

Performance Latency Hardware Storage 52

The Netflix TechBlog

MAY 5, 2021

To support such use cases, access control at the user workspace and project workspace granularity is extremely important for presenting a globally consistent view of pertinent data to these artists. These artists may want to create personal workspaces and work on generating intermediate assets.

Media 174

Media Storage Architecture Cloud 174

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. CLI tools The Cassandra systems were EC2 virtual machine (Xen) instances. Note that Ubuntu also has a frame to show entry into vDSO (virtual dynamic shared object).

Speed 52

Speed Java AWS Virtualization 52

Dotcom-Montior

NOVEMBER 24, 2021

These systems can include physical servers, containers, virtual machines, or even a device, or node, that connects and communicates with the network. A three-tier system is a software application architecture that consists of a presentation layer, application layer, and data, or core, layer. Blockchain is a good example of this.

Systems 74

Systems Monitoring Hardware Network 74

HammerDB

OCTOBER 18, 2019

cpupower frequency-info analyzing CPU 0: driver: intel_pstate CPUs which run at the same hardware frequency: 0 CPUs which need to have their frequency coordinated by software: 0 maximum transition latency: Cannot determine or is not supported. hardware limits: 1000 MHz - 4.00 bin/pgbench -c 1 -S -T 60 pgbench starting vacuum.end.

Benchmarking 63

Benchmarking Performance Hardware C++ 63

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. CLI tools The Cassandra systems were EC2 virtual machine (Xen) instances. Note that Ubuntu also has a frame to show entry into vDSO (virtual dynamic shared object).

Speed 40

Speed Java AWS Virtualization 40

All Things Distributed

JANUARY 18, 2012

Amazon DynamoDB offers low, predictable latencies at any scale. Each service encapsulates its own data and presents a hardened API for others to use. A database service that only presents a table interface with a restricted query set is a very important building block for many developers. Consistency. SimpleDBâ??s

Scalability 167

Scalability Database Ecommerce Latency 167

Dotcom-Montior

DECEMBER 8, 2021

You cannot virtualize everything…yet. An organization’s response to an incident, whether we are talking about downtime, security breaches or cyber-attacks, or even prolonged latency and repeated errors, is critical to the continued success of the business and trust from the customer or end user. Asset Management. Postmortems.

Social Media 90

Social Media Monitoring Latency DevOps 90

Percona

APRIL 17, 2023

Operating System (OS) settings Swappiness Swappiness is a Linux kernel setting that influences the behavior of the Virtual Memory manager when it needs to allocate a swap, ranging from 0-100. The CFQ works well for many general use cases but lacks latency guarantees. Without further ado, let’s start with the OS settings.

Best Practices 52

Best Practices Design Tuning Database 52

Alex Russell

MAY 9, 2022

This is a complex topic, but to borrow from a recent post , web performance expands access to information and services by reducing latency and variance across interactions in a session, with a particular focus on the tail of the distribution (P75+). Consistent performance matters just as much as low average latency.

Performance 86

Performance Latency Metrics Engineering 86

Percona

MAY 15, 2023

In both cases, when using virtually-synchronous replication, the process will require certification from each node and local (by node) write; as such, the number of writes is NOT distributed across multiple nodes but duplicated. In short, any data that is written must be consistent with the data present. UUID(), ?, ?,

Traffic 123

Traffic Scalability Database Servers 123

Adrian Cockcroft

APRIL 5, 2023

This proposal seeks to define a standard for real-time carbon and energy data as time-series data that would be accessed alongside and synchronized with the existing throughput, utilization and latency metrics that are provided for the components and applications in computing environments.

Energy 52

Energy Metrics Cloud Operating System 52

The Morning Paper

DECEMBER 8, 2019

On the last morning of the conference Daniel Bittman presented some of the work being done in the context of the Twizzler OS project to explore new programming models for NVM. Therefore any programming abstraction must be low latency and the kernel needs to be kept off the path of persistent data access as much as possible.

Hardware 56

Hardware Programming Media Storage 56

Adrian Cockcroft

NOVEMBER 18, 2019

OPN304 Learnings from migrating a service from JDK 8 to JDK 11 AWS Lambda improved latency by migrating to JDK 11 with Amazon Corretto. Leigh Capili (DevAdv) demos how to launch apps from Git using Kubernetes orchestration, Ignite virtualization, and GitOps management.

Open Source 40

Open Source AWS Lambda Serverless 40

Adrian Cockcroft

NOVEMBER 18, 2019

OPN304 Learnings from migrating a service from JDK 8 to JDK 11 AWS Lambda improved latency by migrating to JDK 11 with Amazon Corretto. Leigh Capili (DevAdv) demos how to launch apps from Git using Kubernetes orchestration, Ignite virtualization, and GitOps management.

Open Source 40

Open Source AWS Lambda Serverless 40

HammerDB

DECEMBER 5, 2020

For TPC-C this meant enough available spindles to reduce I/O latency and for TPC-H enough bandwidth for data throughput. For example, 1000 user terminals would present transactions with human think times and delays, and the transaction monitor will concentrate them down to a steady stream of, say, 50 concurrent processes.

C++ 40

C++ Benchmarking Virtualization Open Source 40

HammerDB

OCTOBER 12, 2018

For this reason sysbench presents a vastly more simplified workload than HammerDB. . Therefore if you are testing MySQL or MariaDB’s ability to support web-based applications that use SQL statements with minimal contention then sysbench is likely to present the best assessment of the system for this type of workload.

Best Practices 40

Best Practices Scalability Performance C++ 40

Alex Russell

APRIL 29, 2021

Now in development in WebKit after years of radio silence, WebXR APIs provide Augmented Reality and Virtual Reality input and scene information to web applications. For heavily latency-sensitive use-cases like WebXR, this is a critical component in delivering a good experience. Offscreen Canvas. Permissions API. Content Indexing.

Media 145

Media Games Education Engineering 145

Brendan Gregg

SEPTEMBER 5, 2017

Here's some output from my zfsdist tool, in bcc/BPF, which measures ZFS latency as a histogram on Linux: # zfsdist. Tracing ZFS operation latency. Just from a quick search, see this presentation PDF , which digs into oops message components. What happens if processes really do try to populate all that virtual memory?

Virtualization 76

Virtualization AWS Engineering Hardware 76

All Things Distributed

AUGUST 16, 2011

There are different considerations when deciding where to allocate resources with latency and cost being the two obvious ones, but compliance sometimes plays an important role as well. To make use of the services in this region, customers will use the Amazon Virtual Private Cloud (VPC) to organize their AWS resources.

AWS 111

AWS Government Big Data Cloud 111

SQL Server According to Bob

JANUARY 11, 2020

​​ Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information presented after the date of publication. This White Paper is for informational purposes only.

Servers 40

Servers Cache Database Media 40

O'Reilly Software

MARCH 7, 2018

The past and present of enterprise integration. WebServices, unfortunately, failed to deliver on the distributed systems front by having virtually all implementations using synchronous/blocking calls—which we all know is a recipe for scaling disaster. Schema evolution practices were rarely in place.

Transportation 72

Transportation Java Programming Architecture 72

SQL Server According to Bob

JANUARY 11, 2020

​​ Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information presented after the date of publication. This White Paper is for informational purposes only.

Servers 40

Servers Cache Media Hardware 40

Smashing Magazine

JANUARY 11, 2021

Estimated Input Latency tells us if we are hitting that threshold, and ideally, it should be below 50ms. Designed for the modern web, it responds to actual congestion, rather than packet loss like TCP does, it is significantly faster , with higher throughput and lower latency — and the algorithm works differently.

Performance 145

Performance Cache Media Metrics 145