Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on. Ford, et al., “TCP

Performance 140

Performance Latency Hardware Storage 140

The Netflix TechBlog

NOVEMBER 22, 2019

by Shefali Vyas Dalal AWS re:Invent is a couple weeks away and our engineers & leaders are thrilled to be in attendance yet again this year! To sustain this data growth at Netflix, it has deployed open-source software Ceph using AWS services to achieve the required SLOs of some of the post-production workflows.

AWS 37

AWS Entertainment Open Source Benchmarking 37

Brendan Gregg

FEBRUARY 28, 2023

My personal opinion is that I don't see a widespread need for more capacity given horizontal scaling and servers that can already exceed 1 Tbyte of DRAM; bandwidth is also helpful, but I'd be concerned about the increased latency for adding a hop to more memory. Ford, et al., “TCP

Performance 110

Performance Latency Cache Virtualization 110

Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on. Ford, et al., “TCP

Performance 52

Performance Latency Hardware Storage 52

Brendan Gregg

FEBRUARY 28, 2023

My personal opinion is that I don't see a widespread need for more capacity given horizontal scaling and servers that can already exceed 1 Tbyte of DRAM; bandwidth is also helpful, but I'd be concerned about the increased latency for adding a hop to more memory. Ford, et al., “TCP

Performance 52

Performance Latency Cache Virtualization 52

Adrian Cockcroft

NOVEMBER 18, 2019

We’re excited to let you know that we have an Open Source track at re:Invent this year! AWS Developer Relations on how the shift from Robot Operating System (ROS) 1 to ROS 2 will change the landscape for all robot lovers. Brendan Gregg tours BPF tracing, with open source tools & examples for EC2 instance analysis.

Open Source 40

Open Source AWS Lambda Serverless 40

Adrian Cockcroft

NOVEMBER 18, 2019

We’re excited to let you know that we have an Open Source track at re:Invent this year! AWS Developer Relations on how the shift from Robot Operating System (ROS) 1 to ROS 2 will change the landscape for all robot lovers. Brendan Gregg tours BPF tracing, with open source tools & examples for EC2 instance analysis.

Open Source 40

Open Source AWS Lambda Serverless 40

Dynatrace

MAY 17, 2023

OpenTelemetry , the open source observability tool, has become the go-to standard for instrumenting custom applications to collect observability telemetry data. This allows us to quickly tell whether the network link may be saturated or the processor is running at its limit.

Metrics 171

Metrics Monitoring Database Network 171

The Morning Paper

MAY 12, 2019

An open-source benchmark suite for microservices and their hardware-software implications for cloud & edge systems Gan et al., It’s a pretty impressive effort to pull together and make available in open source (not yet available as I write this) such a suite, and I’m sure explains much of the long list of 24 authors on this paper.

Open Source 61

Open Source Hardware Benchmarking Systems 61

The Netflix TechBlog

FEBRUARY 20, 2019

Today we are excited to announce latency heatmaps and improved container support for our on-host monitoring solution?—?Vector?—?to Vector is open source and in use by multiple companies. Remotely view real-time process scheduler latency and tcp throughput with Vector and eBPF What is Vector? to the broader community.

Performance 211

Performance Latency Open Source Metrics 211

Smashing Magazine

AUGUST 3, 2023

You need to beware that slow server response times can significantly increase TTFB, often due to server overload, network issues, or un-optimized logic on the server side. You need to beware of large HTML files or slow network connections because they can lead to longer download times. Here’s how we do it at Bookaway.

Performance 74

Performance Cache Traffic Metrics 74

All Things Distributed

JULY 20, 2015

The pool of resources, at this time, is the CPU, memory, and networking resources of Amazon EC2 instances as partitioned by containers. networks ports, memory, CPU, etc). This key/value store acts as the single source of truth for all information on the cluster (state, and all changes to state transitions) are entered and stored here.

Latency 166

Latency Architecture AWS Open Source 166

High Scalability

SEPTEMBER 8, 2018

No, I don’t think that is because AWS is earning a 355x margin on DynamoDB! To meet user-defined goals for performance (request latency) and cost, the monitoring service tracks and adjusts resources to workload changes. This increases the cores and network bandwidth available to serve common requests. Related Articles.

Storage 199

Storage Performance AWS Efficiency 199

Percona

MAY 2, 2023

Also, we will take a look at our open-source backup utility custom-built to help avoid costs and proprietary software – Percona Backup for MongoDB or PBM. Especially if going into or out of storage types that may throttle bandwidth/network traffic. It also supports storing the backups on filesystem and AWS S3 buckets.

Best Practices 52

Best Practices Database Storage Servers 52

Adrian Cockcroft

APRIL 5, 2023

This proposal seeks to define a standard for real-time carbon and energy data as time-series data that would be accessed alongside and synchronized with the existing throughput, utilization and latency metrics that are provided for the components and applications in computing environments.

Energy 52

Energy Metrics Cloud Operating System 52

Percona

APRIL 17, 2023

The CFQ works well for many general use cases but lacks latency guarantees. The deadline excels at latency-sensitive use cases ( like databases ), and noop is closer to no schedule at all. Embedding further simplifies database operations, reduces network overhead, and boosts read and query performance.

Best Practices 52

Best Practices Design Tuning Database 52

All Things Distributed

AUGUST 20, 2015

When using relational databases, traversing relationships requires expensive table JOIN operations, causing significantly increased latency as table size and query complexity grow. Like many AWS innovations, the desire to build a solution for a scalable graph database came from Amazon’s retail business. Enter graph databases.

Database 134

Database Logistics Availability Social Media 134

All Things Distributed

OCTOBER 12, 2016

Three years ago, as part of our AWS Fast Data journey we introduced Amazon ElastiCache for Redis , a fully managed in-memory data store that operates at sub-millisecond latency. All these capabilities are available to customers at no additional charge, and maintain open-source Redis compatibility. Redis and Fast Data.

Scalability 130

Scalability Analytics Cache AWS 130

Adrian Cockcroft

NOVEMBER 11, 2019

Collecting some critical metrics at one second intervals, with a total observability latency of ten seconds or less matches the human attention span much better. This is why most AWS regions have three availability zones. Try to measure your mean time to respond (MTTR) for incidents. that are used across multiple applications.

Latency 52

Latency Engineering Systems Hardware 52

Adrian Cockcroft

NOVEMBER 11, 2019

Collecting some critical metrics at one second intervals, with a total observability latency of ten seconds or less matches the human attention span much better. This is why most AWS regions have three availability zones. Try to measure your mean time to respond (MTTR) for incidents. that are used across multiple applications.

Latency 53

Latency Engineering Systems Hardware 53

The Morning Paper

MAY 28, 2019

We don’t talk about energy as often as we probably should on this blog, but it’s certainly true that our data centres and various IT systems consume an awful lot of it. So decision trees are essentially networks of threshold functions. Boosted race trees for low energy classification Tzimpragos et al., ASPLOS’19.

Energy 52

Energy Hardware Efficiency Architecture 52

Smashing Magazine

JANUARY 11, 2021

Networking, HTTP/2, HTTP/3 OCSP stapling, EV/DV certificates, packaging, IPv6, QUIC, HTTP/3. dashboard (open source), SpeedCurve and Calibre are just a few of them, and you can find more tools on perf.rocks. If you don’t have a device at hand, emulate mobile experience on desktop by testing on a throttled 3G network (e.g.

Performance 145

Performance Cache Media Metrics 145

Smashing Magazine

JANUARY 6, 2020

dashboard (open source), SpeedCurve and Calibre are just a few of them, and you can find more tools on perf.rocks. If you don’t have a device at hand, emulate mobile experience on desktop by testing on a throttled 3G network (e.g. Large preview ). There are many tools allowing you to achieve that: SiteSpeed.io 300ms RTT, 1.6

Performance 145

Performance Cache Network Metrics 145

Smashing Magazine

JANUARY 7, 2019

dashboard (open source), SpeedCurve and Calibre are just a few of them, and you can find more tools on perf.rocks. If you don’t have a device at hand, emulate mobile experience on desktop by testing on a throttled network (e.g. There are many tools allowing you to achieve that: SiteSpeed.io 150ms RTT, 1.5 Mbps down, 0.7

Performance 103

Performance Cache Metrics Network 103