Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on. In case you are interested, at the same conference I also gave a talk on [BPF Internals].

Performance 52

Performance Latency Hardware Storage 52

O'Reilly

DECEMBER 2, 2019

The most obvious change 5G might bring about isn’t to cell phones but to local networks, whether at home or in the office. High-speed networks through 5G may represent the next generation of cord cutting. Those waits can be significant, even if you’re on a corporate network. Let’s get back to home networking.

Wireless 53

Wireless Serverless IoT Artificial Intelligence 53

Brendan Gregg

APRIL 30, 2018

USENIX’s LISA conference is the premier event for topics in production system engineering. Another exciting change for 2018: LISA is now a 3-day event, rather than 6 days; check out the Announcement of Changes to Future LISA Conferences for more details. Join us for 3 days in Nashville at LISA'18. Photo by Perry Kivolowitz.

DevOps 43

DevOps Network Best Practices Programming 43

All Things Distributed

DECEMBER 18, 2012

After the AWS re: Invent conference I spent two weeks in Europe for the last customer visits of the year. Aug 11 - " On the Naming and Binding of Network Destinations ", Saltzer, J. Aug 24 - The Five-Minute Rule Ten Years Later, and Other Computer Storage Rules of Thumb , Jim Gray and Goetz Graefe, ACM SIGMOD Record 26 (4): 63â??68,

Operating System 144

Operating System Cache AWS Scalability 144

Brendan Gregg

APRIL 29, 2018

USENIX’s LISA conference is the premier event for topics in production system engineering. Another exciting change for 2018: LISA is now a 3-day event, rather than 6 days; check out the Announcement of Changes to Future LISA Conferences for more details. Join us for 3 days in Nashville at LISA'18. Photo by Perry Kivolowitz.

DevOps 40

DevOps Network Best Practices Programming 40

All Things Distributed

JULY 16, 2012

The first annual AWS user and partner conference will be held November 27-29 at The Venetian in Las Vega. It is shaping up to be a great event with many Amazonians, partners and customers presenting in well over 150 sessions.

AWS 83

AWS Big Data Media Storage 83

The Morning Paper

DECEMBER 8, 2019

At the start of November I was privileged to attend HPTS (the High Performance Transaction Systems) conference in Asilomar. On the last morning of the conference Daniel Bittman presented some of the work being done in the context of the Twizzler OS project to explore new programming models for NVM.

Hardware 56

Hardware Programming Media Storage 56

All Things Distributed

OCTOBER 2, 2017

The success of our early results with the Dynamo database encouraged us to write Amazon's Dynamo whitepaper and share it at the 2007 ACM Symposium on Operating Systems Principles (SOSP conference), so that others in the industry could benefit.

Internet 128

Internet Internet AWS Performance 128

The Morning Paper

SEPTEMBER 19, 2019

There were so many interesting papers at the conference this year though that I haven’t been able to cover nearly as many as I would like. Autoscaling tiered cloud storage in Anna. What if the network was no longer the bottleneck? So today’s post is a short summary of things that caught my eye that I haven’t covered so far.

Blockchain 46

Blockchain Hardware Google Analytics 46

The Symphonia

JUNE 19, 2018

This summer also marks the 4-yearly event that is La Copa Mundial (we only get Telemundo in my apartment, not Fox Sports Network) but since the good old US of A are absent from the men’s World Cup this year, football fever is distinctly frigid. Some in-depth and unusual client work (want to encrypt a petabyte of S3 storage?

Serverless 40

Serverless AWS DevOps Open Source 40

Smashing Magazine

JANUARY 15, 2019

For the last three years, the SustainableUX conference has seen experts in web sustainability sharing their knowledge across an array of web-based disciplines. This includes the work done by the server, the client and the intermediary communications networks that transmit data between the two. These include data transfer (i.e.

Website Performance 73

Website Performance Website Energy Performance 73

All Things Distributed

DECEMBER 5, 2019

On November 18, AWS won six HPCwire Readers' and Editors' Choice Awards at SC19, the International Conference for High Performance Computing, Networking, Storage, and Analysis. Today, I'm happy to share some exciting news about our HPC solutions.

AWS 17

AWS Storage Innovation Network 17

Adrian Cockcroft

JUNE 21, 2022

The early days at Sun Cambridge were special, I absorbed a lot about networking and the technical side of the role from my fellow systems engineer Martin Baines, and we were driving all over the region in cool company cars (I had a Citroen BX 16V) selling a really hot product.

Tuning 52

Tuning Benchmarking Engineering C++ 52

ScaleOut Software

JUNE 29, 2018

Attending technical conferences creates the opportunity to step away from focusing on day-to-day concerns and reflect more deeply about the key principles that guide our work. By Dr. William L. See the diagram below.) As a result, it makes sense to factor its functionality out of application code and migrate it into the platform.

Software Architecture 40

Software Architecture Architecture Software Software 40

ScaleOut Software

JUNE 29, 2018

Attending technical conferences creates the opportunity to step away from focusing on day-to-day concerns and reflect more deeply about the key principles that guide our work. By Dr. William L. See the diagram below.) As a result, it makes sense to factor its functionality out of application code and migrate it into the platform.

Software Architecture 40

Software Architecture Architecture Software Software 40

The Morning Paper

SEPTEMBER 5, 2019

The ability to compute quantiles over aggregated metrics has been recognized to be an essential feature of any monitoring system… Given how expensive calculating exact quantiles can be for both storage and network bandwidth, most monitoring system will compress the data into sketches and compute approximate quantiles.

Latency 52

Latency Metrics Open Source Java 52

ACM Sigarch

NOVEMBER 1, 2019

This blog post gives a glimpse of the computer systems research papers presented at the USENIX Annual Technical Conference (ATC) 2019, with an emphasis on systems that use new hardware architectures. USENIX ATC is a top-tier venue with a broad range of systems research papers from both industry and academia. Heterogeneous ISA. Final words.

Architecture 12

Architecture Hardware Cache Storage 12

ACM Sigarch

NOVEMBER 4, 2019

Conference. The best paper runner-up was “ Dynamic Multi-Resolution Data Storage ”. . The lightning talk sessions on Monday and Tuesday helped the audience decide which talks to attend, and the poster sessions also provided more interactions between the authors and conference attendees. . Workshops and Tutorials.

Hardware 18

Hardware Architecture Programming Innovation 18

Adrian Cockcroft

NOVEMBER 11, 2019

It would take 5–10 minutes after the problem occurred to appear as a problem, then people have to notice and respond to emails or pager text messages, dial into a conference call, and log in to monitoring dashboards before any human response can start. The rows are shown split below for readability.

Latency 52

Latency Engineering Systems Hardware 52

Adrian Cockcroft

NOVEMBER 11, 2019

It would take 5–10 minutes after the problem occurred to appear as a problem, then people have to notice and respond to emails or pager text messages, dial into a conference call, and log in to monitoring dashboards before any human response can start. The rows are shown split below for readability.

Latency 53

Latency Engineering Systems Hardware 53

Brendan Gregg

SEPTEMBER 5, 2017

At my employer we sometimes use SR-IOV for direct network interface access, and NVMe for direct disk access. Most of the changes since rc7 are actually networking fixes, the bulk of them to various drivers. Appliance manufacturers hire kernel engineers to develop custom features, including storage appliances.

Virtualization 76

Virtualization AWS Engineering Hardware 76