InfoQ

APRIL 15, 2024

At the QCon London 2024 conference, Félix GV from LinkedIn discussed the AI/ML platform powering the company’s products. He specifically delved into Venice DB, the NoSQL data store used for feature persistence. By Rafal Gancarz

Artificial Intelligence 105

Artificial Intelligence Big Data Data Engineering Latency 105

Brendan Gregg

FEBRUARY 28, 2023

My personal opinion is that I don't see a widespread need for more capacity given horizontal scaling and servers that can already exceed 1 Tbyte of DRAM; bandwidth is also helpful, but I'd be concerned about the increased latency for adding a hop to more memory. Or even on a plane. It was a great privilege.

Performance 52

Performance Latency Cache Virtualization 52

The Morning Paper

NOVEMBER 8, 2020

USENIX is a nonprofit organisation committed to making content and research freely available – both conference proceedings and the recorded presentations of their events. Without in-person conferences this year, income is down and events are under threat. For Facebook’s Delos, reconfiguration latencies of 10s of ms are ok.

Virtualization 126

Virtualization Latency Storage Systems 126

Adrian Cockcroft

JANUARY 29, 2023

The mean and percentile measurements hide this structure, but the rest of this post will show how the structure can be measured and analyzed so that you can figure out a useful model of your system, understand what is driving the long tail of latencies and come up with better SLAs and measures of capacity.

Lambda 98

Lambda Latency Cache C++ 98

Sutter's Mill

SEPTEMBER 11, 2020

It’s hard to believe CppCon 2020 is nearly here… in fact, pre-conference tutorials are already in progress. I’ll be at the conference throughout the week in the hallways and session rooms. This is my one actual talk, and it’s the last talk of the conference. The conference starts Sunday.

C++ 65

C++ Games Latency Programming 65

Brendan Gregg

JULY 4, 2021

I summarized these topics and more as a plenary conference talk, including my own predictions (as a senior performance engineer) for the future of computing performance, with a focus on back-end servers. In case you are interested, at the same conference I also gave a talk on [BPF Internals]. Ford, et al., “TCP

Performance 52

Performance Latency Hardware Storage 52

Adrian Cockcroft

JANUARY 20, 2023

Summary of types of applications for supercomputers We spent most of the conference walking around the expo and talking to people, rather than attending technical sessions, and asked several people why other vendors weren’t copying Fugaku, and what improvements in architecture were on the horizon.

Architecture 52

Architecture Latency Benchmarking AWS 52

All Things Distributed

MARCH 12, 2018

The availability of large scale voice training data, the advances made in software with processing engines such as Caffe, MXNet and Tensorflow, and the rise of massively parallel compute engines with low-latency memory access, such as the Amazon EC2 P3 instances have made voice processing at scale a reality.

Systems 110

Systems AWS Games Transportation 110

O'Reilly

DECEMBER 2, 2019

I don’t need more bandwidth for video conferences or movies, but I would like to be able to download operating system updates and other large items in seconds rather than minutes. There are impressive estimates for latency for 5G, but reality has a tendency to be harsh on such predictions. Upcoming events.

Wireless 53

Wireless Serverless IoT Artificial Intelligence 53

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. I happened to be speaking at a technical confering while still debugging this, and mentioned what I was working on to a processor engineer. A quick check of basic performance statistics showed over 30% higher CPU consumption.

Speed 126

Speed Java AWS Virtualization 126

Tasktop

JUNE 18, 2019

At Tasktop, we’re gearing up for yet another fantastic conference (Booth P4). As veteran platinum sponsors , we’ve gained a lot of wisdom over the years into how best to maximize the your time at the conference. Here are four tips to get the most out of DOES London 2019: Tip #1 – Develop a plan of attack.

DevOps 74

DevOps Network Software Software 74

ACM Sigarch

MAY 31, 2023

even lowered the latency by introducing a multi-headed device that collapses switches and memory controllers. Figure 2: Latency characteristics of memory technologies (source: Maruf et al., Also, we cannot expect the programmer to know data placement and handle different memory latency and bandwidth in heterogeneous memory.

Latency 52

Latency Hardware Cache Architecture 52

Brendan Gregg

JULY 2, 2021

biolatency Disk I/O latency histogram heat map. runqlat CPU scheduler latency heat map. If you really want to do this and have the time, you certainly can (you'll probably wind up at tracing conferences and bumping into me: See you at Linux Plumber's or the Tracing Summit!) execsnoop New processes (via exec(2)) table.

Latency 145

Latency Cache Energy Systems 145

Brendan Gregg

AUGUST 18, 2019

For example, iostat(1), or a monitoring agent, may tell you your average disk latency, but not the distribution of this latency. For smaller environments, it can be of more use helping eliminate latency outliers. Block I/O latency as a histogram. This traces block I/O, and shows latency as a power-of-2 histogram.

Latency 68

Latency C++ Cache Programming 68

The Morning Paper

JULY 7, 2019

In addition to availability, our respondents focus most heavily on supporting the following data attributes: “accessibility, accuracy, authoritativeness, freshness, latency, structuredness, ontological typing, connectedness, and semantic joinability.”

Software Engineering 92

Software Engineering Engineering Software Software 92

VoltDB

JUNE 1, 2017

Earlier this month I spent a week at the OpenStack conference. But once you realize that there are, in fact, several OpenStack conferences happening at the same time and place, it makes more sense. Latency Optimizers” – need support for very large federated deployments.

Hardware 56

Hardware Latency Virtualization Cloud 56

The Morning Paper

SEPTEMBER 5, 2019

For response times (latencies) reporting a simple metric such as ‘average’ is next to useless. Instead we want to understand what’s happening at different latency percentiles (e.g A characteristic of latency distributions is that they have a long tail. Why do we need a new sketch?

Latency 52

Latency Metrics Open Source Java 52

cdemi

JUNE 10, 2017

Because these are real-time systems, their Byzantine fault tolerance solutions must have very low latency. bus for commercial avionics, can achieve Byzantine fault tolerance on the order of a microsecond of added latency. In fact, Boeing states that SAFEbus , a standard backplane.

Blockchain 62

Blockchain Latency Systems C++ 62

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. I happened to be speaking at a technical confering while still debugging this, and mentioned what I was working on to a processor engineer. A quick check of basic performance statistics showed over 30% higher CPU consumption.

Speed 52

Speed Java AWS Virtualization 52

Speed Curve

NOVEMBER 3, 2019

” Tammy, Steve and Cliff at Velocity Conference circa 2015. Traditionally, we’ve spent a lot of time focusing on entitled groups as it relates to performance – fast connection speeds, devices with high-end CPUs, low-latency geographies. Building a more inclusive web.

Education 47

Education Latency Strategy Speed 47

VoltDB

JUNE 1, 2017

Earlier this month I spent a week at the OpenStack conference. But once you realize that there are, in fact, several OpenStack conferences happening at the same time and place, it makes more sense. Latency Optimizers” – need support for very large federated deployments.

Hardware 40

Hardware Latency Virtualization Cloud 40

All Things Distributed

OCTOBER 2, 2017

The success of our early results with the Dynamo database encouraged us to write Amazon's Dynamo whitepaper and share it at the 2007 ACM Symposium on Operating Systems Principles (SOSP conference), so that others in the industry could benefit.

Internet 128

Internet Internet AWS Performance 128

The Morning Paper

DECEMBER 8, 2019

At the start of November I was privileged to attend HPTS (the High Performance Transaction Systems) conference in Asilomar. On the last morning of the conference Daniel Bittman presented some of the work being done in the context of the Twizzler OS project to explore new programming models for NVM.

Hardware 56

Hardware Programming Media Storage 56

The Morning Paper

JANUARY 23, 2020

1:00pm Eastern Standard Time the Personalisation / Homepage Team for Etsy are in a conference room kicking off a lunch-and-learn session on the personalised feed feature on the Etsy.com homepage. 1:18pm a key observation was made that an API call to populate the homepage sidebar saw a huge jump in latency.

Internet 53

Internet Internet Cache Engineering 53

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. I happened to be speaking at a technical confering while still debugging this, and mentioned what I was working on to a processor engineer. A quick check of basic performance statistics showed over 30% higher CPU consumption.

Speed 40

Speed Java AWS Virtualization 40

Speed Curve

SEPTEMBER 4, 2013

Bandwidth, latency and it's fundamental impact on the speed of the web. Responsive web design is solid gold Etsy - Building Resilient User Experiences Velocity Conference Videos Browser Diet References. Why speed matters, examples of the impact saving a few seconds of load time has had on revenue and engagement.

Speed 40

Speed Benchmarking Latency Mobile 40

Brendan Gregg

MAY 16, 2017

A latency outlier issue that happened every 15 minutes. I also usually speak at some conferences each year. ## Culture The biggest difference I've found working here is still the culture. I spoke about these at Facebook's [Performance@Scale] event and other conferences. Java core dump analysis for a crashing JVM. -

Java 75

Java Entertainment Engineering Scalability 75

John McCalpin

JANUARY 22, 2018

Dr. Damon McDougall gave a short presentation on this study at the IXPUG 2018 Fall Conference ( pdf ) — I originally wrote these notes to help organize my thoughts as we were preparing the IXPUG presentation, and later decided that the extra details contained here are interesting enough for me to post it. cmpl $1000000000, %eax.

Latency 40

Latency Hardware Code Testing 40

Brendan Gregg

JULY 2, 2021

biolatency Disk I/O latency histogram heat map 5. runqlat CPU scheduler latency heat map 10. If you really want to do this and have the time, you certainly can (you'll probably wind up at tracing conferences and bumping into me: See you at Linux Plumber's or the Tracing Summit!) execsnoop New processes (via exec(2)) table 2.

Open Source 40

Open Source Latency Cache Energy 40

The Symphonia

MAY 22, 2018

I also rewrote the section on Startup Latency since Cold Starts are one of the big “FUD” areas of Serverless. Right now there’s been one conference and there are a handful of meetups around the world. many conferences, many communities, and more online fora than you can possibly keep track of.

Serverless 40

Serverless Architecture Lambda Azure 40

John McCalpin

OCTOBER 16, 2016

“Memory Bandwidth and System Balance in HPC Systems” If you are planning to attend the SuperComputing 2016 conference in Salt Lake City next month, be sure to reserve a spot on your calendar for my talk on Wednesday afternoon (4:15pm-5:00pm).

Architecture 40

Architecture Systems Technology Technology 40

Tim Kadlec

AUGUST 14, 2018

The area he was in was served by satellite internet access, and experienced significant latency (a floor of 506 milliseconds) and packet loss (between 50-80% was typical). I can personally remember bringing this up to folks involved with Chrome at conferences, online AMA’s and basically whenever else I had the opportunity.

Cache 64

Cache Mobile Servers Latency 64

Adrian Cockcroft

NOVEMBER 11, 2019

It would take 5–10 minutes after the problem occurred to appear as a problem, then people have to notice and respond to emails or pager text messages, dial into a conference call, and log in to monitoring dashboards before any human response can start. Try to measure your mean time to respond (MTTR) for incidents.

Latency 52

Latency Engineering Systems Hardware 52

The Netflix TechBlog

NOVEMBER 3, 2022

In that scenario, the system would need to deal with the data propagation latency directly, for example, by use of timeouts or client-originated update tracking mechanisms. We started seeing increased response latencies and leader servers running at dangerously high utilization. The query rate in this test is set to 1K requests/second.

Cache 224

Cache Latency Traffic Systems 224

Adrian Cockcroft

NOVEMBER 11, 2019

It would take 5–10 minutes after the problem occurred to appear as a problem, then people have to notice and respond to emails or pager text messages, dial into a conference call, and log in to monitoring dashboards before any human response can start. Try to measure your mean time to respond (MTTR) for incidents.

Latency 53

Latency Engineering Systems Hardware 53

The Netflix TechBlog

FEBRUARY 9, 2021

By offloading token processing from these systems to the central Edge Authentication Services, downstream systems saw significant gains in CPU, request latency, and garbage collection metrics, all of which help reduce cluster footprint and cloud costs. The following examples of these gains are from the primary API service.

Architecture 221

Architecture Latency Servers Website 221

Brendan Gregg

SEPTEMBER 5, 2017

Here's some output from my zfsdist tool, in bcc/BPF, which measures ZFS latency as a histogram on Linux: # zfsdist. Tracing ZFS operation latency. Which reminds me: I'm helping run the tracing micro conference at Plumbers this year, and I'm also speaking at Kernel Recipes, so if you manage to make it to either, I'll see you there.)

Virtualization 76

Virtualization AWS Engineering Hardware 76