The Netflix TechBlog

JUNE 4, 2019

Because microprocessors are so fast, computer architecture design has evolved towards adding various levels of caching between compute units and the main memory, in order to hide the latency of bringing the bits to the brains. We formulate the problem as a Mixed Integer Program (MIP). can we actually make this work in practice?

Cache 251

Cache Latency Airlines Logistics 251

Sutter's Mill

FEBRUARY 13, 2017

Tue-Thu Apr 25-27: High-Performance and Low-Latency C++ (Stockholm). On April 25-27, I’ll be in Stockholm (Kista) giving a three-day seminar on “High-Performance and Low-Latency C++.”

Latency 48

Latency C++ Hardware Performance 48

Brendan Gregg

FEBRUARY 28, 2023

This talk originated from my updates to [Systems Performance 2nd Edition], and this was the first time I've given this talk in person! CXL in a way allows a custom memory controller to be added to a system, to increase memory capacity, bandwidth, and overall performance. The call for participation ends on March 2nd 23:59 SGT!

Performance 110

Performance Latency Cache Virtualization 110

The Morning Paper

DECEMBER 10, 2019

. …software operating on persistent data structures requires "global" pointers that remain valid after a process terminates, while hardware requires that a diverse set of devices all have the same mappings they need for bulk transfers to and from memory, and that they be able to do so for a potentially heterogeneous memory system.

Hardware 52

Hardware Virtualization Operating System Programming 52

Scalegrid

APRIL 16, 2020

This is why our BYOC pricing is less than our Dedicated Hosting pricing, as the costs listed for BYOC are only what you pay for ScaleGrid and don’t include your hardware costs. Deploying your application and database on the same VPC also provides the lowest possible latency path. Where to host your cloud database? Expert Tip.

Cloud 242

Cloud Azure AWS Database 242

Brendan Gregg

AUGUST 18, 2019

For example, iostat(1), or a monitoring agent, may tell you your average disk latency, but not the distribution of this latency. For smaller environments, it can be of more use helping eliminate latency outliers. The probe is BEGIN , a special probe that runs at the beginning of the program (like awk). There's no filter.

Latency 68

Latency C++ Cache Programming 68

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. CLI tools The Cassandra systems were EC2 virtual machine (Xen) instances. Was there some other program consuming CPU, like a misbehaving Ubuntu service that wasn't in CentOS? Microbenchmark os::javaTimeMillis() on both systems.

Speed 126

Speed Java AWS Virtualization 126

The Morning Paper

DECEMBER 8, 2019

At the start of November I was privileged to attend HPTS (the High Performance Transaction Systems) conference in Asilomar. On the last morning of the conference Daniel Bittman presented some of the work being done in the context of the Twizzler OS project to explore new programming models for NVM. The Twizzler programming model.

Hardware 56

Hardware Programming Media Storage 56

John McCalpin

AUGUST 1, 2018

According to Dr. Bandwidth, performance analysis has two recurring themes: How fast should this code (or “simple” variations on this code) run on this hardware? MPI is a commonly used standard to implement message-passing programs on computer clusters. The MPI runtime library. in ways that are seldom transparent.

Hardware 40

Hardware Transportation Performance Latency 40

Brendan Gregg

FEBRUARY 28, 2023

This talk originated from my updates to Systems Performance 2nd Edition , and this was the first time I've given this talk in person! CXL in a way allows a custom memory controller to be added to a system, to increase memory capacity, bandwidth, and overall performance. It was a great privilege. That's about 24 hours from now!

Performance 52

Performance Latency Cache Virtualization 52

Smashing Magazine

AUGUST 3, 2021

This premise, known as graceful degradation allows a system to continue working when parts of it are dysfunctional — much like an electric bike becomes a regular bike when its battery dies. Often system failures are chalked up as “corner cases” — things that rarely happen, however, the web has many corners.

Network 145

Network Engineering Availability Monitoring 145

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. CLI tools The Cassandra systems were EC2 virtual machine (Xen) instances. Was there some other program consuming CPU, like a misbehaving Ubuntu service that wasn't in CentOS? These can be invisible to top(8).

Speed 52

Speed Java AWS Virtualization 52

Brendan Gregg

AUGUST 8, 2017

Linux load averages are "system load averages" that show the running thread (task) demand on the system as an average number of running plus waiting threads. This measures demand, which can be greater than what the system is currently processing. then your system is idle. - cat /proc/loadavg. 42/3411 43603. 42/3411 43603.

Latency 111

Latency Metrics C++ Systems 111

Alex Russell

APRIL 29, 2021

After 20 years of neck-in-neck competition, often starting from common code lineages, there just isn't that much left to wring out of the system. Consistent improvement is the name of the game, and it can still have positive impacts, particularly as users lean on the system more heavily over time. PWA App Icon Badging.

Media 145

Media Games Education Engineering 145

O'Reilly

JANUARY 16, 2024

I even contributed my own hot take last year with my O’Reilly Radar article Real-Real-World Programming with ChatGPT.) I’ve recently been brainstorming ideas for how to design such a system and how to deal with the practical challenges of scaling and maintenance. software” rather than “hardware” in our brains).

Entertainment 76

Entertainment Internet Internet Design 76

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. CLI tools The Cassandra systems were EC2 virtual machine (Xen) instances. Was there some other program consuming CPU, like a misbehaving Ubuntu service that wasn't in CentOS? Microbenchmark os::javaTimeMillis() on both systems.

Speed 40

Speed Java AWS Virtualization 40

Alex Russell

JUNE 20, 2020

3] Oh, and it should be imperatively programmed with Lisp-in-C's-clothing. Recall that browsers arose atop platforms that universally provided a host of services by the late 90's: system fonts (to support layout programs, including WYSIWYG editing). multi-tasking & concurrent programming. high-color image raster.

Hardware 55

Hardware Games Java Media 55

John McCalpin

JANUARY 22, 2018

Each of the two vector units can issue one FMA instruction per cycle, assuming that there are enough independent accumulators to tolerate the 6-cycle dependent-operation latency. This is an uninspiring fraction of peak performance that would normally suggest significant inefficiencies in either the hardware or software.

Latency 40

Latency Hardware Code Testing 40

SQL Server According to Bob

JANUARY 11, 2020

This will help you increase system performance and avoid I/O environment errors. Important When planning, deploying, and maintaining a Microsoft SQL Server installation, ensure that the I/O system supports all the factors outlined in this article. The modifications persist even in the event of a system failure.

Servers 40

Servers Cache Media Hardware 40

Sutter's Mill

JUNE 21, 2012

Now welcome to the hardware jungle. I should have remembered that describing a PC as a “heterogeneous cluster in a box” is a big red button for people, in particular because “cluster” implies “parts can fail and program should continue.” We can and do build secure reliable global banking systems on that.

Latency 40

Latency Transportation Hardware Education 40

O'Reilly Software

APRIL 4, 2018

Are there inherent time relationships in the messages that need to be preserved as they travel across the system? A message-oriented implementation requires an efficient messaging backbone that facilitates the exchange of data in a reliable and secure way with the lowest latency possible. Clean and reprocess it? At least once?

Architecture 80

Architecture Scalability Google Operating System 80

The Morning Paper

SEPTEMBER 12, 2019

If you think about a system like Procella that’s combining transactional and analytic workloads on top of a cloud-native architecture, extensions to SQL for streaming , dataflow based materialized views (see e.g. It would be a bold departure from the current imperative high-level DSL based approach to deep learning taken by TensorFlow et al.,

Network 44

Network Database Programming Hardware 44

High Scalability

SEPTEMBER 14, 2018

editingemily : "In peacetime, a ticketing system is great. Because of that big servers and other memory systems need to have another kind of memory in the hierarchy. SCM slots between DRAM and flash in terms of latency, cost, and density. noahsussman : Complex systems are intrinsically hazardous systems.

Internet 30

Internet Internet Scalability Education 30

Alex Russell

JULY 14, 2021

The predominant desktop situation is relatively straightforward: Browsers handle links, and non-browsers defer loading http and https URLs to the system, which in turn invokes the default browser. Instead, they load content referred by their hosting native app in system-provided WebViews. Hardware access APIs, notably: Geolocation.

Google 121

Google Mobile Engineering Internet 121

Alex Russell

JANUARY 30, 2024

HTML, CSS, images, and fonts can all be parsed and run at near wire speeds on low-end hardware, but JavaScript is at least three times more expensive, byte-for-byte. If you or your company are able to generate a credible worldwide latency estimate in the higher percentiles for next year's update, please get in touch.

Performance 90

Performance Network Mobile Speed 90

SQL Server According to Bob

JANUARY 11, 2020

​​ Without limiting the rights under copyright, no part of this document may be reproduced, stored in or introduced into a retrieval system, or transmitted in any form or by any means (electronic, mechanical, photocopying, recording, or otherwise), or for any purpose, without the express written permission of Microsoft Corporation.

Servers 40

Servers Cache Database Media 40

All Things Distributed

JULY 14, 2015

In this blog post, I will explain how these three new capabilities empower you to build applications with distributed systems architecture and create responsive, reliable, and high-performance applications using DynamoDB that work at any scale. DynamoDB Streams simplifies and improves this design pattern with a distributed systems approach.

Database 167

Database Lambda AWS IoT 167

All Things Distributed

NOVEMBER 15, 2010

Werner Vogels weblog on building scalable and robust distributed systems. We believe that making these GPU resources available for everyone to use at low cost will drive new innovation in the application of highly parallel programming models. All Things Distributed. By Werner Vogels on 14 November 2010 04:00 PM. Comments ().

AWS 136

AWS Latency Programming Architecture 136

All Things Distributed

DECEMBER 12, 2018

They can run applications in Sweden, serve end users across the Nordics with lower latency, and leverage advanced technologies such as containers, serverless computing, and more. In 2013, AWS launched the AWS Activate program to provide Nordic startups access to guidance and one-on-one time with AWS experts.

AWS 124

AWS Cloud Games Serverless 124

O'Reilly

JULY 20, 2021

There may be alarm systems. There have been cases of harassment, intimidation, and domestic abuse by people whose access should have been revoked: for example, an ex-partner turning off the heating system. This is why people have made a business out of setting up home stereo and video systems.

Google 123

Google Games Technology Technology 123