All Things Distributed

OCTOBER 25, 2013

In the back to basics readings this week I am re-reading a paper from 1995 about the work that I did together with Thorsten on solving the problem of end-to-end low-latency communication on high-speed networks. The lack of low-latency made that distributed systems (e.g.

Network 99

Network Latency Operating System Speed 99

Adrian Cockcroft

APRIL 5, 2023

This proposal seeks to define a standard for real-time carbon and energy data as time-series data that would be accessed alongside and synchronized with the existing throughput, utilization and latency metrics that are provided for the components and applications in computing environments.

Energy 52

Energy Metrics Cloud Operating System 52

SQL Performance

FEBRUARY 26, 2020

Organizations are taking advantage of having managed backups, lots of built-in security features, an uptime SLA of 99.99%, and an always up-to-date environment where they are no longer responsible for patching SQL Server or the operating system. One size does not always fit all. Managed Instance provides two tiers for performance.

Azure 63

Azure Performance Storage Latency 63

Smashing Magazine

OCTOBER 31, 2023

You might think of it like racing a car in virtual reality, where the conditions are decided in advance, rather than racing on a live track where conditions may vary. If throttling is applied at the operating system level , then the metrics match what a real user with those network conditions would experience.

Speed 97

Speed Google Website Metrics 97

Percona

APRIL 17, 2023

In this blog post, we will discuss the best practices on the MongoDB ecosystem applied at the Operating System (OS) and MongoDB levels. Operating System (OS) settings Swappiness Swappiness is a Linux kernel setting that influences the behavior of the Virtual Memory manager when it needs to allocate a swap, ranging from 0-100.

Best Practices 52

Best Practices Design Tuning Database 52

HammerDB

MAY 5, 2019

However in the Skylake microarchitecture (you can see a list of CPUs here ) the PAUSE instruction changed and in the documentation it says “the latency of the PAUSE instruction in prior generation microarchitectures is about 10 cycles, whereas in Skylake microarchitecture it has been extended to as many as 140 cycles.”

Testing 48

Testing Tuning Latency Storage 48

The Morning Paper

DECEMBER 8, 2019

Byte-addressable non-volatile memory,) NVM will fundamentally change the way hardware interacts, the way operating systems are designed, and the way applications operate on data. This means that the overheads of system calls become much more noticeable. in front of that memory , as we saw last week).

Hardware 56

Hardware Programming Media Storage 56

Dotcom-Montior

NOVEMBER 24, 2021

This complexity is “hidden” to the end user, like how an API (Application Programming Interface) operates, whether that is an actual user or another computer. These systems can include physical servers, containers, virtual machines, or even a device, or node, that connects and communicates with the network. Heterogeneity.

Systems 74

Systems Monitoring Hardware Network 74

Adrian Cockcroft

NOVEMBER 18, 2019

AWS Developer Relations on how the shift from Robot Operating System (ROS) 1 to ROS 2 will change the landscape for all robot lovers. OPN304 Learnings from migrating a service from JDK 8 to JDK 11 AWS Lambda improved latency by migrating to JDK 11 with Amazon Corretto.

Open Source 40

Open Source AWS Lambda Serverless 40

Adrian Cockcroft

NOVEMBER 18, 2019

AWS Developer Relations on how the shift from Robot Operating System (ROS) 1 to ROS 2 will change the landscape for all robot lovers. OPN304 Learnings from migrating a service from JDK 8 to JDK 11 AWS Lambda improved latency by migrating to JDK 11 with Amazon Corretto.

Open Source 40

Open Source AWS Lambda Serverless 40

The Morning Paper

JUNE 30, 2019

In such a situation I’d expect to see unusually high latencies, but normal throughput). I was only partially right (there is a steady-state queue involved)… Plus, although it’s not described, the performance degradation observed in this case would almost certainly be poor latency and poor throughput. Hence convoys will occur.

Traffic 75

Traffic Latency Programming Scalability 75

Brendan Gregg

AUGUST 8, 2017

Nowadays, the source code to old operating systems can also be found online. For everyone familiar with other operating systems and their CPU load averages, including this state is at first deeply confusing. **Why?** avg-cpu: %user %nice %system %iowait %steal %idle 0.54 One system with a ratio of 1.5

Latency 111

Latency Metrics C++ Systems 111

O'Reilly

DECEMBER 2, 2019

I don’t need more bandwidth for video conferences or movies, but I would like to be able to download operating system updates and other large items in seconds rather than minutes. There are impressive estimates for latency for 5G, but reality has a tendency to be harsh on such predictions.

Wireless 53

Wireless Serverless IoT Artificial Intelligence 53

The Morning Paper

APRIL 14, 2019

A covert cache-based channel (for example) can be built by the sender modulating its footprint in the cache through its execution, and the receiver probing this footprint by systematically touching cache lines and measuring memory latency and by observing its own execution speed. virtually-addressed state must be flushed.

Hardware 44

Hardware Cache Latency Speed 44

The Netflix TechBlog

SEPTEMBER 24, 2021

Uploading and downloading data always come with a penalty, namely latency. Virtual Assembly Figure 3 describes how a virtual assembly of the encoded chunks replaces the physical assembly used in our previous architecture. Any single read or write operation may involve a mix of previously uploaded and yet-to-be uploaded bytes.

Cloud 237

Cloud Media Storage Cache 237

SQL Server According to Bob

JANUARY 11, 2020

Subsystem / Path The ​​ I/O subsystem or path ​​ includes ​​ those ​​ components ​​ that are ​​ used to support an I/O operation. ​​ Also, it ​​ is ​​ generally impractical on a production system.

Servers 40

Servers Cache Database Media 40

SQL Server According to Bob

JANUARY 11, 2020

Many high-end disk subsystems provide high-speed cache facilities to reduce the latency of read and write operations. SQL Server always checks I/O completion status for any operating system error conditions and proper data transfer size and then handles errors appropriately.

Servers 40

Servers Cache Media Hardware 40

ScaleOut Software

MAY 15, 2014

Likewise, object access paths must be heavily multi-threaded and avoid lock contention to minimize access latency and maximize throughput. These are areas in which we have invested heavily to take advantage of 10 Gbps (and faster) networks and to handle intermittent network delays inherent in virtual server infrastructures.

Cache 40

Cache Servers Network Design 40

All Things Distributed

MARCH 11, 2016

Failures are a given and everything will eventually fail over time: from routers to hard disks, from operating systems to memory units corrupting TCP packets, from transient errors to permanent failures. Developing a NIC that supported single root IO virtualization allowed us to give each VM its own hardware virtualized NIC.

AWS 147

AWS Hardware Retail Virtualization 147

All Things Distributed

OCTOBER 2, 2017

The success of our early results with the Dynamo database encouraged us to write Amazon's Dynamo whitepaper and share it at the 2007 ACM Symposium on Operating Systems Principles (SOSP conference), so that others in the industry could benefit. This was the genesis of the Amazon Dynamo database.

Internet 130

Internet Internet AWS Performance 130