The Morning Paper

NOVEMBER 15, 2020

Today’s paper choice is a wonderful example of pushing the state of the art on a single server. This makes the whole system latency sensitive. Regular expression matching is well studied, but state of the art hardware algorithms don’t reach the performance and memory targets needed for Pigasus.

Servers 128

Servers Hardware Latency Design 128

The Morning Paper

MAY 21, 2019

Software-defined far memory in warehouse-scale computers Lagar-Cavilla et al., If extra provisioned capacity was needed to offset a slowdown for example then this could easily offset all potential TCO savings. Thus we’re fundamentally trading (de)-compression latency at access time for the ability to pack more data in memory.

Software 78

Software Software Google Hardware 78

Dynatrace

SEPTEMBER 30, 2021

Cloud migration is the process of transferring some or all your data, software, and operations to a cloud-based computing environment that offers unlimited scale and high availability. They need enough hardware to serve their anticipated volume and keep things running smoothly without buying too much or too little. Reduced cost.

Cloud 172

Cloud Traffic Best Practices Strategy 172

The Morning Paper

NOVEMBER 10, 2019

It’s been clear for a while that software designed explicitly for the data center environment will increasingly want/need to make different design trade-offs to e.g. general-purpose systems software that you might install on your own machines. The desire for CPU efficiency and lower latencies is easy to understand. Enter Google!

Network 92

Network Transportation Latency Entertainment 92

The Morning Paper

MAY 19, 2019

Last week we learned about the [increased tail-latency sensitivity of microservices based applications with high RPC fan-outs. Seer uses estimates of queue depths to mitigate latency spikes on the order of 10-100ms, in conjunction with a cluster manager. So what we have here is a glimpse of the limits for low-latency RPCs under load.

Latency 80

Latency Hardware Network Architecture 80

Dotcom-Montior

NOVEMBER 24, 2021

Ok, so maybe that is an oversimplified example, but you get the point. For example, you can think of a cell phone network as a type of distributed system, consisting of a network of internet-connected devices that share resources workload. Blockchain is a good example of this. Awesome, everything is running as expected.

Systems 74

Systems Monitoring Hardware Network 74

Brendan Gregg

AUGUST 18, 2019

bpftrace is a new open source tracer for Linux for analyzing production performance problems and troubleshooting software. For example, iostat(1), or a monitoring agent, may tell you your average disk latency, but not the distribution of this latency. This example instrumented one of many thousands of available events.

Latency 68

Latency C++ Cache Programming 68

Dotcom-Montior

MAY 12, 2020

Network latency. Hardware resources. Network Latency. With the evolution of cloud technologies, such as Single Page Applications (SPAs), Web APIs, and Model View Controller (MVC), network latency has become a crucial factor to be monitored. Network latency can be affected due to. Software that’s running.

Monitoring 63

Monitoring Entertainment Hardware Latency 63

Percona

JUNE 22, 2023

Let’s dive in and learn how (and what) to effectively monitor MySQL performance, along with examples from PMM, by understanding the critical KPIs to watch for. This is not an exhaustive list but an example of what we can watch for.

Performance 104

Performance Monitoring Traffic Database 104

Percona

NOVEMBER 9, 2023

If you have any experience working with database software, you have undoubtedly heard the term Kubernetes a lot. Your workloads, encapsulated in containers, can be deployed freely across different clouds or your own hardware. You may already be using it daily and find it makes running applications in the cloud much more manageable.

Efficiency 103

Efficiency Cloud Healthcare Open Source 103

HammerDB

OCTOBER 18, 2019

cpupower frequency-info analyzing CPU 0: driver: intel_pstate CPUs which run at the same hardware frequency: 0 CPUs which need to have their frequency coordinated by software: 0 maximum transition latency: Cannot determine or is not supported. hardware limits: 1000 MHz - 4.00 hardware limits: 1000 MHz - 4.00

Benchmarking 63

Benchmarking Performance Hardware C++ 63

Percona

SEPTEMBER 1, 2023

This results in expedited query execution, reduced resource utilization, and more efficient exploitation of the available hardware resources. This reduction in latency ensures that applications and websites provide a more rapid and responsive user experience. What are the common performance issues in MySQL databases?

Tuning 52

Tuning Database Performance Hardware 52

Dotcom-Montior

OCTOBER 6, 2021

A site reliability engineer, or SRE, is a role that that encompasses aspects of both software engineering and operations/infrastructure. At that time, the team was made up of software engineers. Site reliability engineers bridge the gap between operations and software developers. What Does a Site Reliability Engineer Do?

Engineering 67

Engineering DevOps Monitoring Google 67

The Morning Paper

APRIL 14, 2019

The paper sets out what we can do in software given today’s hardware, and along the way also highlights areas where cooperation from hardware will be needed in the future. Even when we do flush caches, the latency of flushing can itself be used as a channel! Microarchitectural channels. Threat scenarios.

Hardware 44

Hardware Cache Latency Speed 44

John McCalpin

AUGUST 1, 2018

According to Dr. Bandwidth, performance analysis has two recurring themes: How fast should this code (or “simple” variations on this code) run on this hardware? The user environment defines the mapping of MPI ranks to hardware resources (cores, sockets, nodes). The MPI runtime library. in ways that are seldom transparent.

Hardware 40

Hardware Transportation Performance Latency 40

HammerDB

OCTOBER 23, 2023

HammerDB has always used stored procedures as a design decision because the original benchmark was implemented as close as possible to the example workload in the TPC-C specification that uses stored procedures. As an example from the TPC-C specification, this is the Stock Level procedure. On MySQL, we saw a 1.5X performance advantage.

Benchmarking 62

Benchmarking Database Network C++ 62

cdemi

FEBRUARY 20, 2017

Let's talk about the elephant in the room; Serverless doesn't really mean that there are no Software or Hardware servers. It just means that from Software Development perspective, servers are abstracted and outsourced to another entity, so you don't need to worry about it. In fact, the 12 Factor App has this same recommendation.

Serverless 64

Serverless Architecture Lambda Azure 64

The Morning Paper

MARCH 3, 2020

The core algorithms (chain-replication, Paxos-based consensus) aren’t the stars of the show here, instead the paper focuses on how these algorithms are deployed, and the software engineering practices behind the creation of a mission-critical production system employing them. Larger cells have better tolerance of tail latency (e.g.

Database 106

Database AWS Network Design 106

The Morning Paper

NOVEMBER 5, 2019

It’s also a fabulous example of recognising and challenging implicit assumptions. Breaking that assumption allowed Ceph to introduce a new storage backend called BlueStore with much better performance and predictability, and the ability to support the changing storage hardware landscape. Supporting new storage hardware.

Storage 64

Storage Systems Hardware Efficiency 64

The Morning Paper

JULY 4, 2019

degraded hardware, transient networking problem) or, more often, because of some change deployed by Netflix engineers that did not have the intended effect. Two failure modes we focus on are a service becoming slower (increase in response latency) or a service failing outright (returning errors).

Latency 77

Latency Engineering Metrics Traffic 77

Abhishek Tiwari

JULY 12, 2018

Data Pipeline A data pipeline is a software that ingests data from multiple sources, transforms it and finally makes it available to internal or external products. A data pipeline is a software which runs on hardware. The software is error-prone and hardware failures are inevitable.

Latency 63

Latency Analytics Scalability Engineering 63

The Morning Paper

DECEMBER 8, 2019

Byte-addressable non-volatile memory,) NVM will fundamentally change the way hardware interacts, the way operating systems are designed, and the way applications operate on data. Therefore any programming abstraction must be low latency and the kernel needs to be kept off the path of persistent data access as much as possible.

Hardware 56

Hardware Programming Media Storage 56

The Morning Paper

MAY 14, 2019

Last time around we looked at the DeathStarBench suite of microservices-based benchmark applications and learned that microservices systems can be especially latency sensitive, and that hotspots can propagate through a microservices architecture in interesting ways. on end-to-end latency) and less than 0.15% on throughput.

Big Data 45

Big Data Cloud Performance Hardware 45

Brendan Gregg

AUGUST 8, 2017

For example, an hourly load average of 10 would mean that (for a single CPU system) at any time during that hour one could expect to see 1 process running and 9 others ready to run (i.e., I generated this using my offcputime tool from [bcc] (this tool needs eBPF features from Linux 4.8+), and my [flame graph] software: #./bcc/tools/offcputime.py

Latency 111

Latency Metrics C++ Systems 111

Dotcom-Montior

DECEMBER 8, 2021

Software services still require physical devices and hardware for them to function. Knowing when and where an error, downtime, or application latency occurs is a critical factor in limiting the impact to users and customers. For example, if the incident is related to an outage, that would automatically fall into high priority.

Social Media 90

Social Media Monitoring Latency DevOps 90

HammerDB

OCTOBER 8, 2018

As an Intel employee (#IAMINTEL) the examples are taken from a PostgreSQL on Linux on Intel system, the approach is the same for whatever system you are testing although some of the settings you see may be different. CPUs which run at the same hardware frequency: 0. CPUs which need to have their frequency coordinated by software: 0.

Best Practices 40

Best Practices Scalability Performance Hardware 40

John McCalpin

JANUARY 22, 2018

Introduction: In December 2017, my colleague Damon McDougall (now at AMD) asked for help in porting the fused multiply-add example code from a Colfax report ( [link] ) to the Xeon Phi x200 (Knights Landing) processors here at TACC. A peculiar throughput limitation on Intel’s Xeon Phi x200 (Knights Landing).

Latency 40

Latency Hardware Code Testing 40

All Things Distributed

JANUARY 23, 2012

VM Import allows our customers to move virtual machine images from their datacenters to the Cloud and Amazon Direct Connect makes the network latencies and bandwidth between on-premises and AWS more predictable. The AWS Storage Gateway is a service connecting an on-premises software appliance with cloud-based storage.

Storage 115

Storage AWS Virtualization Cloud 115

SQL Server According to Bob

JANUARY 11, 2020

Many high-end disk subsystems provide high-speed cache facilities to reduce the latency of read and write operations. The following are examples of successful recovery situations actually encountered by Microsoft SQL Server Product Support Services personnel. This cache is often supported by a battery-powered backup facility.

Servers 40

Servers Cache Media Hardware 40

Adrian Cockcroft

NOVEMBER 11, 2019

In the same way that we have moved from a few big software releases a year to continuous delivery of many small changes, we need to move from annual disaster recover tests or suffering when things actually break, to continuously tested resilience. This discussion focuses on hardware, software and operational failure modes.

Latency 52

Latency Engineering Systems Hardware 52

Alex Russell

JANUARY 30, 2024

HTML, CSS, images, and fonts can all be parsed and run at near wire speeds on low-end hardware, but JavaScript is at least three times more expensive, byte-for-byte. Representative examples from that time period include the Samsung Galaxy A51 and the Pixel 4a. But that's not the whole story! 2:1] The A51 featured eight slow cores (4x2.3

Performance 90

Performance Network Mobile Speed 90

Alex Russell

APRIL 29, 2021

For heavily latency-sensitive use-cases like WebXR, this is a critical component in delivering a good experience. A tool for reliably sending data — for example, chat and email messages — in the face of intermittent network connections. is access to hardware devices. Offscreen Canvas. TextEncoderStream & TextDecoderStream.

Media 145

Media Games Education Engineering 145

Adrian Cockcroft

NOVEMBER 11, 2019

In the same way that we have moved from a few big software releases a year to continuous delivery of many small changes, we need to move from annual disaster recover tests or suffering when things actually break, to continuously tested resilience. This discussion focuses on hardware, software and operational failure modes.

Latency 53

Latency Engineering Systems Hardware 53

Percona

APRIL 17, 2023

The CFQ works well for many general use cases but lacks latency guarantees. The deadline excels at latency-sensitive use cases ( like databases ), and noop is closer to no schedule at all. For example, on a 128GB memory host, this can allow up to 38.4GB of dirty pages. Two other schedulers are deadline and noop.

Best Practices 52

Best Practices Design Tuning Database 52

O'Reilly

JANUARY 16, 2024

For a concrete example of what such a personalized podcast felt like, I started one conversation by straight-up asking ChatGPT to keep me awake while I was driving in Southern California from Los Angeles to San Diego. software” rather than “hardware” in our brains). If you don’t believe me, just try it for an hour.

Entertainment 72

Entertainment Internet Internet Design 72

O'Reilly Software

APRIL 4, 2018

Here are five considerations every software architect and developer needs to take into account when setting the architectural foundations for a fast data platform. For example, we can combine a machine learning job for anomaly detection with a dashboard that summarizes the findings to facilitate further investigation.

Architecture 80

Architecture Scalability Google Operating System 80

All Things Distributed

JULY 13, 2010

During my academic career, I spent many years working on HPC technologies such as user-level networking interfaces, large scale high-speed interconnects, HPC software stacks, etc. When instances are placed in a cluster they have access to low latency, non-blocking 10 Gbps networking when communicating the other instances in the cluster.

Cloud 118

Cloud AWS Automotive Latency 118