The Morning Paper

MAY 12, 2019

An open-source benchmark suite for microservices and their hardware-software implications for cloud & edge systems Gan et al., Microservices fundamentally change a lot of assumptions current cloud systems are designed with, and present both opportunities and challenges when optimizing for quality of service (QoS) and utilization.

Open Source 61

Open Source Hardware Benchmarking Systems 61

The Morning Paper

NOVEMBER 15, 2020

With more nodes and more coordination comes more complexity, both in design and operation. So before matching, the IDS/IPS has to reconstruct a TCP bytestream in the face of packet fragmentation, loss, and out-of-order delivery – a process known as reassembly. This makes the whole system latency sensitive.

Servers 128

Servers Hardware Latency Design 128

The Netflix TechBlog

JUNE 4, 2019

Because microprocessors are so fast, computer architecture design has evolved towards adding various levels of caching between compute units and the main memory, in order to hide the latency of bringing the bits to the brains. Its goal is to assign running processes to time slices of the CPU in a “fair” way. So why mess with it?

Cache 251

Cache Latency Airlines Logistics 251

Percona

APRIL 17, 2023

The CFQ works well for many general use cases but lacks latency guarantees. The deadline excels at latency-sensitive use cases ( like databases ), and noop is closer to no schedule at all. 25.84 - Total 21.04 zone_reclaim_mode In some OS versions, the vm.zone_reclaim_mode is enabled. 25.84 - Total 21.04

Best Practices 52

Best Practices Design Tuning Database 52

Highly Scalable

AUGUST 20, 2013

The shortcomings and drawbacks of batch-oriented data processing were widely recognized by the Big Data community quite a long time ago. It became clear that real-time query processing and in-stream processing is the immediate need in many practical applications. Fault-tolerance.

Big Data 154

Big Data Processing Lambda Database 154

Dynatrace

SEPTEMBER 30, 2021

Cloud migration is the process of transferring some or all your data, software, and operations to a cloud-based computing environment that offers unlimited scale and high availability. A key step in digital transformation is migrating from traditional on-prem IT processes to adopting cloud services. What is cloud migration?

Cloud 169

Cloud Traffic Best Practices Strategy 169

The Morning Paper

NOVEMBER 10, 2019

It’s been clear for a while that software designed explicitly for the data center environment will increasingly want/need to make different design trade-offs to e.g. general-purpose systems software that you might install on your own machines. The desire for CPU efficiency and lower latencies is easy to understand.

Network 92

Network Transportation Latency Entertainment 92

The Morning Paper

MAY 19, 2019

Last week we learned about the [increased tail-latency sensitivity of microservices based applications with high RPC fan-outs. Seer uses estimates of queue depths to mitigate latency spikes on the order of 10-100ms, in conjunction with a cluster manager. So what we have here is a glimpse of the limits for low-latency RPCs under load.

Latency 80

Latency Hardware Network Architecture 80

The Netflix TechBlog

FEBRUARY 9, 2021

Before designing a solution it’s important to understand the main product requirements for such a feature: The content needs to be new, relevant, and regional (not all countries have the same catalogue). To reduce latency, assets should be generated in an offline fashion and not in real time. First, the fields can be coded by hand.

Engineering 165

Engineering Storage Latency Entertainment 165

Brendan Gregg

FEBRUARY 28, 2023

My personal opinion is that I don't see a widespread need for more capacity given horizontal scaling and servers that can already exceed 1 Tbyte of DRAM; bandwidth is also helpful, but I'd be concerned about the increased latency for adding a hop to more memory. Ford, et al., “TCP

Performance 110

Performance Latency Cache Virtualization 110

Dynatrace

OCTOBER 1, 2021

In these modern environments, every hardware, software, and cloud infrastructure component and every container, open-source tool, and microservice generates records of every activity. An advanced observability solution can also be used to automate more processes, increasing efficiency and innovation among Ops and Apps teams.

Metrics 363

Metrics Open Source Monitoring Infrastructure 363

The Morning Paper

JANUARY 30, 2020

Edge servers are the middle ground – more compute power than a mobile device, but with latency of just a few ms. The current system assumes an application specific regression model is available on the servers which can predict processing time given the current parameters of the job (e.g. in the cloud).

Mobile 104

Mobile Cloud Latency Games 104

Percona

SEPTEMBER 1, 2023

This results in expedited query execution, reduced resource utilization, and more efficient exploitation of the available hardware resources. A finely tuned database processes queries more efficiently, leading to swifter results. MySQL relies heavily on the availability of hardware resources to perform at its best.

Tuning 52

Tuning Database Performance Hardware 52

All Things Distributed

MARCH 11, 2016

This is a given, whether you are using the highest quality hardware or lowest cost components. This becomes an even more important lesson at scale: for example, as S3 processes trillions and trillions of storage transactions, anything that has even the slightest probability of error will become realistic. Primitives not frameworks.

AWS 144

AWS Hardware Retail Virtualization 144

The Morning Paper

JANUARY 28, 2020

Shredder is " a low-latency multi-tenant cloud store that allows small units of computation to be performed directly within storage nodes. " From an operator perspective it makes it harder to follow the classic cloud-native design in which a global storage layer is separate to compute.

Serverless 99

Serverless Storage Latency Cloud 99

John McCalpin

APRIL 25, 2023

This metric is interesting because we don’t always have the luxury of parallelizing every application we run, and our operating systems almost always process each call (e.g., This post is about a secondary performance characteristic — sustained memory bandwidth for a single thread running on a single core.

Benchmarking 97

Benchmarking Cache Latency Tuning 97

The Morning Paper

MARCH 3, 2020

It takes you through the thinking processes and engineering practices behind the design of a key part of the control plane for AWS Elastic Block Storage (EBS): the Physalia database that stores configuration information. This work is latency critical, because volume IO is blocked until it is complete. NSDI’20.

Database 106

Database AWS Network Design 106

Percona

MAY 2, 2023

Let’s look at some questions I did that a MySQL DBA usually needs to answer in an interview process. Keep in mind that setting the buffer pool size too high may result in other processes on your server competing for memory, which can impact performance. Questions Q: I have a MySQL server with 500 GB of RAM; my data set is 100 GB.

Social Media 119

Social Media Database Servers Cache 119

Brendan Gregg

FEBRUARY 28, 2023

My personal opinion is that I don't see a widespread need for more capacity given horizontal scaling and servers that can already exceed 1 Tbyte of DRAM; bandwidth is also helpful, but I'd be concerned about the increased latency for adding a hop to more memory. Ford, et al., “TCP

Performance 52

Performance Latency Cache Virtualization 52

The Morning Paper

DECEMBER 10, 2019

. …software operating on persistent data structures requires "global" pointers that remain valid after a process terminates, while hardware requires that a diverse set of devices all have the same mappings they need for bulk transfers to and from memory, and that they be able to do so for a potentially heterogeneous memory system.

Hardware 52

Hardware Virtualization Operating System Programming 52

Brendan Gregg

AUGUST 18, 2019

For example, iostat(1), or a monitoring agent, may tell you your average disk latency, but not the distribution of this latency. For smaller environments, it can be of more use helping eliminate latency outliers. bpftrace uses BPF (Berkeley Packet Filter), an in-kernel execution engine that processes a virtual instruction set.

Latency 68

Latency C++ Cache Programming 68

The Morning Paper

NOVEMBER 5, 2019

Breaking that assumption allowed Ceph to introduce a new storage backend called BlueStore with much better performance and predictability, and the ability to support the changing storage hardware landscape. But let’s take a quick look at the changing hardware landscape before we go on… The changing hardware landscape.

Storage 64

Storage Systems Hardware Efficiency 64

Alex Russell

MARCH 6, 2021

Advances in browser content processing. Hardware Past As Performance Prologue. If those specs sound eerily familiar, it's perhaps because they're identical to 2016's $200USD Moto G4 , all the way down to the 2011-vintage 28nm SoC process node used to fab the chip's anemic, 2012-vintage A53 cores. Mind The Gap.

Performance 124

Performance Network Cache Metrics 124

The Morning Paper

JULY 4, 2019

This is a fascinating paper from members of Netflix’s Resilience Engineering team describing their chaos engineering initiatives: automated controlled experiments designed to verify hypotheses about how the system should behave under gray failure conditions, and to probe for and flush out any weaknesses. Safeguards.

Latency 77

Latency Engineering Metrics Traffic 77

Dotcom-Montior

DECEMBER 8, 2021

Now that we have talked about what an incident is, incident management is the process by which teams resolve these events and bring systems and services back to normal operation. ITSM defines how teams design, create, and deliver their services. ITSM is the policies, processes, and structure behind the lifecycle of IT services.

Social Media 90

Social Media Monitoring Latency DevOps 90

The Morning Paper

MAY 21, 2019

This boils down to a single digit µs latency toleration in the tail for far memory, and in addition to security and privacy concerns, rules out remote memory solutions. Thus we’re fundamentally trading (de)-compression latency at access time for the ability to pack more data in memory.

Software 78

Software Software Google Hardware 78

The Morning Paper

DECEMBER 8, 2019

Byte-addressable non-volatile memory,) NVM will fundamentally change the way hardware interacts, the way operating systems are designed, and the way applications operate on data. Therefore any programming abstraction must be low latency and the kernel needs to be kept off the path of persistent data access as much as possible.

Hardware 56

Hardware Programming Media Storage 56

O'Reilly

JANUARY 16, 2024

I’m personally interested in this topic since I am a professor who researches human-computer interaction, user experience design, and cognitive science , so AI voice interfaces are fascinating to me. I’ve recently been brainstorming ideas for how to design such a system and how to deal with the practical challenges of scaling and maintenance.

Entertainment 72

Entertainment Internet Internet Design 72

Abhishek Tiwari

JULY 12, 2018

These data pipelines can process data at petabytes scale and to some extent, their success can be attributed to an army of engineers devoted to build and maintain internal data pipelines. Depending on frameworks, data processing units (a.k.a A data pipeline is a software which runs on hardware.

Latency 63

Latency Analytics Scalability Engineering 63

Smashing Magazine

AUGUST 22, 2021

Because we are dealing with network protocols here, we will mainly look at network aspects, of which two are most important: latency and bandwidth. Latency can be roughly defined as the time it takes to send a packet from point A (say, the client) to point B (the server). Two-way latency is often called round-trip time (RTT).

Performance 106

Performance Network Latency Servers 106

HammerDB

OCTOBER 23, 2023

HammerDB has always used stored procedures as a design decision because the original benchmark was implemented as close as possible to the example workload in the TPC-C specification that uses stored procedures. If we were running over a network using the network card we would also see an increase in hardware interrupts).

Benchmarking 62

Benchmarking Database Network C++ 62

The Morning Paper

MAY 28, 2019

The goal is to produce a low-energy hardware classifier for embedded applications doing local processing of sensor data. The resulting system can integrate seamlessly into a scikit-learn based development process, and dramatically reduces the total energy usage required for classification with very low latency.

Energy 52

Energy Hardware Efficiency Architecture 52

All Things Distributed

NOVEMBER 15, 2010

From financial processing and traditional oil & gas exploration HPC applications to integrating complex 3D graphics into online and mobile applications, the applications of GPU processing appear to be limitless. For example, the most fundamental abstraction trade-off has always been latency versus throughput.

AWS 136

AWS Latency Programming Architecture 136

Smashing Magazine

AUGUST 3, 2021

This liberal attitude is known as Postel’s Law, which is conveyed superbly by Jeremy Keith in Resilient Web Design : “Even if there are errors in the HTML or CSS, the browser will still attempt to process the information, skipping over any pieces that it can’t parse.”. On design systems, CSS/JS and UX. Resilience is extrinsic.

Network 145

Network Engineering Monitoring Availability 145

Abhishek Tiwari

DECEMBER 27, 2017

In 2018, we anticipate that ETL will either lose relevance or the ETL process will disintegrate and be consumed by new data architectures. It offers reliability and performance of a data warehouse, real-time and low-latency characteristics of a streaming system, and scale and cost-efficiency of a data lake.

Big Data 49

Big Data Artificial Intelligence Storage Hardware 49

Adrian Cockcroft

NOVEMBER 11, 2019

Another problem is that a design control, intended to mitigate a failure mode, may not work as intended. Staff should be familiar with recovery processes and the behavior of the system when it’s working hard to mitigate failures. This discussion focuses on hardware, software and operational failure modes.

Latency 52

Latency Engineering Systems Hardware 52

Percona

JULY 1, 2023

Understanding DBaaS DBaaS cloud services allow users to use databases without configuring physical hardware and infrastructure or installing software. RDS also simplifies the process of automatic scaling based on workload demand, adding or subtracting replicas to efficiently distribute read requests and reduce costs during low demand.

AWS 52

AWS Database Serverless Storage 52