Percona

APRIL 17, 2023

The CFQ works well for many general use cases but lacks latency guarantees. The deadline excels at latency-sensitive use cases ( like databases ), and noop is closer to no schedule at all. For example, on a 128GB memory host, this can allow up to 38.4GB of dirty pages. Two other schedulers are deadline and noop.

Best Practices 52

Best Practices Design Tuning Database 52

The Morning Paper

NOVEMBER 15, 2020

With more nodes and more coordination comes more complexity, both in design and operation. Today’s paper choice is a wonderful example of pushing the state of the art on a single server. Today’s paper choice is a wonderful example of pushing the state of the art on a single server. This makes the whole system latency sensitive.

Servers 128

Servers Hardware Latency Design 128

The Netflix TechBlog

AUGUST 30, 2021

Complementing the hardware is the software on the RAE and in the cloud, and bridging the software on both ends is a bi-directional control plane. For example, when running tests, the state of the device will change from “available for testing” to “in test.” In this blog post, we will focus on the latter feature set.

Latency 213

Latency Traffic Transportation Hardware 213

The Netflix TechBlog

FEBRUARY 9, 2021

Before designing a solution it’s important to understand the main product requirements for such a feature: The content needs to be new, relevant, and regional (not all countries have the same catalogue). To reduce latency, assets should be generated in an offline fashion and not in real time.

Engineering 165

Engineering Storage Latency Entertainment 165

The Morning Paper

NOVEMBER 10, 2019

It’s been clear for a while that software designed explicitly for the data center environment will increasingly want/need to make different design trade-offs to e.g. general-purpose systems software that you might install on your own machines. The desire for CPU efficiency and lower latencies is easy to understand.

Network 92

Network Transportation Latency Entertainment 92

Dynatrace

SEPTEMBER 30, 2021

It requires purchasing, powering, and configuring physical hardware, training and retaining the staff capable of servicing and securing the machines, operating a data center, and so on. They need enough hardware to serve their anticipated volume and keep things running smoothly without buying too much or too little. Reduced cost.

Cloud 169

Cloud Traffic Best Practices Strategy 169

The Morning Paper

MAY 19, 2019

Last week we learned about the [increased tail-latency sensitivity of microservices based applications with high RPC fan-outs. Seer uses estimates of queue depths to mitigate latency spikes on the order of 10-100ms, in conjunction with a cluster manager. So what we have here is a glimpse of the limits for low-latency RPCs under load.

Latency 80

Latency Hardware Network Architecture 80

The Morning Paper

JANUARY 30, 2020

Edge servers are the middle ground – more compute power than a mobile device, but with latency of just a few ms. The kind of edge server envisaged here might, for example, be integrated with your WiFi access point. One example from the paper is an application using the ammo.js Why would we want to live migrate web workers?

Mobile 104

Mobile Cloud Latency Games 104

All Things Distributed

MARCH 11, 2016

This is a given, whether you are using the highest quality hardware or lowest cost components. This becomes an even more important lesson at scale: for example, as S3 processes trillions and trillions of storage transactions, anything that has even the slightest probability of error will become realistic. Primitives not frameworks.

AWS 144

AWS Hardware Retail Virtualization 144

The Morning Paper

JUNE 13, 2019

As we saw with the SOAP paper last time out, even with a fixed model variant and hardware there are a lot of different ways to map a training workload over the available hardware. The following figure highlights how just one of these variables, batch size, impacts throughput and latency on ResNet50.

Hardware 58

Hardware Latency Serverless Energy 58

The Morning Paper

JANUARY 28, 2020

Shredder is " a low-latency multi-tenant cloud store that allows small units of computation to be performed directly within storage nodes. " From an operator perspective it makes it harder to follow the classic cloud-native design in which a global storage layer is separate to compute.

Serverless 99

Serverless Storage Latency Cloud 99

Percona

SEPTEMBER 1, 2023

This results in expedited query execution, reduced resource utilization, and more efficient exploitation of the available hardware resources. This reduction in latency ensures that applications and websites provide a more rapid and responsive user experience. Regularly optimizing query structures is vital.

Tuning 52

Tuning Database Performance Hardware 52

Brendan Gregg

AUGUST 18, 2019

For example, iostat(1), or a monitoring agent, may tell you your average disk latency, but not the distribution of this latency. This example instrumented one of many thousands of available events. For smaller environments, it can be of more use helping eliminate latency outliers. Block I/O latency as a histogram.

Latency 68

Latency C++ Cache Programming 68

The Morning Paper

MARCH 17, 2020

higher latency and lower bandwidth)… We have found the actual behavior of Optane DIMMs to be more complicated and nuanced than the "slower, persistent DRAM" label would suggest. The read latency for Optane is 2x-3x higher than DRAM. Optane DIMMs are here! Optane memory is also more pattern-dependent than DRAM.

Scalability 59

Scalability Latency Cache Media 59

The Morning Paper

NOVEMBER 5, 2019

It’s also a fabulous example of recognising and challenging implicit assumptions. Breaking that assumption allowed Ceph to introduce a new storage backend called BlueStore with much better performance and predictability, and the ability to support the changing storage hardware landscape. Supporting new storage hardware.

Storage 64

Storage Systems Hardware Efficiency 64

The Morning Paper

MARCH 3, 2020

It takes you through the thinking processes and engineering practices behind the design of a key part of the control plane for AWS Elastic Block Storage (EBS): the Physalia database that stores configuration information. This work is latency critical, because volume IO is blocked until it is complete. NSDI’20. Requirements.

Database 106

Database AWS Network Design 106

John McCalpin

AUGUST 1, 2018

According to Dr. Bandwidth, performance analysis has two recurring themes: How fast should this code (or “simple” variations on this code) run on this hardware? The user environment defines the mapping of MPI ranks to hardware resources (cores, sockets, nodes). The MPI runtime library. in ways that are seldom transparent.

Hardware 40

Hardware Transportation Performance Latency 40

HammerDB

OCTOBER 23, 2023

HammerDB has always used stored procedures as a design decision because the original benchmark was implemented as close as possible to the example workload in the TPC-C specification that uses stored procedures. As an example from the TPC-C specification, this is the Stock Level procedure. On MySQL, we saw a 1.5X

Benchmarking 62

Benchmarking Database Network C++ 62

The Morning Paper

JULY 4, 2019

This is a fascinating paper from members of Netflix’s Resilience Engineering team describing their chaos engineering initiatives: automated controlled experiments designed to verify hypotheses about how the system should behave under gray failure conditions, and to probe for and flush out any weaknesses. Safeguards.

Latency 77

Latency Engineering Metrics Traffic 77

Smashing Magazine

AUGUST 22, 2021

Because we are dealing with network protocols here, we will mainly look at network aspects, of which two are most important: latency and bandwidth. Latency can be roughly defined as the time it takes to send a packet from point A (say, the client) to point B (the server). Two-way latency is often called round-trip time (RTT).

Performance 106

Performance Network Latency Servers 106

All Things Distributed

JULY 20, 2015

To be robust and scalable, this key/value store needs to be distributed for durability and availability, to protect against network partitions or hardware failures. This architecture affords Amazon ECS high availability, low latency, and high throughput because the data store is never pessimistically locked.

Latency 166

Latency Architecture AWS Open Source 166

Smashing Magazine

AUGUST 3, 2021

This liberal attitude is known as Postel’s Law, which is conveyed superbly by Jeremy Keith in Resilient Web Design : “Even if there are errors in the HTML or CSS, the browser will still attempt to process the information, skipping over any pieces that it can’t parse.”. On design systems, CSS/JS and UX. JavaScript is less forgiving.

Network 145

Network Engineering Monitoring Availability 145

All Things Distributed

JULY 14, 2015

In traditional database architectures, database engines often run a small search engine or data warehouse engines on the same hardware as the database. DynamoDB Streams simplifies and improves this design pattern with a distributed systems approach. DynamoDB Cross-region Replication.

Database 167

Database Lambda AWS IoT 167

The Morning Paper

MAY 14, 2019

Last time around we looked at the DeathStarBench suite of microservices-based benchmark applications and learned that microservices systems can be especially latency sensitive, and that hotspots can propagate through a microservices architecture in interesting ways. on end-to-end latency) and less than 0.15% on throughput.

Big Data 45

Big Data Cloud Performance Hardware 45

The Morning Paper

DECEMBER 8, 2019

Byte-addressable non-volatile memory,) NVM will fundamentally change the way hardware interacts, the way operating systems are designed, and the way applications operate on data. Therefore any programming abstraction must be low latency and the kernel needs to be kept off the path of persistent data access as much as possible.

Hardware 56

Hardware Programming Media Storage 56

The Morning Paper

MAY 21, 2019

If extra provisioned capacity was needed to offset a slowdown for example then this could easily offset all potential TCO savings. This boils down to a single digit µs latency toleration in the tail for far memory, and in addition to security and privacy concerns, rules out remote memory solutions.

Software 78

Software Software Google Hardware 78

The Morning Paper

MAY 28, 2019

The goal is to produce a low-energy hardware classifier for embedded applications doing local processing of sensor data. The resulting system can integrate seamlessly into a scikit-learn based development process, and dramatically reduces the total energy usage required for classification with very low latency. Introducing race logic.

Energy 52

Energy Hardware Efficiency Architecture 52

All Things Distributed

JANUARY 18, 2012

a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Today is a very exciting day as we release Amazon DynamoDB , a fast, highly reliable and cost-effective NoSQL database service designed for internet scale applications. Amazon DynamoDB offers low, predictable latencies at any scale. Comments ().

Scalability 167

Scalability Database Ecommerce Latency 167

Alex Russell

MARCH 6, 2021

The Moto G4 , for example. Hardware Past As Performance Prologue. Regardless, the overall story for hardware progress remains grim, particularly when we recall how long device replacement cycles are: Tap for a larger version. But the hardware future is not evenly distributed, and web workloads aren't heavily parallel.

Performance 124

Performance Network Cache Metrics 124

O'Reilly

JANUARY 16, 2024

I’m personally interested in this topic since I am a professor who researches human-computer interaction, user experience design, and cognitive science , so AI voice interfaces are fascinating to me. I’ve recently been brainstorming ideas for how to design such a system and how to deal with the practical challenges of scaling and maintenance.

Entertainment 72

Entertainment Internet Internet Design 72

Testsigma

JANUARY 30, 2021

The applications are designed using the same code base as Desktop like HTML, Javascript, and CSS. Unlike Native Applications, Mobile web applications do not have to be designed separately for IOS and Android. Example of such apps: We all are aware of how online shopping has taken over the world. What are Native Applications?

Mobile 52

Mobile Testing Website Internet 52

Abhishek Tiwari

JULY 12, 2018

Here are 8 fallacies of data pipeline The pipeline is reliable Topology is stateless Pipeline is infinitely scalable Processing latency is minimum Everything is observable There is no domino effect Pipeline is cost­-effective Data is homogeneous The pipeline is reliable The inconvenient truth is that pipeline is not reliable.

Latency 63

Latency Analytics Scalability Engineering 63

Dotcom-Montior

DECEMBER 8, 2021

ITSM defines how teams design, create, and deliver their services. Software services still require physical devices and hardware for them to function. Knowing when and where an error, downtime, or application latency occurs is a critical factor in limiting the impact to users and customers. It is much more than just IT support.

Social Media 90

Social Media Monitoring Latency DevOps 90

All Things Distributed

NOVEMBER 15, 2010

For example, the most fundamental abstraction trade-off has always been latency versus throughput. These trade-offs have even impacted the way the lowest level building blocks in our computer architectures have been designed. The throughput of this pipeline is more important than the latency of the individual operations.

AWS 136

AWS Latency Programming Architecture 136

O'Reilly

JULY 20, 2021

Examples include popular home assistants and smart displays like the Amazon Echo, Google Home, Apple HomePod, and many others. But we, as technologists, have typically ignored our own expectations when designing and building those devices. Communal devices are intended to be used by groups of people in homes and offices.

Google 121

Google Games Technology Technology 121

SQL Server According to Bob

JANUARY 11, 2020

Many high-end disk subsystems provide high-speed cache facilities to reduce the latency of read and write operations. The following are examples of successful recovery situations actually encountered by Microsoft SQL Server Product Support Services personnel. This cache is often supported by a battery-powered backup facility.

Servers 40

Servers Cache Media Hardware 40

John McCalpin

JANUARY 22, 2018

Introduction: In December 2017, my colleague Damon McDougall (now at AMD) asked for help in porting the fused multiply-add example code from a Colfax report ( [link] ) to the Xeon Phi x200 (Knights Landing) processors here at TACC. A peculiar throughput limitation on Intel’s Xeon Phi x200 (Knights Landing). cmpl $1000000000, %eax.

Latency 40

Latency Hardware Code Testing 40