The Morning Paper

NOVEMBER 15, 2020

With more nodes and more coordination comes more complexity, both in design and operation. This makes the whole system latency sensitive. One of the joys of this paper is that you don’t just get to see the final design, you also get insight into the forces and trade-offs that led to it. Back of the envelope.

Servers 128

Servers Hardware Latency Design 128

The Netflix TechBlog

JUNE 4, 2019

Because microprocessors are so fast, computer architecture design has evolved towards adding various levels of caching between compute units and the main memory, in order to hide the latency of bringing the bits to the brains. This avoids thrashing caches too much for B and evens out the pressure on the L3 caches of the machine.

Cache 251

Cache Latency Airlines Logistics 251

Dynatrace

OCTOBER 1, 2021

As dynamic systems architectures increase in complexity and scale, IT teams face mounting pressure to track and respond to conditions and issues across their multi-cloud environments. The architects and developers who create the software must design it to be observed. Dynatrace news. Benefits of observability.

Metrics 363

Metrics Open Source Monitoring Infrastructure 363

Percona

APRIL 17, 2023

The swap issue is explained in the excellent article by Jeremy Cole at the Swap Insanity and NUMA Architecture. The CFQ works well for many general use cases but lacks latency guarantees. The deadline excels at latency-sensitive use cases ( like databases ), and noop is closer to no schedule at all.

Best Practices 52

Best Practices Design Tuning Database 52

The Morning Paper

MAY 19, 2019

Last week we learned about the [increased tail-latency sensitivity of microservices based applications with high RPC fan-outs. Seer uses estimates of queue depths to mitigate latency spikes on the order of 10-100ms, in conjunction with a cluster manager. So what we have here is a glimpse of the limits for low-latency RPCs under load.

Latency 80

Latency Hardware Network Architecture 80

The Morning Paper

NOVEMBER 10, 2019

It’s been clear for a while that software designed explicitly for the data center environment will increasingly want/need to make different design trade-offs to e.g. general-purpose systems software that you might install on your own machines. The desire for CPU efficiency and lower latencies is easy to understand.

Network 92

Network Transportation Latency Entertainment 92

Brendan Gregg

FEBRUARY 28, 2023

My personal opinion is that I don't see a widespread need for more capacity given horizontal scaling and servers that can already exceed 1 Tbyte of DRAM; bandwidth is also helpful, but I'd be concerned about the increased latency for adding a hop to more memory. Ford, et al., “TCP

Performance 110

Performance Latency Cache Virtualization 110

Dynatrace

SEPTEMBER 30, 2021

It requires purchasing, powering, and configuring physical hardware, training and retaining the staff capable of servicing and securing the machines, operating a data center, and so on. They need enough hardware to serve their anticipated volume and keep things running smoothly without buying too much or too little. Reduced cost.

Cloud 167

Cloud Traffic Best Practices Strategy 167

The Morning Paper

JUNE 13, 2019

As we saw with the SOAP paper last time out, even with a fixed model variant and hardware there are a lot of different ways to map a training workload over the available hardware. The following figure highlights how just one of these variables, batch size, impacts throughput and latency on ResNet50.

Hardware 58

Hardware Latency Serverless Energy 58

SQL Performance

APRIL 27, 2020

Gen 5 is the primary hardware option now for most regions since Gen 4 is aging out. I highly recommend that you take a look at the diagram that breaks down the architecture and how it all works in this article. New Hardware Configuration for Provisioned Compute Tier. GB per vCore. Serverless Database.

Azure 55

Azure Database Serverless Hardware 55

Brendan Gregg

FEBRUARY 28, 2023

My personal opinion is that I don't see a widespread need for more capacity given horizontal scaling and servers that can already exceed 1 Tbyte of DRAM; bandwidth is also helpful, but I'd be concerned about the increased latency for adding a hop to more memory. Ford, et al., “TCP

Performance 52

Performance Latency Cache Virtualization 52

John McCalpin

AUGUST 1, 2018

According to Dr. Bandwidth, performance analysis has two recurring themes: How fast should this code (or “simple” variations on this code) run on this hardware? The user environment defines the mapping of MPI ranks to hardware resources (cores, sockets, nodes). The MPI runtime library. in ways that are seldom transparent.

Hardware 40

Hardware Transportation Performance Latency 40

VoltDB

JUNE 1, 2017

Hardware Optimizers” want to get the maximum utilization out of hardware. These systems were designed to have a lifetime of half a decade or more, and rapidly changing hardware meant that the initial deployment had to be sized for 5-7 years out. Latency Optimizers” – need support for very large federated deployments.

Hardware 56

Hardware Latency Virtualization Cloud 56

John McCalpin

APRIL 25, 2023

To understand what is happening here, we need to understand the way memory bandwidth interacts with memory latency and the concurrency (parallelism) of memory accesses. That is the topic of the next blog entry. (“Real Soon Now”) Can this problem be fixed?

Benchmarking 97

Benchmarking Cache Latency Tuning 97

The Morning Paper

MAY 14, 2019

Last time around we looked at the DeathStarBench suite of microservices-based benchmark applications and learned that microservices systems can be especially latency sensitive, and that hotspots can propagate through a microservices architecture in interesting ways. on end-to-end latency) and less than 0.15% on throughput.

Big Data 45

Big Data Cloud Performance Hardware 45

Alex Russell

MARCH 6, 2021

Hardware Past As Performance Prologue. Regardless, the overall story for hardware progress remains grim, particularly when we recall how long device replacement cycles are: Tap for a larger version. Chip design choices and silicon economics are the defining feature of the still-growing Performance Inequality Gap. Mind The Gap.

Performance 124

Performance Network Cache Metrics 124

VoltDB

JUNE 1, 2017

Hardware Optimizers” want to get the maximum utilization out of hardware. These systems were designed to have a lifetime of half a decade or more, and rapidly changing hardware meant that the initial deployment had to be sized for 5-7 years out. Latency Optimizers” – need support for very large federated deployments.

Hardware 40

Hardware Latency Virtualization Cloud 40

The Morning Paper

MAY 28, 2019

The goal is to produce a low-energy hardware classifier for embedded applications doing local processing of sensor data. The resulting system can integrate seamlessly into a scikit-learn based development process, and dramatically reduces the total energy usage required for classification with very low latency. Introducing race logic.

Energy 52

Energy Hardware Efficiency Architecture 52

SQL Server According to Bob

SEPTEMBER 26, 2016

When we released Always On Availability Groups in SQL Server 2012 as a new and powerful way to achieve high availability, hardware environments included NUMA machines with low-end multi-core processors and SATA and SAN drives for storage (some SSDs). As we moved towards SQL Server 2014, the pace of hardware accelerated.

Availability 40

Availability Servers Hardware Benchmarking 40

Percona

JULY 1, 2023

Understanding DBaaS DBaaS cloud services allow users to use databases without configuring physical hardware and infrastructure or installing software. This eliminates the need for complex or scripted backup procedures and designated backup windows. Considering a Fully Managed DBaaS Offering For Your Business?

AWS 52

AWS Database Serverless Storage 52

Abhishek Tiwari

JULY 12, 2018

Here are 8 fallacies of data pipeline The pipeline is reliable Topology is stateless Pipeline is infinitely scalable Processing latency is minimum Everything is observable There is no domino effect Pipeline is cost­-effective Data is homogeneous The pipeline is reliable The inconvenient truth is that pipeline is not reliable.

Latency 63

Latency Analytics Scalability Engineering 63

All Things Distributed

JULY 13, 2010

Cluster Computer Instances for Amazon EC2 are a new instance type specifically designed for High Performance Computing applications. Other industries using Amazon EC2 for HPC-style workloads include pharmaceuticals, oil exploration, industrial and automotive design, media and entertainment, and more. until today.

Cloud 118

Cloud AWS Automotive Latency 118

John McCalpin

JANUARY 22, 2018

Each of the two vector units can issue one FMA instruction per cycle, assuming that there are enough independent accumulators to tolerate the 6-cycle dependent-operation latency. This is an uninspiring fraction of peak performance that would normally suggest significant inefficiencies in either the hardware or software.

Latency 40

Latency Hardware Code Testing 40

Alex Russell

JANUARY 30, 2024

HTML, CSS, images, and fonts can all be parsed and run at near wire speeds on low-end hardware, but JavaScript is at least three times more expensive, byte-for-byte. Engineering is the discipline of designing solutions under specific constraints. That's where the good news ends.

Performance 90

Performance Network Mobile Speed 90

SQL Server According to Bob

JANUARY 11, 2020

Many high-end disk subsystems provide high-speed cache facilities to reduce the latency of read and write operations. Example 1: ​​ Hardware failure (CPU board) Battery backup on the caching controller maintained the data. Important Always consult with your hardware manufacturer for proper stable media strategies.

Servers 40

Servers Cache Media Hardware 40

John McCalpin

NOVEMBER 5, 2016

The art and science of microprocessor architecture is a never-ending struggling to balance complexity, verifiability, usability, expressiveness, compactness, ease of encoding/decoding, energy consumption, backwards compatibility, forwards compatibility, and other factors. This includes Haswell and newer cores.

Cache 40

Cache C++ Latency Hardware 40

Alex Russell

OCTOBER 22, 2017

One distinct trend is a belief that a JavaScript framework and Single-Page Architecture (SPA) is a must for PWA development. It simulates a link with a 400ms RTT and 400-600Kbps of throughput (plus latency variability and simulated packet loss). Our baseline, then, should probably trade lower throughput/higher-latency for packet loss.

Performance 68

Performance Benchmarking Network Mobile 68

Highly Scalable

AUGUST 20, 2013

This system has been designed to supplement and succeed the existing Hadoop-based system that had too high latency of data processing and too high maintenance costs. The design of the in-stream processing engine itself was driven by the following requirements: SQL-like functionality. Fault-tolerance.

Big Data 154

Big Data Processing Lambda Database 154

Smashing Magazine

JANUARY 6, 2020

Performance isn’t just a technical concern: it affects everything from accessibility to usability to search engine optimization, and when baking it into the workflow, design decisions have to be informed by their performance implications. Map design decisions against performance budget and the priorities defined early on.

Performance 145

Performance Cache Network Metrics 145

Smashing Magazine

JANUARY 7, 2019

Performance isn’t just a technical concern: it matters, and when baking it into the workflow, design decisions have to be informed by their performance implications. Without a strong alignment between dev/design and business/marketing teams, performance isn’t going to sustain long-term. Setting Realistic Goals.

Performance 103

Performance Cache Metrics Network 103

Smashing Magazine

JANUARY 11, 2021

Performance isn’t just a technical concern: it affects everything from accessibility to usability to search engine optimization, and when baking it into the workflow, design decisions have to be informed by their performance implications. Looking back now, things seem to have changed quite significantly.

Performance 145

Performance Cache Media Metrics 145

Alex Russell

JULY 14, 2021

The benefits to apps that adopt WebView-based IABs are numerous: WebViews are system components designed for use within other apps. Hardware access APIs, notably: Geolocation. CCT's core design is sound and has enormous potential if made mandatory in place of WebView IABs by the Android and Play teams. Web Bluetooth. Web Serial.

Google 121

Google Mobile Engineering Internet 121

The Netflix TechBlog

FEBRUARY 9, 2021

Before designing a solution it’s important to understand the main product requirements for such a feature: The content needs to be new, relevant, and regional (not all countries have the same catalogue). To reduce latency, assets should be generated in an offline fashion and not in real time.

Engineering 165

Engineering Storage Latency Entertainment 165

All Things Distributed

MARCH 11, 2016

The expectation was that with each order or two of magnitude, we would need to revisit and revise the architecture to make sure we could address the issues of scale. We needed to build such an architecture that we could introduce new software components without taking the service down. Primitives not frameworks. your resource usage.

AWS 144

AWS Hardware Retail Virtualization 144

All Things Distributed

JULY 14, 2015

In this blog post, I will explain how these three new capabilities empower you to build applications with distributed systems architecture and create responsive, reliable, and high-performance applications using DynamoDB that work at any scale. DynamoDB Streams simplifies and improves this design pattern with a distributed systems approach.

Database 167

Database Lambda AWS IoT 167

All Things Distributed

JULY 20, 2015

Today, I want to explore the Amazon ECS architecture and what this architecture enables. To be robust and scalable, this key/value store needs to be distributed for durability and availability, to protect against network partitions or hardware failures. Let’s talk about what Amazon ECS is actually doing.

Latency 166

Latency Architecture AWS Open Source 166

All Things Distributed

JANUARY 18, 2012

a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Today is a very exciting day as we release Amazon DynamoDB , a fast, highly reliable and cost-effective NoSQL database service designed for internet scale applications. Amazon DynamoDB offers low, predictable latencies at any scale. Comments ().

Scalability 167

Scalability Database Ecommerce Latency 167