The Morning Paper

OCTOBER 4, 2020

We are standing on the eve of the 5G era… 5G, as a monumental shift in cellular communication technology, holds tremendous potential for spurring innovations across many vertical industries, with its promised multi-Gbps speed, sub-10 ms low latency, and massive connectivity. Throughput and latency. Application performance.

Energy 130

Energy Latency Performance Network 130

Brendan Gregg

JULY 4, 2021

It's an exciting time for developments in computer performance, not just for the BPF technology (which I often [write about]) but also for processors with 3D stacking and cloud vendor CPUs (e.g., This was a chance to talk about other things I've been working on, such as the present and future of hardware performance. Ford, et al., “TCP

Performance 52

Performance Latency Hardware Storage 52

Brendan Gregg

FEBRUARY 28, 2023

My personal opinion is that I don't see a widespread need for more capacity given horizontal scaling and servers that can already exceed 1 Tbyte of DRAM; bandwidth is also helpful, but I'd be concerned about the increased latency for adding a hop to more memory. Ford, et al., “TCP

Performance 52

Performance Latency Cache Virtualization 52

All Things Distributed

JULY 13, 2010

Expanding the Cloud - Cluster Compute Instances for Amazon EC2. Today, Amazon Web Services took very an important step in unlocking the advantages of cloud computing for a very important application area. Unlocking the benefits of the cloud for the HPC community. By Werner Vogels on 12 July 2010 05:00 PM. Comments ().

Cloud 118

Cloud AWS Automotive Latency 118

The Morning Paper

JUNE 13, 2019

As we saw with the SOAP paper last time out, even with a fixed model variant and hardware there are a lot of different ways to map a training workload over the available hardware. The following figure highlights how just one of these variables, batch size, impacts throughput and latency on ResNet50.

Hardware 58

Hardware Latency Serverless Energy 58

Abhishek Tiwari

DECEMBER 27, 2017

portability between cloud and on-premises. faster access to external storage and data locality (I/O, bandwidth). Using default scheduler's node affinity feature you can ensure that certain pods only schedule on nodes with specialized hardware like GPU, memory-optimised, I/O optimised etc. Storage provisioning.

Big Data 63

Big Data Storage Benchmarking Hardware 63

Abhishek Tiwari

JULY 12, 2018

These nodes and edges require a good amount of compute and storage which is typically distributed across a large number servers either running in the cloud or your own data center. A data pipeline is a software which runs on hardware. The software is error-prone and hardware failures are inevitable.

Latency 63

Latency Analytics Scalability Engineering 63

Percona

MARCH 23, 2023

Hardware Memory The amount of RAM to be provisioned for database servers can vary greatly depending on the size of the database and the specific requirements of the company. Storage The type of storage and disk used for database servers can have a significant impact on performance and reliability. Setting oom_score_adj to -800.

Performance 127

Performance Hardware Tuning Storage 127

HammerDB

DECEMBER 5, 2020

A full understanding of why this is important requires some knowledge of the evolution of database hardware and software. For TPC-C this meant enough available spindles to reduce I/O latency and for TPC-H enough bandwidth for data throughput. This was both expensive and time consuming to configure.

C++ 40

C++ Benchmarking Virtualization Open Source 40

The Morning Paper

JANUARY 28, 2020

Narrowing the gap between serverless and its state with storage functions , Zhang et al., Shredder is " a low-latency multi-tenant cloud store that allows small units of computation to be performed directly within storage nodes. " Cloud providers count on this to ease provisioning and fault-tolerance.

Serverless 99

Serverless Storage Latency Cloud 99

All Things Distributed

DECEMBER 12, 2018

They can run applications in Sweden, serve end users across the Nordics with lower latency, and leverage advanced technologies such as containers, serverless computing, and more. In addition, we are working with the venture capital community, startup accelerators, and incubators to help startups grow in the cloud. " Hemnet.

AWS 124

AWS Cloud Games Serverless 124

Percona

JULY 1, 2023

Understanding DBaaS DBaaS cloud services allow users to use databases without configuring physical hardware and infrastructure or installing software. Download our eBook, “ Enterprise Guide to Cloud Databases ” to help you make more informed decisions and avoid costly mistakes as you develop and execute your cloud strategy.

AWS 52

AWS Database Serverless Storage 52

All Things Distributed

MARCH 11, 2016

This is a given, whether you are using the highest quality hardware or lowest cost components. This becomes an even more important lesson at scale: for example, as S3 processes trillions and trillions of storage transactions, anything that has even the slightest probability of error will become realistic. Primitives not frameworks.

AWS 144

AWS Hardware Retail Virtualization 144

Dotcom-Montior

MAY 12, 2020

Websites are now more than just the storage and retrieval of information to present content to users. Network latency. Hardware resources. Network Latency. Network latency can be affected due to. Hardware Resources. Website and web application technologies have grown tremendously over the years. Wi-Fi usage.

Monitoring 63

Monitoring Entertainment Hardware Latency 63

Dynatrace

AUGUST 5, 2019

Across the board, the topics cloud migration, application modernization, breaking the monolith or hybrid cloud re-platforming have been a center point in many of our discussions with our joint enterprise customers. If you can answer all these questions fine – if not: get your own Dynatrace Trial and start installing OneAgents.

Cloud 31

Cloud Traffic Database Network 31

All Things Distributed

JANUARY 18, 2012

DynamoDB is the result of 15 years of learning in the areas of large scale non-relational databases and cloud services. With Amazon DynamoDB, developers scaling cloud-based applications can start small with just the capacity they need and then increase the request capacity of a given table as their app grows in popularity.

Scalability 167

Scalability Database Ecommerce Latency 167

The Morning Paper

MARCH 3, 2020

It takes you through the thinking processes and engineering practices behind the design of a key part of the control plane for AWS Elastic Block Storage (EBS): the Physalia database that stores configuration information. This work is latency critical, because volume IO is blocked until it is complete. This paper is a real joy to read.

Database 106

Database AWS Network Design 106

Abhishek Tiwari

DECEMBER 27, 2017

With the arrival of new cloud-native tools and platform, ETL is becoming obsolete. It offers reliability and performance of a data warehouse, real-time and low-latency characteristics of a streaming system, and scale and cost-efficiency of a data lake. Leveraging the recent hardware advances. Common in-memory data interfaces.

Big Data 49

Big Data Artificial Intelligence Storage Hardware 49

All Things Distributed

NOVEMBER 15, 2010

Expanding the Cloud - Adding the Incredible Power of the Amazon EC2 Cluster GPU Instances. For example, the most fundamental abstraction trade-off has always been latency versus throughput. The throughput of this pipeline is more important than the latency of the individual operations. All Things Distributed. Comments ().

AWS 136

AWS Latency Programming Architecture 136

High Scalability

SEPTEMBER 14, 2018

Hey, it's HighScalability time: The Cloud Native Interactive Landscape is fecund. And if you know anyone looking for a simple book that uses lots of pictures and lots of examples to explain the cloud, then please recommend my new book: Explain the Cloud Like I'm 10. changelog ). Do you like this sort of Stuff?

Internet 30

Internet Internet Scalability Education 30

Adrian Cockcroft

NOVEMBER 11, 2019

This discussion focuses on hardware, software and operational failure modes. Collecting some critical metrics at one second intervals, with a total observability latency of ten seconds or less matches the human attention span much better. Try to measure your mean time to respond (MTTR) for incidents.

Latency 52

Latency Engineering Systems Hardware 52

Adrian Cockcroft

NOVEMBER 11, 2019

This discussion focuses on hardware, software and operational failure modes. Collecting some critical metrics at one second intervals, with a total observability latency of ten seconds or less matches the human attention span much better. Try to measure your mean time to respond (MTTR) for incidents.

Latency 53

Latency Engineering Systems Hardware 53

Brendan Gregg

SEPTEMBER 5, 2017

Here's some output from my zfsdist tool, in bcc/BPF, which measures ZFS latency as a histogram on Linux: # zfsdist. Tracing ZFS operation latency. Xen's biggest user is the Amazon EC2 cloud, which has over one million customers, and appears to be a custom version (it self identifies as version "3.4.3.amazon").

Virtualization 76

Virtualization AWS Engineering Hardware 76

Alex Russell

MARCH 6, 2021

A then-representative $200USD device had 4-8 slow (in-order, low-cache) cores, ~2GiB of RAM, and relatively slow MLC NAND flash storage. A silver lining on this dark cloud is that mobile JavaScript payload growth paused in 2020. Hardware Past As Performance Prologue. The Moto G4 , for example. Mind The Gap.

Performance 124

Performance Network Cache Metrics 124

Smashing Magazine

JANUARY 6, 2020

Estimated Input Latency tells us if we are hitting that threshold, and ideally, it should be below 50ms. Designed for the modern web, it responds to actual congestion, rather than packet loss like TCP does, it is significantly faster , with higher throughput and lower latency — and the algorithm works differently.

Performance 145

Performance Cache Network Metrics 145

Smashing Magazine

JANUARY 11, 2021

Estimated Input Latency tells us if we are hitting that threshold, and ideally, it should be below 50ms. Designed for the modern web, it responds to actual congestion, rather than packet loss like TCP does, it is significantly faster , with higher throughput and lower latency — and the algorithm works differently.

Performance 145

Performance Cache Media Metrics 145

Smashing Magazine

JANUARY 7, 2019

Estimated Input Latency tells us if we are hitting that threshold, and ideally, it should be below 50ms. On the other hand, we have hardware constraints on memory and CPU due to JavaScript parsing times (we’ll talk about them in detail later). A good starting point is to choose a good default stack for your application.

Performance 103

Performance Cache Metrics Network 103