The Morning Paper

MAY 14, 2019

Seer: leveraging big data to navigate the complexity of performance debugging in cloud microservices Gan et al., Seer is an online system that observes the behaviour of cloud applications (using the DeathStarBench microservices for the evaluation) and predicts when QoS violations may be about to occur. ASPLOS’19.

Big Data 45

Big Data Cloud Performance Hardware 45

Brendan Gregg

JULY 4, 2021

It's an exciting time for developments in computer performance, not just for the BPF technology (which I often [write about]) but also for processors with 3D stacking and cloud vendor CPUs (e.g., This was a chance to talk about other things I've been working on, such as the present and future of hardware performance. Ford, et al., “TCP

Performance 52

Performance Latency Hardware Storage 52

All Things Distributed

JULY 13, 2010

Expanding the Cloud - Cluster Compute Instances for Amazon EC2. Today, Amazon Web Services took very an important step in unlocking the advantages of cloud computing for a very important application area. Unlocking the benefits of the cloud for the HPC community. By Werner Vogels on 12 July 2010 05:00 PM. Comments ().

Cloud 118

Cloud AWS Automotive Latency 118

Brendan Gregg

FEBRUARY 28, 2023

My personal opinion is that I don't see a widespread need for more capacity given horizontal scaling and servers that can already exceed 1 Tbyte of DRAM; bandwidth is also helpful, but I'd be concerned about the increased latency for adding a hop to more memory. Ford, et al., “TCP

Performance 52

Performance Latency Cache Virtualization 52

VoltDB

JUNE 1, 2017

Hardware Optimizers” want to get the maximum utilization out of hardware. These systems were designed to have a lifetime of half a decade or more, and rapidly changing hardware meant that the initial deployment had to be sized for 5-7 years out. Latency Optimizers” – need support for very large federated deployments.

Hardware 56

Hardware Latency Virtualization Cloud 56

cdemi

FEBRUARY 20, 2017

Let's talk about the elephant in the room; Serverless doesn't really mean that there are no Software or Hardware servers. It just means that from Software Development perspective, servers are abstracted and outsourced to another entity, so you don't need to worry about it. Serverless can be achieved on Clouds.

Serverless 64

Serverless Architecture Lambda Azure 64

Dynatrace

SEPTEMBER 29, 2020

At Dynatrace we host most of our Dynatrace SaaS clusters for paying customers as well as trial users in the Amazon Web Services (AWS) cloud. The Autonomous Cloud Enablement (ACE) Team at Dynatrace has an important role to play in that offering. Sydney, we have a disk write latency problem!

Infrastructure 177

Infrastructure Cloud Monitoring AWS 177

VoltDB

JUNE 1, 2017

Hardware Optimizers” want to get the maximum utilization out of hardware. These systems were designed to have a lifetime of half a decade or more, and rapidly changing hardware meant that the initial deployment had to be sized for 5-7 years out. Latency Optimizers” – need support for very large federated deployments.

Hardware 40

Hardware Latency Virtualization Cloud 40

All Things Distributed

JANUARY 23, 2012

Expanding the Cloud - The AWS Storage Gateway. Today Amazon Web Services has launched the AWS Storage Gateway, making the power of secure and reliable cloud storage accessible from customersâ?? The Amazon Virtual Private Cloud extends on-premises compute with all the power of AWS, making it elastic, scalable and highly reliable.

Storage 115

Storage AWS Virtualization Cloud 115

Abhishek Tiwari

JULY 12, 2018

Data Pipeline A data pipeline is a software that ingests data from multiple sources, transforms it and finally makes it available to internal or external products. A data pipeline is a software which runs on hardware. The software is error-prone and hardware failures are inevitable.

Latency 63

Latency Analytics Scalability Engineering 63

HammerDB

OCTOBER 23, 2023

Note that for all tests, we used the local loopback address and port to provide the lowest possible network latency between client and server and also so we don’t have any concerns about bandwidth limitations. When we observe the global CPU usage one clear difference is the increase in softirqs or software interrupts.(If

Benchmarking 62

Benchmarking Database Network C++ 62

O'Reilly

JANUARY 16, 2024

I’ve been diligent about data backup throughout my life, but my files are fragmented amongst different media over the years—burning CDs and DVDs back in the day, several generations of external hard drives (that are in various states of decay), university servers, Dropbox, and other cloud services.

Entertainment 73

Entertainment Internet Internet Design 73

Scalegrid

FEBRUARY 8, 2024

Key Takeaways Distributed storage systems benefit organizations by enhancing data availability, fault tolerance, and system scalability, leading to cost savings from reduced hardware needs, energy consumption, and personnel. This process effectively duplicates essential parts of information to safeguard against potential loss.

Storage 130

Storage Systems Big Data Azure 130

The Morning Paper

MAY 12, 2019

An open-source benchmark suite for microservices and their hardware-software implications for cloud & edge systems Gan et al., In this paper we explore the implications microservices have across the cloud system stack. Hardware implications. ASPLOS’19. Operating system and network implications.

Open Source 61

Open Source Hardware Benchmarking Systems 61

Dynatrace

JANUARY 26, 2021

VMware commercialized the idea of virtual machines, and cloud providers embraced the same concept with services like Amazon EC2, Google Compute, and Azure virtual machines. Serverless computing is a cloud-based, on-demand execution model where customers consume resources solely based on their application usage.

Serverless 241

Serverless Efficiency Lambda Azure 241

Abhishek Tiwari

DECEMBER 27, 2017

portability between cloud and on-premises. Over last few years, we have seen several attempts to run data workload in the containers especially distributed big data frameworks like Apache Hadoop, Apache Storm [3] , and Apache Spark [4] [5] without any software modifications. better cluster resource utilization.

Big Data 63

Big Data Storage Benchmarking Hardware 63

KeyCDN

AUGUST 15, 2019

In the context of web development, performance testing entails using software tools to simulate how an application runs under specific circumstances. Wait time: Sometimes called average latency, wait time refers the amount of time a request spends in a queue before it gets processed. What is Performance Testing?

Testing Tools 55

Testing Tools Best Practices Performance Testing Testing 55

Percona

NOVEMBER 9, 2023

If you have any experience working with database software, you have undoubtedly heard the term Kubernetes a lot. You may already be using it daily and find it makes running applications in the cloud much more manageable. It simplifies infrastructure management and is the driving force behind many cloud-native applications and services.

Efficiency 100

Efficiency Cloud Healthcare Open Source 100

HammerDB

DECEMBER 5, 2020

A full understanding of why this is important requires some knowledge of the evolution of database hardware and software. For TPC-C this meant enough available spindles to reduce I/O latency and for TPC-H enough bandwidth for data throughput. This was both expensive and time consuming to configure.

C++ 40

C++ Benchmarking Virtualization Open Source 40

Sutter's Mill

FEBRUARY 13, 2017

Tue-Thu Apr 25-27: High-Performance and Low-Latency C++ (Stockholm). On April 25-27, I’ll be in Stockholm (Kista) giving a three-day seminar on “High-Performance and Low-Latency C++.”

Latency 50

Latency C++ Hardware Performance 50

Dynatrace

OCTOBER 1, 2021

As dynamic systems architectures increase in complexity and scale, IT teams face mounting pressure to track and respond to conditions and issues across their multi-cloud environments. Observability relies on telemetry derived from instrumentation that comes from the endpoints and services in your multi-cloud computing environments.

Metrics 363

Metrics Open Source Monitoring Infrastructure 363

All Things Distributed

APRIL 4, 2017

This enables customers to serve content to their end users with low latency, giving them the best application experience. In 2011, AWS opened a Point of Presence (PoP) in Stockholm to enable customers to serve content to their end users with low latency. As well as AWS Regions, we also have 24 AWS Edge Network Locations in Europe.

AWS 116

AWS Airlines Latency Games 116

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. As a Xen guest, this profile was gathered using perf(1) and the kernel's software cpu-clock soft interrupts, not the hardware NMI. We ended up setting it in the BaseAMI for all cloud services. But I'm not completely sure.

Speed 126

Speed Java AWS Virtualization 126

All Things Distributed

MARCH 11, 2016

Almost from day one, we knew that the software we were building would not be the software that would be running a year later. We needed to build such an architecture that we could introduce new software components without taking the service down. Build evolvable systems. Primitives not frameworks. Automation is key.

AWS 144

AWS Hardware Retail Virtualization 144

Dotcom-Montior

MAY 12, 2020

Network latency. Hardware resources. Network Latency. With the evolution of cloud technologies, such as Single Page Applications (SPAs), Web APIs, and Model View Controller (MVC), network latency has become a crucial factor to be monitored. Network latency can be affected due to. Hardware Resources.

Monitoring 63

Monitoring Entertainment Hardware Latency 63

Dotcom-Montior

NOVEMBER 24, 2021

With the rapid advancements in web application technologies, programming languages, cloud computing services, microservices, hybrid environments, etc., A three-tier system is a software application architecture that consists of a presentation layer, application layer, and data, or core, layer. Blockchain is a good example of this.

Systems 74

Systems Monitoring Hardware Network 74

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. As a Xen guest, this profile was gathered using perf(1) and the kernel's software cpu-clock soft interrupts, not the hardware NMI. We ended up setting it in the BaseAMI for all cloud services.

Speed 52

Speed Java AWS Virtualization 52

Dynatrace

AUGUST 5, 2019

Across the board, the topics cloud migration, application modernization, breaking the monolith or hybrid cloud re-platforming have been a center point in many of our discussions with our joint enterprise customers. If you can answer all these questions fine – if not: get your own Dynatrace Trial and start installing OneAgents.

Cloud 31

Cloud Traffic Database Network 31

The Morning Paper

APRIL 14, 2019

The paper sets out what we can do in software given today’s hardware, and along the way also highlights areas where cooperation from hardware will be needed in the future. “ Preventing side-channel attacks between VMs hosted on public cloud infrastructure. Microarchitectural channels. Threat scenarios.

Hardware 44

Hardware Cache Latency Speed 44

Percona

JULY 1, 2023

Understanding DBaaS DBaaS cloud services allow users to use databases without configuring physical hardware and infrastructure or installing software. Amazon Aurora is a proprietary, cloud-native, fully managed relational database service developed by Amazon Web Services (AWS). Download Now What is Amazon Aurora?

AWS 52

AWS Database Serverless Storage 52

All Things Distributed

JULY 14, 2015

In traditional database architectures, database engines often run a small search engine or data warehouse engines on the same hardware as the database. No matter which mechanism you choose to use, we make the stream data available to you instantly (latency in milliseconds) and how fast you want to apply the changes is up to you.

Database 167

Database Lambda AWS IoT 167

The Morning Paper

MARCH 3, 2020

The core algorithms (chain-replication, Paxos-based consensus) aren’t the stars of the show here, instead the paper focuses on how these algorithms are deployed, and the software engineering practices behind the creation of a mission-critical production system employing them. Larger cells have better tolerance of tail latency (e.g.

Database 106

Database AWS Network Design 106

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. As a Xen guest, this profile was gathered using perf(1) and the kernel's software cpu-clock soft interrupts, not the hardware NMI. We ended up setting it in the BaseAMI for all cloud services. But I'm not completely sure.

Speed 40

Speed Java AWS Virtualization 40

All Things Distributed

JANUARY 18, 2012

DynamoDB is the result of 15 years of learning in the areas of large scale non-relational databases and cloud services. With Amazon DynamoDB, developers scaling cloud-based applications can start small with just the capacity they need and then increase the request capacity of a given table as their app grows in popularity.

Scalability 167

Scalability Database Ecommerce Latency 167

The Morning Paper

JULY 4, 2019

Netflix’s system is deployed on the public cloud as complex set of interacting microservices. degraded hardware, transient networking problem) or, more often, because of some change deployed by Netflix engineers that did not have the intended effect. On error rates.

Latency 77

Latency Engineering Metrics Traffic 77

Brendan Gregg

AUGUST 8, 2017

Load averages are an industry-critical metric – my company spends millions auto-scaling cloud instances based on them and other metrics – but on Linux there's some mystery around them. They can be also useful when a single value of demand is desired, such as for a cloud auto scaling rule. I've never seen an explanation.

Latency 111

Latency Metrics C++ Systems 111

Adrian Cockcroft

NOVEMBER 11, 2019

In the same way that we have moved from a few big software releases a year to continuous delivery of many small changes, we need to move from annual disaster recover tests or suffering when things actually break, to continuously tested resilience. This discussion focuses on hardware, software and operational failure modes.

Latency 52

Latency Engineering Systems Hardware 52