The Morning Paper

NOVEMBER 15, 2020

Achieving 100 Gbps intrusion prevention on a single server , Zhao et al., So while scale out has seen the majority of attention in the cloud era, it’s good to remind ourselves periodically just what we really can do on a single box or even a single thread. This makes the whole system latency sensitive. OSDI’20.

Servers 128

Servers Hardware Latency Design 128

Dynatrace

APRIL 5, 2021

The 2014 launch of AWS Lambda marked a milestone in how organizations use cloud services to deliver their applications more efficiently, by running functions at the edge of the cloud without the cost and operational overhead of on-premises servers. Dynatrace news. What is AWS Lambda? The Amazon Web Services ecosystem.

Lambda 184

Lambda AWS Serverless Hardware 184

The Morning Paper

MAY 12, 2019

An open-source benchmark suite for microservices and their hardware-software implications for cloud & edge systems Gan et al., Microservices fundamentally change a lot of assumptions current cloud systems are designed with, and present both opportunities and challenges when optimizing for quality of service (QoS) and utilization.

Open Source 61

Open Source Hardware Benchmarking Systems 61

The Morning Paper

JANUARY 30, 2020

Seamless offloading of web app computations from mobile device to edge clouds via HTML5 web worker migration , Jeong et al., Edge servers are the middle ground – more compute power than a mobile device, but with latency of just a few ms. As such, web workers are a natural target to offload to a more powerful server.

Mobile 104

Mobile Cloud Latency Games 104

Brendan Gregg

JULY 4, 2021

It's an exciting time for developments in computer performance, not just for the BPF technology (which I often [write about]) but also for processors with 3D stacking and cloud vendor CPUs (e.g., This was a chance to talk about other things I've been working on, such as the present and future of hardware performance. Ford, et al., “TCP

Performance 140

Performance Latency Hardware Storage 140

Percona

MARCH 23, 2023

Hardware Memory The amount of RAM to be provisioned for database servers can vary greatly depending on the size of the database and the specific requirements of the company. Some servers may need a few GBs of RAM, while others may need hundreds of GBs or even terabytes of RAM. Benchmark before you decide.

Performance 123

Performance Hardware Tuning Storage 123

ACM Sigarch

MAY 31, 2023

Memory disaggregation separates memory pools from traditional server boxes, enabling more flexible resource allocation and potentially reducing costs. There are three common mechanisms to access remote memory: modifying applications, modifying virtual memory, and hardware-level cache coherence support. The recently announced CXL3.0

Latency 52

Latency Hardware Cache Architecture 52

Percona

MAY 1, 2023

Default settings can help you get started quickly – but they can also cost you performance and a higher cloud bill at the end of the month. After some time of receiving these messages, eventually, they hit performance issues to the point that the server becomes unresponsive for a few minutes. In practical terms, it was 3.7G

AWS 117

AWS Hardware Storage Tuning 117

Brendan Gregg

FEBRUARY 28, 2023

My personal opinion is that I don't see a widespread need for more capacity given horizontal scaling and servers that can already exceed 1 Tbyte of DRAM; bandwidth is also helpful, but I'd be concerned about the increased latency for adding a hop to more memory. Ford, et al., “TCP

Performance 110

Performance Latency Cache Virtualization 110

The Morning Paper

OCTOBER 4, 2020

We are standing on the eve of the 5G era… 5G, as a monumental shift in cellular communication technology, holds tremendous potential for spurring innovations across many vertical industries, with its promised multi-Gbps speed, sub-10 ms low latency, and massive connectivity. Throughput and latency. energy consumption).

Energy 130

Energy Latency Performance Network 130

The Morning Paper

JANUARY 28, 2020

Shredder is " a low-latency multi-tenant cloud store that allows small units of computation to be performed directly within storage nodes. " From an operator perspective it makes it harder to follow the classic cloud-native design in which a global storage layer is separate to compute.

Serverless 99

Serverless Storage Latency Cloud 99

The Morning Paper

MAY 14, 2019

Seer: leveraging big data to navigate the complexity of performance debugging in cloud microservices Gan et al., Seer is an online system that observes the behaviour of cloud applications (using the DeathStarBench microservices for the evaluation) and predicts when QoS violations may be about to occur. ASPLOS’19.

Big Data 45

Big Data Cloud Performance Hardware 45

Dotcom-Montior

NOVEMBER 24, 2021

Do you have a web server? Is the web server running? The last item to check was if the web server was able to talk to the database? With the rapid advancements in web application technologies, programming languages, cloud computing services, microservices, hybrid environments, etc., Do you have a database? Peer-to-Peer.

Systems 74

Systems Monitoring Hardware Network 74

Dotcom-Montior

NOVEMBER 11, 2020

Well, to start, serverless, or serverless computing , doesn’t really mean there aren’t servers involved, because there are, rather it refers to the fact that the responsibility of having to manage, scale, provision, maintain, etc., Benefits of a Serverless Model. No more having to worry about maintenance, patching, or scaling.

Serverless 57

Serverless Monitoring Lambda Latency 57

Dotcom-Montior

MAY 12, 2020

Early web applications involved less on client-side behavior and more server-side for all its navigation, query handling, and updates. A request will be sent from the client-side and an HTTP check waits on the server port to get the message, process it, and then send back the response. Connection closed by the server.

Monitoring 63

Monitoring Entertainment Hardware Latency 63

Brendan Gregg

JULY 4, 2021

It's an exciting time for developments in computer performance, not just for the BPF technology (which I often [write about]) but also for processors with 3D stacking and cloud vendor CPUs (e.g., This was a chance to talk about other things I've been working on, such as the present and future of hardware performance. Ford, et al., “TCP

Performance 52

Performance Latency Hardware Storage 52

All Things Distributed

APRIL 4, 2017

This enables customers to serve content to their end users with low latency, giving them the best application experience. In 2011, AWS opened a Point of Presence (PoP) in Stockholm to enable customers to serve content to their end users with low latency. As well as AWS Regions, we also have 24 AWS Edge Network Locations in Europe.

AWS 116

AWS Airlines Latency Games 116

Brendan Gregg

FEBRUARY 28, 2023

My personal opinion is that I don't see a widespread need for more capacity given horizontal scaling and servers that can already exceed 1 Tbyte of DRAM; bandwidth is also helpful, but I'd be concerned about the increased latency for adding a hop to more memory. Ford, et al., “TCP

Performance 52

Performance Latency Cache Virtualization 52

All Things Distributed

JULY 13, 2010

Expanding the Cloud - Cluster Compute Instances for Amazon EC2. Today, Amazon Web Services took very an important step in unlocking the advantages of cloud computing for a very important application area. Unlocking the benefits of the cloud for the HPC community. By Werner Vogels on 12 July 2010 05:00 PM. Comments ().

Cloud 118

Cloud AWS Automotive Latency 118

The Morning Paper

JUNE 13, 2019

As we saw with the SOAP paper last time out, even with a fixed model variant and hardware there are a lot of different ways to map a training workload over the available hardware. First off there still is a model of course (but then there are servers hiding behind a serverless abstraction too!). autoscaling).

Hardware 58

Hardware Latency Serverless Energy 58

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. This server is spending about a third of its CPU cycles just checking the time! As a Xen guest, this profile was gathered using perf(1) and the kernel's software cpu-clock soft interrupts, not the hardware NMI.

Speed 126

Speed Java AWS Virtualization 126

All Things Distributed

MARCH 11, 2016

This is a given, whether you are using the highest quality hardware or lowest cost components. When customers left the constraining, old world of IT hardware and datacenters behind, they started to develop systems with new and interesting usage patterns that no one had ever seen before. Primitives not frameworks. APIs are forever.

AWS 144

AWS Hardware Retail Virtualization 144

cdemi

FEBRUARY 20, 2017

Let's talk about the elephant in the room; Serverless doesn't really mean that there are no Software or Hardware servers. It just means that from Software Development perspective, servers are abstracted and outsourced to another entity, so you don't need to worry about it. Serverless can be achieved on Clouds. Advantages.

Serverless 64

Serverless Architecture Lambda Azure 64

HammerDB

OCTOBER 23, 2023

Note that for all tests, we used the local loopback address and port to provide the lowest possible network latency between client and server and also so we don’t have any concerns about bandwidth limitations. the amount of data from the server to the client to achieve the same result. On MySQL, we saw a 1.5X client (i.e.

Benchmarking 62

Benchmarking Database Network C++ 62

Percona

JULY 1, 2023

Understanding DBaaS DBaaS cloud services allow users to use databases without configuring physical hardware and infrastructure or installing software. Download our eBook, “ Enterprise Guide to Cloud Databases ” to help you make more informed decisions and avoid costly mistakes as you develop and execute your cloud strategy.

AWS 52

AWS Database Serverless Storage 52

Dynatrace

AUGUST 5, 2019

Across the board, the topics cloud migration, application modernization, breaking the monolith or hybrid cloud re-platforming have been a center point in many of our discussions with our joint enterprise customers. If you can answer all these questions fine – if not: get your own Dynatrace Trial and start installing OneAgents.

Cloud 31

Cloud Traffic Database Network 31

All Things Distributed

JANUARY 18, 2012

DynamoDB is the result of 15 years of learning in the areas of large scale non-relational databases and cloud services. With Amazon DynamoDB, developers scaling cloud-based applications can start small with just the capacity they need and then increase the request capacity of a given table as their app grows in popularity.

Scalability 167

Scalability Database Ecommerce Latency 167

VoltDB

JUNE 29, 2017

Most existing adtech infrastructure simply can not achieve the required latency. VoltDB provides the necessary technology to achieve the latency required by header bidding. The simple answer is to just spin up more servers. More servers means more capacity. Spinning up more servers just won’t cut it.

Performance 40

Performance Hardware Latency Infrastructure 40

VoltDB

JUNE 29, 2017

Most existing adtech infrastructure simply can not achieve the required latency. VoltDB provides the necessary technology to achieve the latency required by header bidding. The simple answer is to just spin up more servers. More servers means more capacity. Spinning up more servers just won’t cut it.

Performance 40

Performance Hardware Latency Infrastructure 40

The Morning Paper

JULY 4, 2019

Netflix’s system is deployed on the public cloud as complex set of interacting microservices. degraded hardware, transient networking problem) or, more often, because of some change deployed by Netflix engineers that did not have the intended effect. RPCs at Netflix are wrapped as Hystrix commands.

Latency 77

Latency Engineering Metrics Traffic 77

All Things Distributed

JANUARY 23, 2012

Expanding the Cloud - The AWS Storage Gateway. Today Amazon Web Services has launched the AWS Storage Gateway, making the power of secure and reliable cloud storage accessible from customersâ?? The Amazon Virtual Private Cloud extends on-premises compute with all the power of AWS, making it elastic, scalable and highly reliable.

Storage 115

Storage AWS Virtualization Cloud 115

The Morning Paper

MARCH 3, 2020

This work is latency critical, because volume IO is blocked until it is complete. Cells are spread across a mesh of nodes (each node running on a single server). Larger cells have better tolerance of tail latency (e.g. Thus the configuration master is under stress just when you need it the most. Cells have seven nodes.

Database 106

Database AWS Network Design 106

Brendan Gregg

AUGUST 8, 2017

Load averages are an industry-critical metric – my company spends millions auto-scaling cloud instances based on them and other metrics – but on Linux there's some mystery around them. They can be also useful when a single value of demand is desired, such as for a cloud auto scaling rule. I've never seen an explanation.

Latency 111

Latency Metrics C++ Systems 111

All Things Distributed

NOVEMBER 15, 2010

Expanding the Cloud - Adding the Incredible Power of the Amazon EC2 Cluster GPU Instances. For example, the most fundamental abstraction trade-off has always been latency versus throughput. The throughput of this pipeline is more important than the latency of the individual operations. All Things Distributed. Comments ().

AWS 136

AWS Latency Programming Architecture 136

Abhishek Tiwari

JULY 12, 2018

These nodes and edges require a good amount of compute and storage which is typically distributed across a large number servers either running in the cloud or your own data center. A data pipeline is a software which runs on hardware. The software is error-prone and hardware failures are inevitable.

Latency 63

Latency Analytics Scalability Engineering 63

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. This server is spending about a third of its CPU cycles just checking the time! As a Xen guest, this profile was gathered using perf(1) and the kernel's software cpu-clock soft interrupts, not the hardware NMI.

Speed 52

Speed Java AWS Virtualization 52

Alex Russell

MARCH 6, 2021

A silver lining on this dark cloud is that mobile JavaScript payload growth paused in 2020. Hardware Past As Performance Prologue. Regardless, the overall story for hardware progress remains grim, particularly when we recall how long device replacement cycles are: Tap for a larger version. Mind The Gap.

Performance 124

Performance Network Cache Metrics 124