The Morning Paper

MARCH 8, 2020

Building an elastic query engine on disaggregated storage , Vuppalapati, NSDI’20. This paper presents Snowflake design and implementation along with a discussion on how recent changes in cloud infrastructure (emerging hardware, fine-grained billing, etc.) But the ephemeral storage service for intermediate data is not based on S3.

Storage 112

Storage Engineering Cache Serverless 112

Percona

JUNE 22, 2023

As a MySQL database administrator, keeping a close eye on the performance of your MySQL server is crucial to ensure optimal database operations. A monitoring tool like Percona Monitoring and Management (PMM) is a popular choice among open source options for effectively monitoring MySQL performance.

Performance 108

Performance Monitoring Traffic Database 108

HammerDB

APRIL 19, 2023

Predicting application performance is a difficult art, but an important one when choosing the target deployment environment. In this blog, we aim to call out some key considerations when trying to assess MySQL performance for your application. For storage, FIO is generally used.

Performance 54

Performance Benchmarking Cache Storage 54

Scalegrid

JANUARY 5, 2024

The DBMS is key to maintaining these aspects by offering a storage system that allows users to perform operations such as data insertion, deletion, and selection, thereby promoting enhanced data integration across diverse applications and platforms. Practical Applications of DBMS DBMS finds practical applications in various fields.

Efficiency 147

Efficiency Storage Database Scalability 147

Dynatrace

AUGUST 5, 2022

Consumers store messages in a queue — usually in a buffer or on a storage medium — until they can process and delete them. It provides a consistent platform that integrates with a variety of message queuing types to enable consistent performance regardless of the platform. A producer creates the message, and a consumer processes it.

Monitoring 199

Monitoring Serverless Programming Speed 199

Dynatrace

AUGUST 5, 2022

Consumers store messages in a queue — usually in a buffer or on a storage medium — until they can process and delete them. It provides a consistent platform that integrates with a variety of message queuing types to enable consistent performance regardless of the platform. A producer creates the message, and a consumer processes it.

Monitoring 199

Monitoring Serverless Programming Speed 199

Scalegrid

FEBRUARY 8, 2024

A distributed storage system is foundational in today’s data-driven landscape, ensuring data spread over multiple servers is reliable, accessible, and manageable. Understanding distributed storage is imperative as data volumes and the need for robust storage solutions rise.

Storage 130

Storage Systems Big Data Azure 130

Brendan Gregg

FEBRUARY 28, 2023

At USENIX SREcon22 APAC I gave the opening keynote on the future of computer performance, rounding up the latest developments and making predictions of where I see things heading. This talk originated from my updates to [Systems Performance 2nd Edition], and this was the first time I've given this talk in person! Or even on a plane.

Performance 110

Performance Latency Cache Virtualization 110

The Morning Paper

OCTOBER 4, 2020

Understanding operational 5G: a first measurement study on its coverage, performance and energy consumption , Xu et al., The first 5G networks are now deployed and operational. The study is based on one of the world’s first commercial 5G network deployments (launched in April 2019), a 0.5 SIGCOMM’20.

Energy 130

Energy Latency Performance Network 130

Brendan Gregg

JULY 4, 2021

It's an exciting time for developments in computer performance, not just for the BPF technology (which I often [write about]) but also for processors with 3D stacking and cloud vendor CPUs (e.g., This was a chance to talk about other things I've been working on, such as the present and future of hardware performance.

Performance 52

Performance Latency Hardware Storage 52

Scalegrid

JANUARY 25, 2024

Redis® is an in-memory database that provides blazingly fast performance. This makes it a compelling alternative to disk-based databases when performance is a concern. You might already use ScaleGrid hosting for Redis hosting to power your performance-sensitive applications.

Metrics 130

Metrics Monitoring Latency Cache 130

Brendan Gregg

FEBRUARY 28, 2023

At USENIX SREcon22 APAC I gave the opening keynote on the future of computer performance, rounding up the latest developments and making predictions of where I see things heading. This talk originated from my updates to Systems Performance 2nd Edition , and this was the first time I've given this talk in person!

Performance 52

Performance Latency Cache Virtualization 52

Smashing Magazine

JANUARY 15, 2019

How Improving Website Performance Can Help Save The Planet. How Improving Website Performance Can Help Save The Planet. Perhaps the biggest win when it comes to making websites more sustainable is that performance, user experience and sustainability are all neatly intertwined. Jack Lenox. 2019-01-15T13:30:32+01:00.

Website Performance 73

Website Performance Website Energy Performance 73

The Morning Paper

JUNE 13, 2019

As we saw with the SOAP paper last time out, even with a fixed model variant and hardware there are a lot of different ways to map a training workload over the available hardware. “ For instance, Facebook applications issue tens-of-trillions of inference queries per day with varying performance, accuracy, and cost constraints.”

Hardware 58

Hardware Latency Serverless Energy 58

The Morning Paper

JANUARY 30, 2020

These use their regression models to estimate processing time (which will depend on the hardware available, current load, etc.). The figure below shows the migration time for these three applications, broken down into snapshot capture, snapshot restoration, and ‘other’ (including the network transfer time).

Mobile 104

Mobile Cloud Latency Games 104

Abhishek Tiwari

DECEMBER 27, 2017

faster access to external storage and data locality (I/O, bandwidth). optimised container networking and security. overall performance comparable to bare metal. The good news is all of these challenges including performance can be tackled and in several cases, there are new developments to overcome them. Performance.

Big Data 63

Big Data Storage Benchmarking Hardware 63

High Scalability

NOVEMBER 14, 2018

New topics range from additional workloads like video streaming, machine learning, and public cloud to specialized silicon accelerators, storage and network building blocks, and a revised discussion of data center power and cooling, and uptime.

Design 54

Design Education Google Internet 54

Adrian Cockcroft

JUNE 21, 2022

The early days at Sun Cambridge were special, I absorbed a lot about networking and the technical side of the role from my fellow systems engineer Martin Baines, and we were driving all over the region in cool company cars (I had a Citroen BX 16V) selling a really hot product. that a lot of people used.

Tuning 52

Tuning Benchmarking Engineering C++ 52

Dotcom-Montior

OCTOBER 6, 2021

trying to reduce the amount of manual work and ensuring all the components (infrastructure/hardware, middleware, software, etc.) Performance. One minute an SRE might be provisioning storage in AWS, the next minute an SRE might have to talk to customers or go write some Python code for a new project. Availability. Monitoring.

Engineering 67

Engineering DevOps Monitoring Google 67

All Things Distributed

APRIL 5, 2012

From tax preparation to safe social networks, Amazon RDS brings new and innovative applications to the cloud. Intelligent Social network - Facilitate topical Q&A conversations among employees, customers and our most valued super contributors. Teachers can interact with their colleagues in professional learning networks.

Innovation 146

Innovation AWS Education Network 146

Scalegrid

FEBRUARY 1, 2024

However, data loss is always possible due to hardware malfunction, software defects, or other unforeseen circumstances, just like with any computer system. The biggest drawbacks are that a full backup can be time-consuming, and they require a significant amount of storage space.

Best Practices 130

Best Practices Storage Strategy Database 130

Percona

AUGUST 30, 2023

In general terms, here are potential trouble spots: Hardware failure: Manufacturing defects, wear and tear, physical damage, and other factors can cause hardware to fail. heat) can damage hardware components and prompt data loss. Human mistakes: Incorrect configuration is an all-too-common cause of hardware and software failure.

Database 92

Database Hardware Open Source Strategy 92

All Things Distributed

JULY 13, 2010

Cluster Computer Instances for Amazon EC2 are a new instance type specifically designed for High Performance Computing applications. During my academic career, I spent many years working on HPC technologies such as user-level networking interfaces, large scale high-speed interconnects, HPC software stacks, etc. HPC and Amazon EC2.

Cloud 118

Cloud AWS Automotive Latency 118

All Things Distributed

AUGUST 16, 2012

An apples to apples comparison of the costs associated with running various usage patterns on-premises and with AWS requires more than a simple comparison of hardware expense versus always-on utility pricing for compute and storage.

AWS 118

AWS Hardware Traffic Best Practices 118

Dynatrace

JUNE 25, 2020

The network latency between cluster nodes should be around 10 ms or less. Our Premium High Availability comes with the following features: Active-active deployment model for optimum hardware utilization. Minimized cross-data center network traffic. – A Dynatrace customer, Head of Performance Engineering.

Availability 247

Availability Hardware Latency Traffic 247

Scalegrid

DECEMBER 21, 2023

Buckle up as we delve into the world of Redis® monitoring, exploring the most important Redis® metrics, discussing essential tools, and even peering into the future of Redis® performance management. Key Takeaways Redis® monitoring is essential for safeguarding performance, reliability, and security.

Strategy 130

Strategy Monitoring Latency DevOps 130

Scalegrid

MAY 13, 2020

Greenplum Database is an open-source , hardware-agnostic MPP database for analytics, based on PostgreSQL and developed by Pivotal who was later acquired by VMware. Greenplum uses an MPP database design that can help you develop a scalable, high performance deployment. What Exactly is Greenplum? The Greenplum Architecture.

Big Data 321

Big Data Database Artificial Intelligence Open Source 321

Abhishek Tiwari

JULY 12, 2018

These nodes and edges require a good amount of compute and storage which is typically distributed across a large number servers either running in the cloud or your own data center. A data pipeline is a software which runs on hardware. The software is error-prone and hardware failures are inevitable.

Latency 63

Latency Analytics Scalability Engineering 63

Dynatrace

AUGUST 11, 2022

Before an organization moves to function as a service, it’s important to understand how it works, its benefits and challenges, its effect on scalability, and why cloud-native observability is essential for attaining peak performance. Cloud providers then manage physical hardware, virtual machines, and web server software management.

Development 250

Development Serverless Best Practices Lambda 250

The Morning Paper

JANUARY 28, 2020

Narrowing the gap between serverless and its state with storage functions , Zhang et al., Shredder is " a low-latency multi-tenant cloud store that allows small units of computation to be performed directly within storage nodes. " High performance. SoCC’19. "Narrowing Introducing Shredder.

Serverless 99

Serverless Storage Latency Cloud 99

ACM Sigarch

NOVEMBER 4, 2019

Krste Asanovic from UC Berkeley kicked off the main program sharing his experience on “ Rejuvenating Computer Architecture Research with Open-Source Hardware ”. He ended the keynote with a call to action for open hardware and tools to start the next wave of computing innovation. This year’s MICRO had three inspiring keynote talks.

Hardware 18

Hardware Architecture Programming Innovation 18

Scalegrid

JANUARY 8, 2024

Real-world examples like Spotify’s multi-cloud strategy for cost reduction and performance, and Netflix’s hybrid cloud setup for efficient content streaming and creation, illustrate the practical applications of each model. In this scenario, two notable models – multi-cloud and hybrid cloud have emerged. But what do these entail?

Strategy 147

Strategy Cloud Scalability Artificial Intelligence 147

Brendan Gregg

NOVEMBER 29, 2017

Hardware virtualization for cloud computing has come a long way, improving performance using technologies such as VT-x, SR-IOV, VT-d, NVMe, and APICv. The latest AWS hypervisor, Nitro, uses everything to provide a new hardware-assisted hypervisor that is easy to use and has near bare-metal performance.

Virtualization 111

Virtualization AWS Hardware Storage 111

Dynatrace

NOVEMBER 11, 2020

Deployment performs the whole rollout, instrumentation, configuration, connection, and automatic detection of monitored entities in your environment. Easier rollout thanks to log storage best practices. Easier rollout thanks to log storage best practices. Advanced customization of OneAgent deployments made easy.

Best Practices 196

Best Practices Storage Java Benchmarking 196

The Netflix TechBlog

NOVEMBER 15, 2022

But it’s not easy: to pull this off, VFX studios need to build and operate serious technical infrastructure (compute, storage, networking, and software licensing), otherwise known as a “ render farm.” Many shows have needs that exceed 100,000 frames, so aggregate rendering time can impact the timely delivery of a show on Netflix.

Cloud 282

Cloud Entertainment AWS Infrastructure 282

Percona

OCTOBER 18, 2023

Community support One of the most significant advantages of open source databases is the expansive global community of users, developers, DBAs, and enthusiasts who collaborate to provide a seemingly never-ending array of how-tos, resources, guidance, and solutions to help you make your database more performant and secure.

Open Source 97

Open Source Database Hardware Strategy 97

Percona

FEBRUARY 24, 2023

Figure 1: PMM Home Dashboard From the Amazon Web Services (AWS) documentation , an instance is considered over-provisioned when at least one specification of your instance, such as CPU, memory, or network, can be sized down while still meeting the performance requirements of your workload and no specification is under-provisioned.

Cloud 123

Cloud Serverless AWS Storage 123