Percona

MAY 1, 2023

Default settings can help you get started quickly – but they can also cost you performance and a higher cloud bill at the end of the month. I’ll show you some MySQL settings to tune to get better performance, and cost savings, with AWS RDS. Want to save money on your AWS RDS bill? IOPs) required by MySQL.

AWS 124

AWS Hardware Storage Tuning 124

The Morning Paper

NOVEMBER 5, 2019

File systems unfit as distributed storage backends: lessons from 10 years of Ceph evolution Aghayev et al., In this case, the assumption that a distributed storage backend should clearly be layered on top of a local file system. What is a distributed storage backend? SOSP’19. This is not surprising in hindsight.

Storage 64

Storage Systems Hardware Efficiency 64

The Morning Paper

OCTOBER 4, 2020

Understanding operational 5G: a first measurement study on its coverage, performance and energy consumption , Xu et al., Three different 5G phones are used, including a ZTE Axon10 Pro with powerful communication (SDX 50 5G modem) and compute (Qualcomm Snapdragon TM855) capabilities together with 256GB of storage. SIGCOMM’20.

Energy 130

Energy Latency Performance Network 130

Brendan Gregg

JULY 4, 2021

It's an exciting time for developments in computer performance, not just for the BPF technology (which I often [write about]) but also for processors with 3D stacking and cloud vendor CPUs (e.g., This was a chance to talk about other things I've been working on, such as the present and future of hardware performance.

Performance 52

Performance Latency Hardware Storage 52

Brendan Gregg

FEBRUARY 28, 2023

At USENIX SREcon22 APAC I gave the opening keynote on the future of computer performance, rounding up the latest developments and making predictions of where I see things heading. This talk originated from my updates to Systems Performance 2nd Edition , and this was the first time I've given this talk in person!

Performance 52

Performance Latency Cache Virtualization 52

Scalegrid

FEBRUARY 8, 2024

A distributed storage system is foundational in today’s data-driven landscape, ensuring data spread over multiple servers is reliable, accessible, and manageable. Understanding distributed storage is imperative as data volumes and the need for robust storage solutions rise.

Storage 130

Storage Systems Big Data Azure 130

The Morning Paper

JUNE 13, 2019

As we saw with the SOAP paper last time out, even with a fixed model variant and hardware there are a lot of different ways to map a training workload over the available hardware. “ For instance, Facebook applications issue tens-of-trillions of inference queries per day with varying performance, accuracy, and cost constraints.”

Hardware 58

Hardware Latency Serverless Energy 58

The Morning Paper

JANUARY 30, 2020

Edge servers are the middle ground – more compute power than a mobile device, but with latency of just a few ms. These use their regression models to estimate processing time (which will depend on the hardware available, current load, etc.). Why would we want to live migrate web workers? Is the migration worth it though?

Mobile 104

Mobile Cloud Latency Games 104

Percona

MARCH 23, 2023

This blog is in reference to our previous ones for ‘Innodb Performance Optimizations Basics’ 2007 and 2013. Although there have been many blogs about adjusting MySQL variables for better performance since then, I think this topic deserves a blog update since the last update was a decade ago, and MySQL 5.7

Performance 128

Performance Hardware Tuning Storage 128

Dotcom-Montior

OCTOBER 6, 2021

trying to reduce the amount of manual work and ensuring all the components (infrastructure/hardware, middleware, software, etc.) Performance. One minute an SRE might be provisioning storage in AWS, the next minute an SRE might have to talk to customers or go write some Python code for a new project. Availability. Monitoring.

Engineering 67

Engineering DevOps Monitoring Google 67

Abhishek Tiwari

DECEMBER 27, 2017

faster access to external storage and data locality (I/O, bandwidth). overall performance comparable to bare metal. The good news is all of these challenges including performance can be tackled and in several cases, there are new developments to overcome them. Performance. Storage provisioning. Native frameworks.

Big Data 63

Big Data Storage Benchmarking Hardware 63

Scalegrid

DECEMBER 21, 2023

Buckle up as we delve into the world of Redis® monitoring, exploring the most important Redis® metrics, discussing essential tools, and even peering into the future of Redis® performance management. Key Takeaways Redis® monitoring is essential for safeguarding performance, reliability, and security.

Strategy 130

Strategy Monitoring Latency DevOps 130

Abhishek Tiwari

JULY 12, 2018

These nodes and edges require a good amount of compute and storage which is typically distributed across a large number servers either running in the cloud or your own data center. A data pipeline is a software which runs on hardware. The software is error-prone and hardware failures are inevitable.

Latency 63

Latency Analytics Scalability Engineering 63

All Things Distributed

JULY 13, 2010

Cluster Computer Instances for Amazon EC2 are a new instance type specifically designed for High Performance Computing applications. In those days, my main goal was to take the advances in building the highly dedicated High Performance Cluster environments and turn them into commodity technologies for the enterprise to use.

Cloud 118

Cloud AWS Automotive Latency 118

Dynatrace

JUNE 25, 2020

The network latency between cluster nodes should be around 10 ms or less. Our Premium High Availability comes with the following features: Active-active deployment model for optimum hardware utilization. – A Dynatrace customer, Head of Performance Engineering. A similar analysis can be performed on your GRO.

Availability 247

Availability Hardware Latency Traffic 247

HammerDB

DECEMBER 5, 2020

A full understanding of why this is important requires some knowledge of the evolution of database hardware and software. The HammerDB TPROC-C workload by design intended as CPU and memory intensive workload derived from TPC-C – so that we get to benchmark at maximum CPU performance at a much smaller database footprint.

C++ 40

C++ Benchmarking Virtualization Open Source 40

The Morning Paper

JANUARY 28, 2020

Narrowing the gap between serverless and its state with storage functions , Zhang et al., Shredder is " a low-latency multi-tenant cloud store that allows small units of computation to be performed directly within storage nodes. " High performance. SoCC’19. "Narrowing Introducing Shredder.

Serverless 99

Serverless Storage Latency Cloud 99

Highly Scalable

AUGUST 20, 2013

This system has been designed to supplement and succeed the existing Hadoop-based system that had too high latency of data processing and too high maintenance costs. The pipelines can be stateful and the engine’s middleware should provide a persistent storage to enable state checkpointing. High performance and mobility.

Big Data 154

Big Data Processing Lambda Database 154

SQL Performance

APRIL 27, 2020

The basic tier provides up to 5 DTUs with standard storage. The standard tier supports from 10 up to 3000 DTUs with standard storage and the premium tier supports 125 up to 4000 DTUs with premium storage, which is orders of magnitude faster than standard storage. New Hardware Configuration for Provisioned Compute Tier.

Azure 55

Azure Database Serverless Hardware 55

The Netflix TechBlog

FEBRUARY 9, 2021

Server-generated assets, since client-side generation would require the retrieval of many individual images, which would increase latency and time-to-render. To reduce latency, assets should be generated in an offline fashion and not in real time. This requires an asset storage solution.

Engineering 165

Engineering Storage Latency Entertainment 165

Alex Russell

MARCH 6, 2021

Back in 2016, I gave a talk outlining the causes and effects of the terrible performance of web apps built using popular tools on the fastest-growing device segment: low-end to mid-range Android phones. Poor performance has a compound effect on user expectations at an ecosystem level. Live by the link, die by the link.

Performance 124

Performance Network Cache Metrics 124

All Things Distributed

MARCH 11, 2016

Looking back over the past 10 years, there are hundreds of lessons that we’ve learned about building and operating services that need to be secure, reliable, scalable, with predictable performance at the lowest possible cost. This is a given, whether you are using the highest quality hardware or lowest cost components.

AWS 144

AWS Hardware Retail Virtualization 144

Dotcom-Montior

MAY 12, 2020

Websites are now more than just the storage and retrieval of information to present content to users. Web monitoring is a comprehensive term that describes the activity of testing a website or web application for its availability and performance. HTTP monitoring allows you to test availability and performance from around the world.

Monitoring 63

Monitoring Entertainment Hardware Latency 63

Percona

JULY 1, 2023

Understanding DBaaS DBaaS cloud services allow users to use databases without configuring physical hardware and infrastructure or installing software. These may be performance, high availability, operational cost, management, capacity planning, scalability, security, monitoring, etc.

AWS 52

AWS Database Serverless Storage 52

The Morning Paper

DECEMBER 8, 2019

At the start of November I was privileged to attend HPTS (the High Performance Transaction Systems) conference in Asilomar. Byte-addressable non-volatile memory,) NVM will fundamentally change the way hardware interacts, the way operating systems are designed, and the way applications operate on data. PLOS’19.

Hardware 56

Hardware Programming Media Storage 56

HammerDB

OCTOBER 12, 2018

This post complements the previous best practice guides this time with the focus on MySQL and MariaDB and achieving top levels of performance with the HammerDB MySQL TPC-C test. As is exactly the same with PostgreSQL for system choice a 2 socket system is optimal for MySQL OLTP performance. hardware limits: 1000 MHz - 3.80

Best Practices 40

Best Practices Scalability Performance C++ 40

The Morning Paper

MARCH 17, 2020

Based on these findings, the authors present four guidelines to get the best performance out of this memory today. The data we have collected demonstrate that many of the assumptions that researchers have made about how NVDIMMs would behave and perform are incorrect. Understanding Optane DIMM performance. Optane DIMMs are here!

Scalability 59

Scalability Latency Cache Media 59

Alex Russell

APRIL 29, 2021

Classics of the genre include: Apple's just focused on performance! The Performance Argument. As an engineer on a browser team, I'm privy to the blow-by-blow of various performance projects, benchmark fire drills, and the ways performance marketing (deeply) impacts engineering priorities. Steve & Tim's Close-up Magic.

Media 145

Media Games Education Engineering 145

Percona

APRIL 17, 2023

Note that the intent of tuning the settings is not exclusively about improving performance but also enhancing the high availability and resilience of the MongoDB database. The CFQ works well for many general use cases but lacks latency guarantees. The goal is to reduce memory usage without impacting query performance negatively.

Best Practices 52

Best Practices Design Tuning Database 52

Alex Russell

OCTOBER 22, 2017

TL;DR: performance budgets are an essential but under-appreciated part of product success and team health. Nobody is trying to do a poor job, and yet the results of a “completed” PWA project often require weeks or months of painstaking rework to deliver minimally acceptable performance. Partner meetings are illuminating.

Performance 68

Performance Benchmarking Network Mobile 68

Abhishek Tiwari

DECEMBER 27, 2017

It offers reliability and performance of a data warehouse, real-time and low-latency characteristics of a streaming system, and scale and cost-efficiency of a data lake. Delta implements the unified data management layer by extending the Amazon S3 object storage for ACID transactions and automatic data indexing.

Big Data 49

Big Data Artificial Intelligence Storage Hardware 49

All Things Distributed

JANUARY 18, 2012

Amazon DynamoDB is a fully managed NoSQL database service that provides fast performance at any scale. Amazon DynamoDB offers low, predictable latencies at any scale. It is very gratifying to see all of our learning and experience become available to our customers in the form of an easy-to-use managed service. The growth of Amazonâ??s

Scalability 167

Scalability Database Ecommerce Latency 167

SQL Server According to Bob

JANUARY 11, 2020

This will help you increase system performance and avoid I/O environment errors. Atomicity A transaction must be an atomic unit of work; either all of its data modifications are performed or none of them are performed. Consistency When completed, a transaction must leave all data in a consistent state.

Servers 40

Servers Cache Media Hardware 40

The Morning Paper

MARCH 3, 2020

It takes you through the thinking processes and engineering practices behind the design of a key part of the control plane for AWS Elastic Block Storage (EBS): the Physalia database that stores configuration information. This work is latency critical, because volume IO is blocked until it is complete. This paper is a real joy to read.

Database 106

Database AWS Network Design 106

The Morning Paper

MAY 28, 2019

The goal is to produce a low-energy hardware classifier for embedded applications doing local processing of sensor data. The resulting system can integrate seamlessly into a scikit-learn based development process, and dramatically reduces the total energy usage required for classification with very low latency. Introducing race logic.

Energy 52

Energy Hardware Efficiency Architecture 52

Highly Scalable

SEPTEMBER 18, 2012

Historically, NoSQL paid a lot of attention to tradeoffs between consistency, fault-tolerance and performance to serve geographically distributed systems, low-latency or highly available applications. A database should accommodate itself to different data distributions, cluster topologies and hardware configurations.

Database 213

Database Latency C++ Scalability 213

All Things Distributed

NOVEMBER 15, 2010

This incredible power is available for anyone to use in the usual pay-as-you-go model, removing the investment barrier that has kept many organizations from adopting GPUs for their workloads even though they knew there would be significant performance benefit. General Purpose GPU programming.

AWS 136

AWS Latency Programming Architecture 136