Brendan Gregg

FEBRUARY 28, 2023

At USENIX SREcon22 APAC I gave the opening keynote on the future of computer performance, rounding up the latest developments and making predictions of where I see things heading. This talk originated from my updates to Systems Performance 2nd Edition , and this was the first time I've given this talk in person!

Performance 52

Performance Latency Cache Virtualization 52

Scalegrid

JULY 17, 2020

Wave 1: PostgreSQL 9.2 (2012) added support for JSON data type. JSONB storage has some drawbacks vs. traditional columns: PostreSQL does not store column statistics for JSONB columns. JSONB storage results in a larger storage footprint. JSONB storage does not deduplicate the key names in the JSON.

Storage 321

Storage Database Efficiency Processing 321

All Things Distributed

OCTOBER 2, 2017

We were pushing the limits of what was a leading commercial database at the time and were unable to sustain the availability, scalability and performance needs that our growing Amazon business demanded. Performant – The service would need to be able to maintain consistent performance in the face of diverse customer workloads.

Internet 130

Internet Internet AWS Performance 130

Percona

JUNE 6, 2023

This blog was originally published in January 2012 and was updated in June 2023. Depending on an organization’s specific requirements, legal or otherwise, full backups are typically performed periodically, such as daily, weekly, or monthly. What is an incremental backup?

Storage 67

Storage Strategy Network Efficiency 67

All Things Distributed

JULY 19, 2012

High Performance I/O Instances for Amazon EC2. By Werner Vogels on 19 July 2012 12:00 AM. These include the likes of high performance computation, for which we introduced the Cluster Compute and Cluster GPU instance types. Databases are one particular area that for scaling can benefit tremendously from high performance I/O.

Cloud 129

Cloud Performance AWS Virtualization 129

All Things Distributed

OCTOBER 8, 2014

The best part is that we are also significantly expanding the free tier many of you already enjoy by increasing the storage to 25 GB and throughput to 200 million requests per month. More than a decade ago, Amazon embarked on a mission to build a distributed system that challenged conventional methods of data storage and querying.

Availability 145

Availability Performance Scalability AWS 145

Brendan Gregg

NOVEMBER 29, 2017

Hardware virtualization for cloud computing has come a long way, improving performance using technologies such as VT-x, SR-IOV, VT-d, NVMe, and APICv. The latest AWS hypervisor, Nitro, uses everything to provide a new hardware-assisted hypervisor that is easy to use and has near bare-metal performance.

Virtualization 111

Virtualization AWS Hardware Storage 111

All Things Distributed

NOVEMBER 28, 2012

By Werner Vogels on 28 November 2012 09:00 AM. Amazon Redshift enables customers to obtain dramatically increased query performance when analyzing datasets ranging in size from hundreds of gigabytes to a petabyte or more, using the same SQL-based business intelligence tools they use today. Comments (). Amazon Redshiftâ?? Amazon.comâ??s

Cloud 164

Cloud Storage Architecture Scalability 164

SQL Performance

MAY 16, 2019

Achieving minimal logging using INSERT.SELECT into an empty clustered index target is not quite as simple as described in the Data Performance Loading Guide. The Data Loading Performance Guide contains a high-level summary of the conditions required for minimal logging into clustered tables: This post is concerned with the top row only.

Cache 67

Cache Servers Testing Storage 67

Percona

JUNE 4, 2023

MariaDB retains compatibility with MySQL, offers support for different programming languages, including Python, PHP, Java, and Perl, and works with all major open source storage engines such as MyRocks, Aria, and InnoDB. Elevate your MariaDB environment with Percona Support for MariaDB. Contact us to learn more!

Open Source 52

Open Source Servers Storage Scalability 52

All Things Distributed

SEPTEMBER 25, 2012

By Werner Vogels on 25 September 2012 06:00 PM. Following the huge success of being able to provision a consistent, user-requested I/O rate for DynamoDB and Elastic Block Store (EBS), the AWS Database Services team has now released Provisioned IOPS, a new high performance storage option for the Amazon Relational Database Service (Amazon RDS).

Cloud 118

Cloud AWS Storage Database 118

All Things Distributed

MAY 8, 2012

By Werner Vogels on 08 May 2012 02:00 PM. of administrative tasks such as OS and database software patching, storage management, and implementing reliable backup and disaster recovery solutions. Amazon RDS currently supports SQL Server 2008 R2 and plans to add support for SQL Server 2012 later this year. All Things Distributed.

Cloud 116

Cloud Development AWS Servers 116

All Things Distributed

DECEMBER 27, 2012

By Werner Vogels on 27 December 2012 12:00 PM. S3 is not only a highly reliable and available storage service but also one of the most powerful web serving engines that exists today. S3 is not only a highly reliable and available storage service but also one of the most powerful web serving engines that exists today.

Website 127

Website Traffic Storage Scalability 127

SQL Performance

MAY 1, 2019

This is reflected in the summary tables included in the Data Loading Performance Guide and the Tiger Team post. As noted in the Data Loading Performance Guide , bulk loading with INSERT.SELECT takes an exclusive X lock on the table, not the bulk update BU lock required for concurrent bulk loads. Introduction. Target table row size.

Servers 47

Servers Database Testing Performance 47

All Things Distributed

FEBRUARY 15, 2013

As you may remember from our announcement at re: Invent in November 2012, Amazon Redshift is a fast and powerful, fully managed, petabyte-scale data warehouse service that delivers fast query performance at less than one tenth the cost of most traditional data warehouse systems. Performance is important, but it just doesnâ??t

Design 112

Design AWS Storage Systems 112

SQL Server According to Bob

SEPTEMBER 26, 2016

When we released Always On Availability Groups in SQL Server 2012 as a new and powerful way to achieve high availability, hardware environments included NUMA machines with low-end multi-core processors and SATA and SAN drives for storage (some SSDs). The rapid acceleration in technology brought on a new discovery and paradigm.

Availability 40

Availability Servers Hardware Benchmarking 40

All Things Distributed

JUNE 21, 2017

DynamoDB has come a long way in the 5 years since we announced its availability in January 2012. DynamoDB was the first service at AWS to use SSD storage. It delivers predictable performance, consistently in the single-digit milliseconds, to users of some of the largest, most popular, iconic applications in use today.

Speed 123

Speed Cache Latency AWS 123

Brendan Gregg

NOVEMBER 28, 2017

Hardware virtualization for cloud computing has come a long way, improving performance using technologies such as VT-x, SR-IOV, VT-d, NVMe, and APICv. The latest AWS hypervisor, Nitro, uses everything to provide a new hardware-assisted hypervisor that is easy to use and has near bare-metal performance.

Virtualization 40

Virtualization AWS Hardware Storage 40

SQL Server According to Bob

JUNE 3, 2016

. ‘It Just Runs Faster’ – Out of the box SQL Server 2016 DBCC provides you better performance, scale while shrinking your maintenance window(s.). The DBCC CheckDB demonstration loads a table and demonstrates the performance improvement. 32GB RAM, 4 Core Hyper-threaded enabled 2.8Ghz, SSD Storage. SQL Server.

Hardware 40

Hardware Cache Servers Software Engineering 40

All Things Distributed

JANUARY 18, 2012

By Werner Vogels on 18 January 2012 07:00 AM. Amazon DynamoDB is a fully managed NoSQL database service that provides fast performance at any scale. In response, we began to develop a collection of storage and database technologies to address the demanding scalability and reliability requirements of the Amazon.com ecommerce platform.

Scalability 167

Scalability Database Ecommerce Latency 167

All Things Distributed

APRIL 5, 2012

By Werner Vogels on 06 April 2012 06:00 AM. Going forward well continue to employ a hybrid approach using RDS for the necessary transactional computation and services like DynamoDB for high performance and scalability for structured data. Werner Vogels weblog on building scalable and robust distributed systems. Comments ().

Innovation 149

Innovation AWS Education Network 149

All Things Distributed

AUGUST 16, 2012

By Werner Vogels on 16 August 2012 10:00 AM. An apples to apples comparison of the costs associated with running various usage patterns on-premises and with AWS requires more than a simple comparison of hardware expense versus always-on utility pricing for compute and storage. All Things Distributed. Comments ().

AWS 118

AWS Hardware Traffic Best Practices 118

SQL Performance

AUGUST 23, 2019

In traditional row-mode execution plans, SQL Server may introduce a Bitmap operator as part of performing early semi join reduction before a parallel hash or merge join. There have been major improvements since the first appearance of the batch mode execution engine in SQL Server 2012. Background. Simple Bitmaps.

Servers 75

Servers Engineering Efficiency Retail 75

SQL Performance

APRIL 23, 2019

In SQL Server 2012, grouped (vector) aggregation was able to use parallel batch-mode execution, but only for the partial (per-thread) aggregate. SQL Server 2014 added the ability to perform parallel batch-mode grouped aggregation within a single Hash Match Aggregate operator. Columnstore storage. Introduction.

Servers 67

Servers Testing Metrics Storage 67

Smashing Magazine

NOVEMBER 8, 2018

In this article, I will describe this latter solution, based on a WordPress application storing files on Amazon Web Services (AWS) Simple Storage Service (S3) (a cloud object storage solution to store and retrieve data), operating through the AWS SDK. Conclusion.

AWS 44

AWS Servers Storage Cloud 44

ScaleOut Software

MAY 15, 2014

For example, the IMDG must be able to efficiently create millions of objects in each server to make use of its huge storage capacity. In addition to looking at performance differences, we also want to compare ScaleOut StateServer (SOSS) to AppFabric on qualitative measures, such as features, ease of installation, and management.

Cache 40

Cache Servers Network Design 40

Alex Russell

JULY 14, 2021

Engine diversity is essential, as it is the mechanism that causes competition to deliver better performance, capability, privacy, security, and user controls. Here, native apps are doing work related to their core function; storage and tracking of user data are squarely within the four corners of the app's natural responsibilities.

Google 121

Google Mobile Engineering Internet 121

Percona

JANUARY 14, 2019

With the latest ClickHouse version, all of these features are available, but some of them may not perform fast enough. In a partitioned massively parallel database system, the storage format and sorting algorithm may not be optimized for that operation as we are reading multiple partitions in parallel. Deleting messages. Text search.

Database 40

Database Analytics Blockchain Healthcare 40

O'Reilly

SEPTEMBER 19, 2023

It progressed from “raw compute and storage” to “reimplementing key services in push-button fashion” to “becoming the backbone of AI work”—all under the umbrella of “renting time and storage on someone else’s computers.” ” (It will be easier to fit in the overhead storage.)

Hardware 99

Hardware Storage Big Data Blockchain 99

O'Reilly

JULY 25, 2023

To provide some coherence to the music, I decided to use Taylor Swift songs since her discography covers the time span of most papers that I typically read: Her main albums were released in 2006, 2008, 2010, 2012, 2014, 2017, 2019, 2020, and 2022. This choice also inspired me to call my project Swift Papers.

Programming 98

Programming Code Design Benchmarking 98