2010, Design, Storage and Systems - Technology Performance Pulse

USENIX SREcon APAC 2022: Computing Performance: What's on the Horizon

Brendan Gregg

FEBRUARY 28, 2023

This talk originated from my updates to [Systems Performance 2nd Edition], and this was the first time I've given this talk in person! CXL in a way allows a custom memory controller to be added to a system, to increase memory capacity, bandwidth, and overall performance. Ford, et al., “TCP

Performance

Performance Latency Cache Virtualization

USENIX LISA2021 Computing Performance: On the Horizon

Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on. I also wrote about these topics in detail for my recent [Systems Performance 2nd Edition] book.

Performance

Performance Latency Hardware Storage

The Ultimate Guide to Open Source Databases

Percona

MARCH 30, 2023

Further, open source databases can be modified in infinite ways, enabling institutions to meet their specific needs for data storage, retrieval, and processing. Non-relational databases: Instead of tables, non-relational (NoSQL) databases use document-based data storage, column-oriented storage, and graph databases.

Open Source

Open Source Database Storage Scalability

USENIX SREcon APAC 2022: Computing Performance: What's on the Horizon

Brendan Gregg

FEBRUARY 28, 2023

This talk originated from my updates to Systems Performance 2nd Edition , and this was the first time I've given this talk in person! CXL in a way allows a custom memory controller to be added to a system, to increase memory capacity, bandwidth, and overall performance. Ford, et al., “TCP

Performance

Performance Latency Cache Virtualization

MariaDB vs MySQL: Key Differences and Use Cases

Percona

JUNE 4, 2023

Before we dive into the differences between MariaDB and MySQL, we will provide a thorough examination of each relational database management system (RDBMS). While originally designed to be a drop-in replacement for MySQL, it evolved into its own distinct database management system and is now maintained and supported by the MariaDB Foundation.

Open Source

Open Source Servers Storage Scalability

Which Is the Best PostgreSQL GUI? 2019 Comparison

Scalegrid

SEPTEMBER 16, 2019

PostgreSQL is the fourth most popular database management system in the world, and heavily used in all sizes of applications from small to large. I believe anyone who comes to programming after 2010 will tell you GUI tools increase their productivity over a CLI solution. Easier access to files, features, and the operating system.

Open Source

Open Source Database Azure Cloud

USENIX LISA2021 Computing Performance: On the Horizon

Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on. I also wrote about these topics in detail for my recent [Systems Performance 2nd Edition] book.

Performance

Performance Latency Hardware Storage

Expanding the Cloud - AWS Import/Export Support for Amazon EBS.

All Things Distributed

JULY 7, 2011

Werner Vogels weblog on building scalable and robust distributed systems. AWS Import/Export transfers data off of storage devices using Amazons high-speed internal network and bypassing the Internet. Amazon Import/Export is an important tool for customers to accelerate moving large amounts of data into the AWS storage systems.

AWS

AWS Cloud Storage Internet

No Server Required - Jekyll & Amazon S3 - All Things Distributed

All Things Distributed

AUGUST 17, 2011

Werner Vogels weblog on building scalable and robust distributed systems. As some of you may remember I was pretty excited when Amazon Simple Storage Service (S3) released its website feature such that I could serve this weblog completely from S3. Driving Storage Costs Down for AWS Customers. All Things Distributed.

Servers

Servers Social Media AWS Website

Expanding the Cloud with DNS - Introducing Amazon Route 53 - All.

All Things Distributed

DECEMBER 5, 2010

Werner Vogels weblog on building scalable and robust distributed systems. By Werner Vogels on 05 December 2010 02:00 PM. I am very excited that today we have launched Amazon Route 53, a high-performance and highly-available Domain Name System (DNS) service. Naming is one of the fundamental concepts in Distributed Systems.

Cloud

Cloud Internet Internet AWS

DROAM - Dreaming about Cheap Data Roaming - All Things.

All Things Distributed

JANUARY 11, 2011

Werner Vogels weblog on building scalable and robust distributed systems. I received one of these devices and tested it for the last three months of 2010 when I was almost continuously on the road. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. All Things Distributed.

Wireless

Wireless AWS Internet Internet

Job Openings in AWS - Senior Leader in Database Services - All.

All Things Distributed

AUGUST 19, 2011

Werner Vogels weblog on building scalable and robust distributed systems. AWS Database Services is responsible for setting the database strategy and delivering distributed structured storage services to our AWS customers. The ideal candidate will be someone who has built and ran large scale distributed systems and/or databases.

AWS

AWS Database Storage Scalability

Expanding the Cloud - Introducing Amazon ElastiCache - All Things.

All Things Distributed

AUGUST 22, 2011

Werner Vogels weblog on building scalable and robust distributed systems. Systems that make extensive use of caching almost all report a significant reduction in the cost of their database tier. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. All Things Distributed.

Cloud

Cloud Cache AWS Storage

Introducing the AWS South America - All Things Distributed

All Things Distributed

DECEMBER 14, 2011

Werner Vogels weblog on building scalable and robust distributed systems. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. The Amazon.com 2010 Shareholder Letter Focusses on Technology.

AWS

AWS Latency Storage Big Data

Expanding the Cloud - Cluster Compute Instances for Amazon EC2.

All Things Distributed

JULY 13, 2010

Werner Vogels weblog on building scalable and robust distributed systems. By Werner Vogels on 12 July 2010 05:00 PM. Cluster Computer Instances for Amazon EC2 are a new instance type specifically designed for High Performance Computing applications. Not just for HPC but for mission critical enterprise systems such as OLTP.

Cloud

Cloud AWS Automotive Latency

Hacking with AWS at The Next Web Hackaton - All Things Distributed

All Things Distributed

MARCH 24, 2011

Werner Vogels weblog on building scalable and robust distributed systems. Up to 200 developers and designers will get together to hack up interesting applications using the Internets APIs and SDKs. If you want to be that team of 5-7 developer/designers you can sign up using this form. All Things Distributed. Comments ().

AWS

AWS Internet Internet Storage

Reboot - All Things Distributed

All Things Distributed

SEPTEMBER 29, 2010

Werner Vogels weblog on building scalable and robust distributed systems. By Werner Vogels on 29 September 2010 07:50 AM. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Comments ().

AWS

AWS Storage Big Data Scalability

Expanding the Cloud - Introducing the AWS Asia Pacific (Tokyo.

All Things Distributed

MARCH 2, 2011

Werner Vogels weblog on building scalable and robust distributed systems. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. The Amazon.com 2010 Shareholder Letter Focusses on Technology.

AWS

AWS Cloud Games Latency

Driving Bandwidth Cost Down for AWS Customers. - All Things.

All Things Distributed

JUNE 29, 2011

Werner Vogels weblog on building scalable and robust distributed systems. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. The Amazon.com 2010 Shareholder Letter Focusses on Technology.

AWS

AWS Retail Innovation Strategy

Free at Last - A Fully Self-Sustained Blog Running in Amazon S3.

All Things Distributed

FEBRUARY 23, 2011

Werner Vogels weblog on building scalable and robust distributed systems. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. The Amazon.com 2010 Shareholder Letter Focusses on Technology.

AWS

AWS Storage Big Data Servers

This week in review: GPUs, Zombies, Biomimicry and Tom Waits.

All Things Distributed

NOVEMBER 19, 2010

Werner Vogels weblog on building scalable and robust distributed systems. By Werner Vogels on 19 November 2010 07:51 AM. for November 2010 was released and an Amazon EC2 Cluster Compute Instance based cluster came in at #231. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway.

AWS

AWS Cloud Benchmarking Storage

From the Archives - Gapingvoid's Nobody Cares - All Things.

All Things Distributed

FEBRUARY 27, 2011

Werner Vogels weblog on building scalable and robust distributed systems. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. The Amazon.com 2010 Shareholder Letter Focusses on Technology.

AWS

AWS Storage Big Data Scalability

I am looking for new application and platform services - All Things.

All Things Distributed

APRIL 23, 2010

Werner Vogels weblog on building scalable and robust distributed systems. By Werner Vogels on 22 April 2010 05:17 PM. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Comments ().

AWS

AWS Storage Cloud Big Data

Expanding the Cloud - New AWS Region: US-West (Northern.

All Things Distributed

DECEMBER 3, 2009

Werner Vogels weblog on building scalable and robust distributed systems. As we announced earlier this month a Region with multiple Availability Zones will come online in Singapore in the first half of 2010, with other regions in Asia to follow later in 2010. Driving Storage Costs Down for AWS Customers. Comments ().

AWS

AWS Cloud Latency Storage

AWS Elastic Beanstalk: A Quick and Simple Way into the Cloud - All.

All Things Distributed

JANUARY 19, 2011

Werner Vogels weblog on building scalable and robust distributed systems. Flexibility is one of the key principles of Amazon Web Services - developers can select any programming language and software package, any operating system, any middleware and any database to build systems and applications that meet their requirements.

AWS

AWS Cloud Java Operating System

Driving down the cost of Big-Data analytics - All Things Distributed

All Things Distributed

AUGUST 18, 2011

Werner Vogels weblog on building scalable and robust distributed systems. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. The Amazon.com 2010 Shareholder Letter Focusses on Technology.

Big Data

Big Data Analytics AWS Cloud

Around the World in 28 Days - All Things Distributed

All Things Distributed

SEPTEMBER 30, 2010

Werner Vogels weblog on building scalable and robust distributed systems. By Werner Vogels on 30 September 2010 04:27 AM. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Comments ().

AWS

AWS Storage Cloud Best Practices

The Amazon.com 2010 Shareholder Letter Focusses on Technology.

All Things Distributed

APRIL 27, 2011

Werner Vogels weblog on building scalable and robust distributed systems. The Amazon.com 2010 Shareholder Letter Focusses on Technology. In the 2010 Shareholder Letter Jeff Bezos writes about the unique technologies developed at Amazon.com over the years. All Things Distributed. By Werner Vogels on 27 April 2011 12:51 AM.

Technology

Technology Technology AWS Storage

Spot Instances - Increased Control - All Things Distributed

All Things Distributed

JULY 11, 2011

Werner Vogels weblog on building scalable and robust distributed systems. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. The Amazon.com 2010 Shareholder Letter Focusses on Technology.

AWS

AWS Storage Cloud Big Data

Speed Up Your Website With WebP

Smashing Magazine

OCTOBER 29, 2019

Considering how important images are to web design, this isn’t an element we can dispose of so easily nor can we afford to cut corners when it comes to optimizing them. Here’s what Google suggests: PageSpeed Insights demonstrates how much storage and bandwidth websites stand to save with WebP. So, what’s the solution? What is WebP?

Website

Website Speed Cache Google

New Route 53 and ELB features: IPv6, Zone Apex, WRR and more.

All Things Distributed

MAY 24, 2011

Werner Vogels weblog on building scalable and robust distributed systems. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. The Amazon.com 2010 Shareholder Letter Focusses on Technology.

Internet

Internet Internet AWS Scalability

APAC Summer Tour - All Things Distributed

All Things Distributed

JULY 3, 2011

Werner Vogels weblog on building scalable and robust distributed systems. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. The Amazon.com 2010 Shareholder Letter Focusses on Technology.

AWS

AWS Storage Cloud Big Data

Expanding the Cloud - Opening the AWS Asia Pacific (Singapore.

All Things Distributed

APRIL 28, 2010

Werner Vogels weblog on building scalable and robust distributed systems. By Werner Vogels on 28 April 2010 11:00 AM. You need to be able to place your systems in locations where you can minimize the distance to your most important customers. Driving Storage Costs Down for AWS Customers. All Things Distributed.

AWS

AWS Cloud Latency Storage

The AWS GovCloud (US) Region - All Things Distributed

All Things Distributed

AUGUST 16, 2011

Werner Vogels weblog on building scalable and robust distributed systems. The Cloud First strategy is most visible with new Federal IT programs, which are all designed to be â??Cloud Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. All Things Distributed. Comments ().

AWS

AWS Government Big Data Cloud

Should You Use ClickHouse as a Main Operational Database?

Percona

JANUARY 14, 2019

In a partitioned massively parallel database system, the storage format and sorting algorithm may not be optimized for that operation as we are reading multiple partitions in parallel. ClickHouse is a great massively parallel analytical system. At the same time, it was not originally designed that way. Conclusion.

Database

Database Analytics Blockchain Healthcare

Powerful New Amazon EC2 Boot Features - All Things Distributed

All Things Distributed

DECEMBER 3, 2009

Werner Vogels weblog on building scalable and robust distributed systems. A wide variety of operating systems and software configurations is available for use. with more memory or CPU), a different operating system (e.g., Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway.

AWS

AWS Storage Operating System Cloud

The Performance Inequality Gap, 2021

Alex Russell

MARCH 6, 2021

A then-representative $200USD device had 4-8 slow (in-order, low-cache) cores, ~2GiB of RAM, and relatively slow MLC NAND flash storage. Chip design choices and silicon economics are the defining feature of the still-growing Performance Inequality Gap. The Moto G4 , for example. Don't pay a lot for an Android-shaped muffler.

Performance

Performance Network Cache Metrics

Expanding the Cloud - Amazon EC2 Spot Instances - All Things.

All Things Distributed

DECEMBER 13, 2009

Werner Vogels weblog on building scalable and robust distributed systems. Consistently we have lowered compute, storage and bandwidth prices based on such cost savings. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. All Things Distributed. Comments (). or rss feed.

Cloud

Cloud AWS Storage Innovation

Structural Evolutions in Data

O'Reilly

SEPTEMBER 19, 2023

It progressed from “raw compute and storage” to “reimplementing key services in push-button fashion” to “becoming the backbone of AI work”—all under the umbrella of “renting time and storage on someone else’s computers.” ” (It will be easier to fit in the overhead storage.)

Hardware

Hardware Storage Big Data Blockchain

Expanding the Cloud - Amazon S3 Reduced Redundancy Storage.

All Things Distributed

MAY 18, 2010

Werner Vogels weblog on building scalable and robust distributed systems. Expanding the Cloud - Amazon S3 Reduced Redundancy Storage. By Werner Vogels on 18 May 2010 04:00 PM. Today a new storage option for Amazon S3 has been launched: Amazon S3 Reduced Redundancy Storage (RRS). Comments ().

Storage

Storage Cloud AWS Scalability

Amazon Cloudfront is Streaming Media 2010 Editor's pick - All.

All Things Distributed

APRIL 19, 2010

Werner Vogels weblog on building scalable and robust distributed systems. Amazon Cloudfront is Streaming Media 2010 Editors pick. By Werner Vogels on 19 April 2010 03:02 AM. I am excited that Amazon Cloudfront has been selected as one of the 10 Editors pick of 2010 by Streaming Media. Comments (). or rss feed.

Media

Media AWS Storage Big Data

Music to my Ears - All Things Distributed

All Things Distributed

MARCH 28, 2011

Werner Vogels weblog on building scalable and robust distributed systems. Our smart phones and tablets are obvious examples, but many other devices are quickly gaining these capabilities; TV Sets and Hifi systems are internet enabled, and soon our treadmills and automobiles will be equally plugged into the digital world. Comments ().

AWS

AWS Cloud Storage Internet

Real-Real-World Programming with ChatGPT

O'Reilly

JULY 25, 2023

To provide some coherence to the music, I decided to use Taylor Swift songs since her discography covers the time span of most papers that I typically read: Her main albums were released in 2006, 2008, 2010, 2012, 2014, 2017, 2019, 2020, and 2022. This choice also inspired me to call my project Swift Papers.

Programming

Programming Code Design Benchmarking

New AWS feature: Run your website from Amazon S3 - All Things.

All Things Distributed

FEBRUARY 17, 2011

Werner Vogels weblog on building scalable and robust distributed systems. Since a few days ago this weblog serves 100% of its content directly out of the Amazon Simple Storage Service (S3) without the need for a web server to be involved. Driving Storage Costs Down for AWS Customers. Comments (). Subscribe to this weblogs.

AWS

AWS Website Storage Servers

USENIX SREcon APAC 2022: Computing Performance: What's on the Horizon

USENIX LISA2021 Computing Performance: On the Horizon

Trending Sources

The Ultimate Guide to Open Source Databases

USENIX SREcon APAC 2022: Computing Performance: What's on the Horizon

MariaDB vs MySQL: Key Differences and Use Cases

Which Is the Best PostgreSQL GUI? 2019 Comparison

USENIX LISA2021 Computing Performance: On the Horizon

Expanding the Cloud - AWS Import/Export Support for Amazon EBS.

No Server Required - Jekyll & Amazon S3 - All Things Distributed

Expanding the Cloud with DNS - Introducing Amazon Route 53 - All.

DROAM - Dreaming about Cheap Data Roaming - All Things.

Job Openings in AWS - Senior Leader in Database Services - All.

Expanding the Cloud - Introducing Amazon ElastiCache - All Things.

Introducing the AWS South America - All Things Distributed

Expanding the Cloud - Cluster Compute Instances for Amazon EC2.

Hacking with AWS at The Next Web Hackaton - All Things Distributed

Reboot - All Things Distributed

Expanding the Cloud - Introducing the AWS Asia Pacific (Tokyo.

Driving Bandwidth Cost Down for AWS Customers. - All Things.

Free at Last - A Fully Self-Sustained Blog Running in Amazon S3.

This week in review: GPUs, Zombies, Biomimicry and Tom Waits.

From the Archives - Gapingvoid's Nobody Cares - All Things.

I am looking for new application and platform services - All Things.

Expanding the Cloud - New AWS Region: US-West (Northern.

AWS Elastic Beanstalk: A Quick and Simple Way into the Cloud - All.

Driving down the cost of Big-Data analytics - All Things Distributed

Around the World in 28 Days - All Things Distributed

The Amazon.com 2010 Shareholder Letter Focusses on Technology.

Spot Instances - Increased Control - All Things Distributed

Speed Up Your Website With WebP

New Route 53 and ELB features: IPv6, Zone Apex, WRR and more.

APAC Summer Tour - All Things Distributed

Expanding the Cloud - Opening the AWS Asia Pacific (Singapore.

The AWS GovCloud (US) Region - All Things Distributed

Should You Use ClickHouse as a Main Operational Database?

Powerful New Amazon EC2 Boot Features - All Things Distributed

The Performance Inequality Gap, 2021

Expanding the Cloud - Amazon EC2 Spot Instances - All Things.

Structural Evolutions in Data

Expanding the Cloud - Amazon S3 Reduced Redundancy Storage.

Amazon Cloudfront is Streaming Media 2010 Editor's pick - All.

Music to my Ears - All Things Distributed

Real-Real-World Programming with ChatGPT

New AWS feature: Run your website from Amazon S3 - All Things.

Stay Connected