2010, Design, Internet and Storage - Technology Performance Pulse

USENIX LISA2021 Computing Performance: On the Horizon

Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on.

Performance

Performance Latency Hardware Storage

USENIX SREcon APAC 2022: Computing Performance: What's on the Horizon

Brendan Gregg

FEBRUARY 28, 2023

I didn't end up getting published in SysAdmin directly, but my performance work did make it as a feature article (thanks Matty). DDR6: Here's What to Expect in RAM Modules,” [link] Nov 2020 - [Salter 20] Jim Salter, “Western Digital releases new 18TB, 20TB EAMR drives,” [link] Jul 2020 - [Spier 20] Martin Spier, Brendan Gregg, et al.,

Performance

Performance Latency Cache Virtualization

USENIX SREcon APAC 2022: Computing Performance: What's on the Horizon

Brendan Gregg

FEBRUARY 28, 2023

As for attending USENIX conferences: I finally started attending and speaking at them in 2010 when a community manager encouraged me to (thanks Deirdre Straughan), and since then I've met many friends and connections, including Amy who is now USENIX President, and Rikki with whom I co-chaired the USENIX LISA18 conference.

Performance

Performance Latency Cache Virtualization

USENIX LISA2021 Computing Performance: On the Horizon

Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on.

Performance

Performance Latency Hardware Storage

Expanding the Cloud - AWS Import/Export Support for Amazon EBS.

All Things Distributed

JULY 7, 2011

AWS Import/Export transfers data off of storage devices using Amazons high-speed internal network and bypassing the Internet. Amazon Import/Export is an important tool for customers to accelerate moving large amounts of data into the AWS storage systems. Driving Storage Costs Down for AWS Customers. or rss feed.

AWS

AWS Cloud Storage Internet

Hacking with AWS at The Next Web Hackaton - All Things Distributed

All Things Distributed

MARCH 24, 2011

Over the past years The Next Web Conference has become a premier conference on internet life and its technologies. Up to 200 developers and designers will get together to hack up interesting applications using the Internets APIs and SDKs. If you want to be that team of 5-7 developer/designers you can sign up using this form.

AWS

AWS Internet Internet Storage

DROAM - Dreaming about Cheap Data Roaming - All Things.

All Things Distributed

JANUARY 11, 2011

For an internet road warrior they are a complete nightmare. For a while this was great but as this doesnt include web and application internet traffic I started to see a rise in my roaming costs which T-Mobile charges at $15/MB. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway.

Wireless

Wireless AWS Internet Internet

Expanding the Cloud with DNS - Introducing Amazon Route 53 - All.

All Things Distributed

DECEMBER 5, 2010

By Werner Vogels on 05 December 2010 02:00 PM. DNS is one of the fundamental building blocks of internet applications and was high on the wish list of our customers for some time already. DNS is an absolutely critical piece of the internet infrastructure. Expanding the Cloud with DNS - Introducing Amazon Route 53. Comments ().

Cloud

Cloud Internet Internet AWS

No Server Required - Jekyll & Amazon S3 - All Things Distributed

All Things Distributed

AUGUST 17, 2011

As some of you may remember I was pretty excited when Amazon Simple Storage Service (S3) released its website feature such that I could serve this weblog completely from S3. It is simple and elegant, as you would expect from someone who has won several design awards. Driving Storage Costs Down for AWS Customers. or rss feed.

Servers

Servers Social Media AWS Website

New Route 53 and ELB features: IPv6, Zone Apex, WRR and more.

All Things Distributed

MAY 24, 2011

Elastic Load Balancing now provides support for EC2 Security Groups such that customers that hosts their Internet accessible application instances behind ELB can build security rules that for example restrict traffic to only the ELB instances that front them. Introducing a new Internet protocol is not a simple feat. or rss feed.

Internet

Internet Internet AWS Scalability

Introducing the AWS South America - All Things Distributed

All Things Distributed

DECEMBER 14, 2011

Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. The Amazon.com 2010 Shareholder Letter Focusses on Technology. Subscribe to this weblogs. or rss feed. All postings. Recent Entries.

AWS

AWS Latency Storage Big Data

Job Openings in AWS - Senior Leader in Database Services - All.

All Things Distributed

AUGUST 19, 2011

AWS Database Services is responsible for setting the database strategy and delivering distributed structured storage services to our AWS customers. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications.

AWS

AWS Database Storage Scalability

Reboot - All Things Distributed

All Things Distributed

SEPTEMBER 29, 2010

By Werner Vogels on 29 September 2010 07:50 AM. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. The Amazon.com 2010 Shareholder Letter Focusses on Technology. Comments ().

AWS

AWS Storage Big Data Scalability

Expanding the Cloud - Introducing Amazon ElastiCache - All Things.

All Things Distributed

AUGUST 22, 2011

Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. The Amazon.com 2010 Shareholder Letter Focusses on Technology. Subscribe to this weblogs. or rss feed. All postings. Recent Entries.

Cloud

Cloud Cache AWS Storage

Expanding the Cloud - Introducing the AWS Asia Pacific (Tokyo.

All Things Distributed

MARCH 2, 2011

Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. The Amazon.com 2010 Shareholder Letter Focusses on Technology. Subscribe to this weblogs. or rss feed. All postings. Recent Entries.

AWS

AWS Cloud Games Latency

Driving Bandwidth Cost Down for AWS Customers. - All Things.

All Things Distributed

JUNE 29, 2011

Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. The Amazon.com 2010 Shareholder Letter Focusses on Technology. Subscribe to this weblogs. or rss feed. All postings. Recent Entries.

AWS

AWS Retail Innovation Strategy

Free at Last - A Fully Self-Sustained Blog Running in Amazon S3.

All Things Distributed

FEBRUARY 23, 2011

Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. The Amazon.com 2010 Shareholder Letter Focusses on Technology. Subscribe to this weblogs. or rss feed. All postings. Recent Entries.

AWS

AWS Storage Big Data Servers

From the Archives - Gapingvoid's Nobody Cares - All Things.

All Things Distributed

FEBRUARY 27, 2011

Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. The Amazon.com 2010 Shareholder Letter Focusses on Technology. Subscribe to this weblogs. or rss feed. All postings. Recent Entries.

AWS

AWS Storage Big Data Scalability

This week in review: GPUs, Zombies, Biomimicry and Tom Waits.

All Things Distributed

NOVEMBER 19, 2010

By Werner Vogels on 19 November 2010 07:51 AM. for November 2010 was released and an Amazon EC2 Cluster Compute Instance based cluster came in at #231. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. The Amazon.com 2010 Shareholder Letter Focusses on Technology.

AWS

AWS Cloud Benchmarking Storage

I am looking for new application and platform services - All Things.

All Things Distributed

APRIL 23, 2010

By Werner Vogels on 22 April 2010 05:17 PM. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. The Amazon.com 2010 Shareholder Letter Focusses on Technology. All Things Distributed.

AWS

AWS Storage Cloud Big Data

Driving down the cost of Big-Data analytics - All Things Distributed

All Things Distributed

AUGUST 18, 2011

Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. The Amazon.com 2010 Shareholder Letter Focusses on Technology. Subscribe to this weblogs. or rss feed. All postings. Recent Entries.

Big Data

Big Data Analytics AWS Cloud

Expanding the Cloud - New AWS Region: US-West (Northern.

All Things Distributed

DECEMBER 3, 2009

As we announced earlier this month a Region with multiple Availability Zones will come online in Singapore in the first half of 2010, with other regions in Asia to follow later in 2010. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. Subscribe to this weblogs. or rss feed.

AWS

AWS Cloud Latency Storage

Expanding the Cloud - Cluster Compute Instances for Amazon EC2.

All Things Distributed

JULY 13, 2010

By Werner Vogels on 12 July 2010 05:00 PM. Cluster Computer Instances for Amazon EC2 are a new instance type specifically designed for High Performance Computing applications. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. Comments (). Subscribe to this weblogs. or rss feed.

Cloud

Cloud AWS Automotive Latency

Around the World in 28 Days - All Things Distributed

All Things Distributed

SEPTEMBER 30, 2010

By Werner Vogels on 30 September 2010 04:27 AM. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. The Amazon.com 2010 Shareholder Letter Focusses on Technology. Comments ().

AWS

AWS Storage Cloud Best Practices

Spot Instances - Increased Control - All Things Distributed

All Things Distributed

JULY 11, 2011

Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. The Amazon.com 2010 Shareholder Letter Focusses on Technology. Subscribe to this weblogs. or rss feed. All postings. Recent Entries.

AWS

AWS Storage Cloud Big Data

APAC Summer Tour - All Things Distributed

All Things Distributed

JULY 3, 2011

Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. The Amazon.com 2010 Shareholder Letter Focusses on Technology. Subscribe to this weblogs. or rss feed. All postings. Recent Entries.

AWS

AWS Storage Cloud Big Data

Expanding the Cloud - Opening the AWS Asia Pacific (Singapore.

All Things Distributed

APRIL 28, 2010

By Werner Vogels on 28 April 2010 11:00 AM. Quite often "The Cloud" is portrayed as something magically transparent that lives somewhere in the internet. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. The Amazon.com 2010 Shareholder Letter Focusses on Technology.

AWS

AWS Cloud Latency Storage

The AWS GovCloud (US) Region - All Things Distributed

All Things Distributed

AUGUST 16, 2011

The Cloud First strategy is most visible with new Federal IT programs, which are all designed to be â??Cloud Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Cloud Readyâ??; or rss feed.

AWS

AWS Government Big Data Cloud

AWS Elastic Beanstalk: A Quick and Simple Way into the Cloud - All.

All Things Distributed

JANUARY 19, 2011

Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. The Amazon.com 2010 Shareholder Letter Focusses on Technology. Subscribe to this weblogs. or rss feed. All postings. Recent Entries.

AWS

AWS Cloud Java Operating System

The Amazon.com 2010 Shareholder Letter Focusses on Technology.

All Things Distributed

APRIL 27, 2011

The Amazon.com 2010 Shareholder Letter Focusses on Technology. In the 2010 Shareholder Letter Jeff Bezos writes about the unique technologies developed at Amazon.com over the years. The storage systems weve pioneered demonstrate extreme scalability while maintaining tight control over performance, availability, and cost.

Technology

Technology Technology AWS Storage

Powerful New Amazon EC2 Boot Features - All Things Distributed

All Things Distributed

DECEMBER 3, 2009

While the instance is stopped it does not accrue any usage hours and customers are only charged for the storage associated with the Amazon EBS volume. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications.

AWS

AWS Storage Operating System Cloud

Expanding the Cloud - Amazon EC2 Spot Instances - All Things.

All Things Distributed

DECEMBER 13, 2009

Consistently we have lowered compute, storage and bandwidth prices based on such cost savings. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Subscribe to this weblogs. or rss feed.

Cloud

Cloud AWS Storage Innovation

Expanding the Cloud - Amazon S3 Reduced Redundancy Storage.

All Things Distributed

MAY 18, 2010

Expanding the Cloud - Amazon S3 Reduced Redundancy Storage. By Werner Vogels on 18 May 2010 04:00 PM. Today a new storage option for Amazon S3 has been launched: Amazon S3 Reduced Redundancy Storage (RRS). Werner Vogels weblog on building scalable and robust distributed systems. Comments (). Durability in Amazon S3.

Storage

Storage Cloud AWS Scalability

Amazon Cloudfront is Streaming Media 2010 Editor's pick - All.

All Things Distributed

APRIL 19, 2010

Amazon Cloudfront is Streaming Media 2010 Editors pick. By Werner Vogels on 19 April 2010 03:02 AM. I am excited that Amazon Cloudfront has been selected as one of the 10 Editors pick of 2010 by Streaming Media. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway.

Media

Media AWS Storage Big Data

Real-Real-World Programming with ChatGPT

O'Reilly

JULY 25, 2023

To provide some coherence to the music, I decided to use Taylor Swift songs since her discography covers the time span of most papers that I typically read: Her main albums were released in 2006, 2008, 2010, 2012, 2014, 2017, 2019, 2020, and 2022. This choice also inspired me to call my project Swift Papers.

Programming

Programming Code Design Benchmarking

The Ultimate Guide to Open Source Databases

Percona

MARCH 30, 2023

Further, open source databases can be modified in infinite ways, enabling institutions to meet their specific needs for data storage, retrieval, and processing. Non-relational databases: Instead of tables, non-relational (NoSQL) databases use document-based data storage, column-oriented storage, and graph databases.

Open Source

Open Source Database Storage Scalability

Music to my Ears - All Things Distributed

All Things Distributed

MARCH 28, 2011

Our smart phones and tablets are obvious examples, but many other devices are quickly gaining these capabilities; TV Sets and Hifi systems are internet enabled, and soon our treadmills and automobiles will be equally plugged into the digital world. Driving Storage Costs Down for AWS Customers. Subscribe to this weblogs. or rss feed.

AWS

AWS Cloud Storage Internet

New AWS feature: Run your website from Amazon S3 - All Things.

All Things Distributed

FEBRUARY 17, 2011

Since a few days ago this weblog serves 100% of its content directly out of the Amazon Simple Storage Service (S3) without the need for a web server to be involved. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. The Amazon.com 2010 Shareholder Letter Focusses on Technology.

AWS

AWS Website Storage Servers

Simplifying IT - Create Your Application with AWS CloudFormation.

All Things Distributed

FEBRUARY 25, 2011

Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. The Amazon.com 2010 Shareholder Letter Focusses on Technology. Subscribe to this weblogs. or rss feed. All postings. Recent Entries.

AWS

AWS Cloud Scalability Storage

5 Terabyte Object Support in Amazon S3 - All Things Distributed

All Things Distributed

DECEMBER 9, 2010

By Werner Vogels on 09 December 2010 11:30 AM. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. The Amazon.com 2010 Shareholder Letter Focusses on Technology. Comments ().

AWS

AWS Big Data Scalability Storage

Amazon EC2 Cluster GPU Instances - All Things Distributed

All Things Distributed

NOVEMBER 15, 2010

By Werner Vogels on 14 November 2010 04:00 PM. These trade-offs have even impacted the way the lowest level building blocks in our computer architectures have been designed. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. Comments (). Subscribe to this weblogs. or rss feed.

AWS

AWS Latency Programming Architecture

Choosing Consistency - All Things Distributed

All Things Distributed

FEBRUARY 24, 2010

By Werner Vogels on 24 February 2010 07:00 AM. These new features will make it easier to transition those applications to SimpleDB that are designed with traditional database tools in mind. Especially those applications that originally were designed with a traditional database in mind will be easier to adapt to Simple DB.

AWS

AWS Latency Database Scalability

Speed Up Your Website With WebP

Smashing Magazine

OCTOBER 29, 2019

Considering how important images are to web design, this isn’t an element we can dispose of so easily nor can we afford to cut corners when it comes to optimizing them. Here’s what Google suggests: PageSpeed Insights demonstrates how much storage and bandwidth websites stand to save with WebP. Samsung Internet. What is WebP?

Website

Website Speed Cache Google

USENIX LISA2021 Computing Performance: On the Horizon

USENIX SREcon APAC 2022: Computing Performance: What's on the Horizon

Trending Sources

USENIX SREcon APAC 2022: Computing Performance: What's on the Horizon

USENIX LISA2021 Computing Performance: On the Horizon

Expanding the Cloud - AWS Import/Export Support for Amazon EBS.

Hacking with AWS at The Next Web Hackaton - All Things Distributed

DROAM - Dreaming about Cheap Data Roaming - All Things.

Expanding the Cloud with DNS - Introducing Amazon Route 53 - All.

No Server Required - Jekyll & Amazon S3 - All Things Distributed

New Route 53 and ELB features: IPv6, Zone Apex, WRR and more.

Introducing the AWS South America - All Things Distributed

Job Openings in AWS - Senior Leader in Database Services - All.

Reboot - All Things Distributed

Expanding the Cloud - Introducing Amazon ElastiCache - All Things.

Expanding the Cloud - Introducing the AWS Asia Pacific (Tokyo.

Driving Bandwidth Cost Down for AWS Customers. - All Things.

Free at Last - A Fully Self-Sustained Blog Running in Amazon S3.

From the Archives - Gapingvoid's Nobody Cares - All Things.

This week in review: GPUs, Zombies, Biomimicry and Tom Waits.

I am looking for new application and platform services - All Things.

Driving down the cost of Big-Data analytics - All Things Distributed

Expanding the Cloud - New AWS Region: US-West (Northern.

Expanding the Cloud - Cluster Compute Instances for Amazon EC2.

Around the World in 28 Days - All Things Distributed

Spot Instances - Increased Control - All Things Distributed

APAC Summer Tour - All Things Distributed

Expanding the Cloud - Opening the AWS Asia Pacific (Singapore.

The AWS GovCloud (US) Region - All Things Distributed

AWS Elastic Beanstalk: A Quick and Simple Way into the Cloud - All.

The Amazon.com 2010 Shareholder Letter Focusses on Technology.

Powerful New Amazon EC2 Boot Features - All Things Distributed

Expanding the Cloud - Amazon EC2 Spot Instances - All Things.

Expanding the Cloud - Amazon S3 Reduced Redundancy Storage.

Amazon Cloudfront is Streaming Media 2010 Editor's pick - All.

Real-Real-World Programming with ChatGPT

The Ultimate Guide to Open Source Databases

Music to my Ears - All Things Distributed

New AWS feature: Run your website from Amazon S3 - All Things.

Simplifying IT - Create Your Application with AWS CloudFormation.

5 Terabyte Object Support in Amazon S3 - All Things Distributed

Amazon EC2 Cluster GPU Instances - All Things Distributed

Choosing Consistency - All Things Distributed

Speed Up Your Website With WebP

Stay Connected