2011 and Storage - Technology Performance Pulse

ScaleGrid DigitalOcean Support for MySQL, PostgreSQL and Redis™ Now Available

Scalegrid

JUNE 9, 2020

These databases are a natural fit for the developer market that has gravitated towards DigitalOcean since its launch just nine years ago in 2011. MySQL and PostgreSQL are the top two open source relational databases in the world, and Redis is the top key-value database.

Availability

Availability Open Source Benchmarking Database

USENIX LISA2021 Computing Performance: On the Horizon

Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on.

Performance

Performance Latency Hardware Storage

MongoDB Database Backup: Best Practices & Expert Tips

Percona

MAY 2, 2023

example.net --port=27017 --username=user --authenticationDatabase=admin --db=demo --collection=events --out=/opt/backup/mongodump-2011-10-24 Note : If we don’t specify the DB name or Collection name explicitly in the above “mongodump” syntax then the backup will be taken for the entire database or collections, respectively.

Best Practices

Best Practices Database Storage Servers

USENIX SREcon APAC 2022: Computing Performance: What's on the Horizon

Brendan Gregg

FEBRUARY 28, 2023

## References I've reproduced the references from my SREcon22 keynote below, so you can click on links: - [Gregg 08] Brendan Gregg, “ZFS L2ARC,” [link] Jul 2008 - [Gregg 10] Brendan Gregg, “Visualizations for Performance Analysis (and More),” [link] 2010 - [Greenberg 11] Marc Greenberg, “DDR4: Double the speed, double the latency?

Performance

Performance Latency Cache Virtualization

USENIX LISA2021 Computing Performance: On the Horizon

Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on.

Performance

Performance Latency Hardware Storage

Expanding the Cloud - AWS Import/Export Support for Amazon EBS.

All Things Distributed

JULY 7, 2011

By Werner Vogels on 07 July 2011 01:40 PM. AWS Import/Export transfers data off of storage devices using Amazons high-speed internal network and bypassing the Internet. Amazon Import/Export is an important tool for customers to accelerate moving large amounts of data into the AWS storage systems. Comments (). At werner.ly

AWS

AWS Cloud Storage Internet

Back-to-the-Future Weekend Reading - CryptDB - All Things.

All Things Distributed

SEPTEMBER 14, 2012

That goes especially for the interaction between applications and storage engines, and between applications and databases. Whether in-the-cloud or on-premise there is a shift to a model where individual applications need to protect themselves instead of relying on firewall-like techniques. You can download the CryptDB software from here.

Operating System

Operating System Storage Scalability Database

DROAM - Dreaming about Cheap Data Roaming - All Things.

All Things Distributed

JANUARY 11, 2011

By Werner Vogels on 11 January 2011 10:20 AM. Starting on January 1, 2011, the service, which is called DROAM, is open to use for everyone. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. All Things Distributed. DROAM - Dreaming about Cheap Data Roaming. Comments ().

Wireless

Wireless AWS Internet Internet

MariaDB vs MySQL: Key Differences and Use Cases

Percona

JUNE 4, 2023

MariaDB retains compatibility with MySQL, offers support for different programming languages, including Python, PHP, Java, and Perl, and works with all major open source storage engines such as MyRocks, Aria, and InnoDB. GA 28 April 2011 5.5.11-20.2 MariaDB Server includes many storage engines beyond the default InnoDB.

Open Source

Open Source Servers Storage Scalability

No Server Required - Jekyll & Amazon S3 - All Things Distributed

All Things Distributed

AUGUST 17, 2011

By Werner Vogels on 17 August 2011 11:40 AM. As some of you may remember I was pretty excited when Amazon Simple Storage Service (S3) released its website feature such that I could serve this weblog completely from S3. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway.

Servers

Servers Social Media AWS Website

USENIX SREcon APAC 2022: Computing Performance: What's on the Horizon

Brendan Gregg

FEBRUARY 28, 2023

References I've reproduced the references from my SREcon22 keynote below, so you can click on links: [Gregg 08] Brendan Gregg, “ZFS L2ARC,” [link] , Jul 2008 [Gregg 10] Brendan Gregg, “Visualizations for Performance Analysis (and More),” [link] , 2010 [Greenberg 11] Marc Greenberg, “DDR4: Double the speed, double the latency?

Performance

Performance Latency Cache Virtualization

Introducing the AWS South America - All Things Distributed

All Things Distributed

DECEMBER 14, 2011

By Werner Vogels on 14 December 2011 07:00 PM. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. Werner Vogels weblog on building scalable and robust distributed systems. Expanding the Cloud â?? Introducing the AWS South America (Sao Paulo) Region. Comments (). At werner.ly Syndication.

AWS

AWS Latency Storage Big Data

Expanding the Cloud - Introducing Amazon ElastiCache - All Things.

All Things Distributed

AUGUST 22, 2011

By Werner Vogels on 22 August 2011 07:40 PM. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. All Things Distributed. Werner Vogels weblog on building scalable and robust distributed systems. Expanding the Cloud - Introducing Amazon ElastiCache. Comments (). At werner.ly Syndication.

Cloud

Cloud Cache AWS Storage

Job Openings in AWS - Senior Leader in Database Services - All.

All Things Distributed

AUGUST 19, 2011

By Werner Vogels on 19 August 2011 12:40 PM. AWS Database Services is responsible for setting the database strategy and delivering distributed structured storage services to our AWS customers. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. All Things Distributed. Comments ().

AWS

AWS Database Storage Scalability

Expanding the Cloud - Introducing the AWS Asia Pacific (Tokyo.

All Things Distributed

MARCH 2, 2011

By Werner Vogels on 01 March 2011 10:00 PM. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. Werner Vogels weblog on building scalable and robust distributed systems. Expanding the Cloud - Introducing the AWS Asia Pacific (Tokyo) Region. Comments (). At werner.ly Syndication.

AWS

AWS Cloud Games Latency

Driving Bandwidth Cost Down for AWS Customers. - All Things.

All Things Distributed

JUNE 29, 2011

By Werner Vogels on 29 June 2011 09:55 AM. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. All Things Distributed. Werner Vogels weblog on building scalable and robust distributed systems. Driving Bandwidth Cost Down for AWS Customers. Comments (). At werner.ly Syndication.

AWS

AWS Retail Innovation Strategy

Hacking with AWS at The Next Web Hackaton - All Things Distributed

All Things Distributed

MARCH 24, 2011

By Werner Vogels on 24 March 2011 10:31 AM. It is likely that the Amazon Web Services will be used by many of the participants for their compute, storage, database and other cloud resource needs. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. All Things Distributed.

AWS

AWS Internet Internet Storage

Free at Last - A Fully Self-Sustained Blog Running in Amazon S3.

All Things Distributed

FEBRUARY 23, 2011

By Werner Vogels on 23 February 2011 09:43 AM. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. All Things Distributed. Werner Vogels weblog on building scalable and robust distributed systems. Free at Last - A Fully Self-Sustained Blog Running in Amazon S3. Comments (). At werner.ly

AWS

AWS Storage Big Data Servers

From the Archives - Gapingvoid's Nobody Cares - All Things.

All Things Distributed

FEBRUARY 27, 2011

By Werner Vogels on 27 February 2011 11:28 PM. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. All Things Distributed. Werner Vogels weblog on building scalable and robust distributed systems. From the Archives - Gapingvoids Nobody Cares. Comments (). At werner.ly Syndication.

AWS

AWS Storage Big Data Scalability

Driving down the cost of Big-Data analytics - All Things Distributed

All Things Distributed

AUGUST 18, 2011

By Werner Vogels on 18 August 2011 04:00 PM. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. All Things Distributed. Werner Vogels weblog on building scalable and robust distributed systems. Driving down the cost of Big-Data analytics. Comments (). At werner.ly Syndication.

Big Data

Big Data Analytics AWS Scalability

The Back-to-Basics Readings of 2012 - All Things Distributed

All Things Distributed

DECEMBER 18, 2012

Aug 24 - The Five-Minute Rule Ten Years Later, and Other Computer Storage Rules of Thumb , Jim Gray and Goetz Graefe, ACM SIGMOD Record 26 (4): 63â??68, Aug 24 - The Five-Minute Rule 20 Years Later: and How Flash Memory Changes the Rules. Goetz Graefe, ACM Queue 6(4): 40-52 (2008). Gray and David R.

Operating System

Operating System Cache AWS Scalability

Spot Instances - Increased Control - All Things Distributed

All Things Distributed

JULY 11, 2011

By Werner Vogels on 11 July 2011 07:22 AM. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. All Things Distributed. Werner Vogels weblog on building scalable and robust distributed systems. Spot Instances - Increased Control. Comments (). At werner.ly Syndication. or rss feed.

AWS

AWS Storage Cloud Big Data

New Route 53 and ELB features: IPv6, Zone Apex, WRR and more.

All Things Distributed

MAY 24, 2011

By Werner Vogels on 24 May 2011 05:26 AM. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. All Things Distributed. Werner Vogels weblog on building scalable and robust distributed systems. New Route 53 and ELB features: IPv6, Zone Apex, WRR and more. Comments (). At werner.ly

Internet

Internet Internet AWS Scalability

APAC Summer Tour - All Things Distributed

All Things Distributed

JULY 3, 2011

By Werner Vogels on 03 July 2011 03:57 PM. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. All Things Distributed. Werner Vogels weblog on building scalable and robust distributed systems. APAC Summer Tour. Comments (). At werner.ly Syndication. Subscribe to this weblogs. or rss feed.

AWS

AWS Storage Big Data Cloud

AWS Elastic Beanstalk: A Quick and Simple Way into the Cloud - All.

All Things Distributed

JANUARY 19, 2011

By Werner Vogels on 18 January 2011 04:00 PM. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. All Things Distributed. Werner Vogels weblog on building scalable and robust distributed systems. AWS Elastic Beanstalk: A Quick and Simple Way into the Cloud. Comments (). At werner.ly

AWS

AWS Cloud Java Scalability

The AWS GovCloud (US) Region - All Things Distributed

All Things Distributed

AUGUST 16, 2011

By Werner Vogels on 16 August 2011 06:40 AM. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. All Things Distributed. Werner Vogels weblog on building scalable and robust distributed systems. Expanding the Cloud - The AWS GovCloud (US) Region. Comments (). At werner.ly Syndication.

AWS

AWS Government Big Data Cloud

Should You Use ClickHouse as a Main Operational Database?

Percona

JANUARY 14, 2019

In a partitioned massively parallel database system, the storage format and sorting algorithm may not be optimized for that operation as we are reading multiple partitions in parallel. downvotes','upvote','drupal','android','upvoted'] ? ? codecs','imgur','floppy','codec','adobe','android'] ? ? scala','currency','println'] ? ?

Database

Database Analytics Blockchain Healthcare

The Performance Inequality Gap, 2021

Alex Russell

MARCH 6, 2021

A then-representative $200USD device had 4-8 slow (in-order, low-cache) cores, ~2GiB of RAM, and relatively slow MLC NAND flash storage. This translates into a budget of ~130-170KB of critical-path resources, depending on composition — the more JS you include, the smaller the bundle must be. The Moto G4 , for example. " package.

Performance

Performance Network Cache Metrics

iOS Engine Choice In Depth

Alex Russell

AUGUST 30, 2021

For example, OWNERs and experts in video and audio codecs can agree to extensive changes in their domain but cannot green-light changes in areas such as layout, networking, storage, or JavaScript engines. Continuing to bring previouly proprietary features into the commons is the core mechanism by which this progress is delivered.

Engineering

Engineering Open Source Website Operating System

New AWS feature: Run your website from Amazon S3 - All Things.

All Things Distributed

FEBRUARY 17, 2011

By Werner Vogels on 17 February 2011 07:45 AM. Since a few days ago this weblog serves 100% of its content directly out of the Amazon Simple Storage Service (S3) without the need for a web server to be involved. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. Comments ().

AWS

AWS Website Storage Servers

The Amazon.com 2010 Shareholder Letter Focusses on Technology.

All Things Distributed

APRIL 27, 2011

By Werner Vogels on 27 April 2011 12:51 AM. The storage systems weve pioneered demonstrate extreme scalability while maintaining tight control over performance, availability, and cost. For example, our Simple Storage Service, Elastic Block Store, and SimpleDB all derive their basic architecture from unique Amazon technologies.

Technology

Technology Technology AWS Storage

Music to my Ears - All Things Distributed

All Things Distributed

MARCH 28, 2011

By Werner Vogels on 28 March 2011 02:50 PM. The scalability, reliability and durability requirements for Cloud Drive are very high which is why they decided to make use of the Amazon Simple Storage Service (S3) as the core component of their service. Driving Storage Costs Down for AWS Customers. Comments (). At werner.ly

AWS

AWS Cloud Storage Internet

Content Management Systems of the Future: Headless, JAMstack, ADN and Functions at the Edge

Abhishek Tiwari

NOVEMBER 3, 2018

Alternatively, you can upload output directory to cloud object/blob storage such as Amazon S3 or Azure Blob Storage and serve your site from there. Most of cloud object/blob storage services have native support for static site hosting. SSG became mainstream and got some real traction during the second Obama campaign.

Systems

Systems Cache Website Network

Simplifying IT - Create Your Application with AWS CloudFormation.

All Things Distributed

FEBRUARY 25, 2011

By Werner Vogels on 24 February 2011 04:00 PM. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. All Things Distributed. Werner Vogels weblog on building scalable and robust distributed systems. Simplifying IT - Create Your Application with AWS CloudFormation. Comments (). At werner.ly

AWS

AWS Cloud Scalability Storage

Technology Performance Pulse

ScaleGrid DigitalOcean Support for MySQL, PostgreSQL and Redis™ Now Available

USENIX LISA2021 Computing Performance: On the Horizon

Trending Sources

MongoDB Database Backup: Best Practices & Expert Tips

USENIX SREcon APAC 2022: Computing Performance: What's on the Horizon

USENIX LISA2021 Computing Performance: On the Horizon

Expanding the Cloud - AWS Import/Export Support for Amazon EBS.

Back-to-the-Future Weekend Reading - CryptDB - All Things.

DROAM - Dreaming about Cheap Data Roaming - All Things.

MariaDB vs MySQL: Key Differences and Use Cases

No Server Required - Jekyll & Amazon S3 - All Things Distributed

USENIX SREcon APAC 2022: Computing Performance: What's on the Horizon

Introducing the AWS South America - All Things Distributed

Expanding the Cloud - Introducing Amazon ElastiCache - All Things.

Job Openings in AWS - Senior Leader in Database Services - All.

Expanding the Cloud - Introducing the AWS Asia Pacific (Tokyo.

Driving Bandwidth Cost Down for AWS Customers. - All Things.

Hacking with AWS at The Next Web Hackaton - All Things Distributed

Free at Last - A Fully Self-Sustained Blog Running in Amazon S3.

From the Archives - Gapingvoid's Nobody Cares - All Things.

Driving down the cost of Big-Data analytics - All Things Distributed

The Back-to-Basics Readings of 2012 - All Things Distributed

Spot Instances - Increased Control - All Things Distributed

New Route 53 and ELB features: IPv6, Zone Apex, WRR and more.

APAC Summer Tour - All Things Distributed

AWS Elastic Beanstalk: A Quick and Simple Way into the Cloud - All.

The AWS GovCloud (US) Region - All Things Distributed

Should You Use ClickHouse as a Main Operational Database?

The Performance Inequality Gap, 2021

iOS Engine Choice In Depth

New AWS feature: Run your website from Amazon S3 - All Things.

The Amazon.com 2010 Shareholder Letter Focusses on Technology.

Music to my Ears - All Things Distributed

Content Management Systems of the Future: Headless, JAMstack, ADN and Functions at the Edge

Simplifying IT - Create Your Application with AWS CloudFormation.

Stay Connected