Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on. I also wrote about these topics in detail for my recent [Systems Performance 2nd Edition] book.

Performance 52

Performance Latency Hardware Storage 52

All Things Distributed

AUGUST 24, 2012

Werner Vogels weblog on building scalable and robust distributed systems. By Werner Vogels on 24 August 2012 04:00 PM. The AWS team launched this week Amazon Glacier , a cold storage archive service at the very low price point of $0.01 Back-to-Basics Weekend Reading - The 5 Minute Rule. Comments (). per GB/month.

Storage 110

Storage Hardware AWS Data Engineering 110

Percona

JUNE 4, 2023

Before we dive into the differences between MariaDB and MySQL, we will provide a thorough examination of each relational database management system (RDBMS). While originally designed to be a drop-in replacement for MySQL, it evolved into its own distinct database management system and is now maintained and supported by the MariaDB Foundation.

Open Source 52

Open Source Servers Storage Scalability 52

All Things Distributed

JULY 16, 2012

Werner Vogels weblog on building scalable and robust distributed systems. By Werner Vogels on 16 July 2012 09:00 AM. General registration opens up on July 25, 2012, however active AWS customers will get a chance to jump the line and start registering on July 20. All Things Distributed. Register for AWS re: Invent. Comments ().

AWS 85

AWS Big Data Media Storage 85

All Things Distributed

MAY 8, 2012

Werner Vogels weblog on building scalable and robust distributed systems. By Werner Vogels on 08 May 2012 02:00 PM. of administrative tasks such as OS and database software patching, storage management, and implementing reliable backup and disaster recovery solutions. All Things Distributed. Comments ().

Cloud 116

Cloud Development AWS Servers 116

All Things Distributed

MARCH 5, 2012

Werner Vogels weblog on building scalable and robust distributed systems. By Werner Vogels on 05 March 2012 02:01 PM. AWS today announced a substantial price drop from March 1, 2012 for many of the Amazon EC2, Amazon RDS, and Amazon ElastiCache instances types around the world. All Things Distributed. Comments ().

AWS 111

AWS Innovation Scalability Cache 111

Brendan Gregg

FEBRUARY 28, 2023

This talk originated from my updates to Systems Performance 2nd Edition , and this was the first time I've given this talk in person! CXL in a way allows a custom memory controller to be added to a system, to increase memory capacity, bandwidth, and overall performance. Ford, et al., “TCP

Performance 52

Performance Latency Cache Virtualization 52

All Things Distributed

DECEMBER 27, 2012

Werner Vogels weblog on building scalable and robust distributed systems. By Werner Vogels on 27 December 2012 12:00 PM. S3 is not only a highly reliable and available storage service but also one of the most powerful web serving engines that exists today. All Things Distributed. My Best Christmas Present â?? Comments ().

Website 127

Website Traffic Storage Scalability 127

All Things Distributed

JULY 19, 2012

Werner Vogels weblog on building scalable and robust distributed systems. By Werner Vogels on 19 July 2012 12:00 AM. Magnetic disks are rapidly starting to exhibit tape-like properties and with modern workloads being increasingly random, they are becoming less and less suitable as a storage system. All Things Distributed.

Cloud 129

Cloud Performance AWS Virtualization 129

All Things Distributed

SEPTEMBER 14, 2012

Werner Vogels weblog on building scalable and robust distributed systems. By Werner Vogels on 14 September 2012 05:00 PM. That goes especially for the interaction between applications and storage engines, and between applications and databases. All Things Distributed. Back-to-the-Future Weekend Reading - CryptDB. Comments ().

Operating System 83

Operating System Storage Scalability Database 83

All Things Distributed

SEPTEMBER 25, 2012

Werner Vogels weblog on building scalable and robust distributed systems. By Werner Vogels on 25 September 2012 06:00 PM. Amazon RDS Provisioned IOPS is ideal for mission-critical online transaction processing (OLTP) workloads that require a high performance storage option with consistent IOPS, within a narrow band of tolerance.

Cloud 118

Cloud AWS Storage Database 118

All Things Distributed

MARCH 20, 2012

Werner Vogels weblog on building scalable and robust distributed systems. By Werner Vogels on 20 March 2012 09:00 PM. AWS Elastic Beanstalk now supports PHP applications (in addition to Java) and the ability to deploy through the popular Git version control system. All Things Distributed. A Thousand Platforms. Comments ().

AWS 106

AWS Scalability Java Storage 106

SQL Server According to Bob

JUNE 3, 2016

Use SQL Server Management Studio (SSMS) or your favorite query editor to connect to a SQL Server 2012 or 2014 instance. Note: You may need to execute the dbcc a second time so buffer cache is hot, eliminating I/O sub-system variants. 32GB RAM, 4 Core Hyper-threaded enabled 2.8Ghz, SSD Storage. or newer release. SQL Server.

Hardware 40

Hardware Cache Servers Software Engineering 40

All Things Distributed

APRIL 5, 2012

Werner Vogels weblog on building scalable and robust distributed systems. By Werner Vogels on 06 April 2012 06:00 AM. All Things Distributed. Customer Conversations - How Intuit and Edmodo Innovate using Amazon RDS. Comments ().

Innovation 149

Innovation AWS Education Network 149

Scalegrid

JULY 17, 2020

Often times an external system is providing data as JSON, so it might be a temporary store before data is ingested into other parts of the system. Wave 1: PostgreSQL 9.2 (2012) added support for JSON data type. JSONB storage results in a larger storage footprint. For example, Stripe transactions.

Storage 321

Storage Database Efficiency Processing 321

All Things Distributed

AUGUST 16, 2012

Werner Vogels weblog on building scalable and robust distributed systems. By Werner Vogels on 16 August 2012 10:00 AM. All Things Distributed. Total Cost of Ownership and the Return on Agility. Comments ().

AWS 118

AWS Hardware Traffic Best Practices 118

Smashing Magazine

NOVEMBER 8, 2018

In this article, I will describe this latter solution, based on a WordPress application storing files on Amazon Web Services (AWS) Simple Storage Service (S3) (a cloud object storage solution to store and retrieve data), operating through the AWS SDK. Conclusion.

AWS 44

AWS Servers Storage Cloud 44

Percona

JUNE 6, 2023

This blog was originally published in January 2012 and was updated in June 2023. Full backups are most suitable for critical systems or sensitive data that cannot afford any loss or downtime, allowing for a complete recovery of data in the event of data corruption, hacking, system failures, or natural disasters.

Storage 68

Storage Strategy Network Efficiency 68

O'Reilly

SEPTEMBER 19, 2023

It progressed from “raw compute and storage” to “reimplementing key services in push-button fashion” to “becoming the backbone of AI work”—all under the umbrella of “renting time and storage on someone else’s computers.” ” (It will be easier to fit in the overhead storage.)

Hardware 99

Hardware Storage Big Data Blockchain 99

Brendan Gregg

NOVEMBER 29, 2017

In this configuration, the AMI and boot is paravirt (PV), the kernel is making hypercalls instead of privileged instructions, and the system is using paravirt network and storage drivers. But not all workloads: some are network bound (proxies) and storage bound (databases). ## 5. The AMI and boot are now HVM.

Virtualization 111

Virtualization AWS Hardware Storage 111

All Things Distributed

NOVEMBER 28, 2012

Werner Vogels weblog on building scalable and robust distributed systems. By Werner Vogels on 28 November 2012 09:00 AM. They contain large amounts of locally attached storage on multiple spindles and are connected by a minimally oversubscribed 10 Gigabit Ethernet network. All Things Distributed. Expanding the Cloud â??

Cloud 164

Cloud Storage Architecture Scalability 164

All Things Distributed

OCTOBER 2, 2017

With these requirements in mind, and a willingness to question the status quo, a small group of distributed systems experts came together and designed a horizontally scalable distributed database that would scale out for both reads and writes to meet the long-term needs of our business. This was the genesis of the Amazon Dynamo database.

Internet 130

Internet Internet AWS Performance 130

Brendan Gregg

NOVEMBER 28, 2017

In this configuration, the AMI and boot is paravirt (PV), the kernel is making hypercalls instead of privileged instructions, and the system is using paravirt network and storage drivers. But not all workloads: some are network bound (proxies) and storage bound (databases). ## 5. The AMI and boot are now HVM.

Virtualization 40

Virtualization AWS Hardware Storage 40

All Things Distributed

FEBRUARY 15, 2013

Werner Vogels weblog on building scalable and robust distributed systems. Amazon Redshift uses local attached storage to deliver high IO performance. This combination of in-cluster replication and continuous backup to Amazon S3 ensures you have a highly durable system. This is all entirely transparent to the running system.

Design 112

Design AWS Storage Systems 112

Alex Russell

JULY 14, 2021

The predominant desktop situation is relatively straightforward: Browsers handle links, and non-browsers defer loading http and https URLs to the system, which in turn invokes the default browser. Instead, they load content referred by their hosting native app in system-provided WebViews. The Baseline Scenario #.

Google 121

Google Mobile Engineering Internet 121

All Things Distributed

JUNE 21, 2017

DynamoDB has come a long way in the 5 years since we announced its availability in January 2012. DynamoDB was the first service at AWS to use SSD storage. You can add DAX to your existing DynamoDB applications with just a few clicks in the AWS Management Console – no application rewrites required.

Speed 123

Speed Cache Latency AWS 123

All Things Distributed

JANUARY 18, 2012

Werner Vogels weblog on building scalable and robust distributed systems. By Werner Vogels on 18 January 2012 07:00 AM. The original Dynamo design was based on a core set of strong distributed systems principles resulting in an ultra-scalable and highly reliable database system. All Things Distributed. Comments ().

Scalability 167

Scalability Database Ecommerce Latency 167

All Things Distributed

OCTOBER 8, 2014

The best part is that we are also significantly expanding the free tier many of you already enjoy by increasing the storage to 25 GB and throughput to 200 million requests per month. More than a decade ago, Amazon embarked on a mission to build a distributed system that challenged conventional methods of data storage and querying.

Availability 145

Availability Performance Scalability AWS 145

Alex Russell

MARCH 6, 2021

A then-representative $200USD device had 4-8 slow (in-order, low-cache) cores, ~2GiB of RAM, and relatively slow MLC NAND flash storage. The cheapest (high volume) Androids perform like 2012/2013 iPhones, respectively. low-end Androids have finally caught up to the iPhone 5 from 2012. The Moto G4 , for example.

Performance 124

Performance Network Cache Metrics 124

O'Reilly

JULY 25, 2023

To provide some coherence to the music, I decided to use Taylor Swift songs since her discography covers the time span of most papers that I typically read: Her main albums were released in 2006, 2008, 2010, 2012, 2014, 2017, 2019, 2020, and 2022. This choice also inspired me to call my project Swift Papers.

Programming 98

Programming Code Design Benchmarking 98

SQL Performance

APRIL 23, 2019

In SQL Server 2012, grouped (vector) aggregation was able to use parallel batch-mode execution, but only for the partial (per-thread) aggregate. Columnstore storage. To understand this, it is necessary to first review how columnstore storage works at a high level: A compressed row group contains a column segment for each column.

Servers 67

Servers Testing Metrics Storage 67

ScaleOut Software

MAY 15, 2014

For example, the IMDG must be able to efficiently create millions of objects in each server to make use of its huge storage capacity. We believe that installing our software should be as straightforward as we can make it, requiring minimal knowledge of the host operating system and the fewest possible explicit configuration settings.

Cache 40

Cache Servers Network Design 40

Percona

JANUARY 14, 2019

In a partitioned massively parallel database system, the storage format and sorting algorithm may not be optimized for that operation as we are reading multiple partitions in parallel. ClickHouse is a great massively parallel analytical system. blockade','arizona'] ? ? protests','occupy','romney','weiner','protesters'] ? ?

Database 40

Database Analytics Blockchain Healthcare 40