Brendan Gregg

JULY 4, 2021

It's an exciting time for developments in computer performance, not just for the BPF technology (which I often [write about]) but also for processors with 3D stacking and cloud vendor CPUs (e.g., I also wrote about these topics in detail for my recent [Systems Performance 2nd Edition] book. Ford, et al., “TCP

Performance 52

Performance Latency Hardware Storage 52

Brendan Gregg

FEBRUARY 28, 2023

At USENIX SREcon22 APAC I gave the opening keynote on the future of computer performance, rounding up the latest developments and making predictions of where I see things heading. This talk originated from my updates to Systems Performance 2nd Edition , and this was the first time I've given this talk in person! Ford, et al., “TCP

Performance 52

Performance Latency Cache Virtualization 52

All Things Distributed

MARCH 5, 2012

Werner Vogels weblog on building scalable and robust distributed systems. By Werner Vogels on 05 March 2012 02:01 PM. AWS today announced a substantial price drop from March 1, 2012 for many of the Amazon EC2, Amazon RDS, and Amazon ElastiCache instances types around the world. All Things Distributed. Comments (). Contact Info.

AWS 110

AWS Innovation Scalability Cache 110

All Things Distributed

JULY 19, 2012

Werner Vogels weblog on building scalable and robust distributed systems. By Werner Vogels on 19 July 2012 12:00 AM. Magnetic disks are rapidly starting to exhibit tape-like properties and with modern workloads being increasingly random, they are becoming less and less suitable as a storage system. All Things Distributed.

Cloud 129

Cloud Performance AWS Virtualization 129

All Things Distributed

SEPTEMBER 25, 2012

Werner Vogels weblog on building scalable and robust distributed systems. By Werner Vogels on 25 September 2012 06:00 PM. Amazon RDS Provisioned IOPS is ideal for mission-critical online transaction processing (OLTP) workloads that require a high performance storage option with consistent IOPS, within a narrow band of tolerance.

Cloud 117

Cloud AWS Storage Database 117

All Things Distributed

MARCH 20, 2012

Werner Vogels weblog on building scalable and robust distributed systems. By Werner Vogels on 20 March 2012 09:00 PM. This application is a great way to highlight how developers might leverage different services, abstractions, and tools to deliver the most value to their customers. in the development platform space?

AWS 104

AWS Scalability Java Storage 104

All Things Distributed

APRIL 5, 2012

Werner Vogels weblog on building scalable and robust distributed systems. By Werner Vogels on 06 April 2012 06:00 AM. Recently I had great conversations with Troy Otillio, Senior Development Manager at Intuit and Jack Murgia, Senior DevOps Engineer at Edmodo. and took near zero development effort. All Things Distributed.

Innovation 146

Innovation AWS Education Network 146

Scalegrid

JULY 17, 2020

Often times an external system is providing data as JSON, so it might be a temporary store before data is ingested into other parts of the system. Wave 1: PostgreSQL 9.2 (2012) added support for JSON data type. JSONB storage results in a larger storage footprint. For example, Stripe transactions.

Storage 321

Storage Database Efficiency Processing 321

All Things Distributed

AUGUST 16, 2012

Werner Vogels weblog on building scalable and robust distributed systems. By Werner Vogels on 16 August 2012 10:00 AM. However during development and the year of business AWS lowered it prices a number of times such that the project paid back for itself in 8 months. All Things Distributed. Comments (). Saving money.

AWS 118

AWS Hardware Traffic Best Practices 118

Smashing Magazine

NOVEMBER 8, 2018

In this article, I will describe this latter solution, based on a WordPress application storing files on Amazon Web Services (AWS) Simple Storage Service (S3) (a cloud object storage solution to store and retrieve data), operating through the AWS SDK. Conclusion. rb, ra, yk, il).

AWS 44

AWS Servers Storage Cloud 44

O'Reilly

SEPTEMBER 19, 2023

It progressed from “raw compute and storage” to “reimplementing key services in push-button fashion” to “becoming the backbone of AI work”—all under the umbrella of “renting time and storage on someone else’s computers.” ” (It will be easier to fit in the overhead storage.)

Hardware 99

Hardware Storage Big Data Blockchain 99

Brendan Gregg

NOVEMBER 29, 2017

It's an exciting development in cloud computing: hardware virtualization is now fast. I've summarized hypervisor developments in EC2 with the above diagram. But not all workloads: some are network bound (proxies) and storage bound (databases). ## 5. This was extended to instance storage devices for the x1.32xlarge in 2016.

Virtualization 111

Virtualization AWS Hardware Storage 111

Alex Russell

JULY 14, 2021

Developers also suffer higher costs and reduced opportunities to escape Google, Facebook, and Apple's walled gardens. Web engineers frequently refer to browsers as "User Agents", a nod to their unique role as interpreters of developer intent that give users the final say over how the web is experienced.

Google 121

Google Mobile Engineering Internet 121

Brendan Gregg

NOVEMBER 28, 2017

It's an exciting development in cloud computing: hardware virtualization is now fast. I've summarized hypervisor developments in EC2 with the above diagram. But not all workloads: some are network bound (proxies) and storage bound (databases). ## 5. This was extended to instance storage devices for the x1.32xlarge in 2016.

Virtualization 40

Virtualization AWS Hardware Storage 40

All Things Distributed

OCTOBER 2, 2017

Our straining database infrastructure on Oracle led us to evaluate if we could develop a purpose-built database that would support our business needs for the long term. The requirements for a fully hosted cloud database service needed to be at an even higher bar than what we had set for our Amazon internal system.

Internet 128

Internet Internet AWS Performance 128

All Things Distributed

FEBRUARY 15, 2013

Werner Vogels weblog on building scalable and robust distributed systems. Amazon Redshift uses local attached storage to deliver high IO performance. This combination of in-cluster replication and continuous backup to Amazon S3 ensures you have a highly durable system. This is all entirely transparent to the running system.

Design 110

Design AWS Storage Systems 110

All Things Distributed

JUNE 21, 2017

DynamoDB has come a long way in the 5 years since we announced its availability in January 2012. DynamoDB was the first service at AWS to use SSD storage. These interactions allow me to understand their emerging needs, which I take back to our development teams to further iterate on our services. Saving crucial milliseconds.

Speed 121

Speed Cache Latency AWS 121

All Things Distributed

JANUARY 18, 2012

Werner Vogels weblog on building scalable and robust distributed systems. By Werner Vogels on 18 January 2012 07:00 AM. s Dynamo technology , which was one of the first non-relational databases developed at Amazon. All Things Distributed. Amazon DynamoDB â?? Comments (). History of NoSQL at Amazon â?? The growth of Amazonâ??s

Scalability 167

Scalability Database Ecommerce Latency 167

All Things Distributed

OCTOBER 8, 2014

Today, I’m thrilled to announce several major features that significantly enhance the development experience on DynamoDB. These improvements have been sought by many applications developers, and we are happy to be bringing them to you. In 2012, we launched Amazon DynamoDB, the successor to Amazon Dynamo. NoSQL and Scale.

Availability 145

Availability Performance Scalability AWS 145

Alex Russell

MARCH 6, 2021

A then-representative $200USD device had 4-8 slow (in-order, low-cache) cores, ~2GiB of RAM, and relatively slow MLC NAND flash storage. The cheapest (high volume) Androids perform like 2012/2013 iPhones, respectively. Compared to devices wealthy developers carry, the performance is night and (blinding) day.

Performance 124

Performance Network Cache Metrics 124

O'Reilly

JULY 25, 2023

To provide some coherence to the music, I decided to use Taylor Swift songs since her discography covers the time span of most papers that I typically read: Her main albums were released in 2006, 2008, 2010, 2012, 2014, 2017, 2019, 2020, and 2022. This choice also inspired me to call my project Swift Papers. But still, I liked how Moment.js

Programming 98

Programming Code Design Benchmarking 98

SQL Performance

APRIL 23, 2019

In SQL Server 2012, grouped (vector) aggregation was able to use parallel batch-mode execution, but only for the partial (per-thread) aggregate. Columnstore storage. To understand this, it is necessary to first review how columnstore storage works at a high level: A compressed row group contains a column segment for each column.

Servers 67

Servers Testing Metrics Storage 67

ScaleOut Software

MAY 15, 2014

For example, the IMDG must be able to efficiently create millions of objects in each server to make use of its huge storage capacity. This philosophy manifests itself in all areas, including installation, application development, and cluster management. Distributed Cache or In-Memory Data Grid?

Cache 40

Cache Servers Network Design 40