Brendan Gregg

JULY 4, 2021

It's an exciting time for developments in computer performance, not just for the BPF technology (which I often [write about]) but also for processors with 3D stacking and cloud vendor CPUs (e.g., I also wrote about these topics in detail for my recent [Systems Performance 2nd Edition] book. Ford, et al., “TCP

Performance 140

Performance Latency Hardware Storage 140

Brendan Gregg

FEBRUARY 28, 2023

At USENIX SREcon22 APAC I gave the opening keynote on the future of computer performance, rounding up the latest developments and making predictions of where I see things heading. This talk originated from my updates to [Systems Performance 2nd Edition], and this was the first time I've given this talk in person! Ford, et al., “TCP

Performance 110

Performance Latency Cache Virtualization 110

Randon ASCII

OCTOBER 1, 2023

In a steady-state process (not allocating excessively) on a system with sufficient memory (this system had 64 GiB of RAM and roughly 47 GiB of that was available) the number of page faults should be close to zero, and this was a long way from that. Every second the system process wakes up and runs KeBalanceSetManager.

Efficiency 98

Efficiency Processing Programming Systems 98

The Agile Manager

JANUARY 31, 2014

The growth in demand for software has consistently outpaced the growth in the supply of software developers. Each major expansion in software development - automation (60s), productivity (80s), internet (90s), mobile (00s) - has been additive to the total stock of software in the world. It's worth looking at why.

Software 73

Software Software Development Government 73

O'Reilly

APRIL 23, 2024

Perhaps a more direct way to say this in the context of economic value creation is that companies such as Amazon and Google and Facebook had developed a set of remarkable advances in networked and data-enabled market coordination. By the end of 2012, it was up to 82%. Regulators would be wise to get ahead of this development.

Social Media 107

Social Media Google Internet Internet 107

Strategic Tech

NOVEMBER 1, 2021

An abstract example of a high-level value stream for a single development team A value stream at the level of detail above isn’t particularly useful. Some teams have complicated branching and testing processes which need accentuating, especially when legacy systems are involved or deploying to app stores.

Software Architecture 98

Software Architecture Architecture DevOps Software 98

All Things Distributed

NOVEMBER 13, 2018

In 2012, Amazon opened its first Italian office and its first Italian point of presence (PoP) based in Milan. By moving to AWS, Lamborghini was able to prepare the development and test environment in a couple of days. Since then, AWS has added another PoP in Palermo in 2017.

AWS 167

AWS Energy Automotive Traffic 167

All Things Distributed

MARCH 5, 2012

Werner Vogels weblog on building scalable and robust distributed systems. By Werner Vogels on 05 March 2012 02:01 PM. AWS today announced a substantial price drop from March 1, 2012 for many of the Amazon EC2, Amazon RDS, and Amazon ElastiCache instances types around the world. All Things Distributed. Comments (). Contact Info.

AWS 111

AWS Innovation Scalability Cache 111

Alex Russell

JULY 14, 2021

Developers also suffer higher costs and reduced opportunities to escape Google, Facebook, and Apple's walled gardens. Web engineers frequently refer to browsers as "User Agents", a nod to their unique role as interpreters of developer intent that give users the final say over how the web is experienced.

Google 121

Google Mobile Engineering Internet 121

All Things Distributed

SEPTEMBER 7, 2012

Werner Vogels weblog on building scalable and robust distributed systems. By Werner Vogels on 07 September 2012 03:00 PM. One of the main reasons for picking some of these older papers as back-to-basics reading is that the first researchers on a topic had to develop the fundamental models and principles from scratch.

Software Engineering 88

Software Engineering Scalability Engineering Systems 88

SQL Performance

FEBRUARY 22, 2021

On the contrary, it is almost always because they have developed better and more modern ways to solve those same problems. The system table sys.sysprocesses was replaced way back in SQL Server 2005 by a set of dynamic management views (DMVs), most notably sys.dm_exec_requests , sys.dm_exec_sessions , and sys.dm_exec_connections.

Latency 57

Latency Servers Monitoring Systems 57

ACM Sigarch

APRIL 26, 2018

The new DGX-2, which achieves 2 petaFLOPS in the system, combines 16 fully interconnected GPUS with 10x the deep learning performance. To my best knowledge, even though the term NPU was first mentioned in a MICRO 2012 paper by Hadi Esmaeilzadeh et al. , the first commercial product named after NPU in industry is from Vimicro in 2016.

Hardware 99

Hardware Artificial Intelligence Architecture Google 99

Brendan Gregg

JULY 4, 2021

It's an exciting time for developments in computer performance, not just for the BPF technology (which I often [write about]) but also for processors with 3D stacking and cloud vendor CPUs (e.g., I also wrote about these topics in detail for my recent [Systems Performance 2nd Edition] book. Ford, et al., “TCP

Performance 52

Performance Latency Hardware Storage 52

SQL Performance

MARCH 15, 2021

In my last post , I illustrated one reason you should stop using deprecated system tables like sysprocesses. Since SQL Server 2012 (and, to a much lesser extent, since SQL Server 2008), the most complete and flexible solution for monitoring events on a SQL Server instance has been Extended Events.

Servers 64

Servers Azure Best Practices Monitoring 64

Brendan Gregg

FEBRUARY 28, 2023

At USENIX SREcon22 APAC I gave the opening keynote on the future of computer performance, rounding up the latest developments and making predictions of where I see things heading. This talk originated from my updates to Systems Performance 2nd Edition , and this was the first time I've given this talk in person! Ford, et al., “TCP

Performance 52

Performance Latency Cache Virtualization 52

The Netflix TechBlog

DECEMBER 17, 2019

This motivated the development of DBLog , which offers log and dump processing under a generic framework. In order to be supported, a database is required to fulfill a set of features that are commonly available in systems like MySQL, PostgreSQL, MariaDB, and others. Some of DBLog’s features are: Processes captured log events in-order.

Database 197

Database Traffic Transportation Open Source 197

All Things Distributed

NOVEMBER 12, 2012

Werner Vogels weblog on building scalable and robust distributed systems. By Werner Vogels on 12 November 2012 05:00 AM. Please also visit the AWS developer blog for more great stories from our Australian customers and partners. All Things Distributed. Expanding the Cloud â?? introducing the Asia Pacific (Sydney) Region.

Cloud 118

Cloud AWS Ecommerce Latency 118

Percona

JUNE 4, 2023

Before we dive into the differences between MariaDB and MySQL, we will provide a thorough examination of each relational database management system (RDBMS). While originally designed to be a drop-in replacement for MySQL, it evolved into its own distinct database management system and is now maintained and supported by the MariaDB Foundation.

Open Source 52

Open Source Servers Storage Scalability 52

The Netflix TechBlog

DECEMBER 17, 2019

This motivated the development of DBLog , which offers log and dump processing under a generic framework. In order to be supported, a database is required to fulfill a set of features that are commonly available in systems like MySQL, PostgreSQL, MariaDB, and others. Some of DBLog’s features are: Processes captured log events in-order.

Database 212

Database Traffic Transportation Open Source 212

Alex Russell

MARCH 6, 2021

The cheapest (high volume) Androids perform like 2012/2013 iPhones, respectively. Meanwhile, developer behaviour offers little hope: Median mobile JavaScript payloads have only grown since 2016, now hovering above 400KiB of script transferred, or nearly 2.5MiB of uncompressed JS. The Moto G7 very much looks the part.

Performance 124

Performance Network Cache Metrics 124

All Things Distributed

FEBRUARY 22, 2012

Werner Vogels weblog on building scalable and robust distributed systems. By Werner Vogels on 22 February 2012 12:01 AM. Today AWS launched an exciting new service for developers: the Amazon Simple Workflow Service. Application developers must coordinate multiple distributed components to get the desired results.

Cloud 130

Cloud AWS Java Scalability 130

All Things Distributed

JULY 19, 2012

Werner Vogels weblog on building scalable and robust distributed systems. By Werner Vogels on 19 July 2012 12:00 AM. Magnetic disks are rapidly starting to exhibit tape-like properties and with modern workloads being increasingly random, they are becoming less and less suitable as a storage system. All Things Distributed.

Cloud 129

Cloud Performance AWS Virtualization 129

All Things Distributed

SEPTEMBER 25, 2017

We have supported the development of technology skills across the region with Training and Certification programs to help customers develop skills to design, deploy, and operate their infrastructure and applications on the AWS Cloud. The BIPA has moved their Learning Management System to AWS, reducing costs by over 90%.

Cloud 154

Cloud Education Energy Government 154

All Things Distributed

NOVEMBER 8, 2012

Werner Vogels weblog on building scalable and robust distributed systems. By Werner Vogels on 08 November 2012 03:00 PM. This enables your applications to take advantage of batch pricing more easily, without custom development. Shazam , developers of the mobile discovery app, report using SQS as a buffer for DynamoDB.

Efficiency 107

Efficiency Cloud Games Scalability 107

Brendan Gregg

NOVEMBER 29, 2017

It's an exciting development in cloud computing: hardware virtualization is now fast. I've summarized hypervisor developments in EC2 with the above diagram. This is a great development, and I've been working on a blog post to describe these new instance types: with hardware virtualization for CPU, memory, network, *and* storage.

Virtualization 111

Virtualization AWS Hardware Storage 111

All Things Distributed

MARCH 20, 2012

Werner Vogels weblog on building scalable and robust distributed systems. By Werner Vogels on 20 March 2012 09:00 PM. This application is a great way to highlight how developers might leverage different services, abstractions, and tools to deliver the most value to their customers. in the development platform space?

AWS 106

AWS Scalability Java Storage 106

All Things Distributed

JANUARY 23, 2012

Werner Vogels weblog on building scalable and robust distributed systems. By Werner Vogels on 23 January 2012 12:01 AM. For more information on the AWS Storage Gateway, you can visit the detail page Jeff Barr over at the AWS Developer Blog has more details. All Things Distributed. Expanding the Cloud - The AWS Storage Gateway.

Storage 116

Storage AWS Virtualization Cloud 116

Alex Russell

FEBRUARY 21, 2023

If you're a web developer not living under a rock, you undoubtedly got word of last week's big Safari 16.4 By mandating proof of developer enthusiasm for features, extensive test suites, and accurate specifications, the catch-up process has been put on rails for Apple. What choice do developers have, but to sit and stew?

Energy 79

Energy Games Engineering Design 79

All Things Distributed

AUGUST 20, 2012

Werner Vogels weblog on building scalable and robust distributed systems. By Werner Vogels on 21 August 2012 12:01 AM. It requires substantial upfront capital investments in cold data storage systems such as tape robots and tape libraries, then thereâ??s All Things Distributed. Expanding the Cloud â?? Comments ().

Storage 122

Storage Cloud AWS Media 122

Sutter's Mill

NOVEMBER 30, 2012

I said something similar to the above, but with two important differences: I said hardware “threads,” not only hardware “cores” – it was about the amount of hardware parallelism available on a mainstream system. Longer answer follows: Here’s the main part from article, “Design for Manycore Systems” (August 11, 2009).

Hardware 40

Hardware Programming Scalability Software 40

Smashing Magazine

FEBRUARY 5, 2019

Sometimes, due to insufficient memory, the operating system might need to remove your app from memory while the app is in the background, and the app might lose track of its last UI state if it is not preserved, possibly causing users to lose their work in progress! to go to the home or multitasking screen). There you have it!

Performance 75

Performance Energy Operating System Code 75

Alex Russell

DECEMBER 22, 2018

Back in 2012, a slate of reformers (including myself) ran with a few goals in mind: Refocusing the group on the APIs that most impacted web developers; namely DOM, CSS, and interaction with JS. For the past 6 years, I’ve served as a member of the W3C’s Technical Architecture Group (or “TAG” for short).

Logistics 40

Logistics Google Government Design 40

Scalegrid

JULY 17, 2020

Often times an external system is providing data as JSON, so it might be a temporary store before data is ingested into other parts of the system. Wave 1: PostgreSQL 9.2 (2012) added support for JSON data type. Developers are discouraged from holding a database connection while other operations take place. Learn more.

Storage 321

Storage Database Efficiency Processing 321

Smashing Magazine

JUNE 30, 2021

iOS empowers developers to easily parallelize code using Grand Central Dispatch , Android does this via their new, unified task scheduler WorkManager and game engines like Unity have job systems. Consequently, we as developers have 1000ms/60 = 16.6ms to produce each frame, which is also called the “frame budget”. Web Workers.

Games 145

Games Architecture Code C++ 145

All Things Distributed

SEPTEMBER 25, 2012

Werner Vogels weblog on building scalable and robust distributed systems. By Werner Vogels on 25 September 2012 06:00 PM. Parse , the very cool mobile development platform that runs on AWS, switched to using Provisioned I/O for EBS to run their databases. All Things Distributed. Expanding the Cloud â?? Comments (). Contact Info.

Cloud 118

Cloud AWS Storage Database 118

O'Reilly Software

OCTOBER 23, 2018

A look at the roles of architect and strategist, and how they help develop successful technology strategies for business. Technology systems are difficult to wrangle. Our systems grow in accidental complexity and complication over time. By 2012, Harvard Business Review published an article by Thomas Davenport and D.J.

Strategy 100

Strategy Architecture Technology Technology 100

Smashing Magazine

APRIL 1, 2020

In the end, youll have built a shopping cart using GraphCMS (a (backend-only content management system). A scalable, cross-platform content management system is crucial to ensuring a product’s growth velocity. A headless CMS gives developers the ability to harness creativity quickly. Check here for more facts. Headless CMS Pros.

Open Source 103

Open Source Website Mobile Code 103