All Things Distributed

NOVEMBER 13, 2018

Today, I am happy to announce our plans to open a new AWS Region in Italy! The AWS Europe (Milan) Region is the 25th AWS Region that we've announced globally. It's the sixth AWS Region in Europe, joining existing regions in France, Germany, Ireland, the UK, and the new Region that we recently announced in Sweden.

AWS 167

AWS Energy Automotive Traffic 167

Brendan Gregg

APRIL 14, 2022

PMC analysis (2017). On the Netflix Java/Linux/EC2 stack there were no working mixed-mode flame graphs, no production safe dynamic tracer, and no PMCs: All tools I used extensively for advanced performance analysis. Apart from developing tools, much of my time has been spent helping teams with performance issues and evaluations.

Java 145

Java Cloud Cache AWS 145

Brendan Gregg

JULY 4, 2021

It's an exciting time for developments in computer performance, not just for the BPF technology (which I often [write about]) but also for processors with 3D stacking and cloud vendor CPUs (e.g., This was a chance to talk about other things I've been working on, such as the present and future of hardware performance.

Performance 52

Performance Latency Hardware Storage 52

Brendan Gregg

FEBRUARY 28, 2023

At USENIX SREcon22 APAC I gave the opening keynote on the future of computer performance, rounding up the latest developments and making predictions of where I see things heading. This talk originated from my updates to Systems Performance 2nd Edition , and this was the first time I've given this talk in person!

Performance 52

Performance Latency Cache Virtualization 52

The Symphonia

DECEMBER 6, 2017

The light show at the re:Play party Another re:Invent has come and gone, and us mere AWS-using mortals are now rapidly trying to sort the wheat from the chaff of a heady harvest of announcements. It’s funny to think that AWS Lambda was announced at re:Invent only 3 years ago?—?the skip to the end if you want my take on those.

Serverless 40

Serverless Lambda AWS Traffic 40

Dynatrace

MAY 6, 2021

Improved performance of Licensing and Environments overview page for clusters running dozens of environments. Linux: Amazon Linux AMI 2017.x. AWS CloudWatch metric Amazon MQ EnqueueTime sometimes has invalid minimum values reported by CloudWatch. See Update Dynatrace Managed topic. Cluster Management Console. APM-294399).

Operating System 230

Operating System AWS Metrics Storage 230

Brendan Gregg

SEPTEMBER 5, 2017

I gave a talk about container performance recently at DockerCon, and included a quick summary of how they work: YouTube , SlideShare : If you search of slideshare and youtube, you'll find many other good talks on containers as well. People rarely create them manually.

Virtualization 76

Virtualization AWS Engineering Hardware 76

Brendan Gregg

SEPTEMBER 25, 2021

These strange questions came to the fore back in 2014 when Netflix was switching services from CentOS Linux to Ubuntu, and I helped debug several weird performance issues including one I'll describe here. A quick check of basic performance statistics showed over 30% higher CPU consumption. How would you _time_ time?

Speed 126

Speed Java AWS Virtualization 126

The Symphonia

DECEMBER 13, 2017

got a lot smoother at re:Invent 2017. A thousand-times scaled Lambda could easily cause significant performance problems to a modest SQL database server. Because of this it is strongly recommended that, at the very least, you use separate AWS accounts for production and testing?—?deliberately One of those edges?—?that

Lambda 40

Lambda AWS Architecture Database 40

All Things Distributed

MAY 19, 2017

In many, high-throughput, OLTP style applications the database plays a crucial role to achieve scale, reliability, high-performance and cost efficiency. Amazon Aurora has become the fastest-growing service in the history of AWS and frequently is the target of migration from on-premise proprietary databases.

Database 117

Database Design Cloud Storage 117

Brendan Gregg

JULY 15, 2019

BPF (eBPF) tracing is a superpower that can analyze everything, and I'll show you how in my upcoming book BPF Performance Tools: Linux System and Application Observability , coming soon from Addison Wesley. I'm also grateful that my fiancée, Deirdré Straughan, could find the time outside of her AWS job to do technical copy-edit.

Systems 111

Systems Performance Education Technology 111

Dynatrace

JUNE 15, 2023

If your app runs in a public cloud, such as Amazon Web Services (AWS), Microsoft Azure, or Google Cloud Platform (GCP), the provider secures the infrastructure, while you’re responsible for security measures within applications and configurations. Likewise, attacks on open source libraries have increased.

Cloud 177

Cloud Open Source Architecture Monitoring 177

All Things Distributed

SEPTEMBER 29, 2016

The team with the highest-performing socialbot will win a $500,000 prize. Teams of university students can submit applications now and the contest will conclude at AWS re:Invent in November 2017, where the winners will be announced. Registration opened today and teams have until October 28, 2016 to submit their applications.

Artificial Intelligence 139

Artificial Intelligence Healthcare AWS Government 139

High Scalability

DECEMBER 7, 2018

This is how PCM is able to perform calculations. ivanveram : World R&D leading companies 2017 in US$. . $181.5M : top 10 YouTube star earnings; 153 million/1.2 The conductance of the material changes along with its physical state and can be modified using electrical pulses. 1: Amazon; No.2: 2: Alphabet (Google); No.3:

Internet 163

Internet Internet Scalability Blockchain 163

Scalegrid

APRIL 2, 2019

These results are pretty on-par with a 2017 survey by the Uptime Institute which found that 65% of enterprise workloads were still running in data centers owned and operated by those enterprises. Performance followed in fourth with 10.9% So, how are PostgreSQL users choosing to host the clusters that power their applications?

Database 185

Database Cloud Open Source Azure 185

The Netflix TechBlog

OCTOBER 19, 2020

By 2017, open source projects like Open-Tracing and Open-Zipkin were mature enough for use in polyglot runtime environments at Netflix. Our engineering teams tuned their services for performance after factoring in increased resource utilization due to tracing. Mantis is our go-to platform for processing operational data at Netflix.

Infrastructure 233

Infrastructure Transportation Storage Open Source 233

The Symphonia

MARCH 14, 2018

AWS announced a new service?—?the at re:Invent 2017. The general goal of SAR is to make it easier to distribute, and consume, applications that have been developed using AWS Serverless products, like Lambda. SAM itself is built on top of AWS CloudFormation ?—?Amazon’s the Serverless Application Repository (SAR)?—?at

Serverless 40

Serverless AWS Lambda Open Source 40

Brendan Gregg

APRIL 14, 2022

offer letter logo (2014) flame graphs (2014) eBPF tools (2014-2019) PMC analysis (2017) my pandemic-abandoned desk (2020); office wall I joined Netflix in 2014, a company at the forefront of cloud computing with an attractive work culture. Netflix has been the best job of my career so far, and I'll miss my colleagues and the culture.

Java 52

Java Cache Cloud AWS 52

Dynatrace

OCTOBER 17, 2019

And with today’s increasing financial, availability, performance and innovation requirements meaning applications need to be geographically dispersed to constantly changing dynamic powerhouses, it has become simply not possible to provision, update, monitor and decommissions them by only leveraging manual processes.

Code 109

Code Infrastructure DevOps Serverless 109

Percona

JANUARY 17, 2019

AWS Aurora (based on MySQL 5.6) In this article, we will look at how this can improve the reporting/analytical query performance in MySQL. I will compare AWS Aurora with MySQL (Percona Server) 5.6 I’m using the “Airlines On-Time Performance” database from [link] (You can find the scripts I used here: [link] ).

Cache 46

Cache C++ AWS Airlines 46

Brendan Gregg

SEPTEMBER 25, 2021

These strange questions came to the fore back in 2014 when Netflix was switching services from CentOS Linux to Ubuntu, and I helped debug several weird performance issues including one I'll describe here. A quick check of basic performance statistics showed over 30% higher CPU consumption. How would you _time_ time?

Speed 40

Speed Java AWS Virtualization 40

Brendan Gregg

JULY 14, 2019

BPF (eBPF) tracing is a superpower that can analyze everything, and I'll show you how in my upcoming book BPF Performance Tools: Linux System and Application Observability , coming soon from Addison Wesley. I'm also grateful that my fiancée, Deirdré Straughan, could find the time outside of her AWS job to do technical copy-edit.

Systems 40

Systems Performance Education Technology 40

Smashing Magazine

JANUARY 7, 2019

Front-End Performance Checklist 2019 [PDF, Apple Pages, MS Word]. Front-End Performance Checklist 2019 [PDF, Apple Pages, MS Word]. Web performance is a tricky beast, isn’t it? How do we actually know where we stand in terms of performance, and what our performance bottlenecks exactly are? Vitaly Friedman.

Performance 104

Performance Cache Metrics Network 104

Percona

APRIL 12, 2023

2017: MongoDB goes public, trading as MDB. We are really pleased with our Q1 performance and see it as continued validation of the massive market we are pursuing, our strong product market fit, and our ability to execute.” Some might say this marked the beginning of MongoDB’s “cloud push” escalation.)

Open Source 82

Open Source Programming Database Servers 82

Tasktop

AUGUST 23, 2021

As top-performers (those that understood and embraced Agile fundamentals) began to separate from their competitors, they sought more gains. By bringing the development and operations teams together, elite performers again separated themselves from the competition by shortening the feedback loop by another order of magnitude.

Software 52

Software Software Development Social Media 52

Enprowess

JANUARY 12, 2022

Twitter Lite PWA : It was integrated as the standard User Interface in 2017. Supports multitasking : voice search technology can simultaneously perform multiple tasks from navigation to setting up meetings and reminders. Serverless Computing – AWS Lambda – Amazon Web Services. Pinterest PWA: Pins increased by 401%.

Blockchain 59

Blockchain IoT Development Serverless 59

O'Reilly

FEBRUARY 18, 2020

Up until 2017, the ML+AI topic had been amongst the fastest growing topics on the platform. After several years of steady climbing—and after outstripping Java in 2017—Python-related interactions now comprise almost 10% of all usage. Not necessarily: Java-related searches increased by 5% between 2017 and 2018. Coincidence?

Software Architecture 134

Software Architecture DevOps Data Engineering Architecture 134

All Things Distributed

OCTOBER 2, 2017

We were pushing the limits of what was a leading commercial database at the time and were unable to sustain the availability, scalability and performance needs that our growing Amazon business demanded. So, we set out to build a fully hosted AWS database service based upon the original Dynamo design.

Internet 128

Internet Internet AWS Performance 128

O'Reilly

MARCH 23, 2023

While it is still very large, it is significantly smaller than models like GPT-3 while offering similar performance. All of these models are based on a technology called Transformers , which was invented by Google Research and Google Brain in 2017. Google has announced an API for PaLM, but at this point, there is only a waiting list.

Google 104

Google Open Source Programming Code 104