Brendan Gregg

DECEMBER 30, 2017

My last talk for 2017 was at AWS re:Invent, on "How Netflix Tunes EC2 Instances for Performance," an updated version of my [2014] talk. Not a lot has changed with these tunables since my [2014] talk. Alex Maestretti (security) co-presented SecOps 2021 Today: Using AWS Services to Deliver SecOps. Networking.

Tuning 52

Tuning AWS Best Practices Network 52

Dynatrace

AUGUST 11, 2022

The FaaS model of cloud computing debuted in 2014 with startups like hook.io. Cloud providers such as Google, Amazon Web Services, and Microsoft also followed suit with frameworks such as Google Cloud Functions , AWS Lambda , and Microsoft Azure Functions. How does function as a service work?

Development 248

Development Serverless Best Practices Storage 248

All Things Distributed

SEPTEMBER 26, 2014

The AWS Loft is all about helping you scale and grow your business by offering free AWS technical resources. The AWS Loft is all about helping you scale and grow your business by offering free AWS technical resources. Take a look at the AWS Loft homepage. What’s Happening at the AWS Loft.

AWS 113

AWS Games Education Innovation 113

Brendan Gregg

SEPTEMBER 25, 2021

These strange questions came to the fore back in 2014 when Netflix was switching services from CentOS Linux to Ubuntu, and I helped debug several weird performance issues including one I'll describe here. Aftermath I provided details to AWS and Canonical, and then moved onto the other performance issues as part of the migration.

Speed 126

Speed Java AWS Virtualization 126

Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on.

Performance 140

Performance Latency Hardware Storage 140

Brendan Gregg

NOVEMBER 28, 2017

At Netflix, we've been using these technologies as they've been made available for instance types in the AWS EC2 cloud. The latest AWS hypervisor, Nitro, uses everything to provide a new hardware-assisted hypervisor that is easy to use and has near bare-metal performance. AWS called this [enhanced networking]. The first was c3.

Virtualization 40

Virtualization AWS Hardware Storage 40

Brendan Gregg

APRIL 14, 2022

offer letter logo (2014) flame graphs (2014) eBPF tools (2014-2019) PMC analysis (2017) my pandemic-abandoned desk (2020); office wall I joined Netflix in 2014, a company at the forefront of cloud computing with an attractive work culture. It was the most challenging job among those I interviewed for.

Java 52

Java Cloud Cache Analytics 52

Dynatrace

JUNE 15, 2023

If your app runs in a public cloud, such as Amazon Web Services (AWS), Microsoft Azure, or Google Cloud Platform (GCP), the provider secures the infrastructure, while you’re responsible for security measures within applications and configurations. Likewise, attacks on open source libraries have increased.

Cloud 173

Cloud Open Source Monitoring Architecture 173

Dynatrace

JULY 13, 2020

Two years later, I came across that same customer at the AWS re:Invent conference , who then told me they were in the midst of a big project, moving their eCommerce to AWS , targeting running a big chunk of it in Kubernetes next year. .

Google 130

Google DevOps Ecommerce Cloud 130

Dynatrace

JULY 13, 2020

Two years later, I came across that same customer at the AWS re:Invent conference , who then told me they were in the midst of a big project, moving their eCommerce to AWS , targeting running a big chunk of it in Kubernetes next year. .

Google 132

Google DevOps Ecommerce Cloud 132

All Things Distributed

MAY 19, 2017

Soon after the launch of Amazon Relation Dabase Service (RDS) AWS customers were giving us feedback that they would love to migrate to RDS but what they would love even more was if we could also unshackle them from the high-cost, punitive licensing schemes that came with the proprietary databases.

Database 120

Database Design Cloud Storage 120

Adrian Cockcroft

MARCH 24, 2020

My 2014 re:Invent talk provides a structured basis for covering all the aspects of cost optimization, although some of the examples are now out of date. AWS account management teams are engaging with customers globally to help them manage their costs and financial agility in these difficult times.

Cloud 52

Cloud Social Media Entertainment Healthcare 52

Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on.

Performance 52

Performance Latency Hardware Storage 52

Adrian Cockcroft

MARCH 24, 2020

My 2014 re:Invent talk provides a structured basis for covering all the aspects of cost optimization, although some of the examples are now out of date. AWS account management teams are engaging with customers globally to help them manage their costs and financial agility in these difficult times.

Cloud 40

Cloud Social Media Entertainment Healthcare 40

Brendan Gregg

FEBRUARY 28, 2023

Titus, the Netflix container management platform, is now open source,” [link] Apr 2018 - [Cutress 19] Dr.

Performance 110

Performance Latency Cache Virtualization 110

Brendan Gregg

SEPTEMBER 25, 2021

These strange questions came to the fore back in 2014 when Netflix was switching services from CentOS Linux to Ubuntu, and I helped debug several weird performance issues including one I'll describe here. Aftermath I provided details to AWS and Canonical, and then moved onto the other performance issues as part of the migration.

Speed 40

Speed Java AWS Virtualization 40

Brendan Gregg

SEPTEMBER 25, 2021

These strange questions came to the fore back in 2014 when Netflix was switching services from CentOS Linux to Ubuntu, and I helped debug several weird performance issues including one I'll describe here. Aftermath I provided details to AWS and Canonical, and then moved onto the other performance issues as part of the migration.

Speed 52

Speed Java AWS Virtualization 52

Brendan Gregg

AUGUST 29, 2021

1072-aws (xxx) 12/18/2018 _x86_64_ (16 CPU) avg-cpu: %user %nice %system %iowait %steal %idle 5.03 1072-aws (xxx) 12/19/2018 _x86_64_ (16 CPU) avg-cpu: %user %nice %system %iowait %steal %idle 12.25 Device: rrqm/s wrqm/s r/s w/s rkB/s wkB/s avgrq-sz avgqu-sz await r_await w_await svctm %util xvda 0.00

Cache 105

Cache C++ AWS Latency 105

High Scalability

JUNE 22, 2018

Ultimately, Netflix did end up paying Comcast in 2014 and, surprise surprise, the throttling stopped. Eitally : there are a few critical differences between GCP and AWS or Azure. It doesn't lessen the impact or importance of OpenConnect; but, it grew out of a very real impasse with a very large ISP.

Internet 113

Internet Internet Scalability Artificial Intelligence 113

Brendan Gregg

FEBRUARY 28, 2023

Titus, the Netflix container management platform, is now open source,” [link] , Apr 2018 [Cutress 19] Dr.

Performance 52

Performance Latency Cache Virtualization 52

All Things Distributed

OCTOBER 25, 2018

Expanding the AWS Cloud—An AWS Region is coming to South Africa! Today, I am excited to announce our plans to open a new AWS Region in South Africa! AWS is committed to South Africa's transformation. This news marks the 23rd AWS Region that we have announced globally. We have a long history in South Africa.

AWS 167

AWS Cloud Education Programming 167

The Netflix TechBlog

JUNE 20, 2019

We built this hack using Java (Springboot framework), the Google OAuth and Calendar APIs (for finding rooms) and Twilio API (for calling into the meeting), and deployed it on AWS. Thanks to all the teams who put together a great round of hacks in 24 hours.

Energy 37

Energy Java AWS Innovation 37

Brendan Gregg

JULY 15, 2019

I've been helping lead BPF observability since 2014, and I'm a major contributor and maintainer for the front-ends. I'm also grateful that my fiancée, Deirdré Straughan, could find the time outside of her AWS job to do technical copy-edit. It was developed with the help of many members and leaders of the BPF community.

Systems 111

Systems Performance Education AWS 111

The Polyglot Developer

JANUARY 29, 2015

Since starting this blog in July of 2014, I have had an unexpected amount of growth. A common issue that has plagued me and many other WordPress users is the awful MySQL crash due to exhausted resources. So much, that a lot of strain has been placed on my virtual private server (VPS).

Monitoring 40

Monitoring Traffic Internet Internet 40

Brendan Gregg

AUGUST 29, 2021

1072-aws (xxx) 12/18/2018 _x86_64_ (16 CPU) avg-cpu: %user %nice %system %iowait %steal %idle 5.03 1072-aws (xxx) 12/19/2018 _x86_64_ (16 CPU) avg-cpu: %user %nice %system %iowait %steal %idle 12.25 Device: rrqm/s wrqm/s r/s w/s rkB/s wkB/s avgrq-sz avgqu-sz await r_await w_await svctm %util xvda 0.00 41 33680 53408 0 78 100.0%

Cache 40

Cache C++ AWS Systems 40

All Things Distributed

DECEMBER 12, 2018

In April 2017, Amazon Web Services announced that it would launch a new AWS infrastructure region Region in Sweden. Today, I'm happy to announce that the AWS Europe (Stockholm) Region, our 20th Region globally, is now generally available for use by customers. Public sector.

AWS 124

AWS Cloud Games Serverless 124

All Things Distributed

APRIL 4, 2017

Today, I am very excited to announce our plans to open a new AWS Region in the Nordics! The new region will give Nordic-based businesses, government organisations, non-profits, and global companies with customers in the Nordics, the ability to leverage the AWS technology infrastructure from data centers in Sweden.

AWS 117

AWS Airlines Latency Games 117

Brendan Gregg

SEPTEMBER 5, 2017

I spoke about the performance differences in my 2014 SCALE keynote "What Linux can learn from Solaris performance and vice-versa" ([slides]) where the conclusion was that Linux may run faster out of the box, but I could typically make Solaris run much faster thanks to optimizations found using DTrace.

Virtualization 76

Virtualization AWS Engineering Hardware 76

Brendan Gregg

JULY 14, 2019

I've been helping lead BPF observability since 2014, and I'm a major contributor and maintainer for the front-ends. I'm also grateful that my fiancée, Deirdré Straughan, could find the time outside of her AWS job to do technical copy-edit. It was developed with the help of many members and leaders of the BPF community.

Systems 40

Systems Performance Education Technology 40

Tim Kadlec

JANUARY 30, 2014

We’ve seen these sorts of comparison before, and frankly claiming that you “might” not need jQuery is an awful innocent statement to make. According to the the latest run of HTTPArchive’s top 1000 sites (January 15, 2014), the average weight for a page is 1463kb. The site itself didn’t seem particularly exciting or controversial.

Mobile 40

Mobile AWS Code Testing 40

Smashing Magazine

MARCH 23, 2020

In ‘Girls Are Silly, Aren’t Boys Awful,’ Storch placed two children forehead to forehead with the gutter between them. Girls Are Silly, Aren’t Boys Awful. Spread from McCall’s Magazine Art direction by Otto Storch. Recreated by Andy Clarke. Large preview ). He emphasised this tension by aligning his text in opposite directions.

Design 106

Design Media Energy Availability 106

The Netflix TechBlog

FEBRUARY 20, 2019

Historically the focus of our tooling and platform has been on AWS EC2, but with more users making the migration, we need to provide better support for container use cases. Why the changes There are two main triggers for the refresh: Firstly, at Netflix we are seeing significant growth in the use of our container environment (Titus).

Performance 211

Performance Latency Open Source Metrics 211

All Things Distributed

JULY 20, 2015

Hailo was founded in 2011 and has been built on AWS since Day 1. Over the past few years, Hailo has evolved from a monolithic application running in one AWS region to a microservices-based architecture running across multiple regions. Hailo has a global network of over 60,000 drivers and more than a million passengers.

Latency 166

Latency Architecture AWS Open Source 166

High Scalability

NOVEMBER 16, 2018

AWS Redshift FTW! yishengdd : However from my own experience, AWS Amplify is 10x better than Google Firebase. Doubleslash : Back in 2014 OpenStack may have been a thing but nowadays, 4 years later, people learned a lesson. @Werner : Amazon's Oracle data warehouse was one of the largest (if not THE largest) in the world.

Internet 28

Internet Internet Scalability Energy 28