2015 AWS Traffic Tuning 
Brendan Gregg
DECEMBER 31, 2017
My last talk for 2017 was at AWS re:Invent, on "How Netflix Tunes EC2 Instances for Performance," an updated version of my [2014] talk. Our team looks after the BaseAMI, kernel tuning, OS performance tools and profilers, and self-service tools like Vector. Casey Rosenthal (traffic and chaos) Models of Availability.
Brendan Gregg
DECEMBER 30, 2017
My last talk for 2017 was at AWS re:Invent, on "How Netflix Tunes EC2 Instances for Performance," an updated version of my [2014] talk. Our team looks after the BaseAMI, kernel tuning, OS performance tools and profilers, and self-service tools like Vector. Casey Rosenthal (traffic and chaos) Models of Availability.
This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.
The Netflix TechBlog
AUGUST 29, 2023
A brief history of IPC at Netflix Netflix was early to the cloud, particularly for large-scale companies: we began the migration in 2008, and by 2010, Netflix streaming was fully run on AWS. In 2010, however, nearly none of it existed: the CNCF wasn’t formed until 2015! First, we’ve grown the number of different IPC clients.
Brendan Gregg
SEPTEMBER 25, 2021
Since instances of both CentOS and Ubuntu were running in parallel, I could collect flame graphs at the same time (same time-of-day traffic mix) and compare them side by side. Aftermath I provided details to AWS and Canonical, and then moved onto the other performance issues as part of the migration.
The Netflix TechBlog
DECEMBER 17, 2019
Nonetheless, we found a number of limitations that could not satisfy our requirements e.g. stalling the processing of log events until a dump is complete, missing ability to trigger dumps on demand, or implementations that block write traffic by using table locks. Blocking write traffic by locking tables. Writing events to any output.
The Netflix TechBlog
DECEMBER 17, 2019
Nonetheless, we found a number of limitations that could not satisfy our requirements e.g. stalling the processing of log events until a dump is complete, missing ability to trigger dumps on demand, or implementations that block write traffic by using table locks. Blocking write traffic by locking tables. Writing events to any output.
Brendan Gregg
SEPTEMBER 25, 2021
Since instances of both CentOS and Ubuntu were running in parallel, I could collect flame graphs at the same time (same time-of-day traffic mix) and compare them side by side. Aftermath I provided details to AWS and Canonical, and then moved onto the other performance issues as part of the migration.
Expert insights. Personalized for you.
61 
Let's personalize your content