Brendan Gregg

DECEMBER 30, 2017

My last talk for 2017 was at AWS re:Invent, on "How Netflix Tunes EC2 Instances for Performance," an updated version of my [2014] talk. Fortunately, it was videoed for those who missed it. Networking. What I was most excited for was the launch of a new EC2 hypervisor, which I referred to in the video as the "c5 hypervisor".

Tuning 52

Tuning AWS Best Practices Network 52

Dynatrace

OCTOBER 28, 2021

In 2009, the purveyor of online videos migrated to AWS cloud infrastructure to deliver its entertainment to a growing audience. A disruption spanning hardware, networks, and cloud infrastructure can require input and participation from network and infrastructure architects, risk experts, security teams, and even procurement officers.

Engineering 234

Engineering Entertainment Cloud Infrastructure 234

The Netflix TechBlog

OCTOBER 19, 2020

Investigating a video streaming failure consists of inspecting all aspects of a member account. Reconstructing a streaming session was a tedious and time consuming process that involved tracing all interactions (requests) between the Netflix app, our Content Delivery Network (CDN), and backend microservices.

Infrastructure 233

Infrastructure Transportation Storage Open Source 233

High Scalability

JUNE 29, 2018

kellabyte : LOL at racking up an AWS bill of $140,000 in 4 hours of compute time. kellabyte : Recently I got to work on a project that really stressed Amazon AWS scalability. We spun up a cluster of 100,000 AWS instances multiple times. Google applies bulk discounts after the fact, AWS makes you ask for them ahead of time.

Scalability 131

Scalability Internet Internet Wireless 131

The Netflix TechBlog

MAY 21, 2019

Netflix engineers run a series of tests and benchmarks to validate the device across multiple dimensions including compatibility of the device with the Netflix SDK, device performance, audio-video playback quality, license handling, encryption and security. The neural network (NN)-based agent uses a deep net with fully connected layers.

Testing 163

Testing AWS Lambda Network 163

Brendan Gregg

NOVEMBER 28, 2017

At Netflix, we've been using these technologies as they've been made available for instance types in the AWS EC2 cloud. The latest AWS hypervisor, Nitro, uses everything to provide a new hardware-assisted hypervisor that is easy to use and has near bare-metal performance. AWS called this [enhanced networking].

Virtualization 40

Virtualization AWS Hardware Storage 40

The Morning Paper

MARCH 1, 2020

Firecracker is the virtual machine monitor (VMM) that powers AWS Lambda and AWS Fargate, and has been used in production at AWS since 2018. The first version of AWS Lambda was built using Linux containers. All of the existing approaches we just examined involve trade-offs that AWS didn’t want to make.

Serverless 101

Serverless Virtualization Lambda AWS 101

Smashing Magazine

SEPTEMBER 3, 2021

It can be hard to visualize the huge network of hardware that allows you to send a request for a page to a server and then receive a response back. The good news is that, as developers, we can do an awful lot about it. Recommended reading : How Improving Website Performance Can Help Save The Planet. More after jump!

Website 135

Website Energy Internet Internet 135

All Things Distributed

FEBRUARY 4, 2014

AWS has built a reputation over the years for the breadth and depth of our services and the pace of our innovation with 280 features released in 2013. These are the people working behind the scenes helping customers fully leverage all of AWS’s capabilities when running their infrastructure on AWS.

AWS 132

AWS Energy Innovation Best Practices 132

All Things Distributed

MARCH 11, 2016

The epoch of AWS is the launch of Amazon S3 on March 14, 2006, now almost 10 years ago. Given that AWS is a pioneer in building and operating these services world-wide, these lessons have been of crucial importance to our business. AWS helps its customers do this too. Build security in from the ground up.

AWS 144

AWS Hardware Retail Virtualization 144

All Things Distributed

AUGUST 20, 2015

Developers need efficient methods to store, traverse, and query these relationships. Social media apps navigate relationships between friends, photos, videos, pages, and followers. Like many AWS innovations, the desire to build a solution for a scalable graph database came from Amazon’s retail business. Sharing it with you.

Database 134

Database Logistics Availability Social Media 134

Brendan Gregg

FEBRUARY 28, 2023

The video is now on [YouTube]: The slides are [online] and as a [PDF]: first prev next last / permalink/zoom In Q&A I was asked about CXL (compute express link) which was fortunate as I had planned to cover it and then forgot, so the question let me talk about it (although Q&A is missing from the video).

Performance 110

Performance Latency Cache Virtualization 110

Smashing Magazine

JANUARY 11, 2021

Assets Optimizations Brotli, AVIF, WebP, responsive images, AV1, adaptive media loding, video compression, web fonts, Google fonts. Networking, HTTP/2, HTTP/3 OCSP stapling, EV/DV certificates, packaging, IPv6, QUIC, HTTP/3. You can then mimic the 90th percentile’s experience for testing.

Performance 145

Performance Cache Media Metrics 145

Smashing Magazine

AUGUST 3, 2023

This could be an image, a block of text, or even an embedded video. You need to beware that slow server response times can significantly increase TTFB, often due to server overload, network issues, or un-optimized logic on the server side. Download Time of HTML This is the time it takes to download the page’s HTML file.

Performance 74

Performance Cache Traffic Metrics 74

All Things Distributed

OCTOBER 12, 2016

Three years ago, as part of our AWS Fast Data journey we introduced Amazon ElastiCache for Redis , a fully managed in-memory data store that operates at sub-millisecond latency. ElastiCache for Redis Multi-AZ capability is built to handle any failover case for Redis Cluster with robustness and efficiency. Building upon Redis.

Scalability 130

Scalability Analytics Cache AWS 130

O'Reilly

MAY 19, 2020

Live online training, videos, books, certification prep, and more, from O’Reilly and our partner publishers. AWS is far and away the cloud leader, followed by Azure (at more than half of share) and Google Cloud. But most Azure and GCP users also use AWS; the reverse isn’t necessarily true. Amazon and AWS Ascendant.

Cloud 141

Cloud Serverless AWS Architecture 141

Brendan Gregg

FEBRUARY 28, 2023

The video is now on YouTube : The slides are online and as a PDF : first prev next last / permalink/zoom In Q&A I was asked about CXL (compute express link) which was fortunate as I had planned to cover it and then forgot, so the question let me talk about it (although Q&A is missing from the video).

Performance 52

Performance Latency Cache Virtualization 52

Smashing Magazine

JANUARY 6, 2020

To get a good first impression of how your competitors perform, you can use Chrome UX Report ( CrUX , a ready-made RUM data set, video introduction by Ilya Grigorik and detailed guide by Rick Viscomi) or Treo Sites , a RUM monitoring tool that is powered by Chrome UX Report. You can then mimic the 90th percentile’s experience for testing.

Performance 145

Performance Cache Network Metrics 145

Smashing Magazine

JANUARY 7, 2019

To get a good first impression of how your competitors perform, you can use Chrome UX Report ( CrUX , a ready-made RUM data set, video introduction by Ilya Grigorik), Speed Scorecard (also provides a revenue impact estimator), Real User Experience Test Comparison or SiteSpeed CI (based on synthetic testing). 150ms RTT, 1.5 Mbps down, 0.7

Performance 104

Performance Cache Network Metrics 104

Percona

APRIL 17, 2023

For example: UUID=f41e390f-835b-4223-a9bb-9b45984ddf8d / xfs rw,noatime,attr2,inode64,noquota 0 0 Unix ulimit settings Most UNIX-like operating systems, including Linux and macOS, provide ways to limit and control the usage of system resources such as threads, files, and network connections on a per-process and per-user basis.

Best Practices 52

Best Practices Design Tuning Database 52

VoltDB

JUNE 1, 2017

It was – like the hypothetical movie I describe above – more than a little bit odd, as you could leave a session discussing ever more abstract layers of virtualization and walk into one where they emphasized the critical importance of pinning a network interface to a specific VM for optimal performance. Watch the Video. Very Well!”

Hardware 56

Hardware Latency Virtualization Cloud 56

O'Reilly

NOVEMBER 28, 2023

How will AI adopters react when the cost of renting infrastructure from AWS, Microsoft, or Google rises? Several respondents also mentioned working with video: analyzing video data streams, video analytics, and generating or editing videos. But they may back off on AI development.

Open Source 106

Open Source Artificial Intelligence Google Infrastructure 106

High Scalability

NOVEMBER 25, 2019

Egnyte is a secure Content Collaboration and Data Governance platform, founded in 2007 when Google drive wasn't born and AWS S3 was cost-prohibitive. To add elasticity, reliability and durability, these data centers are connected to Google Cloud platform using high speed, secure Google Interconnect network. Video Transcoding.

Architecture 52

Architecture Cache Azure Storage 52

Brendan Gregg

SEPTEMBER 5, 2017

. ## Observability Here's the big picture of performance observability tools on Linux, from my [Linux performance] page, where I also have diagrams for other tool types, as well as videos and slides of prior Linux performance talks: I also have a USE Method: Linux Performance Checklist , as a different way to navigate and apply the tools.

Virtualization 76

Virtualization AWS Engineering Hardware 76

All Things Distributed

MAY 21, 2018

These new offerings are organized on platforms or networks, and less so in processes. Companies like C-SPAN show how: scores of people would have to scan video material for hours in order to create keywords, for example, according to a person's name. Machine learning can make human labor more effective.

Artificial Intelligence 76

Artificial Intelligence Technology Technology IoT 76