Brendan Gregg

NOVEMBER 29, 2017

Hardware virtualization for cloud computing has come a long way, improving performance using technologies such as VT-x, SR-IOV, VT-d, NVMe, and APICv. At Netflix, we've been using these technologies as they've been made available for instance types in the AWS EC2 cloud. Each dimension has progressed through these stages: 1.

Virtualization 111

Virtualization AWS Hardware Storage 111

Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on. Note that my predictions in this talk may be wrong, but they should be thought-provoking.

Performance 52

Performance Latency Hardware Storage 52

The Morning Paper

MARCH 8, 2020

This paper presents Snowflake design and implementation along with a discussion on how recent changes in cloud infrastructure (emerging hardware, fine-grained billing, etc.) Tenant isolation is achieved by provisioning a separate virtual warehouse (VW) for each tenant. S3 on AWS). From shared-nothing to disaggregation.

Storage 112

Storage Engineering Cache Serverless 112

VoltDB

JUNE 1, 2017

It was – like the hypothetical movie I describe above – more than a little bit odd, as you could leave a session discussing ever more abstract layers of virtualization and walk into one where they emphasized the critical importance of pinning a network interface to a specific VM for optimal performance.

Hardware 56

Hardware Latency Virtualization Cloud 56

Brendan Gregg

FEBRUARY 28, 2023

Make sure your system can handle next-generation DRAM,” [link] , Nov 2011 [Hruska 12] Joel Hruska, “The future of CPU scaling: Exploring options on the cutting edge,” [link] , Feb 2012 [Gregg 13] Brendan Gregg, “Blazing Performance with Flame Graphs,” [link] , 2013 [Shimpi 13] Anand Lal Shimpi, “Seagate to Ship 5TB HDD in 2014 using Shingled Magnetic (..)

Performance 52

Performance Latency Cache Virtualization 52

Adrian Cockcroft

JUNE 21, 2022

The early days at Sun Cambridge were special, I absorbed a lot about networking and the technical side of the role from my fellow systems engineer Martin Baines, and we were driving all over the region in cool company cars (I had a Citroen BX 16V) selling a really hot product. He hasn’t changed.

Tuning 52

Tuning Benchmarking Engineering C++ 52

VoltDB

JUNE 1, 2017

It was – like the hypothetical movie I describe above – more than a little bit odd, as you could leave a session discussing ever more abstract layers of virtualization and walk into one where they emphasized the critical importance of pinning a network interface to a specific VM for optimal performance.

Hardware 40

Hardware Latency Virtualization Cloud 40

Dynatrace

SEPTEMBER 15, 2020

As an Amazon Web Services (AWS) Advanced Technology Partner, Dynatrace easily integrates with AWS to help you stay on top of the dynamics of your enterprise cloud environment?. We’re therefore excited to announce that Dynatrace has received the AWS Outposts Service Ready designation. What is AWS Outposts?

AWS 195

AWS Design Cloud Storage 195

Brendan Gregg

NOVEMBER 28, 2017

Hardware virtualization for cloud computing has come a long way, improving performance using technologies such as VT-x, SR-IOV, VT-d, NVMe, and APICv. At Netflix, we've been using these technologies as they've been made available for instance types in the AWS EC2 cloud. Each dimension has progressed through these stages: 1.

Virtualization 40

Virtualization AWS Hardware Storage 40

All Things Distributed

DECEMBER 20, 2017

Take the example of industrial manufacturing: in prototyping, drafts for technologically complex products are no longer physically produced; rather, their characteristics can be tested in a purely virtual fashion at every location across the globe by using simulations. The German startup SimScale makes use of this trend.

Artificial Intelligence 79

Artificial Intelligence Social Media Logistics AWS 79

The Morning Paper

MARCH 1, 2020

Firecracker is the virtual machine monitor (VMM) that powers AWS Lambda and AWS Fargate, and has been used in production at AWS since 2018. The traditional view is that there is a choice between virtualization with strong security and high overhead, and container technologies with weaker security and minimal overhead.

Serverless 101

Serverless Virtualization Lambda AWS 101

Dynatrace

JUNE 29, 2022

They use the same hardware, APIs, tools, and management controls for both the public and private clouds. Amazon Web Services (AWS) Outpost : This offering provides pre-configured hardware and software for customers to run native AWS computing, networking, and services on-premises in a cloud-native manner.

Infrastructure 176

Infrastructure Cloud Azure AWS 176

Dynatrace

NOVEMBER 3, 2022

Instead, enterprises manage individual containers on virtual machines (VMs). Serverless container offerings such as AWS Fargate enable companies to manage and modify containers while abstracting server layers to offer customization without increased complexity. In FaaS environments, providers manage all the hardware.

Serverless 214

Serverless Azure Hardware Transportation 214

Dynatrace

AUGUST 11, 2022

Cloud providers then manage physical hardware, virtual machines, and web server software management. Cloud providers such as Google, Amazon Web Services, and Microsoft also followed suit with frameworks such as Google Cloud Functions , AWS Lambda , and Microsoft Azure Functions. How does function as a service work?

Development 244

Development Serverless Best Practices Lambda 244

All Things Distributed

MARCH 11, 2016

The epoch of AWS is the launch of Amazon S3 on March 14, 2006, now almost 10 years ago. Given that AWS is a pioneer in building and operating these services world-wide, these lessons have been of crucial importance to our business. This is a given, whether you are using the highest quality hardware or lowest cost components.

AWS 144

AWS Hardware Retail Virtualization 144

O'Reilly

NOVEMBER 28, 2023

That pricing won’t be sustainable, particularly as hardware shortages drive up the cost of building infrastructure. How will AI adopters react when the cost of renting infrastructure from AWS, Microsoft, or Google rises? They will simply be part of the environment in which software developers work. from the healthcare industry, and 3.7%

Open Source 108

Open Source Artificial Intelligence Google Infrastructure 108

Percona

APRIL 17, 2023

Operating System (OS) settings Swappiness Swappiness is a Linux kernel setting that influences the behavior of the Virtual Memory manager when it needs to allocate a swap, ranging from 0-100. Without further ado, let’s start with the OS settings. A setting of 100 determines it to swap aggressively to disk.

Best Practices 52

Best Practices Design Tuning Database 52

Brendan Gregg

SEPTEMBER 5, 2017

Linux has been adding tracing technologies over the years: kprobes (kernel dynamic tracing), uprobes (user-level dynamic tracing), tracepoints (static tracing), and perf_events (profiling and hardware counters). At my employer we sometimes use SR-IOV for direct network interface access, and NVMe for direct disk access. x series.

Virtualization 76

Virtualization AWS Engineering Hardware 76

Dynatrace

AUGUST 5, 2019

In this role, I am leading a global team that works closely with our strategic partners such as AWS, Microsoft, Google, Pivotal, Red Hat and others. While most of our cloud & platform partners have their own dependency analysis tooling, most of them focus on basic dependency detection based on network connection analysis between hosts.

Cloud 31

Cloud Traffic Database Network 31

Smashing Magazine

JANUARY 11, 2021

Networking, HTTP/2, HTTP/3 OCSP stapling, EV/DV certificates, packaging, IPv6, QUIC, HTTP/3. If you don’t have a device at hand, emulate mobile experience on desktop by testing on a throttled 3G network (e.g. Moto G4) on a slow 3G network, emulated at 400ms RTT and 400kbps transfer speed. 300ms RTT, 1.6 Mbps down, 0.8

Performance 145

Performance Cache Media Metrics 145