Brendan Gregg

DECEMBER 30, 2017

My last talk for 2017 was at AWS re:Invent, on "How Netflix Tunes EC2 Instances for Performance," an updated version of my [2014] talk. Virtual Memory. Networking. John Bennett (networking) co-presented How Netflix Monitors Applications in Near Real-Time with Amazon Kinesis. schedtool –B PID. vm.swappiness = 0 # from 60.

Tuning 52

Tuning AWS Best Practices Network 52

Brendan Gregg

FEBRUARY 28, 2023

Titus, the Netflix container management platform, is now open source,” [link] Apr 2018 - [Cutress 19] Dr. [link] 2021 - [Trader 21] Tiffany Trader, “Cerebras Second-Gen 7nm Wafer Scale Engine Doubles AI Performance Over First-Gen Chip ,” [link] Apr 2021 - [Ghigoff 21] Yoann Ghigoff, et al., "BMC:

Performance 110

Performance Latency Cache Virtualization 110

The Morning Paper

MARCH 8, 2020

Analysed from the perspective of cloud-native design this presents a number of issues: CPU, memory, storage, and bandwidth resources are all aggregated at each node, and can’t be scaled independently, making it hard to fit a workload efficiently across multiple dimensions. S3 on AWS). joins) during query processing. Elasticity.

Storage 112

Storage Engineering Cache Serverless 112

All Things Distributed

DECEMBER 18, 2012

After the AWS re: Invent conference I spent two weeks in Europe for the last customer visits of the year. Although there are still a few very exciting AWS news updates to happen this year. May 28 - Virtual Time and Global States of Distributed Systems , Friedemann Mattern, Parallel and Distributed Algorithms, North-Holland (1989) , p.

Operating System 144

Operating System Cache AWS Scalability 144

Brendan Gregg

NOVEMBER 29, 2017

Hardware virtualization for cloud computing has come a long way, improving performance using technologies such as VT-x, SR-IOV, VT-d, NVMe, and APICv. At Netflix, we've been using these technologies as they've been made available for instance types in the AWS EC2 cloud. Each dimension has progressed through these stages: 1.

Virtualization 111

Virtualization AWS Hardware Storage 111

Adrian Cockcroft

APRIL 18, 2018

For each resource there’s usually an underlying or bare metal version, a virtualized resource and sometimes also a containerized resource. This is true for CPU, network, memory and storage, and also for bare metal, virtual machines, containers, processes, functions and threads.

Monitoring 40

Monitoring Systems Virtualization Metrics 40

Brendan Gregg

FEBRUARY 28, 2023

Titus, the Netflix container management platform, is now open source,” [link] , Apr 2018 [Cutress 19] Dr. [link] , 2021 [Trader 21] Tiffany Trader, “Cerebras Second-Gen 7nm Wafer Scale Engine Doubles AI Performance Over First-Gen Chip ,” [link] , Apr 2021 [Ghigoff 21] Yoann Ghigoff, et al.,

Performance 52

Performance Latency Cache Virtualization 52

All Things Distributed

DECEMBER 20, 2017

Take the example of industrial manufacturing: in prototyping, drafts for technologically complex products are no longer physically produced; rather, their characteristics can be tested in a purely virtual fashion at every location across the globe by using simulations. The German startup SimScale makes use of this trend.

Artificial Intelligence 79

Artificial Intelligence Social Media Logistics AWS 79

Scalegrid

MARCH 14, 2024

In practice, a hybrid cloud operates by melding resources and services from multiple computing environments, which necessitates effective coordination, orchestration, and integration to work efficiently. Tailoring resource allocation efficiently ensures faster application performance in alignment with organizational demands.

Strategy 130

Strategy Cloud Artificial Intelligence Infrastructure 130

VoltDB

JUNE 1, 2017

It was – like the hypothetical movie I describe above – more than a little bit odd, as you could leave a session discussing ever more abstract layers of virtualization and walk into one where they emphasized the critical importance of pinning a network interface to a specific VM for optimal performance. How do we fit into all this?

Hardware 56

Hardware Latency Virtualization Cloud 56

Brendan Gregg

NOVEMBER 28, 2017

Hardware virtualization for cloud computing has come a long way, improving performance using technologies such as VT-x, SR-IOV, VT-d, NVMe, and APICv. At Netflix, we've been using these technologies as they've been made available for instance types in the AWS EC2 cloud. Each dimension has progressed through these stages: 1.

Virtualization 40

Virtualization AWS Hardware Storage 40

Scalegrid

JANUARY 12, 2024

This article analyzes cloud workloads, delving into their forms, functions, and how they influence the cost and efficiency of your cloud infrastructure. Simply put, it’s the set of computational tasks that cloud systems perform, such as hosting databases, enabling collaboration tools, or running compute-intensive algorithms.

Cloud 130

Cloud Virtualization Storage Efficiency 130

Dynatrace

SEPTEMBER 7, 2022

VPC Flow Logs is an Amazon service that enables IT pros to capture information about the IP traffic that traverses network interfaces in a virtual private cloud, or VPC. By default, each record captures a network internet protocol (IP), a destination, and the source of the traffic flow that occurs within your environment.

Traffic 212

Traffic AWS Network Cloud 212

VoltDB

JUNE 1, 2017

It was – like the hypothetical movie I describe above – more than a little bit odd, as you could leave a session discussing ever more abstract layers of virtualization and walk into one where they emphasized the critical importance of pinning a network interface to a specific VM for optimal performance. How do we fit into all this?

Hardware 40

Hardware Latency Virtualization Cloud 40

The Morning Paper

MARCH 1, 2020

Firecracker is the virtual machine monitor (VMM) that powers AWS Lambda and AWS Fargate, and has been used in production at AWS since 2018. The traditional view is that there is a choice between virtualization with strong security and high overhead, and container technologies with weaker security and minimal overhead.

Serverless 101

Serverless Virtualization Lambda AWS 101

The Netflix TechBlog

SEPTEMBER 24, 2021

Figure 1: A Simplified Video Processing Pipeline With this architecture, chunk encoding is very efficient and processed in distributed cloud computing instances. It is worth pointing out that cloud processing is always subject to variable network conditions.

Cloud 237

Cloud Media Storage Cache 237

Dynatrace

NOVEMBER 3, 2022

The containerization craze has continued for enterprises, with benefits such as portability, efficiency, and scalability. Instead, enterprises manage individual containers on virtual machines (VMs). IaaS provides direct access to compute resources such as servers, storage, and networks. million in 2020. Managed orchestration.

Serverless 216

Serverless Azure Hardware Transportation 216

Adrian Cockcroft

NOVEMBER 18, 2019

AWS Developer Relations on how the shift from Robot Operating System (ROS) 1 to ROS 2 will change the landscape for all robot lovers. OPN205-R Contributing to the AWS Construct Library (repeats) Using and loving the AWS Cloud Development Kit and want to help make it better? Alejandra Olvera-Novack?—?AWS

Open Source 40

Open Source AWS Lambda Serverless 40

Adrian Cockcroft

NOVEMBER 18, 2019

AWS Developer Relations on how the shift from Robot Operating System (ROS) 1 to ROS 2 will change the landscape for all robot lovers. OPN205-R Contributing to the AWS Construct Library (repeats) Using and loving the AWS Cloud Development Kit and want to help make it better? Alejandra Olvera-Novack?—?AWS

Open Source 40

Open Source AWS Lambda Serverless 40

Dynatrace

JULY 13, 2020

Two years later, I came across that same customer at the AWS re:Invent conference , who then told me they were in the midst of a big project, moving their eCommerce to AWS , targeting running a big chunk of it in Kubernetes next year. . Who manage s the networking aspects? But how will you set up the communication?

Google 132

Google Ecommerce DevOps Cloud 132

Dynatrace

JULY 13, 2020

Two years later, I came across that same customer at the AWS re:Invent conference , who then told me they were in the midst of a big project, moving their eCommerce to AWS , targeting running a big chunk of it in Kubernetes next year. . Who manage s the networking aspects? But how will you set up the communication?

Google 130

Google Ecommerce DevOps Cloud 130

All Things Distributed

MARCH 11, 2016

The epoch of AWS is the launch of Amazon S3 on March 14, 2006, now almost 10 years ago. Given that AWS is a pioneer in building and operating these services world-wide, these lessons have been of crucial importance to our business. AWS helps its customers do this too. Build security in from the ground up.

AWS 144

AWS Hardware Retail Virtualization 144

IO River

NOVEMBER 2, 2023

It’s not just limited to cloud resources like AWS and Azure; Terraform is versatile, extending its capabilities to key performance areas like Content Delivery Network (CDN) management, ensuring efficient content delivery and optimal user experience.‍Started Hold that thought. Migrating isn't as simple as 'copy-paste'.‍Even

Open Source 52

Open Source DevOps AWS Azure 52

Dynatrace

OCTOBER 17, 2019

We’re currently in a technological era where we have a large variety of computing endpoints at our disposal like containers, Platform as a Service (PaaS), serverless, virtual machines, APIs, etc. Once the respective teams are on board and ready to follow these principles, the operations processes can be taken to the next level of efficiency.

Code 108

Code Infrastructure DevOps Serverless 108

IO River

NOVEMBER 2, 2023

In fact, Amazon Web Services (AWS) paved the way with its service, CloudFormation, which introduced the concept of Infrastructure as Code (IaC). Taking inspiration from AWS's CloudFormation, HashiCorp introduced Terraform with a broader vision. As businesses grow and demand fluctuates, infrastructure needs to adapt. Hold that thought.

Open Source 40

Open Source DevOps AWS Azure 40

O'Reilly

MAY 19, 2020

AWS is far and away the cloud leader, followed by Azure (at more than half of share) and Google Cloud. But most Azure and GCP users also use AWS; the reverse isn’t necessarily true. network engineer, at >2%) and management positions (IT manager, at close to 3%; operations manager at >1%). Amazon and AWS Ascendant.

Cloud 141

Cloud Serverless AWS Architecture 141

All Things Distributed

AUGUST 20, 2015

Relationships are a fundamental aspect of both the physical and virtual worlds. Modern applications need to quickly navigate connections in the physical world of people, cities, and public transit stations as well as the virtual world of search terms, social posts, and genetic code, for example. Graph databases at Amazon.

Database 134

Database Logistics Availability Social Media 134

Dynatrace

JUNE 1, 2021

However, with today’s highly connected digital world, monitoring use cases expand to the services, processes, hosts, logs, networks, and of course, end-users that access these applications — including a company’s customers and employees. Mobile apps, websites, and business applications are typical use cases for monitoring.

Monitoring 148

Monitoring Mobile Social Media Artificial Intelligence 148

Adrian Cockcroft

APRIL 5, 2023

Energy data at the entire machine or raw cloud instance level needs to be apportioned to virtual machines or cloud instances which run an operating system, and to pods, containers and processes running applications and background activities that consume CPU, memory and I/O resources.

Energy 52

Energy Metrics Cloud Operating System 52

Percona

APRIL 17, 2023

Operating System (OS) settings Swappiness Swappiness is a Linux kernel setting that influences the behavior of the Virtual Memory manager when it needs to allocate a swap, ranging from 0-100. Without further ado, let’s start with the OS settings. A setting of 100 determines it to swap aggressively to disk.

Best Practices 52

Best Practices Design Tuning Database 52

All Things Distributed

SEPTEMBER 3, 2013

AWS offers its customers a choice of different database services, each optimized for different workloads. The db.cr1.8xlarge has 88 ECUs, 244GB of memory, high-bandwidth network, and the ability to deliver up to 20,000 IOPS for MySQL 5.6, As the amount of data stored increases constantly, the amount of memory needed also goes up.

Cache 129

Cache Cloud Performance Retail 129

Brendan Gregg

SEPTEMBER 5, 2017

I wrote a page on it: [perf]. - **eBPF**: tracing features completed in 2016, this provides efficient programmatic tracing to existing kernel frameworks. At my employer we sometimes use SR-IOV for direct network interface access, and NVMe for direct disk access. It's the official profiler. x series.

Virtualization 76

Virtualization AWS Engineering Hardware 76

Dynatrace

AUGUST 5, 2019

In this role, I am leading a global team that works closely with our strategic partners such as AWS, Microsoft, Google, Pivotal, Red Hat and others. While most of our cloud & platform partners have their own dependency analysis tooling, most of them focus on basic dependency detection based on network connection analysis between hosts.

Cloud 31

Cloud Traffic Database Network 31

O'Reilly

NOVEMBER 28, 2023

How will AI adopters react when the cost of renting infrastructure from AWS, Microsoft, or Google rises? The same thing happened to networking 20 or 25 years ago: wiring an office or a house for ethernet used to be a big deal. But they may back off on AI development. Now we expect wireless everywhere, and even that’s not correct.

Open Source 108

Open Source Artificial Intelligence Google Infrastructure 108

All Things Distributed

MAY 21, 2018

In the first step we might reach this goal by combining the fastest mobility services through a digital platform; in the next, it might be a task fulfilled by Virtual Reality. These new offerings are organized on platforms or networks, and less so in processes. A voice command creates a lot more productivity.

Artificial Intelligence 76

Artificial Intelligence Technology Technology IoT 76

Smashing Magazine

JANUARY 11, 2021

Networking, HTTP/2, HTTP/3 OCSP stapling, EV/DV certificates, packaging, IPv6, QUIC, HTTP/3. If you don’t have a device at hand, emulate mobile experience on desktop by testing on a throttled 3G network (e.g. Moto G4) on a slow 3G network, emulated at 400ms RTT and 400kbps transfer speed. 300ms RTT, 1.6 Mbps down, 0.8

Performance 145

Performance Cache Media Metrics 145