Brendan Gregg

DECEMBER 31, 2017

My last talk for 2017 was at AWS re:Invent, on "How Netflix Tunes EC2 Instances for Performance," an updated version of my [2014] talk. Networking. Networking. Not a lot has changed with these tunables since my [2014] talk. File System. Storage I/O. tcp_wmem = 4096 12582912 16777216 net.ipv4.tcp_rmem Hypervisor (Xen).

Tuning 61

Tuning AWS Best Practices Network 61

Brendan Gregg

FEBRUARY 28, 2023

TCP Extensions for Multipath Operation with Multiple Addresses,” [link] , Mar 2020 [Gregg 20] Brendan Gregg, “Systems Performance: Enterprise and the Cloud, Second Edition,” Addison-Wesley, 2020 [Hruska 20] Joel Hruska, “Intel Demos PCIe 5.0 Ford, et al., “TCP

Performance 52

Performance Latency Cache Virtualization 52

Brendan Gregg

DECEMBER 30, 2017

My last talk for 2017 was at AWS re:Invent, on "How Netflix Tunes EC2 Instances for Performance," an updated version of my [2014] talk. Networking. Networking. Not a lot has changed with these tunables since my [2014] talk. File System. Storage I/O. tcp_wmem = 4096 12582912 16777216 net.ipv4.tcp_rmem Hypervisor (Xen).

Tuning 52

Tuning AWS Best Practices Network 52

Brendan Gregg

JULY 4, 2021

It's an exciting time for developments in computer performance, not just for the BPF technology (which I often [write about]) but also for processors with 3D stacking and cloud vendor CPUs (e.g., Ford, et al., “TCP on Upcoming Sapphire Rapids CPUs,” [link] Oct 2020 - [Liu 20] Linda Liu, “Samsung QVO vs EVO vs PRO: What’s the Difference?

Performance 52

Performance Latency Hardware Storage 52

ACM Sigarch

APRIL 26, 2018

They use the graph as the basic representation for many AI-related algorithms, including neural network, Bayesian network, Markov Field, and some other emerging methods. NPU: Neural Network Processing Unit (NPU) has become a general name of AI chip rather than a brand name of a company.

Hardware 99

Hardware Artificial Intelligence Architecture Google 99

All Things Distributed

SEPTEMBER 26, 2014

Topics include Introduction to AWS, Big Data, Compute & Networking, Architecture, Mobile & Gaming, Databases, Operations, Security, and more. When: October 1, 2014 at 6:30 -8:00 PM. Tom will also share the role that Cloud Computing has played in the exploration of space in the last decade and where we are heading next.

AWS 111

AWS Games Education Innovation 111

O'Reilly

APRIL 23, 2024

Perhaps a more direct way to say this in the context of economic value creation is that companies such as Amazon and Google and Facebook had developed a set of remarkable advances in networked and data-enabled market coordination. But over time, something went very wrong. The market was maturing. By the end of 2012, it was up to 82%.

Social Media 107

Social Media Google Internet Internet 107

Alex Russell

JUNE 22, 2022

World-class experts in graphics, networking, cryptography, databases, language design, VM implementation, security, usability (particularly usable security), power management, compilers, fonts, high-performance layout, codecs, real-time media, audio and video pipelines, and per- OS specialisation are required.

Engineering 110

Engineering Traffic Government Google 110

Smashing Magazine

DECEMBER 2, 2021

Lean UXMas has been publishing each advent since 2014 and is a collection of the most popular articles from this year’s Agile and Lean UX latest news. Don't store sensitive data in the cloud; keep it entirely disconnected from the web.” All videos have even been manually re-captioned, just so they’re all at their best. Lean UXMas.

Design 109

Design Development Programming Website 109

All Things Distributed

OCTOBER 25, 2018

Expanding the AWS Cloud—An AWS Region is coming to South Africa! That's where we built many pioneering networking technologies, our next-generation software for customer support, and the technology behind our compute service, Amazon EC2. In 2017, we brought the Amazon Global Network to Africa, through AWS Direct Connect.

AWS 167

AWS Cloud Education Programming 167

Dynatrace

AUGUST 11, 2022

Before an organization moves to function as a service, it’s important to understand how it works, its benefits and challenges, its effect on scalability, and why cloud-native observability is essential for attaining peak performance. Cloud providers then manage physical hardware, virtual machines, and web server software management.

Development 250

Development Serverless Best Practices Lambda 250

Dynatrace

MAY 31, 2021

According to the 2020 Cloud Native Computing Foundation (CNCF) survey , 92 percent of organizations are using containers in production, and 83 percent of these use Kubernetes as their preferred container management solution. This simplifies orchestration in cloud-native environments. Dynatrace news.

Virtualization 133

Virtualization DevOps Infrastructure Cloud 133

All Things Distributed

DECEMBER 12, 2018

We launched Edge Network locations in Denmark, Finland, Norway, and Sweden. In addition, we are working with the venture capital community, startup accelerators, and incubators to help startups grow in the cloud. They rely on the AWS Cloud for their entire infrastructure and use almost every AWS service available. " Hemnet.

AWS 124

AWS Cloud Games Serverless 124

Dynatrace

JULY 13, 2020

Cloud Native DevOps with Kubernetes : . Cloud: A utomation of infrastructure and services on-demand, pay as you use model . Cloud-native? refers to cloud-based, containerized, distributed systems, made up of cooperating microservices, dynamically managed by automated infrastructure as code. . ?

Google 132

Google Ecommerce DevOps Cloud 132

Dynatrace

JULY 13, 2020

Cloud Native DevOps with Kubernetes : . Cloud: A utomation of infrastructure and services on-demand, pay as you use model . Cloud-native? refers to cloud-based, containerized, distributed systems, made up of cooperating microservices, dynamically managed by automated infrastructure as code. . ?

Google 130

Google Ecommerce DevOps Cloud 130

Brendan Gregg

NOVEMBER 29, 2017

Hardware virtualization for cloud computing has come a long way, improving performance using technologies such as VT-x, SR-IOV, VT-d, NVMe, and APICv. At Netflix, we've been using these technologies as they've been made available for instance types in the AWS EC2 cloud. AWS called this [enhanced networking]. The first was c3.

Virtualization 111

Virtualization AWS Hardware Storage 111

The Netflix TechBlog

JANUARY 10, 2024

From Reloaded to Cosmos Reloaded Starting in 2014, we developed and operated the video processing pipeline on our third-generation platform Reloaded. For the streaming use case, the generated videos are deployed to our content delivery network (CDN) for Netflix members to consume. These videos can easily be watched millions of times.

Processing 229

Processing Media Latency Innovation 229

The Netflix TechBlog

FEBRUARY 20, 2019

by Jason Koch , with Martin Spier , Brendan Gregg , Ed Hunter Improving the tools available to our engineers to help them diagnose, triage, and work through software performance challenges in the cloud is a key goal for the cloud performance engineering team at Netflix. This allows us to create more complex single-pane dashboards.

Performance 211

Performance Latency Open Source Metrics 211

Brendan Gregg

NOVEMBER 28, 2017

Hardware virtualization for cloud computing has come a long way, improving performance using technologies such as VT-x, SR-IOV, VT-d, NVMe, and APICv. At Netflix, we've been using these technologies as they've been made available for instance types in the AWS EC2 cloud. AWS called this [enhanced networking]. The first was c3.

Virtualization 40

Virtualization AWS Hardware Storage 40

All Things Distributed

APRIL 4, 2017

As well as AWS Regions, we also have 24 AWS Edge Network Locations in Europe. In 2014 and 2015 respectively, AWS opened offices in Stockholm and Espoo, Finland. AWS Partner Network (APN) Consulting Partners in the Nordics help customers migrate to the cloud.

AWS 116

AWS Airlines Latency Games 116

Testsigma

JANUARY 7, 2022

2014 saw the trend of mobile app testing as they were becoming a multi-billion dollar business all over the world. Testsigma, a completely cloud-based test automation tool uses AI technology in software testing to save time, costs and smoothen out the learning curve of the testers.

Artificial Intelligence 89

Artificial Intelligence IoT Software Software 89

Abhishek Tiwari

NOVEMBER 3, 2018

Although some vendors have added support for APIs and cloud services most have not even bothered to adapt with changing technology landscape. Case-in-point, most enterprise CMS vendors lack robust full-site content delivery network (CDN) integration. Circa 2014, I was working with a big Japanese automotive brand in Australia.

Systems 63

Systems Cache Website Network 63

Alex Russell

MARCH 6, 2021

Thanks to progress in networks and browsers (but not devices), a more generous global budget cap has emerged for sites constructed the "modern" way: ~100KiB of HTML/CSS/fonts and ~300-350KiB of JS (compressed) is the new rule-of-thumb limit for at least the next year or two. Modern network performance and availability.

Performance 124

Performance Network Cache Metrics 124

Brendan Gregg

SEPTEMBER 5, 2017

Xen's biggest user is the Amazon EC2 cloud, which has over one million customers, and appears to be a custom version (it self identifies as version "3.4.3.amazon"). At my employer we sometimes use SR-IOV for direct network interface access, and NVMe for direct disk access. Oracle VM Server is based on Xen.

Virtualization 76

Virtualization AWS Engineering Hardware 76

KeyCDN

OCTOBER 10, 2018

Although a beta version was released in 2014, the first stable release of Kubernetes was just made available in September 2018. The result was Kubernetes, which allows developers to create and manage “clusters” of physical and virtual machines in order to coordinate cooperation via a shared network.

Virtualization 47

Virtualization Open Source Network Architecture 47

High Scalability

NOVEMBER 16, 2018

Know anyone looking for a simple book explaining the cloud? book: Explain the Cloud Like I'm 10. While the market prices of the coins are quite volatile, the network hashrates for three of the four cryptocurrencies have trended consistently upward, suggesting that energy requirements will continue to increase.

Internet 28

Internet Internet Scalability Energy 28

Brendan Gregg

AUGUST 8, 2017

Load averages are an industry-critical metric – my company spends millions auto-scaling cloud instances based on them and other metrics – but on Linux there's some mystery around them. They can be also useful when a single value of demand is desired, such as for a cloud auto scaling rule. Network I/O?

Latency 111

Latency Metrics C++ Systems 111