All Things Distributed

DECEMBER 1, 2016

In my keynote at AWS re:Invent today, I announced 13 new features and services (in addition to the 15 we announced yesterday). At AWS, we want to be the Q for developers, giving them the super-powered tools and services with deep features in the Cloud. We launched the following new services and features today to help.

AWS 162

AWS Development Lambda Open Source 162

Dynatrace

MAY 26, 2021

From May 17 to May 18, 2021, the Open-Source Engineering team at Dynatrace attended the virtual observability conference, o11yfest. The two-day conference offered two tracks: One dedicated to the business value of OpenTelemetry observability, where we got an insight into use cases from Skyscanner, HBE Digital, and Logz.io, to name a few.

AWS 147

AWS Strategy Storage Metrics 147

Brendan Gregg

JULY 4, 2021

It's an exciting time for developments in computer performance, not just for the BPF technology (which I often [write about]) but also for processors with 3D stacking and cloud vendor CPUs (e.g., Ford, et al., “TCP on Upcoming Sapphire Rapids CPUs,” [link] Oct 2020 - [Liu 20] Linda Liu, “Samsung QVO vs EVO vs PRO: What’s the Difference?

Performance 140

Performance Latency Hardware Storage 140

Dynatrace

JULY 13, 2020

Cloud Native DevOps with Kubernetes : . Cloud: A utomation of infrastructure and services on-demand, pay as you use model . DevOps and Continuous delivery: R evolution in the process, the way people and organizations delivering software work . Cloud-native? Enter the orchestration platform.? .

Google 132

Google Ecommerce DevOps Cloud 132

Dynatrace

JULY 13, 2020

Cloud Native DevOps with Kubernetes : . Cloud: A utomation of infrastructure and services on-demand, pay as you use model . DevOps and Continuous delivery: R evolution in the process, the way people and organizations delivering software work . Cloud-native? Enter the orchestration platform.?.

Google 130

Google Ecommerce DevOps Cloud 130

Brendan Gregg

FEBRUARY 28, 2023

This included SysAdmin magazine, which contained articles from various experts including Amy Rich, and a couple of advertisements: One was to submit your own articles to the magazine for publication (by writing to the editor, Rikki Endsley) and another was to attend USENIX conferences in the US and learn directly from the experts!

Performance 110

Performance Latency Cache Virtualization 110

O'Reilly

SEPTEMBER 15, 2021

While it’s sadly premature to say that the survey took place at the end of the COVID-19 pandemic (though we can all hope), it took place at a time when restrictions were loosening: we were starting to go out in public, have parties, and in some cases even attend in-person conferences. Salaries were lower regardless of education or job title.

Azure 145

Azure Social Media Programming AWS 145

Adrian Cockcroft

JANUARY 17, 2022

My talks on Failing Over Without Falling Over are still very relevant, but AWS did finally release a key new service that implements key parts of the architecture: AWS Route 53 Application Recovery Controller. For example AWS launched an instance type with 800 Gbits/s of network bandwith in 2021. primarily virtual?—?and

Serverless 98

Serverless Hardware AWS Architecture 98

Brendan Gregg

SEPTEMBER 25, 2021

As a Xen guest, this profile was gathered using perf(1) and the kernel's software cpu-clock soft interrupts, not the hardware NMI. Software-based clocksources could fix those issues and provide accurate monotonically-increasing time. We ended up setting it in the BaseAMI for all cloud services. But I'm not completely sure.

Speed 126

Speed Java AWS Virtualization 126

Brendan Gregg

FEBRUARY 28, 2023

This included SysAdmin magazine, which contained articles from various experts including Amy Rich, and a couple of advertisements: One was to submit your own articles to the magazine for publication (by writing to the editor, Rikki Endsley) and another was to attend USENIX conferences in the US and learn directly from the experts!

Performance 52

Performance Latency Cache Virtualization 52

All Things Distributed

OCTOBER 2, 2017

The success of our early results with the Dynamo database encouraged us to write Amazon's Dynamo whitepaper and share it at the 2007 ACM Symposium on Operating Systems Principles (SOSP conference), so that others in the industry could benefit. Manageable – The service would need to be easy to manage and operate.

Internet 128

Internet Internet AWS Performance 128

All Things Distributed

MARCH 12, 2018

The availability of large scale voice training data, the advances made in software with processing engines such as Caffe, MXNet and Tensorflow, and the rise of massively parallel compute engines with low-latency memory access, such as the Amazon EC2 P3 instances have made voice processing at scale a reality.

Systems 110

Systems AWS Games Transportation 110

Dynatrace

APRIL 30, 2019

Validating Deployments still seems to be a semi-automated task for most software delivery teams. Because we analyzed the results of our Autonomous Cloud Survey and sat down with a handful of these companies that provided answers to questions such as: What’s your Commit Cycle Time? Bamboo, Azure DevOps, AWS CodePipeline ….

Architecture 125

Architecture Open Source Azure Metrics 125

Brendan Gregg

JULY 4, 2021

It's an exciting time for developments in computer performance, not just for the BPF technology (which I often [write about]) but also for processors with 3D stacking and cloud vendor CPUs (e.g., Ford, et al., “TCP on Upcoming Sapphire Rapids CPUs,” [link] Oct 2020 - [Liu 20] Linda Liu, “Samsung QVO vs EVO vs PRO: What’s the Difference?

Performance 52

Performance Latency Hardware Storage 52

The Symphonia

MARCH 13, 2018

The biggest change that your editor (Mike) sees from a year ago is the mind-boggling number of Serverless conferences, and Serverless tracks at other conferences, that now exist. Already this year we’ve had the latest Serverless Conf from A Cloud Guru, which happened in the same week and on the same continent as the final Jeff Conf.

Serverless 40

Serverless Lambda AWS DevOps 40

The Symphonia

NOVEMBER 15, 2018

More “Service Mesh” style functionality across AWS Serverless services. This was sorta / kinda announced last year, and while both EKS and Fargate have individually advanced, the promised land of Serverlessish Kubernetes on AWS hasn’t yet materialized. API support for disabling / deleting sub accounts within AWS Organizations.

Lambda 40

Lambda Serverless AWS Software Architecture 40

Brendan Gregg

SEPTEMBER 25, 2021

As a Xen guest, this profile was gathered using perf(1) and the kernel's software cpu-clock soft interrupts, not the hardware NMI. Software-based clocksources could fix those issues and provide accurate monotonically-increasing time. We ended up setting it in the BaseAMI for all cloud services.

Speed 52

Speed Java AWS Virtualization 52

O'Reilly

DECEMBER 2, 2019

I don’t need more bandwidth for video conferences or movies, but I would like to be able to download operating system updates and other large items in seconds rather than minutes. What would the world look like if all of our storage was in the cloud, and access to that storage was so fast we didn’t care? Upcoming events.

Wireless 53

Wireless Serverless IoT Artificial Intelligence 53

Brendan Gregg

SEPTEMBER 25, 2021

As a Xen guest, this profile was gathered using perf(1) and the kernel's software cpu-clock soft interrupts, not the hardware NMI. Software-based clocksources could fix those issues and provide accurate monotonically-increasing time. We ended up setting it in the BaseAMI for all cloud services. But I'm not completely sure.

Speed 40

Speed Java AWS Virtualization 40

VoltDB

JUNE 1, 2017

Earlier this month I spent a week at the OpenStack conference. But once you realize that there are, in fact, several OpenStack conferences happening at the same time and place, it makes more sense. Private Clouds made of commodity hardware are perceived as the logical solution to this problem. The “Public Private Cloud” folks.

Hardware 56

Hardware Latency Virtualization Cloud 56

VoltDB

JUNE 1, 2017

Earlier this month I spent a week at the OpenStack conference. But once you realize that there are, in fact, several OpenStack conferences happening at the same time and place, it makes more sense. Private Clouds made of commodity hardware are perceived as the logical solution to this problem. The “Public Private Cloud” folks.

Hardware 40

Hardware Latency Virtualization Cloud 40

The Symphonia

MAY 22, 2018

and products like AWS Fargate have made this distinction murkier still. Finally in this first overall section it was good to be able to talk about AWS SAM and SAR?—?“Serverless On the other hand I’m more convinced that for automated testing we should just be using real cloud environments. Because of course it did.

Serverless 40

Serverless Architecture Lambda Azure 40

Brendan Gregg

SEPTEMBER 5, 2017

They use third-party software like Docker or Kubernetes to simplify their administration. There are workarounds: I can use the perf_events cgroup ID, provided the container software is configuring it (they do). There have been security vulnerabilities, just like there are with any software. People rarely create them manually.

Virtualization 76

Virtualization AWS Engineering Hardware 76

Adrian Cockcroft

NOVEMBER 11, 2019

In the same way that we have moved from a few big software releases a year to continuous delivery of many small changes, we need to move from annual disaster recover tests or suffering when things actually break, to continuously tested resilience. This discussion focuses on hardware, software and operational failure modes.

Latency 52

Latency Engineering Systems Hardware 52

Adrian Cockcroft

NOVEMBER 11, 2019

In the same way that we have moved from a few big software releases a year to continuous delivery of many small changes, we need to move from annual disaster recover tests or suffering when things actually break, to continuously tested resilience. This discussion focuses on hardware, software and operational failure modes.

Latency 53

Latency Engineering Systems Hardware 53

O'Reilly

FEBRUARY 18, 2020

Software architecture, infrastructure, and operations are each changing rapidly. The shift to cloud native design is transforming both software architecture and infrastructure and operations. Still cloud-y, but with a possibility of migration. Trends in software architecture, infrastructure, and operations.

Software Architecture 134

Software Architecture DevOps Data Engineering Architecture 134

The Netflix TechBlog

NOVEMBER 3, 2022

by Tomasz Bak and Fabio Kung Introduction Titus is the Netflix cloud container runtime that runs and manages containers at scale. In USENIX annual technical conference (Vol. As the number of Titus users increased over the years, the load and pressure on the system increased substantially. V., & Gharachorloo, K. 1996, January).

Cache 224

Cache Latency Traffic Systems 224

Strategic Tech

JUNE 23, 2018

Loosely-coupled teams enabled by loosely-coupled software architecture is one of the strongest predictors of continuous delivery performance and organizational scaling. It’s asking an awful lot. One of the topics I touched on was the importance of finding boundaries that confer greater autonomy to teams.

Systems 40

Systems Social Media Design Media 40