All Things Distributed

MARCH 11, 2015

Cloud computing is enabling amazing new innovations both in consumer and enterprise products, as it became the new normal for organizations of all sizes. So many exciting new areas are being empowered by cloud that it is fascinating to watch. Cloud analytics are everywhere. Cloud enables self-service analytics.

Analytics 135

Analytics Cloud Healthcare Retail 135

Adrian Cockcroft

MARCH 24, 2020

While datacenter based IT costs are largely fixed, in a three year depreciation schedule, cloud costs are inherently variable, and can be sized to fit the need. When times get tough, a focus on cost optimization can also greatly reduce cloud costs, and the results take effect in next month’s bill.

Cloud 52

Cloud Social Media Healthcare Entertainment 52

Adrian Cockcroft

NOVEMBER 30, 2020

I’m helping manage AWS contributions to the project, as we build an open source data lake and analysis service that can be used to model climate related asset risks for investors. AWS is supporting customers who are working to change the way they operate and build more sustainable products. Orange mid-day sky at San Gregorio Beach?—?smoky

AWS 52

AWS IoT Open Source Government 52

Dynatrace

NOVEMBER 20, 2023

At the AWS re:Invent 2023 conference, generative AI is a centerpiece. In this AWS re:Invent 2023 guide, we explore the role of generative AI in the issues organizations face as they move to the cloud: IT automation, cloud migration and digital transformation, application security, and more.

AWS 203

AWS Artificial Intelligence Analytics Cloud 203

Adrian Cockcroft

MARCH 24, 2020

While datacenter based IT costs are largely fixed, in a three year depreciation schedule, cloud costs are inherently variable, and can be sized to fit the need. When times get tough, a focus on cost optimization can also greatly reduce cloud costs, and the results take effect in next month’s bill.

Cloud 40

Cloud Social Media Healthcare Entertainment 40

All Things Distributed

JANUARY 19, 2011

AWS Elastic Beanstalk: A Quick and Simple Way into the Cloud. Additionally customers are not restricted to AWS services; they can mix-and-match services from other providers to best meet their needs. There are some excellent platforms running on AWS that do precisely this; Ruby on Rails developers have Heroku.

AWS 115

AWS Cloud Java Operating System 115

Dynatrace

OCTOBER 28, 2021

But with the complexity that comes with digital transformation and cloud-native architecture, teams need a way to make sure applications can withstand the “chaos” of production. Chaos engineering answers this need so organizations can deliver robust, resilient cloud-native applications that can stand up under any conditions.

Engineering 218

Engineering Entertainment Cloud Infrastructure 218

Brendan Gregg

DECEMBER 31, 2017

My last talk for 2017 was at AWS re:Invent, on "How Netflix Tunes EC2 Instances for Performance," an updated version of my [2014] talk. Fortunately, it was videoed for those who missed it. What I was most excited for was the launch of a new EC2 hypervisor, which I referred to in the video as the "c5 hypervisor".

Tuning 61

Tuning AWS Best Practices Network 61

Brendan Gregg

DECEMBER 30, 2017

My last talk for 2017 was at AWS re:Invent, on "How Netflix Tunes EC2 Instances for Performance," an updated version of my [2014] talk. Fortunately, it was videoed for those who missed it. What I was most excited for was the launch of a new EC2 hypervisor, which I referred to in the video as the "c5 hypervisor".

Tuning 52

Tuning AWS Best Practices Network 52

Dynatrace

JUNE 30, 2020

In my role as DevOps and Autonomous Cloud Activist at Dynatrace, I get to talk to a lot of organizations and teams, and advise them on how to speed up delivery while also increasing the delivery in order to minimize the impact on operations. Thanks to Session Replay you can even see the full user journey in a 4k video like replay.

Lambda 174

Lambda Monitoring Cloud DevOps 174

High Scalability

DECEMBER 14, 2018

Bill English : What we did was lease two video circuits from the phone company. That was our video link. Know anyone looking for a simple book explaining the cloud? book: Explain the Cloud Like I'm 10. mattray : OH: "Cloud native is pretty simple. Cables of course going down into the room at both ends.

Internet 141

Internet Internet Scalability Serverless 141

All Things Distributed

APRIL 23, 2014

We launched Elastic Beanstalk in 2011 with support for Java web applications and Tomcat 6 in one region, and we''ve seen the service grow to 6 container types (Java/Tomcat, PHP, Ruby, Python,NET, and Node.js) supported in 8 AWS regions around the world.

Cloud 123

Cloud Java AWS Database 123

All Things Distributed

MAY 8, 2012

AWS re: Invent. Hundreds of thousands of businesses in over 190 countries are relying on AWS to support some or all of their business and IT needs. AWS re: Invent is our inaugural global customer and partner conference that will be held November 27-29 at The Venetian in Las Vegas. All Things Distributed. Comments ().

AWS 98

AWS Games Internet Internet 98

Brendan Gregg

JULY 4, 2021

It's an exciting time for developments in computer performance, not just for the BPF technology (which I often [write about]) but also for processors with 3D stacking and cloud vendor CPUs (e.g., This was a chance to talk about other things I've been working on, such as the present and future of hardware performance. Ford, et al., “TCP

Performance 140

Performance Latency Hardware Storage 140

Adrian Cockcroft

JANUARY 17, 2022

As well as the video, there’s a long podcast where I discuss them with Mik Kersten. My talks on Failing Over Without Falling Over are still very relevant, but AWS did finally release a key new service that implements key parts of the architecture: AWS Route 53 Application Recovery Controller.

Serverless 98

Serverless Hardware AWS Architecture 98

High Scalability

OCTOBER 19, 2018

It's HighScalability time: Now that's a cloud! Know anyone looking for a simple book explaining the cloud? Then please recommend my well reviewed book: Explain the Cloud Like I'm 10. Then please recommend my well reviewed book: Explain the Cloud Like I'm 10. The largest structure ever found in the early universe.

Internet 123

Internet Internet Scalability Lambda 123

High Scalability

DECEMBER 7, 2018

Know anyone looking for a simple book explaining the cloud? book: Explain the Cloud Like I'm 10. heipei : It's Friday, I've been in a jumpsuit doing manual labor all day (crazy, I know) and weighing my options between passing out on the couch over some Youtube videos, reading the Friday @highscal blog post or writing code.

Internet 163

Internet Internet Scalability Blockchain 163

Brendan Gregg

FEBRUARY 28, 2023

The video is now on [YouTube]: The slides are [online] and as a [PDF]: first prev next last / permalink/zoom In Q&A I was asked about CXL (compute express link) which was fortunate as I had planned to cover it and then forgot, so the question let me talk about it (although Q&A is missing from the video). Ford, et al., “TCP

Performance 110

Performance Latency Cache Virtualization 110

All Things Distributed

AUGUST 20, 2012

Expanding the Cloud â?? One factor in this growth is the presence of image, audio and video archives, which are often archived in their original un-edited form. Amazon Glacier integrates seamlessly with other AWS services such as Amazon S3 and the different AWS Database services. All Things Distributed. Comments ().

Storage 122

Storage Cloud AWS Media 122

High Scalability

SEPTEMBER 21, 2018

And if you know anyone looking for a simple book that uses lots of pictures and lots of examples to explain the cloud, then please recommend my new book: Explain the Cloud Like I'm 10. It would mean a great deal to me. They'll love you even more. They'll love you even more.

Internet 126

Internet Internet Scalability Traffic 126

All Things Distributed

FEBRUARY 11, 2013

Expanding the Cloud: The Amazon Elastic Transcoder. While I was returning from an exciting time in New Orleans watching the Super Bowl, AWS launched a very cool, brand new service: Amazon Elastic Transcoder. Amazon Elastic Transcoder is designed to be very easy to use, scalable and cost-effective video transcoding in the cloud.

AWS 102

AWS Media Scalability Storage 102

Adrian Cockcroft

AUGUST 9, 2022

Amongst other things, HPC is becoming more cloud centric, and blending with both quantum computing, and AI/ML. One is general technology advice on the state of the art in development practices, along the lines of the Cloud for CEOs booklet I published for AWS in 2019. My own consulting work is initially in two areas.

IoT 52

IoT Best Practices AWS Media 52

The Netflix TechBlog

OCTOBER 19, 2020

Investigating a video streaming failure consists of inspecting all aspects of a member account. The use of a cheaper EBS Elastic volume instead of an SSD instance store was an attractive option because AWS allows dynamic increase in EBS volume size without re-provisioning the EC2 node.

Infrastructure 233

Infrastructure Transportation Storage Open Source 233

Adrian Cockcroft

MAY 6, 2023

Then they tried to scale it to cope with high traffic and discovered that some of the state transitions in their step functions were too frequent, and they had some overly chatty calls between AWS lambda functions and S3. This is only one of many microservices that make up the Prime Video application. Finally, what were they building?

Serverless 145

Serverless Lambda Best Practices Traffic 145

Dynatrace

OCTOBER 11, 2021

In recent years, function-as-a-service (FaaS) platforms such as Google Cloud Functions (GCF) have gained popularity as an easy way to run code in a highly available, fault-tolerant serverless environment. What is Google Cloud Functions? Google Cloud Functions is a serverless compute service for creating and launching microservices.

Google 214

Google Cloud Serverless Azure 214

Brendan Gregg

FEBRUARY 28, 2023

The video is now on YouTube : The slides are online and as a PDF : first prev next last / permalink/zoom In Q&A I was asked about CXL (compute express link) which was fortunate as I had planned to cover it and then forgot, so the question let me talk about it (although Q&A is missing from the video). Ford, et al., “TCP

Performance 52

Performance Latency Cache Virtualization 52

The Symphonia

DECEMBER 19, 2017

re:Invent re:View AWS re:Invent was the expected cloud-fest of mind-boggling proportions. We survived intact, and in fact had a wonderful time meeting with a lot of fellow cloud enthusiasts. John’s on AWS Lambda and the JVM (which needed 2 repeats) and Mike’s on Serverless and Organizational Effectiveness.

Serverless 40

Serverless Lambda AWS DevOps 40

Brendan Gregg

JULY 4, 2021

It's an exciting time for developments in computer performance, not just for the BPF technology (which I often [write about]) but also for processors with 3D stacking and cloud vendor CPUs (e.g., Ford, et al., “TCP on Upcoming Sapphire Rapids CPUs,” [link] Oct 2020 - [Liu 20] Linda Liu, “Samsung QVO vs EVO vs PRO: What’s the Difference?

Performance 52

Performance Latency Hardware Storage 52

All Things Distributed

AUGUST 18, 2011

The Amazon Elastic MapReduce (EMR) team announced today the ability to seamlessly use Amazon EC2 Spot Instances with their service, significantly driving down the cost of data analytics in the cloud. Many of our Big-Data customers already saw a big drop in their AWS bill last month when the cost of incoming bandwidth was dropped to $0.00.

Big Data 111

Big Data Analytics AWS Cloud 111

The Netflix TechBlog

SEPTEMBER 24, 2021

After content ingestion, inspection and encoding, the packaging step encapsulates encoded video and audio in codec agnostic container formats and provides features such as audio video synchronization, random access and DRM protection. Packaging has always been an important step in media processing. is 220 Mbps.

Cloud 237

Cloud Media Storage Cache 237

The Netflix TechBlog

OCTOBER 18, 2019

They described the problem of video uploads to Facebook where the goal is to maximize the quality of the video without a decrease in reliability of the upload. Their training infrastructure relies on a hybrid cloud approach. The final section of Sam’s talk focussed on Constrained Bayesian Contextual Bandits.

Infrastructure 126

Infrastructure Metrics Architecture Efficiency 126

The Symphonia

NOVEMBER 15, 2018

More “Service Mesh” style functionality across AWS Serverless services. This was sorta / kinda announced last year, and while both EKS and Fargate have individually advanced, the promised land of Serverlessish Kubernetes on AWS hasn’t yet materialized. API support for disabling / deleting sub accounts within AWS Organizations.

Lambda 40

Lambda Serverless AWS Software Architecture 40

All Things Distributed

AUGUST 13, 2013

This year as I hosted AWS Summits in 12 different cities around the world, I met thousands of developers who are building powerful new applications for smartphones, tablets and other connected devices, all running mobile cloud backends on AWS. per million push notifications ($0.50 per million publishes and $0.50

Mobile 108

Mobile Development AWS Games 108

Testsigma

DECEMBER 12, 2020

It simplifies the job by managing multiple browser environments, allowing you to use the cloud infrastructure for running parallel browser sessions on multiple platforms and devices. All of these are available on the cloud and can be accessible on the go. You can also set the screen resolutions. In-Sprint Compatibility Test Automation.

Testing Tools 52

Testing Tools Testing DevOps Mobile 52

The Netflix TechBlog

OCTOBER 18, 2019

They described the problem of video uploads to Facebook where the goal is to maximize the quality of the video without a decrease in reliability of the upload. Their training infrastructure relies on a hybrid cloud approach. The final section of Sam’s talk focussed on Constrained Bayesian Contextual Bandits.

Infrastructure 100

Infrastructure Metrics Architecture Efficiency 100

O'Reilly

DECEMBER 2, 2019

I don’t need more bandwidth for video conferences or movies, but I would like to be able to download operating system updates and other large items in seconds rather than minutes. What would the world look like if all of our storage was in the cloud, and access to that storage was so fast we didn’t care?

Wireless 53

Wireless Serverless IoT Artificial Intelligence 53

Dynatrace

DECEMBER 22, 2019

AWS offers a broad set of global, cloud-based services including computing, storage, networking, Internet of Things (IoT), and many others. Therefore, the ability to view a real-time map of your applications, services, and cloud resources is key to your success. Monitor and understand additional AWS services. Amazon EMR.

AWS 135

AWS Metrics IoT Storage 135