Brendan Gregg

NOVEMBER 29, 2017

Hardware virtualization for cloud computing has come a long way, improving performance using technologies such as VT-x, SR-IOV, VT-d, NVMe, and APICv. At Netflix, we've been using these technologies as they've been made available for instance types in the AWS EC2 cloud. Each dimension has progressed through these stages: 1.

Virtualization 111

Virtualization AWS Hardware Storage 111

All Things Distributed

APRIL 4, 2017

Today, I am very excited to announce our plans to open a new AWS Region in the Nordics! The new region will give Nordic-based businesses, government organisations, non-profits, and global companies with customers in the Nordics, the ability to leverage the AWS technology infrastructure from data centers in Sweden.

AWS 116

AWS Airlines Latency Games 116

High Scalability

OCTOBER 24, 2022

What I'm concerned about, as a developer, is the collateral damage such ham-fisted regulation might cause. Limit the cloud services a cloud provider can offer and you limit the quality of the software we can build. Each cloud-native evolution is about using the hardware more efficiently. Building software is not moving freight.

Cloud 187

Cloud Hardware Infrastructure Innovation 187

Dynatrace

JUNE 15, 2023

The cloud allows a modular approach to building applications, enabling development and operations teams to create and deploy feature-rich apps very quickly. It also entails secure development practices, security monitoring and logging, compliance and governance, and incident response.

Cloud 185

Cloud Open Source Architecture Monitoring 185

Percona

JULY 1, 2023

Now that Database-as-a-service (DBaaS) is in high demand, there are multiple questions regarding AWS services that cannot always be answered easily: When should I use Aurora and when should I use RDS MySQL ? Amazon Aurora is a proprietary, cloud-native, fully managed relational database service developed by Amazon Web Services (AWS).

AWS 52

AWS Database Serverless Storage 52

Dynatrace

JANUARY 16, 2023

The study analyzes factual Kubernetes production data from thousands of organizations worldwide that are using the Dynatrace Software Intelligence Platform to keep their Kubernetes clusters secure, healthy, and high performing. Open-source software drives a vibrant Kubernetes ecosystem. Java, Go, and Node.js

Open Source 349

Open Source Java Operating System Programming 349

Brendan Gregg

MAY 1, 2022

My dream is to turn computer performance analysis into a science, one where we can completely understand the performance of everything: of applications, libraries, kernels, hypervisors, firmware, and hardware. eBPF is in development for Windows as well (not just Linux where it originated).

Wireless 145

Wireless Hardware Open Source AWS 145

Adrian Cockcroft

JANUARY 17, 2022

There were five trends and topics for 2021, Serverless First, Chaos Engineering, Wardley Mapping, Huge Hardware, Sustainability. The need for systems to be resilient is still increasing, and chaos engineering tools and techniques are developing as a key way to validate that resilience is working as designed.

Serverless 98

Serverless Hardware AWS Architecture 98

Dynatrace

NOVEMBER 15, 2021

Driving this growth is the increasing adoption of hyperscale cloud providers (AWS, Azure, and GCP) and containerized microservices running on Kubernetes. Logs can include data about user inputs, system processes, and hardware states. In fact, the global log management market is expected to grow from 1.9 billion in 2020 to $4.1

Analytics 218

Analytics Monitoring Artificial Intelligence DevOps 218

All Things Distributed

NOVEMBER 30, 2016

Today, there are thousands of machine learning scientists and developers applying machine learning in various places, from recommendations to fraud detection, from inventory levels to book classification to abusive review detection. in ML and neural networks) and access to vast amounts of data.

AWS 165

AWS Lambda Artificial Intelligence Mobile 165

Dynatrace

OCTOBER 28, 2021

Chaos engineering is a method of testing distributed software that deliberately introduces failure and faulty scenarios to verify its resilience in the face of random disruptions. Practitioners subject software to a controlled, simulated crisis to test for unstable behavior. Chaos engineers ask why. The history of chaos engineering.

Engineering 234

Engineering Entertainment Cloud Infrastructure 234

Dynatrace

AUGUST 12, 2020

As companies strive to innovate and deliver faster, modern software architecture is evolving at near the speed of light. With Azure Functions, engineers don’t have to worry about provisioning and maintaining underlying hardware; they simply upload their code, and it’s up and running seconds later. Dynatrace news.

Serverless 241

Serverless Azure Monitoring Lambda 241

Brendan Gregg

NOVEMBER 28, 2017

Hardware virtualization for cloud computing has come a long way, improving performance using technologies such as VT-x, SR-IOV, VT-d, NVMe, and APICv. At Netflix, we've been using these technologies as they've been made available for instance types in the AWS EC2 cloud. Each dimension has progressed through these stages: 1.

Virtualization 40

Virtualization AWS Hardware Storage 40

All Things Distributed

MARCH 11, 2016

The epoch of AWS is the launch of Amazon S3 on March 14, 2006, now almost 10 years ago. Given that AWS is a pioneer in building and operating these services world-wide, these lessons have been of crucial importance to our business. This is a given, whether you are using the highest quality hardware or lowest cost components.

AWS 144

AWS Hardware Retail Virtualization 144

Dynatrace

NOVEMBER 22, 2022

Cloud service providers, such as Amazon Web Services (AWS) , can offer infrastructure with five-nines availability by deploying in multiple availability zones and replicating data between regions. Traditionally, teams achieve this high level of uptime using a combination of high-capacity hardware, system redundancy, and failover models.

Infrastructure 191

Infrastructure Availability Systems Retail 191

All Things Distributed

MAY 8, 2012

Expanding the Cloud for Windows Developers. The software that powers todayâ??s Using the AWS Toolkit for Visual Studio , you can now deploy your.NET applications to AWS Elastic Beanstalk directly from your Visual Studio environment without changing any code. By Werner Vogels on 08 May 2012 02:00 PM. Comments ().

Cloud 115

Cloud Development AWS Servers 115

All Things Distributed

JANUARY 23, 2012

Expanding the Cloud - The AWS Storage Gateway. Today Amazon Web Services has launched the AWS Storage Gateway, making the power of secure and reliable cloud storage accessible from customersâ?? The Amazon Virtual Private Cloud extends on-premises compute with all the power of AWS, making it elastic, scalable and highly reliable.

Storage 115

Storage AWS Virtualization Cloud 115

Dynatrace

OCTOBER 1, 2021

In these modern environments, every hardware, software, and cloud infrastructure component and every container, open-source tool, and microservice generates records of every activity. The architects and developers who create the software must design it to be observed.

Metrics 363

Metrics Open Source Monitoring Infrastructure 363

Brendan Gregg

JULY 4, 2021

It's an exciting time for developments in computer performance, not just for the BPF technology (which I often [write about]) but also for processors with 3D stacking and cloud vendor CPUs (e.g., This was a chance to talk about other things I've been working on, such as the present and future of hardware performance.

Performance 140

Performance Latency Hardware Storage 140

The Morning Paper

MARCH 1, 2020

Firecracker is the virtual machine monitor (VMM) that powers AWS Lambda and AWS Fargate, and has been used in production at AWS since 2018. The first version of AWS Lambda was built using Linux containers. All of the existing approaches we just examined involve trade-offs that AWS didn’t want to make.

Serverless 101

Serverless Virtualization Lambda AWS 101

All Things Distributed

MARCH 19, 2018

At AWS, we continue to strive to enable builders to build cutting-edge technologies faster in a secure, reliable, and scalable fashion. Machine learning is one such transformational technology that is top of mind not only for CIOs and CEOs, but also developers and data scientists. Acceleration and distribution.

Scalability 159

Scalability Hardware AWS Tuning 159

Dynatrace

AUGUST 12, 2020

As companies strive to innovate and deliver faster, modern software architecture is evolving at near the speed of light. With Azure Functions, engineers don’t have to worry about provisioning and maintaining underlying hardware; they simply upload their code, and it’s up and running seconds later. Dynatrace news.

Serverless 144

Serverless Azure Monitoring Lambda 144

Dynatrace

SEPTEMBER 30, 2021

Cloud services platforms like AWS, Azure, and GCP are reshaping how organizations deliver value to their customers, making cloud migration an increasingly attractive option for running applications. They need enough hardware to serve their anticipated volume and keep things running smoothly without buying too much or too little.

Cloud 172

Cloud Traffic Best Practices Strategy 172

The Netflix TechBlog

APRIL 29, 2019

takes place in Amazon Web Services (AWS), whereas everything that happens afterwards (i.e., Various software systems are needed to design, build, and operate this CDN infrastructure, and a significant number of them are written in Python. are you logged in? what plan do you have? what do you want to watch?)

Open Source 279

Open Source Network Infrastructure Big Data 279

O'Reilly

SEPTEMBER 15, 2021

The results gave us insight into what our subscribers are paid, where they’re located, what industries they work for, what their concerns are, and what sorts of career development opportunities they’re pursuing. Cloud certifications, specifically in AWS and Microsoft Azure, were most strongly associated with salary increases.

Azure 145

Azure Social Media Programming AWS 145

All Things Distributed

NOVEMBER 21, 2018

People often ask me if developing for the cloud is any different from developing on-premises software. The biggest difference between developing for the cloud and developing on-premises software is that in the cloud, you have much better access to how your customers are using your services. It really is.

Cloud 135

Cloud Benchmarking Performance AWS 135

Dynatrace

JUNE 30, 2020

This not only works for your custom developed applications, but also works for 3 rd party applications you host, e.g: Stephan demoed RUM for both a custom developed application as well as for Office 365 where he logged on to SharePoint and navigated through some pages. Avodaq is not only a Dynatrace customer.

Lambda 175

Lambda Monitoring Cloud DevOps 175

Brendan Gregg

MAY 1, 2022

My dream is to turn computer performance analysis into a science, one where we can completely understand the performance of everything: of applications, libraries, kernels, hypervisors, firmware, and hardware. eBPF is in development for Windows as well (not just Linux where it originated).

Wireless 52

Wireless Hardware Open Source Cloud 52

The Morning Paper

MARCH 3, 2020

It takes you through the thinking processes and engineering practices behind the design of a key part of the control plane for AWS Elastic Block Storage (EBS): the Physalia database that stores configuration information. For Physalia, and for AWS more generally, the guiding principle is minimise the blast radius. NSDI’20.

Database 106

Database AWS Network Design 106

All Things Distributed

NOVEMBER 15, 2016

As I mentioned, we live in a world where massive volumes of data are being generated, every day, from connected devices, websites, mobile apps, and customer applications running on top of AWS infrastructure. As a native offering from AWS, QuickSight comes deeply integrated with AWS data sources such as Amazon Redshift, RDS, and S3.

Analytics 152

Analytics Availability Media Social Media 152

Dotcom-Montior

OCTOBER 6, 2021

A site reliability engineer, or SRE, is a role that that encompasses aspects of both software engineering and operations/infrastructure. At that time, the team was made up of software engineers. Site reliability engineers bridge the gap between operations and software developers. What Does a Site Reliability Engineer Do?

Engineering 67

Engineering DevOps Monitoring Google 67

cdemi

FEBRUARY 20, 2017

Let's talk about the elephant in the room; Serverless doesn't really mean that there are no Software or Hardware servers. It just means that from Software Development perspective, servers are abstracted and outsourced to another entity, so you don't need to worry about it. Amazon: AWS Lambda. Disadvantages.

Serverless 64

Serverless Architecture Lambda Azure 64

All Things Distributed

OCTOBER 7, 2015

However, the data infrastructure to collect, store and process data is geared toward developers (e.g., Amazon Redshift, DynamoDB, Amazon EMR) whereas insights need to be derived by not just developers but also non-technical business users. Big data challenges.

Cloud 137

Cloud Big Data AWS Analytics 137

All Things Distributed

OCTOBER 8, 2014

Today, I’m thrilled to announce several major features that significantly enhance the development experience on DynamoDB. These improvements have been sought by many applications developers, and we are happy to be bringing them to you. Enter Native Support for JSON in DynamoDB: Scalability and Flexibility Together at Last.

Availability 145

Availability Performance Scalability AWS 145

Brendan Gregg

JULY 4, 2021

It's an exciting time for developments in computer performance, not just for the BPF technology (which I often [write about]) but also for processors with 3D stacking and cloud vendor CPUs (e.g., This was a chance to talk about other things I've been working on, such as the present and future of hardware performance.

Performance 52

Performance Latency Hardware Storage 52

All Things Distributed

SEPTEMBER 6, 2013

This spring I travelled through Europe for the AWS Global Summit series. Europe is a continent with much diversity and for each country there are great AWS customer examples to tell. To reach those goals, Shell in 2010 began using AWS. Shell leverages AWS for big data analytics to help achieve these goals.

Cloud 129

Cloud Energy AWS Healthcare 129

All Things Distributed

JULY 14, 2015

Many happy developers are using DynamoDB to handle trillions of requests every day. In traditional database architectures, database engines often run a small search engine or data warehouse engines on the same hardware as the database. Let me expand on each one of them. DynamoDB Streams.

Database 167

Database Lambda AWS IoT 167