High Scalability

OCTOBER 24, 2022

What I'm concerned about, as a developer, is the collateral damage such ham-fisted regulation might cause. Each cloud-native evolution is about using the hardware more efficiently. Admittedly, it's a developer focussed argument, but there are more technical arguments against the move. I've read the report. Not that I found.

Cloud 187

Cloud Hardware Infrastructure Innovation 187

Dynatrace

NOVEMBER 15, 2021

Driving this growth is the increasing adoption of hyperscale cloud providers (AWS, Azure, and GCP) and containerized microservices running on Kubernetes. A log is a detailed, timestamped record of an event generated by an operating system, computing environment, application, server, or network device. billion in 2020 to $4.1

Analytics 209

Analytics Monitoring Artificial Intelligence DevOps 209

Adrian Cockcroft

FEBRUARY 9, 2023

The layers of platforms start at the bottom with hardware choices such as which CPU architectures and vendors you want to use. The virtualization and networking platform could be datacenter based, with something like VMware, or cloud based using one of the cloud providers such as AWS EC2.

Engineering 137

Engineering Serverless Lambda AWS 137

Dynatrace

JUNE 15, 2023

The cloud allows a modular approach to building applications, enabling development and operations teams to create and deploy feature-rich apps very quickly. It also entails secure development practices, security monitoring and logging, compliance and governance, and incident response.

Cloud 177

Cloud Open Source Architecture Monitoring 177

Scalegrid

MAY 13, 2020

Greenplum Database is an open-source , hardware-agnostic MPP database for analytics, based on PostgreSQL and developed by Pivotal who was later acquired by VMware. Greenplum uses an MPP database design that can help you develop a scalable, high performance deployment. What Exactly is Greenplum? At a glance – TLDR.

Big Data 321

Big Data Database Artificial Intelligence Open Source 321

Dynatrace

NOVEMBER 22, 2022

Cloud service providers, such as Amazon Web Services (AWS) , can offer infrastructure with five-nines availability by deploying in multiple availability zones and replicating data between regions. Instead, to speed up response times, applications are now processing most data at the network’s perimeter, closest to the data’s origin.

Infrastructure 182

Infrastructure Availability Systems Retail 182

The Netflix TechBlog

APRIL 29, 2019

Open Connect Open Connect is Netflix’s content delivery network (CDN). takes place in Amazon Web Services (AWS), whereas everything that happens afterwards (i.e., video streaming) takes place in the Open Connect network. takes place in Amazon Web Services (AWS), whereas everything that happens afterwards (i.e.,

Open Source 279

Open Source Network Infrastructure Big Data 279

Brendan Gregg

NOVEMBER 28, 2017

Hardware virtualization for cloud computing has come a long way, improving performance using technologies such as VT-x, SR-IOV, VT-d, NVMe, and APICv. At Netflix, we've been using these technologies as they've been made available for instance types in the AWS EC2 cloud. I'd expect between 0.1%

Virtualization 40

Virtualization AWS Hardware Storage 40

Dynatrace

OCTOBER 28, 2021

As software performance degrades or fails, the chaos engineers’ findings enable developers to add resiliency into the code, so the application remains intact in an emergency. In 2009, the purveyor of online videos migrated to AWS cloud infrastructure to deliver its entertainment to a growing audience. Blast radius.

Engineering 225

Engineering Entertainment Cloud Infrastructure 225

The Morning Paper

MARCH 1, 2020

Firecracker is the virtual machine monitor (VMM) that powers AWS Lambda and AWS Fargate, and has been used in production at AWS since 2018. The first version of AWS Lambda was built using Linux containers. All of the existing approaches we just examined involve trade-offs that AWS didn’t want to make.

Serverless 101

Serverless Virtualization Lambda AWS 101

Brendan Gregg

JULY 4, 2021

It's an exciting time for developments in computer performance, not just for the BPF technology (which I often [write about]) but also for processors with 3D stacking and cloud vendor CPUs (e.g., This was a chance to talk about other things I've been working on, such as the present and future of hardware performance.

Performance 140

Performance Latency Hardware Storage 140

All Things Distributed

JANUARY 23, 2012

Expanding the Cloud - The AWS Storage Gateway. Today Amazon Web Services has launched the AWS Storage Gateway, making the power of secure and reliable cloud storage accessible from customersâ?? The Amazon Virtual Private Cloud extends on-premises compute with all the power of AWS, making it elastic, scalable and highly reliable.

Storage 115

Storage AWS Virtualization Cloud 115

Scalegrid

JANUARY 8, 2024

Understanding Multi-Cloud and Hybrid Cloud Cloud computing has revolutionized the IT industry, offering a host of advantages including cost-effectiveness, increased agility, and access to cutting-edge hardware. In this scenario, two notable models – multi-cloud and hybrid cloud have emerged. But what do these entail?

Strategy 147

Strategy Cloud Scalability Artificial Intelligence 147

Dynatrace

SEPTEMBER 30, 2021

Cloud services platforms like AWS, Azure, and GCP are reshaping how organizations deliver value to their customers, making cloud migration an increasingly attractive option for running applications. They need enough hardware to serve their anticipated volume and keep things running smoothly without buying too much or too little.

Cloud 165

Cloud Traffic Best Practices Strategy 165

The Morning Paper

MARCH 3, 2020

It takes you through the thinking processes and engineering practices behind the design of a key part of the control plane for AWS Elastic Block Storage (EBS): the Physalia database that stores configuration information. For Physalia, and for AWS more generally, the guiding principle is minimise the blast radius. NSDI’20.

Database 106

Database AWS Network Design 106

All Things Distributed

SEPTEMBER 6, 2013

This spring I travelled through Europe for the AWS Global Summit series. Europe is a continent with much diversity and for each country there are great AWS customer examples to tell. To reach those goals, Shell in 2010 began using AWS. Shell leverages AWS for big data analytics to help achieve these goals.

Cloud 129

Cloud Energy AWS Healthcare 129

All Things Distributed

MAY 22, 2013

these are core principles for every AWS service. A lot of the power of AWS comes from the fact that we can invest in expertise in these sorts of areas and spread the benefits across all our customers. Amazon Redshift starts with the security foundation underlying all AWS services. s clear that Amazon Redshiftâ??s These arenâ??t

Design 110

Design AWS Hardware Media 110

Brendan Gregg

JULY 4, 2021

It's an exciting time for developments in computer performance, not just for the BPF technology (which I often [write about]) but also for processors with 3D stacking and cloud vendor CPUs (e.g., This was a chance to talk about other things I've been working on, such as the present and future of hardware performance.

Performance 52

Performance Latency Hardware Storage 52

All Things Distributed

APRIL 5, 2012

From tax preparation to safe social networks, Amazon RDS brings new and innovative applications to the cloud. Empowering innovation is at the heart of everything we do at Amazon Web Services (AWS). Intelligent Social network - Facilitate topical Q&A conversations among employees, customers and our most valued super contributors.

Innovation 146

Innovation AWS Education Network 146

All Things Distributed

AUGUST 16, 2012

The best practices that we are collecting in the AWS Economics Center are there to help our customers get a total view on their IT cost such that they can accurately compare on-premise and cloud. The AWS Economics Center now features the TCO of Web Applications whitepaper. Total Cost of Ownership.

AWS 118

AWS Hardware Traffic Best Practices 118

Brendan Gregg

FEBRUARY 28, 2023

At USENIX SREcon22 APAC I gave the opening keynote on the future of computer performance, rounding up the latest developments and making predictions of where I see things heading. This talk originated from my updates to [Systems Performance 2nd Edition], and this was the first time I've given this talk in person!

Performance 110

Performance Latency Cache Virtualization 110

The Netflix TechBlog

FEBRUARY 9, 2021

The homepage needs to load in a reasonable amount of time, even in poor network conditions. We can leverage high performance VMs in AWS to generate the assets. However, it would be cost-inefficient to leverage this same hardware for lightweight and more consistent traffic patterns that an asset management service requires.

Engineering 165

Engineering Storage Latency Entertainment 165

All Things Distributed

JULY 13, 2010

Customers with complex computational workloads such as tightly coupled, parallel processes, or with applications that are very sensitive to network performance, can now achieve the same high compute and networking performance provided by custom-built infrastructure while benefiting from the elasticity, flexibility and cost advantages of Amazon EC2.

Cloud 118

Cloud AWS Automotive Latency 118

The Morning Paper

MAY 28, 2019

We don’t talk about energy as often as we probably should on this blog, but it’s certainly true that our data centres and various IT systems consume an awful lot of it. The goal is to produce a low-energy hardware classifier for embedded applications doing local processing of sensor data. Introducing race logic.

Energy 52

Energy Hardware Efficiency Architecture 52

Adrian Cockcroft

JUNE 21, 2022

The early days at Sun Cambridge were special, I absorbed a lot about networking and the technical side of the role from my fellow systems engineer Martin Baines, and we were driving all over the region in cool company cars (I had a Citroen BX 16V) selling a really hot product. He hasn’t changed.

Tuning 52

Tuning Benchmarking Engineering C++ 52

Testsigma

MAY 19, 2021

A process that was developed to automate the processes from build creation to deployment and maybe everything in between. DevOps and cloud-based solutions mingle in such a synchronous manner, it seems like they were developed to support each other even though this is not true in any aspect. Why Opt For Cloud-Based Solutions and DevOps?

DevOps 59

DevOps Cloud Artificial Intelligence Infrastructure 59

All Things Distributed

DECEMBER 20, 2017

Developments like cloud computing, the internet of things, artificial intelligence, and machine learning are proving that IT has (again) become a strategic business driver. Kärcher benefits as well: By developing this service, the company gets exact insight into how the machines are actually used by its customers.

Artificial Intelligence 79

Artificial Intelligence Social Media Logistics AWS 79

VoltDB

JUNE 1, 2017

It was – like the hypothetical movie I describe above – more than a little bit odd, as you could leave a session discussing ever more abstract layers of virtualization and walk into one where they emphasized the critical importance of pinning a network interface to a specific VM for optimal performance. The “Public Private Cloud” folks.

Hardware 56

Hardware Latency Virtualization Cloud 56

Dotcom-Montior

OCTOBER 6, 2021

Since then, the concept of site reliability engineering has evolved and made its way into the broader software development industry and is now its own role within organizations. Site reliability engineers bridge the gap between operations and software developers. What Does a Site Reliability Engineer Do? Monitoring. Incident Response.

Engineering 67

Engineering DevOps Monitoring Google 67

Dotcom-Montior

OCTOBER 12, 2017

EasyTravel demo application on AWS server. LoadView scripting tool Easystep on AWS server. Firewall on AWS server. AWS server security policy. Setup Demo App EasyTravel on AWS box. Connect demo application hosted on AWS to Dynatrace. Setup Demo App EasyTravel on AWS Box. Installation. Configuration.

AWS 40

AWS Tuning Monitoring Servers 40

VoltDB

JUNE 1, 2017

It was – like the hypothetical movie I describe above – more than a little bit odd, as you could leave a session discussing ever more abstract layers of virtualization and walk into one where they emphasized the critical importance of pinning a network interface to a specific VM for optimal performance. The “Public Private Cloud” folks.

Hardware 40

Hardware Latency Virtualization Cloud 40

Brendan Gregg

FEBRUARY 28, 2023

At USENIX SREcon22 APAC I gave the opening keynote on the future of computer performance, rounding up the latest developments and making predictions of where I see things heading. This talk originated from my updates to Systems Performance 2nd Edition , and this was the first time I've given this talk in person!

Performance 52

Performance Latency Cache Virtualization 52

Brendan Gregg

SEPTEMBER 5, 2017

Switching from Solaris to Linux has become much easier in the last two years, with Linux developments in ZFS, Zones, and DTrace. Linux has also been developing its own ZFS-like filesystem, btrfs. Since ZFS is an add-on developed out-of-tree, it will always be harder to get the same level of attention. LTS (April 2016).

Virtualization 76

Virtualization AWS Engineering Hardware 76

Percona

JULY 26, 2023

MongoDB is popular with developers as it is easy to get started with. As with any database, developers and DBAs working with MongoDB should look at how to optimize the performance of their database, especially nowadays with cloud services, where each byte processed, transmitted, and stored costs money.

Database 79

Database Servers Storage Strategy 79

Adrian Cockcroft

NOVEMBER 11, 2019

This discussion focuses on hardware, software and operational failure modes. This is why most AWS regions have three availability zones. Each category is centered around the responsibilities of a different team of people, and should be discussed and developed in partnership with those teams.

Latency 52

Latency Engineering Systems Hardware 52

All Things Distributed

DECEMBER 12, 2018

In April 2017, Amazon Web Services announced that it would launch a new AWS infrastructure region Region in Sweden. Today, I'm happy to announce that the AWS Europe (Stockholm) Region, our 20th Region globally, is now generally available for use by customers.

AWS 124

AWS Cloud Games Serverless 124

Adrian Cockcroft

NOVEMBER 11, 2019

This discussion focuses on hardware, software and operational failure modes. This is why most AWS regions have three availability zones. Each category is centered around the responsibilities of a different team of people, and should be discussed and developed in partnership with those teams.

Latency 53

Latency Engineering Systems Hardware 53