All Things Distributed

JULY 13, 2010

Today, I am very proud to be a part of the Amazon Web Services team as we truly make HPC available as an on-demand commodity for every developer to use. Additionally, many high-end HPC applications take advantage of knowing their in-house hardware platforms to achieve major speedup by exploiting the specific processor architecture.

Cloud 118

Cloud AWS Automotive Latency 118

Dynatrace

SEPTEMBER 29, 2020

At Dynatrace we host most of our Dynatrace SaaS clusters for paying customers as well as trial users in the Amazon Web Services (AWS) cloud. Since we moved to AWS in May 2014 we have had an availability of 99.95%! Sydney, we have a disk write latency problem!

Infrastructure 179

Infrastructure Cloud Monitoring AWS 179

Dynatrace

JANUARY 26, 2021

This allows teams to sidestep much of the cost and time associated with managing hardware, platforms, and operating systems on-premises, while also gaining the flexibility to scale rapidly and efficiently. AWS Lambda functions are an example of how a serverless framework works: Developers write a function in a supported language or platform.

Serverless 243

Serverless Efficiency Lambda Azure 243

All Things Distributed

APRIL 4, 2017

Today, I am very excited to announce our plans to open a new AWS Region in the Nordics! The new region will give Nordic-based businesses, government organisations, non-profits, and global companies with customers in the Nordics, the ability to leverage the AWS technology infrastructure from data centers in Sweden.

AWS 116

AWS Airlines Latency Games 116

All Things Distributed

DECEMBER 12, 2018

In April 2017, Amazon Web Services announced that it would launch a new AWS infrastructure region Region in Sweden. Today, I'm happy to announce that the AWS Europe (Stockholm) Region, our 20th Region globally, is now generally available for use by customers.

AWS 124

AWS Cloud Games Serverless 124

Percona

JULY 1, 2023

Now that Database-as-a-service (DBaaS) is in high demand, there are multiple questions regarding AWS services that cannot always be answered easily: When should I use Aurora and when should I use RDS MySQL ? These may be performance, high availability, operational cost, management, capacity planning, scalability, security, monitoring, etc.

AWS 52

AWS Database Serverless Storage 52

The Morning Paper

MAY 12, 2019

An open-source benchmark suite for microservices and their hardware-software implications for cloud & edge systems Gan et al., It’s a pretty impressive effort to pull together and make available in open source (not yet available as I write this) such a suite, and I’m sure explains much of the long list of 24 authors on this paper.

Open Source 61

Open Source Hardware Benchmarking Systems 61

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. As a Xen guest, this profile was gathered using perf(1) and the kernel's software cpu-clock soft interrupts, not the hardware NMI. Checking those available: $ cat /sys/devices/system/clocksource/clocksource0/available_clocksource.

Speed 126

Speed Java AWS Virtualization 126

All Things Distributed

MARCH 11, 2016

The epoch of AWS is the launch of Amazon S3 on March 14, 2006, now almost 10 years ago. Given that AWS is a pioneer in building and operating these services world-wide, these lessons have been of crucial importance to our business. This is a given, whether you are using the highest quality hardware or lowest cost components.

AWS 144

AWS Hardware Retail Virtualization 144

All Things Distributed

JULY 14, 2015

DynamoDB Streams is the enabling technology behind two other features announced today: cross-region replication maintains identical copies of DynamoDB tables across AWS regions with push-button ease, and triggers execute AWS Lambda functions on streams, allowing you to respond to changing data conditions. DynamoDB Streams.

Database 167

Database Lambda AWS IoT 167

All Things Distributed

JULY 20, 2015

A cluster is just a pool of compute resources available to a customer’s applications. The agent is written in Go, has a minimal footprint, and is available on GitHub under an Apache license. This architecture affords Amazon ECS high availability, low latency, and high throughput because the data store is never pessimistically locked.

Latency 166

Latency Architecture AWS Open Source 166

The Morning Paper

MARCH 3, 2020

It takes you through the thinking processes and engineering practices behind the design of a key part of the control plane for AWS Elastic Block Storage (EBS): the Physalia database that stores configuration information. For Physalia, and for AWS more generally, the guiding principle is minimise the blast radius. NSDI’20.

Database 106

Database AWS Network Design 106

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. As a Xen guest, this profile was gathered using perf(1) and the kernel's software cpu-clock soft interrupts, not the hardware NMI. Other EC2 instance types, such as C5 or M5, use the AWS Nitro Hypervisor.

Speed 52

Speed Java AWS Virtualization 52

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. As a Xen guest, this profile was gathered using perf(1) and the kernel's software cpu-clock soft interrupts, not the hardware NMI. Other EC2 instance types, such as C5 or M5, use the AWS Nitro Hypervisor.

Speed 40

Speed Java AWS Virtualization 40

All Things Distributed

JANUARY 18, 2012

It is very gratifying to see all of our learning and experience become available to our customers in the form of an easy-to-use managed service. Amazon DynamoDB offers low, predictable latencies at any scale. It provides multi-data center replication, high availability, and offers rock-solid durability.

Scalability 167

Scalability Database Ecommerce Latency 167

All Things Distributed

NOVEMBER 15, 2010

This incredible power is available for anyone to use in the usual pay-as-you-go model, removing the investment barrier that has kept many organizations from adopting GPUs for their workloads even though they knew there would be significant performance benefit. The different stages were then load balanced across the available units.

AWS 136

AWS Latency Programming Architecture 136

Dynatrace

OCTOBER 1, 2021

In these modern environments, every hardware, software, and cloud infrastructure component and every container, open-source tool, and microservice generates records of every activity. Observability relies on telemetry derived from instrumentation that comes from the endpoints and services in your multi-cloud computing environments.

Metrics 363

Metrics Open Source Monitoring Infrastructure 363

Percona

APRIL 17, 2023

Note that the intent of tuning the settings is not exclusively about improving performance but also enhancing the high availability and resilience of the MongoDB database. There is an issue with this, which causes the OS to swap even with memory available. The CFQ works well for many general use cases but lacks latency guarantees.

Best Practices 52

Best Practices Design Tuning Database 52

The Morning Paper

MAY 28, 2019

We don’t talk about energy as often as we probably should on this blog, but it’s certainly true that our data centres and various IT systems consume an awful lot of it. The goal is to produce a low-energy hardware classifier for embedded applications doing local processing of sensor data. Introducing race logic. Performance evaluation.

Energy 52

Energy Hardware Efficiency Architecture 52

Adrian Cockcroft

NOVEMBER 11, 2019

This discussion focuses on hardware, software and operational failure modes. Collecting some critical metrics at one second intervals, with a total observability latency of ten seconds or less matches the human attention span much better. This is why most AWS regions have three availability zones.

Latency 52

Latency Engineering Systems Hardware 52

Adrian Cockcroft

NOVEMBER 11, 2019

This discussion focuses on hardware, software and operational failure modes. Collecting some critical metrics at one second intervals, with a total observability latency of ten seconds or less matches the human attention span much better. This is why most AWS regions have three availability zones.

Latency 53

Latency Engineering Systems Hardware 53

Brendan Gregg

SEPTEMBER 5, 2017

What follows are topics that may be of interest to anyone looking to migrate their systems and skillset: scan these to find topics that interest you. ## ZFS ZFS is available for Linux via the [zfsonlinux] and [OpenZFS] projects, and more recently was included in Canonical's Ubuntu Linux distribution: Ubuntu Xenial 16.04 LTS (April 2016).

Virtualization 76

Virtualization AWS Engineering Hardware 76

Sutter's Mill

JUNE 21, 2012

They made a nice recording and it’s now available online here: Facebook Engineering. Now welcome to the hardware jungle. The slides are available here. For those interested in a longer version, in April I gave a 105-minute + Q&A version of this talk in Kansas City at Perceptive, also available online where I posted before.

Latency 40

Latency Transportation Hardware Education 40

Dynatrace

AUGUST 5, 2019

In this role, I am leading a global team that works closely with our strategic partners such as AWS, Microsoft, Google, Pivotal, Red Hat and others. Lift & Shift is where you basically just move physical or virtual hosts to the cloud – essentially you just run your host on somebody else’s hardware.

Cloud 31

Cloud Traffic Database Network 31

Percona

NOVEMBER 3, 2023

Rather than listing the concepts, function calls, etc, available in Citus, which frankly is a bit boring, I’m going to explore scaling out a database system starting with a single host. I won’t cover all the features but show just enough that you’ll want to see more of what you can learn to accomplish for yourself.

Database 109

Database Benchmarking Latency C++ 109

Smashing Magazine

JANUARY 11, 2021

Usually, the most specific and relevant ones are: Time to Interactive (TTI) The point at which layout has stabilized , key webfonts are visible, and the main thread is available enough to handle user input — basically the time mark when a user can interact with the UI. Large preview ).

Performance 145

Performance Cache Media Metrics 145

Smashing Magazine

JANUARY 6, 2020

Usually, the most specific and relevant ones are: Time to Interactive (TTI) The point at which layout has stabilized, key webfonts are visible, and the main thread is available enough to handle user input — basically the time mark when a user can interact with the UI. Getting started with Webpack can be tough though.

Performance 145

Performance Cache Network Metrics 145

Smashing Magazine

JANUARY 7, 2019

Time to Interactive (TTI) The point at which layout has stabilized, key webfonts are visible, and the main thread is available enough to handle user input — basically the time mark when a user can interact with the UI. Estimated Input Latency tells us if we are hitting that threshold, and ideally, it should be below 50ms.

Performance 103

Performance Cache Metrics Network 103