All Things Distributed

APRIL 24, 2019

Today, I am happy to introduce the new AWS Asia Pacific ( Hong Kong ) Region. AWS customers can now use this Region to serve their end users in Hong Kong SAR at a lower latency, and to comply with any data locality requirements.

AWS 167

AWS Latency Cloud Availability 167

Percona

DECEMBER 11, 2023

A quick configuration change may do the trick in improving the performance of your AWS RDS for MySQL instance. DLVs are particularly advantageous for databases with large allocated storage, high I/O per second (IOPS) requirements, or latency-sensitive workloads. Who can benefit from DLV? and later v10 versions MySQL: 8.0.28

AWS 93

AWS Benchmarking Performance Traffic 93

The Netflix TechBlog

NOVEMBER 9, 2022

At Netflix, we periodically reevaluate our workloads to optimize utilization of available capacity. to a larger AWS instance size, from m5.4xl (16 vCPUs) to m5.12xl (48 vCPUs). What’s worse, average latency degraded by more than 50%, with both CPU and latency patterns becoming more “choppy.” let’s call it GS2?—?to

Hardware 363

Hardware Cache Performance Latency 363

The Netflix TechBlog

DECEMBER 21, 2020

By Anupom Syam Background At Netflix, our current data warehouse contains hundreds of Petabytes of data stored in AWS S3 , and each day we ingest and create additional Petabytes. Some of the optimizations are prerequisites for a high-performance data warehouse. Iceberg plans to enable this in the form of delta files.

Storage 203

Storage Latency Efficiency Data Engineering 203

All Things Distributed

JUNE 7, 2017

Unlocking the value of data is a primary goal that AWS helps our customers to pursue. In recent years, an explosion of intelligent devices have created oceans of new data across many industries. This is because data gets more valuable when it can be processed together with other data. Law of Economics.

AWS 118

AWS IoT Lambda Storage 118

All Things Distributed

JULY 30, 2019

I'm happy to announce today that the new AWS Middle East (Bahrain) Region is now open! This is our first AWS Region in the Middle East and I'm excited by the opportunities the availability of hyper scale infrastructure will bring to organizations of all sizes.

AWS 166

AWS Education Government Latency 166

The Netflix TechBlog

MARCH 7, 2024

Berg , Romain Cledat , Kayla Seeley , Shashank Srikanth , Chaoying Wang , Darin Yu Netflix uses data science and machine learning across all facets of the company, powering a wide range of business applications from our internal infrastructure and content demand modeling to media understanding.

Systems 226

Systems Media Cache Open Source 226

Dynatrace

MAY 17, 2023

OpenTelemetry , the open source observability tool, has become the go-to standard for instrumenting custom applications to collect observability telemetry data. For this third and final part of our series, we saved the best for last: How you can enhance telemetry data even more and with less effort on your end with Dynatrace OneAgent.

Metrics 176

Metrics Monitoring Database Network 176

Dynatrace

DECEMBER 22, 2019

AWS offers a broad set of global, cloud-based services including computing, storage, networking, Internet of Things (IoT), and many others. At Dynatrace, we’re constantly improving our AWS monitoring capabilities. Monitor and understand additional AWS services. Get up to 300 new AWS metrics out of the box. Dynatrace news.

AWS 137

AWS Metrics IoT Storage 137

Dynatrace

DECEMBER 22, 2019

AWS offers a broad set of global, cloud-based services including computing, storage, networking, Internet of Things (IoT), and many others. At Dynatrace, we’re constantly improving our AWS monitoring capabilities. Monitor and understand additional AWS services. Get up to 300 new AWS metrics out of the box. Dynatrace news.

AWS 133

AWS Metrics IoT Storage 133

The Netflix TechBlog

NOVEMBER 22, 2019

by Shefali Vyas Dalal AWS re:Invent is a couple weeks away and our engineers & leaders are thrilled to be in attendance yet again this year! Technology advancements in content creation and consumption have also increased its data footprint. Please stop by our “Living Room” for an opportunity to connect or reconnect with Netflixers.

AWS 100

AWS Entertainment Open Source Benchmarking 100

The Netflix TechBlog

NOVEMBER 22, 2019

by Shefali Vyas Dalal AWS re:Invent is a couple weeks away and our engineers & leaders are thrilled to be in attendance yet again this year! Technology advancements in content creation and consumption have also increased its data footprint. Please stop by our “Living Room” for an opportunity to connect or reconnect with Netflixers.

AWS 100

AWS Entertainment Open Source Benchmarking 100

All Things Distributed

OCTOBER 25, 2018

Expanding the AWS Cloud—An AWS Region is coming to South Africa! Today, I am excited to announce our plans to open a new AWS Region in South Africa! AWS is committed to South Africa's transformation. This news marks the 23rd AWS Region that we have announced globally. We have a long history in South Africa.

AWS 167

AWS Cloud Education Programming 167

All Things Distributed

NOVEMBER 12, 2018

Today, I'm happy to announce that the AWS GovCloud (US-East) Region, our 19th global infrastructure Region, is now available for use by customers in the US. It is accessible only to vetted US entities and AWS account root users, who must confirm that they are US citizens or US permanent residents.

AWS 117

AWS Healthcare Cloud Government 117

The Netflix TechBlog

JUNE 14, 2023

Testing Strategies: A Summary Two key factors determined our testing strategies: Functional vs. non-functional requirements Idempotency If we were testing functional requirements like data accuracy, and if the request was idempotent , we relied on Replay Testing. In such cases, we were not testing for response data but overall behavior.

Traffic 353

Traffic Latency Cache Metrics 353

Dynatrace

SEPTEMBER 29, 2020

At Dynatrace we host most of our Dynatrace SaaS clusters for paying customers as well as trial users in the Amazon Web Services (AWS) cloud. Since we moved to AWS in May 2014 we have had an availability of 99.95%! Sydney, we have a disk write latency problem! After two days of quiet Davis again detected a Slow Disk issue.

Infrastructure 182

Infrastructure Cloud Monitoring AWS 182

Dynatrace

JANUARY 26, 2021

AWS Lambda functions are an example of how a serverless framework works: Developers write a function in a supported language or platform. Every time the trigger executes, the function runs on an available resource. When an application is triggered, it can cause latency as the application starts. Pay Per Use.

Serverless 245

Serverless Efficiency Lambda Azure 245

All Things Distributed

NOVEMBER 13, 2018

Today, I am happy to announce our plans to open a new AWS Region in Italy! The AWS Europe (Milan) Region is the 25th AWS Region that we've announced globally. It's the sixth AWS Region in Europe, joining existing regions in France, Germany, Ireland, the UK, and the new Region that we recently announced in Sweden.

AWS 167

AWS Energy Automotive Traffic 167

All Things Distributed

DECEMBER 12, 2018

In April 2017, Amazon Web Services announced that it would launch a new AWS infrastructure region Region in Sweden. Today, I'm happy to announce that the AWS Europe (Stockholm) Region, our 20th Region globally, is now generally available for use by customers.

AWS 124

AWS Cloud Games Serverless 124

All Things Distributed

JUNE 20, 2017

Today, I am very excited to announce our plans to open a new AWS Region in Hong Kong! The new region will give Hong Kong-based businesses, government organizations, non-profits, and global companies with customers in Hong Kong, the ability to leverage AWS technologies from data centers in Hong Kong.

AWS 146

AWS Logistics Cloud Social Media 146

The Netflix TechBlog

NOVEMBER 3, 2022

We introduce a caching mechanism in the API gateway layer, allowing us to offload processing from singleton leader elected controllers without giving up strict data consistency and guarantees clients observe. Active data includes jobs and tasks that are currently running. Titus Gateway handles user requests.

Cache 224

Cache Latency Traffic Systems 224

All Things Distributed

MARCH 26, 2018

At AWS, we don't mark many anniversaries. March 26, 2008 doesn't have any delicious desserts associated with it, but that's the day when we launched Availability Zones for Amazon EC2. A concept that has changed infrastructure architecture is now at the core of both AWS and customer reliability and operations.

AWS 132

AWS Latency Lambda Architecture 132

Scalegrid

DECEMBER 16, 2019

While you may assume a great majority of the cloud database deployments are run on AWS, Azure, or Google Cloud Platform, small to medium-sized businesses in particular are gravitating towards the developer-friendly cloud provider, DigitalOcean , for their hosting for MongoDB® needs. DigitalOcean Advantages for MongoDB. DigitalOcean Droplets.

Azure 187

Azure AWS Latency Database 187

Scalegrid

APRIL 16, 2020

Each of these models is suitable for production deployments and high traffic applications, and are available for all of our supported databases, including MySQL , PostgreSQL , Redis™ and MongoDB® database ( Greenplum® database coming soon). AWS , Azure. AWS , Azure. AWS , Azure. AWS , Azure. AWS , Azure.

Cloud 242

Cloud Azure AWS Database 242

The Netflix TechBlog

DECEMBER 17, 2019

Andreas Andreakis , Ioannis Papapanagiotou Overview Change-Data-Capture (CDC) allows capturing committed changes from a database in real-time and propagating those changes to downstream consumers [1][2]. Designed with High Availability in mind. This is crucial for repairs downstream when data has been lost or corrupted.

Database 212

Database Traffic Transportation Open Source 212

All Things Distributed

APRIL 4, 2017

Today, I am very excited to announce our plans to open a new AWS Region in the Nordics! The new region will give Nordic-based businesses, government organisations, non-profits, and global companies with customers in the Nordics, the ability to leverage the AWS technology infrastructure from data centers in Sweden.

AWS 116

AWS Airlines Latency Games 116

The Netflix TechBlog

DECEMBER 17, 2019

Andreas Andreakis , Ioannis Papapanagiotou Overview Change-Data-Capture (CDC) allows capturing committed changes from a database in real-time and propagating those changes to downstream consumers [1][2]. Designed with High Availability in mind. This is crucial for repairs downstream when data has been lost or corrupted.

Database 197

Database Traffic Transportation Open Source 197

All Things Distributed

SEPTEMBER 29, 2016

Today, I am very excited to announce our plans to open a new AWS Region in France! Based in the Paris area, the region will provide even lower latency and will allow users who want to store their content in datacenters in France to easily do so. Over the past 10 years, we have seen tremendous growth at AWS.

AWS 166

AWS IoT Internet Internet 166

Percona

JULY 1, 2023

Now that Database-as-a-service (DBaaS) is in high demand, there are multiple questions regarding AWS services that cannot always be answered easily: When should I use Aurora and when should I use RDS MySQL ? These may be performance, high availability, operational cost, management, capacity planning, scalability, security, monitoring, etc.

AWS 52

AWS Database Serverless Storage 52

All Things Distributed

OCTOBER 12, 2016

Fast Data is an emerging industry term for information that is arriving at high volume and incredible rates, faster than traditional databases can manage. Three years ago, as part of our AWS Fast Data journey we introduced Amazon ElastiCache for Redis , a fully managed in-memory data store that operates at sub-millisecond latency.

Scalability 130

Scalability Analytics Cache AWS 130

The Netflix TechBlog

AUGUST 29, 2023

A brief history of IPC at Netflix Netflix was early to the cloud, particularly for large-scale companies: we began the migration in 2008, and by 2010, Netflix streaming was fully run on AWS. Since there were no existing solutions available, we needed to build them ourselves.

Traffic 220

Traffic Latency Cloud C++ 220

All Things Distributed

JANUARY 6, 2016

In November, Amazon Web Services announced that it would launch a new AWS infrastructure region in South Korea. Today, I’m happy to announce that the Asia Pacific (Seoul) Region is now generally available for use by customers worldwide. Many of these enterprises are assisted by our extensive partner ecosystem in Korea.

AWS 110

AWS Cloud Games Latency 110

The Netflix TechBlog

FEBRUARY 20, 2019

by Jason Koch , with Martin Spier , Brendan Gregg , Ed Hunter Improving the tools available to our engineers to help them diagnose, triage, and work through software performance challenges in the cloud is a key goal for the cloud performance engineering team at Netflix. 10–20 MB/sec (it is, unsurprisingly, receiving lots of data).

Performance 211

Performance Latency Open Source Metrics 211

Scalegrid

MARCH 14, 2024

Implementing a hybrid cloud solution involves careful decision-making regarding application and data placement, migration strategies, and choosing compatible cloud service providers while ensuring seamless integration and addressing security and compliance challenges.

Strategy 130

Strategy Cloud Artificial Intelligence Infrastructure 130

Percona

NOVEMBER 3, 2023

When it comes to Citus, successfully building out and scaling a PostgreSQL cluster across multiple nodes and even across data centers can feel, at times, to be an art form because there are so many ways of building it out. The following invocation generates almost 4GB of data.

Database 101

Database Benchmarking Latency C++ 101

Dynatrace

APRIL 7, 2021

But your infrastructure teams don’t see any issue on their AWS or Azure monitoring tools, your platform team doesn’t see anything too concerning in Kubernetes logging, and your apps team says there are green lights across the board. Every component has its own siloed cloud monitoring tool, with its own set of data.

Cloud 158

Cloud Monitoring Latency Games 158

All Things Distributed

AUGUST 20, 2015

When using relational databases, traversing relationships requires expensive table JOIN operations, causing significantly increased latency as table size and query complexity grow. Like many AWS innovations, the desire to build a solution for a scalable graph database came from Amazon’s retail business. Enter graph databases.

Database 134

Database Logistics Availability Social Media 134