All Things Distributed

MARCH 2, 2011

Expanding the Cloud - Introducing the AWS Asia Pacific (Tokyo) Region. Today Amazon Web Services is expanding its world-wide coverage with the launch of a new AWS Region located in Tokyo, Japan. The advanced Asia Pacific network infrastructure also makes the AWS Tokyo Region a viable low-latency option for customers from South Korea.

AWS 114

AWS Cloud Games Latency 114

The Netflix TechBlog

NOVEMBER 22, 2019

by Shefali Vyas Dalal AWS re:Invent is a couple weeks away and our engineers & leaders are thrilled to be in attendance yet again this year! To sustain this data growth at Netflix, it has deployed open-source software Ceph using AWS services to achieve the required SLOs of some of the post-production workflows.

AWS 37

AWS Entertainment Open Source Benchmarking 37

cdemi

DECEMBER 4, 2016

Maximizing Availability : Delays or Downtime of the service does not affect the application generating the messages. Control Costs : You don't have to design your service to meet peak load, but rather average load. Message Brokers are servers that take care of Queue Handling , Routing Messages, High Availability and Scaling out.

Design 47

Design Azure Scalability Latency 47

All Things Distributed

SEPTEMBER 25, 2017

Today, I am excited to announce plans for Amazon Web Services (AWS) to bring an infrastructure Region to the Middle East! Based in Bahrain, this will be the first Region for AWS in the Middle East. This Region will consist of three Availability Zones at launch, and it will provide even lower latency to users across the Middle East.

Cloud 154

Cloud Education Energy Government 154

All Things Distributed

NOVEMBER 26, 2013

As I discussed in my re:Invent keynote earlier this month, I am now happy to announce the immediate availability of Amazon RDS Cross Region Read Replicas , which is another important enhancement for our customers using or planning to use multiple AWS Regions to deploy their applications.

Cloud 147

Cloud AWS Traffic Latency 147

All Things Distributed

AUGUST 16, 2011

Expanding the Cloud - The AWS GovCloud (US) Region. Today AWS announced the launch of the AWS GovCloud (US) Region. The concept of regions gives AWS customers control over the placement of their resources and services. The Cloud First strategy is most visible with new Federal IT programs, which are all designed to be â??Cloud

AWS 113

AWS Government Big Data Cloud 113

Dynatrace

SEPTEMBER 30, 2021

Cloud services platforms like AWS, Azure, and GCP are reshaping how organizations deliver value to their customers, making cloud migration an increasingly attractive option for running applications. Improved performance and availability. The third big advantage of cloud migration is performance and availability.

Cloud 165

Cloud Traffic Best Practices Strategy 165

All Things Distributed

DECEMBER 3, 2009

Expanding the Cloud - New AWS Region: US-West (Northern California). We have expanded the AWS footprint in the US and starting today a new AWS Region is available for use: US-West (Northern California). AWS is committed to making its services available at low cost. Countdown to What is Next in AWS.

AWS 60

AWS Cloud Latency Storage 60

All Things Distributed

APRIL 17, 2013

While DynamoDB already allows you to perform low-latency queries based on your tableâ??s This gives you the ability to perform richer queries while still meeting the low-latency demands of responsive, scalable applications. s scalability, availability, resilience, low cost and minimal operational overhead. experiences.â??.

Cloud 116

Cloud Latency Games Scalability 116

All Things Distributed

APRIL 28, 2010

Expanding the Cloud - Opening the AWS Asia Pacific (Singapore) Region. Today Amazon Web Services has taken another important step in serving customers worldwide: the AWS Asia Pacific (Singapore) Region is now launched. The new Singapore Region offers customers in APAC lower-latency access to AWS services. Comments ().

AWS 61

AWS Cloud Latency Storage 61

ScaleOut Software

APRIL 6, 2021

Because it runs on a scalable, highly available in-memory computing platform, it can do all this simultaneously for hundreds of thousands or even millions of data sources. Message are delivered to the grid using messaging hubs, such as Azure IoT Hub, AWS IoT Core, Kafka, a built-in REST service, or directly using APIs.

IoT 52

IoT Azure Analytics Healthcare 52

The Morning Paper

AUGUST 29, 2019

If you’re moving an OLAP workload to the cloud (AWS in the context of this paper), what DBMS setup should you go with? We focused on OLAP-oriented parallel data warehouse products available for AWS and restricted our attention to commercially available systems. The design space. VLDB’19. The last word.

Architecture 76

Architecture Cloud Storage Serverless 76

All Things Distributed

FEBRUARY 22, 2012

Today AWS launched an exciting new service for developers: the Amazon Simple Workflow Service. By designing autonomous distributed components, developers get the flexibility to deploy and scale out parts of the application independently as load increases. As always The AWS developer blog has additional details. Comments ().

Cloud 130

Cloud AWS Java Scalability 130

All Things Distributed

DECEMBER 5, 2010

I am very excited that today we have launched Amazon Route 53, a high-performance and highly-available Domain Name System (DNS) service. Route 53 has the business properties that you have come to expect from an AWS service: fully self-service and programmable, with transparent pay-as-you-go pricing and no minimum usage commitments.

Cloud 117

Cloud Internet Internet AWS 117

All Things Distributed

JULY 13, 2010

Cluster Computer Instances for Amazon EC2 are a new instance type specifically designed for High Performance Computing applications. Today, I am very proud to be a part of the Amazon Web Services team as we truly make HPC available as an on-demand commodity for every developer to use. HPC and Amazon EC2. More information.

Cloud 119

Cloud AWS Automotive Latency 119

All Things Distributed

JULY 11, 2011

With this change, we will improve the granularity of pricing information you receive by introducing a Spot Instance price per Availability Zone rather than a Spot Instance price per Region. Customers whose bids exceed the Spot price gain access to the available Spot Instances and run as long as the bid exceeds the Spot Price.

AWS 87

AWS Storage Cloud Big Data 87

Percona

DECEMBER 11, 2023

A quick configuration change may do the trick in improving the performance of your AWS RDS for MySQL instance. A Dedicated Log Volume (DLV) is a specialized storage volume designed to house database transaction logs separately from the volume containing the database tables. and later v10 versions MySQL: 8.0.28

AWS 95

AWS Benchmarking Performance Traffic 95

The Netflix TechBlog

NOVEMBER 9, 2022

At Netflix, we periodically reevaluate our workloads to optimize utilization of available capacity. to a larger AWS instance size, from m5.4xl (16 vCPUs) to m5.12xl (48 vCPUs). What’s worse, average latency degraded by more than 50%, with both CPU and latency patterns becoming more “choppy.” let’s call it GS2?—?to

Hardware 363

Hardware Cache Performance Latency 363

Dynatrace

DECEMBER 22, 2019

AWS offers a broad set of global, cloud-based services including computing, storage, networking, Internet of Things (IoT), and many others. At Dynatrace, we’re constantly improving our AWS monitoring capabilities. Monitor and understand additional AWS services. Get up to 300 new AWS metrics out of the box. Dynatrace news.

AWS 136

AWS Metrics IoT Storage 136

All Things Distributed

MARCH 26, 2018

At AWS, we don't mark many anniversaries. March 26, 2008 doesn't have any delicious desserts associated with it, but that's the day when we launched Availability Zones for Amazon EC2. A concept that has changed infrastructure architecture is now at the core of both AWS and customer reliability and operations.

AWS 134

AWS Latency Lambda Architecture 134

Dynatrace

DECEMBER 22, 2019

AWS offers a broad set of global, cloud-based services including computing, storage, networking, Internet of Things (IoT), and many others. At Dynatrace, we’re constantly improving our AWS monitoring capabilities. Monitor and understand additional AWS services. Get up to 300 new AWS metrics out of the box. Dynatrace news.

AWS 133

AWS Metrics IoT Storage 133

Scalegrid

DECEMBER 16, 2019

While you may assume a great majority of the cloud database deployments are run on AWS, Azure, or Google Cloud Platform, small to medium-sized businesses in particular are gravitating towards the developer-friendly cloud provider, DigitalOcean , for their hosting for MongoDB® needs. DigitalOcean Advantages for MongoDB. DigitalOcean Droplets.

Azure 187

Azure AWS Latency Database 187

Percona

JULY 1, 2023

Now that Database-as-a-service (DBaaS) is in high demand, there are multiple questions regarding AWS services that cannot always be answered easily: When should I use Aurora and when should I use RDS MySQL ? These may be performance, high availability, operational cost, management, capacity planning, scalability, security, monitoring, etc.

AWS 52

AWS Database Serverless Storage 52

Percona

APRIL 17, 2023

Note that the intent of tuning the settings is not exclusively about improving performance but also enhancing the high availability and resilience of the MongoDB database. There is an issue with this, which causes the OS to swap even with memory available. The CFQ works well for many general use cases but lacks latency guarantees.

Best Practices 52

Best Practices Design Tuning Database 52

Scalegrid

MARCH 14, 2024

Providers such as AWS Outposts, Microsoft Azure Stack, Google Anthos, and VMware Cloud on AWS offer compatible private clouds that integrate seamlessly with established public cloud platforms — a key feature for constructing hybrid cloud systems.

Strategy 130

Strategy Cloud Artificial Intelligence Infrastructure 130

The Netflix TechBlog

DECEMBER 21, 2020

By Anupom Syam Background At Netflix, our current data warehouse contains hundreds of Petabytes of data stored in AWS S3 , and each day we ingest and create additional Petabytes. This article will list some of the use cases of AutoOptimize, discuss the design principles that help enhance efficiency, and present the high-level architecture.

Storage 203

Storage Latency Efficiency Data Engineering 203

The Netflix TechBlog

NOVEMBER 3, 2022

In PACELC terms we choose PC/EC and have the same level of availability for writes of our previous system while improving our theoretical availability for reads. In that scenario, the system would need to deal with the data propagation latency directly, for example, by use of timeouts or client-originated update tracking mechanisms.

Cache 224

Cache Latency Traffic Systems 224

The Netflix TechBlog

AUGUST 29, 2023

A brief history of IPC at Netflix Netflix was early to the cloud, particularly for large-scale companies: we began the migration in 2008, and by 2010, Netflix streaming was fully run on AWS. Today we have a wealth of tools, both OSS and commercial, all designed for cloud-native environments.

Traffic 220

Traffic Latency Cloud C++ 220

The Netflix TechBlog

AUGUST 16, 2023

By Arthur Gonigberg , Argha C Plaintext Past When Zuul was designed and developed , there was an inherent assumption that connections were effectively free, given we weren’t using mutual TLS (mTLS). Service mesh being available on many services made testing and rolling out this feature very easy because it enables ALPN by default.

Traffic 170

Traffic Servers Google Metrics 170

The Netflix TechBlog

APRIL 26, 2022

We will share how its design has evolved over the years and the lessons learned while building it. To understand Axion’s design, we need to know the various components that interact with it. These facts are managed and made available by services like viewing history or video metadata services outside of Axion.

Storage 187

Storage Design Scalability Latency 187

All Things Distributed

JULY 14, 2015

DynamoDB Streams is the enabling technology behind two other features announced today: cross-region replication maintains identical copies of DynamoDB tables across AWS regions with push-button ease, and triggers execute AWS Lambda functions on streams, allowing you to respond to changing data conditions. DynamoDB Streams.

Database 167

Database Lambda AWS IoT 167

Adrian Cockcroft

JANUARY 20, 2023

Clouds using Ethernet that are multipath optimized using libfabric and features like EFA on AWS are going to be increasingly competitive, and Ethernet will replace other interconnects between racks. The emergence of chiplet technology also allows higher performance and integration without having to design every chip from scratch.

Architecture 52

Architecture Latency Benchmarking AWS 52

The Netflix TechBlog

OCTOBER 27, 2020

The processed data is typically stored as data warehouse tables in AWS S3. The data warehouse is not designed to serve point requests from microservices with low latency. Therefore, we must efficiently move data from the data warehouse to a global, low-latency and highly-reliable key-value store.

Latency 243

Latency Storage Big Data Tuning 243

The Morning Paper

MARCH 3, 2020

It takes you through the thinking processes and engineering practices behind the design of a key part of the control plane for AWS Elastic Block Storage (EBS): the Physalia database that stores configuration information. For Physalia, and for AWS more generally, the guiding principle is minimise the blast radius. NSDI’20.

Database 106

Database AWS Network Design 106

Scalegrid

JANUARY 12, 2024

All rely heavily on utilizing allocated portions from existing pools made available through specific providers as part of their service offerings. There are numerous choices available for deploying these workloads on various cloud provider platforms that offer unique capabilities.

Cloud 130

Cloud Virtualization Storage Efficiency 130

The Netflix TechBlog

FEBRUARY 18, 2022

Scaling Policies To address the thundering herd problem and to keep latencies under acceptable thresholds, the cluster scale-up policies are configured to be more aggressive than the scale-down policies. Event Priority Based Clusters AWS Instance Clusters that subscribe to the corresponding queues with the same priority.

Systems 334

Systems Traffic Architecture Mobile 334

High Scalability

SEPTEMBER 8, 2018

No, I don’t think that is because AWS is earning a 355x margin on DynamoDB! To meet user-defined goals for performance (request latency) and cost, the monitoring service tracks and adjusts resources to workload changes. This increases the cores and network bandwidth available to serve common requests.

Storage 199

Storage Performance AWS Efficiency 199