All Things Distributed

NOVEMBER 13, 2018

Today, I am happy to announce our plans to open a new AWS Region in Italy! The AWS Europe (Milan) Region is the 25th AWS Region that we've announced globally. It's the sixth AWS Region in Europe, joining existing regions in France, Germany, Ireland, the UK, and the new Region that we recently announced in Sweden.

AWS 164

AWS Energy Automotive Traffic 164

Scalegrid

APRIL 16, 2020

Each of these models is suitable for production deployments and high traffic applications, and are available for all of our supported databases, including MySQL , PostgreSQL , Redis™ and MongoDB® database ( Greenplum® database coming soon). AWS , Azure. AWS , Azure. AWS , Azure. AWS , Azure. AWS , Azure.

Cloud 242

Cloud Azure AWS Database 242

The Netflix TechBlog

SEPTEMBER 10, 2024

By Karthik Yagna , Baskar Odayarkoil , and Alex Ellis Pushy is Netflix’s WebSocket server that maintains persistent WebSocket connections with devices running the Netflix application. Where aws ends and the internet begins is an exercise left to the reader. Sample system diagram for an Alexa voice command.

Latency 230

Latency Cache Tuning Efficiency 230

The Netflix TechBlog

NOVEMBER 3, 2022

In PACELC terms we choose PC/EC and have the same level of availability for writes of our previous system while improving our theoretical availability for reads. In that scenario, the system would need to deal with the data propagation latency directly, for example, by use of timeouts or client-originated update tracking mechanisms.

Cache 228

Cache Latency Traffic Systems 228

The Netflix TechBlog

AUGUST 22, 2019

Once the instance was available, the engineer would use a remote administration tool like RDP to login to the instance to install software and customize settings. Packer requires specific information for your baking environment and extensive AWS IAM permissions. This means changes can be tracked and reviewed like any other code change.

DevOps 209

DevOps AWS Tuning Infrastructure 209

High Scalability

SEPTEMBER 8, 2018

No, I don’t think that is because AWS is earning a 355x margin on DynamoDB! To meet user-defined goals for performance (request latency) and cost, the monitoring service tracks and adjusts resources to workload changes. Each storage server collects statistics about the requests it serves, the data it stores, etc.

Storage 199

Storage Performance AWS Cloud 199

All Things Distributed

JANUARY 18, 2012

It is very gratifying to see all of our learning and experience become available to our customers in the form of an easy-to-use managed service. Behind the scenes, Amazon DynamoDB automatically spreads the data and traffic for a table over a sufficient number of servers to meet the request capacity specified by the customer.

Scalability 162

Scalability Database Ecommerce Latency 162

All Things Distributed

JANUARY 6, 2016

In November, Amazon Web Services announced that it would launch a new AWS infrastructure region in South Korea. Today, I’m happy to announce that the Asia Pacific (Seoul) Region is now generally available for use by customers worldwide. Many of these enterprises are assisted by our extensive partner ecosystem in Korea.

AWS 99

AWS Cloud Games Latency 99

Dynatrace

MAY 17, 2023

For that, we focused on OpenTelemetry as the underlying technology and showed how you can use the available SDKs and libraries to instrument applications across different languages and platforms. Let’s click “Apache Web Server apache” now. All of which, without the need to access or analyze web server logs.

Metrics 243

Metrics Monitoring Database Network 243

All Things Distributed

MARCH 2, 2011

Expanding the Cloud - Introducing the AWS Asia Pacific (Tokyo) Region. Today Amazon Web Services is expanding its world-wide coverage with the launch of a new AWS Region located in Tokyo, Japan. The advanced Asia Pacific network infrastructure also makes the AWS Tokyo Region a viable low-latency option for customers from South Korea.

AWS 92

AWS Cloud Games Latency 92

The Netflix TechBlog

FEBRUARY 18, 2022

To this end, we developed a Rapid Event Notification System (RENO) to support use cases that require server initiated communication with devices in a scalable and extensible manner. Event Priority Based Clusters AWS Instance Clusters that subscribe to the corresponding queues with the same priority.

Systems 334

Systems Traffic Architecture Mobile 334

VoltDB

MAY 14, 2024

Balancing Low Latency, High Availability and Cloud Choice Cloud hosting is no longer just an option — it’s now, in many cases, the default choice. Let’s look at the top cloud computing use cases, the use cases for which cloud probably isn’t the best route available, and the use cases where a hybrid approach may be best.

Latency 52

Latency Availability Cloud Hardware 52

All Things Distributed

JUNE 7, 2017

Unlocking the value of data is a primary goal that AWS helps our customers to pursue. Some applications may also rely on timely decisions: when maneuvering heavy machinery, an absolute minimum of latency is critical. AWS Greengrass provides the following features: Local execution ofAWS Lambda functions written in Python 2.7

AWS 89

AWS IoT Lambda Storage 89

Dynatrace

JULY 10, 2019

OneAgents are optimized to send data to the Dynatrace servers with the smallest possible impact, querying the metrics every minute, and the data is a first-class citizen for the Dynatrace AI root-cause analysis. Dynatrace provides out-of-the-box support for VMware, AWS, Azure, Pivotal Cloud Foundry, and Kubernetes.

Java 197

Java Best Practices Metrics Azure 197

Dynatrace

SEPTEMBER 30, 2021

Cloud services platforms like AWS, Azure, and GCP are reshaping how organizations deliver value to their customers, making cloud migration an increasingly attractive option for running applications. Improved performance and availability. The third big advantage of cloud migration is performance and availability. Reduced cost.

Cloud 241

Cloud Traffic Best Practices Strategy 241

All Things Distributed

NOVEMBER 15, 2010

This incredible power is available for anyone to use in the usual pay-as-you-go model, removing the investment barrier that has kept many organizations from adopting GPUs for their workloads even though they knew there would be significant performance benefit. The different stages were then load balanced across the available units.

AWS 125

AWS Programming Latency Architecture 125

All Things Distributed

DECEMBER 5, 2010

I am very excited that today we have launched Amazon Route 53, a high-performance and highly-available Domain Name System (DNS) service. Route 53 has the business properties that you have come to expect from an AWS service: fully self-service and programmable, with transparent pay-as-you-go pricing and no minimum usage commitments.

Cloud 112

Cloud Internet Internet AWS 112

The Netflix TechBlog

AUGUST 29, 2023

A brief history of IPC at Netflix Netflix was early to the cloud, particularly for large-scale companies: we began the migration in 2008, and by 2010, Netflix streaming was fully run on AWS. Since there were no existing solutions available, we needed to build them ourselves.

Traffic 224

Traffic Latency Cloud C++ 224

All Things Distributed

MAY 13, 2012

With just one click you can enable content to be distributed to the customer with low latency and high-reliability. The first set of features that CloudFront is launching today include: Multiple Origin Servers: the ability to specify multiple origin servers, including a default origin, for a CloudFront download distribution.

Cache 97

Cache Latency AWS Website 97

The Netflix TechBlog

AUGUST 16, 2023

It means that if each event loop has a connection pool that connects to every origin (our name for backend) server, there would be a multiplication of event loops by servers by Zuul instances. For example, a 16-core box connecting to an 800-server origin would have 12,800 connections.

Traffic 174

Traffic Servers Google Metrics 174

All Things Distributed

OCTOBER 2, 2017

We were pushing the limits of what was a leading commercial database at the time and were unable to sustain the availability, scalability and performance needs that our growing Amazon business demanded. So, we set out to build a fully hosted AWS database service based upon the original Dynamo design.

Internet 110

Internet Internet AWS Performance 110

All Things Distributed

MARCH 11, 2016

The epoch of AWS is the launch of Amazon S3 on March 14, 2006, now almost 10 years ago. Given that AWS is a pioneer in building and operating these services world-wide, these lessons have been of crucial importance to our business. AWS helps its customers do this too. Build security in from the ground up.

AWS 127

AWS Hardware Retail Virtualization 127

All Things Distributed

JULY 13, 2010

Today, I am very proud to be a part of the Amazon Web Services team as we truly make HPC available as an on-demand commodity for every developer to use. Cluster Compute Instances can be grouped as cluster using a "cluster placement group" to indicate that these are instances that require low-latency, high bandwidth communication.

Cloud 98

Cloud AWS Automotive Latency 98

Dynatrace

AUGUST 5, 2019

In this role, I am leading a global team that works closely with our strategic partners such as AWS, Microsoft, Google, Pivotal, Red Hat and others. All available in Dynatrace in the UI or through the API! The following shows one of the slides I use to answer the question: What happens if I move this group of servers?

Cloud 38

Cloud Traffic Database Network 38

The Morning Paper

MARCH 3, 2020

It takes you through the thinking processes and engineering practices behind the design of a key part of the control plane for AWS Elastic Block Storage (EBS): the Physalia database that stores configuration information. For Physalia, and for AWS more generally, the guiding principle is minimise the blast radius. NSDI’20.

Database 106

Database AWS Network Design 106

All Things Distributed

SEPTEMBER 3, 2013

Choosing your database architecture may be the most critical decision you’ll make and has a disproportionate impact on the performance, scalability, and availability of your app. Get it right and your application will seamlessly scale from hundreds to tens of millions of users without difficulty, while remaining performant and available.

Cache 99

Cache Cloud Performance Retail 99

VoltDB

JULY 24, 2024

As part of our new support for ARM processors , we recently ran benchmarks on both Intel C7 and ARM c7g on AWS. Obviously, these numbers are not cast in stone because AWS can change them at any time for any reason, and large AWS customers often have their own pricing agreements. We then shifted to a bigger server.

AWS 52

AWS Benchmarking Hardware Latency 52

Scalegrid

JUNE 7, 2024

It provides durable queues for message persistence and various exchange types for routing logic and supports clustering for high availability and fault tolerance across multiple instances. It plays a critical role by assigning tasks, which trims down the delivery times for web application servers and enhances overall productivity.

IoT 130

IoT Software Architecture Architecture Scalability 130

Percona

NOVEMBER 3, 2023

Rather than listing the concepts, function calls, etc, available in Citus, which frankly is a bit boring, I’m going to explore scaling out a database system starting with a single host. I won’t cover all the features but show just enough that you’ll want to see more of what you can learn to accomplish for yourself.

Database 108

Database Benchmarking Latency C++ 108

The Netflix TechBlog

DECEMBER 17, 2019

In order to be supported, a database is required to fulfill a set of features that are commonly available in systems like MySQL, PostgreSQL, MariaDB, and others. Designed with High Availability in mind. Providing high availability for real-time events. Some of DBLog’s features are: Processes captured log events in-order.

Database 216

Database Traffic Transportation Open Source 216

The Netflix TechBlog

DECEMBER 17, 2019

In order to be supported, a database is required to fulfill a set of features that are commonly available in systems like MySQL, PostgreSQL, MariaDB, and others. Designed with High Availability in mind. Providing high availability for real-time events. High Availability DBLog uses active-passive architecture. Figure 3?—?DBLog

Database 202

Database Traffic Transportation Open Source 202

Speed Curve

FEBRUARY 5, 2024

Server-timing headers are a key tool in understanding what's happening within that black box of Time to First Byte (TTFB). Cue server-timing headers Historically, when looking at page speed, we've had the tendency to ignore TTFB when trying to optimize the user experience. I mean, why wouldn't we?

Servers 64

Servers Cache Benchmarking Retail 64

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. This server is spending about a third of its CPU cycles just checking the time! Checking those available: $ cat /sys/devices/system/clocksource/clocksource0/available_clocksource. 30.14% in the middle of the flame graph.

Speed 103

Speed Java AWS Virtualization 103

Scalegrid

JANUARY 8, 2024

Infrastructure Excellence ScaleGrid’s infrastructure is designed to facilitate hosting in your cloud account and provides cost-saving options with AWS or Azure Reserved Instances or GCP. Another significant trend is the expansion of edge computing in AI cloud computing.

Artificial Intelligence 147

Artificial Intelligence Cloud Scalability Analytics 147

All Things Distributed

JULY 11, 2011

With this change, we will improve the granularity of pricing information you receive by introducing a Spot Instance price per Availability Zone rather than a Spot Instance price per Region. Customers whose bids exceed the Spot price gain access to the available Spot Instances and run as long as the bid exceeds the Spot Price.

AWS 70

AWS Storage Cloud Big Data 70

All Things Distributed

NOVEMBER 21, 2017

Redis's microsecond latency has made it a de facto choice for caching. Four years ago, as part of our AWS fast data journey, we introduced Amazon ElastiCache for Redis , a fully managed, in-memory data store that operates at microsecond latency. However, the slots must be moved manually on the server side.

Games 96

Games Retail Latency Education 96

Scalegrid

JANUARY 12, 2024

All rely heavily on utilizing allocated portions from existing pools made available through specific providers as part of their service offerings. These include popular technologies such as web servers and web applications, along with advanced solutions like distributed data stores and containerized microservices.

Cloud 130

Cloud Virtualization Storage Efficiency 130