All Things Distributed

JANUARY 23, 2012

Werner Vogels weblog on building scalable and robust distributed systems. Expanding the Cloud - The AWS Storage Gateway. Today Amazon Web Services has launched the AWS Storage Gateway, making the power of secure and reliable cloud storage accessible from customersâ?? Once the AWS Storage Gatewayâ??s Comments ().

Storage 115

Storage AWS Virtualization Cloud 115

All Things Distributed

MARCH 2, 2011

Werner Vogels weblog on building scalable and robust distributed systems. Expanding the Cloud - Introducing the AWS Asia Pacific (Tokyo) Region. Today Amazon Web Services is expanding its world-wide coverage with the launch of a new AWS Region located in Tokyo, Japan. For more details on AWS in Japan see [link].

AWS 112

AWS Cloud Games Latency 112

Dynatrace

SEPTEMBER 30, 2021

Cloud services platforms like AWS, Azure, and GCP are reshaping how organizations deliver value to their customers, making cloud migration an increasingly attractive option for running applications. Increased scalability. This can dramatically decrease network latency and its effect on the end-user experience. Reduced cost.

Cloud 165

Cloud Traffic Best Practices Strategy 165

All Things Distributed

AUGUST 16, 2011

Werner Vogels weblog on building scalable and robust distributed systems. Expanding the Cloud - The AWS GovCloud (US) Region. Today AWS announced the launch of the AWS GovCloud (US) Region. The concept of regions gives AWS customers control over the placement of their resources and services. All Things Distributed.

AWS 111

AWS Government Big Data Cloud 111

Dotcom-Montior

NOVEMBER 11, 2020

Well, to start, serverless, or serverless computing , doesn’t really mean there aren’t servers involved, because there are, rather it refers to the fact that the responsibility of having to manage, scale, provision, maintain, etc., Scalability. Benefits of a Serverless Model. Response Times. Security & Privacy.

Serverless 57

Serverless Monitoring Lambda Latency 57

All Things Distributed

NOVEMBER 26, 2013

As I discussed in my re:Invent keynote earlier this month, I am now happy to announce the immediate availability of Amazon RDS Cross Region Read Replicas , which is another important enhancement for our customers using or planning to use multiple AWS Regions to deploy their applications. Cross Region Read Replicas are available for MySQL 5.6

Cloud 145

Cloud AWS Traffic Latency 145

ScaleOut Software

APRIL 6, 2021

Because it runs on a scalable, highly available in-memory computing platform, it can do all this simultaneously for hundreds of thousands or even millions of data sources. Message are delivered to the grid using messaging hubs, such as Azure IoT Hub, AWS IoT Core, Kafka, a built-in REST service, or directly using APIs.

IoT 52

IoT Azure Analytics Healthcare 52

All Things Distributed

DECEMBER 3, 2009

Werner Vogels weblog on building scalable and robust distributed systems. Expanding the Cloud - New AWS Region: US-West (Northern California). We have expanded the AWS footprint in the US and starting today a new AWS Region is available for use: US-West (Northern California). Driving Storage Costs Down for AWS Customers.

AWS 60

AWS Cloud Latency Storage 60

All Things Distributed

APRIL 28, 2010

Werner Vogels weblog on building scalable and robust distributed systems. Expanding the Cloud - Opening the AWS Asia Pacific (Singapore) Region. Today Amazon Web Services has taken another important step in serving customers worldwide: the AWS Asia Pacific (Singapore) Region is now launched. All Things Distributed. Comments ().

AWS 61

AWS Cloud Latency Storage 61

All Things Distributed

DECEMBER 5, 2010

Werner Vogels weblog on building scalable and robust distributed systems. Route 53 has the business properties that you have come to expect from an AWS service: fully self-service and programmable, with transparent pay-as-you-go pricing and no minimum usage commitments. Authoritative servers hold the definitive mappings.

Cloud 117

Cloud Internet Internet AWS 117

All Things Distributed

SEPTEMBER 25, 2012

Werner Vogels weblog on building scalable and robust distributed systems. As with all AWS services, if you are in doubt about whether your application can benefit from Provisioned IOPS, it is very easy to try it out and decide for yourself, as there are no upfront costs. Expanding the Cloud â?? Provisioned IOPS for Amazon RDS.

Cloud 117

Cloud AWS Storage Database 117

All Things Distributed

JULY 13, 2010

Werner Vogels weblog on building scalable and robust distributed systems. In particular this has been true for applications based on algorithms - often MPI-based - that depend on frequent low-latency communication and/or require significant cross sectional bandwidth. Driving Storage Costs Down for AWS Customers. Comments ().

Cloud 118

Cloud AWS Automotive Latency 118

cdemi

DECEMBER 4, 2016

Maximizing Scalability : Number of Queues and Services can be varied to meet Demand. Message Brokers are servers that take care of Queue Handling , Routing Messages, High Availability and Scaling out. Apache Kafka - High-Throughput, Low-Latency, Uses Apache ZooKeeper for Distribution, Written in Scala and Java. Message Brokers.

Design 47

Design Azure Scalability Latency 47

All Things Distributed

JULY 11, 2011

Werner Vogels weblog on building scalable and robust distributed systems. As a part of that process, we also realized that there were a number of latency sensitive or location specific use cases like Hadoop, HPC, and testing that would be ideal for Spot. Driving Storage Costs Down for AWS Customers. All Things Distributed.

AWS 85

AWS Storage Cloud Big Data 85

All Things Distributed

NOVEMBER 19, 2010

Werner Vogels weblog on building scalable and robust distributed systems. Understanding Throughput-Oriented Architectures - background article in CACM on massively parallel and throughput vs latency oriented architectures. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway.

AWS 67

AWS Cloud Benchmarking Storage 67

Percona

JULY 1, 2023

Now that Database-as-a-service (DBaaS) is in high demand, there are multiple questions regarding AWS services that cannot always be answered easily: When should I use Aurora and when should I use RDS MySQL ? These may be performance, high availability, operational cost, management, capacity planning, scalability, security, monitoring, etc.

AWS 52

AWS Database Serverless Storage 52

High Scalability

DECEMBER 21, 2018

It's HighScalability time: Have a very scalable Xmas everyone! 2) Cloud will decentralise in terms of provision not power i.e. Amazon will "invade" more of those holdouts with AWS Outpost. Tim Bray : How to talk about [Serverless Latency] · To start with, don’t just say “I need 120ms.” Don't be late.

Internet 137

Internet Internet Scalability Serverless 137

All Things Distributed

APRIL 4, 2017

Today, I am very excited to announce our plans to open a new AWS Region in the Nordics! The new region will give Nordic-based businesses, government organisations, non-profits, and global companies with customers in the Nordics, the ability to leverage the AWS technology infrastructure from data centers in Sweden.

AWS 116

AWS Airlines Latency Games 116

High Scalability

JULY 20, 2018

It also works well to justify an acquisition of more servers to investors. During our testing using the storage optimized EC2 instances (I3.2xlarge) we noticed that we were able to perform over 200K IOPS of 1K byte items thus meeting our throughput goals with latency rarely exceeding 1 millisecond. They never question this belief.

Internet 121

Internet Internet Scalability Automotive 121

Dynatrace

MAY 17, 2023

Think about items such as general system metrics (for example, CPU utilization, free memory, number of services), the connectivity status, details of our web server, or even more granular in-application tasks like database queries. Let’s click “Apache Web Server apache” now.

Metrics 171

Metrics Monitoring Database Network 171

The Netflix TechBlog

NOVEMBER 3, 2022

In that scenario, the system would need to deal with the data propagation latency directly, for example, by use of timeouts or client-originated update tracking mechanisms. We started seeing increased response latencies and leader servers running at dangerously high utilization.

Cache 224

Cache Latency Traffic Systems 224

Scalegrid

JANUARY 12, 2024

These include popular technologies such as web servers and web applications, along with advanced solutions like distributed data stores and containerized microservices. Strategic allocation of these resources plays a crucial role in achieving scalability, cost savings, improved performance, and staying ahead of advancements in the field.

Cloud 130

Cloud Virtualization Storage Efficiency 130

All Things Distributed

JANUARY 18, 2012

Werner Vogels weblog on building scalable and robust distributed systems. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. The original Dynamo design was based on a core set of strong distributed systems principles resulting in an ultra-scalable and highly reliable database system.

Scalability 167

Scalability Database Ecommerce Latency 167

Smashing Magazine

AUGUST 3, 2023

Time To First Byte (TTFB) This is the time it takes for the first piece of information from the server to reach the user’s browser. You need to beware that slow server response times can significantly increase TTFB, often due to server overload, network issues, or un-optimized logic on the server side.

Performance 74

Performance Cache Traffic Metrics 74

The Netflix TechBlog

AUGUST 16, 2023

It means that if each event loop has a connection pool that connects to every origin (our name for backend) server, there would be a multiplication of event loops by servers by Zuul instances. For example, a 16-core box connecting to an 800-server origin would have 12,800 connections.

Traffic 170

Traffic Servers Google Metrics 170

The Netflix TechBlog

FEBRUARY 18, 2022

To this end, we developed a Rapid Event Notification System (RENO) to support use cases that require server initiated communication with devices in a scalable and extensible manner. Event Priority Based Clusters AWS Instance Clusters that subscribe to the corresponding queues with the same priority.

Systems 334

Systems Traffic Architecture Mobile 334

The Morning Paper

FEBRUARY 6, 2020

The key ingredients of Cloudburst are a highly-scalable key-value store for persistent state ( Anna ), local caches co-located with function execution environments, and cache-consistency protocols to preserve developer sanity while data is moved in and out of those caches. Updates should be allowed at any function invocation site.

Lambda 98

Lambda Serverless Cache Latency 98

Percona

MAY 2, 2023

During the logical backups, using client API, the data gets read from the server and returned back to the same API, which will be serialized and written into respective “ bson”, “ json” or “ csv” backup files on disk depending upon the type of backup utilities used.

Best Practices 52

Best Practices Database Storage Servers 52

All Things Distributed

MARCH 11, 2016

The epoch of AWS is the launch of Amazon S3 on March 14, 2006, now almost 10 years ago. Looking back over the past 10 years, there are hundreds of lessons that we’ve learned about building and operating services that need to be secure, reliable, scalable, with predictable performance at the lowest possible cost. APIs are forever.

AWS 144

AWS Hardware Retail Virtualization 144

All Things Distributed

SEPTEMBER 3, 2013

As we prepared to launch these features, I was struck not only by the range of services we provide to enable customers to run fully managed, scalable, high performance database workloads, including Amazon RDS , Amazon DynamoDB , Amazon Redshift and Amazon ElastiCache , but also by the pace at which these services are evolving and improving.

Cache 129

Cache Cloud Performance Retail 129

All Things Distributed

OCTOBER 2, 2017

We were pushing the limits of what was a leading commercial database at the time and were unable to sustain the availability, scalability and performance needs that our growing Amazon business demanded. So, we set out to build a fully hosted AWS database service based upon the original Dynamo design.

Internet 128

Internet Internet AWS Performance 128

The Morning Paper

JUNE 23, 2019

Coupled with stateless application servers to execute business logic and a database-like system to provide persistent storage, they form a core component of popular data center service archictectures. session state that you want to survive an application process crash), and to keep the application server/services layer stateless.

Cache 79

Cache Latency Google Lambda 79

All Things Distributed

MAY 13, 2012

Werner Vogels weblog on building scalable and robust distributed systems. With just one click you can enable content to be distributed to the customer with low latency and high-reliability. This is useful when customers want to use different origin servers for different types of content. All Things Distributed. Comments ().

Cache 117

Cache Latency AWS Website 117

High Scalability

SEPTEMBER 8, 2018

No, I don’t think that is because AWS is earning a 355x margin on DynamoDB! To meet user-defined goals for performance (request latency) and cost, the monitoring service tracks and adjusts resources to workload changes. Each storage server collects statistics about the requests it serves, the data it stores, etc.

Storage 199

Storage Performance AWS Efficiency 199

Smashing Magazine

AUGUST 20, 2021

Yet, for all these technological developments, it’s interesting that many of us are still serving sites in the same way Tim did with the very first website — a web server serving static website files. Throughout the web’s history, static websites have always been a popular option due to their simplicity, scalability, and security.

Ecommerce 139

Ecommerce Website Government Internet 139

All Things Distributed

NOVEMBER 21, 2017

Redis's microsecond latency has made it a de facto choice for caching. Four years ago, as part of our AWS fast data journey, we introduced Amazon ElastiCache for Redis , a fully managed, in-memory data store that operates at microsecond latency. However, the slots must be moved manually on the server side.

Games 112

Games Retail Latency Education 112

All Things Distributed

NOVEMBER 15, 2010

Werner Vogels weblog on building scalable and robust distributed systems. For example, the most fundamental abstraction trade-off has always been latency versus throughput. The throughput of this pipeline is more important than the latency of the individual operations. Also more details can be found on the AWS Developer blog.

AWS 136

AWS Latency Programming Architecture 136