All Things Distributed

NOVEMBER 13, 2018

Today, I am happy to announce our plans to open a new AWS Region in Italy! The AWS Europe (Milan) Region is the 25th AWS Region that we've announced globally. It's the sixth AWS Region in Europe, joining existing regions in France, Germany, Ireland, the UK, and the new Region that we recently announced in Sweden.

AWS 167

AWS Energy Automotive Traffic 167

Scalegrid

MARCH 14, 2024

This approach allows companies to combine the security and control of private clouds with public clouds’ scalability and innovation potential. Understanding Hybrid Cloud Strategy A hybrid cloud merges the capabilities of public and private clouds into a singular, coherent system. A hybrid cloud strategy could be your answer.

Strategy 130

Strategy Cloud Artificial Intelligence Infrastructure 130

High Scalability

DECEMBER 21, 2018

It's HighScalability time: Have a very scalable Xmas everyone! 2) Cloud will decentralise in terms of provision not power i.e. Amazon will "invade" more of those holdouts with AWS Outpost. odrotbohm : I’ve seen microservice based systems more deranged after 2 years than any 1,5 decades old monolith could ever have been.

Internet 137

Internet Internet Scalability Serverless 137

Scalegrid

JANUARY 8, 2024

This article delves into the specifics of how AI optimizes cloud efficiency, ensures scalability, and reinforces security, providing a glimpse at its transformative role without giving away extensive details. AI models integrated into cloud systems offer flexibility, enable agile methodologies, and ensure secure systems.

Artificial Intelligence 147

Artificial Intelligence Cloud Scalability Analytics 147

High Scalability

FEBRUARY 19, 2021

This means a system that is not merely available but is also engineered with extensive redundant measures to continue to work as its users expect. Fault tolerance The ability of a system to continue to be dependable (both available and reliable) in the presence of certain component or subsystem failures.

Engineering 215

Engineering Systems Scalability Availability 215

All Things Distributed

JUNE 20, 2017

Today, I am very excited to announce our plans to open a new AWS Region in Hong Kong! The new region will give Hong Kong-based businesses, government organizations, non-profits, and global companies with customers in Hong Kong, the ability to leverage AWS technologies from data centers in Hong Kong.

AWS 149

AWS Logistics Cloud Social Media 149

High Scalability

JULY 20, 2018

The third wing of the architecture piece is the “domain specific system-on-chip.” tef : You can use a message broker to glue systems together, but never use one to cut systems apart. CompSciFact : 'Fancy algorithms are slow when n is small, and n is usually small.' -- Rob Pike. There are a few more quotes.

Internet 121

Internet Internet Scalability Automotive 121

High Scalability

AUGUST 17, 2018

coryodaniel : Rewrote an #AWS APIGateway & #lambda service that was costing us about $16000 / month in #elixir. 12 million requests / hour with sub-second latency, ~300GB of throughput / day. and others) you don’t know distributed systems.” Its running in 3 nodes that cost us about $150 / month. myelixirstatus !#Serverless.No

Internet 105

Internet Internet Scalability Games 105

Percona

JULY 1, 2023

Now that Database-as-a-service (DBaaS) is in high demand, there are multiple questions regarding AWS services that cannot always be answered easily: When should I use Aurora and when should I use RDS MySQL ? These may be performance, high availability, operational cost, management, capacity planning, scalability, security, monitoring, etc.

AWS 52

AWS Database Serverless Storage 52

The Netflix TechBlog

OCTOBER 19, 2020

which is difficult when troubleshooting distributed systems. If we had an ID for each streaming session then distributed tracing could easily reconstruct session failure by providing service topology, retry and error tags, and latency measurements for all service calls.

Infrastructure 233

Infrastructure Transportation Storage Open Source 233

Scalegrid

JANUARY 12, 2024

Simply put, it’s the set of computational tasks that cloud systems perform, such as hosting databases, enabling collaboration tools, or running compute-intensive algorithms. Such demanding use cases place a great value on systems capable of fast and reliable execution, a need that spans across various industry segments.

Cloud 130

Cloud Virtualization Storage Efficiency 130

All Things Distributed

NOVEMBER 13, 2014

When AWS launched, it changed how developers thought about IT services: What used to take weeks or months of purchasing and provisioning turned into minutes with Amazon EC2. Our answer is a new compute service called AWS Lambda. You can go from code to service in three clicks and then let AWS Lambda take care of the rest.

Lambda 136

Lambda AWS Cloud Scalability 136

Dynatrace

OCTOBER 1, 2021

As dynamic systems architectures increase in complexity and scale, IT teams face mounting pressure to track and respond to conditions and issues across their multi-cloud environments. How do you make a system observable? Dynatrace news. But what is observability? Why is it important, and what can it actually help organizations achieve?

Metrics 363

Metrics Open Source Monitoring Infrastructure 363

Dynatrace

MAY 17, 2023

Think about items such as general system metrics (for example, CPU utilization, free memory, number of services), the connectivity status, details of our web server, or even more granular in-application tasks like database queries. DNS query time indicates the average response times of DNS requests across the system.

Metrics 175

Metrics Monitoring Database Network 175

Adrian Cockcroft

JANUARY 20, 2023

on Myths and Legends of High Performance Computing  — it’s a somewhat light-hearted look at some of the same issues by the leader of the team that built the Fugaku system I mention below. HPCG is led by Japan’s RIKEN Fugaku system at 16 petaflops, which is 3% of it’s peak capacity. Next generation architectures will use CXL3.0

Architecture 52

Architecture Latency Benchmarking AWS 52

The Morning Paper

FEBRUARY 6, 2020

The key ingredients of Cloudburst are a highly-scalable key-value store for persistent state ( Anna ), local caches co-located with function execution environments, and cache-consistency protocols to preserve developer sanity while data is moved in and out of those caches. Updates should be allowed at any function invocation site.

Lambda 98

Lambda Serverless Cache Latency 98

All Things Distributed

JANUARY 23, 2012

Werner Vogels weblog on building scalable and robust distributed systems. Expanding the Cloud - The AWS Storage Gateway. Today Amazon Web Services has launched the AWS Storage Gateway, making the power of secure and reliable cloud storage accessible from customersâ?? Once the AWS Storage Gatewayâ??s Comments ().

Storage 116

Storage AWS Virtualization Cloud 116

All Things Distributed

DECEMBER 14, 2011

Werner Vogels weblog on building scalable and robust distributed systems. Introducing the AWS South America (Sao Paulo) Region. Today, Amazon Web Services is expanding its worldwide coverage with the launch of a new AWS Region in Sao Paulo, Brazil. RAMA , a Brazilian financial services firm and AWS customer : â??The

AWS 115

AWS Latency Storage Big Data 115

All Things Distributed

MARCH 2, 2011

Werner Vogels weblog on building scalable and robust distributed systems. Expanding the Cloud - Introducing the AWS Asia Pacific (Tokyo) Region. Today Amazon Web Services is expanding its world-wide coverage with the launch of a new AWS Region located in Tokyo, Japan. For more details on AWS in Japan see [link].

AWS 114

AWS Cloud Games Latency 114

The Netflix TechBlog

NOVEMBER 22, 2019

by Shefali Vyas Dalal AWS re:Invent is a couple weeks away and our engineers & leaders are thrilled to be in attendance yet again this year! To sustain this data growth at Netflix, it has deployed open-source software Ceph using AWS services to achieve the required SLOs of some of the post-production workflows.

AWS 37

AWS Entertainment Open Source Benchmarking 37

Dynatrace

SEPTEMBER 30, 2021

Cloud services platforms like AWS, Azure, and GCP are reshaping how organizations deliver value to their customers, making cloud migration an increasingly attractive option for running applications. Increased scalability. This can dramatically decrease network latency and its effect on the end-user experience. Reduced cost.

Cloud 169

Cloud Traffic Best Practices Strategy 169

High Scalability

SEPTEMBER 8, 2018

No, I don’t think that is because AWS is earning a 355x margin on DynamoDB! The issue is that Anna is now orders of magnitude more efficient than competing systems, in addition to being orders of magnitude faster. Just to throw out some numbers, we measured Anna providing 355x the performance of DynamoDB for the dollar.

Storage 199

Storage Performance AWS Efficiency 199

All Things Distributed

AUGUST 16, 2011

Werner Vogels weblog on building scalable and robust distributed systems. Expanding the Cloud - The AWS GovCloud (US) Region. Today AWS announced the launch of the AWS GovCloud (US) Region. The concept of regions gives AWS customers control over the placement of their resources and services. Comments ().

AWS 113

AWS Government Big Data Cloud 113

All Things Distributed

APRIL 17, 2013

Werner Vogels weblog on building scalable and robust distributed systems. While DynamoDB already allows you to perform low-latency queries based on your tableâ??s This gives you the ability to perform richer queries while still meeting the low-latency demands of responsive, scalable applications. Comments ().

Cloud 116

Cloud Latency Games Scalability 116

All Things Distributed

SEPTEMBER 25, 2017

Today, I am excited to announce plans for Amazon Web Services (AWS) to bring an infrastructure Region to the Middle East! This move is another milestone in our global expansion and mission to bring flexible, scalable, and secure cloud computing infrastructure to organizations around the world.

Cloud 154

Cloud Education Energy Government 154

All Things Distributed

FEBRUARY 22, 2012

Werner Vogels weblog on building scalable and robust distributed systems. Today AWS launched an exciting new service for developers: the Amazon Simple Workflow Service. Amazon SWF is an orchestration service for building scalable distributed applications. As always The AWS developer blog has additional details.

Cloud 130

Cloud AWS Java Scalability 130

All Things Distributed

NOVEMBER 12, 2012

Werner Vogels weblog on building scalable and robust distributed systems. Today, Amazon Web Services has greater worldwide coverage with the launch of a new AWS Region in Sydney, Australia. Many young businesses as well as established enterprises are already using AWS, many of them targeting customers globally.

Cloud 118

Cloud AWS Ecommerce Latency 118

ScaleOut Software

APRIL 6, 2021

Because it runs on a scalable, highly available in-memory computing platform, it can do all this simultaneously for hundreds of thousands or even millions of data sources. Message are delivered to the grid using messaging hubs, such as Azure IoT Hub, AWS IoT Core, Kafka, a built-in REST service, or directly using APIs.

IoT 52

IoT Azure Analytics Healthcare 52

The Morning Paper

AUGUST 29, 2019

If you’re moving an OLAP workload to the cloud (AWS in the context of this paper), what DBMS setup should you go with? We focused on OLAP-oriented parallel data warehouse products available for AWS and restricted our attention to commercially available systems. Choosing a cloud DBMS: architectures and tradeoffs Tan et al.,

Architecture 76

Architecture Cloud Storage Serverless 76

Dotcom-Montior

NOVEMBER 11, 2020

those resources now belong to cloud providers, such as AWS Lambda, Google Cloud Platform, Microsoft Azure, and others. Scalability. Developers don’t have to put in additional time to fine-tuning the system, or rely on other teams for support, as it’s done automatically with the cloud provider. Security & Privacy.

Serverless 57

Serverless Monitoring Lambda Latency 57

All Things Distributed

NOVEMBER 26, 2013

As I discussed in my re:Invent keynote earlier this month, I am now happy to announce the immediate availability of Amazon RDS Cross Region Read Replicas , which is another important enhancement for our customers using or planning to use multiple AWS Regions to deploy their applications. Cross Region Read Replicas are available for MySQL 5.6

Cloud 147

Cloud AWS Traffic Latency 147

All Things Distributed

DECEMBER 3, 2009

Werner Vogels weblog on building scalable and robust distributed systems. Expanding the Cloud - New AWS Region: US-West (Northern California). We have expanded the AWS footprint in the US and starting today a new AWS Region is available for use: US-West (Northern California). Countdown to What is Next in AWS.

AWS 60

AWS Cloud Latency Storage 60

The Morning Paper

JUNE 23, 2019

Coupled with stateless application servers to execute business logic and a database-like system to provide persistent storage, they form a core component of popular data center service archictectures. Why are developers using RInK systems as part of their design? We’ve seen similar high marshalling overheads in big data systems too.)

Cache 79

Cache Latency Google Lambda 79

All Things Distributed

APRIL 28, 2010

Werner Vogels weblog on building scalable and robust distributed systems. Expanding the Cloud - Opening the AWS Asia Pacific (Singapore) Region. Today Amazon Web Services has taken another important step in serving customers worldwide: the AWS Asia Pacific (Singapore) Region is now launched. All Things Distributed.

AWS 61

AWS Cloud Latency Storage 61

Smashing Magazine

AUGUST 3, 2023

We realized that we needed to consider a more global and scalable solution to better serve our global audience. This proximity significantly reduces the time it takes for the data to travel from the server to the user, thus reducing latency and improving load times. The following sections will discuss how we navigated these hurdles.

Performance 74

Performance Cache Traffic Metrics 74

All Things Distributed

MARCH 11, 2013

Werner Vogels weblog on building scalable and robust distributed systems. I spent a lot of time talking to AWS developers, many working in the gaming and mobile space, and most of them have been finding Node.js allows these developers to handle a large number of concurrent connections with low latencies. Comments ().

AWS 105

AWS Mobile Games Java 105

All Things Distributed

DECEMBER 5, 2010

Werner Vogels weblog on building scalable and robust distributed systems. I am very excited that today we have launched Amazon Route 53, a high-performance and highly-available Domain Name System (DNS) service. Naming is one of the fundamental concepts in Distributed Systems. By Werner Vogels on 05 December 2010 02:00 PM.

Cloud 117

Cloud Internet Internet AWS 117