All Things Distributed

JUNE 20, 2017

Today, I am very excited to announce our plans to open a new AWS Region in Hong Kong! The new region will give Hong Kong-based businesses, government organizations, non-profits, and global companies with customers in Hong Kong, the ability to leverage AWS technologies from data centers in Hong Kong.

AWS 146

AWS Logistics Cloud Social Media 146

The Morning Paper

FEBRUARY 6, 2020

Last week we looked at a function shipping solution to the problem; Cloudburst uses the more common data shipping to bring data to caches next to function runtimes (though you could also make a case that the scheduling algorithm placing function execution in locations where the data is cached a flavour of function-shipping too).

Lambda 98

Lambda Serverless Cache Latency 98

All Things Distributed

SEPTEMBER 3, 2013

As we prepared to launch these features, I was struck not only by the range of services we provide to enable customers to run fully managed, scalable, high performance database workloads, including Amazon RDS , Amazon DynamoDB , Amazon Redshift and Amazon ElastiCache , but also by the pace at which these services are evolving and improving.

Cache 129

Cache Cloud Performance Retail 129

All Things Distributed

JANUARY 18, 2012

Werner Vogels weblog on building scalable and robust distributed systems. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. The original Dynamo design was based on a core set of strong distributed systems principles resulting in an ultra-scalable and highly reliable database system.

Scalability 167

Scalability Database Ecommerce Latency 167

All Things Distributed

JUNE 21, 2017

Today, I'm excited to announce the general availability of Amazon DynamoDB Accelerator (DAX) , a fully managed, highly available, in-memory cache that can speed up DynamoDB response times from milliseconds to microseconds, even at millions of requests per second. DynamoDB was the first service at AWS to use SSD storage.

Speed 121

Speed Cache Latency AWS 121

All Things Distributed

MARCH 5, 2012

Werner Vogels weblog on building scalable and robust distributed systems. Driving Compute Cost Down for AWS Customers. AWS today announced a substantial price drop from March 1, 2012 for many of the Amazon EC2, Amazon RDS, and Amazon ElastiCache instances types around the world. All Things Distributed. Comments ().

AWS 110

AWS Innovation Scalability Cache 110

All Things Distributed

OCTOBER 2, 2017

We were pushing the limits of what was a leading commercial database at the time and were unable to sustain the availability, scalability and performance needs that our growing Amazon business demanded. So, we set out to build a fully hosted AWS database service based upon the original Dynamo design.

Internet 128

Internet Internet AWS Performance 128

All Things Distributed

JULY 14, 2015

In this blog post, I will explain how these three new capabilities empower you to build applications with distributed systems architecture and create responsive, reliable, and high-performance applications using DynamoDB that work at any scale. DynamoDB Streams simplifies and improves this design pattern with a distributed systems approach.

Database 167

Database Lambda AWS IoT 167

All Things Distributed

AUGUST 22, 2011

Werner Vogels weblog on building scalable and robust distributed systems. Today AWS has launched Amazon ElastiCache , a new service that makes it easy to add distributed in-memory caching to any application. A Cache Cluster, which is a set of collaborating Cache Nodes, can be started in minutes. Comments ().

Cloud 117

Cloud Cache AWS Storage 117

The Morning Paper

AUGUST 29, 2019

If you’re moving an OLAP workload to the cloud (AWS in the context of this paper), what DBMS setup should you go with? We focused on OLAP-oriented parallel data warehouse products available for AWS and restricted our attention to commercially available systems. Choosing a cloud DBMS: architectures and tradeoffs Tan et al.,

Architecture 76

Architecture Cloud Storage Serverless 76

Smashing Magazine

AUGUST 3, 2023

We realized that we needed to consider a more global and scalable solution to better serve our global audience. It also opens up the possibility for more effective use of caching strategies, potentially enhancing load times further. These edge servers are distributed in data centers across the globe.

Performance 74

Performance Cache Traffic Metrics 74

HammerDB

APRIL 19, 2023

Therefore, before we attempt to measure our database performance, we should know the system or cloud instance to be tested in detail. For example, if you are buying the latest Amazon memory-optimized EC2 instance (R7iz), the AWS page ( [link] ) tells us the following: Up to 3.9 Operating System: Ubuntu 22.04

Performance 54

Performance Benchmarking Cache Storage 54

All Things Distributed

DECEMBER 18, 2012

Werner Vogels weblog on building scalable and robust distributed systems. After the AWS re: Invent conference I spent two weeks in Europe for the last customer visits of the year. Although there are still a few very exciting AWS news updates to happen this year. Bar-Yam, Journal of Systems Science and Complexity.

Operating System 144

Operating System Cache AWS Scalability 144

IO River

NOVEMBER 2, 2023

It’s not just limited to cloud resources like AWS and Azure; Terraform is versatile, extending its capabilities to key performance areas like Content Delivery Network (CDN) management, ensuring efficient content delivery and optimal user experience.‍Started ‍AutomationCode-based systems also shine in automation.

Open Source 52

Open Source DevOps AWS Azure 52

The Morning Paper

JUNE 23, 2019

Coupled with stateless application servers to execute business logic and a database-like system to provide persistent storage, they form a core component of popular data center service archictectures. Why are developers using RInK systems as part of their design? We’ve seen similar high marshalling overheads in big data systems too.)

Cache 79

Cache Latency Google Lambda 79

Adrian Cockcroft

JANUARY 20, 2023

on Myths and Legends of High Performance Computing  — it’s a somewhat light-hearted look at some of the same issues by the leader of the team that built the Fugaku system I mention below. HPCG is led by Japan’s RIKEN Fugaku system at 16 petaflops, which is 3% of it’s peak capacity. Next generation architectures will use CXL3.0

Architecture 52

Architecture Latency Benchmarking AWS 52

All Things Distributed

DECEMBER 5, 2010

Werner Vogels weblog on building scalable and robust distributed systems. I am very excited that today we have launched Amazon Route 53, a high-performance and highly-available Domain Name System (DNS) service. Naming is one of the fundamental concepts in Distributed Systems. By Werner Vogels on 05 December 2010 02:00 PM.

Cloud 117

Cloud Internet Internet AWS 117

IO River

NOVEMBER 2, 2023

In fact, Amazon Web Services (AWS) paved the way with its service, CloudFormation, which introduced the concept of Infrastructure as Code (IaC). Taking inspiration from AWS's CloudFormation, HashiCorp introduced Terraform with a broader vision. This level of granularity is not found in UI-managed systems.

Open Source 40

Open Source DevOps AWS Azure 40

Smashing Magazine

JUNE 25, 2020

Today, we’ll address storing and serving files for both single-server and scalable deployments while considering factors like compression, caching, and availability. However, its tooling for handling static assets and media files is not, in my opinion, well-suited for production on scalable sites.

Media 69

Media Cache Storage AWS 69

All Things Distributed

SEPTEMBER 21, 2012

Werner Vogels weblog on building scalable and robust distributed systems. I was in Los Angeles this week for the Digital Media on AWS Summit and to visit many of the studios and production houses that are using AWS for production and post-production work. All the hard work is being done by them on AWS.

AWS 75

AWS Media Cache Operating System 75

All Things Distributed

SEPTEMBER 28, 2012

Werner Vogels weblog on building scalable and robust distributed systems. I am in India for the AWS Summits in Mumbai, Chennai and Bangalore (next week). In 2000 an improvement on the original Bloom filters called Counting Bloom Filters was published as part of the Summary Cache protocol. All Things Distributed.

Cache 84

Cache AWS Scalability Network 84

All Things Distributed

MAY 13, 2012

Werner Vogels weblog on building scalable and robust distributed systems. Of course non-AWS origins are also permitted. Query String based Caching: the ability to include query string parameters as part of the objects cache key. Each URL path pattern will include a set of cache behaviors associated with it.

Cache 117

Cache Latency AWS Website 117

All Things Distributed

NOVEMBER 26, 2013

As I discussed in my re:Invent keynote earlier this month, I am now happy to announce the immediate availability of Amazon RDS Cross Region Read Replicas , which is another important enhancement for our customers using or planning to use multiple AWS Regions to deploy their applications. Cross Region Read Replicas are available for MySQL 5.6

Cloud 145

Cloud AWS Traffic Latency 145

High Scalability

NOVEMBER 25, 2019

He and his colleagues spend their productive hours scaling large distributed file systems. Egnyte is a secure Content Collaboration and Data Governance platform, founded in 2007 when Google drive wasn't born and AWS S3 was cost-prohibitive. Edge caching. Nginx for disk based caching. You can reach him at @kpatelwork.

Architecture 52

Architecture Cache Azure Storage 52

All Things Distributed

APRIL 27, 2011

Werner Vogels weblog on building scalable and robust distributed systems. And while many of our systems are based on the latest in computer science research, this often hasnt been sufficient: our architects and engineers have had to advance research in directions that no academic had yet taken. All Things Distributed.

Technology 151

Technology Technology AWS Storage 151

The Morning Paper

JUNE 16, 2019

Specifically, scalable, parallel streaming dataflow computing systems now support partially-stateful and dynamically-changing dataflows. The amount of computation required on a base update can be reduced by sharing computation and cached data between universes. Recent research has provided this missing key primitive.

Database 90

Database Cache Benchmarking Efficiency 90

Percona

MAY 2, 2023

As a MongoDB user, it’s crucial to ensure that your data is safe and secure in the event of a disaster or system failure. Regular database backups are essential to protect against data loss caused by system failures, human errors, natural disasters, or cyber-attacks. Why are MongoDB database backups important?

Best Practices 52

Best Practices Database Storage Servers 52

All Things Distributed

AUGUST 17, 2011

Werner Vogels weblog on building scalable and robust distributed systems. If you have a largely static site you can rely on the enormous power of S3 to make serving your content highly scalable and storing it extremely durable. My templates and blog posts are now located in DropBox and thus locally cached at each machine I use.

Servers 126

Servers Social Media AWS Website 126

Smashing Magazine

AUGUST 20, 2021

Throughout the web’s history, static websites have always been a popular option due to their simplicity, scalability, and security. During the 90s, we saw two content management systems for static sites — Microsoft FrontPage in 1996 and Macromedia Dreamweaver in 1997. The site will load in a snap. Large preview ).

Ecommerce 139

Ecommerce Website Government Internet 139

All Things Distributed

NOVEMBER 21, 2017

Redis's microsecond latency has made it a de facto choice for caching. Four years ago, as part of our AWS fast data journey, we introduced Amazon ElastiCache for Redis , a fully managed, in-memory data store that operates at microsecond latency. The system is more robust. TB of in-memory capacity in a single cluster.

Games 112

Games Retail Latency Education 112

The Netflix TechBlog

DECEMBER 17, 2019

In order to be supported, a database is required to fulfill a set of features that are commonly available in systems like MySQL, PostgreSQL, MariaDB, and others. There are services at Netflix that use RDBMS kind of databases such as MySQL or PostgreSQL via AWS RDS. Some of DBLog’s features are: Processes captured log events in-order.

Database 197

Database Traffic Transportation Open Source 197

The Netflix TechBlog

DECEMBER 17, 2019

In order to be supported, a database is required to fulfill a set of features that are commonly available in systems like MySQL, PostgreSQL, MariaDB, and others. There are services at Netflix that use RDBMS kind of databases such as MySQL or PostgreSQL via AWS RDS. Some of DBLog’s features are: Processes captured log events in-order.

Database 212

Database Traffic Transportation Open Source 212

Smashing Magazine

JANUARY 11, 2021

Build Optimizations JavaScript modules, module/nomodule pattern, tree-shaking, code-splitting, scope-hoisting, Webpack, differential serving, web worker, WebAssembly, JavaScript bundles, React, SPA, partial hydration, import on interaction, 3rd-parties, cache. This improves page load time and caching during navigations.

Performance 145

Performance Cache Media Metrics 145

Enprowess

JANUARY 12, 2022

So it is convenient for all to use irrespective of internet speed and it works offline using cached data. IoT tracking systems. IBM OpenWhisk, Microsoft Azure, AWS Lambda, and Google Cloud Functions are famous names that provide server-less services. Serverless Computing – AWS Lambda – Amazon Web Services.

Blockchain 59

Blockchain IoT Development Serverless 59

Smashing Magazine

JANUARY 6, 2020

You could go as far as evaluating a framework (or any JavaScript library) on Sacha Greif’s 12-point scale scoring system by exploring features, accessibility, stability, performance, package ecosystem, community, learning curve, documentation, tooling, track record, team, compatibility, security for example.

Performance 145

Performance Cache Network Metrics 145

Smashing Magazine

JANUARY 7, 2019

You could go as far as evaluating a framework (or any JavaScript library) on Sacha Greif’s 12-point scale scoring system by exploring features, accessibility, stability, performance, package ecosystem, community, learning curve, documentation, tooling, track record, team, compatibility, security for example.

Performance 104

Performance Cache Network Metrics 104

High Scalability

FEBRUARY 19, 2019

Redis Cluster is the native sharding implementation available within Redis that allows you to automatically distribute your data across multiple nodes without having to rely on external tools and utilities. At ScaleGrid, we recently added support for Redis Clusters on our platform through our fully managed Redis hosting plans.

Availability 204

Availability Open Source Cache Storage 204