All Things Distributed

JULY 13, 2010

Werner Vogels weblog on building scalable and robust distributed systems. In particular this has been true for applications based on algorithms - often MPI-based - that depend on frequent low-latency communication and/or require significant cross sectional bandwidth. Driving Storage Costs Down for AWS Customers. Comments ().

Cloud 118

Cloud AWS Automotive Latency 118

All Things Distributed

DECEMBER 3, 2009

Werner Vogels weblog on building scalable and robust distributed systems. This new Region consists of multiple Availability Zones and provides low-latency access to the AWS services from for example the Bay Area. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. Comments ().

AWS 60

AWS Cloud Latency Storage 60

All Things Distributed

JULY 11, 2011

Werner Vogels weblog on building scalable and robust distributed systems. As a part of that process, we also realized that there were a number of latency sensitive or location specific use cases like Hadoop, HPC, and testing that would be ideal for Spot. Driving Storage Costs Down for AWS Customers. All Things Distributed.

AWS 85

AWS Storage Cloud Big Data 85

All Things Distributed

DECEMBER 5, 2010

Werner Vogels weblog on building scalable and robust distributed systems. Often these namespaces are hierarchical in nature such that it becomes easier to manage them and to decentralize control, which makes the system more scalable. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway.

Cloud 117

Cloud Internet Internet AWS 117

HammerDB

DECEMBER 5, 2020

For TPC-C this meant enough available spindles to reduce I/O latency and for TPC-H enough bandwidth for data throughput. Official TPC-C and TPC-H compliant results can as has always been the case only be found on the official TPC website. . . This was both expensive and time consuming to configure.

C++ 40

C++ Benchmarking Virtualization Open Source 40

All Things Distributed

NOVEMBER 19, 2010

Werner Vogels weblog on building scalable and robust distributed systems. Understanding Throughput-Oriented Architectures - background article in CACM on massively parallel and throughput vs latency oriented architectures. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway.

AWS 67

AWS Cloud Benchmarking Storage 67

All Things Distributed

APRIL 28, 2010

Werner Vogels weblog on building scalable and robust distributed systems. There are four main reasons to do so: Performance - For many applications and services, data access latency to end users is important. The new Singapore Region offers customers in APAC lower-latency access to AWS services. All Things Distributed.

AWS 61

AWS Cloud Latency Storage 61

Scalegrid

JANUARY 12, 2024

Storage is a critical aspect to consider when working with cloud workloads. High availability storage options within the context of cloud computing involve highly adaptable storage solutions specifically designed for storing vast amounts of data while providing easy access to it. This also aids scalability down the line.

Cloud 130

Cloud Virtualization Storage Efficiency 130

Percona

MAY 2, 2023

The speed of backup also depends on allocated IOPS and type of storage since lots of read/writes would be happening during this process. Back up anywhere – to the cloud (use any S3-compatible storage) or on-premise with a locally-mounted remote file system It allows you to choose which compression algorithms to use.

Best Practices 52

Best Practices Database Storage Servers 52

All Things Distributed

JUNE 21, 2018

As I have talked about before, one of the reasons why we built Amazon DynamoDB was that Amazon was pushing the limits of what was a leading commercial database at the time and we were unable to sustain the availability, scalability, and performance needs that our growing Amazon.com business demanded. The opposite is true.

Database 167

Database AWS Games Latency 167

Dotcom-Montior

MAY 12, 2020

Website and web application technologies have grown tremendously over the years. Websites are now more than just the storage and retrieval of information to present content to users. Website and Web Application Monitoring. Network latency. Network Latency. Network latency can be affected due to.

Monitoring 63

Monitoring Entertainment Hardware Latency 63

HammerDB

OCTOBER 12, 2018

As is also the case this limitation is at the database level (especially the storage engine) rather than the hardware level. InnoDB is the storage engine that will deliver the best OLTP throughput and should be chosen for this test. . maximum transition latency: Cannot determine or is not supported. . large-pages.

Best Practices 40

Best Practices Scalability Performance C++ 40

All Things Distributed

APRIL 9, 2015

Amazon ML is highly scalable and can generate billions of predictions, and serve those predictions in real-time and at high throughput. AWS has been offering a range of storage solutions: objects, block storage, databases, archiving, etc. Details on the AWS Blog. The Amazon Elastic File System. for a while already.

Lambda 122

Lambda Cloud IoT AWS 122

Abhishek Tiwari

NOVEMBER 3, 2018

A few months back, I was pulled into a scenario where a business has been working with a leading CMS vendor to roll-out a network of multi-regional websites. If you put your whole website on CDN, technically you don’t need a large number of server infrastructure and CMS licenses.

Systems 63

Systems Cache Website Network 63

All Things Distributed

NOVEMBER 15, 2010

Werner Vogels weblog on building scalable and robust distributed systems. For example, the most fundamental abstraction trade-off has always been latency versus throughput. The throughput of this pipeline is more important than the latency of the individual operations. Driving Storage Costs Down for AWS Customers.

AWS 136

AWS Latency Programming Architecture 136

All Things Distributed

FEBRUARY 24, 2010

Werner Vogels weblog on building scalable and robust distributed systems. There are many factors that come into play when you need to meet stringent availability and performance requirements under ultra-scalable conditions. Achieving strict consistency can come at a cost in update or read latency, and may result in lower throughput.

AWS 69

AWS Latency Database Scalability 69

Dynatrace

AUGUST 5, 2019

Remember: This is a critical aspect as you do not want to migrate a service and suddenly introduce high latency or costs to a system that you forgot about having a dependency with! Optimize Query Performance and Data Storage Cost. Extract less critical data into a cheaper database storage option. These examples include e.g:

Cloud 31

Cloud Traffic Database Network 31

Smashing Magazine

JANUARY 11, 2021

So, if we created an overview of all the things we have to keep in mind when improving performance — from the very start of the project until the final release of the website — what would that look like? Estimated Input Latency tells us if we are hitting that threshold, and ideally, it should be below 50ms. Image source ).

Performance 145

Performance Cache Media Metrics 145

Smashing Magazine

JANUARY 6, 2020

So, if we created an overview of all the things we have to keep in mind when improving performance — from the very start of the process until the final release of the website — what would that list look like? ( Large preview ). Goal: Be at least 20% faster than your fastest competitor. Image source ).

Performance 145

Performance Cache Network Metrics 145

Smashing Magazine

JANUARY 7, 2019

So, if we created an overview of all the things we have to keep in mind when improving performance — from the very start of the process until the final release of the website — what would that list look like? ( Large preview ). Goal: Be at least 20% faster than your fastest competitor. Image source ).

Performance 104

Performance Cache Metrics Network 104