High Scalability

AUGUST 17, 2018

coryodaniel : Rewrote an #AWS APIGateway & #lambda service that was costing us about $16000 / month in #elixir. 12 million requests / hour with sub-second latency, ~300GB of throughput / day. Keep on reading for many more quotes hot off the internet. Its running in 3 nodes that cost us about $150 / month. myelixirstatus !#Serverless.No

Internet 105

Internet Internet Scalability Games 105

Adrian Cockcroft

MAY 6, 2023

Then they tried to scale it to cope with high traffic and discovered that some of the state transitions in their step functions were too frequent, and they had some overly chatty calls between AWS lambda functions and S3. which provides this as a service and where the chief architect and CTO are both ex-Netflix colleagues of mine.

Serverless 145

Serverless Lambda Best Practices Traffic 145

Scalegrid

APRIL 16, 2020

AWS , Azure. AWS , Azure. AWS , Azure. AWS , Azure. AWS , Azure. AWS , Azure. AWS , Azure. AWS , Azure , DigitalOcean. Are you a startup that has free AWS or Azure hosting credits you’d like to use for your database hosting? Do you want to deploy in an AWS VPC or Azure VNET?

Cloud 242

Cloud Azure AWS Database 242

All Things Distributed

JANUARY 6, 2016

In November, Amazon Web Services announced that it would launch a new AWS infrastructure region in South Korea. For example, Samsung Electronic Printing used AWS to deploy its Printing Apps Center in a way that didn’t require them to invest up-front capital and kept total costs quite low.

AWS 110

AWS Cloud Games Latency 110

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. Colleagues/Internet I love using [Linux performance tools]. But I also love solving issues quickly, and sometimes that means just asking colleagues or searching the Internet.

Speed 126

Speed Java AWS Virtualization 126

All Things Distributed

OCTOBER 16, 2019

But they usually have little to no internet connection, making the challenge of exploring environments inhospitable for humans seem even more impossible. The answer to this question is actually on your phone, your smartwatch, and billions of other places on earth—it's the Internet of Things (IoT).

IoT 126

IoT Healthcare Internet Internet 126

Brendan Gregg

JULY 4, 2021

It's an exciting time for developments in computer performance, not just for the BPF technology (which I often [write about]) but also for processors with 3D stacking and cloud vendor CPUs (e.g., Ford, et al., “TCP on Upcoming Sapphire Rapids CPUs,” [link] Oct 2020 - [Liu 20] Linda Liu, “Samsung QVO vs EVO vs PRO: What’s the Difference?

Performance 140

Performance Latency Hardware Storage 140

All Things Distributed

DECEMBER 14, 2011

Introducing the AWS South America (Sao Paulo) Region. Today, Amazon Web Services is expanding its worldwide coverage with the launch of a new AWS Region in Sao Paulo, Brazil. Several prominent South American customers have been using AWS since the early days. RAMA , a Brazilian financial services firm and AWS customer : â??The

AWS 115

AWS Latency Storage Big Data 115

All Things Distributed

MARCH 2, 2011

Expanding the Cloud - Introducing the AWS Asia Pacific (Tokyo) Region. Today Amazon Web Services is expanding its world-wide coverage with the launch of a new AWS Region located in Tokyo, Japan. The advanced Asia Pacific network infrastructure also makes the AWS Tokyo Region a viable low-latency option for customers from South Korea.

AWS 114

AWS Cloud Games Latency 114

High Scalability

MARCH 1, 2019

It's HighScalability time: 10 years of AWS architecture increasing simplicity or increasing complexity? It was made possible by using a low latency of 0.1 seconds, the lower the latency, the more responsive the robot. Michael Wittig ). Do you like this sort of Stuff? I'd greatly appreciate your support on Patreon. So much more.

Internet 33

Internet Internet Scalability Blockchain 33

Brendan Gregg

FEBRUARY 28, 2023

My personal opinion is that I don't see a widespread need for more capacity given horizontal scaling and servers that can already exceed 1 Tbyte of DRAM; bandwidth is also helpful, but I'd be concerned about the increased latency for adding a hop to more memory. Ford, et al., “TCP

Performance 110

Performance Latency Cache Virtualization 110

All Things Distributed

AUGUST 16, 2011

Expanding the Cloud - The AWS GovCloud (US) Region. Today AWS announced the launch of the AWS GovCloud (US) Region. The concept of regions gives AWS customers control over the placement of their resources and services. All Things Distributed. Werner Vogels weblog on building scalable and robust distributed systems.

AWS 113

AWS Government Big Data Cloud 113

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. Colleagues/Internet I love using Linux performance tools. But I also love solving issues quickly, and sometimes that means just asking colleagues or searching the Internet.

Speed 52

Speed Java AWS Virtualization 52

All Things Distributed

DECEMBER 3, 2009

Expanding the Cloud - New AWS Region: US-West (Northern California). We have expanded the AWS footprint in the US and starting today a new AWS Region is available for use: US-West (Northern California). AWS is committed to making its services available at low cost. Driving Storage Costs Down for AWS Customers.

AWS 60

AWS Cloud Latency Storage 60

Brendan Gregg

JULY 4, 2021

It's an exciting time for developments in computer performance, not just for the BPF technology (which I often [write about]) but also for processors with 3D stacking and cloud vendor CPUs (e.g., Ford, et al., “TCP on Upcoming Sapphire Rapids CPUs,” [link] Oct 2020 - [Liu 20] Linda Liu, “Samsung QVO vs EVO vs PRO: What’s the Difference?

Performance 52

Performance Latency Hardware Storage 52

All Things Distributed

APRIL 28, 2010

Expanding the Cloud - Opening the AWS Asia Pacific (Singapore) Region. Today Amazon Web Services has taken another important step in serving customers worldwide: the AWS Asia Pacific (Singapore) Region is now launched. Quite often "The Cloud" is portrayed as something magically transparent that lives somewhere in the internet.

AWS 61

AWS Cloud Latency Storage 61

All Things Distributed

DECEMBER 5, 2010

DNS is one of the fundamental building blocks of internet applications and was high on the wish list of our customers for some time already. Route 53 has the business properties that you have come to expect from an AWS service: fully self-service and programmable, with transparent pay-as-you-go pricing and no minimum usage commitments.

Cloud 117

Cloud Internet Internet AWS 117

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. Colleagues/Internet I love using [Linux performance tools]. But I also love solving issues quickly, and sometimes that means just asking colleagues or searching the Internet.

Speed 40

Speed Java AWS Virtualization 40

Brendan Gregg

FEBRUARY 28, 2023

My personal opinion is that I don't see a widespread need for more capacity given horizontal scaling and servers that can already exceed 1 Tbyte of DRAM; bandwidth is also helpful, but I'd be concerned about the increased latency for adding a hop to more memory. Ford, et al., “TCP

Performance 52

Performance Latency Cache Virtualization 52

Scalegrid

JANUARY 12, 2024

With extensive computational resources at their disposal alongside massive pools of information, developers can utilize these powerful tools to train ML models efficiently or run AI algorithms effectively by accessing stored datasets from anywhere through the internet connection provided by most reputable providers’ hosting services.

Cloud 130

Cloud Virtualization Storage Efficiency 130

All Things Distributed

JULY 13, 2010

In particular this has been true for applications based on algorithms - often MPI-based - that depend on frequent low-latency communication and/or require significant cross sectional bandwidth. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. Countdown to What is Next in AWS.

Cloud 119

Cloud AWS Automotive Latency 119

All Things Distributed

JULY 11, 2011

As a part of that process, we also realized that there were a number of latency sensitive or location specific use cases like Hadoop, HPC, and testing that would be ideal for Spot. To get started using Spot or for more details visit the Amazon EC2 Spot Instance web page, the AWS developer blog , and the EC2 Release Notes. Contact Info.

AWS 87

AWS Storage Cloud Big Data 87

VoltDB

JUNE 1, 2017

Latency Optimizers” – need support for very large federated deployments. 5G expects a latency of 1ms , which considering that the speed of light means the data center can’t be more than 186 miles away, or 93 miles for a round trip, assuming an instant response. The “Public Private Cloud” folks.

Hardware 56

Hardware Latency Virtualization Cloud 56

All Things Distributed

NOVEMBER 19, 2010

Understanding Throughput-Oriented Architectures - background article in CACM on massively parallel and throughput vs latency oriented architectures. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications.

AWS 68

AWS Cloud Benchmarking Storage 68

VoltDB

JUNE 1, 2017

Latency Optimizers” – need support for very large federated deployments. 5G expects a latency of 1ms , which considering that the speed of light means the data center can’t be more than 186 miles away, or 93 miles for a round trip, assuming an instant response. The “Public Private Cloud” folks.

Hardware 40

Hardware Latency Virtualization Cloud 40

All Things Distributed

APRIL 4, 2017

Today, I am very excited to announce our plans to open a new AWS Region in the Nordics! The new region will give Nordic-based businesses, government organisations, non-profits, and global companies with customers in the Nordics, the ability to leverage the AWS technology infrastructure from data centers in Sweden.

AWS 117

AWS Airlines Latency Games 117

High Scalability

DECEMBER 21, 2018

2) Cloud will decentralise in terms of provision not power i.e. Amazon will "invade" more of those holdouts with AWS Outpost. Tim Bray : How to talk about [Serverless Latency] · To start with, don’t just say “I need 120ms.” Me : Nothing special. 1) Enterprise data centres will continue to close. Don't be late.

Internet 137

Internet Internet Scalability Serverless 137

High Scalability

JULY 20, 2018

A typical example of modern "microservices-inspired" Java application would function along these lines: Netflix : We observed during experimentation that RAM random read latencies were rarely higher than 1 microsecond whereas typical SSD random read speeds are between 100–500 microseconds. There are a few more quotes.

Internet 121

Internet Internet Scalability Automotive 121

Brendan Gregg

SEPTEMBER 5, 2017

Here's some output from my zfsdist tool, in bcc/BPF, which measures ZFS latency as a histogram on Linux: # zfsdist. Tracing ZFS operation latency. The odd time we hit them, we'll take the "oops message" – a dump of the kernel stack trace and other details from the system log – and search the Internet.

Virtualization 76

Virtualization AWS Engineering Hardware 76

All Things Distributed

OCTOBER 2, 2017

As we began growing the AWS business, we realized that external customers might find our Dynamo database just as useful as we found it within Amazon.com. So, we set out to build a fully hosted AWS database service based upon the original Dynamo design.

Internet 130

Internet Internet AWS Performance 130

All Things Distributed

JULY 14, 2015

In just three short years, Amazon DynamoDB has emerged as the backbone for many powerful Internet applications such as AdRoll , Druva , DeviceScape , and Battlecamp. You can enable the DynamoDB Streams feature for a table with just a few clicks using the AWS Management Console, or you can use the DynamoDB API. DynamoDB Streams.

Database 167

Database Lambda AWS IoT 167

Smashing Magazine

AUGUST 20, 2021

I had my website with funny photos and links to favorite websites live on the internet, and better yet, I could edit directly on the server. It’s safe to say WordPress, the platform now powering 40% of the internet, won that battle, but MovableType paved the way for Jamstack CMSs in the future. But, when it worked, it was magical.

Ecommerce 139

Ecommerce Website Government Internet 139

All Things Distributed

APRIL 9, 2015

Details on the AWS Blog. AWS has been offering a range of storage solutions: objects, block storage, databases, archiving, etc. When we designed Amazon EFS we decided to build along the AWS principles: Elastic, scalable, highly available, consistent performance, secure, and cost-effective. Details on the AWS Blog.

Lambda 123

Lambda Cloud IoT AWS 123

All Things Distributed

JUNE 21, 2018

In fact, this is been proven by our customers as Amazon Aurora remains the fastest growing service in AWS history. We are increasingly seeing customers wanting to build Internet-scale applications that require diverse data models. The opposite is true. What we experienced at Amazon.com was using a database beyond its intended purpose.

Database 167

Database AWS Games Latency 167

All Things Distributed

JANUARY 18, 2012

a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Today is a very exciting day as we release Amazon DynamoDB , a fast, highly reliable and cost-effective NoSQL database service designed for internet scale applications. Amazon DynamoDB offers low, predictable latencies at any scale. Comments ().

Scalability 167

Scalability Database Ecommerce Latency 167

The Netflix TechBlog

FEBRUARY 18, 2022

While a mobile device is almost always connected to the internet and reachable, a smart TV is only online while in use. Scaling Policies To address the thundering herd problem and to keep latencies under acceptable thresholds, the cluster scale-up policies are configured to be more aggressive than the scale-down policies.

Systems 334

Systems Traffic Architecture Mobile 334

Smashing Magazine

JANUARY 7, 2019

Estimated Input Latency tells us if we are hitting that threshold, and ideally, it should be below 50ms. Brotli is widely supported, and many CDNs support it ( Akamai , AWS , KeyCDN , Fastly , Cloudlare , CDN77 ) and you can enable Brotli even on CDNs that don’t support it yet (with a service worker).

Performance 103

Performance Cache Metrics Network 103