High Scalability

JULY 20, 2018

And if you know anyone looking for a simple book that uses lots of pictures and lots of examples to explain the cloud, then please recommend my new book: Explain the Cloud Like I'm 10. Do you like this sort of Stuff? Please lend me your support on Patreon. It would mean a great deal to me. They'll love you even more. Not so many this week.

Internet 121

Internet Internet Scalability Automotive 121

High Scalability

AUGUST 17, 2018

And if you know anyone looking for a simple book that uses lots of pictures and lots of examples to explain the cloud, then please recommend my new book: Explain the Cloud Like I'm 10. coryodaniel : Rewrote an #AWS APIGateway & #lambda service that was costing us about $16000 / month in #elixir. Do you like this sort of Stuff?

Internet 105

Internet Internet Scalability Games 105

Dynatrace

OCTOBER 10, 2022

Many organizations today rely on cloud-native applications for their scalability and agility, among other benefits. Popular examples include AWS Lambda and Microsoft Azure Functions , but new providers are constantly emerging as this model becomes more mainstream. Serverless benefits include the following: Dynamic scalability.

Serverless 163

Serverless Infrastructure Lambda Latency 163

Percona

JULY 1, 2023

Now that Database-as-a-service (DBaaS) is in high demand, there are multiple questions regarding AWS services that cannot always be answered easily: When should I use Aurora and when should I use RDS MySQL ? These may be performance, high availability, operational cost, management, capacity planning, scalability, security, monitoring, etc.

AWS 52

AWS Database Serverless Storage 52

All Things Distributed

NOVEMBER 13, 2014

When AWS launched, it changed how developers thought about IT services: What used to take weeks or months of purchasing and provisioning turned into minutes with Amazon EC2. Our answer is a new compute service called AWS Lambda. You can go from code to service in three clicks and then let AWS Lambda take care of the rest.

Lambda 136

Lambda AWS Cloud Scalability 136

The Netflix TechBlog

OCTOBER 19, 2020

a Netflix member via Twitter This is an example of a question our on-call engineers need to answer to help resolve a member issue?—?which An additional implication of a lenient sampling policy is the need for scalable stream processing and storage infrastructure fleets to handle increased data volume. Storage: don’t break the bank!

Infrastructure 233

Infrastructure Transportation Storage Open Source 233

Scalegrid

JANUARY 12, 2024

Various forms can take shape when discussing workloads within the realm of cloud computing environments – examples include order management databases, collaboration tools, videoconferencing systems, virtual desktops, and disaster recovery mechanisms. This also aids scalability down the line.

Cloud 130

Cloud Virtualization Storage Efficiency 130

Dynatrace

MAY 17, 2023

Think about items such as general system metrics (for example, CPU utilization, free memory, number of services), the connectivity status, details of our web server, or even more granular in-application tasks like database queries. Let’s take our previous screenshot as an example.

Metrics 168

Metrics Monitoring Database Network 168

All Things Distributed

JANUARY 23, 2012

Werner Vogels weblog on building scalable and robust distributed systems. Expanding the Cloud - The AWS Storage Gateway. Today Amazon Web Services has launched the AWS Storage Gateway, making the power of secure and reliable cloud storage accessible from customersâ?? Once the AWS Storage Gatewayâ??s Comments ().

Storage 115

Storage AWS Virtualization Cloud 115

Dynatrace

SEPTEMBER 30, 2021

Cloud services platforms like AWS, Azure, and GCP are reshaping how organizations deliver value to their customers, making cloud migration an increasingly attractive option for running applications. Increased scalability. For example, as traffic increases, costs will too. Here are three major benefits of cloud migration: 1.

Cloud 163

Cloud Traffic Best Practices Strategy 163

The Netflix TechBlog

NOVEMBER 22, 2019

by Shefali Vyas Dalal AWS re:Invent is a couple weeks away and our engineers & leaders are thrilled to be in attendance yet again this year! To sustain this data growth at Netflix, it has deployed open-source software Ceph using AWS services to achieve the required SLOs of some of the post-production workflows.

AWS 37

AWS Entertainment Open Source Benchmarking 37

All Things Distributed

AUGUST 16, 2011

Werner Vogels weblog on building scalable and robust distributed systems. Expanding the Cloud - The AWS GovCloud (US) Region. Today AWS announced the launch of the AWS GovCloud (US) Region. The concept of regions gives AWS customers control over the placement of their resources and services. All Things Distributed.

AWS 111

AWS Government Big Data Cloud 111

All Things Distributed

NOVEMBER 26, 2013

As I discussed in my re:Invent keynote earlier this month, I am now happy to announce the immediate availability of Amazon RDS Cross Region Read Replicas , which is another important enhancement for our customers using or planning to use multiple AWS Regions to deploy their applications. Cross Region Read Replicas are available for MySQL 5.6

Cloud 145

Cloud AWS Traffic Latency 145

High Scalability

FEBRUARY 19, 2021

In the remainder of this article we will give examples of each of these situations and explain the engineering challenges encountered in achieving fault tolerance in practice. Byzantine faults are a classic example. For example, a system component might work intermittently, or produce misleading output. This ensures reliability.

Engineering 215

Engineering Systems Scalability Availability 215

All Things Distributed

DECEMBER 3, 2009

Werner Vogels weblog on building scalable and robust distributed systems. Expanding the Cloud - New AWS Region: US-West (Northern California). We have expanded the AWS footprint in the US and starting today a new AWS Region is available for use: US-West (Northern California). Driving Storage Costs Down for AWS Customers.

AWS 60

AWS Cloud Latency Storage 60

All Things Distributed

APRIL 17, 2013

Werner Vogels weblog on building scalable and robust distributed systems. While DynamoDB already allows you to perform low-latency queries based on your tableâ??s This gives you the ability to perform richer queries while still meeting the low-latency demands of responsive, scalable applications. As an example, letâ??s

Cloud 114

Cloud Latency Games Scalability 114

ScaleOut Software

APRIL 6, 2021

Because it runs on a scalable, highly available in-memory computing platform, it can do all this simultaneously for hundreds of thousands or even millions of data sources. For example, consider some of the new capabilities that real-time digital twins can provide in fleet telematics and vaccine distribution during COVID-19.

IoT 52

IoT Azure Analytics Healthcare 52

Dotcom-Montior

NOVEMBER 11, 2020

those resources now belong to cloud providers, such as AWS Lambda, Google Cloud Platform, Microsoft Azure, and others. Scalability. However, when the time comes for resources to be requested, there can be latency in the time it takes to for that code to start back up. Security & Privacy. This is known as a cold start.

Serverless 57

Serverless Monitoring Lambda Latency 57

Smashing Magazine

AUGUST 3, 2023

Here are some examples: Looker Studio filter. We realized that we needed to consider a more global and scalable solution to better serve our global audience. This proximity significantly reduces the time it takes for the data to travel from the server to the user, thus reducing latency and improving load times.

Performance 74

Performance Cache Traffic Metrics 74

All Things Distributed

APRIL 28, 2010

Werner Vogels weblog on building scalable and robust distributed systems. Expanding the Cloud - Opening the AWS Asia Pacific (Singapore) Region. Today Amazon Web Services has taken another important step in serving customers worldwide: the AWS Asia Pacific (Singapore) Region is now launched. All Things Distributed. Comments ().

AWS 61

AWS Cloud Latency Storage 61

The Morning Paper

JUNE 23, 2019

After all, we’ve been doing that forever with the 2nd-level cache of ORMs , and it is highly encouraged in e.g. the AWS Lambda programming model — which was born on the cloud— to help mitigate function start-up times. The network latency of fetching data over the network, even considering fast data center networks. Who knew! ;).

Cache 79

Cache Latency Google Lambda 79

All Things Distributed

MARCH 11, 2013

Werner Vogels weblog on building scalable and robust distributed systems. I spent a lot of time talking to AWS developers, many working in the gaming and mobile space, and most of them have been finding Node.js allows these developers to handle a large number of concurrent connections with low latencies. All Things Distributed.

AWS 102

AWS Mobile Games Java 102

All Things Distributed

NOVEMBER 8, 2012

Werner Vogels weblog on building scalable and robust distributed systems. The Amazon Simple Queue Service (SQS) is a highly scalable, reliable and elastic queuing service that just works. Similarly, AWS customers have been using SQS in interesting ways. Amazon SQS provides highly scalable â??eventual Comments ().

Efficiency 104

Efficiency Cloud Games Scalability 104

All Things Distributed

SEPTEMBER 25, 2012

Werner Vogels weblog on building scalable and robust distributed systems. As with all AWS services, if you are in doubt about whether your application can benefit from Provisioned IOPS, it is very easy to try it out and decide for yourself, as there are no upfront costs. Expanding the Cloud â?? Provisioned IOPS for Amazon RDS.

Cloud 117

Cloud AWS Storage Database 117

All Things Distributed

JULY 13, 2010

Werner Vogels weblog on building scalable and robust distributed systems. In particular this has been true for applications based on algorithms - often MPI-based - that depend on frequent low-latency communication and/or require significant cross sectional bandwidth. All Things Distributed. By Werner Vogels on 12 July 2010 05:00 PM.

Cloud 118

Cloud AWS Automotive Latency 118

Dotcom-Montior

OCTOBER 6, 2021

Site reliability engineers are focused with creating scalable and reliable software systems, so this also includes ensuring that development work is efficient and reliable, so when the finished product is ready for production, there are no surprises. What Does a Site Reliability Engineer Do? Monitoring. Incident Response. On-call Support.

Engineering 67

Engineering DevOps Monitoring Google 67

All Things Distributed

DECEMBER 5, 2010

Werner Vogels weblog on building scalable and robust distributed systems. Route 53 has the business properties that you have come to expect from an AWS service: fully self-service and programmable, with transparent pay-as-you-go pricing and no minimum usage commitments. All Things Distributed. Comments (). Some fundamentals on Naming.

Cloud 117

Cloud Internet Internet AWS 117

Percona

MAY 2, 2023

This is an example of the Backup Progress Logging mentioned above. It also supports storing the backups on filesystem and AWS S3 buckets. root@ip-172-31-37-92 ~]# aws ec2 describe-snapshots --query "sort_by(Snapshots, &StartTime)[-1].{SnapshotId:SnapshotId,StartTime:StartTime}" 8 connecting to: mongodb://127.0.0.1:27017/?compressors=disabled&gssapiServiceName=mongodb

Best Practices 52

Best Practices Database Storage Servers 52

O'Reilly Software

MARCH 7, 2018

Build a more scalable, composable, and functional architecture for interconnecting systems and applications. What if we could fully embrace the concept of streaming, and redesign system integration from a reactive—asynchronous, non-blocking, scalable, and resilient perspective? Welcome to a new world of data-driven systems.

Transportation 72

Transportation Java Programming Architecture 72

The Netflix TechBlog

NOVEMBER 3, 2022

For example, it is OK to send writes through one instance, and do reads from another one with full data read consistency guarantees. For example, a batch workflow orchestration system may create multiple jobs which are part of a single workflow execution. Kubernetes is a good example here.

Cache 224

Cache Latency Traffic Systems 224

All Things Distributed

JULY 14, 2015

DynamoDB Streams is the enabling technology behind two other features announced today: cross-region replication maintains identical copies of DynamoDB tables across AWS regions with push-button ease, and triggers execute AWS Lambda functions on streams, allowing you to respond to changing data conditions. DynamoDB Streams.

Database 167

Database Lambda AWS IoT 167

The Netflix TechBlog

OCTOBER 27, 2020

The processed data is typically stored as data warehouse tables in AWS S3. For example, in order to enhance our user experience, one online application fetches subscribers’ preferences data to recommend movies and TV shows. The data warehouse is not designed to serve point requests from microservices with low latency.

Latency 243

Latency Storage Big Data Tuning 243

All Things Distributed

JANUARY 18, 2012

Werner Vogels weblog on building scalable and robust distributed systems. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. The original Dynamo design was based on a core set of strong distributed systems principles resulting in an ultra-scalable and highly reliable database system.

Scalability 167

Scalability Database Ecommerce Latency 167

All Things Distributed

OCTOBER 12, 2016

Three years ago, as part of our AWS Fast Data journey we introduced Amazon ElastiCache for Redis , a fully managed in-memory data store that operates at sub-millisecond latency. This allows for faster failover times while minimizing latency. Building upon Redis. Redis and Fast Data.

Scalability 130

Scalability Analytics Cache AWS 130

All Things Distributed

JUNE 21, 2018

As I have talked about before, one of the reasons why we built Amazon DynamoDB was that Amazon was pushing the limits of what was a leading commercial database at the time and we were unable to sustain the availability, scalability, and performance needs that our growing Amazon.com business demanded. The opposite is true.

Database 167

Database AWS Games Latency 167

The Netflix TechBlog

APRIL 26, 2022

An example of data about members is the video they had watched or added to their My List. An example of video data is video metadata, like the length of a video. We use Keystone as it is easy to use, reliable, scalable, and provides aggregation of facts from different cloud regions into a single AWS region.

Storage 187

Storage Design Scalability Latency 187

The Netflix TechBlog

DECEMBER 21, 2020

By Anupom Syam Background At Netflix, our current data warehouse contains hundreds of Petabytes of data stored in AWS S3 , and each day we ingest and create additional Petabytes. For example, we allow a partition to have a few small files instead of always merging files in perfect sizes. More processing resources.

Storage 203

Storage Latency Efficiency Data Engineering 203