article thumbnail

So many bad takes?—?What is there to learn from the Prime Video microservices to monolith story

Adrian Cockcroft

Then they tried to scale it to cope with high traffic and discovered that some of the state transitions in their step functions were too frequent, and they had some overly chatty calls between AWS lambda functions and S3. They state in the blog that this was quick to build, which is the point.

article thumbnail

Stuff The Internet Says On Scalability For August 17th, 2018

High Scalability

coryodaniel : Rewrote an #AWS APIGateway & #lambda service that was costing us about $16000 / month in #elixir. 12 million requests / hour with sub-second latency, ~300GB of throughput / day. Keep on reading for many more quotes hot off the internet. Its running in 3 nodes that cost us about $150 / month. myelixirstatus !#Serverless.No

Internet 105
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

Embrace event-driven computing: Amazon expands DynamoDB with streams, cross-region replication, and database triggers

All Things Distributed

In just three short years, Amazon DynamoDB has emerged as the backbone for many powerful Internet applications such as AdRoll , Druva , DeviceScape , and Battlecamp. An AWS Lambda function is a simpler option that you can use, as it only requires you to code the logic, set it, and forget it. Lambda and DynamoDB take care of the rest.

Database 167
article thumbnail

Expanding the Cloud: Amazon Machine Learning Service, the Amazon Elastic Filesystem and more

All Things Distributed

Amazon Lambda. One of the most exciting technologies we have built lately at AWS is Amazon Lambda. A great example by Valentino in the AWSSummit today was the use of Lambda by Adroll to deliver real-time updates around the word to their DynamoDB instances. Today Amazon Lambda is entering General Availability.

Lambda 123
article thumbnail

A one size fits all database doesn't fit anyone

All Things Distributed

We are increasingly seeing customers wanting to build Internet-scale applications that require diverse data models. Use cases such as gaming, ad tech, and IoT lend themselves particularly well to the key-value data model where the access patterns require low-latency Gets/Puts for known key values. Purpose-built databases.

Database 167
article thumbnail

Accelerating Data: Faster and More Scalable ElastiCache for Redis

All Things Distributed

Three years ago, as part of our AWS Fast Data journey we introduced Amazon ElastiCache for Redis , a fully managed in-memory data store that operates at sub-millisecond latency. This allows for faster failover times while minimizing latency. The client keeps a map of Redis nodes, which is updated in case of failover.

article thumbnail

In-Stream Big Data Processing

Highly Scalable

This system has been designed to supplement and succeed the existing Hadoop-based system that had too high latency of data processing and too high maintenance costs. For example, consider a system that calculates average purchase value in the internet shop for each hour. Marz, “Big Data Lambda Architecture”. Jacobsen and R.

Big Data 154