Remove Analytics Remove Efficiency Remove Internet Remove Lambda
article thumbnail

In-Stream Big Data Processing

Highly Scalable

The engine should be compact and efficient, so one can deploy it in multiple datacenters on small clusters. Thus, on a conceptual level, an efficient query engine in a distributed database can act as a stream processing system and vice versa, a stream processing system can act as a distributed database query engine. Pipelining.

Big Data 154
article thumbnail

So many bad takes?—?What is there to learn from the Prime Video microservices to monolith story

Adrian Cockcroft

Then they tried to scale it to cope with high traffic and discovered that some of the state transitions in their step functions were too frequent, and they had some overly chatty calls between AWS lambda functions and S3. A real-time user experience analytics engine for live video, that looked at all users rather than a subsample.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

Embrace event-driven computing: Amazon expands DynamoDB with streams, cross-region replication, and database triggers

All Things Distributed

In just three short years, Amazon DynamoDB has emerged as the backbone for many powerful Internet applications such as AdRoll , Druva , DeviceScape , and Battlecamp. An AWS Lambda function is a simpler option that you can use, as it only requires you to code the logic, set it, and forget it. Lambda and DynamoDB take care of the rest.

Database 167
article thumbnail

Expanding the AWS Cloud: Introducing the AWS Europe (London) Region

All Things Distributed

With the launch of the AWS Europe (London) Region, AWS can enable many more UK enterprise, public sector and startup customers to reduce IT costs, address data locality needs, and embark on rapid transformations in critical new areas, such as big data analysis and Internet of Things.

AWS 166
article thumbnail

A one size fits all database doesn't fit anyone

All Things Distributed

We are increasingly seeing customers wanting to build Internet-scale applications that require diverse data models. Tinder is one example of a customer that is using the flexible schema model of DynamoDB to achieve developer efficiency. Purpose-built databases.

Database 167
article thumbnail

Accelerating Data: Faster and More Scalable ElastiCache for Redis

All Things Distributed

Since then we’ve introduced Amazon Kinesis for real-time streaming data, AWS Lambda for serverless processing, Apache Spark analytics on EMR, and Amazon QuickSight for high performance Business Intelligence. ElastiCache for Redis Multi-AZ capability is built to handle any failover case for Redis Cluster with robustness and efficiency.