article thumbnail

In-Stream Big Data Processing

Highly Scalable

For example, consider a system that calculates average purchase value in the internet shop for each hour. For example, consider a system that counts unique visitors on some internet site. Sketches are very popular in certain areas like internet advertising and can be considered as an independent pattern of in-stream processing.

Big Data 154
article thumbnail

So many bad takes?—?What is there to learn from the Prime Video microservices to monolith story

Adrian Cockcroft

Then they tried to scale it to cope with high traffic and discovered that some of the state transitions in their step functions were too frequent, and they had some overly chatty calls between AWS lambda functions and S3. A real-time user experience analytics engine for live video, that looked at all users rather than a subsample.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

Embrace event-driven computing: Amazon expands DynamoDB with streams, cross-region replication, and database triggers

All Things Distributed

In just three short years, Amazon DynamoDB has emerged as the backbone for many powerful Internet applications such as AdRoll , Druva , DeviceScape , and Battlecamp. An AWS Lambda function is a simpler option that you can use, as it only requires you to code the logic, set it, and forget it. Lambda and DynamoDB take care of the rest.

Database 167
article thumbnail

Expanding the AWS Cloud: Introducing the AWS Europe (London) Region

All Things Distributed

With the launch of the AWS Europe (London) Region, AWS can enable many more UK enterprise, public sector and startup customers to reduce IT costs, address data locality needs, and embark on rapid transformations in critical new areas, such as big data analysis and Internet of Things.

AWS 166
article thumbnail

A one size fits all database doesn't fit anyone

All Things Distributed

We are increasingly seeing customers wanting to build Internet-scale applications that require diverse data models. Amazon Elasticsearch Service (Amazon ES) is purpose built for providing near real-time visualizations and analytics of machine-generated data by indexing, aggregating, and searching semi structured logs and metrics.

Database 167
article thumbnail

Accelerating Data: Faster and More Scalable ElastiCache for Redis

All Things Distributed

Since then we’ve introduced Amazon Kinesis for real-time streaming data, AWS Lambda for serverless processing, Apache Spark analytics on EMR, and Amazon QuickSight for high performance Business Intelligence. Team Internet AG is an ad tech company with a focus on domain monetization and real-time bidding. “In Building upon Redis.

article thumbnail

Bringing the Magic of Amazon AI and Alexa to Apps on AWS.

All Things Distributed

Today, I want to focus on helping app developers who have chosen to develop their apps on AWS and have in the past developed some of the seminal apps of our times on AWS, such as Netflix, AirBnB, or Pinterest or created internet connected devices powered by AWS such as Alexa and Dropcam. Getting started with Rekognition is simple.

AWS 165