article thumbnail

The Power of Caching: Boosting API Performance and Scalability

DZone

Caching is the process of storing frequently accessed data or resources in a temporary storage location, such as memory or disk, to improve retrieval speed and reduce the need for repetitive processing.

Cache 246
article thumbnail

Hashnode Creates Scalable Feed Architecture on AWS with Step Functions, EventBridge and Redis

InfoQ

Hashnode created a scalable event-driven architecture (EDA) for composing feed data for thousands of users. The company used serverless services on AWS, including Lambda, Step Functions, EventBridge, and Redis Cache. The solution leverages Step Functions' distributed maps feature that enables high-concurrency processing.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

Supporting Diverse ML Systems at Netflix

The Netflix TechBlog

In addition to Spark, we want to support last-mile data processing in Python, addressing use cases such as feature transformations, batch inference, and training. We use metaflow.Table to resolve all input shards which are distributed to Metaflow tasks which are responsible for processing terabytes of data collectively.

Systems 226
article thumbnail

Sustainable IT: Optimize your hybrid-cloud carbon footprint

Dynatrace

And while these examples were resolved by just asking a few questions, in many cases, the answers are more elusive, requiring real-time and historical drill-downs into the processes and dependencies specific to each host. Reduce inter-process communications overhead. Implement intelligent retry and failover processes.

Cloud 209
article thumbnail

Designing Instagram

High Scalability

There are two major processes which gets executed when a user posts a photo on Instagram. Firstly, the synchronous process which is responsible for uploading image content on file storage, persisting the media metadata in graph data-storage, returning the confirmation message to the user and triggering the process to update the user activity.

Design 334
article thumbnail

Key Advantages of DBMS for Efficient Data Management

Scalegrid

Despite initial investment costs, DBMS presents long-term savings and improved efficiency through automated processes, efficient query optimizations, and scalability, contributing to enhanced decision-making and end-user productivity. It provides tools for organizing and retrieving data efficiently.

article thumbnail

Dynatrace supports SnapStart for Lambda as an AWS launch partner

Dynatrace

Lambda then takes a snapshot of the memory and disk state of the initialized execution environment, persists the encrypted snapshot, and caches it for low-latency access. Built for enterprise scalability. With SnapStart enabled, function code is initialized once when a function version is published. How does Dynatrace help?

Lambda 225