article thumbnail

Medallion Architecture: Efficient Batch and Stream Processing Data Pipelines With Azure Databricks and Delta Lake

DZone

In today's data-driven world, organizations need efficient and scalable data pipelines to process and analyze large volumes of data. Medallion Architecture provides a framework for organizing data processing workflows into different zones, enabling optimized batch and stream processing.

Azure 246
article thumbnail

Testing Challenges Related to Microservice Architecture

DZone

Over the last few years, microservice architecture emerged to be on top of conventional SOA (Service Oriented Architecture). This much more precise and smaller architecture brought in many benefits. have backed their performance based on this architecture. have backed their performance based on this architecture.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

Hashnode Creates Scalable Feed Architecture on AWS with Step Functions, EventBridge and Redis

InfoQ

Hashnode created a scalable event-driven architecture (EDA) for composing feed data for thousands of users. The solution leverages Step Functions' distributed maps feature that enables high-concurrency processing. The company used serverless services on AWS, including Lambda, Step Functions, EventBridge, and Redis Cache.

article thumbnail

What Should You Know About Graph Database’s Scalability?

DZone

Having a distributed and scalable graph database system is highly sought after in many enterprise scenarios. Do Not Be Misled Designing and implementing a scalable graph database system has never been a trivial task.

article thumbnail

Why APIs, Service Discovery, and Registry Are Crucial for Your Microservices Architecture

DZone

Microservices architecture is a software development approach that structures an application as a collection of small, independent services, each running in its own process and communicating with lightweight mechanisms, such as APIs.

article thumbnail

Effective Communication Strategies Between Microservices: Techniques and Real-World Examples

DZone

Building scalable systems using microservices architecture is a strategic approach to developing complex applications. This step-by-step guide outlines the process of creating a microservices-based system, complete with detailed examples.

Strategy 279
article thumbnail

Microservices vs. Monolith at a Startup: Making the Choice

DZone

The reality of the startup is that engineering teams are often at a crossroads when it comes to choosing the foundational architecture for their software applications. The allure of a microservice architecture is understandable in today's tech state of affairs, where scalability, flexibility, and independence are highly valued.