Design, Scalability, Software and Software Architecture

Architecture Patterns: Publish/Subscribe

DZone

JANUARY 2, 2024

The Publish/Subscribe (Pub/Sub) pattern is a widely-used software architecture paradigm, particularly relevant in the design of distributed, messaging-driven systems. The communication framework is decoupled, scalable, and dynamic, making it useful for addressing complex software requirements in modern application development.

Architecture

Architecture Software Architecture Scalability Design

Scalability?: ?Think in Terms Of TCO

DZone

JUNE 12, 2019

A system that has the ability to easily scale resources to meet the increasing workload without affecting the performance is known as a scalable system. To make an easy-to-scale system, it is crucial to have an evolutionary way of thinking about the software development cycle.

Scalability

Scalability Software Architecture Storage Architecture

Why applying chaos engineering to data-intensive applications matters

Dynatrace

MAY 23, 2024

Stream processing One approach to such a challenging scenario is stream processing, a computing paradigm and software architectural style for data-intensive software systems that emerged to cope with requirements for near real-time processing of massive amounts of data.

Engineering

Engineering Tuning Latency Open Source

Gossip Protocol Explained

High Scalability

JULY 16, 2023

You can subscribe to the system design newsletter to excel in system design interviews and software architecture. The original article was published on systemdesign.one website. What Is Gossip Protocol?

Software Architecture

Software Architecture Website Architecture Systems

UI Design Patterns That Don't Scale

SQL Performance

JULY 8, 2021

I spend a large amount of time translating software requirements into schema and queries. I want to talk about UI design choices that lead to data access patterns that are awkward to implement using SQL Server. That kind of feedback is necessary to help build maintainable, scalable solutions. Sort By Column. Conclusion.

Design

Design Software Architecture Database Servers

Sociotechnical Design Variables

Strategic Tech

MAY 24, 2019

Over the past few years I have focused much of my learning and work choices around learning about the design of sociotechnical systems?—?how how to design software architectures and organise teams around them. As part of good design, we should consider the effects of changing all of these variables.

Design

Design Software Architecture Strategy Technology

Design Patterns: Queue-Based Load Leveling Pattern

cdemi

DECEMBER 4, 2016

Modern software usually involves running tasks that invoke services. Maximizing Scalability : Number of Queues and Services can be varied to meet Demand. Control Costs : You don't have to design your service to meet peak load, but rather average load.

Design

Design Azure Scalability Latency

Design Patterns: Series Introduction

cdemi

MAY 6, 2016

I have decided to write a series on some common and modern Design Patterns that are useful in today's horizontally scalable (such as cloud-hosted) applications. The Competing Consumer Pattern enables a system to process multiple messages concurrently to optimize throughput, to improve scalability and availability.

Design

Design Cache Scalability Architecture

Design Patterns: Cache-Aside Pattern

cdemi

MAY 8, 2016

This post is part of a Design Patterns series. Applications that rely heavily on a data-store usually can benefit greatly from using the Cache-Aside Pattern. If used correctly, this pattern can improve performance and help maintain consistency between the cache and the underlying data store. Reading Data.

Cache

Cache Design C++ Processing

Digital Twins Enable Seamless Use of Edge Computing in IoT

ScaleOut Software

AUGUST 18, 2018

Digital twins are software abstractions that track the behavior of individual devices in IoT applications. What is required is a software architecture that enables seamless migration without requiring application code to be reimplemented for execution on edge-based platforms.

IoT

IoT Ecommerce Analytics Latency

Digital Twins Enable Seamless Use of Edge Computing in IoT

ScaleOut Software

AUGUST 18, 2018

Digital twins are software abstractions that track the behavior of individual devices in IoT applications. What is required is a software architecture that enables seamless migration without requiring application code to be reimplemented for execution on edge-based platforms.

IoT

IoT Ecommerce Analytics Latency

How architecture evolves into strategy

O'Reilly Software

OCTOBER 23, 2018

Likewise, the term "architect" didn't enter popular usage to describe a role in the software field until the late 1990s. It's a given that we must design a system, including a local software architecture, that actually runs, that is "solid." the user experience and design) and within the software construction itself.

Strategy

Strategy Architecture Technology Technology

ABAC on SpiceDB: Enabling Netflix’s Complex Identity Types

The Netflix TechBlog

MAY 19, 2023

To do so Netflix’s design required: An event based mechanism that could ingest information about application autoscaling groups. What was problematic about this design? Over time, each node caches a subset of subproblems to support a distributed cache, reduce the datastore load, and achieve SpiceDB’s horizontal scalability.

Cache

Cache Google Open Source Systems

Primary Sociotechnical Design Heuristics

Strategic Tech

JULY 18, 2018

There are thousands of ways we can shape the software systems we build and organise our teams around them. Yet there is no flowchart we can simply follow to find the optimal design. The products themselves are software systems which grow harder and harder to reason about as they scale and age.

Design

Design Architecture Software Architecture Systems

MLOps and DevOps: Why Data Makes It Different

O'Reilly

OCTOBER 19, 2021

This is both frustrating for companies that would prefer making ML an ordinary, fuss-free value-generating function like software engineering, as well as exciting for vendors who see the opportunity to create buzz around a new category of enterprise software. All ML projects are software projects.

DevOps

DevOps Software Engineering Infrastructure Open Source

Open-Sourcing Metaflow, a Human-Centric Framework for Data Science

The Netflix TechBlog

DECEMBER 3, 2019

mainly because of mundane reasons related to software engineering. The infrastructure should allow them to exercise their freedom as data scientists but it should provide enough guardrails and scaffolding, so they don’t have to worry about software architecture too much. It leverages elasticity of the cloud by design?—?both

Open Source

Open Source AWS Infrastructure Energy

Open-Sourcing Metaflow, a Human-Centric Framework for Data Science

The Netflix TechBlog

DECEMBER 3, 2019

mainly because of mundane reasons related to software engineering. The infrastructure should allow them to exercise their freedom as data scientists but it should provide enough guardrails and scaffolding, so they don’t have to worry about software architecture too much. It leverages elasticity of the cloud by design?—?both

Open Source

Open Source AWS Infrastructure Energy

Design Patterns: Competing Consumer Pattern

cdemi

DECEMBER 7, 2016

Building on the Queue-Based Load Leveling Pattern , the Competing Consumer Pattern enables a system to process multiple messages concurrently to optimize throughput, to improve scalability and availability, and to balance the workload. Scalability : Depending on the backlog of the Queue, consumers can be increased or decreased on the fly.

Design

Design Scalability Systems Processing

The Amazon.com 2010 Shareholder Letter Focusses on Technology.

All Things Distributed

APRIL 27, 2011

Werner Vogels weblog on building scalable and robust distributed systems. Look inside a current textbook on software architecture, and youll find few patterns that we dont apply at Amazon. The storage systems weve pioneered demonstrate extreme scalability while maintaining tight control over performance, availability, and cost.

Technology

Technology Technology AWS Storage

Amazon EC2 Cluster GPU Instances - All Things Distributed

All Things Distributed

NOVEMBER 15, 2010

Werner Vogels weblog on building scalable and robust distributed systems. These trade-offs have even impacted the way the lowest level building blocks in our computer architectures have been designed. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. All Things Distributed.

AWS

AWS Latency Programming Architecture

Technology Performance Pulse

Architecture Patterns: Publish/Subscribe

Scalability?: ?Think in Terms Of TCO

Trending Sources

Why applying chaos engineering to data-intensive applications matters

Gossip Protocol Explained

UI Design Patterns That Don't Scale

Sociotechnical Design Variables

Design Patterns: Queue-Based Load Leveling Pattern

Design Patterns: Series Introduction

Design Patterns: Cache-Aside Pattern

Digital Twins Enable Seamless Use of Edge Computing in IoT

Digital Twins Enable Seamless Use of Edge Computing in IoT

How architecture evolves into strategy

ABAC on SpiceDB: Enabling Netflix’s Complex Identity Types

Primary Sociotechnical Design Heuristics

MLOps and DevOps: Why Data Makes It Different

Open-Sourcing Metaflow, a Human-Centric Framework for Data Science

Open-Sourcing Metaflow, a Human-Centric Framework for Data Science

Design Patterns: Competing Consumer Pattern

The Amazon.com 2010 Shareholder Letter Focusses on Technology.

Amazon EC2 Cluster GPU Instances - All Things Distributed

Stay Connected