Design, Scalability and Software Architecture - Technology Performance Pulse

Architecture Patterns: Publish/Subscribe

DZone

JANUARY 2, 2024

The Publish/Subscribe (Pub/Sub) pattern is a widely-used software architecture paradigm, particularly relevant in the design of distributed, messaging-driven systems. The communication framework is decoupled, scalable, and dynamic, making it useful for addressing complex software requirements in modern application development.

Architecture

Architecture Software Architecture Scalability Design

Scalability?: ?Think in Terms Of TCO

DZone

JUNE 12, 2019

A system that has the ability to easily scale resources to meet the increasing workload without affecting the performance is known as a scalable system. To make an easy-to-scale system, it is crucial to have an evolutionary way of thinking about the software development cycle.

Scalability

Scalability Software Architecture Storage Architecture

UI Design Patterns That Don't Scale

SQL Performance

JULY 8, 2021

I spend a large amount of time translating software requirements into schema and queries. I want to talk about UI design choices that lead to data access patterns that are awkward to implement using SQL Server. That kind of feedback is necessary to help build maintainable, scalable solutions. Sort By Column. Conclusion.

Design

Design Software Architecture Database Servers

Gossip Protocol Explained

High Scalability

JULY 16, 2023

You can subscribe to the system design newsletter to excel in system design interviews and software architecture. The original article was published on systemdesign.one website. What Is Gossip Protocol?

Software Architecture

Software Architecture Website Architecture Systems

Sociotechnical Design Variables

Strategic Tech

MAY 24, 2019

Over the past few years I have focused much of my learning and work choices around learning about the design of sociotechnical systems?—?how how to design software architectures and organise teams around them. As part of good design, we should consider the effects of changing all of these variables.

Design

Design Software Architecture Strategy Technology

ABAC on SpiceDB: Enabling Netflix’s Complex Identity Types

The Netflix TechBlog

MAY 19, 2023

To do so Netflix’s design required: An event based mechanism that could ingest information about application autoscaling groups. What was problematic about this design? Over time, each node caches a subset of subproblems to support a distributed cache, reduce the datastore load, and achieve SpiceDB’s horizontal scalability.

Cache

Cache Google Open Source Systems

Primary Sociotechnical Design Heuristics

Strategic Tech

JULY 18, 2018

There are thousands of ways we can shape the software systems we build and organise our teams around them. Yet there is no flowchart we can simply follow to find the optimal design. The products themselves are software systems which grow harder and harder to reason about as they scale and age.

Design

Design Architecture Software Architecture Systems

Design Patterns: Series Introduction

cdemi

MAY 6, 2016

I have decided to write a series on some common and modern Design Patterns that are useful in today's horizontally scalable (such as cloud-hosted) applications. The Competing Consumer Pattern enables a system to process multiple messages concurrently to optimize throughput, to improve scalability and availability.

Design

Design Cache Scalability Architecture

Design Patterns: Competing Consumer Pattern

cdemi

DECEMBER 7, 2016

Building on the Queue-Based Load Leveling Pattern , the Competing Consumer Pattern enables a system to process multiple messages concurrently to optimize throughput, to improve scalability and availability, and to balance the workload. Scalability : Depending on the backlog of the Queue, consumers can be increased or decreased on the fly.

Design

Design Scalability Systems Processing

Design Patterns: Queue-Based Load Leveling Pattern

cdemi

DECEMBER 4, 2016

Maximizing Scalability : Number of Queues and Services can be varied to meet Demand. Control Costs : You don't have to design your service to meet peak load, but rather average load. Amazon Simple Queue Service - The Go-To choice if you're already on AWS, Reliable, Simple, Flexible, Scalable, Secure, Inexpensive.

Design

Design Azure Scalability Latency

Open-Sourcing Metaflow, a Human-Centric Framework for Data Science

The Netflix TechBlog

DECEMBER 3, 2019

The infrastructure should allow them to exercise their freedom as data scientists but it should provide enough guardrails and scaffolding, so they don’t have to worry about software architecture too much. It leverages elasticity of the cloud by design?—?both On the surface, this doesn’t seem like much.

Open Source

Open Source AWS Infrastructure Energy

Design Patterns: Cache-Aside Pattern

cdemi

MAY 8, 2016

This post is part of a Design Patterns series. Applications that rely heavily on a data-store usually can benefit greatly from using the Cache-Aside Pattern. If used correctly, this pattern can improve performance and help maintain consistency between the cache and the underlying data store. Reading Data.

Cache

Cache Design C++ Processing

Open-Sourcing Metaflow, a Human-Centric Framework for Data Science

The Netflix TechBlog

DECEMBER 3, 2019

The infrastructure should allow them to exercise their freedom as data scientists but it should provide enough guardrails and scaffolding, so they don’t have to worry about software architecture too much. It leverages elasticity of the cloud by design?—?both On the surface, this doesn’t seem like much.

Open Source

Open Source AWS Infrastructure Energy

The Amazon.com 2010 Shareholder Letter Focusses on Technology.

All Things Distributed

APRIL 27, 2011

Werner Vogels weblog on building scalable and robust distributed systems. Look inside a current textbook on software architecture, and youll find few patterns that we dont apply at Amazon. The storage systems weve pioneered demonstrate extreme scalability while maintaining tight control over performance, availability, and cost.

Technology

Technology Technology AWS Storage

Digital Twins Enable Seamless Use of Edge Computing in IoT

ScaleOut Software

AUGUST 18, 2018

What is required is a software architecture that enables seamless migration without requiring application code to be reimplemented for execution on edge-based platforms. The digital twin model is worth a close look when designing the next generation of IoT applications.

IoT

IoT Ecommerce Analytics Latency

Digital Twins Enable Seamless Use of Edge Computing in IoT

ScaleOut Software

AUGUST 18, 2018

What is required is a software architecture that enables seamless migration without requiring application code to be reimplemented for execution on edge-based platforms. The digital twin model is worth a close look when designing the next generation of IoT applications.

IoT

IoT Ecommerce Analytics Latency

Amazon EC2 Cluster GPU Instances - All Things Distributed

All Things Distributed

NOVEMBER 15, 2010

Werner Vogels weblog on building scalable and robust distributed systems. These trade-offs have even impacted the way the lowest level building blocks in our computer architectures have been designed. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. All Things Distributed.

AWS

AWS Latency Programming Architecture

How architecture evolves into strategy

O'Reilly Software

OCTOBER 23, 2018

It's a given that we must design a system, including a local software architecture, that actually runs, that is "solid." This is supported in real terms through standards and consistent application of conventions, both in the information architecture (i.e., It must be useful, have utility. Solid doesn't mean inflexible.

Strategy

Strategy Architecture Technology Technology

MLOps and DevOps: Why Data Makes It Different

O'Reilly

OCTOBER 19, 2021

Let’s start by considering the job of a non-ML software engineer: writing traditional software deals with well-defined, narrowly-scoped inputs, which the engineer can exhaustively and cleanly model in the code. In effect, the engineer designs and builds the world wherein the software operates. Software Architecture.

DevOps

DevOps Software Engineering Infrastructure Open Source

Technology Performance Pulse

Architecture Patterns: Publish/Subscribe

Scalability?: ?Think in Terms Of TCO

Trending Sources

UI Design Patterns That Don't Scale

Gossip Protocol Explained

Sociotechnical Design Variables

ABAC on SpiceDB: Enabling Netflix’s Complex Identity Types

Primary Sociotechnical Design Heuristics

Design Patterns: Series Introduction

Design Patterns: Competing Consumer Pattern

Design Patterns: Queue-Based Load Leveling Pattern

Open-Sourcing Metaflow, a Human-Centric Framework for Data Science

Design Patterns: Cache-Aside Pattern

Open-Sourcing Metaflow, a Human-Centric Framework for Data Science

The Amazon.com 2010 Shareholder Letter Focusses on Technology.

Digital Twins Enable Seamless Use of Edge Computing in IoT

Digital Twins Enable Seamless Use of Edge Computing in IoT

Amazon EC2 Cluster GPU Instances - All Things Distributed

How architecture evolves into strategy

MLOps and DevOps: Why Data Makes It Different

Stay Connected