ScaleOut Software

JUNE 29, 2018

Having just concluded participation in another In-Memory Computing Summit , it has become even more clear to me that the key to mainstream adoption of in-memory computing software platforms is architecture — the root of a platform’s value to applications. The digital twin model for stateful stream-processing is a case in point.

Software Architecture 40

Software Architecture Architecture Software Software 40

ScaleOut Software

JUNE 29, 2018

Having just concluded participation in another In-Memory Computing Summit , it has become even more clear to me that the key to mainstream adoption of in-memory computing software platforms is architecture — the root of a platform’s value to applications. The digital twin model for stateful stream-processing is a case in point.

Software Architecture 40

Software Architecture Architecture Software Software 40

SQL Performance

JULY 8, 2021

I spend a large amount of time translating software requirements into schema and queries. I want to talk about UI design choices that lead to data access patterns that are awkward to implement using SQL Server. The post UI Design Patterns That Don't Scale appeared first on SQLPerformance.com. Sort By Column. Conclusion.

Design 92

Design Software Architecture Database Servers 92

Strategic Tech

JULY 29, 2021

If you would like to learn or practice how to break up a large business into domains and use them as the foundation for your software architecture and team organization, I have created a strategic domain-driven design kata that you may find useful. Who to invite? I recommend organising attendees into groups of 4–5 people.

Design 52

Design Software Architecture Architecture Strategy 52

Strategic Tech

MAY 24, 2019

Over the past few years I have focused much of my learning and work choices around learning about the design of sociotechnical systems?—?how how to design software architectures and organise teams around them. As part of good design, we should consider the effects of changing all of these variables.

Design 45

Design Software Architecture Strategy Technology 45

Dynatrace

MAY 23, 2022

As the pace of business quickens, software development has adapted. Increasingly, teams release software features more quickly to accommodate customer needs. As a result, organizations are weighing microservices vs. monolithic architecture to improve software delivery speed and quality. What is monolithic architecture?

Architecture 203

Architecture DevOps Monitoring Programming 203

Strategic Tech

NOVEMBER 1, 2021

The 2010s were a turning-point in the history of software engineering. or “How do software architecture, domains, Conway’s Law, Team Topologies, and value streams all fit together?”. Team Flow Event Storming is also a great technique for mapping out and visualizing value stream-like processes collaboratively.

Software Architecture 98

Software Architecture Architecture DevOps Software 98

Strategic Tech

AUGUST 26, 2018

A trip to the supermarket can teach you a lot about designing software systems and shaping teams to build them… I was recently in need of some chocolate sauce. The Chocolate Sauce Heuristic for Software Design There are a few lessons about software development we can learn from this story, but I want to focus on design.

Design 40

Design Software Architecture Architecture Software 40

Strategic Tech

JULY 18, 2018

There are thousands of ways we can shape the software systems we build and organise our teams around them. Yet there is no flowchart we can simply follow to find the optimal design. The products themselves are software systems which grow harder and harder to reason about as they scale and age.

Design 40

Design Architecture Software Architecture Systems 40

O'Reilly

FEBRUARY 18, 2020

Software architecture, infrastructure, and operations are each changing rapidly. The shift to cloud native design is transforming both software architecture and infrastructure and operations. R was designed for use in academic, scientific, and, more recently, commercial use cases.

Software Architecture 132

Software Architecture DevOps Data Engineering Architecture 132

Strategic Tech

OCTOBER 3, 2020

Use them as a starting point for design and discovery, and then bend them to your needs. If you’re not familiar with the Bounded Context Canvas it is a tool for visualising the key design choices of a Bounded Context or a sub-system in your software architecture. What happens if we explore the free design option?

Software Architecture 97

Software Architecture Design Best Practices Architecture 97

The Netflix TechBlog

DECEMBER 3, 2019

mainly because of mundane reasons related to software engineering. We heard many stories about difficulties related to data access and basic data processing. By design, Metaflow is a deceptively simple Python library: Data scientists can structure their workflow as a Directed Acyclic Graph of steps, as depicted above.

Open Source 232

Open Source AWS Infrastructure Energy 232

O'Reilly

OCTOBER 19, 2021

This is both frustrating for companies that would prefer making ML an ordinary, fuss-free value-generating function like software engineering, as well as exciting for vendors who see the opportunity to create buzz around a new category of enterprise software. What does a modern technology stack for streamlined ML processes look like?

DevOps 137

DevOps Software Engineering Infrastructure Open Source 137

Strategic Tech

APRIL 1, 2022

I’ve just created a new kata which you and your team/friends can use to practice your architecture and domain-driven design skills. This kata is split into four sections that address different aspects of architecting software systems. First with a domain quiz, and then by slicing up the provided event storm into domains.

Architecture 52

Architecture Software Architecture Strategy Design 52

Strategic Tech

JULY 22, 2019

In Domain-Driven Design, a large system is decomposed into bounded contexts , which become natural boundaries in code as microservices and as teams in the organisation. The Bounded Context Design Canvas I designed this canvas based on the typical flow of strategic DDD workshops I run publicly and privately.

Design 76

Design Systems Strategy Processing 76

O'Reilly

AUGUST 9, 2022

Designing the prompts to get DALL-E to do something extraordinary requires a new kind of technique that’s very different from understanding pigments and brushes. It’s easy to imagine a lot of software professionals saying, “Of course you’ll have to know C. You have to know what you want to do; you have to have a design in mind.

Programming 104

Programming Java C++ Design 104

Strategic Tech

FEBRUARY 19, 2020

I’ve been disappointed for a long time with the way in which companies organise software development teams. I remember as a young, naive software developer, I assumed there would be structured processes and patterns similar to those used for designing a software architecture. A clear warning sign.

Architecture 64

Architecture Strategy Design Software Architecture 64

The Netflix TechBlog

MAY 19, 2023

To do so Netflix’s design required: An event based mechanism that could ingest information about application autoscaling groups. A cleanup process to prune stale relationships from the database. What was problematic about this design? Their attributes are used to scope permissions to varying degrees.

Cache 249

Cache Google Open Source Systems 249

Strategic Tech

SEPTEMBER 18, 2021

In companies with many teams and many millions of lines of code, including a lot of legacy, there are endless things that can be improved in the product, software, and organization. Choosing where to focus is a balancing act: delivering new products, fixing legacy software, and improving engineering culture.

Strategy 97

Strategy Technology Technology Design 97

The Netflix TechBlog

DECEMBER 3, 2019

mainly because of mundane reasons related to software engineering. We heard many stories about difficulties related to data access and basic data processing. By design, Metaflow is a deceptively simple Python library: Data scientists can structure their workflow as a Directed Acyclic Graph of steps, as depicted above.

Open Source 134

Open Source AWS Infrastructure Energy 134

Adrian Cockcroft

JANUARY 17, 2022

I did a few talks on this subject early in the year, and linked this to the sustainability advantages of serverless architectures. The need for systems to be resilient is still increasing, and chaos engineering tools and techniques are developing as a key way to validate that resilience is working as designed. primarily virtual?—?and

Serverless 98

Serverless Hardware AWS Architecture 98

cdemi

DECEMBER 4, 2016

Modern software usually involves running tasks that invoke services. The service retrieves the messages from the queue and processes them. Control Costs : You don't have to design your service to meet peak load, but rather average load. The queue acts as a buffer , storing the message until it is retrieved by the service.

Design 47

Design Azure Scalability Latency 47

Strategic Tech

MAY 3, 2021

Mapping out your business’s domain landscape has many benefits: knowledge sharing, generating product ideas, providing the foundation for software architecture, aligning on requirements, but a common challenge is… “where do we start?” The high-level structure is not design structure (e.g. Q: What is a domain landscape?

Software Architecture 52

Software Architecture Architecture Design Software 52

cdemi

MAY 8, 2016

This post is part of a Design Patterns series. It may be beneficial to have the application prepopulate the cache as part of the startup process. An item in the data store may be changed at any time by an external process, and this change might not be reflected in the cache until the next time the item is loaded into the cache.

Cache 54

Cache Design C++ Processing 54

Strategic Tech

DECEMBER 20, 2020

Team Topologies has significantly advanced the discussion on organisation design for technology companies. My goal is to create common ground so that we can discuss the trade-offs of organisational design patterns. They are outside of the software. Processes are also a hierarchical concept. The answer is all of them.

Architecture 98

Architecture Design Technology Technology 98

Strategic Tech

SEPTEMBER 30, 2020

One of the biggest time costs in software development is understanding how a system works. As we continuously develop software systems, the complexity slowly increases and we don’t fully realise it. I believe that self-documenting architecture would dramatically reduce one of the big costs in software development.

Architecture 75

Architecture Design Programming Software 75

cdemi

MAY 6, 2016

I have decided to write a series on some common and modern Design Patterns that are useful in today's horizontally scalable (such as cloud-hosted) applications. The Competing Consumer Pattern enables a system to process multiple messages concurrently to optimize throughput, to improve scalability and availability.

Design 40

Design Cache Scalability Architecture 40

cdemi

DECEMBER 7, 2016

Building on the Queue-Based Load Leveling Pattern , the Competing Consumer Pattern enables a system to process multiple messages concurrently to optimize throughput, to improve scalability and availability, and to balance the workload. Systems that use the Competing Consumer Pattern should ensure that message processing is idempotent.

Design 40

Design Scalability Systems Processing 40

Strategic Tech

JANUARY 9, 2024

People use these words to try and articulate the types of work and activities they are referring to, or where they are in the process of building something new. In my work, I often encounter software developers who refer to the software as the solution space. the backlog) and implementing them in software is the solution.

Development 98

Development Strategy Software Software 98

Sutter's Mill

OCTOBER 22, 2010

Elements of Design. At C++ and Beyond next week (and in December) I’ll also be giving a brand-new half-day talk on Elements of Design. Although those areas are pretty diverse, they also have a lot of commonalities, and the insights and learnings apply directly to mainstream classes-and-libraries production software design.

Design 40

Design Lambda C++ Software Architecture 40

The Netflix TechBlog

MARCH 10, 2020

by Damir Svrtan and Sergii Makagon As the production of Netflix Originals grows each year, so does our need to build apps that enable efficiency throughout the entire creative process. We decided to build our app based on principles behind Hexagonal Architecture and Uncle Bob’s Clean Architecture.

Architecture 345

Architecture Transportation Java Strategy 345

ScaleOut Software

AUGUST 18, 2018

In previous blogs , we have explored the power of the digital twin model for stateful stream-processing. Digital twins are software abstractions that track the behavior of individual devices in IoT applications. The digital twin model is worth a close look when designing the next generation of IoT applications.

IoT 45

IoT Ecommerce Analytics Latency 45

Smashing Magazine

NOVEMBER 22, 2021

Now, let’s take a deeper look into the actions and processes we put in place in order to achieve these significant results. There are more challenges for us in addition to scale and diversity: Retaining existing design and behavior. In other words, we needed to find a way to automate the process of preventing performance degradations.

Website 126

Website Performance Google Media 126

ScaleOut Software

AUGUST 18, 2018

In previous blogs , we have explored the power of the digital twin model for stateful stream-processing. Digital twins are software abstractions that track the behavior of individual devices in IoT applications. The digital twin model is worth a close look when designing the next generation of IoT applications.

IoT 40

IoT Ecommerce Analytics Latency 40

Strategic Tech

FEBRUARY 14, 2020

The architecture of the software could be sliced up into a Leasing context and a Car Pool context. Leasing is responsible for managing the leasing process and keeping a historial record of all leases. If the answer is yes, it should probably not be coupled to your specific business process steps.

Architecture 98

Architecture Government Design Availability 98

Strategic Tech

JANUARY 22, 2024

To demonstrate this process, we will build a canvas for the following fictitious example (inspired by real examples from our consulting work): A large logistics company wants to expand into new verticals and integrate its offerings into an emerging open marketplace. They need a more loosely coupled architecture and empowered teams.

Architecture 98

Architecture Metrics Logistics Strategy 98

O'Reilly

MAY 19, 2020

Software engineers represent the largest cohort, comprising almost 20% of all respondents (see Figure 1 ). Technical leads and architects (about 11%) are next, followed by software and systems architects (9+%). Almost one-quarter (23%) of respondents work in the software industry ( Figure 3 ). Respondent Demographics.

Cloud 141

Cloud Serverless AWS Architecture 141