Dynatrace

AUGUST 25, 2023

Further, legacy custom-developed apps were not built to meet the present-day user experience that HHS clients and partners expect. HHS tends to have large numbers of systems, networks, and devices, which collectively increase complexity and the potential for failure, as does unsupported legacy tech.

Government 200

Government Infrastructure Programming Cloud 200

The Netflix TechBlog

FEBRUARY 13, 2024

However, each of these methods presents a unique trade-off: you have to choose between controlling the test fixture and setup, or controlling the test driver. This approach has its own set of challenges: Difficulty in making calls to an alternative API endpoint without implementing custom network layer API rewrite rules.

Testing 244

Testing Code Servers Testing Tools 244

The Netflix TechBlog

NOVEMBER 14, 2023

In this context, managing the data, especially when it arrives late, can present a substantial challenge! In this three-part blog post series, we introduce you to Psyberg , our incremental data processing framework designed to tackle such challenges! Given our role on this critical path, accuracy is paramount.

Data Engineering 264

Data Engineering Engineering Processing Games 264

Scalegrid

JANUARY 5, 2024

Despite initial investment costs, DBMS presents long-term savings and improved efficiency through automated processes, efficient query optimizations, and scalability, contributing to enhanced decision-making and end-user productivity. Types of DBMS DBMS can be classified into hierarchical, network, relational, and object-oriented types.

Efficiency 147

Efficiency Storage Database Scalability 147

Strategic Tech

JULY 22, 2019

In Domain-Driven Design, a large system is decomposed into bounded contexts , which become natural boundaries in code as microservices and as teams in the organisation. The Bounded Context Design Canvas I designed this canvas based on the typical flow of strategic DDD workshops I run publicly and privately.

Design 76

Design Systems Strategy Processing 76

The Netflix TechBlog

AUGUST 30, 2021

System Setup Architecture The following diagram summarizes the architecture description: Figure 1: Event-sourcing architecture of the Device Management Platform. When a new hardware device is connected, the Local Registry detects and collects a set of information about it, such as networking information and ESN.

Latency 213

Latency Traffic Transportation Hardware 213

ACM Sigarch

APRIL 26, 2018

APU: Accelerated Processing Unit is the AMD’s Fusion architecture that integrates both CPU and GPU on the same die. BPU: Brain Processing Unit is the design of the AI chips by Horizon Robotics. With its modular architecture, DLA is scalable, highly configurable, and designed to simplify integration and portability.

Hardware 99

Hardware Artificial Intelligence Architecture Google 99

Percona

MAY 8, 2023

Improved design The new Inventory page now provides a much clearer design and emphasizes useful information while downplaying reference details like service labels and IDs. ” To answer this question, you would have had to search by ID in a few places and be familiar with PMM’s internal architecture.

Monitoring 79

Monitoring Database Metrics Tuning 79

Rigor

JANUARY 13, 2020

These are the bestsellers in the web performance field, including the good old Speed Up Your Site (2003) by Andy King; Steve Souders’ Even Faster Web Sites (2009) ; Ilya Grigorik’s High Performance Browser Networking (2013) ; Tammy Everts’ Time is Money (2016) ; and a handful of more recent publications. Time is Money.

Performance 75

Performance Social Media Website Website Performance 75

InfoQ

MAY 13, 2022

In this article, I want to present a simple cloud architecture that can allow an organization to take monolithic applications to the cloud incrementally without a dramatic change in the architecture. We will discuss the minimal requirements and basic components to take advantage of the scalability of the cloud.

Cloud 65

Cloud Architecture Scalability Network 65

The Morning Paper

MARCH 8, 2020

This paper describes the design decisions behind the Snowflake cloud-based data warehouse. This paper presents Snowflake design and implementation along with a discussion on how recent changes in cloud infrastructure (emerging hardware, fine-grained billing, etc.) From shared-nothing to disaggregation. Workload characteristics.

Storage 112

Storage Engineering Cache Serverless 112

InfoQ

JANUARY 12, 2021

In this article, we’ll briefly outline the use-case for a library like Donkey and present our benchmarks. Finally, we will discuss Clojure and immutability, and some of our design decisions. By Yaron Elyashiv.

Benchmarking 120

Benchmarking Performance Design Network 120

Jos

JUNE 2, 2018

presented in Google IO 2018 ( source ) These tools make it easier to determine where we need to put emphasis to improve our sites. UI/UX : There is usually a designer and/or UX person that sets the look & feel and information architecture. Simulate bad network conditions and slow CPUs and make your project resilient.

Performance 237

Performance Speed Google Media 237

Brendan Gregg

FEBRUARY 28, 2023

DDR6: Here's What to Expect in RAM Modules,” [link] Nov 2020 - [Salter 20] Jim Salter, “Western Digital releases new 18TB, 20TB EAMR drives,” [link] Jul 2020 - [Spier 20] Martin Spier, Brendan Gregg, et al.,

Performance 110

Performance Latency Cache Virtualization 110

The Netflix TechBlog

SEPTEMBER 3, 2021

Remote calls are never free; they impose extra latency, increase probability of an error, and consume network bandwidth. How can we achieve a similar functionality when designing our gRPC APIs? There are a number of utilities and conventions on how to use this message when it is present in an RPC request.

Design 245

Design Java Efficiency Code 245

The Netflix TechBlog

JUNE 4, 2019

Because microprocessors are so fast, computer architecture design has evolved towards adding various levels of caching between compute units and the main memory, in order to hide the latency of bringing the bits to the brains. We are working on multiple fronts to extend the solution presented here.

Cache 251

Cache Latency Airlines Logistics 251

O'Reilly

APRIL 23, 2024

Back in 1971, in a talk called “ Designing Organizations for an Information-rich World ,” political scientist Herbert Simon noted that the cost of information is not just money spent to acquire it but the time it takes to consume it. What is the limited resource that they control and monopolize? It’s not our data. It’s our attention.

Social Media 108

Social Media Google Internet Internet 108

ACM Sigarch

MARCH 25, 2019

Part 1 previously discussed Bottleneck Analysis and Little’s Law, while this post (Part 2) presents the M/M/1 Queue. It also presented Bottleneck Analysis and Little’s Law that can give initial answers to questions like: What is the maximum throughput through several subsystems in series and parallel?

Systems 53

Systems Latency Performance C++ 53

Scalegrid

FEBRUARY 8, 2024

Their design emphasizes increasing availability by spreading out files among different nodes or servers — this approach significantly reduces risks associated with losing or corrupting data due to node failure. Variations within these storage systems are called distributed file systems.

Storage 130

Storage Systems Big Data Azure 130

The Symphonia

JUNE 19, 2018

This summer also marks the 4-yearly event that is La Copa Mundial (we only get Telemundo in my apartment, not Fox Sports Network) but since the good old US of A are absent from the men’s World Cup this year, football fever is distinctly frigid. This track was a good state-of-the-union type affair, so I thought I’d share what was presented.

Serverless 40

Serverless AWS DevOps Open Source 40

Jos

JUNE 2, 2018

presented in Google IO 2018 ( source ). Security : Hopefully there’s a team or individual with deep knowledge about security that help us reviewing system designs, implementations, and informs us about reports or and security patches. Simulate bad network conditions and slow CPUs and make your project resilient.

Performance 130

Performance Speed Google Media 130

Brendan Gregg

FEBRUARY 28, 2023

DDR6: Here's What to Expect in RAM Modules,” [link] , Nov 2020 [Salter 20] Jim Salter, “Western Digital releases new 18TB, 20TB EAMR drives,” [link] , Jul 2020 [Spier 20] Martin Spier, Brendan Gregg, et al.,

Performance 52

Performance Latency Cache Virtualization 52

Scalegrid

MARCH 14, 2024

The architecture usually integrates several private, public, and on-premises infrastructures. Key Components of Hybrid Cloud Infrastructure A hybrid cloud architecture usually merges a public Infrastructure-as-a-Service (IaaS) platform with private computing assets and incorporates tools to manage these combined environments.

Strategy 130

Strategy Cloud Artificial Intelligence Infrastructure 130

Adrian Cockcroft

JUNE 21, 2022

The early days at Sun Cambridge were special, I absorbed a lot about networking and the technical side of the role from my fellow systems engineer Martin Baines, and we were driving all over the region in cool company cars (I had a Citroen BX 16V) selling a really hot product.

Tuning 52

Tuning Benchmarking Engineering C++ 52

cdemi

JUNE 10, 2017

Simply put, a Byzantine Fault is a fault that presents different symptoms to different observers. Several system architectures were designed that implement Byzantine Fault Tolerance. Similarly, a Byzantine Failure is the loss of a system component due to a Byzantine Fault in a distributed system that requires consensus.

Blockchain 62

Blockchain Latency Systems C++ 62

The Morning Paper

JUNE 13, 2019

HotOS’19 is presenting me with something of a problem as there are so many interesting looking papers in the proceedings this year it’s going to be hard to cover them all! Different hardware architectures (CPUs, GPUs, TPUs, FPGAs, ASICs, …) offer different performance and cost trade-offs. HotOS’19. The last word.

Hardware 58

Hardware Latency Serverless Energy 58

The Netflix TechBlog

FEBRUARY 9, 2021

A few years ago, we decided to address this complexity by spinning up a new initiative, and eventually a new team, to move the complex handling of user and device authentication, and various security protocols and tokens, to the edge of the network, managed by a set of centralized services, and a single team. We are serving over 2.5

Architecture 221

Architecture Latency Servers Website 221

Scalegrid

JANUARY 8, 2024

Discover key insights and strategic advice in our article, designed to steer you toward the best cloud solution that fits your company’s priorities. Challenges of Multi-Cloud Although multi-cloud has its benefits, it also presents some obstacles. This enables businesses to fully utilize all the benefits provided by such arrangements.

Strategy 147

Strategy Cloud Scalability Artificial Intelligence 147

Adrian Cockcroft

JANUARY 20, 2023

Here’s some predictions I’m making: Jack Dongarra’s efforts to highlight the low efficiency of the HPCG benchmark as an issue will influence the next generation of supercomputer architectures to optimize for sparse matrix computations. Next generation architectures will use CXL3.0 Next generation architectures will use CXL3.0

Architecture 52

Architecture Latency Benchmarking AWS 52

Percona

APRIL 17, 2023

The swap issue is explained in the excellent article by Jeremy Cole at the Swap Insanity and NUMA Architecture. This schema design approach ensures data consistency and enables complex queries involving multiple tables, but it can be rigid and may pose scaling challenges as data volume increases.

Best Practices 52

Best Practices Design Tuning Database 52

Dynatrace

MAY 15, 2020

Overcoming the barriers presented by legacy security practices that are typically manually intensive and slow, requires a DevSecOps mindset where security is architected and planned from project conception and automated for speed and scale throughout where possible. Challenge: Monitoring processes for anomalous behavior.

Government 222

Government DevOps Infrastructure Network 222

Percona

JULY 7, 2023

Unfortunately, using certain open source database software as part of an HA architecture can present significant challenges. Despite all its upside, PostgreSQL software presents such challenges. Where a high availability design once worked well, it can no longer keep up with more complex requirements.

Availability 85

Availability Open Source Architecture Database 85

Dynatrace

MAY 31, 2021

Although Kubernetes simplifies application development while increasing resource utilization, it is a complex system that presents its own challenges. What challenges does it present, and how can you overcome them? Containers and microservices: A revolution in the architecture of distributed systems. Where does it come from?

Virtualization 132

Virtualization DevOps Infrastructure Cloud 132

The Netflix TechBlog

NOVEMBER 3, 2022

In the time since it was first presented as an advanced Mesos framework, Titus has transparently evolved from being built on top of Mesos to Kubernetes, handling an ever-increasing volume of containers. The original assumptions and architectural choices were no longer viable.

Cache 224

Cache Latency Traffic Systems 224

The Netflix TechBlog

JANUARY 10, 2024

This architecture shift greatly reduced the processing latency and increased system resiliency. When Reloaded was designed, we focused on a single use case: converting high-quality media files (also known as mezzanines) received from studios into compressed assets for Netflix streaming.

Processing 229

Processing Media Latency Innovation 229

Percona

JUNE 22, 2023

Typically, the servers are configured in a primary/replica configuration, with one server designated as the primary server that handles all incoming requests and the others designated as replica servers that monitor the primary and take over its workload if it fails.

Availability 110

Availability Database Open Source Hardware 110

Dynatrace

DECEMBER 2, 2020

As more organizations transition to distributed services, IT teams are experiencing the limitations of traditional monitoring tools, which were designed for yesterday’s monolithic architectures. The architects and developers who create the software must design it to be observed. Dynatrace news. Observability defined.

DevOps 150

DevOps Monitoring Cloud Artificial Intelligence 150