The Netflix TechBlog

SEPTEMBER 29, 2022

Timestone: Netflix’s High-Throughput, Low-Latency Priority Queueing System with Built-in Support for Non-Parallelizable Workloads by Kostas Christidis Introduction Timestone is a high-throughput, low-latency priority queueing system we built in-house to support the needs of Cosmos , our media encoding platform. Over the past 2.5

Latency 212

Latency Systems Media Serverless 212

InfoQ

APRIL 26, 2024

Lily Mara, Hunter Laine walk through the design of a system, its performance characteristics, and how they scaled it. By Lily Mara, Hunter Laine

Design 89

Design Systems Performance Scalability 89

Dynatrace

MAY 2, 2024

Additionally, blind spots in cloud architecture are making it increasingly difficult for organizations to balance application performance with a robust security posture. At this year’s RSA conference, taking place in San Francisco from May 6-9, presenters will explore ideas such as redefining security in the age of AI.

Artificial Intelligence 235

Artificial Intelligence Cloud Best Practices DevOps 235

Strategic Tech

MARCH 16, 2021

I believe that attitude towards the design of code and architecture is one of them. In my experience, the culture is better and the results are better in orgs where engineers and architects obsess over the design of code and architecture. Both valuing design and striving for continuous delivery are necessary.

Software Engineering 80

Software Engineering Design Engineering Software 80

Smashing Magazine

OCTOBER 15, 2021

Tips And Tricks For Evaluating UX/UI Designers. Tips And Tricks For Evaluating UX/UI Designers. When a company’s digital representation lacks a dedicated UX/UI design team, it can be hard to produce something that stands out from the crowd. That happens when your app/website/system is efficient. Nataliya Sambir.

Design 113

Design Website Efficiency Games 113

Dynatrace

MAY 23, 2024

Stream processing One approach to such a challenging scenario is stream processing, a computing paradigm and software architectural style for data-intensive software systems that emerged to cope with requirements for near real-time processing of massive amounts of data. We designed experimental scenarios inspired by chaos engineering.

Engineering 185

Engineering Tuning Latency Open Source 185

Dynatrace

JANUARY 23, 2024

At this year’s Perform, we are thrilled to have our three strategic cloud partners, Amazon Web Services (AWS), Microsoft Azure, and Google Cloud Platform (GCP), returning as both sponsors and presenters to share their expertise about cloud modernization and observability of generative AI models. What will the new architecture be?

Cloud 217

Cloud Artificial Intelligence Performance AWS 217

DZone

DECEMBER 28, 2020

The system could work efficiently with a specific number of concurrent users; however, it may get dysfunctional with extra loads during peak traffic. With rising competition in the digital world and the requirement to be present in the top rank of the category, makes performance tests crucial for companies.

Performance Testing 220

Performance Testing Testing Tools Testing Performance 220

Scalegrid

MARCH 14, 2024

Understanding Hybrid Cloud Strategy A hybrid cloud merges the capabilities of public and private clouds into a singular, coherent system. The architecture usually integrates several private, public, and on-premises infrastructures. We will examine each of these elements in more detail.

Strategy 130

Strategy Cloud Artificial Intelligence Infrastructure 130

Dynatrace

JANUARY 18, 2024

DevOps tools , security response systems , search technologies, and more have all benefited from AI technology’s progress. To some, it’s a design methodology — a foundational pillar of the AI model development process. The functionality and complexity of business-oriented AI applications have increased exponentially.

Artificial Intelligence 217

Artificial Intelligence Healthcare Government Technology 217

Dynatrace

JANUARY 31, 2024

While off-the-shelf models assist many organizations in initiating their journeys with generative AI (GenAI), scaling AI for enterprise use presents formidable challenges. GenAI is prone to erratic behavior due to unforeseen data scenarios or underlying system issues.

Cache 209

Cache Azure Infrastructure Monitoring 209

InfoQ

JUNE 23, 2023

Frank Yu discusses how to decrease bandwidth usage and buffering across the system, protect against thundering herd problems, and simplify the logic of gateway and persistence services. By Frank Yu

Systems 52

Systems Design Scalability Architecture 52

Adrian Cockcroft

JANUARY 20, 2023

on Myths and Legends of High Performance Computing  — it’s a somewhat light-hearted look at some of the same issues by the leader of the team that built the Fugaku system I mention below. Next generation architectures will use CXL3.0 HPCG is led by Japan’s RIKEN Fugaku system at 16 petaflops, which is 3% of it’s peak capacity.

Architecture 52

Architecture Latency Benchmarking AWS 52

The Netflix TechBlog

JUNE 13, 2023

This is where large-scale system migrations come into play. Our previous blog post presented replay traffic testing — a crucial instrument in our toolkit that allows us to implement these transformations with precision and reliability. Canaries and sticky canaries are valuable tools in the system migration process.

Traffic 279

Traffic Metrics Systems Strategy 279

The Netflix TechBlog

AUGUST 29, 2023

Today we have a wealth of tools, both OSS and commercial, all designed for cloud-native environments. To improve availability, we designed systems where components could fail separately and avoid single points of failure. Eureka and Ribbon presented a simple but powerful interface, which made adopting them easy.

Traffic 220

Traffic Latency Cloud C++ 220

The Netflix TechBlog

JANUARY 10, 2024

This architecture shift greatly reduced the processing latency and increased system resiliency. By integrating with studio content systems, we enabled the pipeline to leverage rich metadata from the creative side and create more engaging member experiences like interactive storytelling.

Processing 229

Processing Media Latency Innovation 229

The Netflix TechBlog

MARCH 7, 2023

We designed a unique concept called Annotation Operations which allows teams to create data pipelines and easily write annotations without worrying about access patterns of their data from different applications. But we cannot search or present low latency retrievals from files Etc. This is obviously very expensive.

Media 264

Media Latency Architecture Database 264

Dynatrace

FEBRUARY 15, 2023

Introducing Metrics on Grail Despite their many advantages, modern cloud-native architectures can result in scalability and fragmentation challenges. For more complex cloud-native architectures, adding more services and applications leads to a massive increase in the volume of collected traces.

Analytics 235

Analytics Social Media Metrics Efficiency 235

The Netflix TechBlog

NOVEMBER 3, 2022

In the time since it was first presented as an advanced Mesos framework, Titus has transparently evolved from being built on top of Mesos to Kubernetes, handling an ever-increasing volume of containers. As the number of Titus users increased over the years, the load and pressure on the system increased substantially.

Cache 224

Cache Latency Traffic Systems 224

Strategic Tech

JANUARY 24, 2021

As a system grows, higher-order abstractions are needed for ease of understanding, communication, and management. Individual teams may be full-stack/end-to-end or dedicated presentation/domain teams. An Experience Group is a collection of teams which handle only experience and presentation concerns.

Architecture 98

Architecture Mobile Infrastructure Cloud 98

Scalegrid

JANUARY 5, 2024

If you’re considering a database management system, understanding these benefits is crucial. Despite initial investment costs, DBMS presents long-term savings and improved efficiency through automated processes, efficient query optimizations, and scalability, contributing to enhanced decision-making and end-user productivity.

Efficiency 147

Efficiency Storage Database Scalability 147

O'Reilly Software

OCTOBER 23, 2018

I should start by saying this section does not offer a treatise on how to do architecture. Technology systems are difficult to wrangle. Our systems grow in accidental complexity and complication over time. Vitruvius and the principles of architecture. Architecture begins when someone has a nontrivial problem to be solved.

Strategy 100

Strategy Architecture Technology Technology 100

All Things Distributed

MAY 19, 2017

We decided to use our inventive powers to design and build a new database engine that would give database systems such as MySQL and PostgreSQL reliability and performance at scale, at a level that could serve even the most demanding OLTP applications.

Database 117

Database Design Cloud Storage 117

Strategic Tech

DECEMBER 29, 2020

The systems we build are composed of many pieces. How should we slice up the system and divide responsibilities among teams in our organisation? In Part 1 of this series, a shared language was proposed to accurately describe different elements of a business’s architecture. From mobile apps, to domains, to user journeys.

Architecture 59

Architecture Design Mobile Systems 59

The Netflix TechBlog

AUGUST 17, 2023

The tool provides an efficient way for creatives (photo editors, artwork designers, etc.) With the AVA Discovery View, all the prominent characters of the title and their best possible shots are presented to the creatives. For Visual Search We found that the model was influenced by the text present in the image.

Media 169

Media Scalability Architecture Strategy 169

Percona

APRIL 17, 2023

In this blog post, we will discuss the best practices on the MongoDB ecosystem applied at the Operating System (OS) and MongoDB levels. Operating System (OS) settings Swappiness Swappiness is a Linux kernel setting that influences the behavior of the Virtual Memory manager when it needs to allocate a swap, ranging from 0-100.

Best Practices 52

Best Practices Design Tuning Database 52

Dynatrace

AUGUST 25, 2023

Program staff depend on the reliable functioning of critical program systems and infrastructure to provide the best service delivery to the communities and citizens HHS serves, from newborn infants to persons requiring health services to our oldest citizens. Both can result in lost productivity for IT teams and staff in the field.

Government 209

Government Infrastructure Programming Cloud 209

Dynatrace

JUNE 9, 2023

Data scale and silos present challenges to DevOps maturity DevOps teams often run into problems trying to drive better data-driven decisions with observability and security data. That’s because of the heterogeneity of the data their environments generate and the limitations of the systems they rely on to analyze this information.

DevOps 189

DevOps Analytics Storage Metrics 189

Dynatrace

MAY 8, 2023

Consumers expect personalized, proactive, and convenient service, which traditional application architectures often struggle to provide. It often involves replacing legacy systems and workflows that have been in place for years or even decades. Improved customer experience. Competitive advantage.

Strategy 180

Strategy Retail DevOps Education 180

Dynatrace

DECEMBER 2, 2020

As more organizations transition to distributed services, IT teams are experiencing the limitations of traditional monitoring tools, which were designed for yesterday’s monolithic architectures. The architects and developers who create the software must design it to be observed. Dynatrace news.

DevOps 154

DevOps Monitoring Cloud Artificial Intelligence 154

Percona

JUNE 22, 2023

Defining high availability In general terms, high availability refers to the continuous operation of a system with little to no interruption to end users in the event of hardware or software failures, power outages, or other disruptions. Some disruption might occur, but it will be minimal. Fault tolerance aims for zero downtime and data loss.

Availability 105

Availability Database Open Source Hardware 105

The Netflix TechBlog

NOVEMBER 14, 2023

In this context, managing the data, especially when it arrives late, can present a substantial challenge! In this three-part blog post series, we introduce you to Psyberg , our incremental data processing framework designed to tackle such challenges! Given our role on this critical path, accuracy is paramount.

Data Engineering 264

Data Engineering Engineering Processing Games 264

The Netflix TechBlog

FEBRUARY 9, 2021

The whole system was quite complex, and starting to become brittle. Plus, the architecture of the Edge tier was evolving to a PaaS (platform as a service) model, and we had some tough decisions to make about how, and where, to handle identity token handling. The API server orchestrates backend systems to authenticate the user.

Architecture 221

Architecture Latency Servers Website 221

Adrian Cockcroft

JANUARY 17, 2022

photo taken by Adrian Cockcroft A year ago I did a talk at re:Invent called Architecture Trends and Topics for 2021 , so I thought it was worth seeing how they played out and updating them for the coming year. I did a few talks on this subject early in the year, and linked this to the sustainability advantages of serverless architectures.

Serverless 98

Serverless Hardware AWS Architecture 98

Dynatrace

JUNE 17, 2021

Though, it’s typically impossible to remediate all known security vulnerabilities so enterprises need a better solution for identifying those detected security vulnerabilities that present the greatest risk. Teams also use information about applications or system architecture for prioritization.

Open Source 207

Open Source Internet Internet Cloud 207

Percona

JULY 7, 2023

Unfortunately, using certain open source database software as part of an HA architecture can present significant challenges. Despite all its upside, PostgreSQL software presents such challenges. Where a high availability design once worked well, it can no longer keep up with more complex requirements.

Availability 82

Availability Open Source Architecture Database 82

Strategic Tech

MAY 24, 2019

Over the past few years I have focused much of my learning and work choices around learning about the design of sociotechnical systems?—?how how to design software architectures and organise teams around them. As part of good design, we should consider the effects of changing all of these variables.

Design 45

Design Software Architecture Strategy Technology 45