The Netflix TechBlog

MARCH 10, 2023

This feature support required a significant update in the data table design (which includes new tables and updating existing table columns). Data Sharding strategy in elasticsearch is updated to provide low search latency (as described in blog post) Design of new Cassandra reverse indices to support different sets of queries.

Media 237

Media Traffic Processing Design 237

Dynatrace

AUGUST 27, 2019

Welcome back to the blog series in which we share how you can easily solve three common problem scenarios by using Dynatrace and xMatters Flow Designer. This is where xMatters Flow Designer comes into play, by automating remediation steps at the touch of a button. Step 5 – xMatters triggers a runbook in Ansible to fix the disk latency.

Systems 176

Systems DevOps Latency Azure 176

The Netflix TechBlog

MARCH 7, 2024

Since its inception , Metaflow has been designed to provide a human-friendly API for building data and ML (and today AI) applications and deploying them in our production infrastructure frictionlessly. In other cases, it is more convenient to share the results via a low-latency API.

Systems 226

Systems Media Cache Open Source 226

Randon ASCII

JANUARY 12, 2022

That meant I started having regular meetings with the hardware engineers who were working with IBM on the CPU which gave me even more expertise on this CPU, which was critical in helping me discover a design flaw in one of its instructions , and in helping game developers master this finicky beast. So, anyway. I wrote a lot of benchmarks.

Cache 126

Cache Latency Benchmarking Hardware 126

The Netflix TechBlog

AUGUST 30, 2021

By Benson Ma , Alok Ahuja Introduction At Netflix, hundreds of different device types, from streaming sticks to smart TVs, are tested every day through automation to ensure that new software releases continue to deliver the quality of the Netflix experience that our customers enjoy. In this blog post, we will focus on the latter feature set.

Latency 213

Latency Traffic Transportation Cloud 213

Brendan Gregg

JULY 4, 2021

## References I've reproduced the talk references below, so you can click on links: - [Gregg 08] Brendan Gregg, “ZFS L2ARC,” [link] Jul 2008 - [Gregg 10] Brendan Gregg, “Visualizations for Performance Analysis (and More),” [link] 2010 - [Greenberg 11] Marc Greenberg, “DDR4: Double the speed, double the latency? Ford, et al., “TCP

Performance 140

Performance Latency Hardware Storage 140

Brendan Gregg

FEBRUARY 28, 2023

My personal opinion is that I don't see a widespread need for more capacity given horizontal scaling and servers that can already exceed 1 Tbyte of DRAM; bandwidth is also helpful, but I'd be concerned about the increased latency for adding a hop to more memory. Ford, et al., “TCP

Performance 110

Performance Latency Cache Virtualization 110

ACM Sigarch

MAY 31, 2023

using Compute Express Link or CXL), organizing memory components for optimal performance, adapting system software traditionally designed for homogeneous memory systems, and developing memory abstractions and programming constructs for HCM management. Figure 2: Latency characteristics of memory technologies (source: Maruf et al.,

Latency 52

Latency Hardware Cache Architecture 52

Dynatrace

DECEMBER 2, 2021

Error budgets allow development teams to make informed decisions between new development vs operations and polishing existing software. Generally, SLOs are important because they: Improve software quality. It is inevitable that software can break. For example, if your SLO guarantees 99.5% What are SLIs? Watch webinar now!

Metrics 184

Metrics Best Practices DevOps Infrastructure 184

Dynatrace

DECEMBER 15, 2022

ITOps refers to the process of acquiring, designing, deploying, configuring, and maintaining equipment and services that support an organization’s desired business outcomes. Besides the traditional system hardware, storage, routers, and software, ITOps also includes virtual components of the network and cloud infrastructure.

Artificial Intelligence 195

Artificial Intelligence DevOps Hardware Virtualization 195

cdemi

DECEMBER 4, 2016

Modern software usually involves running tasks that invoke services. Control Costs : You don't have to design your service to meet peak load, but rather average load. Apache Kafka - High-Throughput, Low-Latency, Uses Apache ZooKeeper for Distribution, Written in Scala and Java. Considerations.

Design 47

Design Azure Scalability Latency 47

Dynatrace

FEBRUARY 2, 2022

Architecting service-level objectives (SLOs) , along with service-level agreements and service-level indicators, is a great way for teams to evaluate and measure software performance that stays within error budgets. service availability with <50ms latency for an application with no revenue impact. But there are SLO pitfalls.

DevOps 189

DevOps Metrics Best Practices Latency 189

Dynatrace

APRIL 5, 2021

But with the benefits also come concerns about observability, and how to monitor and manage ever-expanding cloud software stacks. AWS continues to improve how it handles latency issues. Organizations are realizing the cost savings and management benefits of serverless automation. The Amazon Web Services ecosystem.

Lambda 175

Lambda AWS Serverless Hardware 175

Dynatrace

APRIL 26, 2022

STM generates traffic that replicates the typical path or behavior of a user on a network to measure performance for example, response times, availability, packet loss, latency, jitter, and other variables). One use case for STM is to model the behavior of a customer in the form of a flow of transactions along the buyer’s journey.

Monitoring 196

Monitoring Social Media IoT Metrics 196

The Netflix TechBlog

NOVEMBER 22, 2019

This entertaining romp through the tech stack serves as an introduction to how we think about and design systems, the Netflix approach to operational challenges, and how other organizations can apply our thought processes and technologies. Technology advancements in content creation and consumption have also increased its data footprint.

AWS 100

AWS Entertainment Open Source Benchmarking 100

The Netflix TechBlog

NOVEMBER 22, 2019

This entertaining romp through the tech stack serves as an introduction to how we think about and design systems, the Netflix approach to operational challenges, and how other organizations can apply our thought processes and technologies. Technology advancements in content creation and consumption have also increased its data footprint.

AWS 100

AWS Entertainment Open Source Benchmarking 100

VoltDB

MARCH 13, 2024

Maintain control This may sound a bit crazy, but if you’re going to own the latency/availability SLA, then you need to ‘own’ as much of the call path as possible. Reconcile modern DevOps practices with the need for stability We used to rarely upgrade software. What you own, you control.

Availability 52

Availability Latency DevOps Systems 52

The Morning Paper

OCTOBER 11, 2020

Orbital Edge Computing (OEC) is designed to do just that. OEC nanosatellites also run local software for autonomous control, modelling the satellite’s position in time and space, and achievable bitrate, to determine when to communicate and what to communicate (raw data or processed images). Introducing Orbital Edge Computing (OEC).

Systems 125

Systems Latency Architecture Energy 125

All Things Distributed

NOVEMBER 12, 2018

The AWS GovCloud (US-East) Region is located in the eastern part of the United States, providing customers with a second isolated Region in which to run mission-critical workloads with lower latency and high availability. By using AWS, they have been able to reduce the time to build, test, and scale software from weeks to hours.

AWS 117

AWS Healthcare Cloud Government 117

Scalegrid

MARCH 22, 2024

They can also bolster uptime and limit latency issues or potential downtimes. It’s important to ensure the bells and whistles of any software-as-a-service (SaaS) they offer can support where you aim to take your business, keeping your strategy tight and on track. Scalegrid: Your Multi-Cloud Strategy Solution ScaleGrid.io

Strategy 130

Strategy Cloud Government Innovation 130

Percona Community

OCTOBER 23, 2020

It’s a new generation in storage software, designed for super high speed low latency NVMe devices. Mayastor + SPDK + NVMe = fast databases Mayastor is new tech, it’s fast, and it’s based on SPDK. Why is SPDK exciting?

Storage 52

Storage Latency Speed Database 52

Brendan Gregg

FEBRUARY 28, 2023

My personal opinion is that I don't see a widespread need for more capacity given horizontal scaling and servers that can already exceed 1 Tbyte of DRAM; bandwidth is also helpful, but I'd be concerned about the increased latency for adding a hop to more memory. Ford, et al., “TCP

Performance 52

Performance Latency Cache Virtualization 52

The Netflix TechBlog

OCTOBER 19, 2020

Now let’s look at how we designed the tracing infrastructure that powers Edgar. If we had an ID for each streaming session then distributed tracing could easily reconstruct session failure by providing service topology, retry and error tags, and latency measurements for all service calls. What’s next?

Infrastructure 233

Infrastructure Transportation Storage Open Source 233

VoltDB

MARCH 22, 2024

This can lead to a ‘camel-is -a-horse designed-by-committee’ situation, where the resulting API is more a reflection of battling political wills than technical common sense. Given that the two most important words in software are ‘done’ and ‘finished’, this is a problem. API Challenge #5.

Latency 52

Latency Java Code Servers 52

Brendan Gregg

AUGUST 18, 2019

bpftrace is a new open source tracer for Linux for analyzing production performance problems and troubleshooting software. For example, iostat(1), or a monitoring agent, may tell you your average disk latency, but not the distribution of this latency. software Kernel software-based events.

Latency 68

Latency C++ Cache Programming 68

Brendan Gregg

JULY 4, 2021

## References I've reproduced the talk references below, so you can click on links: - [Gregg 08] Brendan Gregg, “ZFS L2ARC,” [link] Jul 2008 - [Gregg 10] Brendan Gregg, “Visualizations for Performance Analysis (and More),” [link] 2010 - [Greenberg 11] Marc Greenberg, “DDR4: Double the speed, double the latency? Ford, et al., “TCP

Performance 52

Performance Latency Hardware Storage 52

The Netflix TechBlog

SEPTEMBER 3, 2021

Remote calls are never free; they impose extra latency, increase probability of an error, and consume network bandwidth. How can we achieve a similar functionality when designing our gRPC APIs? When we process a request it is often beneficial to know which fields the caller is interested in and which ones they ignore.

Design 245

Design Java Efficiency Code 245

ScaleOut Software

APRIL 6, 2021

With the ScaleOut Digital Twin Streaming Service , an Azure-hosted cloud service, ScaleOut Software introduced breakthrough capabilities for streaming analytics using the real-time digital twin concept. The post Deploying Real-Time Digital Twins On Premises with ScaleOut StreamServer DT appeared first on ScaleOut Software.

IoT 52

IoT Azure Analytics Healthcare 52

Dotcom-Montior

NOVEMBER 16, 2021

As defined by the Google SRE initiative, the four golden signals of monitoring include the following metrics: Latency. Latency is the amount of time, or delay, a service takes to respond to a request. Sounds like a complex subject, but in reality, it is just a simple way to define how software is built and delivered.

Monitoring 91

Monitoring Google DevOps Engineering 91

Apica

JULY 1, 2022

The Apica Difference Apica is designed to give you a complete end-to-end picture of your streaming performance from the user’s perspective. There’s no need to download extra software or make changes on your side to the scripts. We worked closely with an online gambling customer.

Internet 52

Internet Internet Latency Virtualization 52

ScaleOut Software

JULY 21, 2020

Designed to help scalable applications deliver high performance, it stores live, fast-changing data in memory (DRAM) for fast updates and retrieval. From its inception, the design philosophy behind ScaleOut StateServer has been to simultaneously maximize both performance and ease of use. In-Memory Data Grids for Fast-Changing Data.

Analytics 52

Analytics Airlines Cache Scalability 52

O'Reilly Software

JUNE 12, 2018

The benefits of modeling data as events as a mechanism to evolve our software systems. Data is all-important—vital for the continued success of our businesses—but has also been seen as a massive constraint in how we design and evolve our systems. All too often, the software wasn’t designed in a way that made it easy to ship.

Database 72

Database Cache Architecture Latency 72

O'Reilly

JANUARY 16, 2024

I’m personally interested in this topic since I am a professor who researches human-computer interaction, user experience design, and cognitive science , so AI voice interfaces are fascinating to me. I’ve recently been brainstorming ideas for how to design such a system and how to deal with the practical challenges of scaling and maintenance.

Entertainment 76

Entertainment Internet Internet Design 76

Testsigma

AUGUST 24, 2020

Continuous Testing is the process of testing at all stages of software development – one after the another- without any human intervention. Continuous Testing makes it possible to eliminate testing as a bottleneck for faster software development and delivery. Testability should be part of the low-level design for the product.

Testing 69

Testing Open Source Scalability Latency 69

ScaleOut Software

AUGUST 18, 2018

Digital twins are software abstractions that track the behavior of individual devices in IoT applications. This minimizes event-handling latency and enables better management of local operations, while still providing strategic analysis and control by remote (cloud-based or on-premises) IoT applications.

IoT 45

IoT Ecommerce Analytics Latency 45

Particular Software

JUNE 3, 2019

From Udi Dahan's Advanced Distributed Systems Design Course , Day 1 Problem of scale The real problem with bandwidth is not one of absolute speed but one of scale. Design systems to deal with limited bandwidth: See what Udi has to say in Day 1 of his Advanced Distributed Systems Design video course. "Goldilocks"

Latency 40

Latency Speed Network Strategy 40

ScaleOut Software

JULY 21, 2020

Designed to help scalable applications deliver high performance, it stores live, fast-changing data in memory (DRAM) for fast updates and retrieval. From its inception, the design philosophy behind ScaleOut StateServer has been to simultaneously maximize both performance and ease of use. In-Memory Data Grids for Fast-Changing Data.

Analytics 52

Analytics Airlines Cache Scalability 52