The Netflix TechBlog

MAY 4, 2023

Migrating Critical Traffic At Scale with No Downtime — Part 1 Shyam Gala , Javier Fernandez-Ivern , Anup Rokkam Pratap , Devang Shah Hundreds of millions of customers tune into Netflix every day, expecting an uninterrupted and immersive streaming experience. This approach has a handful of benefits.

Traffic 339

Traffic Latency Tuning Systems 339

Dynatrace

NOVEMBER 23, 2020

Today’s highly dynamic, heterogeneous, and complex software systems require organizations to establish observability for all provided cloud-native services. T o get performance insights into applications and efficiently troubleshoot and optimize them, you need precise and actionable analytics across the entire software life cycle.

Metrics 151

Metrics Open Source Tuning Analytics 151

The Netflix TechBlog

DECEMBER 7, 2020

VMAF is a video quality metric that Netflix jointly developed with a number of university collaborators and open-sourced on Github. VMAF has become a de facto standard for evaluating the performance of encoding systems and driving encoding optimizations. This tech blog highlights our recent progress toward this goal.

Metrics 154

Metrics Open Source Tuning Speed 154

Dynatrace

MARCH 29, 2024

As organizations continue to modernize their technology stacks, many turn to Kubernetes , an open source container orchestration system for automating software deployment, scaling, and management. Consider a sudden drop in performance. In fact, more than half of organizations use Kubernetes in production.

Engineering 231

Engineering DevOps Operating System Open Source 231

Dynatrace

APRIL 17, 2024

Mainframe is a strong choice for hybrid cloud, but it brings observability challenges IBM Z is a mainframe computing platform chosen by many organizations with a hybrid cloud strategy because of its security, resiliency, performance, scalability, and sustainability. You can now install OneAgent on Linux with s390 architecture.

Operating System 211

Operating System Energy Infrastructure Architecture 211

The Netflix TechBlog

JUNE 13, 2023

This is where large-scale system migrations come into play. A small percentage of production traffic is redirected to the two new clusters, allowing us to monitor the new version’s performance and compare it against the current version. Canaries and sticky canaries are valuable tools in the system migration process.

Traffic 279

Traffic Metrics Systems Strategy 279

The Netflix TechBlog

JUNE 14, 2023

This blog post will share broadly-applicable techniques (beyond GraphQL) we used to perform this migration. So, we relied on higher-level metrics-based testing: AB Testing and Sticky Canaries. To determine customer impact, we could compare various metrics such as error rates, latencies, and time to render.

Traffic 353

Traffic Latency Cache Metrics 353

Dynatrace

SEPTEMBER 15, 2020

In my recent Performance Clinic with Stefano Doni , CTO & Co-Founder of Akamas , I made the statement, “Application development and release cycles today are measured in days, instead of months. Increase in environment complexity and increased frequency in delivery requires a novel approach to performance optimization.

Performance 189

Performance Java Metrics Cloud 189

Dynatrace

JULY 23, 2020

With the advent and ingestion of thousands of custom metrics into Dynatrace, we’ve once again pushed the boundaries of automatic, AI-based root cause analysis with the introduction of auto-adaptive baselines as a foundational concept for Dynatrace topology-driven timeseries measurements. In many cases, metric behavior changes over time.

Metrics 216

Metrics Innovation Strategy Monitoring 216

Dynatrace

NOVEMBER 27, 2020

Welcome back to the second part of our blog series on how easy it is to get enterprise-grade observability at scale in Dynatrace for your OpenTelemetry custom metrics. In Part 1 , we announced our new OpenTelemetry custom-metric exporters that provide the broadest language coverage on the market, including Go , .NET record(value); }.

Metrics 142

Metrics Open Source Lambda Serverless 142

Dynatrace

APRIL 5, 2024

For a more proactive approach and to gain further visibility, other SLOs focusing on performance can be implemented. For instance, consider how fine-tuned failure rate detection can provide insights for comprehensive understanding. Please refer to How to fine-tune failure detection (dynatrace.com) for further information.

Efficiency 230

Efficiency Traffic Tuning Metrics 230

Dynatrace

FEBRUARY 14, 2022

Building on its advanced analytics capabilities for Prometheus data , Dynatrace now enables you to create extensions based on Prometheus metrics. Many technologies expose their metrics in the Prometheus data format. Easily gain actionable insights with the Dynatrace Extension for Prometheus metrics. Prometheus in Kubernetes ?and

Technology 222

Technology Technology Metrics Infrastructure 222

The Netflix TechBlog

NOVEMBER 11, 2022

Streaming Platforms Commercial streaming platforms shown in Figure 1 mainly rely on Digital Rights Management (DRM) systems. DRM systems provide continuous content protection against unauthorized actions on digital content and restrict it to streaming and in-time consumption.

C++ 312

C++ Metrics Tuning Strategy 312

The Netflix TechBlog

FEBRUARY 13, 2024

Safe software deployment, canary testing, and play-delay Software engineering readers of this blog are likely familiar with unit, integration and load testing, as well as other testing practices that aim to prevent bugs from reaching production systems. Rationale : This system is part of a semi-automated process for all client deployments.

Testing 239

Testing Software Software Metrics 239

Dynatrace

DECEMBER 5, 2023

This growth was spurred by mobile ecosystems with Android and iOS operating systems, where ARM has a unique advantage in energy efficiency while offering high performance. Huge performance leaps in recent years The top priority is often performance, where ARM resources have improved significantly.

Efficiency 271

Efficiency Architecture Energy Monitoring 271

Dynatrace

APRIL 25, 2023

Observability is essential to ensure the reliability, security and quality of any software system. It helps developers and operators identify and troubleshoot issues, optimize performance and improve user experience. Observability is typically achieved by collecting three types of data from a system, metrics, logs and traces.

Serverless 213

Serverless Lambda Azure AWS 213

SQL Performance

SEPTEMBER 17, 2019

This article will cover many areas that database administrators need to be aware of in order to properly license, recover, and tune a Reporting Services installation. Unlike the system database tempdb, ReportServerTempDB is not recreated at startup. Tuning Options. Tuning SSRS is much like any other application.

Tuning 67

Tuning Servers Database Best Practices 67

The Netflix TechBlog

NOVEMBER 6, 2023

We have built an internal system that allows someone to perform in-video search across the entire Netflix video catalog, and we’d like to share our experience in building this system. Building in-video search To build such a visual search engine, we needed a machine learning system that can understand visual elements.

Media 225

Media Social Media Tuning Efficiency 225

Dynatrace

OCTOBER 7, 2020

Open-source metric sources automatically map to our Smartscape model for AI analytics. We’ve just enhanced Dynatrace OneAgent with an open metric API. Here’s a quick overview of what you can achieve now that the Dynatrace Software Intelligence Platform has been extended to ingest third-party metrics. Dynatrace news.

Open Source 258

Open Source Metrics Analytics Tuning 258

Dynatrace

MAY 17, 2023

Making applications observable—relying on metrics, logs, and traces to understand what software is doing and how it’s performing—has become increasingly important as workloads are shifting to multicloud environments. We also introduced our demo app and explained how to define the metrics and traces it uses. initialization files.

Metrics 176

Metrics Monitoring Database Network 176

Dynatrace

OCTOBER 2, 2023

However, it’s common that teams need to refactor an application to help with performance after the lift-and-shift operation. However, the distributed system of a microservices architecture comes with its own cost: increased application complexity and convoluted testing. Migration is time-consuming and involved.

Architecture 237

Architecture Artificial Intelligence Cloud Open Source 237

DZone

MAY 1, 2020

Observability is the ability to understand the internal state of your system by looking at what is happening externally. In a software system, in order to acquire observability, we mainly implement the following aspects: logging, metrics, and tracing. Observability tools allow us to do this.

Programming 159

Programming Tuning Metrics Architecture 159

HammerDB

APRIL 19, 2023

Predicting application performance is a difficult art, but an important one when choosing the target deployment environment. In this blog, we aim to call out some key considerations when trying to assess MySQL performance for your application. We will not concern ourselves with the raw throughput of workload.

Performance 54

Performance Benchmarking Cache Storage 54

Dynatrace

JUNE 8, 2021

This post was co-authored by Jean-Louis Lormeau, Digital Performance Architect at Dynatrace. . In software we use the concept of Service Level Objectives (SLOs) to enable us to keep track of our system versus our goals, often shown in a dashboard – like below –, to help us to reach an objective or provide an excellent service for users.

Metrics 170

Metrics Tuning Programming Systems 170

The Netflix TechBlog

JUNE 7, 2021

At much less than 1% of CPU and memory on the instance, this highly performant sidecar provides flow data at scale for network insight. The sidecar has been implemented by leveraging the highly performant eBPF along with carefully chosen transport protocols to consume less than 1% of CPU and memory on any instance in our fleet.

Network 325

Network Transportation AWS Cloud 325

The Netflix TechBlog

JANUARY 13, 2022

The data platform is built on top of several distributed systems, and due to the inherent nature of these systems, it is inevitable that these workloads run into failures periodically. We have been working on an auto-diagnosis and remediation system called Pensive in the data platform to address these concerns.

Big Data 238

Big Data Infrastructure Metrics Hardware 238

Dynatrace

APRIL 26, 2022

Fast, consistent application delivery creates a positive user experience that can ultimately drive customer loyalty and improve business metrics like conversion rate and user retention. DEM can give organizations business observability—insight into the effects of user experience on the bottom line.

Monitoring 209

Monitoring Social Media IoT Metrics 209

The Netflix TechBlog

NOVEMBER 14, 2023

Several audits, such as verifying source and target counts, are performed on this batch of data. The Data Engineer does not need to perform any manual intervention in this case and can thus focus on more important things! Stay tuned for a new post on this! Audit Run various quality checks on the staged data.

Tuning 244

Tuning Processing C++ Efficiency 244

Scalegrid

MARCH 4, 2019

We asked hundreds of developers, engineers, software architects, dev teams, and IT leaders at DeveloperWeek to discover the current NoSQL vs. SQL usage, most popular databases, important metrics to track, and their most time-consuming database management tasks. SQL vs. NoSQL. NoSQL Database Use: 39.52%. Most Popular Databases.

Database 255

Database Metrics Systems Strategy 255

Dynatrace

JULY 24, 2023

Observability data provides a treasure trove of performance, stability, and user experience metrics encompassing error rates, response times, and user engagement. With swift precision, an answer-driven automation solution that uses causal AI can transform these metrics into invaluable insights. But it doesn’t stop there.

DevOps 225

DevOps Traffic Efficiency Servers 225

Dynatrace

FEBRUARY 17, 2022

These are two values he shares with DevOps activist Andreas Grabner, who sat down with Hightower at Dynatrace Perform 2022 to talk about taming Kubernetes and the future of cloud-native technologies. Kelsey Hightower recalled a time earlier in his career when their teams met in war rooms to troubleshoot broken systems.

Technology 216

Technology Technology Cloud Infrastructure 216

The Netflix TechBlog

NOVEMBER 9, 2021

The Encoding Technologies team took a first stab at this problem by fine-tuning the encoding recipe. The Performance Engineering team specializes in optimizing resource utilization at Netflix. Having a suite of tools that can provide summarized metrics for these streaming sessions is critical to the success of Netflix AV1 streaming.

Media 246

Media Open Source Efficiency Software Engineering 246

Dynatrace

FEBRUARY 8, 2021

Every service and component exposes observability data (metrics, logs, and traces) that contains crucial information to drive digital businesses. They are required to understand the full story of what happened in a system. The “three pillars of observability,” metrics, logs, and traces, still don’t tell the whole story.

Cloud 261

Cloud Azure Analytics AWS 261

The Netflix TechBlog

NOVEMBER 2, 2021

Perceptual quality measurements are used to drive video encoding optimizations , perform video codec comparisons , carry out A/B testing and optimize streaming QoE decisions to mention a few. In particular, the VMAF metric lies at the core of improving the Netflix member’s streaming video quality. We call this system Cosmos.

Media 171

Media Innovation Metrics Latency 171

Dynatrace

DECEMBER 2, 2021

SLOs, together with service-level indicators (SLIs), deliver the performance promised in service-level agreements (SLAs) and other business level objectives (BLOs) while staying within error budgets. In layman’s terms, SLOs represent the performance or health of a service. But what are SLOs? What are SLIs? Watch webinar now!

Metrics 196

Metrics Best Practices DevOps Infrastructure 196

Dynatrace

NOVEMBER 24, 2020

Tracking changes to automated processes, including auditing impacts to the system, and reverting to the previous environment states seamlessly. Easy deployment of Dynatrace OneAgent with AWS Systems Manager Distributor , AWS Elastic Beanstalk , and AWS CloudFormation. Stay tuned. AWS 5-pillars. Dynatrace and AWS.

AWS 146

AWS Artificial Intelligence Best Practices Lambda 146

Dynatrace

NOVEMBER 15, 2021

A log is a detailed, timestamped record of an event generated by an operating system, computing environment, application, server, or network device. Logs can include data about user inputs, system processes, and hardware states. Optimized system performance. What is log monitoring? Increased collaboration.

Analytics 214

Analytics Monitoring Artificial Intelligence DevOps 214