The Netflix TechBlog

AUGUST 1, 2022

Data Mesh?—?A A Data Movement and Processing Platform @ Netflix By Bo Lei , Guilherme Pires , James Shao , Kasturi Chatterjee , Sujay Jain , Vlad Sydorenko Background Realtime processing technologies (A.K.A After evaluating the options , the team has decided to create Data Mesh as our next generation data pipeline solution.

Processing 272

Processing Transportation Entertainment Tuning 272

Dynatrace

JUNE 4, 2024

How we define auto-adaptive thresholds at Dynatrace This blog post explores how Dynatrace leveraged the Site Reliability Guardian to establish a fast feedback loop for Davis AI model improvements. While the data science team appreciated the quick insights and validations of their improvements, they initially struggled with the setup.

Metrics 219

Metrics Engineering Code Tuning 219

Dynatrace

SEPTEMBER 28, 2021

The emerging concepts of working with DevOps metrics and DevOps KPIs have really come a long way. DevOps metrics to help you meet your DevOps goals. Like any IT or business project, you’ll need to track critical key metrics. Here are nine key DevOps metrics and DevOps KPIs that will help you be successful.

DevOps 189

DevOps Metrics Traffic Efficiency 189

Dynatrace

NOVEMBER 23, 2020

As the application owner of an e-commerce application, for example, you can enrich the source code of your application with domain-specific knowledge by adding actionable semantics to collected performance or business metrics. New OpenTelemetry metrics exporters provide the broadest language support on the market.

Metrics 150

Metrics Open Source Tuning Analytics 150

The Netflix TechBlog

JANUARY 13, 2022

By Vikram Srivastava and Marcelo Mayworm Netflix has one of the most complex data platforms in the cloud on which our data scientists and engineers run batch and streaming workloads. As our subscribers grow worldwide and Netflix enters the world of gaming , the number of batch workflows and real-time data pipelines increases rapidly.

Big Data 238

Big Data Infrastructure Metrics Hardware 238

The Netflix TechBlog

MAY 4, 2023

Migrating Critical Traffic At Scale with No Downtime — Part 1 Shyam Gala , Javier Fernandez-Ivern , Anup Rokkam Pratap , Devang Shah Hundreds of millions of customers tune into Netflix every day, expecting an uninterrupted and immersive streaming experience. This technique facilitates validation on multiple fronts.

Traffic 339

Traffic Latency Tuning Systems 339

Dynatrace

AUGUST 5, 2020

With Dynatrace, you can also validate your findings against Real User Monitoring data or even drill down to the code level to pinpoint the root cause of a change in performance. Recently introduced improvements to Visually complete and new web performance metrics for Real User Monitoring are now available for Synthetic Monitoring as well.

Metrics 203

Metrics Monitoring Performance Benchmarking 203

The Netflix TechBlog

DECEMBER 7, 2020

This tech blog highlights our recent progress toward this goal. VMAF is a video quality metric that Netflix jointly developed with a number of university collaborators and open-sourced on Github. For more background information, interested readers may refer to our first and second tech blogs on VMAF. animation vs. documentary).

Metrics 154

Metrics Open Source Tuning Speed 154

The Netflix TechBlog

JULY 26, 2021

This happens at an unprecedented scale and introduces many interesting challenges; one of the challenges is how to provide visibility of Studio data across multiple phases and systems to facilitate operational excellence and empower decision making. With the latest Data Mesh Platform, data movement in Netflix Studio reaches a new stage.

Big Data 253

Big Data Government Analytics Processing 253

Dynatrace

OCTOBER 26, 2020

Dynatrace has recently enhanced its Metrics APIs, allowing everyone to send any type of metric with any set of data dimension to Davis, Dynatrace’s AI engine. Up until then, he had pushed JMeter data in other tools which made it harder to correlate it with the rest of the performance data captured by Dynatrace OneAgent.

Innovation 149

Innovation Metrics Hardware Games 149

Dynatrace

DECEMBER 15, 2020

OpenTelemetry metrics are useful for augmenting the fully automatic observability that can be achieved with Dynatrace OneAgent. OpenTelemetry metrics add domain specific data such as business KPIs and license relevant consumption details. Enterprise-grade observability for custom OpenTelemetry metrics from AWS.

AWS 170

AWS Metrics Analytics Government 170

Dynatrace

JANUARY 17, 2020

In an existing application landscape, however, it can be difficult to get to those metrics. Dynatrace customers have the ability to leverage PurePath distributed tracing functionality in driving adhoc multidimensional analysis (MDA) on any kind of data available within their microservices. Here’s how Dynatrace customers do it.

Metrics 157

Metrics Code Tuning Programming 157

Dynatrace

APRIL 22, 2022

Although many companies adopt solutions such as OpenTelemetry, Prometheus, and Grafana as part of their observability strategy, they often confront a common data analysis problem: data silos. When teams, tools, and data are siloed, it’s harder for organizations to succeed. This leads to multiple tool-specific dashboards.

Open Source 165

Open Source Metrics Cloud Tuning 165

Dynatrace

NOVEMBER 27, 2020

Welcome back to the second part of our blog series on how easy it is to get enterprise-grade observability at scale in Dynatrace for your OpenTelemetry custom metrics. In Part 1 , we announced our new OpenTelemetry custom-metric exporters that provide the broadest language coverage on the market, including Go , .NET

Metrics 138

Metrics Open Source Lambda Serverless 138

Dynatrace

APRIL 17, 2024

The challenge for hybrid cloud deployments is maintaining critical observability, which must include the full set of monitoring signals: logs, metrics, and traces. It’s also easy to minimize the risk of violating data access policies or regulations by masking sensitive data in logs.

Operating System 193

Operating System Energy Infrastructure Architecture 193

Dynatrace

JULY 23, 2020

With the advent and ingestion of thousands of custom metrics into Dynatrace, we’ve once again pushed the boundaries of automatic, AI-based root cause analysis with the introduction of auto-adaptive baselines as a foundational concept for Dynatrace topology-driven timeseries measurements. In many cases, metric behavior changes over time.

Metrics 201

Metrics Innovation Strategy Monitoring 201

The Netflix TechBlog

JUNE 14, 2023

This blog post will share broadly-applicable techniques (beyond GraphQL) we used to perform this migration. In such cases, we were not testing for response data but overall behavior. So, we relied on higher-level metrics-based testing: AB Testing and Sticky Canaries. Let’s discuss the three testing strategies in further detail.

Traffic 353

Traffic Latency Cache Metrics 353

Dynatrace

APRIL 5, 2024

This blog post is for both novice and seasoned audiences alike. The first part of this blog post briefly explores the integration of SLO events with AI. For instance, consider how fine-tuned failure rate detection can provide insights for comprehensive understanding.

Efficiency 213

Efficiency Traffic Tuning Metrics 213

The Netflix TechBlog

JUNE 13, 2023

Our previous blog post presented replay traffic testing — a crucial instrument in our toolkit that allows us to implement these transformations with precision and reliability. This blog post will delve into the techniques leveraged at Netflix to introduce these changes to production.

Traffic 279

Traffic Metrics Systems Strategy 279

The Netflix TechBlog

MARCH 25, 2019

Building and Scaling Data Lineage at Netflix to Improve Data Infrastructure Reliability, and Efficiency By: Di Lin , Girish Lingappa , Jitender Aswani Imagine yourself in the role of a data-inspired decision maker staring at a metric on a dashboard about to make a critical business decision but pausing to ask a question?—?“Can

Infrastructure 219

Infrastructure Big Data Transportation Architecture 219

Dynatrace

OCTOBER 7, 2020

We’re happy to announce that by opening up Dynatrace OneAgent for integration of custom metrics, Dynatrace has automated alerting on crucial metrics and removes the need to maintain local configurations for StatsD, Telegraf, and Prometheus—even in the largest of environments, which can include hundreds of thousands of instances and containers.

Open Source 247

Open Source Metrics Analytics Tuning 247

Dynatrace

FEBRUARY 14, 2022

Building on its advanced analytics capabilities for Prometheus data , Dynatrace now enables you to create extensions based on Prometheus metrics. Without any coding, these extensions make it easy to ingest data from these technologies and provide tailor-made analysis views and zero-config alerting. Prometheus in Kubernetes ?and

Technology 206

Technology Technology Metrics Infrastructure 206

Dynatrace

DECEMBER 22, 2019

To reduce your CloudWatch costs and throttling, you can now select from additional services and metrics to monitor. Get up to 300 new AWS metrics out of the box. Dynatrace ingests AWS CloudWatch metrics for multiple preselected services. Amazon Kinesis Data Analytics. Amazon Kinesis Data Firehose. Amazon Aurora.

AWS 134

AWS Metrics IoT Storage 134

Dynatrace

DECEMBER 22, 2019

To reduce your CloudWatch costs and throttling, you can now select from additional services and metrics to monitor. Get up to 300 new AWS metrics out of the box. Dynatrace ingests AWS CloudWatch metrics for multiple preselected services. Amazon Kinesis Data Analytics. Amazon Kinesis Data Firehose. Amazon Aurora.

AWS 132

AWS Metrics IoT Storage 132

The Netflix TechBlog

OCTOBER 15, 2019

Part I: Overview Andreas Andreakis , Falguni Jhaveri , Ioannis Papapanagiotou , Mark Cho , Poorna Reddy , Tongliang Liu Overview It is a commonly observed pattern for applications to utilize multiple datastores where each is used to serve a specific need such as storing the canonical form of data (MySQL etc.), caching (Memcached etc.),

Transportation 192

Transportation Architecture Processing Storage 192

The Netflix TechBlog

NOVEMBER 14, 2023

By Abhinaya Shetty , Bharath Mummadisetty This blog post will cover how Psyberg helps automate the end-to-end catchup of different pipelines, including dimension tables. In the previous installments of this series, we introduced Psyberg and delved into its core operational modes: Stateless and Stateful Data Processing.

Tuning 244

Tuning Processing C++ Efficiency 244

Dynatrace

APRIL 23, 2019

However, understanding the performance of different application types requires an emphasis on different performance metrics, that is, key performance metrics. For many traditional web applications , User action duration is considered the best metric available for web-performance optimization.

Metrics 101

Metrics Monitoring Performance Speed 101

The Netflix TechBlog

AUGUST 13, 2020

A metric crossed a threshold. You’re half awake and wondering, “Is there really a problem or is this just an alert that needs tuning? You’re not yet convinced there’s a real problem but you’re also aware that the clock is ticking as you dig through a mountain of data looking for clues. Mantis real-time streaming data.

Monitoring 210

Monitoring Tuning Traffic Metrics 210

Dynatrace

AUGUST 6, 2019

Defining a comprehensive user-experience metric gives rise to questions such as: How do we compare the user experience of one session to another? Which metric can be used for the purpose of reporting user experience and tracking it over a period of time? A single metric for user experience segmentation. Error metrics.

Metrics 116

Metrics Tuning Monitoring Analytics 116

Dynatrace

APRIL 25, 2023

In this blog post, we will discuss some of these challenges and how to overcome them. Observability is typically achieved by collecting three types of data from a system, metrics, logs and traces. Collecting these data types from serverless applications is not straightforward due to their ephemeral nature.

Serverless 196

Serverless Lambda Azure AWS 196

Dynatrace

AUGUST 1, 2022

Kubernetes was initially designed with a strong focus on stateless workloads, meaning these workloads do not need to store any persistent data. Interestingly, our partner RedHat reported in 2021 that around 80% of deployed workloads are databases or data caches, storing data in persistent volume claims (PVCs). Stay tuned.

Storage 177

Storage Database Network Metrics 177

Dynatrace

FEBRUARY 8, 2021

Also, these modern, cloud-native architectures produce an immense volume, velocity, and variety of data. Every service and component exposes observability data (metrics, logs, and traces) that contains crucial information to drive digital businesses. Collecting data requires massive and ongoing configuration efforts.

Cloud 254

Cloud Azure Analytics AWS 254

Percona

NOVEMBER 9, 2023

In this blog post, we will discuss how to extend Percona Monitoring and Management (PMM) to get PostgreSQL metrics on checkpointing activity, internal buffers, and WAL usage. With this data, we’ll be able to better understand and tune our Postgres servers. Click on the Dashboards -> Import menu: 2.

Monitoring 87

Monitoring Tuning Metrics Servers 87

Dynatrace

MAY 17, 2022

By taking advantage of native Kubernetes standards, Dynatrace Cloud Native Full Stack injection empowers you to precisely provide the data that your teams need in exceptionally fast and automated ways. A team looking for metrics, traces, and logs no longer needs to file a ticket to get their app monitored in their own environments.

Availability 305

Availability Scalability Cloud Metrics 305

Dynatrace

MAY 12, 2022

To stay tuned, keep an eye on our release notes. A heap dump is no longer produced when the session list has a large amount of data. (RUM-5590). Improved efficiency and response time of filter operators in metric selectors that both apply an entity selector and filter a dimension called `Container` or `Process`. (APM-368260).

Tuning 181

Tuning Metrics Cloud Mobile 181

Percona

DECEMBER 20, 2018

Let’s look at some of the most popular Percona Database Performance Blog posts in 2018. With the Percona Database Performance Blog, Percona staff and leadership work hard to provide the open source community with insights, technical support, predictions and metrics around multiple open source database software technologies.

Database 40

Database Tuning Performance AWS 40

Dynatrace

MAY 16, 2019

Are you applying AI to the unique metrics and KPIs that matter most to the success of your digital business? Do you provide dashboards and analytics that combine technical and business metrics that are specific to your business? Dynatrace out-of-the-box metrics generally focus on availability, failure rate, and performance.

Metrics 115

Metrics Analytics Programming Monitoring 115