The Netflix TechBlog

JUNE 1, 2023

In this blog post, we’ll discuss the methods we used to ensure a successful launch, including: How we tested the system Netflix technologies involved Best practices we developed Realistic Test Traffic Netflix traffic ebbs and flows throughout the day in a sinusoidal pattern. Basic with ads was launched worldwide on November 3rd.

Traffic 342

Traffic Best Practices Systems Testing 342

Dynatrace

MARCH 15, 2024

A collector helps developers control their telemetry data streams for each signal. Different data streams can be directed to different backends or even multicast to multiple backends simultaneously. A collector is also a powerful component for data processing. The configuration is highly flexible in solving various user needs.

Open Source 130

Open Source Best Practices Infrastructure Tuning 130

ScaleOut Software

MAY 4, 2018

Traditional stream-processing and complex event processing systems, such as Apache Storm and Software AG’s Apama , have focused on extracting interesting patterns from incoming data with stateless applications. The answer to this challenge may be found in the digital twin model.

Processing 40

Processing IoT Programming Software Engineering 40

ScaleOut Software

MAY 4, 2018

Traditional stream-processing and complex event processing systems, such as Apache Storm and Software AG’s Apama , have focused on extracting interesting patterns from incoming data with stateless applications. The answer to this challenge may be found in the digital twin model.

Processing 40

Processing IoT Programming Software Engineering 40

The Netflix TechBlog

NOVEMBER 17, 2022

To do so, we continuously push the boundaries of streaming video quality and leverage the best video technologies. In this tech blog, we describe how we improved Netflix video quality with neural networks, the challenges we faced and what lies ahead. Our A/B tests showed QoE improvements without any adverse streaming impact.

Network 292

Network Media Innovation Efficiency 292

Dynatrace

APRIL 8, 2024

This blog explores how vertically integrated risk management solutions that use AI and automation enable unparalleled visibility, control, and efficiency for risk management in banking. Optimize the IT infrastructure supporting risk management processes and controls for maximum performance and resilience.

Analytics 200

Analytics Infrastructure Efficiency Technology 200

Dynatrace

SEPTEMBER 7, 2022

This support enables customers to define specific endpoint delivery of real-time streaming data to platforms such as Dynatrace. As of today’s announcement, Amazon Web Services is adding the capability to stream these logs directly from Kinesis Data Firehose to Dynatrace, bypassing other sources from which to ingest VPC Flow Logs.

Traffic 215

Traffic AWS Network Cloud 215

Dynatrace

AUGUST 10, 2023

But existing business intelligence (BI) tools often lack the broad context, ease of data access, and real-time insights needed to understand and improve customer experience and complex business processes. The key challenges include: Business data is often difficult to access, resulting in fragile data pipelines.

Database 226

Database Metrics Retail Analytics 226

The Netflix TechBlog

OCTOBER 19, 2020

Investigating a video streaming failure consists of inspecting all aspects of a member account. In our previous blog post we introduced Edgar, our troubleshooting tool for streaming sessions. The process started with manual pull of member account information that was part of the session.

Infrastructure 233

Infrastructure Transportation Storage Open Source 233

The Netflix TechBlog

AUGUST 30, 2021

By Benson Ma , Alok Ahuja Introduction At Netflix, hundreds of different device types, from streaming sticks to smart TVs, are tested every day through automation to ensure that new software releases continue to deliver the quality of the Netflix experience that our customers enjoy. In this blog post, we will focus on the latter feature set.

Latency 213

Latency Traffic Transportation Hardware 213

Dynatrace

MARCH 18, 2024

The Dynatrace OTel Collector also seamlessly integrates with Dynatrace OpenPipeline™ , a stream-processing technology, to filter, process, and contextualize data for optimal use with Dynatrace if customers choose to use it as their backend.

Scalability 262

Scalability Open Source Analytics Innovation 262

The Netflix TechBlog

OCTOBER 15, 2019

Another thread or process is constantly polling events from the log table and writes them to one or multiple datastores, optionally removing events from the log table after acknowledged by all datastores. The whole process is nearly real-time, meaning as soon as the changes are committed to the datastore, the search indexes are updated.

Transportation 192

Transportation Architecture Storage Processing 192

Dynatrace

NOVEMBER 20, 2023

Effectively automating IT processes is key to addressing the challenges of  complex cloud environments. Relying on manual processes results in outages, increased costs, and frustrated customers. These three types of AI used together enable more effective IT automation than a single form of AI on its own. What is causal AI?

AWS 208

AWS Artificial Intelligence Analytics Cloud 208

Dynatrace

APRIL 20, 2022

Guest blog from Andrian Gonciaz , Lead QA/SRE at Kitopi, in collaboration with Wolfgang Beer and Andreas Grabner (both Dynatrace). is it due to challenges in the order process, the preparation, or in our delivery to the end-user. We learned quite a bit about streaming Kafka messages and how to aggregate data in Tables.

Metrics 199

Metrics Mobile Internet Internet 199

Dynatrace

APRIL 8, 2022

Fluentd is an open-source data collector that unifies log collection, processing, and consumption. It collects, processes, and outputs log files to and from a wide variety of technologies. Processing plugins parse (normalize), filter, enrich (tagging), format, and buffer log streams. Adding the Dynatrace plug-in is easy.

Metrics 179

Metrics Analytics Software Architecture Open Source 179

The Netflix TechBlog

NOVEMBER 14, 2023

In this three-part blog post series, we introduce you to Psyberg , our incremental data processing framework designed to tackle such challenges! We’ll discuss batch data processing, the limitations we faced, and how Psyberg emerged as a solution. Let’s dive in! What is late-arriving data? How does late-arriving data impact us?

Data Engineering 264

Data Engineering Engineering Processing Games 264

Dynatrace

APRIL 26, 2022

As more organizations turn to application containerization, managing the tasks and processes that come with containers becomes critical. Additionally, they discuss the need for cloud-native observability with GitOps that provides continuous operational insight across the Kubernetes value stream. Dynatrace news.

Cloud 225

Cloud Artificial Intelligence DevOps Scalability 225

Dynatrace

FEBRUARY 8, 2021

Logs and events play an essential role in this mix; they include critical information which can’t be found anywhere else, like details on transactions, processes, users and environment changes. The newly added sources include: All log streams from the hyper-scale cloud providers AWS, Azure, and GCP. What’s next. New to Dynatrace?

Cloud 259

Cloud Azure Analytics Open Source 259

Dynatrace

FEBRUARY 10, 2022

Gartner® states that by 2023, “70% of organizations will use value stream management to improve flow in the DevOps pipeline, leading to faster delivery of customer value.”¹. Observability and AIOps help drive automated delivery and operations processes.

Artificial Intelligence 229

Artificial Intelligence DevOps Azure Cloud 229

Dynatrace

APRIL 8, 2022

Fluentd is an open-source data collector that unifies log collection, processing, and consumption. It collects, processes, and outputs log files to and from a wide variety of technologies. Processing plugins parse (normalize), filter, enrich (tagging), format, and buffer log streams. Adding the Dynatrace plug-in is easy.

Metrics 130

Metrics Analytics Software Architecture Open Source 130

Percona

DECEMBER 14, 2023

While a hallmark feature of PostgreSQL is streaming replication, sometimes data demands a more refined and adaptable replication approach to address different requirements. In this blog post, we will look into the steps of transforming an existing PostgreSQL streaming replication node into a logical replication node.

Servers 75

Servers Open Source Database Systems 75

Dynatrace

DECEMBER 10, 2021

Intertwined processes slow down automation at scale. Developing applications based on modern architectures comes with a challenge for release automation: integrating delivery of many services with similar processes but often with different technologies and tools along the delivery pipelines. To address the problem of processes (i.e.,

DevOps 182

DevOps Cloud Testing Tools Strategy 182

Dynatrace

AUGUST 10, 2023

But existing business intelligence (BI) tools often lack the broad context, ease of data access, and real-time insights needed to understand and improve customer experience and complex business processes. In part two of this blog series, you’ll see how we approached the Database Business Events Stream solution.

Database 130

Database Metrics Retail Analytics 130

Dynatrace

DECEMBER 15, 2022

In this blog, we share three log ingestion strategies from the field that demonstrate how building up efficient log collection can be environment-agnostic by using our generic log ingestion application programming interface (API). Typically, these are streamed to a central syslog server. Log ingestion strategy no.

Strategy 180

Strategy AWS Open Source Transportation 180

Dynatrace

NOVEMBER 1, 2021

In the case of the Azure Database for MySQL, you can configure slow query logging (to adjust the threshold), and in the Diagnostics settings of your database instance, you can add a setting to stream MySqlSlowLogs to an event hub. In upcoming blog posts, we’ll announce and discuss: Simplified cloud services log integration.

Azure 195

Azure Database Performance Monitoring 195

Dynatrace

OCTOBER 6, 2023

Custom data buckets for faster queries, increased control, and custom retention periods The first layer in the Grail data model consists of buckets and tables (and views for entities, which is outside this blog post’s scope). Special thanks to Dominik Punz and Christian Kiesewetter for their contributions to this blog post.

Artificial Intelligence 261

Artificial Intelligence Analytics Metrics Storage 261

John McCalpin

APRIL 25, 2023

This metric is interesting because we don’t always have the luxury of parallelizing every application we run, and our operating systems almost always process each call (e.g., Some I will address today, and some in the next blog entry. Why not something like STREAM? Details in the next blog entry.)

Benchmarking 97

Benchmarking Cache Latency Tuning 97

Dynatrace

OCTOBER 7, 2020

Topology metrics are related to specific entities in your Smartscape topology (for example, the number of successful and failed batch jobs processed by a host). While, in the past, it was only possible to stream third-party metrics into Dynatrace through a custom device API (i.e., Choose your custom metric type.

Metrics 245

Metrics Analytics Storage Monitoring 245

The Netflix TechBlog

MAY 1, 2019

by Guillaume du Pontavice, Phill Williams and Kylee Peña (on behalf of our Streaming Algorithms, Audio Algorithms, and Creative Technologies teams) Remember the epic opening sequence of Stranger Things 2 ? Most conversations about streaming quality focus on video. channel stream, as well as audible degradation of high frequencies.

Engineering 274

Engineering Network Media Entertainment 274

The Netflix TechBlog

JUNE 30, 2020

In an effort to effectively and efficiently produce this content we are looking to improve and automate many areas of the production process. In this overview, we will shed light on the complexity and magnitude of this journey and update this post with links to deeper technical blogs over time.

Engineering 238

Engineering Entertainment Logistics Innovation 238

Dynatrace

MARCH 5, 2021

Davis automatically analyzes and alerts on many important anomalies that can occur within your IT environment, such as host, process or service outages. Still, you might have use cases that rely on important custom data streams. Let the Davis AI automatically detect outages within your custom data streams. Seeing is believing.

Metrics 213

Metrics Network Monitoring Infrastructure 213

Tasktop

DECEMBER 14, 2021

When we heard about the Log4J vulnerability on Friday morning, we quickly launched our standard process: investigation, escalation, creation of a cross-value stream rapid response team. We executed the process perfectly. . Get started with Value Stream Management with Tasktop. A Reminder of the Benefits of Cloud.

Internet 98

Internet Internet Speed Cloud 98

The Netflix TechBlog

DECEMBER 8, 2021

We currently process tens of millions of log records every minute and analyze these events to perform in-house custom detections. Once ingested, findings are then enriched and processed with additional metadata collected from Netflix’s internal data sources. reduction in our false positive finding volume across our ingestion streams.

AWS 196

AWS Cloud Infrastructure Scalability 196

Dynatrace

JULY 6, 2022

At its most basic, automating IT processes works by executing scripts or procedures either on a schedule or in response to particular events, such as checking a file into a code repository. Adding AIOps to automation processes makes the volume of data that applications and multicloud environments generate much less overwhelming.

Artificial Intelligence 188

Artificial Intelligence Tuning Strategy Big Data 188

Dynatrace

AUGUST 5, 2022

In a distributed processing environment, message queuing is similar, although the speed and volume of messages are much greater. A producer creates the message, and a consumer processes it. Consumers store messages in a queue — usually in a buffer or on a storage medium — until they can process and delete them.

Monitoring 199

Monitoring Serverless Programming Speed 199

Dynatrace

APRIL 5, 2021

AWS Lambda is a serverless compute service that can run code in response to predetermined events or conditions and automatically manage all the computing resources required for those processes. Real-time file processing, for quickly indexing files, processing logs, and validating content. Data entering a stream.

Lambda 179

Lambda AWS Serverless Hardware 179

Dynatrace

AUGUST 5, 2022

In a distributed processing environment, message queuing is similar, although the speed and volume of messages are much greater. A producer creates the message, and a consumer processes it. Consumers store messages in a queue — usually in a buffer or on a storage medium — until they can process and delete them.

Monitoring 198

Monitoring Serverless Programming Speed 198