Remove Blog Remove Data Remove Infrastructure Remove Processing
article thumbnail

Rebuilding Netflix Video Processing Pipeline with Microservices

The Netflix TechBlog

This introductory blog focuses on an overview of our journey. Future blogs will provide deeper dives into each service, sharing insights and lessons learned from this process. Future blogs will provide deeper dives into each service, sharing insights and lessons learned from this process.

article thumbnail

Enhance data collection with Dynatrace OpenTelemetry Collector distribution

Dynatrace

As organizations strive for observability and data democratization, OpenTelemetry emerges as a key technology to create and transfer observability data. Understanding OpenTelemetry OpenTelemetry is an open, vendor-neutral standard for creating, collecting, and transferring telemetry data, like traces, metrics, and logs.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

Streaming SQL in Data Mesh

The Netflix TechBlog

Democratizing Stream Processing @ Netflix By Guil Pires , Mark Cho , Mingliang Liu , Sujay Jain Data powers much of what we do at Netflix. On the Data Platform team, we build the infrastructure used across the company to process data at scale. The existing Data Mesh Processors have a lot of overlap with SQL.

article thumbnail

Unlock the observability value of log data with processing at scale

Dynatrace

The data locked in your log files can be a goldmine for your application developers, operations teams, and your enterprise as a whole. However, it can be complicated , expensive , or even impossible to set up robust observability that makes use of this data. Log format inconsistency makes it a challenge to access critical data.

article thumbnail

Building Netflix’s Distributed Tracing Infrastructure

The Netflix TechBlog

In our previous blog post we introduced Edgar, our troubleshooting tool for streaming sessions. Now let’s look at how we designed the tracing infrastructure that powers Edgar. The process started with manual pull of member account information that was part of the session. Stream Processing: to sample or not to sample trace data?

article thumbnail

Building and Scaling Data Lineage at Netflix to Improve Data Infrastructure Reliability, and…

The Netflix TechBlog

Building and Scaling Data Lineage at Netflix to Improve Data Infrastructure Reliability, and Efficiency By: Di Lin , Girish Lingappa , Jitender Aswani Imagine yourself in the role of a data-inspired decision maker staring at a metric on a dashboard about to make a critical business decision but pausing to ask a question?—?“Can

article thumbnail

What is infrastructure as code? Discover the basics, benefits, and best practices

Dynatrace

“As code” means simplifying complex and time-consuming tasks by automating some, or all, of their processes. ” While this methodology extends to every layer of the IT stack, infrastructure as code (IAC) is the most prominent example. .” What is infrastructure as code? What challenges does IAC solve?