Remove Blog Remove Data Remove Monitoring Remove Processing
article thumbnail

Data Mesh?—?A Data Movement and Processing Platform @ Netflix

The Netflix TechBlog

Data Mesh?—?A A Data Movement and Processing Platform @ Netflix By Bo Lei , Guilherme Pires , James Shao , Kasturi Chatterjee , Sujay Jain , Vlad Sydorenko Background Realtime processing technologies (A.K.A Last year we wrote a blog post about how Data Mesh helped our Studio team enable data movement use cases.

article thumbnail

Rebuilding Netflix Video Processing Pipeline with Microservices

The Netflix TechBlog

This introductory blog focuses on an overview of our journey. Future blogs will provide deeper dives into each service, sharing insights and lessons learned from this process. Future blogs will provide deeper dives into each service, sharing insights and lessons learned from this process.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

Incremental Processing using Netflix Maestro and Apache Iceberg

The Netflix TechBlog

by Jun He , Yingyi Zhang , and Pawan Dixit Incremental processing is an approach to process new or changed data in workflows. The key advantage is that it only incrementally processes data that are newly added or updated to a dataset, instead of re-processing the complete dataset.

article thumbnail

Unlock the observability value of log data with processing at scale

Dynatrace

The data locked in your log files can be a goldmine for your application developers, operations teams, and your enterprise as a whole. However, it can be complicated , expensive , or even impossible to set up robust observability that makes use of this data. Log format inconsistency makes it a challenge to access critical data.

article thumbnail

Privacy spotlight: Control compliance in Dynatrace with multiple layers of sensitive data masking

Dynatrace

Observing complex environments involves handling regulatory, compliance, and data governance requirements. This continuously evolving landscape requires careful management and clarity regarding how sensitive data is used. This is particularly important when dealing with large volumes of data.

article thumbnail

Enhance data collection with Dynatrace OpenTelemetry Collector distribution

Dynatrace

As organizations strive for observability and data democratization, OpenTelemetry emerges as a key technology to create and transfer observability data. Understanding OpenTelemetry OpenTelemetry is an open, vendor-neutral standard for creating, collecting, and transferring telemetry data, like traces, metrics, and logs.

article thumbnail

Sequential A/B Testing Keeps the World Streaming Netflix Part 1: Continuous Data

The Netflix TechBlog

Spot the Difference Can you spot any difference between the two data streams below? In this blog post, we will develop a statistical procedure to do just that, and describe the impact of these developments at Netflix. Can you spot any differences in the statistical distributions between the two data streams?

Testing 239