Remove Big Data Remove Definition Remove Java Remove Tuning
article thumbnail

Data Movement in Netflix Studio via Data Mesh

The Netflix TechBlog

As of now, CDC sources have been implemented for data stores at Netflix (MySQL, Postgres). CDC events can also be sent to Data Mesh via a Java Client Producer Library. The Studio Tech Solutions team provides near real-time reports in some data tool of choice, which we call trackers to empower the decision making.

Big Data 253
article thumbnail

Orchestrating Data/ML Workflows at Scale With Netflix Maestro

The Netflix TechBlog

by Jun He , Akash Dwivedi , Natallia Dzenisenka , Snehal Chennuru , Praneeth Yenugutala , Pawan Dixit At Netflix, Data and Machine Learning (ML) pipelines are widely used and have become central for the business, representing diverse use cases that go beyond recommendations, predictions and data transformations.

Java 202
article thumbnail

Optimizing data warehouse storage

The Netflix TechBlog

Orient: Gather tuning parameters for a particular table that changed. In AutoOptimize, the service is a cluster of Java (Spring Boot) applications using Redis to keep the states. AutoAnalyze In short, AutoAnalyze finds the best tuning/configuration parameters for a table. that got added and deleted in the commit.

Storage 203