article thumbnail

Orchestrating Data/ML Workflows at Scale With Netflix Maestro

The Netflix TechBlog

We want users to rely on shared templates and reuse their workflow definitions across their team, saving time and effort on creating the same functionality. Maestro high level architecture In Maestro, a workflow is a DAG (Directed acyclic graph) of individual units of job definition called Steps.

Java 202
article thumbnail

Migrating Netflix to GraphQL Safely

The Netflix TechBlog

A single API team maintained both the Java implementation of the Falcor framework and the API Server. And we definitely couldn’t replay test non-functional requirements like caching and logging user interaction. Phase 1 Created a GraphQL Shim Service on top of our existing Monolith Falcor API.

Traffic 353
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

How Netflix Content Engineering makes a federated graph searchable

The Netflix TechBlog

How do our users tell us which portion and, even more critically, given that the portion of the graph of interest will almost definitely span data exposed by many services, how do we keep the index current with all these various services? This was done using graphql-java.

article thumbnail

Data Movement in Netflix Studio via Data Mesh

The Netflix TechBlog

CDC events can also be sent to Data Mesh via a Java Client Producer Library. For the past few years, many of these trackers were powered by hand-curated SQL scripts and API calls being managed by CRON schedulers implemented in a Java Service called Lego. Please stay tuned! Endnotes Âą Inmon, Bill. Dehghani, Zhamak.

Big Data 253
article thumbnail

Terminology matters: how to enhance user experience by aligning names with expectations

Dynatrace

Definitely not. NET or Java footprint (as diagnostic tools are especially useful for these). Stay tuned for even more improvements to diagnostic workflows in Dynatrace. Does this mean that we shouldn’t try different terminology and navigation patterns and should just repeat whatever is industry standard? What’s next?

Java 246
article thumbnail

Why PostgreSQL Is a Top Choice for Enterprise-level Databases

Percona

It has connectors for programming languages such as Java, Python, and PHP, as well as integrations with popular data visualization tools such as Tableau and Power BI. If you are looking for a database system for your enterprise-level application, PostgreSQL is definitely worth considering.

Database 113
article thumbnail

Applying Netflix DevOps Patterns to Windows

The Netflix TechBlog

The configuration file, referenced scripts, and artifact dependency definitions all live in an internal git repository. Running a canary for each change and testing the AMI in production allows us to capture insights around impact on Windows updates, script changes, tuning web server configuration, among others.

DevOps 207