Remove Analytics Remove Java Remove Traffic Remove Transportation
article thumbnail

Building Netflix’s Distributed Tracing Infrastructure

The Netflix TechBlog

Our tactical approach was to use Netflix-specific libraries for collecting traces from Java-based streaming services until open source tracer libraries matured. We chose Open-Zipkin because it had better integrations with our Spring Boot based Java runtime environment. Stream Processing: to sample or not to sample trace data?

article thumbnail

Evolution of Netflix Conductor:

The Netflix TechBlog

Dynamic Workflow Executions For use cases where the need arises to execute a large/arbitrary number of varying workflow definitions or to run a one-time ad hoc workflow for testing or analytical purposes, registering definitions first with the metadata store in order to then execute them only once, adds a lot of additional overhead.

Lambda 189
article thumbnail

Data Movement in Netflix Studio via Data Mesh

The Netflix TechBlog

The paradigm spans across methods, tools, and technologies and is usually defined in contrast to analytical reporting and predictive modeling which are more strategic (vs. CDC events can also be sent to Data Mesh via a Java Client Producer Library. tactical) in nature. Currently Iceberg sink is appended only.

Big Data 253