Remove tag
article thumbnail

Ready-to-go sample data pipelines with Dataflow

The Netflix TechBlog

Below is an example of plugging that metadata step in the main workflow definition - job: id: metadata type: Metadata metacat: tables: - ${CATALOG}/${TARGET_DB}/${TARGET_TABLE} owner: ${username} tags: - dataflow - sample lifetime: 123 column_types: date: pk country_code: pk rank: pk Transformation The transformation step (or steps) can be executed (..)