This workflow:
- Reads and validates the data from real data sources,
- Calls the developed and tested Data Transformation workflow to transform the raw orders data,
- Loads the transformed data to the production database,
- Besides, it logs the validation and transformation steps to a log file and sends an email in case of failures.
- The workflow then can be deployed as a schedule to run regularly and update the database table.
Workflow
02 Production data pipeline with data validation & logging - Exercise
Used extensions & nodes
Created with KNIME Analytics Platform version 5.2.2
Legal
By using or downloading the workflow, you agree to our terms and conditions.