This workflow:
- Reads and validates the data from real data sources,
- Calls the developed and tested Data Transformation workflow to transform the raw orders data,
- Loads the transformed data to the production database,
- Besides, it logs the validation and transformation steps to a log file and sends an email in case of failures.
- The workflow then can be deployed as a schedule to run regularly and update the database table.
- Reads and validates the data from real data sources,
- Calls the developed and tested Data Transformation workflow to transform the raw orders data,
- Loads the transformed data to the production database,
- Besides, it logs the validation and transformation steps to a log file and sends an email in case of failures.
- The workflow then can be deployed as a schedule to run regularly and update the database table.