Exercise 03 Production Data Pipeline

Learning objective: In this exercise you will learn building the data pipeline for production and usage of Call Workflow services

Workflow description: This workflow showcases the important aspects of building the data pipeline for production. Find below the three major tasks performed in this workflow

The data is read from the real data sources, eg, weekly data is updated in Google sheets, we read it using the Google Sheet reader node

Further the data transformation workflow (created in exercise 1a) is called using the Call Workflow service node and it transforms the data

At last, the transformed data is written to production database to allow us to check the consistency of the processed data