Exercise 01 Data Validation & Statistics Process Control

Learning objective: In this exercise you'll learn how to create data validation workflow

Workflow description: This workflow showcases the steps in creating the data validation workflow that implements the data checks for incoming data . Find below the two major tasks performed in this workflow

Check if the input data is empty, also check if the input data has all the expected columns

Check the statistics of the incoming data and raise error if it is out of expected range