Use Big Data Technologies like Spark to get a robust and scalable data preparation. Use the latest Auo ML technology like H2O.ai AutoML to cretae a robust model and deploy it in a Big Data environment (like Cloudera) https://hub.knime.com/mlauber71/spaces/Public/latest/kn_example_bigdata_h2o_automl_spark „Sparkling Predictions and Encoded Labels – Developing and Deploying Predictive Models on a Big Data Cluster with KNIME, Spark and H2O.ai“ // Markus Lauber, Deutsche Telekom (presentation in German, slides in English) https://www.youtube.com/watch?v=k8MsxzwEVrk&t=4335s