Hub
  • Software
  • Blog
  • Forum
  • Events
  • Documentation
  • About KNIME
  • KNIME Hub
  • knime
  • Spaces
  • Examples
  • 10_Big_Data
  • 02_Spark_Executor
  • 13_H2O_AutoML_on_Spark
WorkflowWorkflow

H2O AutoML on Spark

Spark H2o Automl Sparkling water Airline
+2

Last edited: 

Drag & drop
Like
Download workflow
Copy short link
Workflow preview
This workflow trains classification models for the Airlines Delay dataset using H2O AutoML on Spark. The dataset is expected to be stored on S3 in parquet format. It is first read into the Spark cluster and preprocessed on Spark (missing value handling, normalization, etc.). Then, Sparkling Water is used to train both binary and muliclass classification models with H2O AutoML on the dataset. Last, the models are scored on the previously partitioned test data. The Airlines Delay dataset and description for it can be found here: https://www.kaggle.com/giovamata/airlinedelaycauses You can use the Parquet Writer node to write the dataset to S3 or, e.g., replace the Parquet to Spark node with the CSV Reader and Table to Spark nodes (note that using parquet provides a better performance of the whole process). By increasing or removing the runtime limit for the H2O AutoML Learner nodes, better models might be learned.

External resources

  • Airlines Delay Dataset

Used extensions & nodes

Created with KNIME Analytics Platform version 4.4.0
  • Go to item
    KNIME Amazon Cloud Connectors Trusted extension

    KNIME AG, Zurich, Switzerland

    Version 4.4.0

  • Go to item
    KNIME Extension for Apache Spark Trusted extension

    KNIME AG, Zurich, Switzerland

    Version 4.4.0

  • Go to item
    KNIME H2O Machine Learning Integration Trusted extension

    KNIME AG, Zurich, Switzerland

    Version 4.4.0

  • Go to item
    KNIME H2O Sparkling Water Integration Trusted extension

    KNIME AG, Zurich, Switzerland

    Version 4.4.0

  1. Go to item
  2. Go to item
  3. Go to item
  4. Go to item
  5. Go to item
  6. Go to item

Legal

By using or downloading the workflow, you agree to our terms and conditions.

Discussion
Discussions are currently not available, please try again later.

KNIME
Open for Innovation

KNIME AG
Hardturmstrasse 66
8005 Zurich, Switzerland
  • Software
  • Getting started
  • Documentation
  • E-Learning course
  • Solutions
  • KNIME Hub
  • KNIME Forum
  • Blog
  • Events
  • Partner
  • Developers
  • KNIME Home
  • KNIME Open Source Story
  • Careers
  • Contact us
Download KNIME Analytics Platform Read more on KNIME Server
© 2022 KNIME AG. All rights reserved.
  • Trademarks
  • Imprint
  • Privacy
  • Terms & Conditions
  • Credits