Group 2 Training, Evaluation and Optimization

Tasks for Group 2 in KNIME Data Science Learnathon
- Train a Decision Tree on the training set, and apply the model to the test set
- Evaluate the performance of the Decision Tree model
- Train a Logistic Regression model on the training set, and apply the model to the test set
- Evaluate the performance of the Logistic Regression model
- Optimize the tree depth of a Random Forest model, and train and apply a Random Forest model using the optimal parameter value
- Evaluate the performance of the Random Forest model
- Compare the performances of the different models using scoring metrics for a classification model and an ROC Curve
- Write the best performing model to a file

External resources

• Original Airline Dataset
• Analytics - Model Selection to Predict Flight Departure Delays
• Parameter Optimization for Prediction Models
• Cross-validation (statistics)
• Cross Validation with SVM
• Scoring Metrics for Classification Models
• From Modeling to Scoring: Confusion Matrix and Class Statistics
• KNIME E-Learning Course - Predictive Analytics
• Import Existing Models
• Ensemble Learning
• Decision Tree Learner Node: Algorithm Settings
• Behind the Scenes of Decision Tree with KNIME
• Model Selection and Management with KNIME
• Building a Basic Model for Churn Prediction with KNIME
• KNIME Analytics: a Review