Hub
Pricing About
  • Software
  • Blog
  • Forum
  • Events
  • Documentation
  • About KNIME
  • KNIME Community Hub
  • Nodes
  • Feature Selection Loop Start (2:2)
NodeNode / LoopStart

Feature Selection Loop Start (2:2)

Analytics Mining Feature Selection
Drag & drop
Like
Copy short link

This node is the start of the feature selection loop. The feature selection loop allows you to select, from all the features in the input data set, the subset of features that is best for model construction. With this node you determine (i) which features/columns are to be held fixed in the selection process. These constant or "static" features/columns are included in each loop iteration and are exempt from elimination; (ii) which selection strategy is to be used on the other (variable) features/columns and its settings; and (iii) the specific settings of the selected strategy. This node has two in and out ports. The respective first port is intended for training data and the second port for test data. The same filter is applied to both tables and they will therefore always contain the same columns.

The following feature selection strategies are available:

  • Forward Feature Selection is an iterative approach. It starts with having no feature selected. In each iteration, the feature that improves the model the most is added to the feature set.
  • Backward Feature Elimination is an iterative approach. It starts with having all features selected. In each iteration, the feature that has on its removal the least impact on the models performance is removed.
  • Genetic Algorithm is a stochastic approach that bases its optimization on the mechanics of biological evolution and genetics. Similar to natural selection, different solutions (individuals) are carried and mutated from generation to generation based on their performance (fitness). This approach converges into a local optimum and enabling early stopping might be recommended. See, e.g., this article for more insights.
  • Random is a simple approach that selects feature combinations randomly. There is no converging and by chance (one of) the best feature combination will be drawn in an early iteration, so that early stopping might be recommended.

External resources

  • KNIME E-Learning Course: Section 7.2. Re-executing Workflow Parts: Loops

Node details

Input ports
  1. Type: Table
    Table containing features and constant columns
    A data table containing all features and static columns needed for the feature selection. (Trainingdata)
  2. Type: Table
    Table with same structure as the first one
    A data table containing all features and static columns needed for the feature selection. (Testdata)
Output ports
  1. Type: Table
    Filtered table
    The input table with some columns filtered out. (Training data)
  2. Type: Table
    Filtered table
    The input table with some columns filtered out. (Test data)

Extension

The Feature Selection Loop Start (2:2) node is part of this extension:

  1. Go to item

Related workflows & nodes

  1. Go to item
    Fully Automated Machine Learning
    This application takes a tabular input data and creates a classification model by automat…
    simons > Public > Guided Automation of Machine Learning > Examples > Fully_Automated_Machine_Learning_Example
    simons
  2. Go to item
    Guided Machine Learning
    This application takes a tabular input data and creates a classification model by guiding…
    simons > Public > Guided Automation of Machine Learning > Examples > Guided_Automation_of_Machine_Learning_Example
    simons
  3. Go to item
    KNIME_project_TitanicSecondTry
    kaj > Public > KNIME_project_TitanicSecondTry
    kaj
  1. Go to item
  2. Go to item
  3. Go to item
  4. Go to item
  5. Go to item
  6. Go to item

KNIME
Open for Innovation

KNIME AG
Talacker 50
8001 Zurich, Switzerland
  • Software
  • Getting started
  • Documentation
  • E-Learning course
  • Solutions
  • KNIME Hub
  • KNIME Forum
  • Blog
  • Events
  • Partner
  • Developers
  • KNIME Home
  • KNIME Open Source Story
  • Careers
  • Contact us
Download KNIME Analytics Platform Read more on KNIME Business Hub
© 2023 KNIME AG. All rights reserved.
  • Trademarks
  • Imprint
  • Privacy
  • Terms & Conditions
  • Credits