NodeCorrelation Filter

Manipulator

This node uses the model as generated by a Correlation node to determine which columns are redundant (i.e. correlated) and filters them out. The output table will contain the reduced set of columns.

The filtering step works roughly as follows: For each column in the correlation model the count of correlated columns is determined given a threshold value for the correlation coefficient (specified in the dialog). The column with the most correlated columns is chosen to "survive" and all correlated columns are filtered out. This procedure is repeated until no more columns can be identified. The problem of finding a minimum set of columns to satisfy the constraints is difficult to solve analytically. This method applied here is known to be good approximation, however.

Input Ports

  1. Port Type: Correlation
    The model from the correlation node.
  2. Port Type: Data
    Numeric input data to filter. It must contain the set of columns that were used to create the correlation model. (Typically you connect the input data from the correlation node here.)

Output Ports

  1. Port Type: Data
    Filtered data from input.

  1. Dimensionality Reduction

    This workflow shows 7 methods for dimensionality reduction: 1. High ratio of missing values 2. Low variance 3. High corr…
    shima0011 > 04_Analytics > 01_Preprocessing > 02_Techniques_for_Dimensionality_Reduction

  2. Model Selection to predict Death Occurrences in Car Accidents

    This workflow trains a few data analytics models and automatically selects the best one to predict death in car accident…
    knime > Examples > 50_Applications > 21_Model_Selection_and_Management > 01_Model_Selection_Sampled

  3. Techniques for Dimensionality Reduction

    ETL big data data preprocessing performance accuracy classification dimensionality reduction LDA auto-encoder t-SNE PCA backward feature elimination forward feature selection feature selection
    This workflow performs classification on data sets that were reduced using the following dimensionality reduction techni…
    aajaradata > 02_Techniques_for_Dimensionality_Reduction

  4. Feature selection simulation

    kienerj > Feature selection simulation

  5. Random Forest Model Workflow 15 Plates

    knime > Examples > 02_ETL_Data_Manipulation > Random Forest Model Workflow 15 Plates

  6. Techniques for Dimensionality Reduction

    ETL big data data preprocessing performance accuracy classification dimensionality reduction LDA auto-encoder t-SNE PCA backward feature elimination forward feature selection feature selection
    This workflow performs classification on data sets that were reduced using the following dimensionality reduction techni…
    knime > Examples > 04_Analytics > 01_Preprocessing > 02_Techniques_for_Dimensionality_Reduction > 02_Techniques_for_Dimensionality_Reduction