NodeSpark Correlation Matrix

Other

This node computes the correlation matrix for the selected input columns using the MLlib Statistics package.

Input Ports

  1. Port Type: Spark Data
    Spark DataFrame/RDD to compute correlation matrix for.

Output Ports

  1. Port Type: Spark Data
    Spark DataFrame/RDD representing the correlation matrix.
  2. Port Type: Data
    Correlation variables in a square matrix
  3. Port Type: Correlation
    A model containing the correlation measures. This model is appropriate to be read by the Spark Correlation Filter node.

  1. Taxi Demand Prediction Training Workflow

    Demand prediction random forest time series prediction Spark cluster NYC taxi datset IoT Internet of Things
    In this use case, we use the NYC taxi dataset and a Random Forest to train a simple time series prediction model to pred…
    knime > Examples > 10_Big_Data > 02_Spark_Executor > 11_Taxi_Demand_Prediction > Training_workflow