NodePySpark Script (2 to 1)

Manipulator

This node allows you to execute Python code on Spark (See PySpark documentation). The code has to put the desired output in the data frame with the name resultDataFrame1

Input Ports

  1. Port Type: Spark Data
    First input Spark DataFrame.
  2. Port Type: Spark Data
    First input Spark DataFrame.

Output Ports

  1. Port Type: Spark Data
    Result Spark DataFrame.