Hub
NodeNode / Other

Database to Spark (legacy)

Tools & Services Apache Spark IO Database
Drag & drop
Like
Copy short link

This node is part of the legacy database framework and will be deprecated at the end of 2022. For more information on how to migrate to the new database framework see the migration section of the database documentation .

Reads a database query/table into a Spark RDD/DataFrame. See Spark documentation for more information.

Notice: This feature requires at least Apache Spark 1.5.

Node details

Input ports
  1. Type: Database Query
    Database query
    Input query
  2. Type: Spark Context
    Spark context
    Required Spark context.
Output ports
  1. Type: Spark Data
    Spark data
    Spark RDD/DataFrame

Extension

The Database to Spark (legacy) node is part of this extension:

Related workflows & nodes