Hub
NodeNode / Other

Text to Spark (deprecated)

Tools & Services Apache Spark IO Read
Drag & drop
Like
Copy short link

Reads text from HDFS into a Spark DataFrame/RDD.

Notice: This feature requires at least Apache Spark 1.6.

Node details

Input ports
  1. Type: Remote Connection
    Remote file connection
    Spark compatible connection (HDFS, WebHDFS, HttpFS, S3, Blob Storage, ...)
  2. Type: Spark Context
    Spark context
    Required Spark context.
Output ports
  1. Type: Spark Data
    Spark data
    Spark DataFrame/RDD

Extension

The Text to Spark (deprecated) node is part of this extension:

Related workflows & nodes