Hub
NodeNode / Other

Avro to Spark (deprecated)

Tools & Services Apache Spark IO Read
Drag & drop
Like
Copy short link

Creates a Spark DataFrame/RDD from given Avro file.

Notice: This feature requires at least Apache Spark 1.5.

Node details

Input ports
  1. Type: Remote Connection
    Remote file connection
    Spark compatible connection (HDFS, WebHDFS, HttpFS, S3, Blob Storage, ...)
  2. Type: Spark Context
    Spark context
    Optional Spark context. If not connected a context is created based on the settings in the Spark preferences page.
Output ports
  1. Type: Spark Data
    Spark data
    Spark DataFrame/RDD

Extension

The Avro to Spark (deprecated) node is part of this extension: