NodeHive to Spark (legacy)

Other

This node is part of the legacy database framework. For more information on how to migrate to the new database framework see the migration section of the database documentation.

Converts an incoming Hive query into a Spark DataFrame/RDD by executing the query in Spark.

Notice: On clusters with Hortonworks HDP 3.x, this node requires Hive Warehouse Connector to be part of the Spark classpath and correctly configured. Please consult the HDP documentation.

Input ports
  1. Hive query Type: Database Query
    Input data (Hive query).
  2. Spark context Type: Spark Context
    Required Spark context.
Output ports
  1. Spark data Type: Spark Data
    Spark DataFrame/RDD
  1. Local Big Data Irish Meter
    Hive Spark Spark PCA Spark Pivot Local Big Data Environment Big Data Spark SQL Parquet IoT Internet of Things
    This workflow uses a portion of the Irish Energy Meter dataset, and presents a simple analysis based on the whitepaper …
    knime > Examples > 10_Big_Data > 02_Spark_Executor > 09_Big_Data_Irish_Meter_on_Spark_only
  2. Hive to Spark and Spark to Hive
    Spark Hive Hadoop Big Data SQL
    This workflow demonstrates the usage of the Hive to Spark and Spark to Hive nodes that allow you to transfer data betwe…
    knime > Examples > 10_Big_Data > 02_Spark_Executor > 05_Hive_to_Spark_to_Hive
  3. Hive - how to get from DB-Connectors to Hive (or Impala) tables - Legacy nodes up to vers. 3.7.x
    big data hive impala db nodes legacy
    Hive - how to get from DB-Connectors to Hive (or Impala) tables
    mlauber71 > Public > kn_example_hive_db_loader_37