Hub
NodeNode / Other

DB to Spark

Tools & Services Apache Spark IO Database
Drag & drop
Like
Copy short link

Reads a database query/table into a Spark RDD/DataFrame. See Spark documentation for more information.

Notice: This feature requires at least Apache Spark 1.5.

Node details

Input ports
  1. Type: DB Data
    Database query
    Input query
  2. Type: Spark Context
    Spark context
    Required Spark context.
Output ports
  1. Type: Spark Data
    Spark data
    Spark RDD/DataFrame

Extension

The DB to Spark node is part of this extension:

Related workflows & nodes

  1. 03.1_In-database&Spark_processing
    Education Data engineering Data engineer
    +3
    The company tracks the usage of the website and stores the information about each session…
    knime > Education > Courses > L4-DE Best Practices for Data Engineering > solutions > Session_3_ELT_on_Big_Data > 03.1_In-database&Spark_processing
  2. 03.3_Aggregation_on_Spark
    Education Data engineering Data engineer
    +3
    The company tracks the usage of the website and stores the information about each session…
    knime > Education > Courses > L4-DE Best Practices for Data Engineering > exercises > Session_3_ELT_on_Big_Data > 03.3_Aggregation_on_Spark
  3. 03.2_Missing_value_imputation_on_Spark
    Education Data engineering Data engineer
    +3
    The company tracks the usage of the website and stores the information about each session…
    knime > Education > Courses > L4-DE Best Practices for Data Engineering > exercises > Session_3_ELT_on_Big_Data > 03.2_Missing_value_imputation_on_Spark
  4. 03.3_Aggregation_on_Spark
    Education Data engineering Data engineer
    +3
    The company tracks the usage of the website and stores the information about each session…
    knime > Education > Courses > L4-DE Best Practices for Data Engineering > solutions > Session_3_ELT_on_Big_Data > 03.3_Aggregation_on_Spark
  5. 03.4_Writing_from_Spark
    Education Data engineering Data engineer
    +3
    The company tracks the usage of the website and stores the information about each session…
    knime > Education > Courses > L4-DE Best Practices for Data Engineering > exercises > Session_3_ELT_on_Big_Data > 03.4_Writing_from_Spark
  6. 03.2_Missing_value_imputation_on_Spark
    Education Data engineering Data engineer
    +3
    The company tracks the usage of the website and stores the information about each session…
    knime > Education > Courses > L4-DE Best Practices for Data Engineering > solutions > Session_3_ELT_on_Big_Data > 03.2_Missing_value_imputation_on_Spark
  7. 03.4_Writing_from_Spark
    Education Data engineering Data engineer
    +3
    The company tracks the usage of the website and stores the information about each session…
    knime > Education > Courses > L4-DE Best Practices for Data Engineering > solutions > Session_3_ELT_on_Big_Data > 03.4_Writing_from_Spark
  8. 04.2_ELT_Usage
    Education Data engineering Data engineer
    +3
    The company tracks the usage of the website and stores the information about each session…
    knime > Education > Courses > L4-DE Best Practices for Data Engineering > exercises > Session_4_Orchestration > 04.2_ELT_Usage
  9. 04.2_ELT_Usage
    Education Data engineering Data engineer
    +3
    The company tracks the usage of the website and stores the information about each session…
    knime > Education > Courses > L4-DE Best Practices for Data Engineering > solutions > Session_4_Orchestration > 04.2_ELT_Usage