Hub
  • Software
  • Blog
  • Forum
  • Events
  • Documentation
  • About KNIME
  • KNIME Hub
  • Nodes
  • DB to Spark
NodeNode / Other

DB to Spark

Tools & Services Apache Spark IO Database
Drag & drop
Like
Copy short link

Reads a database query/table into a Spark RDD/DataFrame. See Spark documentation for more information.

Notice: This feature requires at least Apache Spark 1.5.

Node details

Input ports
  1. Type: DB Data
    Database query
    Input query
  2. Type: Spark Context
    Spark context
    Required Spark context.
Output ports
  1. Type: Spark Data
    Spark data
    Spark RDD/DataFrame

Extension

The DB to Spark node is part of this extension:

  1. Go to item

Related workflows & nodes

  1. Go to item
    03.1_In-database&Spark_processing
    Education Data engineering Data engineer
    +3
    The company tracks the usage of the website and stores the information about each session…
    knime > Education > Courses > L4-DE Best Practices for Data Engineering > solutions > Session_3_ELT_on_Big_Data > 03.1_In-database&Spark_processing
  2. Go to item
    03.3_Aggregation_on_Spark
    Education Data engineering Data engineer
    +3
    The company tracks the usage of the website and stores the information about each session…
    knime > Education > Courses > L4-DE Best Practices for Data Engineering > exercises > Session_3_ELT_on_Big_Data > 03.3_Aggregation_on_Spark
  3. Go to item
    03.2_Missing_value_imputation_on_Spark
    Education Data engineering Data engineer
    +3
    The company tracks the usage of the website and stores the information about each session…
    knime > Education > Courses > L4-DE Best Practices for Data Engineering > exercises > Session_3_ELT_on_Big_Data > 03.2_Missing_value_imputation_on_Spark
  4. Go to item
    03.3_Aggregation_on_Spark
    Education Data engineering Data engineer
    +3
    The company tracks the usage of the website and stores the information about each session…
    knime > Education > Courses > L4-DE Best Practices for Data Engineering > solutions > Session_3_ELT_on_Big_Data > 03.3_Aggregation_on_Spark
  5. Go to item
    03.4_Writing_from_Spark
    Education Data engineering Data engineer
    +3
    The company tracks the usage of the website and stores the information about each session…
    knime > Education > Courses > L4-DE Best Practices for Data Engineering > exercises > Session_3_ELT_on_Big_Data > 03.4_Writing_from_Spark
  6. Go to item
    03.2_Missing_value_imputation_on_Spark
    Education Data engineering Data engineer
    +3
    The company tracks the usage of the website and stores the information about each session…
    knime > Education > Courses > L4-DE Best Practices for Data Engineering > solutions > Session_3_ELT_on_Big_Data > 03.2_Missing_value_imputation_on_Spark
  7. Go to item
    03.4_Writing_from_Spark
    Education Data engineering Data engineer
    +3
    The company tracks the usage of the website and stores the information about each session…
    knime > Education > Courses > L4-DE Best Practices for Data Engineering > solutions > Session_3_ELT_on_Big_Data > 03.4_Writing_from_Spark
  8. Go to item
    04.2_ELT_Usage
    Education Data engineering Data engineer
    +3
    The company tracks the usage of the website and stores the information about each session…
    knime > Education > Courses > L4-DE Best Practices for Data Engineering > exercises > Session_4_Orchestration > 04.2_ELT_Usage
  9. Go to item
    04.2_ELT_Usage
    Education Data engineering Data engineer
    +3
    The company tracks the usage of the website and stores the information about each session…
    knime > Education > Courses > L4-DE Best Practices for Data Engineering > solutions > Session_4_Orchestration > 04.2_ELT_Usage

No known nodes available

KNIME
Open for Innovation

KNIME AG
Hardturmstrasse 66
8005 Zurich, Switzerland
  • Software
  • Getting started
  • Documentation
  • E-Learning course
  • Solutions
  • KNIME Hub
  • KNIME Forum
  • Blog
  • Events
  • Partner
  • Developers
  • KNIME Home
  • KNIME Open Source Story
  • Careers
  • Contact us
Download KNIME Analytics Platform Read more on KNIME Server
© 2022 KNIME AG. All rights reserved.
  • Trademarks
  • Imprint
  • Privacy
  • Terms & Conditions
  • Credits