Hub
Pricing About
NodeNode / Source

Create Big Data Test Environment (deprecated)

Tools & ServicesApache Spark

This node has been deprecated and its use is not recommended. Please search for updated nodes instead.

Like

Creates a fully functional big data environment for testing purposes, including Apache Hive, Apache Spark and a remote file system. This node has no own configuration, instead it will read its configuration from a file called flowvariables.csv from the root of the KNIME workspace. This file is expected two provide keys and values. These can be used to control what this node does.

Note: This node only creates a new Spark context upon its first execution after KNIME has started, or after the context has been destroyed. The Spark context created by during its first execution is meant to be shared between KNIME testflows.

Note: This node uses the old connection information based file system output port.

Node details

Output ports
  1. Type: DB Session
    Hive Connection
    JDBC connection to a Hive instance. This port can be connected to the KNIME database nodes.
  2. Type: Remote Connection
    Remote file system Connection
    Remote file system connection that can be used with the Spark nodes that read/write files.
  3. Type: Spark Context
    Spark Context
    Spark context, that can be connected to all Spark nodes.

Extension

The Create Big Data Test Environment (deprecated) node is part of this extension:

  1. Go to item

Related workflows & nodes

  1. Go to item
  2. Go to item
  3. Go to item

KNIME
Open for Innovation

KNIME AG
Talacker 50
8001 Zurich, Switzerland
  • Software
  • Getting started
  • Documentation
  • Courses + Certification
  • Solutions
  • KNIME Hub
  • KNIME Forum
  • Blog
  • Events
  • Partner
  • Developers
  • KNIME Home
  • Careers
  • Contact us
Download KNIME Analytics Platform Read more about KNIME Business Hub
© 2025 KNIME AG. All rights reserved.
  • Trademarks
  • Imprint
  • Privacy
  • Terms & Conditions
  • Data Processing Agreement
  • Credits