03_DatabricksExample

Working with Databricks

This workflow demonstrates the usage of the Create Databricks Environment node which allows you to connect to a Databricks Cluster from within KNIME Analystics Platform.

The node provides three output ports that allow you to utilize the existing DB nodes to interact wtih the Databricks DB, the file handling nodes to work with the Databricks File System, and the Spark nodes to visually assemble Spark analytics flows. All of these nodes allow you to push down the data processing into the Databricks cluster.

External resources

• Databricks on Microsoft Azure
• Databricks on Amazon AWS