Hub
NodeNode / Source

HDFS Connector (KNOX)

IO Connectors
Drag & drop
Like
Copy short link

This node connects to Hadoop Distributed File System (HDFS) using an Apache KNOX gateway. The resulting output port allows downstream nodes to access the files of the remote file system, e.g. to read or write, or to perform other file system operations (browse/list files, copy, move, ...).

Path syntax: Paths for HDFS are specified with a UNIX-like syntax, for example /myfolder/file.csv , which is an absolute path that consists of:

  1. A leading slash ( / ).
  2. The name of a folder ( myfolder ), followed by a slash.
  3. Followed by the name of a file ( file.csv ).

SSL: This node uses the JVM SSL settings.

Node details

Output ports
  1. Type: File System
    HDFS (via KNOX) File System Connection
    HDFS (via KNOX) File System Connection.

Extension

The HDFS Connector (KNOX) node is part of this extension:

Related workflows & nodes

  1. Working with Utility Nodes
    File handling Zip Unzip
    +4
    Download compressed file, extract it, read extracted file and finaly delete extracted fil…
    knime > Examples > 01_Data_Access > 01_Common_Type_Files > 11_Working_with_Utility_Nodes
    knime
  2. Working with Utility Nodes
    File handling Zip Unzip
    +4
    Download compressed file, extract it, read extracted file and finaly delete extracted fil…
    haoran > Public > 01_Data_Access > 01_Common_Type_Files > 11_Working_with_Utility_Nodes
    haoran
  3. Incremental Data Processing with Parquet
    Parquet Incremental loading NYC taxi dataset
    +3
    In this workflow, we will use the NYC taxi dataset to show case a continous preprocessing…
    knime > Examples > 01_Data_Access > 01_Common_Type_Files > 12_Incremental_processing_Parquet_file
    knime
  4. Incremental Data Processing with Parquet
    Parquet Incremental loading NYC taxi dataset
    +3
    In this workflow, we will use the NYC taxi dataset to show case a continous preprocessing…
    haoran > Public > 01_Data_Access > 01_Common_Type_Files > 12_Incremental_processing_Parquet_file
    haoran
  5. Data Transfer between Clouds
    File handling Google Sharepoint
    +1
    This workflow demonstrates the utilization of the new file system connection nodes within…
    knime > Examples > 01_Data_Access > 06_ZIP_and_Remote_Files > 09_Data_Transfer_between_Clouds
    knime
  6. Data Transfer between Clouds
    File handling Google Sharepoint
    +1
    This workflow demonstrates the utilization of the new file system connection nodes within…
    haoran > Public > 01_Data_Access > 06_ZIP_and_Remote_Files > 09_Data_Transfer_between_Clouds
    haoran