Hub
NodeNode / Source

HDFS Connector

IO Connectors
Drag & drop
Like
Copy short link

This node connects to a Hadoop Distributed File System using HDFS, WebHDFS or HTTPFS. The resulting output port allows downstream nodes to access the files of the remote file system, e.g. to read or write, or to perform other file system operations (browse/list files, copy, move, ...).

Path syntax: Paths for HDFS are specified with a UNIX-like syntax, /myfolder/myfile. An absolute for HDFS consists of:

  1. A leading slash ("/").
  2. Followed by the path to the file ("myfolder/myfile" in the above example).

SSL: This node uses the JVM SSL settings.

Node details

Output ports
  1. Type: File System
    HDFS File System Connection
    HDFS File System Connection.

Extension

The HDFS Connector node is part of this extension:

Related workflows & nodes

  1. Spark Java snippet nodes
    Spark Hadoop Big Data
    This workflow demonstrates the usage of the different Spark Java Snippet nodes to read a …
    knime > Education > Courses > L4-BD Introduction to Big Data with KNIME Analytics Platform > 3_Spark > 4_Examples > 06_Modularized_Spark_Scripting
    knime
  2. EC2_connection
    mraraman > Public > IPF > EC2_connection
    mraraman
  3. EC2_connection
    alamisrar > Public > IPF > EC2_connection
    alamisrar
  4. Working with Utility Nodes
    File handling Zip Unzip
    +4
    Download compressed file, extract it, read extracted file and finaly delete extracted fil…
    knime > Examples > 01_Data_Access > 01_Common_Type_Files > 11_Working_with_Utility_Nodes
    knime
  5. Working with Utility Nodes
    File handling Zip Unzip
    +4
    Download compressed file, extract it, read extracted file and finaly delete extracted fil…
    haoran > Public > 01_Data_Access > 01_Common_Type_Files > 11_Working_with_Utility_Nodes
    haoran
  6. Incremental Data Processing with Parquet
    Parquet Incremental loading NYC taxi dataset
    +3
    In this workflow, we will use the NYC taxi dataset to show case a continous preprocessing…
    knime > Examples > 01_Data_Access > 01_Common_Type_Files > 12_Incremental_processing_Parquet_file
    knime
  7. Incremental Data Processing with Parquet
    Parquet Incremental loading NYC taxi dataset
    +3
    In this workflow, we will use the NYC taxi dataset to show case a continous preprocessing…
    haoran > Public > 01_Data_Access > 01_Common_Type_Files > 12_Incremental_processing_Parquet_file
    haoran
  8. Data Transfer between Clouds
    File handling Google Sharepoint
    +1
    This workflow demonstrates the utilization of the new file system connection nodes within…
    knime > Examples > 01_Data_Access > 06_ZIP_and_Remote_Files > 09_Data_Transfer_between_Clouds
    knime
  9. Data Transfer between Clouds
    File handling Google Sharepoint
    +1
    This workflow demonstrates the utilization of the new file system connection nodes within…
    haoran > Public > 01_Data_Access > 06_ZIP_and_Remote_Files > 09_Data_Transfer_between_Clouds
    haoran