Hub
  • Software
  • Blog
  • Forum
  • Events
  • Documentation
  • About KNIME
  • KNIME Hub
  • Nodes
  • Amazon S3 Connection (legacy)
NodeNode / Source

Amazon S3 Connection (legacy)

IO File Handling (legacy) Remote (legacy) Connections (legacy)
Drag & drop
Like
Copy short link

This node configures the connection information that will be used to connect to Amazon S3. Using this connection the other KNIME remote file handling nodes can be used to create directory, list, delete, download and upload files from and to Amazon S3.

The connection information is encoded in the format s3://accessKeyId@region . The protocol is s3 and the host is the region name. The first folder path is the bucket name and the rest is the object key, e.g. s3://AZHC7SNUZCTTSGGRGBXG@eu-west-1/knime-bucket/data/iris.data defines the object data/iris.data in the bucket knime-bucket , which is stored in the region eu-west-1 . The access key ID is AZHC7SNUZCTTSGGRGBXG .

The region name, the bucket name and the object key are needed in order to delete, download, or upload objects from a list. The access key ID is not needed. For instance, to delete the above mentioned object iris.data , it is needed to encode the path to s3://eu-west-1/knime-bucket/data/iris.data in the list.

For further documentation please take a look at the AWS Documentation .

This legacy file handling node has been replaced by the Amazon S3 Connector and will be deprecated in the foreseeable future. For further information about the new file handling framework see the File Handling Guide.

Node details

Output ports
  1. Type: Remote Connection
    Connection information port
    Port object containing the S3 connection information.

Extension

The Amazon S3 Connection (legacy) node is part of this extension:

  1. Go to item

Related workflows & nodes

  1. Go to item
    Connecting to Amazon EMR
    Amazon AWS EMR
    +4
    This workflow demonstrates how to create a Spark context via Apache Livy and execute a si…
    knime > Examples > 10_Big_Data > 01_Big_Data_Connectors > 08_Connecting_to_Amazon_EMR
  2. Go to item
    Amazon S3 Remote File Example
    Amazon S3 Cloud Remote
    +2
    In order to connect to the service, Amazon S3 credentials are required. Folders created o…
    knime > Examples > 01_Data_Access > 06_ZIP_and_Remote_Files > 01_Amazon_S3_Remote_File_Example
  3. Go to item
    Amazon S3 Remote File Example
    Amazon S3 Cloud Remote
    +2
    In order to connect to the service, Amazon S3 credentials are required. Folders created o…
    khofenbitzer > Public > 01_Amazon_S3_Remote_File_Example
  4. Go to item
    Amazon S3 Remote File Example
    Amazon S3 Cloud Remote
    +2
    In order to connect to the service, Amazon S3 credentials are required. Folders created o…
    haoran > Public > 01_Data_Access > 06_ZIP_and_Remote_Files > 01_Amazon_S3_Remote_File_Example
  5. Go to item
    Cleaning the NYC taxi dataset on Spark
    Big data Exploration Visualization
    +4
    This workflow handles the preprocessing of the NYC taxi dataset (loading, cleaning, filte…
    knime > Examples > 50_Applications > 49_NYC_Taxi_Visualization > Data_Preparation
  6. Go to item
    log_parser_jobnames
    This workflow basically retrievs log files from the KNIME Server, parses them in a certai…
    iris > KNIME Server Helpers > Log Parser (Job Names) > log_parser_jobnames
  7. Go to item
    Interactive Big Data Exploration and Visualization
    Big data Data exploration Visualization
    +3
    This workflow shows how to perform data exploration and visualization on a large dataset …
    knime > Examples > 50_Applications > 49_NYC_Taxi_Visualization > Taxi_Visualization
  1. Go to item
  2. Go to item
  3. Go to item
  4. Go to item
  5. Go to item
  6. Go to item

KNIME
Open for Innovation

KNIME AG
Hardturmstrasse 66
8005 Zurich, Switzerland
  • Software
  • Getting started
  • Documentation
  • E-Learning course
  • Solutions
  • KNIME Hub
  • KNIME Forum
  • Blog
  • Events
  • Partner
  • Developers
  • KNIME Home
  • KNIME Open Source Story
  • Careers
  • Contact us
Download KNIME Analytics Platform Read more on KNIME Server
© 2022 KNIME AG. All rights reserved.
  • Trademarks
  • Imprint
  • Privacy
  • Terms & Conditions
  • Credits