Generic S3 Connector

This node connects to services that provide an S3-compatible API endpoint, for example MinIO . The resulting output port allows downstream nodes to access the data behind the endpoint as a file system, e.g. to read or write files and folders, or to perform other file system operations (browse/list files, copy, move, ...). If you want to connect to Amazon S3 on AWS, please use the Amazon S3 Connector node instead.

Path syntax: Paths for this file system are specified with a UNIX-like syntax, /mybucket/myfolder/myfile. An absolute consists of:

1. A leading slash ("/").
2. Followed by the name of a bucket ("mybucket" in the above example), followed by a slash.
3. Followed by the name of an object within the bucket ("myfolder/myfile" in the above example).

URI formats: When you apply the Path to URI node to paths coming from this connector, you can create URIs with the following formats:

1. Presigned https:// URLs which contain credentials, that allow to access files for a certain amount of time (see AWS documentation ).
2. s3:// URLs to access the S3-compatible endpoint with the aws command line interface, or from inside Hadoop environments.

Output ports

1. Type: File System
   Generic S3 File System Connection
   Generic S3 File System Connection

File System Connection (Dynamic Inport)

A file system connection to read the customer key, when SSE-C encryption mode is enabled.

1. Type: File System