This node connects to services that provide an S3-compatible API endpoint, for example MinIO . The resulting output port allows downstream nodes to access the data behind the endpoint as a file system, e.g. to read or write files and folders, or to perform other file system operations (browse/list files, copy, move, ...). If you want to connect to Amazon S3 on AWS, please use the Amazon S3 Connector node instead.
Path syntax: Paths for this file system are specified with a UNIX-like syntax, /mybucket/myfolder/myfile. An absolute consists of:
- A leading slash ("/").
- Followed by the name of a bucket ("mybucket" in the above example), followed by a slash.
- Followed by the name of an object within the bucket ("myfolder/myfile" in the above example).
URI formats: When you apply the Path to URI node to paths coming from this connector, you can create URIs with the following formats:
- Presigned https:// URLs which contain credentials, that allow to access files for a certain amount of time (see AWS documentation ).
- s3:// URLs to access the S3-compatible endpoint with the aws command line interface, or from inside Hadoop environments.