Hub
Pricing About
  • Software
  • Blog
  • Forum
  • Events
  • Documentation
  • About KNIME
  • KNIME Community Hub
  • Nodes
  • Google Cloud Storage Connector
NodeNode / Source

Google Cloud Storage Connector

IO Connectors
Drag & drop
Like
Copy short link

This node connects to Google Cloud Storage. The resulting output port allows downstream nodes to access the Google Cloud Storage data of a project as a file system, e.g. to read or write files and folders, or to perform other file system operations (browse/list files, copy, move, ...).

Please note that for authentication purposes, this node requires the "Google Authentication (API key)" node to be connected to its input port.

Path syntax: Paths for Google Cloud Storage are specified with a UNIX-like syntax, /mybucket/myfolder/myfile. An absolute for Google Cloud Storage consists of:

  1. A leading slash ("/").
  2. Followed by the name of a bucket ("mybucket" in the above example), followed by a slash.
  3. Followed by the name of an object within the bucket ("myfolder/myfile" in the above example).

URI formats: When you apply the Path to URI node to paths coming from this connector, you can create URIs with the following formats:

  1. Signed https:// URLs which contain credentials, that allow to access files for a certain amount of time (see Signed URLs ).
  2. gs:// URLs which can be used to access Google Storage with tools like Google's gsutil or in Hadoop environments.

Node details

Input ports
  1. Type: Google API
    Google API Connection
    The Google Service Connection that carries authentication credentials. Please note that currently only the "Google Authentication (API key)" node can be connected to this port.
Output ports
  1. Type: File System
    Google Cloud Storage File System Connection
    Google Cloud Storage File System Connection

Extension

The Google Cloud Storage Connector node is part of this extension:

  1. Go to item

Related workflows & nodes

  1. Go to item
    Working with Utility Nodes
    File handling Zip Unzip
    +4
    Download compressed file, extract it, read extracted file and finaly delete extracted fil…
    knime > Examples > 01_Data_Access > 01_Common_Type_Files > 11_Working_with_Utility_Nodes
    knime
  2. Go to item
    KNIME_Credit_Card_Rating
    sangramgupta > Public > KNIME_Credit_Card_Rating
    sangramgupta
  3. Go to item
    Working with Utility Nodes
    File handling Zip Unzip
    +4
    Download compressed file, extract it, read extracted file and finaly delete extracted fil…
    haoran > Public > 01_Data_Access > 01_Common_Type_Files > 11_Working_with_Utility_Nodes
    haoran
  4. Go to item
    Incremental Data Processing with Parquet
    Parquet Incremental loading NYC taxi dataset
    +3
    In this workflow, we will use the NYC taxi dataset to show case a continous preprocessing…
    knime > Examples > 01_Data_Access > 01_Common_Type_Files > 12_Incremental_processing_Parquet_file
    knime
  5. Go to item
    Incremental Data Processing with Parquet
    Parquet Incremental loading NYC taxi dataset
    +3
    In this workflow, we will use the NYC taxi dataset to show case a continous preprocessing…
    haoran > Public > 01_Data_Access > 01_Common_Type_Files > 12_Incremental_processing_Parquet_file
    haoran
  6. Go to item
    Microsoft Sharepoint meets Google Cloud Storage
    Google Cloud Microsoft Sharepoint
    +6
    This workflow accesses data on Google Cloud Storage and on Microsoft Sharepoint, blends t…
    knime > Examples > 01_Data_Access > 06_ZIP_and_Remote_Files > 08_Microsoft_Sharepoint_meets_Google_Cloud_Storage
    knime
  7. Go to item
    Microsoft Sharepoint meets Google Cloud Storage
    Google Cloud Microsoft Sharepoint
    +2
    This workflow accesses data on Google Cloud Storage and on Microsoft Sharepoint, blends t…
    stengelb > Public > 08_Microsoft_Sharepoint_meets_Google_Cloud_Storage
    stengelb
  8. Go to item
    Microsoft Sharepoint meets Google Cloud Storage
    Google Cloud Microsoft Sharepoint
    +6
    This workflow accesses data on Google Cloud Storage and on Microsoft Sharepoint, blends t…
    haoran > Public > 01_Data_Access > 06_ZIP_and_Remote_Files > 08_Microsoft_Sharepoint_meets_Google_Cloud_Storage
    haoran
  9. Go to item
    Generating Invoice Reports
    Google Cloud Microsoft Sharepoint
    +5
    This workflow accesses data on Google Cloud Storage and on Microsoft Sharepoint, blends t…
    knime > Finance, Accounting, and Audit > Generating Invoice Reports
    knime
  10. Go to item
    Data Transfer between Clouds
    File handling Google Sharepoint
    +1
    This workflow demonstrates the utilization of the new file system connection nodes within…
    knime > Examples > 01_Data_Access > 06_ZIP_and_Remote_Files > 09_Data_Transfer_between_Clouds
    knime

No known nodes available

KNIME
Open for Innovation

KNIME AG
Talacker 50
8001 Zurich, Switzerland
  • Software
  • Getting started
  • Documentation
  • E-Learning course
  • Solutions
  • KNIME Hub
  • KNIME Forum
  • Blog
  • Events
  • Partner
  • Developers
  • KNIME Home
  • KNIME Open Source Story
  • Careers
  • Contact us
Download KNIME Analytics Platform Read more on KNIME Business Hub
© 2023 KNIME AG. All rights reserved.
  • Trademarks
  • Imprint
  • Privacy
  • Terms & Conditions
  • Credits