Google Cloud Storage List - Data360_Analyze - Latest

Data360 Analyze Server Help

Product type
Software
Portfolio
Verify
Product family
Data360
Product
Data360 Analyze
Version
Latest
Language
English
Product name
Data360 Analyze
Title
Data360 Analyze Server Help
Copyright
2024
First publish date
2016
Last updated
2024-11-28
Published on
2024-11-28T15:26:57.181000

Lists files on a Google Cloud Storage server.

The Google Cloud Storage nodes enable you to access data from Google Cloud Storage buckets, so that you can integrate your data flows with Google. See:

To create a list of files in a single location on a Google Cloud Storage server, specify the name of a Google Cloud Storage bucket that you want to interrogate in the Bucket property.

If you want to list files from multiple locations on a Google Cloud Storage server, use the (from Field) variant of the Bucket property to point to an input field containing a list of Google Cloud Storage buckets.

Tip: For additional information on interacting with Google Cloud Storage, see the Google Cloud Storage documentation.

Properties

Bucket

Specify the name of the Google Cloud Storage Bucket.

Choose the (from Field) variant of this property to look up the value from an input field with the name specified.

A value is required for this property.

ObjectPrefix

Optionally specify the prefix of the Google Cloud Storage Objects.

Choose the (from Field) variant of this property to look up the value from an input field with the name specified.

If the prefix is not set then all objects will be listed.

Credentials

Optionally specify the file containing the Google Cloud Storage credentials.

If the Credentials are not set then the Google Cloud Storage default strategy will be used.

DirectoryMode

Returns results in a directory-like mode. Choose from:

  • True - Allows the Google Cloud Storage List node to operate like a directory listing.

    In Google Cloud Storage, the object namespace is flat, but you can use the API to return objects that do not contain a specified delimiter. Setting DirectoryMode to true is equivalent to specifying a forward slash character '/' as a delimiter, which returns a list of files. The API also returns, as prefixes, a list of objects that do contain the delimiter, truncated to the first instance of that delimiter.

    For example, if a bucket contains "file1.txt" and "dir1/file2.txt", setting DirectoryMode to true returns "file1.txt" and "dir1/" as objects.

  • False - Returns a list of all objects in the specified Bucket, or objects in the Bucket whose name begins with ObjectPrefix if a value is specified.

The default value is False.

FailureBehavior

Optionally specify what to do when the request fails. Choose from:

  • Error - Report error and stop further processing.
  • Log - Log a warning message.
  • Ignore - Ignore the error.

The default value is Log.

Inputs and outputs

Inputs: 1 optional.

Outputs: listed files, errors.