Google Cloud Storage Get - Data360_Analyze - Latest

Downloads files from a server using the Google Cloud Storage protocol.

The Google Cloud Storage nodes enable you to access data from Google Cloud Storage buckets, so that you can integrate your data flows with Google. See:

• Google Cloud Services List
• Google Cloud Services Delete
• Google Cloud Services Put

Downloading a single file from Google Cloud Storage

1. In the Bucket property, specify the name of a Google Cloud Storage bucket that contains the file that you want to download.
2. In the Object property, specify the name of the Google Cloud Storage file that you want to download.
3. In the Directory property, specify where to store the file that is downloaded.

Downloading multiple files from Google Cloud Storage

1. Drag a Google Cloud Storage List node onto the canvas and connect it to a Google Cloud Storage Get node.
2. In the Bucket property of the Google Cloud Storage List node, type the name of the Google Cloud Storage bucket that contains the files that you want to download. Run the Google Cloud Storage List node to generate a list of files in the specified bucket.
3. On the Google Cloud Storage Get node, select the (from Field) variant of the Bucket property and specify the name of the input field that contains the Google Cloud Storage bucket name.
4. Select the (from Field) variant of the Object property, then specify the name of the input field that references the files that you want to download.
5. In the Directory property, specify where to store the downloaded files.

Example

You want to download all files with the "Product" prefix from a Google Cloud Storage bucket:

1. Drag a Google Cloud Storage List node onto the canvas.
2. In the Bucket property, type the name of the Google Cloud Storage bucket for which you want to list files, e.g. my-example-bucket
3. In the ObjectPrefix property, type Product.
4. Run the Google Cloud Storage List node and connect it to a Google Cloud Storage Get node.

   The output of the Google Cloud Storage List node is as follows:

   Bucket unicode	Object unicode	Size long	IsDirectory boolean	Owner unicode	Modified datetime	StorageClass unicode	Md5 unicode
   my-example-bucket	Product_A.txt	25	NULL	owner@account	2017-10-27T08:04:58-0400	STANDARD	md5
   my-example-bucket	Product_B.txt	25	NULL	owner@account	2017-10-27T08:04:58-0400	STANDARD	md5
   my-example-bucket	Product_C.txt	25	NULL	owner@account	2017-10-27T08:04:58-0400	STANDARD	md5
   my-example-bucket	Product_D.txt	25	NULL	owner@account	2017-10-27T08:04:58-0400	STANDARD	md5

5. On the Google Cloud Storage Get node, select the (fromField) variant of the Bucket property and type the name of the input field that contains the Google Cloud Storage bucket name, in this case Bucket.
6. Select the (from Field) variant of the Object property, then specify the name of the input field that references the files that you want to download, in this case Object.
7. In the Directory property, specify where to store the downloaded files, e.g. C:\Users\<username>\Documents\Google Cloud Storage download.
8. Run the Google Cloud Storage Get node to download the files from Google Cloud Storage.