Create a new remote file server for Snowflake on AWS - Connect_CDC - connect_cdc_mimix_share - 6.x

Connect CDC Getting Started Guide
Product type
Software
Portfolio
Integrate
Product family
Connect
Product
Connect > Connect CDC (MIMIX Share)
Version
6.x
Language
English
Product name
Connect CDC
Title
Connect CDC Getting Started Guide
Copyright
2024
First publish date
2003
Last updated
2024-10-15
Published on
2024-10-15T20:38:41.117981

This section describes how you create a new remote file server connection for staging (storing) your data in your external storage environment.

The following remote file server connection types are supported:

  • Amazon (AWS) S3 Storage. An Amazon S3 stage is an external S3 bucket location where data files are stored (staged) in batches before data is loaded into Snowflake tables. The storage location can be either private (protected) or public.

  • Snowflake Internal. If you do not plan to use Amazon S3 Storage for external staging, then you must instead configure your Snowflake DBMS server to use an internal (local) Snowflake staging location. For more information, see Create a new server for Snowflake.

  • Azure Storage. In addition to Amazon S3 Storage for external staging, you can configure your Azure Storage to use an external Snowflake staging location.

  1. To create a new remote file server connection:

    • From a Server Properties dialog for a Snowflake server, under Staging, click New.

    • Right-click a host or the Remote file servers branch, and select New Remote File Server.

      The Remote File Server Properties dialog opens.

    • Right-click a host and select Properties.

      The Remote File Server Properties dialog opens.

  2. On the Cloud tab, enter information for each field.

Table 1. Remote File Server Properties for Snowflake

Parameter

Description

Name

Use alphanumeric characters to specify a unique remote file server name for use in the model.

Note: The slash (/), backslash (\), colon (:), left caret (<), right caret (>), and spaces cannot be used in a Server name.

Connection type

Select AWS S3 from the dropdown list. Based on your selection, you will get a different set of options in the Remote File Server Properties window.

Authentication Method
Click the Authentication method dropdown list and select one of the following authentication methods:
  • Keys. When selected, specify the following:
    • AWS Access key. Enter the Amazon Web Services (AWS) access key ID, which is alphanumeric string that is a component of the AWS access key and uniquely identifies the AWS account. For example: AKIAIOSFODNN7EXAMPLE.
    • AWS Secret key. Enter the AWS secret access key, which is a string that is a component of the AWS access key. For example: wJalrXUtnFEMI/K7MDENG/bPxRfiCYEXAMPLEKEY.

  • Use Runtime Environment. This option can be specified when running Connect CDC on a cloud EC2 machine with an IAM role attached. In this case, no keys are required.

Bucket url and encryption
Specify the following bucket staging properties:
  • Bucket url. Enter the path to an S3 bucket. Enter the string using this syntax: s3://bucket_name[/key]. External staging CDC data files will be created in the specified bucket.
  • Bucket encryption. Amazon S3 encrypts your unencrypted data at its destination then decrypts it when you access it. Click the drop-down list and select one of the following encryption methods:
    • AES256 (the default). 256-bit Advanced Encryption Standard
    • aws-kms. AWS Key Management Service (KMS).
    • None.

Verify

Click to test the remote file server connection. After a few seconds a message opens with information about whether the test was successful. If the test was unsuccessful, note the errors in the message, troubleshoot, and verify again.