Using an Azure Synapse Analytics JDBC connection, Connect for Big Data can write supported Azure Synapse Analytics data types to Azure Synapse Analytics targets directly for optimal performance.
Defining Azure Synapse Analytics targets
At the Target Database Table dialog, define an Azure Synapse Analytics database table
target:
- At Connection, select a previously defined Azure Synapse Analytics target connection or select Add new... to add a new one.
- Select a table from the list of Tables, or select Create new... to create a new one.
- User defined SQL statement is not supported.
- All target disposition methods are supported.
- On the Parameters tab, the following optional parameters are available for Azure
Synapse Analytics target database tables. Values specified here take precedence over
their corresponding property in the JDBC configuration file, if any.
- Maximum parallel streams - the maximum number of parallel streams that can be established to load data for performance and that are created according to demand.
- Work table directory - Required. A URL that includes the Blob Storage account name
with the endpoint, including the container name. See https://docs.microsoft.com/en-us/azure/storage/blobs/storage-blobs-introduction#blob-storage-resources.
For example:
WorkTableDirectory=https://<dmxazurestorage>.blob.core.windows.net/dmx- azstorage-containerWhere <dmxazurestorage> is the Blob storage account name and <dmx-azstorage-container> is the container name. If the work table directory is missing or invalid, Connect issues an AZSQDWTERR error message and aborts the job.
- Work table codec - specifies the compression algorithm used to compress data staged in Blob storage.
- Work table schema - the schema used to create the staging table.
- Set commit interval and Abort task if any record is rejected are not supported.