Creating a Loader Connection - trillium_discovery - trillium_quality - 17.2

Trillium DQ Repository Administrator Guide

Product type
Software
Portfolio
Verify
Product family
Trillium
Product
Trillium > Trillium Discovery
Trillium > Trillium Quality
Version
17.2
Language
English
Product name
Trillium Quality and Discovery
Title
Trillium DQ Repository Administrator Guide
First publish date
2008
Last updated
2024-07-01
Published on
2024-07-01T08:53:20.448228

You can create loader connections using the Repository Manager application and the Repository Administration Command Prompt utility. For information on how to create a loader connection using the utility, see Command Line Utility.

Note the following guidelines:

  • When adding loader connections to relational databases, ensure that the relational data sources are properly configured before you create entities.

  • When you add a loader connection, it is enabled by default. You can disable it if needed. For instructions, see Enabling or Disabling a Loader Connection.

  • To create HDFS delimited loader (data) connections for profiling data on a Hadoop edge node, you must add the connection in the Administration Center. This type of connection is not supported in the Repository Manager.

To add a loader connection from the Repository Manager

  1. In the Repository Manager’s Navigation View, right-click Loader Connections.

  2. Select Add Loader Connection. The Add Loader Connection window opens.

    Add Loader Connection Window
  3. In the Name field, specify a name.

  4. In the Description field, add a brief description.

  5. From the Type drop-down list, select a data source type.

  6. Configure the loader connection configuration using the information in table Loader Connection Properties as a guideline.

    Table 1. Loader Connection Properties

    Loader Connection

    Property

    Description

    COBOL Flat Fixed length Files

     

    This loader connection option allows you to connect to flat, fixed length files described by COBOL Copybooks. The data must match copybook layout.

     

    Default Filter

    Default value is *.

    Specify a default filter to limit the number of files that will get listed in the Create Entity Wizard of the Control Center.

    For example, to list only those files/tables that contain cust, enter cust in the Default Filter field.

     

    Data Directory

    Directory path to data files.

     

    Data Extensions

     

    Specify expected data file extensions. Only files with these extensions display in the Create Entity Wizard for this connection.

    If none are specified, dat is the default.

    Separate each extension with a space and omit the leading period. If you want to display files that have no extension, add {} to the list.

    Example

    If you only want to display data files with the extensions dat, txt, and files without extensions, type the following entry:

    dat txt {}

     

    Schema Directory

    Directory path to copybook files.

     

    Schema Extensions

    Specify expected schema file extensions. Only files with these extensions display in the Create Entity Wizard for this connection.

    If none are specified, cpy is the default.

    Separate each extension with a space and omit the leading period. If you want to display files that have no extension, add {} to the list.

    Example

    If you only want to display schemas with the extensions cpy and cbl, and schemas without extensions, type the following entry:

    cpy cbl {}

    DB2 (VendorSupplied)

     

    This loader connection option allows you to connect to DB2 databases.

     

    Default Filter

    Default value is *.

    Specify a default filter to limit the number of files that will get listed in the Create Entity Wizard of the Control Center.

    For example, to list only those files/tables that contain cust, enter cust in the Default Filter field.

     

    Alias

    DB2 alias.

    Delimited Files

     

    This loader connection option allows you to connect to ASCII, extended ASCII, or hexadecimal delimiters.

     

    Default Filter

    Default value is *.

    Specify a default filter to limit the number of files that will get listed in the Create Entity Wizard of the Control Center.

    For example, to list only those files/tables that contain cust, enter cust in the Default Filter field.

     

    Data Extensions

    Specify expected data file extensions. Only files with these extensions display in the Create Entity Wizard for this connection.

    If none are specified, txt, csv and dat are the default file extensions.

    Separate each extension with a space and omit the leading period. If you want to display files that have no extension, add {} to the list.

    Example

    If you only want to display data files with the extensions dat and txt, and files without extensions, enter: dat txt {}

     

    Schema Directory

    Directory path to schema files such as DDLs.

     

    Schema Extensions

    Specify expected schema file extensions. Only files with these extensions display in the Create Entity Wizard for this connection.

    If none are specified, ddl is the default.

    Separate each extension with a space and omit the leading period. If you want to display files that have no extension, add {} to the list.

    Example

    If you only want to display schemas with the extensions ddl and ddt, and schemas without extensions, type the following entry:

    ddl ddt {}

    ODBC (Vendor Supplied)

     

    This loader connection option allows you to connect to a number of databases using ODBC drivers supplied by database vendors. Choose this to connect to a database that is not available through TSS ODBC.

    Note: If you are running Trillium applications on a 64-bit system and are planning to configure ODBC, you must configure odbc32, not odbc64.

     

    Default Filter

    Default value is *.

    Specify a default filter to limit the number of files that will get listed in the Create Entity Wizard of the Control Center.

    For example, to list only those files/tables that contain cust, enter cust in the Default Filter field.

     

    Machine Name

     

    Name of the system or the IP address of the system where the ODBC Adapter is installed. (Applicable only if the ODBC Adapter is installed on a remote system.)

     

    Port Number

    Port number of TSS ODBC Service—specified during TSS ODBC Support installation.

     

    DSN Name

    The ODBC system DSN on the server where TSS ODBC Support was installed.

     

    SSO

    Optional. If you are using a Windows operating system, check the Use Single Sign-on option if you want to apply Windows authentication to users of this connection.

    Oracle (Vendor Supplied)

     

     

    This loader connection option allows you to connect to an Oracle database. This connection requires an Oracle client to be installed.

     

    Default Filter

    Default value is *.

    Specify a default filter to limit the number of files that will get listed in the Create Entity Wizard of the Control Center.

    For example, to list only those files/tables that contain cust, enter cust in the Default Filter field.

     

    TNS Name

    TNS Name is the name of the entry in tnsnames.ora file which is kept in $ORACLE_HOME/network/admin

     

    SSO

    Optional. If you are using a Windows operating system, check the Use Single Sign-on option if you want to apply Windows authentication to users of this connection.

    Trillium Flat Files

     

    This option allows you to connect to a flat file described by a schema, including files created by Trillium Quality modules when they process data.

     

    Default Filter

    Default value is *.

    Specify a default filter to limit the number of files that will get listed in the Create Entity Wizard of the Control Center.

    For example, to list only those files/tables that contain cust, enter cust in the Default Filter field.

     

    Data Directory

    Directory path to data files.

     

    Data Extensions

    Specify expected data file extensions. Only files with these extensions display in the Create Entity Wizard for this connection.

    If none are specified, no extension is the default.

    Separate each extension with a space and omit the leading period. If you want to display files that have no extension, add {} to the list.

    Example

    If you only want to display data files with the extensions dat and txt, and files without extensions, type the following entry:

    dat txt {}

     

    Schema Directory

    Directory path to schema files such as DDLs.

     

    Schema Extensions

    Specify expected schema file extensions. Only files with these extensions display in the Create Entity Wizard for this connection. If none are specified, ddl and ddx are the defaults.

    Separate each extension with a space and omit the leading period. If you want to display files that have no extension, add {} to the list.

    Example

    If you only want to display schemas with the extensions ddl and ddt, and schemas without extensions, type the following entry:

    ddl ddt {}

    TSS ODBC (Trillium Supplied)

     

     

    This loader connection option allows you to connect to the widest selection of external databases, including Oracle, DB2, SQL and so on without installing any external component.

     

    Default Filter

     

    Default value is *.

    Specify a default filter to limit the number of files that will get listed in the Create Entity Wizard of the Control Center.

    For example, to list only those files/tables that contain cust, enter cust in the Default Filter field.

     

    DSN Name

    The DSN name as defined on the server for the TSS ODBC driver.

     

    SSO

    Optional. If you are using a Windows operating system, check the Use Single Sign-on option if you want to apply Windows authentication to users of this connection.

  7. To limit repository access, repository, select Set Repository Access. The Repository Access window opens.

    Repository Access Window
  8. Click Selected repositories and then select the repositories that can be accessed using the loader connection.

  9. Click OK to save your changes.

    Note: By default, all repositories in the repository server are granted permission to use the connection.
  10. (Optional) Specify a default filter to limit the number of files that will get listed in the Create Entity Wizard of the Control Center. For example, to list only those files/tables that contain cust, enter cust in the Default Filter field.

    Note:  The default is *, to list all available files.
  11. Click OK to create the loader connection.

  12. Repeat the steps to create additional loader connections if needed.