When you are using an entity created from a relational data source, you have the option to load data from the database for a batch script. By specifying a database table name, you can configure a batch script to extract the data directly from the database, route it to your project and run it through the process flow. By adding a Database Write process at any point in the project, you can write back outputs to the database.
Guidelines: Note the following
guidelines when using the database read function:
- After the loader connection is established, you need to create an entity using the database as a data source and create a project. You can use both dynamic and real entities.
- If you are reading a large number of rows, consider doing one of the following to
optimize performance:
- Define an SQL Where clause in the Create Entity Wizard to filter the data.
- Select Use pipes in Script Options in the Export Project Options window to pipe the data through the project's processes.
- The maximum attribute size is 32KB for database read/write. Attributes that are bigger than 32KB such as Text fields in SQL Database will be truncated.
To read data from a database for a batch export
-
(Optional) The password is always displayed in the control file (STX file). If you want the password to display encrypted, select Encrypt Password.
Note: The password option will become the Reset password option after encryption. The next time you enter the username and password, check the Reset password option and re-enter your password.
