/DATASIZE - Connect_ETL - 9.13

Connect ETL Data Transformation Language (DTL) Guide

Product type
Software
Portfolio
Integrate
Product family
Connect
Product
Connect > Connect (ETL, Sort, AppMod, Big Data)
Version
9.13
ft:locale
en-US
Product name
Connect ETL
ft:title
Connect ETL Data Transformation Language (DTL) Guide
Copyright
2023
First publish date
2003
ft:lastEdition
2023-09-11
ft:lastPublication
2023-09-11T19:01:45.019000

Purpose

To provide the expected size of the source data post-filtering.

Format

/DATASIZE number {RECORDS|BYTES|KILOBYTES|MEGABYTES|GIGABYTES|TERABYTES}

Arguments

number The amount of data released to the task, in the unit specified.

Location

The option may appear anywhere in the task definition for tasks other than a join. For a join task, the /DATASIZE option for the left side of the join must appear after the source options, for example, /INFILE, that define the left side input stream, and before the source options that define the right-side input stream. The /DATASIZE option for the right side must appear after the source options that define the right-side input stream. Any /DATASIZE option that appears before the first source option for the left side is ignored.

Notes

It is recommended that you provide the /DATASIZE option for a sort or a join task when Connect ETL cannot obtain the information from the file system for the input files. It is also recommended for a Sort task when you request input selection which omits a sizeable percentage of the records.

/DATASIZE overrides any size values you specified for /INFILE.

Examples

/datasize 256 megabytes 
This informs Connect ETL that 256 megabytes of data are released to Connect ETL after input record processing is done.
/datasize 700 records 

This informs Connect ETL that 700 records of data are released to Connect ETL after input record processing is done