/DATASIZE - Connect_ETL - 9.13

Connect ETL Data Transformation Language (DTL) Guide

Product type
Software
Portfolio
Integrate
Product family
Connect
Product
Connect > Connect (ETL, Sort, AppMod, Big Data)
Version
9.13
Language
English
Product name
Connect ETL
Title
Connect ETL Data Transformation Language (DTL) Guide
Copyright
2023
First publish date
2003
Last updated
2023-09-11
Published on
2023-09-11T19:01:45.019000

Purpose

To provide the expected size of the source data post-filtering.

Format

/DATASIZE number {RECORDS|BYTES|KILOBYTES|MEGABYTES|GIGABYTES|TERABYTES}

Arguments

number The amount of data released to the task, in the unit specified.

Location

The option may appear anywhere in the task definition for tasks other than a join. For a join task, the /DATASIZE option for the left side of the join must appear after the source options, for example, /INFILE, that define the left side input stream, and before the source options that define the right-side input stream. The /DATASIZE option for the right side must appear after the source options that define the right-side input stream. Any /DATASIZE option that appears before the first source option for the left side is ignored.

Notes

It is recommended that you provide the /DATASIZE option for a sort or a join task when Connect ETL cannot obtain the information from the file system for the input files. It is also recommended for a Sort task when you request input selection which omits a sizeable percentage of the records.

/DATASIZE overrides any size values you specified for /INFILE.

Examples

/datasize 256 megabytes 
This informs Connect ETL that 256 megabytes of data are released to Connect ETL after input record processing is done.
/datasize 700 records 

This informs Connect ETL that 700 records of data are released to Connect ETL after input record processing is done