Task definition file examples - Connect_ETL - 9.13

Connect ETL Data Transformation Language (DTL) Guide
Product type
Software
Portfolio
Integrate
Product family
Connect
Product
Connect > Connect (ETL, Sort, AppMod, Big Data)
Version
9.13
Language
English
Product name
Connect ETL
Title
Connect ETL Data Transformation Language (DTL) Guide
Copyright
2023
First publish date
2003
Last updated
2023-09-11
Published on
2023-09-11T19:01:45.019000

Connect ETL task definition command options are outlined within task definition files, which are executed as tasks when made accessible to and run by Connect ETL.

Aggregate task definition file example

Consider the following aggregate task definition file example

/DTL
/TASKTYPE AGGREGATE SORTEDOUTPUT PRESORTED VERIFYORDER
/DELIMITEDRECORDLAYOUT recordlayout1 {
id EN,
name CHARACTER}
/INFILE inAggregateTask.dat STREAM CRLF FIELDSEPARATOR "," LAYOUT recordlayout1
/GROUPBY FIELDS recordlayout1.id, recordlayout1.name
/SUMMARY total_count COUNT
/OUTFILE outAggregateTask.dat STREAM CRLF OVERWRITE
/REFORMAT CREATE LAYOUT recordlayout2 DELIMITED VALUES
recordlayout1.id ALIAS f1,
recordlayout1.name ALIAS f2,
total_count ALIAS f3
/END

Copy task definition file example

Consider the following copy definition file example:
/DTL
/TASKTYPE COPY
/INFILE inCopyTask.dat FIXED 25 LAYOUT recordlayout1
/RECORDLAYOUT recordlayout1 { f1 EN 3,
f2 CHARACTER 5,
f3 CHARACTER 5,
f4 10 DATETIME (MM0/DD0/YEAR),
f5 CHARACTER 2}
/OUTFILE outCopyTask_01.dat STREAM CRLF FIELDSEPARATOR "," OVERWRITE encoding ASCII
/REFORMAT CREATE LAYOUT recordlayout2 DELIMITED VALUES
recordlayout1.f1 ALIAS r2tf1,
recordlayout1.f3 ALIAS r2tf2,
recordlayout1.f4 ALIAS r2tf4
/OUTFILE outCopyTask_02.dat FIXED 10 OVERWRITE encoding ASCII
/REFORMAT CREATE LAYOUT recordlayout3 POSITIONAL VALUES
recordlayout1.f1 ALIAS r3tf1,
recordlayout1.f2 ALIAS r3tf2,
recordlayout1.f5 ALIAS r3tf3
/END

Join task definition file example

Consider the following join definition file example:
/DTL
/TASKTYPE JOIN PRESORTED LEFTSIDE RIGHTSIDE UNPAIRED RIGHTSIDE SORTEDOUTPUT
/DELIMITEDRECORDLAYOUT recordlayout1 {name_field CHARACTER,
id_field EN,
location_field CHARACTER}
/DELIMITEDRECORDLAYOUT recordlayout2 {name_field CHARACTER,
id_field EN,
location_field CHARACTER}
/DELIMITEDRECORDLAYOUT recordlayout3 {name_field CHARACTER,
id_field EN,
location_field1 CHARACTER,
location_field2 CHARACTER}
/INFILE inJoinTask_01.dat Stream CRLF FIELDSEPARATOR ";" LAYOUT recordlayout1
/JOINKEYS recordlayout1.name_field, recordlayout1.id_field
/INFILE inJoinTask_02.dat Stream CRLF FIELDSEPARATOR ";" LAYOUT recordlayout1
/JOINKEYS recordlayout2.name_field, recordlayout2.id_field
/OUTFILE outJoinTask.dat Stream CRLF OVERWRITE
/REFORMAT MAPTO LAYOUT recordlayout3 MAPPINGS
Recordlayout3.name_field = recordlayout2.name_field,
Recordlayout3.id_field = recordlayout2.id_field,
Recordlayout3.location_field = recordlayout1.location_field,
Recordlayout3.location_field2 = recordlayout2.location_field
/END

Merge task definition file example

Consider the following merge definition file example:
/DTL
/TASKTYPE MERGE
/KEYS recordlayout1.date_field desc, recordlayout1.id desc
/INFILE inMergeTask_01.dat Stream CRLF FIELDSEPARATOR "," LAYOUT recordlayout1
/INFILE inMergeTask_02.dat Stream CRLF FIELDSEPARATOR "," LAYOUT recordlayout1
/DELIMITEDRECORDLAYOUT recordlayout1 {active_flag EN,
id EN,
start_date DATETIME (MM0/DD0/YEAR),
name CHARACTER}
/OUTFILE outMergeTask.dat Stream CRLF OVERWRITE
/END

Sort task definition file example

Consider the following sort definition file example:
/DTL
/TASKTYPE SORT
/KEYS recordlayout1.f1
/INFILE inSortTask.dat STREAM CRLF FIELDSEPARATOR "," LAYOUT recordlayout1
/DELIMITEDRECORDLAYOUT recordlayout1 { f1 EN, f2 CHARACTER }
/OUTFILE outSortTask.dat STREAM CRLF OVERWRITE
/END