/TASKTYPE - Connect_ETL

Purpose

To define the type of task.

Format

/TASKTYPE task_type_settings

where

task_type_settings	=	{COPY [copy_settings] } {SORT [sort_settings] } {MERGE [merge_settings] } {AGGREGATE [aggregate_settings]} {JOIN [join_settings] }
copy_settings	=	ALLOWREORDERING
sort_settings	=	NODUPLICATE
merge_settings	=	[NODUPLICATE] [VERIFYORDER]
aggregate_settings	=	[SORTEDOUTPUT] [OUTRECORDCOUNT record_count] [PRESORTED [VERIFYORDER]]
join_settings	=	[UNPAIRED [LEFTSIDE] [RIGHTSIDE] [ONLY]] [SORTEDOUTPUT] PRESORTED [LEFTSIDE] [RIGHTSIDE]

Arguments

record_count

The expected number of records in the output

Location

The option may appear anywhere in the task definition.

Notes

The /TASKTYPE option is required and enables the definition of one of the following Connect ETL task types: COPY, SORT, MERGE, AGGREGATE, JOIN.

For aggregate task types, only group-by and summarized values can be referenced in a target filter and reformat.

Consider the following task-specific option arguments:

ALLOWREORDERING – This option argument is applicable to copy tasks only. This performance optimization feature specifies that the order of the output records is not important and therefore extracted records from the source can be reordered when copied to the target.

In the absence of the ALLOWREORDERING argument, the order of the output records is the same as the order of the input records.

NODUPLICATE – This option argument is applicable to sort and merge tasks only. When this option argument is specified, only one record from each set of equal-keyed records is retained; the rest of the duplicate records are discarded. The record that survives is dependent on whether or not the /STABLE option is specified. If specified, the retained record is the first of the set of equal-keyed records.
SORTEDOUTPUT – This option argument is applicable to aggregate and join tasks only. When specified, the output of an aggregate or join task is sorted. When not specified, the output of an aggregate or join task is not sorted and performance gains are realized.

For aggregate tasks, only group-by and summarized values can be referenced in a target layout.

OUTRECORDCOUNT – This option clause is applicable to aggregate tasks only. You can use this clause to provide the expected number of output records. When provided, Connect ETL will attempt to use the value to optimize performance.
PRESORTED - This option argument is applicable aggregate and join tasks only. When specified, the records in the source file are assumed to be sorted order upon input to the task.
VERIFYORDER – This option argument is applicable to merge and aggregate tasks. When specified, the sequence of the source file records, which is implied or specified to be sorted, is verified upon input to the task.
UNPAIRED - This option clause is applicable to join tasks only.Use this clause to specify whether to retain matched records and unpaired records from both sides of the join or from either the left side or the right side of the join. An unpaired record is a record that does not have a matching record from the other join side. A match occurs when the contents of the join fields in a record from one side equal the contents of the join fields in a record from the other side.
JOIN UNPAIRED ONLY - This option clause is applicable to join tasks only. Use this option to discard the paired or matched records from a join and retain only the unpaired or unmatched records.

To discard matched records and retain the unpaired records from one of the join sides, add either the LEFTSIDE or the RIGHTSIDE argument. To discard matched records and retain the unpaired records from both sides, add both the LEFTSIDE and the RIGHTSIDE argument.

Example

/TASKTYPE COPY

This option sets the application type to a copy task without reordering records.

/TASKTYPE COPY ALLOWREORDERING

This option sets the application type to a copy task. Records may be reordered.

/TASKTYPE SORT

This option sets the application type to a sort task.

/TASKTYPE SORT NODUPLICATE

This option sets the application type to a sort task. All duplicate keys are removed.

/TASKTYPE MERGE VERIFYORDER

This option sets the application type to a merge task. The source file record sequence, which can be implied or specified for sorting, is verified upon input to the task.

/TASKTYPE AGGREGATE

This option sets the application type to an aggregate task.

/TASKTYPE JOIN PRESORTED

This option sets the application type to a join task. The records in the source file are presorted prior to being input to the task. The output of this join consists of matched records only.

/TASKTYPE JOIN UNPAIRED

This option sets the application type to a join task. The output of this full outer join consists of matched records, unmatched records from the left side, and unmatched records from the right side.

/TASKTYPE JOIN UNPAIRED LEFTSIDE

This option sets the application type to a join task. The output of this left outer join consists of matched records and unmatched records from the left side.

/TASKTYPE JOIN UNPAIRED LEFTSIDE ONLY

This option sets the application type to a join task. The output of this join consists of unmatched records from the left side only.

/TASKTYPE JOIN UNPAIRED RIGHTSIDE

This option sets the application type to a join task. The output of this right outer join consists of matched records and unmatched records from the right side.

/TASKTYPE JOIN UNPAIRED RIGHTSIDE ONLY

This option sets the application type to a join task. The output of this join consists of unmatched records from the right side only.

/TASKTYPE JOIN UNPAIRED LEFTSIDE RIGHTSIDE ONLY

This option sets the application type to a join task. The output of this join consists of unmatched records from the left side and from the right side.