Options - dataflow_designer - spectrum_quality_1 - 23.1

Spectrum Data Quality Guide

Product type
Software
Portfolio
Verify
Product family
Spectrum
Product
Spectrum > Quality > Spectrum Quality
Version
23.1
Language
English
Product name
Spectrum Data Quality
Title
Spectrum Data Quality Guide
First publish date
2007
Last updated
2024-03-04
Published on
2024-03-04T22:52:13.486265

Settings in the Read Exceptions stage are configured on the General, Sort, and Runtime tabs.

General Tab

The options on the General tab specify which exception records you want to read into the dataflow.

The Filter options allow you to select a subset of records from the exception repository using these criteria.

User
The user who ran the dataflow that generated the exceptions you want to read into the dataflow.
Dataflow name
The name of the dataflow that generated the exceptions you want to read into the dataflow.
Stage label
The Exception Monitor stage's label as shown in the dataflow in Enterprise Designer. This criteria is useful if the dataflow that generated the exceptions contains multiple Exception Monitor stages and you only want to read in the exceptions from one of those Exception Monitor stages.
From date
The date and time of the oldest records that you want to read into the dataflow. The date of an exception record is the date it was last modified.
To date
The date and time of the newest records that you want to read into the dataflow. The date of an exception record is the date it was last modified.

The Fields listing shows the fields that will be read into the dataflow. By default all fields are included, but you can exclude fields by clearing the check box in the Include column.

The Preview listing shows the records that meet the criteria you specified under Filter.

Note: The preview displays only records that have been marked "Approved" in the Data Stewardship Portal and meet the filter criteria.

Sort Tab

Options on the Sort tab specify how to sort input records based on field values.

Add
Adds a field to sort on.
Field Name column
Shows the name of the field to sort on. You can select a field by clicking the drop-down button.
Order column
Specifies whether to sort in ascending or descending order.
Up and Down
Changes the order of the sort. Records are sorted first by the field at the top of the list, then by the second, and so forth.
Remove
Removes a sort field.

Runtime Tab

Options on the Runtime tab specify runtime behavior of the Read Exceptions stage.

Starting record
Specify the position in the repository of the first record you want to read into the dataflow. For example, if you want to skip the first 99 records in the repository, you would specify 100. The 100th record would be the first one read into the repository if it matches the criteria specified on the General tab. A record's position is determined by the order of the records in the Data Stewardship Portal.
All records
Select this option if you want to read in all records that match the search criteria specified on the General tab.
Max records
Select this option if you want to limit the number of records read in to the dataflow. For example, if you only want to read in the first 1,000 records that match the selection criteria, select this option and specify 1000.
Process resolved records
Select this check box to process resolved records. Clear this check box to process and purge unresolved records. By default, this check box is selected.