Create a real-time validation scenario - spectrum_quality_1 - 23.1

Spectrum Data Quality Guide

Product type
Software
Portfolio
Verify
Product family
Spectrum
Product
Spectrum > Quality > Spectrum Quality
Version
23.1
Language
English
Product name
Spectrum Data Quality
Title
Spectrum Data Quality Guide
Topic type
Overview
Reference
Tips
How Do I
First publish date
2007
ft:lastEdition
2024-03-04
ft:lastPublication
2024-03-04T22:52:13.486265

Follow these steps to create and use a real-time revalidation scenario:

  1. Open or create a job or service dataflow that contains an Exception Monitor stage, an input source (such as a Read from File or Input stage), an output sink (such as a Write to File or other output stage), and a Write Exceptions stage.
  2. Convert the Exception Monitor stage to a subflow, and map the input and output fields to match those in the initial dataflow.
    Be sure to include the ExceptionMetadata field for the input source as well as the output stage that populates the Write Exceptions stage in the job. Expose the subflow so it can be used by the job and service.
  3. Create a service that contains an Input stage, the subflow you created in step 2, an output stage or sink (such as a Write to File or Write to DB stage).
    If using the Write to File stage, select the File Properties tab, click the File name browse button (), and select Remote Machine to define the file name.
    Map the input and output fields to match those in the initial dataflow. Be sure to include the ExceptionMetadata field for the Input stage as well as the Output stage. Expose the service so it can be used by the validation process when records are corrected in the Data Stewardship Portal.
  4. Return to the subflow and open the Configuration tab of the Exception Monitor stage.
  5. Select the revalidation service you created in step 3 and specify which action to take after revalidation.
  6. Save and expose the subflow again.
  7. Return to the service.
    A message will appear, notifying you of changes to the subflow and that the service will be refreshed.
  8. Click OK, then save and expose the service again.
  9. Return to the initial job or service.
    A message will appear, notifying you of changes to the subflow and saying that the dataflow will be refreshed
  10. Click OK, then save the dataflow.
  11. Run the job.
    Note: Even if you have run the initial job or service before, you must run it again after creating the revalidation scenario to populate the repository with records that are eligible for revalidation. You can identify whether records in the Data Stewardship Portal Editor are eligible for revalidation because the Save button will be active for those records.