Sorting Input Records - 23.1

Spectrum Dataflow Designer Guide

Version
23.1
Language
English
Product name
Spectrum Technology Platform
Title
Spectrum Dataflow Designer Guide
First publish date
2007
Last updated
2024-05-09
Published on
2024-05-09T23:01:03.226155

In the Read from File stage, the Sort Fields tab defines fields by which to sort the input records before they are sent into the dataflow. Sorting is optional.

  1. On the Sort Fields tab, click Add.
  2. Click the drop-down arrow in the Field Name column and select the field you want to sort by. The fields available for selection depend on the fields defined in this input file.
  3. In the Order column, select Ascending or Descending.
  4. Repeat until you have added all the input fields you wish to use for sorting. Change the order of the sort by highlighting the row for the field you wish to move and clicking Up or Down.
  5. Default sort performance options for your system are set in Spectrum Management Console. If you want to override your system's default sort performance options, click Advanced. The Advanced Options dialog box contains these sort performance options:
    Note: The optimal sort performance settings depends on your server's hardware configuration. You can use this equation as a general guideline to produce good sort performance:

    (InMemoryRecordLimit × MaxNumberOfTempFiles ÷ 2) >= TotalNumberOfRecords