Adding Data from Flat Files - discovery - 23.1

Spectrum Discovery Guide

Product type
Product family
Spectrum > Discovery
Product name
Spectrum Discovery
Spectrum Discovery Guide
Topic type
How Do I
First publish date

These steps describe the process of creating a scorecard from records in flat files on your machine or on server.
  1. On the Spectrum Discovery Home page, click Profile.
  2. Click the icon on the icon bar just below the tabs.
  3. On the page that is displayed, select the Flat File option from the Select data source field.
  4. Click the Add Files button.
    The Choose File pop-up window is displayed.
  5. Use the file path selection box to go to the required path on your local machine or server.
    A list of files is at the selected location is displayed below the file path selection box.
  6. Select all the files you need, and click OK.
    Note: Use the Filter to go to specific files in the list.
    The selected files are displayed on the left side of the page, below the Add Files button.
  7. To add more files, click the Add Files button again and repeat steps 6 and 7.
    Note: You can add files from different folders on your local system, on server, and SFTP server in any combination you want. For using SFTP server, you need to configure it first. For more information, see the Administration Guide.
  8. Click any file in the list to view these details below the Add Files button.:
    • The number of files selected. For example 7 File(s) selected
    • Color coding for file's metadata
      • Green: Metadata detected automatically
      • Blue: User configured metadata
      • Red: Metadata not detected. Such files are skipped during profiling and scorecarding. However, you can configure the metadata of these files using the File Setting fields as described in this task below. After manual configuration, these files turn blue.
    • Path of the file. For example, E:/Sample Files/profile/fileOne.txt
    • File settings
    • Preview of the records in the file
  9. To modify settings for any of the files, select it and make changes as described in this table.
    Settings Description
    Character encoding The text file encoding. For more information, see Character Encodings.
    Field delimiter

    Specifies the character used to separate fields in a delimited file.

    For example, this record uses a pipe (|) as a field delimiter:

    7200 13TH ST|MIAMI|FL|33144

    The characters available as field delimiter are:

    • Comma
    • Semicolon
    • Pipe
    • Tab
    • Space
    • Period
    You can also add custom field delimiters, to add a custom field delimiter follow these steps:
    1. Click the Add button placed adjacent to Field delimiter. Add Separator pop-up window is displayed.
    2. Enter your desired field delimiter in the character field, the corresponding Unicode is displayed automatically.
    3. Enter a suitable name for your delimiter in the Description field.
    4. Click Save, your delimiter appears in the Field delimiter drop down.
    Text qualifier

    The character used to surround text values in a delimited file.

    For example, this record uses double quotes (") as a text qualifier.

    "7200 13TH ST"|"MIAMI"|"FL"|"33144"

    The characters available to define as text qualifiers are:

    • Single quote (')
    • Double quote (")
    Line separator Specifies the character used to separate records in line in a sequential or delimited file.

    The record separator settings available are:

    Unix (U+000A)
    A line feed character separates the records. This is the standard record separator for Unix systems.
    Macintosh (U+000D)
    A carriage return character separates the records. This is the standard record separator for Macintosh systems.
    Windows (U+000D U+000A)
    A carriage return followed by a line feed separates the records. This is the standard record separator for Windows systems.
    First row is header row

    Specifies if the first record in a delimited file contains header information. A Yes indicates it has header information.

    For example, this file snippet shows a header row in the first record.

    "7200 13TH ST"|"MIAMI"|"FL"|"33144"
    "One Global View"|"Troy"|"NY"|12180
  10. To apply settings of one file to another:
    1. Select the file from which you want to copy the settings, and click the Copy File Settings button.
    2. In the Apply file settings pop-up window that is displayed, select the files to which you want to apply the settings, and click OK.
      Note: This option is applicable only in cases where you have selected multiple files.
  11. To see preview of the selected file, see the Preview section below File Settings.
  12. To go to the configuration stage, click on the top right corner of the page.