Viewing Profile Statistics - discovery - 23.1

Spectrum Discovery Guide

Product type
Software
Portfolio
Verify
Product family
Spectrum
Product
Spectrum > Discovery
Version
23.1
Language
English
Product name
Spectrum Discovery
Title
Spectrum Discovery Guide
Topic type
How Do I
Reference
Overview
First publish date
2007
ft:lastEdition
2024-02-07
ft:lastPublication
2024-02-07T17:21:58.768552
When you build a rule to configure the scorecard, the Profile Statistics panel extracts and displays the corresponding entity's column statistics. You can analyze the statistics for an entity's column rule and make decisions to build a better rule for your entity. The statistics are auto-refreshed based on your column selection in the Rule Builder.
Note: The statistics displayed on the panel are non-editable. It is intended for viewable purposes only.
The Profile Statistics panel allows you to:
  1. Select a column name from the Column drop-down to view the statistics of any particular entity's column.
    Note: The profile statistics for Service Configuration Output Fields will not be displayed.
  2. View the detailed profiling statistics of an entity by clicking on Details adjacent to the Column drop-down. If you click on Details, you are navigated to the Data Profiling Results page with the details of the corresponding column. For more information, see Viewing Data Profiling Results.
    Note: The Profile Statistics panel is available only if you had run the profile against the selected entity. In case your selected entity has never been profiled, you must run the profile against the entity at least once to make the Profile Statistics panel visible, or configure and run the scorecard once to make the statistics available during the rule update, but in this case, you will not see the Details link to view the detailed profiling statistics.
The Profile Statistics panel displays these comprehensive profiling statistics of an entity generated at the column level:
  1. Completeness: Displays the completeness of records in the column. The percentage of Complete, Null, and Empty String detected in the column are displayed in the legend.
  2. Uniqueness: Displays the uniqueness of the data contained in the column by showing the percentage of these statistics in the legend:
    • Unique: Records with no duplicates in the data source.
    • NonUnique: Records having duplicates in the data source.
    • Distinct: A list of all records present in your data source irrespective of those being unique or non-unique record.
  3. Frequency: Displays the frequency of the data contained in the column.
    Note: It is displayed only if the column data type is string.
  4. Patterns: Displays the pattern of the data contained in the column.
    Note: It is displayed only if the column data type is string.

Accessing profile statistics

You can access Profile Statistics by these two ways:
  1. On the Profile & Monitor page:
    1. Go to the Profiles tab and select a profile.
    2. Click the Create Scorecard button below the Profiles tab.
      The Create Scorecard page is displayed with a list of entities associated with the profile you select.
      Note: You do not have to reselect the source as your profile already has the selected source.
    3. Configure the scorecard for your entity. For more information, see Configuring scorecard.

      You see the Profile Statistics panel on the Rule Configuration page to analyze the statistics for your entity's columns.

  2. On the Profile & Monitor page:
    1. Go to the Scorecards tab.

      The Create Scorecard page is displayed.

    2. Add the data source. For more information, see Adding data sources.
    3. Configure the scorecard for your entity. For more information, see Configuring scorecard.
      Note: The Profile Statistics panel will be visible only if you run and evaluate the scorecard against the entity at least once while modifying any rules. In this case, you will not see the Details link to view the detailed profiling statistics as the entity has only been evaluated by the scorecard and has not been profiled.