Overflow - 17.1

Inline Quality and Discovery

Version
17.1
Language
English
Product name
Trillium Quality and Discovery
Title
Inline Quality and Discovery

Sometimes, the data has a longer record length than the length described by a COBOL copybook or schema. Since this is a common issue, loads the data source and does not reject any data that does not match. Instead, represents the data just as the copybook or schema describes it with the addition of a field named Overflow.

Note: If your data source uses line feeds or carriage returns as delimiters and you omit that specification when you create the entity, the entity will contain an Overflow attribute.

Check for Overflow attributes

To check for Overflow attributes

  1. From the Navigation View, click the Entities tab on the Discover bar.
  2. Expand each entity.
  3. Look for any attribute with the name Overflow.
  4. Make note of which entity or entities have an Overflow attribute and then investigate the causes of the overflow.

Locate overflow rows

To locate overflow rows

  1. From the Navigation View, click the Entities tab.
  2. From the expanded entities list, find the COBOL-based entities that you identified as problematic.
  3. Right-click the entity and select Drill down to Metadata. The Entity List View opens.
  4. Double-click the metadata labeled Rows and try to identify the following:
    • Which row has a value in the column labeled Overflow?
    • What value displays in the column labeled Overflow?
    • Does the copybook accommodate for these values? If not, correct the copybook and create the entity again.

Locate Overflow rows when there are no visible values in the Overflow columns

To locate Overflow rows when there are no visible values in the Overflow columns 

  1. Double-click the attribute labeled Overflow.
  2. Double-click Values.
  3. Highlight the values in the List View.
  4. Right-click and select Drill down to Matching Rows.
  5. Examine the rows to determine the problem:
    • What values are common in the last column of that entity (column left of Overflow)?
    • Does the copybook have enough space allocated for each attribute (field)? For example, does a PIC X(10) contain data that is 13 characters long? If not, correct the copybook and try to create the Entity again.