Ignore Word Tables for the Business Data Parser - trillium_discovery - trillium_quality - 17.1

Trillium Control Center

Product type
Software
Portfolio
Verify
Product family
Trillium
Product
Trillium > Trillium Discovery
Trillium > Trillium Quality
Version
17.1
Language
English
Product name
Trillium Quality and Discovery
Title
Trillium Control Center
Topic type
Administration
Overview
How Do I
Configuration
Reference
Installation
First publish date
2008

Ignore word tables contain words that you want the phrase analysis to ignore during profiling activities. These tables are a way for you to instruct the analysis to ignore small or insignificant words or phrases that obscure or complicate the results. After you build or import the table, you have the option to import it for use in the Business Data Parser (BDP) process.

When an ignore word table is imported to the BDP, the Parser Tuner will automatically recodes the entries to commas. For example, if you have some noise words in the ignore word table, and you assign the category of SKIP when importing the table, the entries will be displayed in the Parser Tuner as follows:

----------------------------------------------------------------------------

*Ignore word table <IgnoreNoiseWords> imported 2014-06-04 14:44:51 by ssmith

'to' INSERT MISC ATT=SKIP RECODE=','

'in' INSERT MISC ATT=SKIP RECODE=','

'of' INSERT MISC ATT=SKIP RECODE=','

'the' INSERT MISC ATT=SKIP RECODE=','

----------------------------------------------------------------------------

When the BDP is run, those words are removed and recoded to commas in the output. See Importing an Ignore Word Table and Word Definition Table for procedure of importing the table.