Ignore word tables contain words that you want the phrase analysis to ignore during profiling activities. These tables are a way for you to instruct the analysis to ignore small or insignificant words or phrases that obscure or complicate the results. After you build or import the table, you have the option to import it for use in the Business Data Parser (BDP) process.
When an ignore word table is imported to the BDP, the Parser Tuner will automatically recodes the entries to commas. For example, if you have some noise words in the ignore word table, and you assign the category of SKIP when importing the table, the entries will be displayed in the Parser Tuner as follows:
----------------------------------------------------------------------------
*Ignore word table <IgnoreNoiseWords> imported 2014-06-04 14:44:51 by ssmith
'to' INSERT MISC ATT=SKIP RECODE=','
'in' INSERT MISC ATT=SKIP RECODE=','
'of' INSERT MISC ATT=SKIP RECODE=','
'the' INSERT MISC ATT=SKIP RECODE=','
----------------------------------------------------------------------------
When the BDP is run, those words are removed and recoded to commas in the output. See Importing an Ignore Word Table and Word Definition Table for procedure of importing the table.