Standard and Keyword Analyzer - dataflow_designer - spectrum_quality_1 - 23.1

Spectrum Data Quality Guide

Product type
Software
Portfolio
Verify
Product family
Spectrum
Product
Spectrum > Quality > Spectrum Quality
Version
23.1
Language
English
Product name
Spectrum Data Quality
Title
Spectrum Data Quality Guide
Topic type
Overview
Reference
Tips
How Do I
First publish date
2007
ft:lastEdition
2024-03-04
ft:lastPublication
2024-03-04T22:52:13.486265

Before choosing between the Standard and Keyword analyzers you should be aware of the following difference in the behavior of these two analyzers:

  • Standard analyzer: It breaks the string to tokenize it and also converts all its tokens to lower case.
  • Keyword analyzer: It tokenizes the whole string and keeps it as is (does not change the case).

Example

Let us take an example of contains any algorithm and assume the input is P O. In this case, the Standard analyzer will return both P O and P records, while the Keyword analyzer will return only the P O records (shown below).

Search result with Standard analyzer:

Search result with Standard analyzer

Search result with Keyword analyzer:

Search result with Keyword analyzer