Write to Search Index - dataflow_designer - spectrum_quality_1 - 23.1

Spectrum Data Quality Guide

Product type
Software
Portfolio
Verify
Product family
Spectrum
Product
Spectrum > Quality > Spectrum Quality
Version
23.1
Language
English
Product name
Spectrum Data Quality
Title
Spectrum Data Quality Guide
First publish date
2007
Last updated
2024-03-04
Published on
2024-03-04T22:52:13.486265

This stage enables you to create a full-text index based on the data that the stage is accepting for processing. You can retain data in a dedicated search index to improve response times when searching the Candidate Finder.

Write to Search Index enables you to create a full-text index based on the data coming in to the stage. Having this data in a dedicated search index results in quicker response time when you conduct searches against the index from other Spectrum Technology Platform stages. Full-text-search indexes are preferable to relational databases when you have a great deal of free-form text data that needs to be searched or categorized or if you support a high volume of interactive, text-based queries.

Write to Search Index uses an analyzer to break input text into small indexing elements called tokens. It then extracts search index terms from those tokens. The type of analyzer used—the manner in which input text is broken into tokens—determines how you will then be able to search for that text. For example, the Keyword analyzer always does an exact match and tokenizes the whole string as single token, while the Standard analyzer breaks the string to create tokens. The Stop Word analyzer is all the more sophisticated and removes articles, such as "a" or "the" from the string before tokenizing, thus shrinking the index size.

Search indexes support the near real time feature, allowing indexes to be updated almost immediately, without the need to close and rebuild the stage using the search index.

For information about the search index tasks you can perform through the command line, see Search Indexes in Administration Utility section of the Administration Guide.