The Options Tab - 23.1

Spectrum Dataflow Designer Guide
Version
23.1
Language
English
Product name
Spectrum Technology Platform
Title
Spectrum Dataflow Designer Guide
Copyright
2024
First publish date
2007
Last updated
2024-10-11
Published on
2024-10-11T22:55:47.128293
Batch size
This option specifies how many records or transactions are read in a batch before they are written to the model. You can adjust this setting to optimize performance. The default setting is 500. Increasing batch size increases memory usage.
  • For systems that have processing capacity to support increased memory usage, you can increase batch size to improve performance.
  • On slow networks, do not set a very large batch size.
  • If different instances of Context Graph stages will often write simultaneously to models, you can set this option to a small to medium size (100 to no more than a few thousand) to reduce overall memory usage.
  • A batch is rolled back should a statement fail. The larger the batch size, the longer it takes to perform the rollback.
Clear model before processing
Check this check box if you wish to remove all existing entities and relationships before processing new data. If this is not selected, new information will be used to update any existing entities and relationships.
Note: Using this option does not alter security settings for Context Graph. The model will be recreated, but the security settings will remain the same.
Remove orphaned entities after processing
Check this check box if you wish to remove entities that have no relationships.