Consistency Check - Data360_DQ+ - Latest

Data360 DQ+ Help

Product type
Software
Portfolio
Verify
Product family
Data360
Product
Data360 DQ+
Version
Latest
Language
English
Product name
Data360 DQ+
Title
Data360 DQ+ Help
Copyright
2024
First publish date
2016
ft:lastEdition
2024-07-09
ft:lastPublication
2024-07-09T15:09:58.774265

The Consistency Check node is used to evaluate whether a record's values satisfy an expression or set of expressions. The node produces a new field containing Boolean values for each expression that is written. If a record satisfies the conditions in an expression, the Consistency Check node will output True. Conversely, when a record doesn't satisfy an expression, the node will output False.

Properties

Name

When adding a new consistency check, Name is the name that will be given to the field containing the consistency check's Boolean results.

Expression

The expression that each record will be evaluated against during the check.

Consistency check example

You have the following data set:

account_number

value

007

1200

007

1000

007

999

 

For this data set, we could write a consistency check with a Name of 007AboveOneThousand and an Expression of accountNumber = ‘007' && value > 1000

This would produce the following data set:

account_number

value

007AboveOneThousand

007

1200

True

007

1001

True

007

999

False

 

Note that multiple consistency checks may be written per Consistency Check node, so you could also create the following:

Name: valueAboveOneThousand

Expression: value > 1000

Which, in combination with 007AboveOneThousand, would produce the following results:

account_number

value

007AboveOneThousand aboveOneThousand

007

1200

True

True

007

1001

True

True

007

999

False

False