Use derived property values - Latest

Data360 Analyze Server Help

Product type
Software
Portfolio
Verify
Product family
Data360
Product
Data360 Analyze
Version
Latest
Language
English
Product name
Data360 Analyze
Title
Data360 Analyze Server Help
Copyright
2024
First publish date
2016
Last updated
2024-11-28
Published on
2024-11-28T15:26:57.181000

Using derived property values is a very powerful technique in Data360 Analyze, which allows you to substitute the values of properties from one (typically centralized) location to another, for consistent reuse of common values across your data flows. For example, paths for input/output data, or parametrized aspects of your analysis, such as locations or dimensions upon which to perform complex analyses.

You can explicitly substitute a property value into another property by typing the following text, where propertyname is replaced by the name of the property:

{{^propertyname^}}

Alternatively, you can select a property to reference from the node property menu:

  1. Click the menu button on the node property where you want to insert the reference.
  2. Select Property References then choose a property group. Choose from:
    • Data Flow Properties – Properties on the top-level data flow.
    • Run Properties – Run properties defined on the top-level data flow.
    • Container Properties – Properties on the container node of the reference.
    • Local Properties – Properties on the same node as the reference.
  3. Select the specific property that you want to reference.

The chosen property reference is inserted at the cursor position in the related field.

A property reference can be combined with further text to build larger values:

{{^rootpath^}}\{{^datafolder^}}\input.csv

Note: When textual substitution is used to reference a value in a password property, the substitution expression is not encrypted. This allows increased portability of data flows between systems, and does not pose any risk to security given that the substitution expression is not itself sensitive, but is referring to a sensitive value stored elsewhere. However, for security, it is recommended that you only substitute password properties into other password properties.

Substitute within script

Note: If you are inserting a property reference into a script-based property, ensure that your script is valid when the substitution occurs.

Input data:

model:unicode
roadster
Y

The input data is passed to a Transform node which has a property called make with the following value:

Tesla

The Transform node is configured as follows:

ConfigureFields

out1 += in1
out1.make = unicode

ProcessRecords

out1 += in1
out1.make = in1.model + ' ' + '{{^make^}}'

In this example, the Transform node concatenates the value from the input with the value from the make property on the Transform node.

Note that in this example the property reference must be surrounded in quote marks to indicate that the value is a string, and produce the following output:

model:unicode make:unicode
roadster roadster Tesla
Y Y Tesla