Streaming Compute - Latest

Data360 DQ+ Help

Product type
Software
Portfolio
Verify
Product family
Data360
Product
Data360 DQ+
Version
Latest
Language
English
Product name
Data360 DQ+
Title
Data360 DQ+ Help
Copyright
2024
First publish date
2016
ft:lastEdition
2024-07-09
ft:lastPublication
2024-07-09T15:09:58.774265

The Streaming Compute node uses an expression to create new computed fields or change the values of existing fields. Once new fields are added or the values of existing fields are changed, the Streaming Compute node's sheet will display all fields from its input node with the changes you have made.

This node performs a similar function to the Compute node, but the Streaming Compute node only produces and accepts streaming data.

Creating a new computed field

Using the Streaming Compute node to create a new computed field is effectively the same as adding a computed field in any other node's sheet.

  1. In the Computation Fields property, click Add.
  2. Give the field a unique Output Field Name that does not match the name of any other existing fields in the analysis.
  3. Select a data type for the field in the Output Field Type property.
  4. Create an expression that is used to populate the field's values.

Changing the values of an existing field

To change the values of fields that already exist in an input to the Streaming Compute node:

  1. In the Computation Fields property, click Add.
  2. Select an Output Field Name from the list of existing fields.
  3. Create an expression that is used to populate the field's values.

Properties

Display Name

Specify the name of the node that is displayed on the Analysis Designer canvas.

The default value is Streaming Compute.

Computation Fields

Click Add to create a new computed field or to change the values of an existing field.

View SQL

Click View SQL to see the SQL produced by the node.

You may want to modify the SQL for use with the Streaming SQL node, which allows you to customize your data transformations further.