To help you interrogate the data as it passes through your application, the data viewer provides the ability to filter the data sets you inspect on the outputs of your nodes.
You can then add any filters that you have applied in the data viewer to your data flow as a pre-configured Filter node, see Adding filters from the data viewer to your data flow.
To apply a filter:
- In the data viewer, click the menu button in the column of the data that you want to filter.
- Select Filter.
The filtering options available depend on the type of the data in the column. For example, the following options are available for String filters:
- Contains
- Does Not Contain
- Equals
- Does Not Equal
- Begins With
- Ends With
- Is Null
- Is Not Null
Number filters provide the following options:
- Equals
- Does Not Equal
- Greater Than
- Greater Than or Equal To
- Less Than
- Less Than or Equal To
- Between
- Is Null
- Is Not Null
Date filters provide the following options:
- Equals
- Before
- After
- Between
- Today
- Tomorrow
- Yesterday
- All Dates in Period
- Is Null
- Is Not Null
Once you have applied a filter, the column menu icon changes to a filter symbol on a blue background, to indicate that this column is being filtered. You can apply filters to multiple columns. The filters take effect over the entire data set, not just the first 1000 records which are displayed.
Where you have applied filters to the data set, the information in the bottom bar indicates the number of records that are present in the data viewer before and after filtering.
For a filtered column, you can choose the following options from the column menu:
- Edit Filter - edit the filter on this column
- Remove Filter - remove the filter on this column
- Remove All Filters - remove the filters across all columns
Adding filters from the data viewer to your data flow
You can choose to add any filters that you have applied to the data in the data viewer directly to your data flow as a pre-configured node.
After you have filtered your data, from the top right corner of the data viewer, select the type of node that you want to add to your data flow. For filtered data, choose from Filter or Split (on filters).
Depending on your selection, a pre-configured Filter or Split node is then automatically added to your data flow, connected to the output pin of the node outputting the filtered data.
Only one node is added to your data flow, regardless of the number of filters that you have applied. If you have applied more than one filter in the data viewer, the Filter or Split node will be configured to apply each of the filters.