Regex (Regular Expression) Filter - Ironstream_Hub - 1.3.2

With a Regex filter, you can define a regular expression to pass or not to pass data that is more powerful than the simple filter. A Regex Filter is similar to a Simple Filter but with this you can perform more complex searching and matching.

1. To add a Regex Filter, click the Regex Filter in the Add Process window. The canvas updates immediately to show the empty filter. The orange icon against the empty filter identifies that it is not valid, or not complete. The green ‘check’ icon is no longer present against the Target. This identifies that the Pipeline is not complete, or not correct.
2. Complete these fields for a Regex Filter in the bottom panel of the canvas.

   Field Description Name Name of the filter. Character limit is from 1 to 50. Description Short description about the Regex Filter. This will be visible on the canvas. Character limit is 200. Send records that Search criteria that has two values: match and do not match. Any records matching or not matching regular expression processing are passed to the next item on the canvas. Note: Default value is ‘match’. Regular expression Add a regular expression to be searched for. Any records that match these criteria are sent to the Processes or Targets listed in the file. Character limit is from 1 to 5000. For more information, see Specifying the Regular expression.

   Note: Name and Regular expression are the required fields. If you leave one of the required fields blank, text on the botton panel identifies this and the icon against the filter on the canvas remains orange. You must complete the required fields to turn the icon to a green ‘check’ against the filter and the Target.
   Example of completed Regex filter:

   Figure 1. Completed Regex Filter

   To configure Regex Filter, see Configuring REGEX Filters.

Specifying the Regular expression

All parts of the Regular expression are case-sensitive. For example, ‘PRODUCTION’, ‘Production’ and ‘production’ are all considered as different strings, and “STATUS”:”OK” and “Status”:”OK” will be considered as two different strings.

Example: To look for a string that contains “ERRORCODE”:” followed by a number, you can enter a regular expression of “ERRORCODE”:\d. \d string identifies “a number”.

If your regular expression is incorrect, you will get the notification as you move away from the field in the bottom panel. For example, here the final ‘d’ character is missing:

Figure 2. Incorrect Regular Expression