Create process models - Data360_DQ+ - Latest

Prerequisites

Process models require the most comprehensive understanding of your organization's data and overall Data360 DQ+ workflow.

To create a process model, you will need:

• An understanding of all other data stages and how they are used to manage and visualize your organization's data.
• Create Process Model and Write permissions to a pipeline.

• Access to the set of data stages for which you want to model loading or execution.

Configuring process model nodes

1. Select the Pipelines menu at the top of the page.
2. Click the menu button to the right of the path where you want to add the process model and select New > Process Model.
3. Drag and drop nodes from the left of the screen onto the canvas. You can change the category of nodes that are displayed by clicking the Gateway, Task or Event tabs on the left of the screen.
4. Connect the nodes to build your process model.
5. Select each node in turn and configure the properties on the right of the screen.
6. Define any output variables, see Process Model variables.

For more information about how to configure specific Process Model nodes, see Process Model nodes.

Configuring process model settings

1. Click the Settings button to open the Settings dialog:

   

2. Configure the following settings as required:
   The General tab

   • Description - Optionally, enter a description for the process model. If you enter a description, this will be displayed in a tooltip when you hover over the process model in the Pipelines view.
   • Inherit Reference Time From Start Event - Select this option if the process model is triggered by a Start Stage Event to set the reference time of the process model to that of the Start Stage Event.
   The Failure Notification tab

   • You can set the Failure Notification parameters to notify users in the event of process model failure:

     • Groups to Notify on Failure - Click the pencil button to select an environment group to notify via email if the process model fails to execute.

       Note: If any executable within the process model fails to execute, the entire process model will fail to execute.
     • Message - Specify the email subject of the failure notification that will be sent when a process model fails.
     • Message Details - Create the message body of the failure notification email that will be sent when a process model fails.
   The Failure Rerun tab

   • Configure automatic rerun behavior when process model stages fail. This tab allows you to specify which executable stage types should be automatically rerun and set retry parameters:
     • Enable Automatic Rerun on Failure - Select this checkbox to enable automatic rerun functionality for the process model.
     • Rerun executable stage types - Select which stage types should be automatically rerun when they fail. Available options include:
       • Data Store - Rerun Data Store stages on failure.
       • Data View - Rerun Data View stages on failure.
       • Analysis - Rerun Analysis stages on failure.
     • Delay Before Rerun (minutes) - Specify the number of minutes to wait before automatically rerunning a failed stage. This delay allows time for transient issues to resolve.
     • Number of times to retry - Specify the maximum number of times a failed stage should be automatically rerun before the process model is marked as failed.