The wide variety of data stages that are available in Data360 DQ+, combined with the permissions that can be applied to them, allow for numerous pipeline structures.
Before you build a pipeline, you should consider what the pipeline will be used for and who will use it. You can then build the necessary components and delegate access rights as needed.
- Select the Pipelines menu at the top of the page.
- Click the New Pipeline button.
- Enter a Name for the pipeline and optionally, enter a Description.
If you enter a description, this will be displayed in a tooltip when a user hovers over the pipeline in the Pipelines view, giving an overview of the pipeline function.
The following examples show how you can combine data stages and permissions to create pipeline structures:
Example 1
The most basic type of pipeline would perhaps be created in a development environment, where all components are placed in a single path:
Example 2
Alternatively, you could create a pipeline containing multiple paths, to stay organized and to facilitate delegation of access rights. This could work well in an environment where one set of users is responsible for creating and managing data stores and data views and another set of users is responsible for building dashboards:
Example 3
You could create multiple pipelines, reserving one pipeline for data stores and data views and another for dashboards: