Represents a single pipeline job execution record. Contains the pipeline and run configuration identifiers, the source and target asset paths, timing information, the number of records processed, the job status, and references to the operator-level record counts. Returned when retrieving a specific pipeline job by ID or as an item in a paginated list of pipeline jobs.
Referenced by: GET
/v1/quality/pipelines/jobs/{jobId}
Search
| Property | Description |
|---|---|
runConfigName |
The display name of the run configuration used for this job. |
sourceAssetNamePath |
Specifies a hierarchical path token used for asset or type identification. |
targetAssetNamePath |
Specifies a hierarchical path token used for asset or type identification. |
Parameters
| Property | Description |
|---|---|
id |
The unique identifier of this pipeline job execution. |
pipelineId |
The unique identifier of the pipeline that this job executed. |
pipeline |
The display name of the pipeline that this job executed. |
runConfigId |
The unique identifier of the run configuration used to execute this job. |
sourceAssetTypePath |
The bracket-delimited type path of the source asset, such as [Host].[Database].[Schema].[Table]. |
targetAssetTypePath |
The bracket-delimited type path of the target asset, such as [Host].[Database].[Schema].[Table]. Null when no target asset was configured. |
startTime |
The epoch millisecond timestamp at which the job began processing. |
endTime |
The epoch millisecond timestamp at which the job finished. Null for jobs still in progress. |
duration |
The total elapsed time of the job execution in milliseconds. Calculated as the difference between endTime and startTime. |
recordsProcessed |
The total number of records that the job read from the source asset. |
status |
The current or final state of the job. Common values include SUCCESSFUL, FAILED, RUNNING, and CANCELLED. |
user |
The email address or identifier of the user who triggered the job execution. |
externalUrl |
A URL pointing to the external job execution environment, such as a Spark or Dataproc job dashboard. Null when no external execution system is used. |
externalId |
The identifier assigned to this job by the external execution system. Null when no external system was involved. |
comment |
An optional human-readable note associated with the job execution. May be empty. |
counts |
A list of per-operator record counts that describe how many records each pipeline stage processed. |
targetAssets |
The list of output assets written by this job execution, each with type path, name path, and role label. |
sourceAssets |
The list of input assets read by this job execution, each with type path, name path, and role label. |
isScheduled |
Indicates whether this job was triggered by a schedule rather than a manual request. |
JSON Example
{
"id": "38f73530-8948-481a-8a80-7ed51ece5e58",
"pipelineId": "6853d5dd80b6dd07285dbd8e",
"pipeline": "Customer_Orders_Validation_Pipeline",
"runConfigId": "6853d69880b6dd07285dbd8f",
"runConfigName": "Customer_Orders_Batch_RunConfig",
"sourceAssetTypePath": "[Host].[Database].[Schema].[Table]",
"sourceAssetNamePath": "[SnowflakeSource].[analytics].[dq].[customer_orders]",
"targetAssetTypePath": "[Host].[Database].[Schema].[Table]",
"targetAssetNamePath": "[SnowflakeSource].[analytics].[dq].[customer_orders_validated]",
"startTime": 1753859968635,
"endTime": 1753860182094,
"duration": 213459,
"recordsProcessed": 100,
"status": "SUCCESSFUL",
"user": "data.steward@precisely.com",
"externalUrl": "https://external-spark.example.com/jobs/1027355645833034",
"externalId": "1027355645833034",
"comment": "",
"counts": [
{ "name": "[SnowflakeSource].[analytics].[dq].[customer_orders]", "type": "input", "count": 100 }
],
"targetAssets": [
{ "assetTypePath": "[Host].[Database].[Schema].[Table]", "assetNamePath": "[SnowflakeSource].[analytics].[dq].[customer_orders_validated]", "label": "Output" }
],
"sourceAssets": [
{ "assetTypePath": "[Host].[Database].[Schema].[Table]", "assetNamePath": "[SnowflakeSource].[analytics].[dq].[customer_orders]", "label": "Input" }
],
"isScheduled": false
}