Automated Technique to Get Newest Pipeline Execution Particulars of an Azure Information Manufacturing unit

Downside Assertion

As of Dec 18,2023; One can get the record of all execution particulars of a selected pipeline of an Azure Information Manufacturing unit by way of the Powershell Module: Get-AzDataFactoryV2PipelineRun. However this Module gives all execution particulars of the pipeline or the execution element of the particular pipeline runid.

Equally, the Monitor part gives all execution particulars, and we have now to manually scan for the most recent execution per pipeline.

So, is there an automatic strategy to Get the Newest Pipeline Execution Particulars of an Azure Information Manufacturing unit.

Resolution

1. Open Powershell in admin mode and import the Azure SDK modules by executing the under instructions :

Import-Module Az.Accounts
Import-Module Az.DataFactory

2. Set up the customized module by executing the under command

Set up-Module -Identify AzDataFactoryV2PipelinesLastExecution

3. Now, the atmosphere is ready for us to execute the instructions to fetch the pipeline particulars .

To get the record of all Pipelines in an ADF and its corresponding final execution particulars, execute the under command:

Get-AzDataFactoryV2PipelinesLastExecution -ResourceGroupName “<<RGName>>” -DataFactoryName “<<ADFName>>”

To get the main points of a selected Pipeline in an ADF and its corresponding final execution, execute the under command:

Get-AzDataFactoryV2PipelinesLastExecution -ResourceGroupName “<<RGName>>” -DataFactoryName “<<ADFName>>” -PipelineName “<<PipelineName>>”

To get the record of all Pipelines in an ADF and its corresponding final execution particulars in a selected time vary, execute the under command:

Get-AzDataFactoryV2PipelinesLastExecution -ResourceGroupName “<<RGName>>” -DataFactoryName “<<ADFName>>” -StartRange "<<StartDate>>" -EndRange "<<EndDate>>"

Output Outcomes

1. General ADF output

2. Particular Pipeline output

3. Particular Vary output

: In case no values are offered to StartRange and EndRange; then default values could be assigned as 1900-01-01 and newest datetime accordingly.

This could keep away from manually figuring out the most recent execution particulars of a pipeline in Azure Information Manufacturing unit.