Azure Data Factory monitoring integration

BETA

New Relic Infrastructure provides an integration for reporting your Microsoft Azure Data Factory data to New Relic products. Here we explain how to activate the integration and what data can be reported.

Features

New Relic Infrastructure gathers both DataFactory and Factory data from your Azure Data Factory service. You can monitor and alert on your Azure Data Factory data from New Relic Infrastructure, and you can create custom queries and custom chart dashboards.

Activate integration

To enable the integration follow standard procedures to activate your Azure service in New Relic Infrastructure.

Configuration and polling

You can change the polling frequency and filter data using configuration options.

Default polling information for the Azure Data Factory integration:

  • Polling interval: 5 minutes

Find and use data

To find your integration data in Infrastructure, go to infrastructure.newrelic.com > Azure and select the Data Factory integration.

Data is attached to the following event types:

Entity Event Type Provider
DataFactory AzureDataFactoryDataFactorySample AzureDataFactoryDataFactory
Factory AzureDataFactoryFactorySample AzureDataFactoryFactory

For more on how to use your data, see Understand and use integration data.

Metric data

To view metrics reported by the Data Factory integration, query the Entities below. For detailed metric information, see the Azure supported metrics documentation.

This integration collects Azure Data Factory data for DataFactory and Factory.

DataFactory data

Metric Unit Description

failedRuns

Count Failed Runs

successfulRuns

Count Failed Runs

Factory data

Metric Unit Description

pipelineFailedRuns

Count Failed pipeline runs metrics

pipelineSucceededRuns

Count Succeeded pipeline runs metrics

pipelineCancelledRuns

Count Cancelled pipeline runs metrics

activityFailedRuns

Count Failed activity runs metrics

activitySucceededRuns

Count Succeeded activity runs metrics

activityCancelledRuns

Count Cancelled activity runs metrics

triggerFailedRuns

Count Failed trigger runs metrics

triggerSucceededRuns

Count Succeeded trigger runs metrics

triggerCancelledRuns

Count Cancelled trigger runs metrics

integrationRuntimeCpuPercentagePercent

Percent Integration runtime CPU utilization

integrationRuntimeAvailableMemoryBytes

Bytes Integration runtime available memory

integrationRuntimeAverageTaskPickupDelaySeconds

Seconds Integration runtime queue duration

integrationRuntimeQueueLength

Count Integration runtime queue length

integrationRuntimeAvailableNodeNumber

Count Integration runtime available node count

maxAllowedResourceCount

Count Maximum allowed entities count

maxAllowedFactorySizeInGbUnits

Count Maximum allowed factory size (GB unit)

resourceCount

Count Total entities count

factorySizeInGbUnits

Count Total factory size (GB unit)

For more help

Recommendations for learning more: