---
title: Google Cloud Composer monitoring integration
source: https://docs.newrelic.com/docs/infrastructure/google-cloud-platform-integrations/gcp-integrations-list/google-cloud-composer-monitoring-integration
---

[New Relic integrations](https://docs.newrelic.com/docs/infrastructure/introduction-infra-monitoring) with the [Google Cloud Platform (GCP)](https://cloud.google.com/) include one that reports [Google Cloud Composer](https://cloud.google.com/composer) data to New Relic. This document explains how to activate the GCP Cloud Composer integration and describes the data it reports.

## Features

Cloud Composer is Google Cloud's fully managed workflow orchestration service built on Apache Airflow. New Relic Cloud Composer integration collects environment, workload, and workflow metrics — DAG runs, task instances, scheduler heartbeats, and worker resource usage.

## Activate integration [#activate]

To enable the integration, follow standard procedures to [connect your GCP service to New Relic](https://docs.newrelic.com/docs/connect-google-cloud-platform-services-infrastructure):

-   [Connect with Workload Identity Federation (recommended)](https://docs.newrelic.com/docs/connect-google-cloud-platform-services-infrastructure)
-   [Connect with service account or user account](https://docs.newrelic.com/docs/connect-google-cloud-platform-services-infrastructure)

## Polling frequency [#polling]

New Relic integrations query your GCP services according to a polling interval that varies by integration. The polling frequency for Google Cloud Composer is 5 minutes. The resolution is 1 data point every minute.

## Workload Identity Federation [#wif]

### Find and use data [#find-data-wif]

After you enable the integration, your Cloud Composer resources appear as entities in the New Relic entity explorer. To see dashboards and manage services, go to [one.newrelic.com > All capabilities](https://one.newrelic.com/all-capabilities) > Infrastructure > GCP.

All Cloud Composer metrics available in GCP Cloud Monitoring are collected as dimensional metrics in the `Metric` event type. Additional metrics beyond this table are collected automatically. See [Google's Cloud Composer metrics documentation](https://cloud.google.com/monitoring/api/metrics_gcp#gcp-composer) for the complete list.

#### Entities

**Cloud Composer entities**

| Entity      | Entity type              | Resource type                |
| ----------- | ------------------------ | ---------------------------- |
| Environment | `GCPCOMPOSERENVIRONMENT` | `cloud_composer_environment` |
| Workflow    | `GCPCOMPOSERWORKFLOW`    | `cloud_composer_workflow`    |
| Workload    | `GCPCOMPOSERWORKLOAD`    | `cloud_composer_workload`    |

### Metric data [#metrics-wif]

#### Key metrics — Environment

| Metric name                                                | Unit    | Description                                                |
| ---------------------------------------------------------- | ------- | ---------------------------------------------------------- |
| `gcp.composer.environment.healthy`                         | Boolean | Whether the Composer environment is currently healthy.     |
| `gcp.composer.environment.dag_processing.total_parse_time` | Seconds | Total time spent parsing DAGs in the environment.          |
| `gcp.composer.environment.database.cpu.utilization`        | Percent | CPU utilization of the environment's metadata database.    |
| `gcp.composer.environment.database.memory.utilization`     | Percent | Memory utilization of the environment's metadata database. |
| `gcp.composer.environment.worker.pod_eviction_count`       | Count   | Number of worker pod evictions in the environment.         |

#### Key metrics — Workflow

| Metric name                                          | Unit    | Description                                                     |
| ---------------------------------------------------- | ------- | --------------------------------------------------------------- |
| `gcp.composer.workflow.run_count`                    | Count   | Number of DAG runs, faceted by workflow state.                  |
| `gcp.composer.workflow.run_duration`                 | Seconds | Duration of DAG runs across the workflow.                       |
| `gcp.composer.workflow.task_instance.finished_count` | Count   | Number of task instances across the workflow, faceted by state. |
| `gcp.composer.workflow.task_instance.duration`       | Seconds | Task instance execution time distribution.                      |

#### Key metrics — Workload

| Metric name                               | Unit    | Description                                       |
| ----------------------------------------- | ------- | ------------------------------------------------- |
| `gcp.composer.workload.cpu.usage_time`    | Seconds | CPU-seconds consumed by the Composer workload.    |
| `gcp.composer.workload.memory.bytes_used` | Bytes   | Memory currently in use by the Composer workload. |
| `gcp.composer.workload.pod_count`         | Count   | Number of pods backing the Composer workload.     |

For the complete list of Cloud Composer metrics, see [Google's Cloud Composer metrics documentation](https://cloud.google.com/monitoring/api/metrics_gcp#gcp-composer).

## Service account or user account [#service-account]

### Find and use data [#find-data]

To find your integration data, go to [one.newrelic.com > All capabilities](https://one.newrelic.com/all-capabilities) > Infrastructure > GCP and select the integration.

Data is attached to the following [event types](https://docs.newrelic.com/docs/data-apis/understand-data/new-relic-data-types/#event-data):

| Entity      | Event Type                     | Provider                 |
| ----------- | ------------------------------ | ------------------------ |
| Environment | `GcpComposerEnvironmentSample` | `GcpComposerEnvironment` |
| Workflow    | `GcpComposerWorkflowSample`    | `GcpComposerWorkflow`    |

For more on how to use your data, see [Understand and use integration data](https://docs.newrelic.com/docs/infrastructure/integrations/find-use-infrastructure-integration-data).

## Metric data [#metrics]

This integration collects GCP Composer data for Environment and Workflow.

### Composer Environment data

| Metric                                        | Unit         | Description                                                          |
| --------------------------------------------- | ------------ | -------------------------------------------------------------------- |
| `environment.api.Request`                     | Count        | Number of Composer API requests seen so far.                         |
| `environment.api.RequestLatencies`            | Milliseconds | Distribution of Composer API call latencies.                         |
| `environment.dag_processing.ParseError`       | Count        | Number of errors raised during parsing DAG files.                    |
| `environment.dag_processing.Processes`        | Count        | Number of currently running DAG parsing processes.                   |
| `environment.dag_processing.ProcessorTimeout` | Count        | Number of file processors terminated due to processing timeout.      |
| `environment.dag_processing.TotalParseTime`   | Seconds      | Number of seconds taken to scan and import all DAG files once.       |
| `environment.DagbagSize`                      | Count        | The current dag bag size.                                            |
| `environment.database.cpu.ReservedCores`      | Count        | Number of cores reserved for the database instance.                  |
| `environment.database.cpu.UsageTime`          | Seconds      | CPU usage time of the database instance.                             |
| `environment.database.cpu.Utilization`        | Count        | CPU utilization ratio (from 0.0 to 1.0) of the database instance.    |
| `environment.database.disk.BytesUsed`         | Bytes        | Used disk space in bytes on the database instance.                   |
| `environment.database.disk.Quota`             | Bytes        | Maximum data disk size in bytes of the database instance.            |
| `environment.database.disk.Utilization`       | Count        | Disk quota usage ratio (from 0.0 to 1.0) of the database instance.   |
| `environment.database.memory.BytesUsed`       | Bytes        | Memory usage of the database instance in bytes.                      |
| `environment.database.memory.Quota`           | Bytes        | Maximum RAM size in bytes of the database instance.                  |
| `environment.database.memory.Utilization`     | Count        | Memory utilization ratio (from 0.0 to 1.0) of the database instance. |
| `environment.executor.OpenSlots`              | Count        | Number of open slots on executor.                                    |
| `environment.executor.RunningTasks`           | Count        | Number of running tasks on executor.                                 |
| `environment.FinishedTaskInstance`            | Count        | Overall task instances.                                              |
| `environment.NumCeleryWorkers`                | Count        | Number of Celery workers.                                            |
| `environment.SchedulerHeartbeat`              | Count        | Scheduler heartbeats.                                                |
| `environment.TaskQueueLength`                 | Count        | Number of tasks in queue.                                            |
| `environment.worker.PodEviction`              | Count        | The number of Airflow worker pods evictions.                         |
| `environment.ZombieTaskKilled`                | Count        | Number of zombie tasks killed.                                       |

### Composer Workflow data

| Metric                      | Unit    | Description                                |
| --------------------------- | ------- | ------------------------------------------ |
| `workflow.Run`              | Count   | Number of workflow runs completed so far.  |
| `workflow.RunDuration`      | Seconds | Duration of workflow run completion.       |
| `workflow.task.Run`         | Count   | Number of workflow tasks completed so far. |
| `workflow.task.RunDuration` | Seconds | Duration of task completion.               |