• Log inStart now

Google BigQuery monitoring integration

New Relic's integrations with the Google Cloud Platform (GCP) include an integration to report Google BigQuery data to New Relic. This document explains how to activate the Google BigQuery integration and describes the data that can be reported.

Features

Google BigQuery is a data warehouse with no infrastructure to manage. With BigQuery you can specify the data schema, or allow the service to discover it for you. You can explore your data using SQL queries.

Activate integration

To enable the integration follow standard procedures to connect your GCP service to New Relic.

Polling frequency

New Relic integrations query GCP services according to a polling interval that varies depending on the integration. The polling frequency for the Google BigQuery integration is five minutes. For information about the resolution, see metric data details.

Activate Table metrics

The collection of BigQuery table metrics is disabled by default. This affects the metrics listed under GcpBigQueryTableSample. To collect those metrics, turn on the "Enable table metrics" setting under the configuration menu of the BigQuery integration.

Find and use data

After activating the integration and waiting a few minutes (based on the polling frequency), data will appear in the New Relic UI. To find and use your data, including links to your dashboards and alert settings, go to one.newrelic.com > Infrastructure > GCP > (select an integration).

Metric data

To view metric data for your Google BigQuery integration in New Relic, create NRQL queries for GcpBigQueryProjectSample, GcpBigQueryDatasetSample, and GcpBigQueryTableSample events and their attributes.

GcpBigQueryProjectSample

Query GcpBigQueryProjectSample events in New Relic to view data for the following metrics. Resolution is one data point per minute with an 8-minute delay.

Attribute

Description

query.Count

In-flight queries.

query.ExecutionTimes

Distribution of query execution times.

slots.Allocated

Number of slots currently allocated for project.

slots.AllocatedForProject

Number of slots currently allocated for query jobs in the project.

slots.AllocatedForProjectAndJobType

Number of slots currently allocated for the project and job type.

slots.AllocatedForReservation

Number of slots currently allocated for project in the reservation.

slots.TotalAllocatedForReservation

Number of slots currently allocated across projects in the reservation.

slots.TotalAvailable

Total number of slots available for the project.

GcpBigQueryDatasetSample

Query GcpBigQueryDatasetSample events in New Relic to view data for the following metrics. Resolution is one data point every 30 minutes with a 3-hour delay.

Attribute

Description

storage.StoredBytes

Amount of stored bytes.

storage.Tables

Number of tables.

GcpBigQueryTableSample

Query GcpBigQueryTableSample events to view data for the following metrics. Resolution is one data point per minute with a 6-hour delay.

Attribute

Description

storage.UploadedBytes

Uploaded bytes.

storage.UploadedBytesBilled

Uploaded bytes billed. Currently only streaming API is billed.

storage.UploadedRowCount

Uploaded rows.

Copyright © 2022 New Relic Inc.

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.