Event data retention (original pricing model)

重要

This doc is for accounts on our original pricing model, not our New Relic One pricing model. Not sure which you're on? See Overview of pricing models.

For organizations on New Relic One pricing, our various New Relic products report a wide range of event data. Different products have different data retention periods, and different ways to extend event data retention. You can customize the length of your event data retention through flexible event retention.

Data retention UI

For how to find the data retention UI, see Manage data.

Overview of event data retention

All New Relic product subscriptions come with a certain level of data retention that governs how long different types of data are retained. One type of data governed by data retention rules is event data. Event data is available in some UI charts and tables, and also available for querying via NRQL, our querying language.

There are events reported from products by default, and there are custom events: each have their own retention rules, depending on the product and subscription level.

Here are some examples of how different product subscriptions can affect event data retention:

Free/Lite APM subscription: default-reported events available for 1 day. No custom events available.
Pro APM subscription: default-reported events available for 8 days. Custom events available for 1 day (and able to be extended with Insight Pro).

To see your subscriptions, go to the Account summary page.

Extend your event retention

Product	Method
APM, Browser, and Mobile	Event data retention can be extended with a paid subscription to these products (see product data retention). To extend retention of both default-reported events and custom events further, you need an Insights Pro subscription.
Infrastructure	Event data retention can be extended with a paid Infrastructure subscription. See Infrastructure data retention rules.
Synthetics	Event data retention can be extended with a paid Synthetics subscription. See Synthetics data retention rules.
Custom events	Custom events reported by agent APIs or the Event API: Extension requires an Insights Pro subscription.

Insights Pro

重要

As of April 12, 2021, we are upgrading Insights to an improved web and mobile experience! All of your Insights URLs will be redirected automatically to the corresponding dashboards in New Relic One. For more details about this migration and how you can easily plan for this transition, see our Explorers Hub post.

A paid Insights subscription is what governs the extension of event data retention for:

Our APM, Browser, Mobile, and Serverless products
Custom events that come from an agent API or from the Event API

重要

Note that having an Insights Pro subscription doesn't require use of the Insights UI (insights.newrelic.com) to query your data: there are other querying options available.

To see the data retention governed by your Insights subscription: go to the usage UI and select Insights usage.

With an Insights Pro subscription, you can use flexible retention to customize how your event data is retained. This lets you keep only the data you need, for as long as you need it.

This is an explanation of how the number of stored events are calculated by default for an Insights Pro subscription. (Note that with flexible retention, you have more fine-grained control over the retention period.)

The events stored is calculated based on 1) total events stored over time (calculated based on the events generated per week) and 2) the weeks of data retention available. This equation can be represented like this:

events stored = (events generated per week) * (weeks of retention)

An Insights Pro subscription provides a given number of weeks of data retention as well as a given number of events over that retention period.

For example:

(200M transactions per week) * (4 weeks of retention) = 800M events stored in Insights
(16M transactions per week) * (50 weeks of retention) = 800M events stored in Insights

For Insights Pro subscriptions, data is purged based on retention window, not volume. It is deleted from the system once it's past the retention window.

For example: If your Insights license is for 800 million events with a 4 week retention period, your data would start being purged after it is older than four weeks. Temporary spikes in data exceeding your subscription level will still be recorded, but consistent overage should be solved by upgrading your subscription level or decreasing data collected.

For customers without an Insights Pro subscription, New Relic may throttle or downsample events to a limit of not more than than 4,000 events per host per minute.

In this example, you have an Insights Pro subscription with a license for 800 million events over 4 weeks, a rate of 200 million events per week. You have APM Pro, Browser Pro, and Mobile Enterprise. A fifth week of data is added via your subscriptions, bumping you to a total of 1 billion events stored within your plan:

If you are using 975 million events, you are not over your retention.
If you are using 1.25 billion events, you are over your retention.

ヒント

Owners or Admins

The Insights Data summary UI page is used to see the types of events being reported. You can also use this page to enable and disable the reporting of PageView and Transaction events.

To view Data summary:

Go to insights.newrelic.com > Manage data.
Select the Summary tab.
Note: if you disable PageView or Transaction event reporting, this can affect some New Relic UI elements. You may see some empty charts on some UI pages that rely on this data.
Go to insights.newrelic.com > Manage data > Summary.
From the Summary tab, select Configure data sources.
Toggle the appropriate switch on or off, then save.
Toggling Transaction on or off will cause reporting agents to restart themselves.
For more about configuring event reporting, see Event data retention.

Flexible data retention

With an Insights Pro subscription, you get access to flexible retention, which lets you define how some types of event data are retained. This lets you keep only the event data you need, for as long as you need it. You can manage your flexible retention through the UI or through our GraphQL API.

Requirements to use this feature:

An Insights Pro subscription or equivalent trial.
Applies only for events governed by an Insights Pro subscription.
To use this feature, you must be an account Owner or data retention add-on manager for your account.

To understand how standard event data retention works, first read Event data retention.

With flexible retention, you specify the data retention for applicable event namespaces across your accounts. This gives you per-event namespace control of your data. The retention that you specify for an event namespace will be shared by all the event types under that namespace. If some namespaces are not relevant to you, you can avoid collecting their event data entirely.

Your retention value can’t be lower than the included retention or higher than the default retention.

You can control data retention either in our UI or by API.

To understand the terms used with flexible retention, see the following:

Term	Description
Event namespace	An event's namespace corresponds to one or more event types that share a single data retention value. For more information, see Event namespaces (types). You can also use NerdGraph to get the list of customizable event namespaces.
Retention value	The number (in days) that specifies how long your event data is stored.
Retention rule	The event namespace and retention value pair that you specify to override the current retention.
Licensed retention	Retention period that’s determined in weeks by your Insights Pro subscription contract.
Included retention	Retention period for which your data is stored but not charged under the Insights Pro subscription. For details, see the data retention details for a specific product.
Paid retention	Retention period for which your data is stored and is charged under the Insights Pro subscription. By default, your licensed retention determines this value but Flexible retention lets you override it.
Default retention	Retention period that comes out of the box. This is based on the total of included retention plus licensed retention.

For information on managing retention settings with APIs, see the Manage data retention documentation.

Event data retention (original pricing model)

重要

Data retention UI

Overview of event data retention

Extend your event retention

Insights Pro

重要

重要

How number of events stored is calculated

Insights Pro event overage example

Disable/enable Transaction and Pageview event reporting

ヒント

Flexible data retention

How it works

Manage retention via UI

Glossary