Install AI monitoring

When you install AI monitoring, you're allowing our APM agents to collect metrics and event data from AI libraries and frameworks. To get started, you'll instrument your AI-powered app with an APM agent, then update configurations to adjust the agent's behavior.

A screenshot of the AI Responses page for AI Monitoring

Go to one.newrelic.com > All Capabilities > AI Monitoring > AI Responses

Important

When enabled, AI monitoring records a streaming copy of inputs and outputs sent to and from the models you choose to monitor, including any personal information contained therein. You're responsible for obtaining consent from your model users that their interactions may be recorded by a third party (New Relic) for the purpose of providing the AI monitoring feature.

Tell us about your app

Install AI monitoring

To get data about your AI app, you need to install an APM agent that can collect and send data to New Relic. You can install by manually updating your app with some code.

Configure the agent

Once you've installed the agent, you can enable AI monitoring with configuration variables. We'll make recommendations about configuring your agent for AI monitoring during this step.

Tip

By default, the distributed_tracing.enabled is set to true. This allows us to understand your application's LLM usage as per the overall architecture.

View your data

Trigger an event in your system, wait a few minutes, then check New Relic for your data. You can find your AI data by going to one.newrelic.com > AI monitoring > AI responses.

View your AI data from AI responses in the UI

What's next?

With your AI-powered app instrumented, you can now: