Install AI monitoring
When you install AI monitoring, you're allowing our APM agents to collect metrics and event data from AI libraries and frameworks. To get started, you'll instrument your AI-powered app with an APM agent, then update configurations to adjust the agent's behavior.
![AI Responses page for AIM A screenshot of the AI Responses page for AI Monitoring](/images/ai_screenshot-full_intro-ai-ui.webp)
Go to one.newrelic.com > All Capabilities > AI Monitoring > AI Responses
Important
When enabled, AI monitoring records a streaming copy of inputs and outputs sent to and from the models you choose to monitor, including any personal information contained therein. You're responsible for obtaining consent from your model users that their interactions may be recorded by a third party (New Relic) for the purpose of providing the AI monitoring feature.
Tell us about your app
Install AI monitoring
To get data about your AI app, you need to install an APM agent that can collect and send data to New Relic. You can install by manually updating your app with some code.
Configure the agent
Once you've installed the agent, you can enable AI monitoring with configuration variables. We'll make recommendations about configuring your agent for AI monitoring during this step.
Tip
By default, the distributed_tracing.enabled
is set to true
. This allows us to understand your application's LLM usage as per the overall architecture.
View your data
Trigger an event in your system, wait a few minutes, then check New Relic for your data. You can find your AI data by going to one.newrelic.com > AI monitoring > AI responses.
![AI monitoring with New Relic View your AI data from AI responses in the UI](/images/ai_screenshot-full_view-your-data-install.webp)
What's next?
With your AI-powered app instrumented, you can now:
- Learn about your AI app response data.
- Check out how to customize the agent for AI monitoring to learn about adjusting agent behavior.
- Create drop filters if you want to drop sensitive information from your event data.