• EnglishEspañol日本語한국어Português
  • Log inStart now

Customize the agent for AI monitoring

Once you install AI monitoring, you can configure the default behavior of the agent or update your app to collect different kinds of data.

Configure the agent

Update default agent behavior for AI monitoring at these agent configuration docs:

Token count method

If you haven't disabled ai_monitoring.record_content.enabled, you don't need to implement the token count callback API.

Disabling ai_monitoring.record_content.enabled stops the agent from sending AI content to New Relic, but it also prevents the agent from forwarding token counts for interactions with your app. You can implement a callback in your app code to determine the token counts locally, then have that information forwarded to New Relic.

Refer to the docs below for examples to set up counting tokens locally:

User feedback methods

If end users can leave feedback on an AI response, you can forward this data into the AI monitoring response table. To do this, you'll update your app code to correlate trace IDs from AI event data using callback methods.

There are two methods you need to implement to forward this kind of information:

Copyright © 2024 New Relic Inc.

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.