Configure logs in context for Python

Logs in context for the Python agent connects your logs and APM data in New Relic, giving full context to high-level events, as well as providing high value data to specific log lines. Read on to learn how to configure logs in context and start getting log data.

Compatibility and requirements

To use log monitoring with the Python agent, ensure your configuration meets the following requirements:

Configure logs in context with log monitoring

To configure New Relic logs in context with Python:

  1. Enable New Relic Logs with a compatible log forwarding plugin.
  2. Install or update the Python agent.
  3. Configure the Python logging framework to use the NewRelicContextFormatter.
  4. Check for logging data.

Enable log monitoring

Confirm that you have log monitoring enabled, with a compatible log forwarding plugin installed to send your application logs to New Relic.

Install or update the Python agent

Install or update to the most recent Python agent version, and enable Distributed tracing.

Configure the NewRelicContextFormatter

Enabling logs in Python is as simple as instantiating a log formatter and adding it to your log handler. This example uses a StreamHandler which by default writes logs to sys.stderr, but any handler can be used. See the Python docs for information about configuring log handlers.

# Import the logging module and the New Relic log formatter
import logging
from newrelic.agent import NewRelicContextFormatter

# Instantiate a new log handler
handler = logging.StreamHandler()

# Instantiate the log formatter and add it to the log handler
formatter = NewRelicContextFormatter()
handler.setFormatter(formatter)

# Get the root logger and add the handler to it
root_logger = logging.getLogger()
root_logger.addHandler(handler)

Check for logging data

To verify that you have configured the extension correctly, run your application and verify that the logging you have configured contains the following:

  1. Includes trace.id and span.id fields
  2. Is properly-formatted JSON lines

If everything is configured correctly and your data is being reported, you should see data logs in the New Relic Logs UI using the query operator has: span.id/trace.id

What's next?

Now that you've set up APM logs in context, here are some potential next steps:

For more help