This document explains requirements and tips for integrating the New Relic Python agent with applications that use Tornado 4. For general install instructions, go to Install the Python agent.
New Relic provides introductory support for Tornado 4. While not all features are supported at this point, providing it at an early stage allows interested customers to preview our Tornado 4 support, and provide feedback on what works well and what doesn't.
We strongly advise running the introductory Tornado 4 instrumentation in a testing or staging environment before using it in a production environment.
All questions, issues, and concerns should be submitted to New Relic Support.
Tornado 4.5 is not yet supported.
New Relic has tested the new Tornado 4 instrumentation on the following Tornado versions.
New Relic has tested the new Tornado 4 instrumentation on the following Python versions.
- 3.6 (CPython/PyPy)
Enabling Tornado 4 instrumentation
Tornado 4 instrumentation is not enabled by default in the agent. To enable, you must activate it by using the
tornado.instrumentation.r3 feature flag.
You should only use this feature flag if you are running a Tornado 4 application. Customers running a Tornado 3 application should continue to use our existing instrumentation, which will still be applied automatically without the use of a feature flag.
To use the feature flag, add the following to your
newrelic.ini configuration file:
feature_flag = tornado.instrumentation.r3
r3 stands for the third revision of Tornado instrumentation in the agent, and is not related to the version number for Tornado.)
Enabling Tornado 3 instrumentation
For Tornado 3 instrumentation, see Python agent and Tornado 3.
- All callbacks added to the Tornado IOLoop via
IOLoop.add_callback()are traced as
Function Traceswhen they run, which the agent accomplishes by wrapping
- For functions decorated with
@tornado.gen.coroutine, Tornado will internally run the function as a series of callbacks, each wrapped with
tornado.stack_context:wrap(). As a result, the agent will capture each part of the coroutine that runs as a separate function trace. The initial function call will be named after the function, while subsequent entries into the coroutine will have
(coroutine)appended to the function name. It is possible that this may change in a future release of the agent.
- A Web Transaction will end when all coroutines have finished yielding, when all callbacks added during the course of a transaction have run, and when the RequestHandler "verb" method completes.
- Response times will show in the APM UI on the Overview chart. It is possible for web transactions to end after the response is sent, if callbacks added during the course of a transaction run after the response is sent.
- Cross Application Tracing is supported for inbound web transactions. This means that Tornado 4 applications that are called by other applications (if those applications are using New Relic) appear on service maps.
- Recording Background Transactions is supported.
- Recording Exceptions is supported.
- Synchronous External Traces are supported.
- Synchronous Datastore Traces are supported.
- Collecting Synthetic Transaction Traces is supported.
IOLoop.add_callback()during a transaction must run before the transaction will finish.
Callbacksadded to the
Timeoutsduring the course of a transaction do not hold open a transaction, are not traced, and are not included in transactions. Examples of adding a callback as a timeout include calling:
- Callbacks added via
IOLoop.add_callback_from_signal()will not be included in transactions.
- Done callbacks added via
Future.add_done_callback()will not be included within the transaction they were added in, if the future resolves after the transaction has closed.
- Handlers added via
IOLoop.add_handler()are not traced, and are not included in transactions.
WebsocketHandlersare ignored. Because Web Sockets are used for long-lived connections between the client and server, and do not fit the request/response model of web transactions, all activity that takes place in a
The following is a list of known limitations for our Tornado 4 support as it exists in the current version of the agent (184.108.40.206). In the next few releases, we plan to address these issues.
- Metric names
Metric names should be more consistent. For a method of a class, the metric name should contain both the name of the class and the method, but sometimes, the metric name will be missing the class name.
- Transaction traces
- The nesting of segments in a Transaction Trace should be improved. Right now, transaction traces give a good indication of the order that callbacks run on the IOLoop, but they do not group together callbacks that belong to the same coroutine, nor do they show how callbacks relate to each other.
- Transaction traces mislabel time spent in "Application code." Because the Tornado 4 instrumentation traces all callbacks that run on the IOLoop, nearly everything that happens in a transaction is recorded. Very little is uninstrumented "Application code." When you see "Application code" time in a transaction trace, that usually means that the IOLoop was either busy running callbacks belonging to another transaction, or it was waiting and not doing any work. This will be made clearer in a future release.
- In the current version of the agent, the Total Time for a transaction will always equal the duration of the transaction. In future versions, we may begin measuring the time spent waiting for asynchronous External Traces and Datastore Traces to return results, which will increase the Total Time for a transaction, making it possible to have a Total Time greater than the duration of the transaction.
- Cross application tracing
tornado.httpclient, no Cross Application Tracing headers are added to the outgoing requests. This is true for both
AsyncHTTPClient. That means that the application that the
httpclientconnects to will not show up in any of the following:
- Trace maps
- Transaction maps
- Service maps
- Thread utilization
Measuring thread utilization is disabled for Tornado applications.
- Request handler exceptions
Exceptions thrown in
RequestHandler.initialize()are not recorded.
- Untested and unsupported
The following features are untested and unsupported:
- Use of Tornado's built-in multi-process mode to start multiple processes and have them all share the same port
- Use of
- Use of
tornado.platform.asyncioto bridge between
asyncioand Tornado IOLoop is untested and unsupported. Currently, the agent only supports the use of the
- Use of the
- Integration with
For more help
Additional documentation resources include:
- Python agent and Tornado 3 (instrumenting Tornado 3 apps)