Important
Enable the AWS CloudWatch Metric Streams integration to monitor all CloudWatch metrics from your AWS services, including custom namespaces. Individual integrations are no longer our recommended option.
New Relic infrastructure integrations include an integration for reporting your Amazon S3 data to New Relic. This document explains how to activate the integration and describes the data reported.
AWS states that S3 CloudWatch metrics are provided on a best-effort basis and may not always be current. If the CloudWatch metrics are delayed over 48 hours at collection, New Relic cannot ingest them.
Features
Amazon Simple Storage Service (Amazon S3), provides developers and IT teams with secure, durable, highly-scalable cloud storage.
With New Relic's Amazon S3 integration, data reported includes S3 bucket size, bucket object counts, GET requests, POST requests, and other metrics. S3 data is available in pre-built and you can also create custom queries and charts. You can also create alert conditions to notify you of changes in S3 data.
Activate integration
Important
Request and Data Transfer metrics are premium metrics and paid for separately through AWS. For CloudWatch pricing information, see Amazon's S3 enhanced monitoring documentation.
To enable this integration follow standard procedures to Connect AWS services to New Relic.
Configuration and polling
You can change the polling frequency and filter data using configuration options.
Default polling information for the Amazon S3 integration:
- New Relic polling intervals:
- S3 buckets: 1 hour
- S3 requests: 5 minutes
- Amazon CloudWatch polling intervals:
- S3 buckets: 24 hours
- S3 requests: 1 minute
Note that changing the polling interval for this integration will only affect data collection for S3 request metrics.
Find and use data
To find your integration data, go to one.newrelic.com > All capabilities > Infrastructure > AWS and select one of the S3 integration links.
You can query and explore your data using the DatastoreSample event type, with a provider value of S3Bucket or S3BucketRequests in case you have enabled Request and Transfer metrics.
For more on how to use your data, see Understand integration data.
Metric data
This integration collects the following Amazon S3 metrics. For more details about these metrics, see Amazon's S3 documentation.
Amazon S3 data for buckets
Metric | Description |
|---|---|
| The amount of data in bytes stored in a bucket including Standard Storage, Reduced Redundancy Storage, Infrequent Access Storage (IAS), One zone IAS, and Glacier Storage including overheads. |
| The total number of objects stored in a bucket for all storage classes except for the |
Amazon S3 data for request metrics
To collect these metrics, you must enable request metrics for your S3 bucket:
Metric | Description |
|---|---|
| The total number of HTTP requests made to an Amazon S3 bucket, regardless of type. When using a metrics configuration with a filter, then this metric only counts HTTP requests from objects that meet the filter's requirements. If creating multiple bucket metric filters, you must create a filter scoped to all the objects in the bucket as detailed in these AWS instructions. Note that only that filter should be scoped to all objects in the bucket. |
| The number of HTTP GET requests made for objects in an Amazon S3 bucket. This doesn't include list operations. |
| The number of HTTP PUT requests made for objects in an Amazon S3 bucket. |
| The number of HTTP DELETE requests made for objects in an Amazon S3 bucket. This also includes Delete Multiple Objects requests. This metric shows the number of requests, not the number of objects deleted. |
| The number of HTTP HEAD requests made to an Amazon S3 bucket. |
| The number of HTTP POST requests made to an Amazon S3 bucket. |
| The number of HTTP requests that list the contents of a bucket. |
| The number bytes downloaded for requests made to an Amazon S3 bucket, where the response includes a body. Valid statistics: Average (bytes per request), Sum (bytes per period), Sample Count, Min, Max |
| The number bytes uploaded that contain a request body, made to an Amazon S3 bucket. Valid statistics: Average (bytes per request), Sum (bytes per period), Sample Count, Min, Max |
| The number of HTTP 4xx client error status code requests made to an Amazon S3 bucket with a value of either Valid statistics: Average (reports per request), Sum (reports per period), Min, Max, Sample Count |
| The number of HTTP 5xx server error status code requests made to an Amazon S3 bucket with a value of either Valid statistics: Average (reports per request), Sum (reports per period), Min, Max, Sample Count |
| The per-request time, in milliseconds, from the time the S3 bucket received a complete request to the time the response started to be returned. Valid statistics: Average, Sum, Min, Max, Sample Count |
| The elapsed per-request time, in milliseconds, from the first byte received to the last byte sent to an Amazon S3 bucket. This includes the time taken to receive the request body and send the response body, which is not included in Valid statistics: Average, Sum, Min, Max, Sample Count |