• EnglishEspañol日本語한국어Português
  • Log inStart now

Amazon S3 monitoring integration

Important

Enable the AWS CloudWatch Metric Streams integration to monitor all CloudWatch metrics from your AWS services, including custom namespaces. Individual integrations are no longer our recommended option.

New Relic infrastructure integrations include an integration for reporting your Amazon S3 data to New Relic. This document explains how to activate the integration and describes the data reported.

Features

Amazon Simple Storage Service (Amazon S3), provides developers and IT teams with secure, durable, highly-scalable cloud storage.

With New Relic's Amazon S3 integration, data reported includes S3 bucket size, bucket object counts, GET requests, POST requests, and other metrics. S3 data is available in pre-built and you can also create custom queries and charts. You can also create alert conditions to notify you of changes in S3 data.

Activate integration

Important

Request and Data Transfer metrics are premium metrics and paid for separately through AWS. For CloudWatch pricing information, see Amazon's S3 enhanced monitoring documentation.

To enable this integration follow standard procedures to Connect AWS services to New Relic.

Configuration and polling

You can change the polling frequency and filter data using configuration options.

Default polling information for the Amazon S3 integration:

  • New Relic polling intervals:
    • S3 buckets: 1 hour
    • S3 requests: 5 minutes
  • Amazon CloudWatch polling intervals:
    • S3 buckets: 24 hours
    • S3 requests: 1 minute

Note that changing the polling interval for this integration will only affect data collection for S3 request metrics.

Find and use data

To find your integration data, go to one.newrelic.com > All capabilities > Infrastructure > AWS and select one of the S3 integration links.

You can query and explore your data using the DatastoreSample event type, with a provider value of S3Bucket.

For more on how to use your data, see Understand integration data.

Metric data

This integration collects the following Amazon S3 metrics. For more details about these metrics, see Amazon's S3 documentation.

Amazon S3 data for buckets

Metric

Description

BucketSizeBytes

The amount of data in bytes stored in a bucket including Standard Storage, Reduced Redundancy Storage, Infrequent Access Storage (IAS), One zone IAS, and Glacier Storage including overheads.

NumberOfObjects

The total number of objects stored in a bucket for all storage classes except for the GLACIER storage class.

Amazon S3 data for request metrics

To collect these metrics, you must enable request metrics for your S3 bucket:

Metric

Description

AllRequests

The total number of HTTP requests made to an Amazon S3 bucket, regardless of type. When using a metrics configuration with a filter, then this metric only counts HTTP requests from objects that meet the filter's requirements. If creating multiple bucket metric filters, you must create a filter scoped to all the objects in the bucket as detailed in these AWS instructions. Note that only that filter should be scoped to all objects in the bucket.

GetRequests

The number of HTTP GET requests made for objects in an Amazon S3 bucket. This doesn't include list operations.

PutRequests

The number of HTTP PUT requests made for objects in an Amazon S3 bucket.

DeleteRequests

The number of HTTP DELETE requests made for objects in an Amazon S3 bucket. This also includes Delete Multiple Objects requests. This metric shows the number of requests, not the number of objects deleted.

HeadRequests

The number of HTTP HEAD requests made to an Amazon S3 bucket.

PostRequests

The number of HTTP POST requests made to an Amazon S3 bucket.

ListRequests

The number of HTTP requests that list the contents of a bucket.

BytesDownloaded

The number bytes downloaded for requests made to an Amazon S3 bucket, where the response includes a body.

Valid statistics: Average (bytes per request), Sum (bytes per period), Sample Count, Min, Max

BytesUploaded

The number bytes uploaded that contain a request body, made to an Amazon S3 bucket.

Valid statistics: Average (bytes per request), Sum (bytes per period), Sample Count, Min, Max

4xxErrors

The number of HTTP 4xx client error status code requests made to an Amazon S3 bucket with a value of either 0 or 1. The average statistic shows the error rate, and the sum statistic shows the count of that type of error, during each period.

Valid statistics: Average (reports per request), Sum (reports per period), Min, Max, Sample Count

5xxErrors

The number of HTTP 5xx server error status code requests made to an Amazon S3 bucket with a value of either 0 or 1. The averagestatistic shows the error rate, and the sum statistic shows the count of that type of error, during each period.

Valid statistics: Average (reports per request), Sum (reports per period), Min, Max, Sample Count

FirstByteLatency

The per-request time, in milliseconds, from the time the S3 bucket received a complete request to the time the response started to be returned.

Valid statistics: Average, Sum, Min, Max, Sample Count

TotalRequestLatency

The elapsed per-request time, in milliseconds, from the first byte received to the last byte sent to an Amazon S3 bucket. This includes the time taken to receive the request body and send the response body, which is not included in FirstByteLatency.

Valid statistics: Average, Sum, Min, Max, Sample Count

Copyright © 2024 New Relic Inc.

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.