Cloud Integrations Release Notes

Cloud Integrations Release Notes

Wednesday, April 10, 2019 - 00:00

Bug fix

Some AWS Auto Scaling entities had duplicate identifiers, causing some metadata to be missing or wrong. In order to fix this issue, New Relic has regenerated the internal externalKey attribute for all Auto Scaling entities in Insights events and Infrastructure inventory for this cloud integration.

This change doesn't have any impact either on the integration default dashboard provided by New Relic Infrastructure or on the Insights queries.

However, all entities related to AWS Auto Scaling will be created again in Inventory. Accordingly, once the fix is released in your account, you might see duplicated entities for 48 hours, until the old identifiers expire. This might also cause an unexpected volume of Entity created events.​

Friday, March 29, 2019 - 00:00

New

    Additionally, Inventory for Google Compute Engine and Google Cloud Functions has been enhanced with new attributes and restructured, so it's easier to find the metadata that belongs to each entity.
  • The aforementioned improvements might cause an unexpected volume of Entity modified events, as Inventory will be updated with the new data.
Thursday, March 28, 2019 - 00:00

Bug fixes

  • Some Google Kubernetes Engine entities had duplicate identifiers. In order to fix this issue, New Relic has regenerated the internal entityId and externalKey attributes for all containers in Insights events and Infrastructure inventory for this cloud integration.
    • This change doesn't have any impact either on the integration default dashboard provided by New Relic Infrastructure or on the Insights queries.
    • However, all entities related to Google Kubernetes Engine will be created again in Inventory. Accordingly, you might see duplicated entities for 48 hours, until the old identifiers expire. This might also cause an unexpected volume of Entity created events.
  • ​Metadata for Google Compute Engine virtual machines was not being added to the metric events reported by the New Relic Infrastructure agent. In order to fix this issue, New Relic has regenerated the internal externalKey attribute for all virtual machines and disks in Insights events and Infrastructure inventory for this cloud integration.
    • This change doesn't have any impact either on the integration default dashboard provided by New Relic Infrastructure or on the Insights queries.
    • However, all entities related to Google Compute Engine will be created again in Inventory. Accordingly you might see duplicated entities for 48 hours, until the old identifiers expire. This might also cause an unexpected volume of Entity created events.
  • For Google Cloud integrations, the value of the zone attribute was not reported consistently. As a consequence, some inventory attributes and event metadata, such as project, were not reported for some Google Cloud Storage buckets.
Wednesday, March 13, 2019 - 00:00

New

The account status dashboard for cloud-linked accounts introduces some significant changes:

  • The Account changes chart lists any action that was performed on the linked cloud account configuration, from linking, renaming and enabling cloud services for monitoring, to modifying the polling intervals or any other data collection option.
  • The charts in the dashboard have been reorganized to better understand API call usage, errors that affect New Relic collecting data, and changes to the integrations configuration.
  • For Google Cloud-linked projects, the dashboard now includes the Stackdriver calls chart, which shows the amount of API calls that New Relic sends to the Google Stackdriver Monitoring API.
Tuesday, March 12, 2019 - 00:00

New

  • In order to optimize the volume of calls to AWS APIs, the cloud integrations setting options have been enhanced. In particular:
    • New Relic will be using the same polling interval for metrics and inventory data from now on.
    • Many options for you to control the amount of inventory data that New Relic collects from your cloud account have been added: tags, extended inventory, regions, entity name prefixes, resource groups, etc. Please find which attributes are fetched by enabling extended inventory in the specific document for each cloud integration.
  • You can enable or disable the collection of extended inventory attributes through New Relic's user interface for AWS DynamoDB, AWS ElastiCache and Google Cloud BigQuery.
  • The AWS Lambda integration has been extended with additional metrics and inventory attributes:
    • The ServerlessSample event type now includes deadLetterErrors and iteratorAge metrics, both for functions and function aliases. Additionally, it includes the concurrentExecutions metric for functions that have a custom concurrency limit specified.

    • For functions, inventory (under aws/lambda/function/) now includes the kmsKeyArn, masterArn, revisionId and layers attributes.

    • For function aliases, inventory (under aws/lambda/alias/) now includes the revisionId and routingConfig attributes.

    • For mappings between an AWS resource and a function, inventory (under aws/lambda/event-source-mapping/) now includes the stateTransitionReason attribute.

Bug fixes

  • Google BigQuery tables with no schema were lacking some inventory attributes.​
Thursday, February 28, 2019 - 00:00

New

  • Google Cloud Load Balancing integration is now available. New Relic collects metrics for all types of load balancers, and provides a curated dashboard with successful requests, error percentages, throughput, and latency. Check Google Cloud Load Balancing monitoring integration for details.
  • Google Cloud Pub/Sub integration is now available. New Relic collects metrics and inventory data for Pub/Sub Topics and Subscriptions. Check Google Cloud Pub/Sub monitoring integration for details.
  • Google Cloud Spanner integration is now available. New Relic’s curated dashboard shows relevant metrics for Spanner instances and databases, such as request latency, disk, CPU, successful requests count and error rate. Check Google Cloud Spanner monitoring integration for details.
  • Google Cloud SQL is now available. The most relevant metrics to watch are CPU, memory and disk utilization, to make sure the databases are correctly dimensioned. The curated dashboard also features write and read operations per second, concurrent connections and database state. Check Google Cloud SQL monitoring integration for details.
  • Google BigQuery is now available. Our curated dashboard helps keep track of query execution time, the number of bytes stored in the datasets, and the number of bytes uploaded to any table in the dataset that were billed. Check Google BigQuery monitoring integration for details.
Wednesday, February 20, 2019 - 00:00

New

  • The AWS EMR integration has been optimized to reduce the number of API calls that are made to collect data for terminated clusters, while ensuring that the latest metrics and inventory attribute values will be reported.

  • The AWS Route 53 integration has been optimized to reduce the number of calls to the AWS API that are needed to fetch hosted zone data. It's just one call per 100 hosted zones now, while an additional call per hosted zone was made before.

  • In the AWS RDS integration, the inventory attribute allocatedStorageBytes has been added to the RDS instance metric events, so now it's possible to calculate free storage percentage with an NRDB query:
    SELECT min(provider.freeStorageSpaceBytes.Minimum * 100 / provider.allocatedStorageBytes) FROM DatastoreSample where provider = 'RdsDbInstance' FACET displayName TIMESERIES AUTO

Bug fixes

  • When creating an Integrations alert condition through the user interface, some data sources were wrong or missing in the list:
  • In the AWS VPC integration, the value of the provider attribute for PrivateNetworkSample events, was fixed from VpcEnpoint to VpcEndpoint.
  • For the AWS API Gateway integration, the Count metric aggregate, which provides the number of calls to API methods, has been changed from Sum to Sample Count. This change requires that you manually update all the alert conditions and custom Insights dashboards that involve the deprecated Sum metric.
    • To update an alert condition, use New Relic Infrastructure Alerts UI or API and edit the metric that defines the threshold for the ApiGatewayApi data source. If you use the UI, please replace Provider - Count - Sum with Provider - Count - Sample Count. If you use the API, please replace provider.count.Sum with provider.count.SampleCount.
    • To update an Insights dashboard, use New Relic Insights UI or API and edit the chart queries that involve the provider.count.Sum to replace it with provider.count.SampleCount.
    • In particular, if you enabled AWS API Gateway monitoring before December 2018, New Relic might have created a "AWS API Gateway (APIs)" dashboard automatically. This dashboard contains the "Total Calls compare with 1 hour ago" chart, which involves the provider.count.Sum metric that needs to be replaced.
    • Please note that the default dashboards shown under New Relic Infrastructure have already been updated.
Thursday, January 10, 2019 - 00:00

New: Enable or disable attribute collection via UI

You can enable or disable the collection of extended inventory attributes through New Relic's user interface for AWS Application Load Balancer (ALB), Elastic Load Balancer (ELB), Elastic Beanstalk, Elastic Block Store (EBS), Route53 and Simple Notification Service (SNS). This tool helps you reduce the amount of calls that New Relic does to AWS APIs, and it might contribute to contain your AWS bill. For more information, see the documentation for:

  • Configuring the polling frequency of data collection through the Infrastructure integrations UI
  • Attributes that make part of extended inventory in each cloud integration

New: View errors fetching data via UI

Also, the cloud integrations Account status dashboard shows any errors New Relic might experience when trying to fetch inventory and metric data for your cloud resources. The Fetching errors chart now shows the cloud service these resources belong to. This will help to facilitate troubleshooting the integration setup.

Friday, November 30, 2018 - 00:00

Changes in curated dashboards

New Relic Infrastructure integrations will not automatically create new dashboards in New Relic Insights when an integration is enabled.

Instead, curated dashboards for On-host and Cloud integrations data will be embedded in the New Relic Infrastructure UI, and they can be reached from the following links:

  • On-host integrations:
    https://infrastructure.newrelic.com/accounts/<your_account_ID>/integrations/onHostIntegrations

  • AWS integrations:
    https://infrastructure.newrelic.com/accounts/<your_account_ID>/integrations/aws

  • Azure integrations:
    https://infrastructure.newrelic.com/accounts/<your_account_ID>/integrations/azure

  • GCP integrations:
    https://infrastructure.newrelic.com/accounts/<your_account_ID>/integrations/gcp

Please refer to the transition guide and the Infrastructure integration dashboards and charts documentation for more details about the new pre-built integration dashboards.

Note the existing curated dashboards that had been automatically created in New Relic Insights through the InfrastructurePro@newrelic.com user are still available. These dashboards won't be automatically updated anymore, but now you can edit and remove them. By default, they have the same name as the dashboard in New Relic Infrastructure, that takes this format:

  • For on-host integrations: <Integration name>

  • For cloud integrations: <Integration name> - <Linked account name>

Other changes

  • The former systemErrors metric in the AWS DynamoDB integration is now reported in several different metrics which represent the total number of requests that generate an HTTP 500 status per operation type. Please refer to AWS DynamoDB monitoring integration for details.

New

Friday, October 19, 2018 - 00:00

New

  • It's now possible to filter by tags in the Infrastructure default dashboards. In the filter, tag keys and values are grouped under the Labels category so they can be more easily found.

  • The AWS ALB integration now collects tags for ALB Target Groups that can be used in NQRL queries and dashboard filters. You can also fine-tune the data gathered with this integration by specifying the resource tag key and value you want to monitor with the new Filter by tag. Please refer to Configure polling frequency and data collection for cloud integrations for details.

  • The AWS API Gateway integration now collects tags for stages, resources and methods, which can be used in NQRL queries and dashboard filters.

  • The AWS Redis Cache integration now collects the OperationsPerSecond metric, which reports the number of commands processed per second by the cache server.

Changes

  • The threshold selector in Infrastructure Integrations Alerts now includes the metric unit, so it's much easier to configure the correct threshold value. It is available for RDS metrics, and shall be available in other services soon.
  • The BucketSizeBytes metric for AWS S3 buckets was returning only the size of Standard Storage objects contained in the bucket. Now the metric returns the aggregated size of all storage types. Note the BucketSizeBytes metric is included in the DatastoreSample event type with a provider value of S3Bucket.
Wednesday, September 5, 2018 - 10:00

New

  • The AWS EC2 integration now collects status check results in ComputeSample events: provider.statusCheckFailed, provider.statusCheckFailedInstance, and provider.statusCheckFailedSystem. These checks are performed by AWS EC2 periodically and help identify hardware and software issues on running EC2 instances. Check AWS EC2 integration for details.

  • The AWS VPC integration can now provide metrics for NAT Gateways and VPN Tunnels. To collect data about these entities, please enable the corresponding filter in the integration configuration. Check AWS VPC monitoring integration for a description of AWS VPC related events and entities, as well as their metrics and attributes.
  • The AWS ALB integration now collects tags for ALB Target Groups that can be used in NQRL queries and dashboard filters. You can also fine-tune the data gathered with this integration by specifying the resource tag key and value you want to monitor with the new Filter by tag. Check Configure polling frequency and data collection for cloud integrations for details.

Changes

  • If you had enabled the AWS VPC integration and you want to keep collecting NAT Gateway inventory data, please enable the filter under the integration settings. Take into account that New Relic will also start collecting NAT Gateway metrics from that moment on, and you might notice an increase in the number of calls to AWS CloudWatch.
  • The AWS S3 metric BucketSizeBytes has changed to reflect all storage types. Now, this metric includes the sum of the amount of data in bytes stored in a bucket including Standard Storage, Reduced Redundancy Storage, Infrequent Access Storage (IAS), One zone IAS, and Glacier Storage including overheads. As a result, you might see an increased total number of bytes for that metric.
Friday, July 20, 2018 - 00:00

New for Amazon Web Services monitoring

  • New Relic has optimized the way to fetch metrics from AWS Cloudwatch. This has resulted in a significant reduction in the number of calls to your AWS Cloudwatch service, as well as a reduction in data lag. The list of specific permissions that are required to fetch monitoring data from AWS services has been updated accordingly, with the additional cloudwatch:GetMetricData permission.
    Recommendation: Use a custom policy only when you are unable to use the ReadOnlyAccessmanaged policy from AWS. If you use a custom policy, be sure to check that the new permission is included.
  • AWS Redshift integration now provides four new metrics to monitor the performance of multi-node clusters: QueriesCompletedPerSecond, WLMQueriesCompletedPerSecond, QueryDuration, and WLMQueryDuration. Check AWS Redshift integration for details.
  • If you use AWS API Gateway, you can now fine-tune the data gathered for this service by specifying the stages you want to monitor with the new Filter by stage name prefixes. Check Configure polling frequency and data collection for cloud integrations for details.

New for Google Cloud Platform monitoring

  • Google Kubernetes Engine integration is now available. If you're using Kubernetes v1.10.2 or later, now you can get visibility into containers, nodes, and pods. This cloud integration is complementary to New Relic's Kubernetes on-host integration.
  • You can now link your GCP projects to New Relic using a service account. If you had already used a user account to link your projects, you can migrate to the new authorization type, though the UI. Check Connect Google Cloud Platform services to Infrastructure for details.

Changes in Google Cloud Platform integrations

  • The default dashboards for Google Cloud Platform integrations now include a filter by Project ID. This is very useful if you monitor more than one project from the same Google Stackdriver Monitor service.
Friday, July 6, 2018 - 00:00

New

  • If you're using Lambda@Edge to execute Lambda functions in AWS regions that are closer to your clients, you can get function execution location metadata by enabling the new Collect Lambda@Edge data filter in the AWS CloudFront integration.
  • The status of AWS VPC Network Interfaces and AWS VPC Peering Connections is now available, both as an inventory attribute (status) and as metrics metadata (provider.status).
  • The launch type of AWS ECS services is now available as an inventory attribute (launchType) and as metrics metadata (provider.launchType). It contains the type of infrastructure on which tasks and services are hosted (EC2 or FARGATE).

Changes

  • The default dashboard for AWS ELB has been updated: the previous chart named "Healthy vs. Unhealthy Hosts" has been replaced by a new chart named "ELBs with no healthy hosts", which shows more accurately the number of elastic load balancers that are not able to send traffic to any healthy target.
  • The default dashboard for AWS ALB has been updated: the previous chart named "Healthy vs. Unhealthy Hosts" has been replaced by a new chart named "Target Groups with no healthy hosts", which shows more accurately the number of target groups that don't have any healthy target host to send traffic to.
Wednesday, May 30, 2018 - 00:00

Tags and labels attribute renaming

In order to make it easier to find common attributes across different data providers in New Relic Infrastructure, tags and labels attribute names are going to be renamed as label.<name>, where <name> is:

  • The tag key for Amazon Web Services and Microsoft Azure integrations
  • The label key for Google Cloud Platform integrations

The previous attribute names will be deprecated on June 21, 2018.

If you are using tags or labels in alerts, custom dashboards, or saved queries for New Relic cloud integrations, be sure to rename them using the new format before June 21, 2018.

Azure integrations: Resource group attribute renaming

To make it easier to find common attributes across different cloud services, the resourceGroup attribute will be replaced by the resourceGroupName attribute on June 21, 2018. This affects Infrastructure integrations for:

  • Azure Virtual Machines
  • Azure Service Bus
  • Azure Virtual Networks

If you are using the resourceGroup attribute in alerts, custom dashboards, or saved queries for these Azure services, be sure to rename them using the new format before June 21, 2018.

Amazon Web Services S3 permissions

The list of specific permissions that are required to fetch monitoring data from AWS S3 service has been updated with the additional s3:GetMetricsConfiguration permission in integrations and managed policies.

Recommendation: Use a custom policy only when you are unable to use the ReadOnlyAccess managed policy from AWS. If you use a custom policy, be sure to check that the listed permissions are included.

Thursday, April 12, 2018 - 00:00

New

  • New Relic Infrastructure can now collect metrics and inventory data from Google Cloud Platform services. The first integrations available are Google Compute Engine, Storage, Functions and App Engine. This feature is in beta. For more information, see Introduction to Google Cloud Platform integrations.
Monday, April 9, 2018 - 00:00

New

Saturday, March 31, 2018 - 00:00

New Relic is now publishing release notes for Cloud Integrations. Stay up to date by subscribing to the RSS feed.

New

  • The AWS Lambda integration can now be monitored in these additional regions: South America (Sao Paulo/sa-east-1), Asia Pacific (Mumbai/ap-south-1), Canada (Central/ca-central-1) and EU (London/eu-west-2).

Changes