Microsoft Azure Storage Monitoring


Microsoft Azure Storage- An Overview

Azure Storage is a group of highly scalable cloud-based storage services available for applications running in Azure cloud. Azure Storage provides facilities for storing files (File storage), files and media (Blob storage), messages (Queue storage) and non-relational schema-less data (Table storage).

Creating a new Microsoft Azure Monitor 

Prerequisites:
Follow these steps to enable metrics in the Azure portal:

  • Navigate to your storage account.
  • Select Diagnostics on the Menu blade
  • Ensure that Status is set to On.
  • Select all the metrics provided.
  • Specify a retention policy to indicate how long to retain metrics and log data.
  • Select Save.

To create a new Azure Storage monitor, follow the steps given below:

  • Click on the New Monitor link in the Applications Manager web client.
  • Select 'Microsoft Azure' under Cloud Apps category.
  • Specify the Display Name of Microsoft Azure monitor.
  • Enter the Subscription ID for your Microsoft Azure subscription.
  • Click the Azure Services textbox and choose Storage Accounts from the drop-down menu.
  • Choose the Discovery mode:
    • Discovery using AD Application & Service Principal: Refer Prerequisites link and provide the Client ID, Tenant ID & Application key that were obtained in the above mentioned prerequisite step in the New monitor page.
    • Discovery using Azure Organizational Account (Powershell): Refer Prerequisites link and provide the User email & Password fields in New monitor page with the Username & Password of the created Organizational account.
    • Discovery using OAuth: Use the OAuth Provider that was obtained in the prerequisite step in the New monitor page. Refer Prerequisites section.
  • Specify the polling interval in minutes and timeout in seconds
Note:
  • Azure Storage Account Monitoring does not support ZRS Storage Accounts as they do not have metrics or logging capability enabled at this time.
  • Azure Premium Accounts are not supported for monitoring. Only Azure Standard Accounts with the exception of ZRS accounts are monitored for performance.
  • Blobs capacity metrics data is stored in Azure Diagnostics once per day.

Monitored Parameters

Go to the Monitors Category View by clicking the Monitors tab. Click on Microsoft Azure Storage under the Cloud Apps Table. Displayed is the Microsoft Azure Storage bulk configuration view distributed into three tabs:

  • Availability tab gives the Availability history for the past 24 hours or 30 days.
  • Performance tab gives the Health Status and events for the past 24 hours or 30 days.
  • List view enables you to perform bulk admin configurations.

Microsoft Azure monitor provides a brief detail of the Azure virtual machines under the given subscription. Click on the monitor name to see all the server details listed under the following tabs:

Overview

Parameter Description
Storage Services Availability
Blob Availability The percentage of availability for the Blob storage service. Availability is calculated by taking the TotalBillableRequest value and dividing it by the number of applicable requests, including those that produced unexpected errors. All unexpected errors result in reduced availability for the storage service or the specified API operation.
Table Availability The percentage of availability for the Table storage service.Availability is calculated by taking the TotalBillableRequests value and dividing it by the number of applicable requests, including those that produced unexpected errors. All unexpected errors result in reduced availability for the storage service or the specified API operation.
Queue Availability The percentage of availability for the Queue storage service . Availability is calculated by taking the TotalBillableRequests value and dividing it by the number of applicable requests, including those that produced unexpected errors. All unexpected errors result in reduced availability for the storage service or the specified API operation.
File Availability The percentage of availability for the File storage service .Availability is calculated by taking the TotalBillableRequests value and dividing it by the number of applicable requests, including those that produced unexpected errors. All unexpected errors result in reduced availability for the storage service or the specified API operation.

Configuration

Storage Account Name The Azure Storage Account Name
Primary Status Status of Storage Account.Possible Values:
  • Available
  • Unavailable
Secondary Status Status of the Replica of Storage Account.Possible Values:
  • Available
  • Unavailable
This attribute is available only if the Replication Type is Standard_RAGRS or Standard_GRS.
Resource Group Resource Group where the Storage Account is allocated in.
Location Region where the storage account is provisioned
Provisioning State Provisioning state of Storage AccountPossible values :
  • Invalid
  • Creating
  • Deleting
  • Succeeded
  • Failed
  • Cancelled
Replication Type The replication type used by the Storage account:Possible values:
  • Standard_LRS
  • Standard_GRS
  • Standard_RAGRS
  • Standard_ZRS
  • Premium_LRS


Blobs

Parameter Description
Capacity
Blobs User Data Size The amount of storage used by the storage account’s Blob service, in MB
Container Count The number of blob containers in the storage account’s Blob service.
Blob Object Count The number of blob containers in the storage account’s Blob service.
Blobs Capacity Data Collected Time The time at which blobs capacity metrics data was stored in Azure Diagnostics.
Throughput
Blobs Total Ingress The amount of ingress data, in MB. This number includes ingress from an external client into Azure Storage as well as ingress within Azure.
Blobs Total Egress The amount of egress data, in MB. This number includes egress to an external client from Azure Storage as well as egress within Azure. As a result, this number does not reflect billable egress.
Blobs Total Requests The number of requests made to Blobs storage service or the specified API operation. This number includes successful and failed requests, as well as requests which produced errors.
Blobs Total Billable Requests The number of billable requests to Blobs
Blobs Data Collected Time The time at which blobs performance metrics data was stored in Azure Diagnostics.
Latency
Blobs Average End-To-End Latency The average end-to-end latency of successful requests made to Blobs or the specified API operation, in milliseconds. This value includes the required processing time within Azure Storage to read the request, send the response, and receive acknowledgment of the response.
Blobs Average Server Latency The average latency used by Azure Storage to process a successful request, in milliseconds. This value does not include the network latency specified in AverageE2ELatency.
Requests Failed- Throttling Errors
Blobs Throttling Errors The number of authenticated requests to Blob storage service or the specified API operation that returned a ThrottlingError.
Blobs Anonymous Throttling Errors The number of anonymous requests to Blob storage service or the specified API operation that returned an AnonymousThrottlingError.
Blobs SAS Throttling Errors The number of SAS requests to Blob storage service or the specified API operation that returned a SASThrottlingError.
Blobs Throttling Error Percentage The percentage of requests that failed with a throttling error.
Requests Failed – Timeout Errors
Blobs Client Timeout Errors The number of authenticated requests to Blob storage service or the specified API operation that returned a ClientTimeoutError.
Blobs Anonymous Client Timeout Errors The number of anonymous requests to Blob storage service or the specified API operation that returned an AnonymousClientTimeoutError.
Blobs SAS Client Timeout Errors The number of SAS requests to Blob storage service or the specified API operation that returned an SASClientTimeoutError.
Blobs Server Timeout Errors The number of authenticated requests to Blob storage service or the specified API operation that returned a ServerTimeoutError.
Blobs Anonymous Server Timeout Errors The number of anonymous requests to Blob storage service or the specified API operation that returned an AnonymousServerTimeoutError.
Blobs SAS Server Timeout Errors The number of SAS requests to Blob storage service or the specified API operation that returned an SASServerTimeoutError.
Blobs Percent Timeout Errors The percentage of requests that failed with a timeout error. This number includes both client and server timeouts.
Requests Failed – Other Client Errors
Blobs Client Other Errors The number of authenticated requests to a storage service or the specified API operation that returned a ClientOtherError.
Blobs SAS Client Other Errors The number of SAS requests to a storage service or the specified API operation that returned an SASClientOtherError.
Blobs Anonymous Client Other Errors The number of anonymous requests to a storage service or the specified API operation that returned an AnonymousClientOtherError.
Blobs Client Other Error Percentage The percentage of requests that failed with a ClientOtherError.
Requests Failed – Other Server Errors
Blobs Server Other Errors The number of authenticated requests to Blob storage service or the specified API operation that returned a ServerOtherError.
Blobs Anonymous Server Other Errors The number of anonymous requests to Blob storage service or the specified API operation that returned an AnonymousServerOtherError.
Blobs SAS Server Other Errors The number of SAS requests to Blob storage service or the specified API operation that returned an SASServerOtherError.
Blobs Server Other Error Percentage The percentage of requests that failed with a ServerOtherError.
Requests Failed – Authorization Errors
Blobs Authorization Errors The number of authenticated requests to Blob storage service or the specified API operation that returned an AuthorizationError.
Blobs Anonymous Authorization Errors The number of anonymous requests to Blob storage service or the specified API operation that returned an AnonymousAuthorizationError.
Blobs SAS Authorization Errors The number of SAS requests to Blob storage service or the specified API operation that returned an SASAuthorizationError.
Blobs Authorization Errors Percentage The percentage of requests that failed with an AuthorizationError.
Requests Failed – Network Errors
Blobs Network Errors The number of authenticated requests to Blob storage service or the specified API operation that returned a NetworkError.
Blobs Anonymous Network Errors The number of anonymous requests to Blob storage service or the specified API operation that returned an AnonymousNetworkError .
Blobs SAS Network Errors The number of SAS requests to Blob storage service or the specified API operation that returned a SASNetworkError.
Blobs Network Errors Percentage The percentage of requests that failed with a NetworkError.
Successful Requests
Successful Requests to Blobs The number of successful requests made to a storage service or the specified API operation.
Blobs Anonymous Successful Requests The number of successful anonymous requests made to a storage service or the specified API operation.
Blobs SAS Successful Requests The number of successful Shared Access Signature (SAS) requests made to a storage service or the specified API operation.
Blobs Successful Requests Percentage The percentage of successful requests.
Note: that if there are no requests made against storage, the value of the PercentSuccess metric will be zero. If you are monitoring PercentSuccess, you will also want to ensure that the value of the TotalRequests metric is greater than zero.


Tables

Parameter Description
Throughput
Tables Total Ingress The amount of ingress data, in MB. This number includes ingress from an external client into Azure Storage as well as ingress within Azure.
Tables Total Egress The amount of egress data, in MB. This number includes egress to an external client from Azure Storage as well as egress within Azure. As a result, this number does not reflect billable egress.
Tables Total Requests The number of requests made to Table storage service or the specified API operation. This number includes successful and failed requests, as well as requests which produced errors.
Tables Total Billable Requests The number of billable requests to Tables
Tables Data Collected Time The time at which tables performance metrics data was stored in Azure Diagnostics.
Latency
Tables Average End-To-End Latency The average end-to-end latency of successful requests made to Tables or the specified API operation, in milliseconds. This value includes the required processing time within Azure Storage to read the request, send the response, and receive acknowledgment of the response.
Tables Average Server Latency The average latency used by Azure Storage to process a successful request, in milliseconds. This value does not include the network latency specified in AverageE2ELatency.
Requests Failed- Throttling Errors
Tables Throttling Errors The number of authenticated requests to Table storage service or the specified API operation that returned a ThrottlingError.
Tables Anonymous Throttling Errors The number of anonymous requests to Table storage service or the specified API operation that returned an AnonymousThrottlingError.
Tables SAS Throttling Errors The number of SAS requests to Table storage service or the specified API operation that returned a SASThrottlingError.
Tables Throttling Error Percentage The percentage of requests that failed with a throttling error.
Requests Failed – Timeout Errors  
Tables Client Timeout Errors The number of authenticated requests to Table storage service or the specified API operation that returned a ClientTimeoutError.
Tables Anonymous Client Timeout Errors The number of anonymous requests to Table storage service or the specified API operation that returned an AnonymousClientTimeoutError.
Tables SAS Client Timeout Errors The number of SAS requests to Table storage service or the specified API operation that returned an SASClientTimeoutError.
Tables Server Timeout Errors The number of authenticated requests to Table storage service or the specified API operation that returned a ServerTimeoutError.
Tables Anonymous Server Timeout Errors The number of anonymous requests to Table storage service or the specified API operation that returned an AnonymousServerTimeoutError.
Tables SAS Server Timeout Errors The number of SAS requests to Table storage service or the specified API operation that returned an SASServerTimeoutError.
Tables Percent Timeout Errors The percentage of requests that failed with a timeout error. This number includes both client and server timeouts.
Requests Failed – Other Client Errors
Tables Client Other Errors The number of authenticated requests to Table storage service or the specified API operation that returned a ClientOtherError.
Tables SAS Client Other Errors The number of SAS requests to Table storage service or the specified API operation that returned an SASClientOtherError.
Tables Anonymous Client Other Errors The number of anonymous requests to Table storage service or the specified API operation that returned an AnonymousClientOtherError.
Tables Client Other Error Percentage The percentage of requests that failed with a ClientOtherError.
Requests Failed – Other Server Errors
Tables Server Other Errors The number of authenticated requests to Table storage service or the specified API operation that returned a ServerOtherError.
Tables Anonymous Server Other Errors The number of anonymous requests to Table storage service or the specified API operation that returned an AnonymousServerOtherError.
Tables SAS Server Other Errors The number of SAS requests to Table storage service or the specified API operation that returned an SASServerOtherError.
Tables Server Other Error Percentage The percentage of requests that failed with a ServerOtherError.
Requests Failed – Authorization Errors
Tables Authorization Errors The number of authenticated requests to Table storage service or the specified API operation that returned an AuthorizationError.
Tables Anonymous Authorization Errors The number of anonymous requests to Table storage service or the specified API operation that returned an AnonymousAuthorizationError.
Tables SAS Authorization Errors The number of SAS requests to Table storage service or the specified API operation that returned an SASAuthorizationError.
Tables Authorization Errors Percentage The percentage of requests that failed with an AuthorizationError.
Requests Failed – Network Errors
Tables Network Errors The number of authenticated requests to Table storage service or the specified API operation that returned a NetworkError.
Tables Anonymous Network Errors The number of anonymous requests to Table storage service or the specified API operation that returned an AnonymousNetworkError .
Tables SAS Network Errors The number of SAS requests to Table storage service or the specified API operation that returned a SASNetworkError.
Tables Network Errors Percentage The percentage of requests that failed with a NetworkError.
Successful Requests
Tables Requests to Blobs The number of successful requests made to Table storage service or the specified API operation.
Tables Anonymous Successful Requests The number of successful anonymous requests made to Table storage service or the specified API operation.
Tables SAS Successful Requests The number of successful Shared Access Signature (SAS) requests made to Table storage service or the specified API operation.
Tables Successful Requests Percentage The percentage of successful requests.
Note that if there are no requests made against storage, the value of the PercentSuccess metric will be zero. If you are monitoring PercentSuccess, you will also want to ensure that the value of the TotalRequests metric is greater than zero.


Files

Parameter Description
Throughput
Files Total Ingress The amount of ingress data, in MB. This number includes ingress from an external client into Azure Storage as well as ingress within Azure.
Files Total Egress The amount of egress data, in MB. This number includes egress to an external client from Azure Storage as well as egress within Azure. As a result, this number does not reflect billable egress.
Files Total Requests The number of requests made to File storage service or the specified API operation. This number includes successful and failed requests, as well as requests which produced errors.
Files Total Billable Requests The number of billable requests to Files
Files Data Collected Time The time at which files performance metrics data was stored in Azure Diagnostics.
Latency
Files Average End-To-End Latency The average end-to-end latency of successful requests made to File Storage Service or the specified API operation, in milliseconds. This value includes the required processing time within Azure Storage to read the request, send the response, and receive acknowledgment of the response.
Files Average Server Latency The average latency used by Azure Storage to process a successful request, in milliseconds. This value does not include the network latency specified in AverageE2ELatency.
Requests Failed- Throttling Errors
Files Throttling Errors The number of authenticated requests to File storage service or the specified API operation that returned a ThrottlingError.
Files Anonymous Throttling Errors The number of anonymous requests to File storage service or the specified API operation that returned an AnonymousThrottlingError.
Files SAS Throttling Errors The number of SAS requests to File storage service or the specified API operation that returned a SASThrottlingError.
Files Throttling Error Percentage The percentage of requests that failed with a throttling error.
Requests Failed – Timeout Errors
Files Client Timeout Errors The number of authenticated requests to File storage service or the specified API operation that returned a ClientTimeoutError.
Files Anonymous Client Timeout Errors The number of anonymous requests to File storage service or the specified API operation that returned an AnonymousClientTimeoutError.
Files SAS Client Timeout Errors The number of SAS requests to File storage service or the specified API operation that returned an SASClientTimeoutError.
Files Server Timeout Errors The number of authenticated requests to File storage service or the specified API operation that returned a ServerTimeoutError.
Files Anonymous Server Timeout Errors The number of anonymous requests to File storage service or the specified API operation that returned an AnonymousServerTimeoutError.
Files SAS Server Timeout Errors The number of SAS requests to File storage service or the specified API operation that returned an SASServerTimeoutError.
Files Percent Timeout Errors The percentage of requests that failed with a timeout error. This number includes both client and server timeouts.
Requests Failed – Other Client Errors
Files Client Other Errors The number of authenticated requests to File storage service or the specified API operation that returned a ClientOtherError.
Files SAS Client Other Errors The number of SAS requests to File storage service or the specified API operation that returned an SASClientOtherError.
Files Anonymous Client Other Errors The number of anonymous requests to File storage service or the specified API operation that returned an AnonymousClientOtherError.
Files Client Other Error Percentage The percentage of requests that failed with a ClientOtherError.
Requests Failed – Other Server Errors
Files Server Other Errors The number of authenticated requests to File storage service or the specified API operation that returned a ServerOtherError.
Files Anonymous Server Other Errors The number of anonymous requests to File storage service or the specified API operation that returned an AnonymousServerOtherError.
Files SAS Server Other Errors The number of SAS requests to File storage service or the specified API operation that returned an SASServerOtherError.
Files Server Other Error Percentage The percentage of requests that failed with a ServerOtherError.
Requests Failed – Authorization Errors
Files Authorization Errors The number of authenticated requests to File storage service or the specified API operation that returned an AuthorizationError.
Files Anonymous Authorization Errors The number of anonymous requests to File storage service or the specified API operation that returned an AnonymousAuthorizationError.
Files SAS Authorization Errors The number of SAS requests to File storage service or the specified API operation that returned an SASAuthorizationError.
Files Authorization Errors Percentage The percentage of requests that failed with an AuthorizationError.
Requests Failed – Network Errors
Files Network Errors The number of authenticated requests to File storage service or the specified API operation that returned a NetworkError.
Files Anonymous Network Errors The number of anonymous requests to File storage service or the specified API operation that returned an AnonymousNetworkError .
Files SAS Network Errors The number of SAS requests to File storage service or the specified API operation that returned a SASNetworkError.
Files Network Errors Percentage The percentage of requests that failed with a NetworkError.
Successful Requests
Files Requests to Blobs The number of successful requests made to File storage service or the specified API operation.
Files Anonymous Successful Requests The number of successful anonymous requests made to File storage service or the specified API operation.
Files SAS Successful Requests The number of successful Shared Access Signature (SAS) requests made to File storage service or the specified API operation.
Files Successful Requests Percentage The percentage of successful requests.
Note that if there are no requests made against storage, the value of the PercentSuccess metric will be zero. If you are monitoring PercentSuccess, you will also want to ensure that the value of the TotalRequests metric is greater than zero.


Queues

Parameter Description
Throughput
Queues Total Ingress The amount of ingress data, in MB. This number includes ingress from an external client into Azure Storage as well as ingress within Azure.
Queues Total Egress The amount of egress data, in MB. This number includes egress to an external client from Azure Storage as well as egress within Azure. As a result, this number does not reflect billable egress.
Queues Total Requests The number of requests made to Queue storage service or the specified API operation. This number includes successful and failed requests, as well as requests which produced errors.
Queues Total Billable Requests The number of billable requests to Queues
Queues Data Collected Time The time at which queues performance metrics data was stored in Azure Diagnostics.
Latency
Queues Average End-To-End Latency The average end-to-end latency of successful requests made to Queue or the specified API operation, in milliseconds. This value includes the required processing time within Azure Storage to read the request, send the response, and receive acknowledgment of the response.
Queues Average Server Latency The average latency used by Azure Storage to process a successful request, in milliseconds. This value does not include the network latency specified in AverageE2ELatency.
Requests Failed- Throttling Errors
Queues Throttling Errors The number of authenticated requests to Queue storage service or the specified API operation that returned a ThrottlingError.
Queues Anonymous Throttling Errors The number of anonymous requests to Queue storage service or the specified API operation that returned an AnonymousThrottlingError.
Queues SAS Throttling Errors The number of SAS requests to Queue storage service or the specified API operation that returned a SASThrottlingError.
Queues Throttling Error Percentage The percentage of requests that failed with a throttling error.
Requests Failed – Timeout Errors
Queues Client Timeout Errors The number of authenticated requests to Queue storage service or the specified API operation that returned a ClientTimeoutError.
Queues Anonymous Client Timeout Errors The number of anonymous requests to Queue storage service or the specified API operation that returned an AnonymousClientTimeoutError.
Queues SAS Client Timeout Errors The number of SAS requests to Queue storage service or the specified API operation that returned an SASClientTimeoutError.
Queues Server Timeout Errors The number of authenticated requests to Queue storage service or the specified API operation that returned a ServerTimeoutError.
Queues Anonymous Server Timeout Errors The number of anonymous requests to Queue storage service or the specified API operation that returned an AnonymousServerTimeoutError.
Queues SAS Server Timeout Errors The number of SAS requests to Queue storage service or the specified API operation that returned an SASServerTimeoutError.
Queues Percent Timeout Errors The percentage of requests that failed with a timeout error. This number includes both client and server timeouts.
Requests Failed – Other Client Errors
Queues Client Other Errors The number of authenticated requests to Queue storage service or the specified API operation that returned a ClientOtherError.
Queues SAS Client Other Errors The number of SAS requests to Queue storage service or the specified API operation that returned an SASClientOtherError.
Queues Anonymous Client Other Errors The number of anonymous requests to Queue storage service or the specified API operation that returned an AnonymousClientOtherError.
Queues Client Other Error Percentage The percentage of requests that failed with a ClientOtherError.
Requests Failed – Other Server Errors
Queues Server Other Errors The number of authenticated requests to Queue storage service or the specified API operation that returned a ServerOtherError.
Queues Anonymous Server Other Errors The number of anonymous requests to Queue storage service or the specified API operation that returned an AnonymousServerOtherError.
Queues SAS Server Other Errors The number of SAS requests to Queue storage service or the specified API operation that returned an SASServerOtherError.
Queues Server Other Error Percentage The percentage of requests that failed with a ServerOtherError.
Requests Failed – Authorization Errors
Queues Authorization Errors The number of authenticated requests to Queue storage service or the specified API operation that returned an AuthorizationError.
Queues Anonymous Authorization Errors The number of anonymous requests to Queue storage service or the specified API operation that returned an AnonymousAuthorizationError.
Queues SAS Authorization Errors The number of SAS requests to Queue storage service or the specified API operation that returned an SASAuthorizationError.
Queues Authorization Errors Percentage The percentage of requests that failed with an AuthorizationError.
Requests Failed – Network Errors
Queues Network Errors The number of authenticated requests to Queue storage service or the specified API operation that returned a NetworkError.
Queues Anonymous Network Errors The number of anonymous requests to Queue storage service or the specified API operation that returned an AnonymousNetworkError .
Queues SAS Network Errors The number of SAS requests to Queue storage service or the specified API operation that returned a SASNetworkError.
Queues Network Errors Percentage The percentage of requests that failed with a NetworkError.
Successful Requests
Queues Requests to Blobs The number of successful requests made to Queue storage service or the specified API operation.
Queues Anonymous Successful Requests The number of successful anonymous requests made to Queue storage service or the specified API operation.
Queues SAS Successful Requests The number of successful Shared Access Signature (SAS) requests made to Queue storage service or the specified API operation.
Queues Successful Requests Percentage The percentage of successful requests.
Note that if there are no requests made against storage, the value of the PercentSuccess metric will be zero. If you are monitoring PercentSuccess, you will also want to ensure that the value of the TotalRequests metric is greater than zero.