AWS Storage Gateway Monitoring

Overview

AWS Storage Gateway is a hybrid cloud storage service that connects your on-premises infrastructure with AWS cloud storage. It allows seamless and secure data transfer between your local environment and AWS storage services, providing virtually unlimited cloud storage for applications running both on-premises and in the cloud.

AWS Storage Gateway File Share enable on-premises and cloud applications to store and retrieve files as objects in Amazon S3. This service is ideal for file-based workloads that need scalable cloud storage. File Share provide:

Secure, scalable storage with seamless integration to Amazon S3
Support for NFS and SMB protocols for easy file access
Local caching for frequently accessed files to reduce latency

AWS Storage Gateway Volume provide block storage that on-premises applications can access using the iSCSI (Internet Small Computer System Interface) protocol. This service allows you to create storage Volume in AWS while maintaining local access for applications.

Cached Volume: Store data in AWS while caching frequently accessed data locally for low-latency access.
Stored Volume: Keep all data on-premises while asynchronously backing up snapshots to AWS.

These services together help organizations extend their on-premises storage capabilities into the cloud, improving scalability, reliability, and cost efficiency.

Creating a new AWS Storage Gateway monitor

To learn how to create a new AWS Storage Gateway monitor, refer here.

Monitored Parameters

Go to the Monitors Category View by clicking the Monitors tab. Click on the Storage Gateway/Storage Gateway File Share/Storage Gateway Volume instance available under Amazon in the Cloud Apps section. Displayed is the Amazon Route Health Checks bulk configuration view distributed into three tabs:

Availability tab gives the availability history for the past 24 hours or 30 days.
Performance tab gives the health status and events for the past 24 hours or 30 days.
List view tab enables you to perform bulk admin configurations.

Click on the monitor name to see all the Amazon Storage Gateway metrics listed under the following tabs:

Click on the monitor name to see all the Amazon Storage Gateway File Share metrics listed under the following tabs:

Click on the monitor name to see all the Amazon Storage Gateway Volume metrics listed under the following tabs:

Amazon Storage Gateway Metrics

Amazon Storage Gateway - Performance Overview

Parameter	Description
UTILIZATION IN %
User CPU Utilization	The percentage of CPU time spent on gateway processing, across all the cores at the time of polling (in %).
IO Wait Utilization	The percentage of time the gateway spent waiting for I/O operations to finish at the time of polling (in %).
Cache Utilization	The percentage of the gateway's cache in use at the time of polling (in %).
Cache Hit Percentage	The percentage of application read requests served from the cache at the time of polling (in %).
Dirty Cache	The average percentage of the gateway cache that has not been persisted to AWS at the time of polling (in %).
Upload Buffer Utilization	The average percentage of the upload buffer in use between the poll interval (in %).
Working Storage Utilization	The percentage of the gateway's working storage in use between the poll interval (in %).
MEMORY USAGE
Used Memory	The total amount of RAM currently in use by the gateway VM at the time of polling (in MB).
Free Memory	The total amount of RAM currently available on the gateway VM at the time of polling (in MB).
Total Memory	The total amount of RAM provisioned to the gateway VM at the time of polling (in MB).
CACHE USAGE
Cache Used	The average amount of data used in the gateway's cache storage at the time of polling (in MB).
Cache Free	The average amount of data available in the gateway's cache storage at the time of polling (in MB).
UPLOAD BUFFER USAGE
Upload Buffer Used	The average amount of upload buffer storage used between the poll interval (in MB).
Upload Buffer Free	The average amount of upload buffer storage available between the poll interval (in MB).
WORKING STORAGE USAGE
Working Storage Used	The total number of bytes used in the gateway's working storage between the poll interval (in MB).
Working Storage Free	The total amount of free space in the gateway's working storage between the poll interval (in MB).

Amazon Storage Gateway - Traffic

Parameter	Description
CLOUD TRAFFIC
Rate of Cloud Data Uploaded	The total amount of data uploaded per minute to AWS between the poll interval (in MB/min).
Total Cloud Data Uploaded	The total amount of data uploaded to AWS between the poll interval (in MB).
Rate of Cloud Data Downloaded	The total amount of data downloaded per minute from AWS between the poll interval (in MB/min).
Total Cloud Data Downloaded	The total amount of data downloaded from AWS between the poll interval (in MB).
CLIENT TRAFFIC
Rate of Data Read	The total amount of data read per second from your on-premises applications between the poll interval (in MB/s).
Total Data Read	The total amount of data read from your on-premises applications between the poll interval (in MB).
Rate of Data Written	The total amount of data written per second to your on-premises applications between the poll interval (in MB/s).
Total Data Written	The total amount of data written to your on-premises applications between the poll interval (in MB).
CLOUD IOPS
Read Operations	The total number of read operations per second from the on-premises applications between the poll interval (in operations/s).
Write Operations	The total number of write operations per second to the on-premises applications between the poll interval (in operations/s).
GATEWAY IO PERFORMANCE
Read Time	The average amount of time spent on read operations from your on-premises applications between the poll interval (in ms).
Write Time	The average amount of time spent on write operations to your on-premises applications between the poll interval (in ms).
QUEUED WRITES
Rate of Queued Writes	The average amount of data waiting to be written to AWS per minute between the poll interval (in MB/min).
Queued Writes	The average amount of data waiting to be written to AWS between the poll interval (in MB).
CLOUD DOWNLOAD LATENCY
Cloud Download Latency	The average latency while downloading bytes from the cloud at the time of polling (in ms).
TIME SINCE LAST RECOVERY POINT
Time Since Last Recovery Point	The total accumulated time since the last recovery point was created at the time of polling (in mins).
INDEX CACHE
Index Evictions	The average number of files whose metadata was evicted from the cached index of file metadata to make room for new entries between the poll interval.
Index Fetches	The average number of files for which metadata was fetched between the poll interval.

Amazon Storage Gateway - Configuration

Parameter	Description
CONFIGURATION
Gateway ID	The unique identifier assigned to your gateway during activation.
Gateway Type	The type of the gateway. Possible Values: FILE_S3, VOLUME, STORED, CACHED.
Gateway State	The current operational state of the gateway. Possible Values: RUNNING, OFFLINE, ONLINE, SHUTDOWN.
Gateway Capacity	Specifies the size of the gateway's metadata cache. Possible Values: Small, Medium, Large.
Gateway Timezone	A value that indicates the time zone configured for the gateway.
Host Environment	The type of hardware or software platform on which the gateway is running. Possible Values: VMWARE, HYPER-V, EC2, KVM, OTHER, SNOWBALL.
Host Environment ID	A unique identifier for the specific instance of the host platform running the gateway.
EC2 Instance ID	The ID of the Amazon EC2 instance that was used to launch the gateway.
Endpoint Type	The type of endpoint for your gateway. Possible Values: STANDARD, FIPS.
VPC Endpoint	The configuration settings for the virtual private cloud (VPC) endpoint for your gateway.
Log Group Name	The Amazon Resource Name (ARN) of the Amazon CloudWatch log group that is used to monitor events in the gateway.
Last Software Update	The date on which the last software update was applied to the gateway.
Next Update Availability	The number of days remaining for the next gateway update to be available (in days).

Amazon Storage Gateway File Share Metrics

Amazon Storage Gateway File Share - Performance Overview

Parameter	Description
CACHE UTILIZATION
Cache Utilization	The percentage of the gateway's cache storage used by the file share at the time of polling (in %).
Cache Hit Percentage	The percentage of read operations from the file share served from cache at the time of polling (in %).
Dirty Cache	The average percentage of the gateway's cache used by the file share that hasn't been persisted to AWS at the time of polling (in %).
CLOUD TRAFFIC
Rate of Cloud Data Uploaded	The total amount of data uploaded to cloud per minute by the file share between the poll interval (in MB/min).
Total Cloud Data Uploaded	The total amount of data uploaded to cloud by the file share between the poll interval (in MB).
Rate of Cloud Data Downloaded	The total amount of data downloaded from cloud per minute by the file share between the poll interval (in MB/min).
Total Cloud Data Downloaded	The total amount of data downloaded from cloud by the file share between the poll interval (in MB).
CLIENT TRAFFIC
Rate of Data Read	The total amount of data read by on-premises applications per second from the file share between the poll interval (in MB/s).
Total Data Read	The total amount of data read by on-premises applications from the file share between the poll interval (in MB).
Rate of Data Written	The total amount of data written by on-premises applications per second to the file share between the poll interval (in MB/s).
Total Data Written	The total amount of data written by on-premises applications to the file share between the poll interval (in MB).
FILE SHARE IOPS
Read Operations	The total number of read operations per second from the on-premises applications between the poll interval (in operations/s).
Write Operations	The total number of write operations per second to the on-premises applications between the poll interval (in operations/s).
FILES FAILING TO UPLOAD
Files Failing to Upload	The total number of files failing to upload to AWS between the poll interval.
INDEX FETCHES
Index Fetches	The average number of times the file share attempts to fetch data from its index between the poll interval.
S3 REQUEST TIME
Get Object Request Time	The average time taken to complete S3 GET object requests between the poll interval (in ms).
Put Object Request Time	The average time taken to complete S3 PUT object requests between the poll interval (in ms).
Put Upload Part Request Time	The average time taken to complete S3 PUT upload part object requests between the poll interval (in ms).

Amazon Storage Gateway File Share - Configuration

Parameter	Description
CONFIGURATION
File Share Name	The name of the file share.
File Share State	The status of the file share. Possible Values: CREATING, UPDATING, AVAILABLE, DELETING.
Gateway	The Amazon Resource Name (ARN) that uniquely identifies the attached storage gateway.
KMS Key	A symmetric customer master key (CMK) used for Amazon S3 server-side encryption.
STORAGE
Mount Path	The file share path used by the client to identify the mount point.
Bucket Region	Specifies the Region of the S3 bucket where the file share stores files.
Default Storage Class	Specifies the default storage class for objects uploaded to the S3 bucket by the S3 File Gateway. Possible Values: S3_STANDARD, S3_INTELLIGENT_TIERING, S3_STANDARD_IA, S3_ONEZONE_IA.
Guess MIME Type	Shows whether MIME type guessing is ENABLED or DISABLED.
USERS
Authentication	The authentication method of the file share. Possible Values: ActiveDirectory, GuestAccess.
File and Directory Access Control	Displays the permission control mode of the SMB file share. Possible Values: ACL MODE, POSIX MODE.
Object ACL	Displays the ACL permission for objects in the S3 bucket used by the S3 File Gateway. Possible Values: private, public-read, public-read-write, authenticated-read, bucket-owner-read, bucket-owner-full-control, aws-exec-read.
Requester Pays	Specifies who pays the request and data download costs from the S3 bucket. Possible Values: REQUESTER, BUCKET OWNER.
Squash	Specifies the user mapping to the anonymous user. Possible Values: RootSquash, NoSquash, AllSquash.
Number of Admins	The number of users or groups in the Active Directory that have administrator rights to the file share.
Number of Clients	The number of clients that are allowed to access the S3 File Gateway.
Number of Valid Users	The number of users or groups in the Active Directory that are allowed to access the file share.
Number of Invalid Users	The number of users or groups in the Active Directory that are not allowed to access the file share.

Amazon Storage Gateway Volume Metrics

Amazon Storage Gateway Volume - Performance Overview

Parameter	Description
STATUS DETAILS
Volume State	The current state of the volume. Possible Values: AVAILABLE, CREATING, BOOTSTRAPPING, UPLOAD BUFFER NOT CONFIGURED, PASS THROUGH, RESTORING, IRRECOVERABLE, DELETING.
Attachment Status	Indicates the current attachment state of a volume to a gateway. Possible Values: ATTACHED, DETACHED.
UTILIZATION IN %
User CPU Utilization	The percentage of allocated CPU compute units that are currently used by the volume at the time of polling (in %).
I/O Wait Consumption	The percentage of IoWaitPercent units utilized by the volume at the time of polling (in %).
Cache Utilization	The volume's contribution to the overall percent use of the gateway's cache storage at the time of polling (in %).
Cache Hit Percentage	The percentage of application read operations from the volume that are served from cache at the time of polling (in %).
Dirty Cache	The volume's contribution to the overall percentage of the gateway's cache that isn’t persisted to AWS at the time of polling (in %).
Volume Utilization	The percentage of the volume's total capacity that is currently in use at the time of polling (in %).
Memory Utilization	The percentage of memory that is currently used by the volume at the time of polling (in %).
VOLUME USAGE
Used Volume	The amount of data currently stored on the volume (in GB).
Available Volume	The amount of available storage space on the volume (in GB).
Total Volume	The total capacity of the volume (in GB).
CLOUD TRAFFIC
Rate of Cloud Data Uploaded	The amount of data uploaded per minute from the cloud to the volume between the poll interval (in MB/min).
Total Cloud Data Uploaded	The amount of data uploaded from the cloud to the volume between the poll interval (in MB).
Rate of Cloud Data Downloaded	The amount of data downloaded per minute from the cloud to the volume between the poll interval (in MB/min).
Total Cloud Data Downloaded	The amount of data downloaded from the cloud to the volume between the poll interval (in MB).
CLIENT TRAFFIC
Rate of Data Read	The total amount of data read per minute from the on-premises applications between the poll interval (in MB/s).
Data Read	The total amount of data read from the on-premises applications between the poll interval (in MB).
Rate of Data Written	The total amount of data written per minute to the on-premises applications between the poll interval (in MB/s).
Data Written	The total amount of data written to the on-premises applications between the poll interval (in MB).
VOLUME IOPS
Read Operations	The total number of read operations per second from the on-premises applications between the poll interval (in operations/s).
Write Operations	The total number of write operations per second to the on-premises applications between the poll interval (in operations/s).
LATENCY
Read Latency	The average number of milliseconds spent on read operations from the on-premises applications between the poll interval (in ms).
Write Latency	The average number of milliseconds spent on write operations from your on-premises applications between the poll interval (in ms).
QUEUED WRITES
Rate of Queued Writes	The total amount of data waiting to be written to AWS per minute, sampled between the poll interval (in MB/min).
Queued Writes	The average amount of data waiting to be written to AWS, sampled between the poll interval (in MB).
NOTIFICATIONS
Availability Notification	The average number of availability notifications sent by the volume between the poll interval.
Health Notification	The average number of health notifications sent by the volume between the poll interval.

Amazon Storage Gateway Volume - Configuration

Parameter	Description
CONFIGURATION
Target Name	The name of the iSCSI target used by an initiator to connect to a volume.
Creation Date	The date the volume was created.
Snapshot ID	If the stored volume was created from a snapshot, this field contains the ID of the snapshot used.
KMS Key	A symmetric customer master key (CMK) used for Amazon S3 server-side encryption.
Volume Progress	A value that indicates whether a storage volume is attached to, detached from, or is in the process of detaching from a gateway.
Chap Enabled	Indicates whether mutual CHAP is enabled for the iSCSI target.
Volume Disk ID	The disk ID of the local disk that was specified in the CreateStorediSCSIVolume operation.
Preserved Existing Data	Indicates if when the stored volume was created, existing data on the underlying local disk was preserved.