Amazon DynamoDB Monitoring

Amazon DynamoDB - An Overview

Amazon DynamoDB, a part of the Amazon Web Services portfolio, is a non-relational database that delivers reliable performance at any scale. It is a fully managed, proprietary NoSQL database service that supports key-value and document data structures, offers built-in security, backup and restore, and in-memory caching.

Monitoring Amazon DynamoDB - What We do

With Applications Manager, you can auto-discover your DynamoDB tables, gather data for performance metrics like latency, request throughput and throttling errors. Optimize resource usage and improve application performance of your Amazon Dynamodb database.

Analyze database performance - Track Request Latency, get Successful request latency reports for various read/write operations like GET, PUT, Scan, etc. Gather key usage stats like the count of returned records and bytes from GetRecords operations (Amazon DynamoDB Streams) during specified periods.
Optimize Resource usage - Make informed decisions about setting up DynamoDB Provisioned Throughput capacity. Monitor the consumed read/write capacity units to prevent throttling errors to and be up-to-date on request rates, application throughput pattern and table activity.
Troubleshoot request throttling - Monitor Throttled requests and Throttled read/write events. Reserve capacity so the provisioned throughput does not get exhausted and you can handle sudden increases in traffic, without returning throttling errors.
Handle DB errors and exceptions - Identify performance anomalies by getting a dashboard view of the break-down of System Errors and User Errors.
Gain insight into DB operations performed - Track the number of conditional write attempts to a table that failed. Monitor the number of items returned by database scan and query operations.
Get instant notifications of performance issues and bottlenecks. Take quick remedial action before your end-users experience issues.

Creating a new Amazon DynamoDB monitor

To learn how to create a new Amazon DynamoDB monitor, refer here.

Enabling Data collection for DynamoDB Account metrics

Data collection for DynamoDB Account metrics is disabled by default. To enable them, follow the below given steps:

Go to the Settings tab.
Click Performance Polling under Discovery and Data Collection.
Under Performance Data Collection, Click on the Optimize Data Collection tab.
Select DynamoDB from the Monitor Type drop-down menu.
Select the required metrics from the Metric Name drop-down menu.
Enable data collection at every poll or configure custom time intervals. (24 hours is the preferred time interval for AWS DynamoDB Account metrics as to reduce the API count).
Select how you wish to configure the mertics:
- By Monitor Type - This will be the default polling status, for any new monitor added. All the monitors of this type, will have the default polling status, until any exclusive customization is done for the monitor. You can choose between three different polling settings: Never collect data, Collect data in every polling and Collect data at customized time interval. Changing the polling status of 'Monitor Type', will also change any configuration done for its 'Monitors'. You can use the options Collect data in every polling or Collect data at customized time interval to change the polling interval.
- By Monitors - Use this option to change the polling status of any particular monitor(s).
Click Save.

Monitored Parameters

Go to the Monitors Category View by clicking the Monitors tab. Click on DynamoDB from Amazon Instances category under the Cloud Apps section. Displayed is the DynamoDB bulk configuration view distributed into three tabs:

Availability tab gives the Availability history for the past 24 hours or 30 days.
Performance tab gives the Health Status and events for the past 24 hours or 30 days.
List view enables you to perform bulk admin configurations.

Click on the monitor name to see all the Amazon DynamoDB database metrics listed under the following tabs:

Overview

Parameter	Description
READ CAPACITY UNITS
Provisioned Read - Average	The average number of read capacity units provisioned for the table or index.
Provisioned Read - Minimum	The lowest provisioned read capacity setting during the selected time period.
Provisioned Read - Maximum	The highest provisioned read capacity setting during the selected time period.
Consumed Read - Average	The average number of read capacity units consumed per request.
Consumed Read - Minimum	The minimum number of read capacity units consumed by any individual request.
Consumed Read - Maximum	The maximum number of read capacity units consumed by any individual request.
WRITE CAPACITY UNITS
Provisioned Write - Average	The average number of write capacity units provisioned for the table or index.
Provisioned Write - Minimum	The lowest provisioned write capacity setting during the selected time period.
Provisioned Write - Maximum	The highest provisioned write capacity setting during the selected time period.
Consumed Write - Average	The average number of write capacity units consumed per request.
Consumed Write - Minimum	The minimum number of write capacity units consumed by any individual request.
Consumed Write - Maximum	The maximum number of write capacity units consumed by any individual request.
READ THROTTLED REQUESTS
Get Throttled Requests	The number of GetItem requests that were throttled due to insufficient read capacity.
Scan Throttled Requests	The number of Scan requests that were throttled due to exceeding read capacity limits.
Query Throttled Requests	The number of Query requests that were throttled due to insufficient read capacity.
BatchGet Throttled Requests	The number of BatchGetItem requests that were throttled.
WRITE THROTTLED REQUESTS
Put Throttled Requests	The number of PutItem requests that were throttled due to insufficient write capacity.
Update Throttled Requests	The number of UpdateItem requests that were throttled due to exceeding write capacity.
Delete Throttled Requests	The number of DeleteItem requests that were throttled.
BatchWrite Throttled Requests	The number of BatchWriteItem requests that were throttled.
READ THROTTLED EVENTS
Table Read Throttled Events	The number of read throttling events on the table. A throttled event occurs when any part of a request or batch operation is throttled due to insufficient read capacity.
WRITE THROTTLED EVENTS
Table Write Throttled Events	The number of write throttling events on the table. A throttled event occurs when any part of a request or batch write operation is throttled due to insufficient write capacity.

Read Operations

Parameter	Description
READ LATENCY
Get Latency — Average	Average successful request latency for Get operations during the specified time period (in ms).
BatchGet Latency — Average	Average successful request latency for BatchGet operations during the specified time period (in ms).
Scan Latency — Average	Average successful request latency for Scan operations during the specified time period (in ms).
Query Latency — Average	Average successful request latency for Query operations during the specified time period (in ms).
GET LATENCY
Get Latency — (Average / Minimum / Maximum)	The elapsed time for successful Get requests to DynamoDB during the specified time period (reported as Minimum, Maximum, or Average latency) (in ms).
BATCHGET LATENCY
BatchGet Latency — (Average / Minimum / Maximum)	The elapsed time for successful BatchGet requests to DynamoDB during the specified time period (reported as Minimum, Maximum, or Average latency) (in ms).
SCAN LATENCY
Scan Latency — (Average / Minimum / Maximum)	The elapsed time for successful Scan requests to DynamoDB during the specified time period (reported as Minimum, Maximum, or Average latency) (in ms).
QUERY LATENCY
Query Latency — (Average / Minimum / Maximum)	The elapsed time for successful Query requests to DynamoDB during the specified time period (reported as Minimum, Maximum, or Average latency) (in ms).
RETURNED ITEM COUNT
Scan Returned Item Count	The number of items returned by Scan operations during the specified time period.
Query Returned Item Count	The number of items returned by Query operations during the specified time period.

Write Operations

Parameter	Description
WRITE LATENCY
Put Latency - Average	The average successful request latency for Put operations during the specified time period (in ms).
BatchWrite Latency - Average	The average successful request latency for BatchWrite operations during the specified time period (in ms).
Update Latency - Average	The average successful request latency for Update operations during the specified time period (in ms).
Delete Latency - Average	The average successful request latency for Delete operations during the specified time period (in ms).
PUT LATENCY
Put Latency - (Average/ Minimum/ Maximum)	The elapsed time for successful DynamoDB Put requests during the specified time period (in ms), shown as Minimum, Maximum, or Average.
BATCHWRITE LATENCY
BatchWrite Latency - (Average/ Minimum/ Maximum)	The elapsed time for successful DynamoDB BatchWrite requests during the specified time period (in ms), shown as Minimum, Maximum, or Average.
UPDATE LATENCY
Update Latency - (Average/ Minimum/ Maximum)	The elapsed time for successful DynamoDB Update requests during the specified time period (in ms), shown as Minimum, Maximum, or Average.
DELETE LATENCY
Delete Latency - (Average/ Minimum/ Maximum)	The elapsed time for successful DynamoDB Delete requests during the specified time period (in ms), shown as Minimum, Maximum, or Average.

Table Errors

Parameter	Description
USER ERRORS
User Errors	Requests to DynamoDB or Amazon DynamoDB Streams that return an HTTP 400 status code during the specified time period.
SYSTEM ERRORS
System Errors	Requests to DynamoDB or Amazon DynamoDB Streams that return an HTTP 500 status code during the specified time period.
CONDITIONAL CHECK FAILED REQUESTS
Conditional Check Failed Requests	The number of requests that failed due to conditional write checks not being satisfied.
TIME TO LIVE (TTL) DELETED ITEM COUNT
Time To Live Deleted Item Count	The number of items deleted automatically by DynamoDB Time To Live (TTL) during the specified time period.

Global Secondary Index

Parameter	Description
GSI READ CAPACITY UNITS
GSI Provisioned Read CU	The provisioned read capacity units for the Global Secondary Index (GSI) during the poll interval.
Provisioned Read	The provisioned read capacity units for the GSI during the poll interval.
Consumed Read	The consumed read capacity units for the GSI during the poll interval.
GSI WRITE CAPACITY UNITS
GSI Provisioned Write CU	The provisioned write capacity units for the Global Secondary Index (GSI) during the poll interval.
Provisioned Write	The provisioned write capacity units for the GSI during the poll interval.
Consumed Write	The consumed write capacity units for the GSI during the poll interval.
GSI CAPACITY UNITS
GSI Name	The name of the Global Secondary Index (GSI) in DynamoDB.
Provisioned Read	The provisioned read capacity units for the GSI during the poll interval.
Consumed Read	The consumed read capacity units for the GSI during the poll interval.
Provisioned Write	The provisioned write capacity units for the GSI during the poll interval.
Consumed Write	The consumed write capacity units for the GSI during the poll interval.
GSI READ THROTTLED EVENTS
Read Throttled Events	The number of read operations throttled due to exceeding the provisioned read capacity of the GSI during the poll interval.
GSI WRITE THROTTLED EVENTS
Write Throttled Events	The number of write operations throttled due to exceeding the provisioned write capacity of the GSI during the poll interval.
GSI THROTTLED EVENTS
GSI Name	The name of the Global Secondary Index (GSI) in DynamoDB.
GSI Read Throttled Events	The number of throttled read requests that exceeded the provisioned read capacity units for the GSI.
GSI Write Throttled Events	The number of throttled write requests that exceeded the provisioned write capacity units for the GSI.
ONLINE INDEX CONSUMED WRITE CAPACITY
APM Index	The write capacity units consumed by the Global Secondary Index used for collecting Applications Manager—specific metrics.
Cloud Index	The write capacity units consumed by the Global Secondary Index used for querying cloud resource—related data.
ONLINE INDEX THROTTLE EVENTS
APM Index	The number of throttle events observed in the GSI used for Applications Manager—specific metrics.
Cloud Index	The number of throttle events observed in the GSI used for cloud resource—related queries.
GSI INDEX CREATION
GSI Name	The name of the Global Secondary Index (GSI) in DynamoDB.
Online Index Consumed Write Capacity	The write capacity units consumed while adding a new GSI to the table.
Online Index Percentage Progress	The percentage of completion for creating a new GSI.
Online Index Throttle Events	The number of write throttle events that occur during the creation of a new GSI.
CONFIGURATION
Index Name	The name of the Global Secondary Index (GSI) in DynamoDB.
Status	The current status of the index.
Item Count	The total number of items in the index.
Size (MB)	The storage size of the index in megabytes.
Partition Key	The partition (hash) key attribute of the index.
Sort Key	The sort (range) key attribute of the index.
Projection Type	The set of attributes projected into the index.

Streams

Parameter	Description
REQUEST LATENCY
GetRecords Request Latency	The time taken to successfully complete GetRecords requests during the specified period (in ms).
RETURNED BYTES
Average Returned Bytes	The average number of bytes returned by GetRecords operations during the specified time period (in MB).
Total Returned Bytes	The total number of bytes returned by GetRecords operations during the specified time period (in MB).
RETURNED RECORDS COUNT
Returned Records Count	The number of stream records returned by GetRecords operations during the specified time period.
STREAM CONFIGURATION
Stream Label	The timestamp when the DynamoDB stream was enabled, in ISO 8601 format.
Stream Status	Indicates whether DynamoDB Streams is enabled (true) or disabled (false) for the table.
Stream View Type	Specifies the type of data captured in the stream (e.g., KEYS_ONLY, NEW_IMAGE, OLD_IMAGE, NEW_AND_OLD_IMAGES).
Stream ARN	The Amazon Resource Name (ARN) that uniquely identifies the latest stream for this table.

Configuration

Parameter	Description
CONFIGURATION
Table Name	The name of the DynamoDB table.
Region	The AWS region ID where the current DynamoDB table resides.
Region Name	The name of the AWS region where the current DynamoDB table resides.
Total Provisioned Read CU	The total provisioned read capacity units for the table and all its Global Secondary Indexes (GSIs).
Total Provisioned Write CU	The total provisioned write capacity units for the table and all its Global Secondary Indexes (GSIs).
Storage Size	The total storage size of the specified table, in GB.
Item Count	The number of items present in the specified table.
Table Status	The current status of the table.
Partition Key	The partition key of the table, also known as the hash attribute.
Sort Key	The sort key of the table, also known as the range attribute.
Creation Date	The date and time when the table was created.
Amazon Resource Name (ARN)	The Amazon Resource Name (ARN) that uniquely identifies the table.
Last Decrease Time	The date and time of the last provisioned throughput decrease for this table.
Last Increase Time	The date and time of the last provisioned throughput increase for this table.
Number of Decreases Today	The number of provisioned throughput decreases performed during the current UTC day.
Number of Global Secondary Indexes	The total number of Global Secondary Indexes (GSIs) defined for the table.
Stream	The DynamoDB stream status for the table (Enabled/Disabled).