Microsoft Azure Stream Analytics Job Monitoring

Microsoft Azure Stream Analytics Job - An Overview

Azure Stream Analytics is a real-time analytics and complex event-processing engine that processes high volumes of fast streaming data from multiple sources simultaneously. Applications Manager's Microsoft Azure Stream Analytics Job monitoring tracks SU and CPU utilization, watermark delay, function requests and failures, input and output event throughput, deserialization and conversion errors, and early and late input event counts.

Creating a new Microsoft Azure Stream Analytics Job Monitor

To learn how to create a new Microsoft Azure Stream Analytics Job monitor, click here.

Monitored Parameters

Navigate to the Category View by clicking the Monitors tab. Hover over 'Child Monitors' under Microsoft Azure in the Cloud Apps table, and then select the Stream Analytics Jobs monitor from the displayed tooltip. This action will display the bulk configuration view for Microsoft Azure Stream Analytics Job in three tabs:

Availability tab gives the availability history for the past 24 hours or 30 days.
Performance tab gives the health status and events for the past 24 hours or 30 days.
List view tab enables you to perform bulk admin configurations.

Following are the list of metrics monitored in Microsoft Azure Stream Analytics Job Monitoring in their corresponding tabs:

Performance Overview

Parameter	Description
UTILIZATION
SU Utilization	The average of SU(Memory) utilization of the Azure Stream Analytics Job at the time of polling (in %).
CPU Utilization	The average of CPU utilization of the Azure Stream Analytics Job at the time of polling (in %).
WATERMARK DELAY
Watermark Delay	The average of watermark delay of the Azure Stream Analytics Job at the time of polling (in s).
FUNCTION REQUESTS
Function Requests Rate	The number of function requests made per minute by the Azure Stream Analytics Job between the poll intervals (in requests/min).
Function Requests	The total number of function requests made by the Azure Stream Analytics Job between the poll intervals.
Failed Function Requests Rate	The number of failed function requests per minute for the Azure Stream Analytics Job between the poll intervals (in requests/min).
Failed Function Requests	The total number of failed function requests for the Azure Stream Analytics Job between the poll intervals.
ERRORS
Runtime Errors Rate	The number of runtime errors encountered per minute by the Azure Stream Analytics Job between the poll intervals (in errors/min).
Runtime Errors	The total number of runtime errors encountered by the Azure Stream Analytics Job between the poll intervals.
Data Conversion Errors Rate	The number of data conversion errors encountered per minute by the Azure Stream Analytics Job between the poll intervals (in errors/min).
Data Conversion Errors	The total number of data conversion errors encountered by the Azure Stream Analytics Job between the poll intervals.
Input Deserialization Errors Rate	The number of input deserialization errors encountered per minute by the Azure Stream Analytics Job between the poll intervals (in errors/min).
Input Deserialization Errors	The total number of input deserialization errors encountered by the Azure Stream Analytics Job between the poll intervals.

Events

Parameter	Description
INPUT EVENT DATA
Input Event Data Rate	The number of input events data received per minute by the Azure Stream Analytics Job between the poll intervals (in MB/min).
Input Event Data	The total input events data received by the Azure Stream Analytics Job between the poll intervals (in MB).
INPUT EVENTS SOURCES
Input Sources Received	The total number of input sources per second by the Azure Stream Analytics Job between the poll intervals.
Backlogged Input Events	The average of backlogged input events for the Azure Stream Analytics Job at the time of polling.
EVENT TIMING DETAILS
Early Input Events Rate	The number of early input events received per minute by the Azure Stream Analytics Job between the poll intervals (in events/min).
Early Input Events	The total number of early input events by the Azure Stream Analytics Job between the poll intervals.
Late Input Events Rate	The number of late input events received per minute by the Azure Stream Analytics Job between the poll intervals (in events/min).
Late Input Events	The total number of late input events by the Azure Stream Analytics Job between the poll intervals.
INPUT EVENTS
Input Events Rate	The number of input events received per minute by the Azure Stream Analytics Job between the poll intervals (in events/min).
Input Events	The total number of input events received by the Azure Stream Analytics Job between the poll intervals.
OUTPUT EVENTS
Output Events Rate	The number of output events produced per minute by the Azure Stream Analytics Job between the poll intervals (in events/min).
Output Events	The total number of output events by the Azure Stream Analytics Job between the poll intervals.
FUNCTION EVENTS
Function Events Rate	The number of function events processed per minute by the Azure Stream Analytics Job between the poll intervals (in events/min).
Function Events	The total number of function events processed by the Azure Stream Analytics Job between the poll intervals.
OUT OF ORDER EVENTS
Out of Order Events Rate	The number of out-of-order events per minute between the poll intervals (in events/min).
Out of Order Events	The total number of out-of-order events between the poll intervals.

Note: Events metrics are mapped under Performance Polling. To adjust the polling interval, navigate to Settings → Performance Polling. In the Optimize Data Collection tab, select Azure Stream Analytics Job as the Monitor Type and Events as the Metric Name. Then set Default Polling Status as required, by default opted as Never collect data.

Configuration

Parameter	Description
GENERAL CONFIGURATION
Resource Group Name	The name of the Azure resource group that contains the Stream Analytics job.
Location	The Azure region where the Stream Analytics job is deployed.
Provisioning State	The current provisioning state of the Stream Analytics job resource.
Job State	The current runtime state of the Stream Analytics job. Possible values: Created, Starting, Running, Stopping, Stopped, Deleting, Failed, Degraded, Restarting, Scaling.
SKU Name	The SKU of the Stream Analytics job. Possible values: Standard.
Compatibility Level	Controls certain runtime behaviors of the Stream Analytics job. Possible values: 1.0, 1.2.
Content Storage Policy	Specifies where the Stream Analytics job content is stored. Possible values: SystemAccount, JobStorageAccount.
Creation Time	The timestamp when the Stream Analytics job was created.
Data Locale	The locale used by the Stream Analytics job.
Output Error Policy	The policy applied to events that arrive at the output and cannot be written to external storage because they are malformed. Possible values: Stop, Drop.
JOB DETAILS
Job Id	A GUID that uniquely identifies the Stream Analytics job.
Job Storage Account	The Azure Storage account used to store job content when the Content Storage Policy is set to JobStorageAccount.
Job Type	The type of Stream Analytics job. Possible values: Cloud, Edge.
JOB EVENTS
Events Out of Order Max Delay	The maximum tolerable delay, in seconds, for out-of-order events to be adjusted back into order.
Events Out of Order Policy	The policy applied to events that arrive out of order in the input event stream. Possible values: Adjust, Drop.
Events Late Arrival Max Delay	The maximum tolerable delay, in seconds, for late-arriving events to be included.

Microsoft Azure Stream Analytics Job Monitoring

Microsoft Azure Stream Analytics Job - An Overview

Creating a new Microsoft Azure Stream Analytics Job Monitor

Monitored Parameters

Performance Overview

Events

Configuration

Loved by customers all over the world

"Standout Tool With Extensive Monitoring Capabilities"

"I like Applications Manager because it helps us to detect issues present in our servers and SQL databases."

Carlos Rivero

Trusted by thousands of leading businesses globally