Webpage Analyzer


Overview

Webpage Analyzer monitors performance of the web page. It helps to analyze all individual components of the page like HTML, CSS, JavaScript, images, etc. Webpage Analyzer helps to optimize the web page performance using PageSpeed rules and suggestions.

Creating a new Webpage Analyzer monitor

Prerequisites for monitoring Webpage Analyzer metrics: Click here

Using the REST API to add a new Webpage Analyzer monitor: Click here

Follow the steps given below to create a new Webpage Analyzer monitor:

  1. Click on New Monitor link.
  2. Select Webpage Analyzer under Web Server/Services category.
  3. Specify the Display Name of the Webpage Analyzer monitor.
  4. Enter the Webpage URL to be monitored.
  5. Enter the maximum time (in seconds) for the page to load in Page Load Timeout field.
  6. Enter the time (in seconds) to wait after page load in Wait after load field.
  7. Select the HTTP Method to be used for connecting to the website. If POST method is selected, enter the request Pay Load. Use _sep_ to separate the request param name and value. For specifying multiple params, separate them using # symbol.
    Example: username_sep_admin#password_sep_admin
  8. Specify Custom HTTP(S) Header to modify request headers. Use _sep_ to separate the header name and value. For specifying multiple headers, separate them using # symbol.
    Example: User-Agent_sep_Mozilla/5.0 (Windows NT 6.3; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/46.0.2490.86 Safari/537.36#Accept-Charset_sep_utf-8
  9. Enter the Username and Password for authentication, if required. (Basic Authentication)
  10. Enter Domains to block from monitoring separated by "|". Example: adshost2.com|ad.turn.com
  11. Enable the Add content check for responsecheckbox if you wish to perform content check in the page response.
    • Specify the Regular expression that should match in the webpage response. (Refer Regex Guide for more info)
    • Specify the contents that should contain and/or should not contain while performing the check in the webpage response.
    • Enable the Do case sensitive keyword search checkbox if you wish to perform a content check for case-sensitive character strings
  12. Enable SSL/TLS Certificate monitoring if you wish to monitor SSL/TLS certificates in the webpage. After enabling this option, specify the following details:
    • Enter the Domain Name for which the certificate is required to be monitored. Make sure to specify the domain name without any protocol such as http or https. Example: www.zoho.com
    • Enter the Port in which the server is running.
    • Select the Protocol to be used while connecting to the site. The default option Auto tries to connect with all the protocols.
    • Enable the Need proxy to connect the domain checkbox if the server is connected through proxy. In such cases, you should also Configure Proxy through the option available in the Settings tab.
    • Enable the Ignore Certificate name mismatch error checkbox if you want to ignore mismatch error in the certificate name.
    • Enable the Ignore invalid root and intermediate certificate checkbox if you wish to ignore invalid root and intermedite certificates.
    • Enter the Timeout value in seconds.
  13. Specify the Polling Interval in minutes.
  14. Choose the Monitor Group with which you want to associate the monitor (optional).
  15. Click Add Monitor(s). This discovers Webpage Analyzer from the network and starts monitoring it.
Note:
  • Security/firewall requirement - Webpage should be accessible from the machine where AppManager server is running.
  • User privilege - Required credentials should be provided for the webpage.

Monitored Parameters

Go to the Monitors Category View by clicking the Monitors tab. Click on Webpage Analyzer under the Web Server/Services table. Displayed is the Webpage Analyzer bulk configuration view distributed into three tabs:

  • Availability tab gives the Availability history for the past 24 hours or 30 days.
  • Performance tab gives the Health Status and events for the past 24 hours or 30 days.
  • List view enables you to perform bulk admin configurations.

On clicking a monitor from the list, you'll be taken to the Webpage Analyzer monitor dashboard. It has 5 tabs -

Overview

ParameterDescription
WEBPAGE SUMMARY
Webpage URL URL of the webpage that is monitored.
Page Load Time Time taken to load all the contents of the webpage and display them in the browser window (in milliseconds).
Total Requests Total number of requests sent for loading the webpage.
Page Size Total size of the webpage (in kilobytes).
Days for Certificate Expiry Number of days remaining for the certificate to expire.
Page Score PageSpeed score given (in percentage) based on Page Load Time, Total Requests and Page Size.
RESPONSE TIME SUMMARY
DNS Time Amount of time spent for resolving domain name for the request (in milliseconds).
Connection Time Amount of time spent for establishing TCP connection with server (in milliseconds). It includes both TCP handshakes/retries and SSL time.
First Byte Time Amount of time taken from when the connection to the server established until the first response starts coming in for the base page (in milliseconds).
Start Render Amount of time taken for first visible changes to appear in browser screen (in milliseconds).
Document Complete Amount of time taken for all resource of the page to be downloaded (in milliseconds).
Page Load Time Time taken to load all the contents of the webpage and display them in the browser window (in milliseconds).
DOMAIN SUMMARY
Domain Name Name of the domain for which the request has been sent.
IP Address IP address of each domain.
No of Requests Total number of requests sent per domain.
Size Amount of data transferred from each domain (in kilobytes).
Average Response Time Average time taken to send complete response for a request per domain (in milliseconds).
Average Throughput Rate at which data is transferred from the domain in response time (in kilobytes per second)

Network Log

This tab displays the timing details for all the individual components of the webpage (like HTML, JavaScript, CSS, images etc.) in the form of a Waterfall chart.

ParameterDescription
Resource Name Name of the resource.
Status Code The HTTP response status code of the resource.
Size Size of the resource (in kilobytes).
Content Type Indicates the type of content available in each resource.
Total Requests Total number of requests sent for loading the webpage.
Page Size Total size of the webpage (in kilobytes).
Page Load Time Time taken to load all the contents of the webpage and display them in the browser window (in milliseconds).

SSL/TLS Certificate Details

This tab consists of details of both the issuer and the buyer.

ParameterDescription
ISSUED TO
Common Name (CN) Name of the host or domain to which the certificate is issued.
Organization (O) Name of the organization to which the certificate is issued.
Organization Unit (OU) Name of the organization unit making the request.
ISSUED BY
Common Name (CN) Name of the host or domain that issues the certificate.
Organization (O) Name of the organization that issues the certificate.
Organization Unit (OU) Name of the organization unit making the request.
VALIDITY
Issued On Date at which the certificate was issued.
Expires On Date at which the certificate will expire.
Days for Certificate Expiry Number of days remaining for the certificate to expire.

Resource Details

ParameterDescription
REQUEST SUMMARY
Request Type Type of request sent.
No of Requests Number of requests sent for each type.
Size Amount of data transferred for each type (in kilobytes).
Screenshots - Displays the screenshot of the webpage along with performance information such as the size and count of various components on this webpage in the form of pie charts.
Resource Size % Total size of the resource (in percentage).
Resource count % Total count of the resource (in percentage).

PageSpeed Insights

PageSpeed Insights analyzes the webpage contents and generates suggestions to make page faster. It analyzes page with certain rules and provides score for each rule based on performance of the webpage.

This tab displays the PageSpeed insight details along with the PageSpeed score that can help in optimizing webpage performance.

ParameterDescription
PAGESPEED SCORE Indicates the average score of individual roles.
Rule Indicates the PageSpeed rule. For more information, refer here.
Score Indicates the score obtained for each rule by the webpage.
Grade Indicates the grade obtained for the score for each rule.

PageSpeed Insight Rules

Following are the list of PageSpeed rules that are used to analyze webpage performance in Applications Manager:

  • Avoid bad requests - Indicates that the broken links or requests that result in 404/410 errors can be removed to avoids wasteful requests.
  • Avoid CSS @import - Indicates that the use of CSS @import in an external stylesheet can be avoided to reduce additional delays during the loading of a web page.
  • Defer parsing of JavaScript - Indicates that the amount of JavaScript used in the webpage can be minimized or deferred to reduce additional delays during the loading of a web page.
  • Enable compression - Indicates that the size of files sent from your webpage can be compressed (using gzip) to reduce the webpage size and to increase the speed to which they are transferred to the browser.
  • Enable Keep-Alive - Indicates that the HTTP Keep-Alive or HTTP persistent connections can be enabled to reduce the webpage latency by allowing the same TCP connection to send and receive multiple HTTP requests.
  • Leverage browser caching - Indicates that the resources of your webpage can be cached and reused by leveraging browser caching to reduce the page load times for users revisiting your webpages.
  • Make landing page redirects cacheable - Indicates that the redirects of your webpage can be cached by the browser to reduce page load times for repeat visitors to your webpage.
  • Minify CSS - Indicates that the CSS code of your webpage can be minimized and condensed to save data and to speed up downloading, parsing, and execution time.
  • Minify HTML - Indicates that the HTML code (including inline JavaScript and CSS code) of your webpage can be minimized and condensed to save data and to speed up downloading, parsing, and execution time.
  • Minify JavaScript - Indicates that the Javascript code of your webpage can be minimized and condensed to save data and to speed up downloading, parsing, and execution time.
  • Minimize redirects - Indicates that the HTTP redirects from your webpage can be minimized to reduce additional RTT latency and wait time for users.
  • Optimize images - Indicates that the images on your webpage can be optimized to minimize page load times by loading appropriately sized images.
  • Remove query strings from static resources - Indicates that the query strings can be removed from references to static resources in your webpage for better caching.
  • Serve resources from a consistent URL - Indicates that the resources used in your webpage can be served from a unique URL to eliminate duplicate download bytes and additional RTTs.
  • Specify a cache validator - Indicates that a cache validator (such as Last-Modifier or ETag headers) can be specified to all the static resources of your webpage for better caching by the browsers.
  • Specify a 'Vary: Accept-Encoding' header - Indicates that the HTTP header "Vary: Accept-Encoding" can be specified in your webpage to store both compressed and uncompressed version of the resource for better performance.
  • Specify a character set - Indicates that the character set can be specified in the HTTP response headers of your webpage for faster browser processing and to reduce page load times.