Network Administrators are always in need of more information and insights from their log data. There are times when an IT administrator would identify some log information which is useful and would like to have it indexed automatically as a new field. Having more fields being indexed makes your log data more useful while conducting log forensics analysis and creating network security reports.
EventLog Analyzer allows administrators to (extract or) create custom (new) fields from raw logs by using the interactive Field Extraction UI to create regular expression (RegEx) patterns to help EventLog Analyzer to identify, parse and index these custom fields from new logs it receives from network systems and applications.
Procedure to extract new fields
In the Search screen, select the host(s) or host group(s), if unsure leave it blank. Leaving it blank will search all the hosts of the host groups. Select the log type for which you want to extract new fields. To narrow down the logs, enter specific word(s) in the search query text box, if you are unsure leave it blank. Leaving it blank will list all the log entries in the result. Click Go button. This will list the results for the above mentioned search. Use the Wrench icon of the particular log entry from which you want to extract the new field(s).
Step 1: Edit the log type and view the existing fields
Edit the Log Type display name, if it is not default log type. For non-default log types, the display name will be name of the imported log file or hostname/port
View the details of the 'Existing Fields' with the help of Show and Show All links.
Step 2: Select the required custom field value(s) and specify the details
Select and click the word(s) in the message, to be extracted as field
Provide a name for this field. Optinally, specify the prefix and suffix to the field value
Click on Create Pattern to generate a parser rule pattern
Note: The word(s)/character(s) preceding and succeding the selected field value are called, Prefix and Suffix. These are used as identifiers to extract the fields exactly. The prefix and suffix can have a static value (Exact Match) or dynamic value (Similar Pattern) or they can be ignored.
Example for Static and Dynamic value for Prefix and Suffix
The prefix Logon Type can be a static value as most of the logs will have the exact word as 'Logon Type' where as 'Source Network Address' can be dynamic as the logs may have different word(s) like, Source IP Address, Source Address, but with same pattern.
If the prefix and suffix are defined with exact match, the field extraction will be precise.
Step 3: Validate the pattern and save it to extract the new field
A parser rule pattern is created using the field definition. You can edit the generated pattern manually, if you are familiar with regular expression
Validate link is used to test the generated pattern against the previous search results. You can manually check the suitability of the pattern by analyzing the 'Matched Log Messages' and 'Unmatched Log Messages' displayed.
Optionally, click on Choose another Pattern to choose a pattern from a list of patterns generated by the application
Optionally, you can define any existing field matching criteria to apply the pattern for this specific log type
Save the pattern to extract the field(s) from the upcoming logs. The saved pattern will be listed in the Settings tab under
Custom Pattern Settings section
Use the Ask Support button, if you face any problem and get assistance from the EventLog Analyzer team
Screen shot of Validate check
Screen shot of patterns generated by the application