Migration to Elasticsearch

Elasticsearch is an open-source search engine that carries out an index search instead of searching for text directly, resulting in faster search results. Elasticsearch is better at managing a large number of indexes and can handle complex index searches much faster than a SQL database.

Why choose Elasticsearch over a SQL database to store log data?

  • It helps retrieve data much faster, resulting in almost instant data generation in O365 Manager Plus.
  • It consumes less CPU memory and disk space when compared to a SQL database, so you don't have to worry about usage limits.
  • It speeds up report generation, data updates, data searches, grouping, and more.
  • Eliminates the need for continuous backup of data, which is necessary for SQL databases.

In short, Elasticsearch is much more scalable and performs faster in comparison to SQL databases.

Migrating O365 Manager Plus to Elasticsearch for faster performance

This is applicable only to the existing O365 Manager Plus customers using build 4323 or older, or customers that have recently updated to the latest build. Elasticsearch will be the default search engine for those who started using the product after build 4323.

When you log in to the product, a Data Engine Update pop-up will appear to notify you that the product has adopted Elasticsearch to enhance performance. This pop-up will show the size of the data to be migrated and the approximate time taken for the migration to complete. You can either choose to migrate immediately or schedule the migration for later.

To migrate immediately:

Choose Migrate now from the pop-up to begin immediate migration. During the migration, only some data is available for auditing, alerting, and content search. You will have to wait until the migration is complete to query all your data.

To conduct a scheduled migration:

  1. Choose Schedule Later to schedule the migration to take place during a custom time period.
  2. When you choose to schedule the migration for later, the Schedule Data Migration pop-up appears. Choose the date and time for the migration to take place.
  3. Click Save.
Note: Only some data can be queried while the migration is in progress. Please wait until the migration is complete to query all your data.

To edit an existing migration schedule:

  1. Navigate to Settings → Admin → Administration → Product Schedulers.
  2. Choose the Elasticsearch Migration scheduler from the list, and select the schedule symbol in the Actions column to edit the scheduler.
  3. Select the migration date and time in the Schedule Data Migration pop-up.
  4. Click Save.
Get download link