Importing data from Amazon Athena
If you have data stored in Amazon Athena database, you can easily import the data into Analytics Plus for advanced reporting and analysis. You can also set up schedules to fetch the latest data from your Amazon Athena database periodically.
Log in to Analytics Plus, click on the Import Your Data button found at the top right corner of the screen, and select the Local & Cloud Databases option.
Follow the steps below to import data from Amazon Athena cloud database.
Step 1: Local and Cloud Database Connection Settings
Service Name: Choose Amazon Athena as the service name, this identifies the database service on which the database is running.
AWS Region: Enter the AWS Region of the Amazon Athena cloud database you wish to import data from.
S3 Output Location: Enter the path of the Amazon S3 location where query results are to be saved, prefixed with 's3://'.
Username (Access Key Id): Enter the username that is used to access the database.
Password (Secret Key): Enter the password that is associated with the username specified in the database username text box.
Database Name: Enter the database name to connect with the data source instance.
Click Next to proceed with the import process.
Step 2: Select data to import
Select database: Select the database from which data is to be imported.
Select table: Select the required radio button to import data
Single table: Select the table from which the data is to be imported.
Multiple tables: Select multiple tables option to import data from multiple tables at once.
Custom query: Enter your custom query in the respective database query format from which data is to be imported.
Click on "Next" to proceed with the import process.
Step 3: ManageEngine Analytics Plus database setup
You can change the title of the columns, choose to exclude some and change their data types. Choose what the application should do when an error occurs during import.
Analytics Plus imports the input data provided, it will bring up a Import Summary dialog as shown below, capturing the status of the Import process just completed.
The details that would be shown include:
Column Details: Total number of columns in the input data and the total number of columns that where actually selected for import.
Row Details: Total number of rows in the input data and the total number of successfully imported rows in it.
Scheduling Options: If you wish to schedule imports, click on the "Schedule This Import" option
How do you want to import?
Select your preference from a drop down list on the available options to add new records into your database.
Add records at the end: This option adds the new columns towards the end of the existing database table
Delete existing records and add: This option deletes the existing records and adds the new records into the database table
Add Records and replace if already exists: This option adds the new columns and overwrites records with same column name.
Add new, replace existing and delete missing records: This option adds the new records, overwrites the existing records with same column name and deletes the missing records.
Check the "include new column added in your Cloud Database automatically into ManageEngine Analytics Plus table", to add the new columns into your Analytics Plus table automatically
When Add records and replace if already exists or Add records, replace existing and delete missing record is selected, it is mandatory to specify matching columns using the Select the column(s) to match existing records option. You can choose one or more columns as matching columns. Analytics Plus will use the values in these columns as the key to match the existing records with the new records being imported. Hence the matching column(s) combination should uniquely identify each record in the table. Once a match is identified, then Analytics Plus will update that existing record in the table with the new record values present in the data being Imported. Incase there is no match found, those records will be appended to the end of the table.
You can specify the schedule interval from the available options such as:
Repeat- Specify the schedule interval from the drop-down list. Available options are.
Every 'N' hours - Choose this option to schedule the import every 'N' hours i.e., every 2 hour or 6 hours. On choosing this option, specify the time interval to import the data.
Every Day - Choose this option to schedule the import at a particular time everyday. On choosing this option, specify the time to import data.
Weekly Once - Choose this option to schedule the import once in a week on a particular day. On choosing this option, specify the day of the week and the time to import the data.
Monthly Once - Choose this option if you want to schedule the import once in a month on a particular day. On choosing this option, specify the day of the month and the time to import data.
On closing the Summary dialog, Analytics Plus will display the newly created table with the data loaded in the same.