View on GitHub

Microsoft Informational Bot

Rapid Bot deployment resources for Covid-19, Unemployment and Other Uses

Telemetry and Analytics

App Insights (Time to Setup – 3 Minutes)

Q&A Maker can be deployed with App Insights to capture an analyze application telemetry. In the next few steps you’ll learn how to monitor these metrics, including Questions, Answers and Confidence Scoring. By the end of this section you’ll be able to create the following report:

Please refer to this link for more information: https://docs.microsoft.com/en-us/azure/cognitive-services/qnamaker/how-to/get-analytics-knowledge-base

  1. Locate Application Insights you’ve created when initially deploying the bot

  2. Check that it’s collecting data, you should see charts like these, if you don’t the App Insights aren’t properly configured.

  3. Click on Logs at the top

  4. Run a Kusto query (copy and paste) from this Document – Step 3

  5. Done.

Visualizing, grouping and analyzing customer interactions (Time to Setup – 10 Minutes)

  1. Pre-Requisite - Download Power BI Desktop (free)

  2. Download and Open Power BI Report Template

  3. Edit Parameters to update local time UTC Offset and Application Insights ID (from previous section, step 6)

  4. Log In using Organizational account

  5. Done

Automatic email notification of unanswered questions (Time to Setup – 10 Minutes)

  1. Create a new Logic App in Azure. We recommend putting it into the same Resource Group as other Bot resources

  2. Once created, click on Blank Logic App and select Schedule as the trigger. (Select the All tab if you do not see Schedule as an option under the For You tab)

  3. Set the Recurrence to 1 hour

  4. Click on + New Step, type Visualize in the search box and select Visualize Analytics query in the results.

  5. Give it a Connection Name of your preference

  6. The Application ID will be located in Application Insights - > API Access

  7. Now Create API key to allow your Logic App to authenticate

  8. API Key Configuration

  9. Go back to Logic App Designer and fill in the Application ID and API Key

  10. Now configure the *Query (copy and paste from here)

  11. Add + New Step to email the results to specified people

  12. Authenticate and fill in the appropriate fields

  13. Click Save and Run. Check email, you should receive an email like this one

  14. Done.