The Future of Analytics

Dave Rogers, Director of EBC Operations and Technology Integration - Microsoft

Today’s Agenda

Essential Program Metrics

Advanced Analytics - Using Business Intelligence and Visualization

Machine Learning – Training an algorithm to predict outcomes

Using Artificial Intelligence and Bots to enhance the Planning and Briefing Experience

Leveraging the ABPM World Class Characteristics in Measurement

1. A performance measurement strategy, designed to meet the needs of

key stakeholders, quantifies and communicates the program’s value.

2. Immediate or on-site feedback measures briefing impact.

3. Integrated planning, management, and reporting tools support briefing

operations and provide meaningful insight on program performance.

4. Sales closure tracking and delayed surveys quantify the briefing

program’s contribution to business results.

Essential Program Metrics

Efficiency• Metrics that measure activity

Effectiveness• Metrics that measure impact

Core Objectives• Program goals and commitments

Essential Program Metrics

Efficiency

• # of briefings

• # of events

• # of event days

• # of sessions

• # of customers

• # of partners

• # of employees

• % cancellations

• # of opportunities

Effectiveness

• Revenue

• Revenue expansion

• Revenue acceleration

• Account feedback

• Customer Satisfaction / NPS

• Cost per briefing/event

• Close rate

• % of Top Accounts touched

Core Objectives

• Program reputation

• Budget attainment

Advanced Analytics - Using Business Intelligence and Visualization

Tools of the Trade

Excel• PowerPivot, Power Query

Briefing Management Tool• Standard reports

• Custom Reports

Data Visualization Tools• Power BI

• Tableau

Overall Program Dashboard

Department Dashboard (Tech Support)

Understanding core drivers behind trends - CSAT

Understanding core drivers behind trends - CSAT

Understanding core drivers behind trends - CSAT

Understanding core drivers behind trends - CSAT

Additional uses for Visualization

Setting targets based on multi-year visualization of past performance.

Understanding an increase in costs• Same number of briefings but higher attendees/briefing

Take action based on CSAT responses

Executive participation& Topic health

What Dashboards do you use to manage your program?

Machine Learning – Training an algorithm to predict outcomes

Getting Started with Machine Learning

• What is Machine Learning?• Teaching software to find patterns in current data so that it can seek out the

patterns in future data (typically to predict future outcomes).

• Key providers include Amazon, Databricks, HPE, IBM, Microsoft

• Azure Machine Learning Website - https://studio.azureml.net/

• Overview of AMLhttp://azuremlsimpleds.azurewebsites.net/simpleds/

Predicting Briefing Cancellations

Problem:

Over 50% of all requests are cancelled or rescheduled• FY16- 54% (1529/2807)

• FY17- 54% (1398/2606)

Common Cancellation Assumptions• Weather issues preventing travel

• Change in Executive Team

• Poor relationship between account team and customer

• Political unrest

• Economic or customer specific incidents

EBC Cancellation Prediction Model

Key Cancellation Indicators

Number of speakers/topics requested

Lead time from request to start date

Industry• Public Sector (48%) … Partner (33%)

Country/Region• MEA (58%), LATAM, India, … Australia (20%)

Job title of Briefing Owner

Month• May (47%), June, … Feb (38%)

Day of the Week• Thursday (44%) … Wed (40%)

What’s Next?

• Briefing CSAT?

• Sales Closure?

• Opportunity Increase?

• Deal Acceleration?

• Likelihood to recommend or NSAT?

• Correlating tweets, stock price variations or other external signals to briefing or attendee volume?

How could you use Machine Learning?

Artificial Intelligence and Bots

AI and Bots

Enhancing the Briefing Experience• Executive Engagement Virtual Assistant (EEVA)

• Transcription Bot

AI and Bots

Internal Help Tools• MyEBC Helper Bot

• Agenda Builder

Agenda Builder Design

Briefing Objectives (customer + Microsoft)

Phase 1: Text Analytics + Azure Search = Recommended Topics

Industry Recommendations

Azure Text

Analytics

Key Words & Phrases

Azure Search

Content Catalog

Recommended Topics & Agenda

Actual Agendas

Agenda Builder Design

Briefing Objectives (customer + Microsoft)

Phase 1: Text Analytics + Azure Search = Recommended Topics

Industry Recommendations

Azure Text

Analytics

Key Words & Phrases

Azure Search

Content Catalog

Recommended Topics & Agenda

Actual Agendas

Chat Bot

Phase 2: Chat Bot introduces conversation and increases richness and accuracy of data to be analyzed

Agenda Builder Design

Briefing Objectives (customer + Microsoft)

Phase 1: Text Analytics + Azure Search = Recommended Topics

Industry Recommendations

Machine Learning

Content Catalog

Recommended Topics & Agenda

Actual Agendas

Chat Bot

Phase 2: Chat Bot introduces conversation and increases richness and accuracy of data to be analyzed

Phase 3: Machine Learning applies data and outcomes from past briefings to provide recommended topics

Getting Started with AI and Bots

Intro to AI Course

Building a simple Q&A Bot• QnA Maker

Building a Bot that understands natural language queries• LUIS: Language Understanding Intelligent Service

How are you using AI in your program?

Q&A