The Roi of Learning Toolkit

  • View
    8

  • Download
    0

Embed Size (px)

Transcript

  • ROI of Learning ToolkitPrepared by Kristi Casey Sanders, CMP, CMM, DES, HMCC,

    Director, Thought Leadership, Meeting Professionals International

    @KristiCasey #MPI ksanders@mpiweb.org

  • 3 Steps in Measurement of Learning

    Learning Environment

    Learning Process

    Learning into Action

    2 2018, Meeting Professionals International, www.mpiweb.org/join. All rights reserved.

    http://www.mpiweb.org/join

  • Learning Environment Components

    If you cant evaluate all, at least pick two.

    DesignSetting

    StructureLearner Readiness

    Follow-Up

    3 2018, Meeting Professionals International, www.mpiweb.org/join. All rights reserved.

    http://www.mpiweb.org/join

  • Design Score: ___ out of 90Organizers: Score 1-10 (10 being most true)

    Learning offers appropriate level of challenge to participantsThere are activities to suit a wide

    variety of learner stylesTechnology is used to aid interaction

    with expertsThere is a mix of new and repeat

    participantsThe content challenges the status quo

    Participants are likely to encounter different points of viewThere will be opportunities to benefit

    from collective as well as expert knowledgeParticipants will be able to put and test

    learning in their own contextThe meeting encourages mixing

    between more industry experienced and less experienced participants

    4 2018, Meeting Professionals International, www.mpiweb.org/join. All rights reserved.

    http://www.mpiweb.org/join

  • Setting Score: ____ out of 70Organizers: Score 1-10 (10 being most true)

    There are varied room layouts (theater-style, cabaret, boardroom, informal, etc.)

    There is natural lightRefreshments are available during

    sessions

    There will be spaces for participants to reflect on their own

    There will be spaces for pairs to discuss learning

    There are small group areas

    The meeting provides a safe environment for people to participate

    5 2018, Meeting Professionals International, www.mpiweb.org/join. All rights reserved.

    http://www.mpiweb.org/join

  • Structure Score: ____ out of 30Organizers: Score 1-10 (10 being most true)

    There are frequent breaks

    There is time for reflection at the end of sessions

    Session timing is right for activities

    6 2018, Meeting Professionals International, www.mpiweb.org/join. All rights reserved.

    http://www.mpiweb.org/join

  • Learner Readiness Score: ____ out of 60Organizers: Score 1-10 (10 being most true)

    Speakers will show interest in the audience

    Participant needs have been significantly used to inform the selection of content

    The content will be very relevant to participants

    Participants will receive learning materials in advance of the meeting

    Participants will use an app for pre-scheduling and gaining information in advance of sessions

    Participants come ready to learn

    7 2018, Meeting Professionals International, www.mpiweb.org/join. All rights reserved.

    http://www.mpiweb.org/join

  • Follow-Up Score: ____ out of 70Organizers: Score 1-10 (10 being most true)

    The learning will provide new insightsSocial media will help to engage

    participants in the content

    Sessions will be recorded for participants to use at the event and after the event on any device

    Participants will be able to act upon their learning

    Participants will be encouraged to contact other participants after the event

    Participants are likely to access materials, handouts, slides after the event

    This meeting is part of a year-round engagement strategy

    8 2018, Meeting Professionals International, www.mpiweb.org/join. All rights reserved.

    http://www.mpiweb.org/join

  • Design Score: ____ out of 90Participants: Score 1-10 (10 being most true)

    Learning offered the appropriate level of challengeThere were activities to suit my learner

    preferenceI used technology to interact with

    expertsI met a mix of new and repeat

    participantsThe content challenged the status quo

    I encountered different points of view

    The meeting encouraged mixing between more industry experienced and less experienced participants

    I felt I benefitted from collective as well as expert knowledge

    I could put and test learning in my own context

    9 2018, Meeting Professionals International, www.mpiweb.org/join. All rights reserved.

    http://www.mpiweb.org/join

  • Setting Score: ___ out of 70Participants: Score 1-10 (10 being most true)

    There were varied room layouts (theater-style, cabaret, boardroom, informal, etc.)

    There was natural light

    Refreshments were available during sessions

    There were spaces for me to reflect on my own

    There were spaces for pairs to discuss learning

    There were small group areas

    This event provided a safe environment for me to participate

    10 2018, Meeting Professionals International, www.mpiweb.org/join. All rights reserved.

    http://www.mpiweb.org/join

  • Structure Score: ____ out of 30Participants: Score 1-10 (10 being most true)

    There were frequent breaks

    There was time for reflection at the end of sessions

    Session timing was right for activities

    11 2018, Meeting Professionals International, www.mpiweb.org/join. All rights reserved.

    http://www.mpiweb.org/join

  • Learner Readiness Score: ____ out of 60Participants: Score 1-10 (10 being most true)

    Speakers showed interest in the audience

    I felt participant needs have been significantly used to inform the selection of content

    The content was very relevant to me

    I received learning materials in advance of the meeting

    I used the event app for pre-scheduling and gaining information in advance of sessions

    I came ready to learn

    12 2018, Meeting Professionals International, www.mpiweb.org/join. All rights reserved.

    http://www.mpiweb.org/join

  • Follow-Up Score: ____ out of 70Participants: Score 1-10 (10 being most true)

    The learning will provide new insights

    I felt engaged by social media communications before, during and after the event

    I intend to watch recordings of sessions filmed during the event

    I will be able to use what I learned

    I will stay in touch with people I met during the event

    I intend to refer to session materials, handouts, slides after I return to work

    I feel connected to this events community all year long

    13 2018, Meeting Professionals International, www.mpiweb.org/join. All rights reserved.

    http://www.mpiweb.org/join

  • Assessment of Learning Environment Score Card

    OrganizerElement Score

    Design ____ /90 = _____

    Setting ____ /70 = _____

    Structure ____ /30 = _____

    Learner Readiness ____ /60 = _____

    Follow-Up ____ /70 = _____

    TOTAL ____ /320 = ____

    ParticipantElement Score

    Design ____ /90 = _____

    Setting ____ /70 = _____

    Structure ____ /30 = _____

    Learner Readiness ____ /60 = _____

    Follow-Up ____ /70 = _____

    TOTAL ____ /320 = ____

    Average Learning Environment Score (organizer & participant) = _____

    14 2018, Meeting Professionals International, www.mpiweb.org/join. All rights reserved.

    http://www.mpiweb.org/join

  • Learning Environment Observation Sheet To determine effectiveness of live learning environment, select a random sample of 10% of your sessions and have reviewers audit and rank using the following spectrum. Average

    all session scores to determine average onsite score of the live learning environment.

    10 123456789

    What would your overall score for this session be? Rank the following along the above continuum of 1 to 10.

    StructuredWell-TimedInteractiveHands-OnSpeaker Interest in AudienceOpenness to QuestionsAudience-Focused

    UnstructuredRushedPassiveTheory

    No InterestScripted

    Distracted

    SESSION SCORE: _____ /70 = _____

    Also include reviewer name & notes; date, time & name of session; # of participants & description; session type; and room layout.

    15 2018, Meeting Professionals International, www.mpiweb.org/join. All rights reserved.

    http://www.mpiweb.org/join

  • Learning Process Pre-Event Survey(feel free to customize/edit to meet your needs)

    Meeting my peersMaking new contactsLearning new thingsPromoting my businessMeeting expertsLearning how to do my job betterGaining professional education creditsHaving a break from work

    Seeing the destination

    Feeling part of this community

    Looking for new business

    Looking for a new job

    Strengthening my network

    No specific objectives

    Other (please specify) _____________

    Participant instructions: Please select your top 3 objectives for attending

    High-learning focused people will have 2-3 education-related goals; mid-learning focused will have 1; low-learning will have none. Use data to customize experience & pre-event communications.

    16 2018, Meeting Professionals International, www.mpiweb.org/join. All rights reserved.

    http://www.mpiweb.org/join

  • Learning Process & Learning to Action Onsite Questionnaire

    What learning has taken place?

    What questions arise as a result of attending this session/activity?

    What did you want to achieve at this meeting/training?

    How would you describe your learning experience?

    What did you do in advance of the meeting to prepare?

    What do you think will happen to the learning after the conference?

    Have staff or volunteers stop 1 in e