30
3D GAMES & SIMULATIONS: THE FUTURE ASSESSMENT CENTER Alex Howland, Ph.D.

3D GAMES & SIMULATIONS: THE FUTURE ASSESSMENT CENTER … · THE INCEPTION OF VIRBELA . LECTURE HALL . BUSINESS SIMULATIONS . THE CAMPUS . AVATAR CUSTOMIZATION . Assessment Engine

  • Upload
    others

  • View
    3

  • Download
    0

Embed Size (px)

Citation preview

Page 1: 3D GAMES & SIMULATIONS: THE FUTURE ASSESSMENT CENTER … · THE INCEPTION OF VIRBELA . LECTURE HALL . BUSINESS SIMULATIONS . THE CAMPUS . AVATAR CUSTOMIZATION . Assessment Engine

3D GAMES & SIMULATIONS: THE FUTURE ASSESSMENT CENTER

Alex Howland, Ph.D.

Page 2: 3D GAMES & SIMULATIONS: THE FUTURE ASSESSMENT CENTER … · THE INCEPTION OF VIRBELA . LECTURE HALL . BUSINESS SIMULATIONS . THE CAMPUS . AVATAR CUSTOMIZATION . Assessment Engine

• Assess distributed (& global) leadership skills • Provide social and experiential learning online

• Scalable approach to behavioral assessment

• Make assessment fun!

• Attract Millenials

PROJECT GOALS

Page 3: 3D GAMES & SIMULATIONS: THE FUTURE ASSESSMENT CENTER … · THE INCEPTION OF VIRBELA . LECTURE HALL . BUSINESS SIMULATIONS . THE CAMPUS . AVATAR CUSTOMIZATION . Assessment Engine

THE TECHNOLOGY

• Unity 3D • VoIP • Text chat • Instructor resources • Analytics of user behavior

• Simulations • Collaborative web browsing • Professional avatar customization • User profile system • Record and playback

Page 4: 3D GAMES & SIMULATIONS: THE FUTURE ASSESSMENT CENTER … · THE INCEPTION OF VIRBELA . LECTURE HALL . BUSINESS SIMULATIONS . THE CAMPUS . AVATAR CUSTOMIZATION . Assessment Engine

GMAC MET Fund’s Ideas to Innovation Challenge Global competition seeking the best ideas to improve graduate management education and bring those ideas to fruition.

THE INCEPTION OF VIRBELA

Page 5: 3D GAMES & SIMULATIONS: THE FUTURE ASSESSMENT CENTER … · THE INCEPTION OF VIRBELA . LECTURE HALL . BUSINESS SIMULATIONS . THE CAMPUS . AVATAR CUSTOMIZATION . Assessment Engine

LECTURE HALL

Page 6: 3D GAMES & SIMULATIONS: THE FUTURE ASSESSMENT CENTER … · THE INCEPTION OF VIRBELA . LECTURE HALL . BUSINESS SIMULATIONS . THE CAMPUS . AVATAR CUSTOMIZATION . Assessment Engine

BUSINESS SIMULATIONS

Page 7: 3D GAMES & SIMULATIONS: THE FUTURE ASSESSMENT CENTER … · THE INCEPTION OF VIRBELA . LECTURE HALL . BUSINESS SIMULATIONS . THE CAMPUS . AVATAR CUSTOMIZATION . Assessment Engine

THE CAMPUS

Page 8: 3D GAMES & SIMULATIONS: THE FUTURE ASSESSMENT CENTER … · THE INCEPTION OF VIRBELA . LECTURE HALL . BUSINESS SIMULATIONS . THE CAMPUS . AVATAR CUSTOMIZATION . Assessment Engine

AVATAR CUSTOMIZATION

Page 9: 3D GAMES & SIMULATIONS: THE FUTURE ASSESSMENT CENTER … · THE INCEPTION OF VIRBELA . LECTURE HALL . BUSINESS SIMULATIONS . THE CAMPUS . AVATAR CUSTOMIZATION . Assessment Engine

Assessment Engine

Simulations

• Personality

• Abilities

• Business Acumen

Page 10: 3D GAMES & SIMULATIONS: THE FUTURE ASSESSMENT CENTER … · THE INCEPTION OF VIRBELA . LECTURE HALL . BUSINESS SIMULATIONS . THE CAMPUS . AVATAR CUSTOMIZATION . Assessment Engine

• Action Learning

• Social Presence

• Sense of Autonomy

• Spatial Audio

• Big Data Assessment

• Blended Learning

• Spatial Learning

• Collaboration

• Extremely plastic (customizable)

WHY 3D VIRTUAL WORLDS?

Page 11: 3D GAMES & SIMULATIONS: THE FUTURE ASSESSMENT CENTER … · THE INCEPTION OF VIRBELA . LECTURE HALL . BUSINESS SIMULATIONS . THE CAMPUS . AVATAR CUSTOMIZATION . Assessment Engine

Assessment Design Process

Define Competencies

Identify Behavioral Anchors

Design Simulations

Triangulate Assessment

Approach

Implement

Implement and Iterate

Page 12: 3D GAMES & SIMULATIONS: THE FUTURE ASSESSMENT CENTER … · THE INCEPTION OF VIRBELA . LECTURE HALL . BUSINESS SIMULATIONS . THE CAMPUS . AVATAR CUSTOMIZATION . Assessment Engine

Law Application ASSESSMENT MODALITIES

• User profiles • Automated (e.g., simulation results) • Facilitator observation (real time or post hoc) • Peer feedback (e.g., team 360) • Self-evaluation • Multi-level analysis (time, individuals, teams, orgs.)

Page 13: 3D GAMES & SIMULATIONS: THE FUTURE ASSESSMENT CENTER … · THE INCEPTION OF VIRBELA . LECTURE HALL . BUSINESS SIMULATIONS . THE CAMPUS . AVATAR CUSTOMIZATION . Assessment Engine

AC PROOF OF CONCEPT: GLOBAL MBA

COMPETITION

Page 14: 3D GAMES & SIMULATIONS: THE FUTURE ASSESSMENT CENTER … · THE INCEPTION OF VIRBELA . LECTURE HALL . BUSINESS SIMULATIONS . THE CAMPUS . AVATAR CUSTOMIZATION . Assessment Engine

PARTICIPATING UNIVERSITIES

Page 15: 3D GAMES & SIMULATIONS: THE FUTURE ASSESSMENT CENTER … · THE INCEPTION OF VIRBELA . LECTURE HALL . BUSINESS SIMULATIONS . THE CAMPUS . AVATAR CUSTOMIZATION . Assessment Engine

Law Application GLOBAL LEADERSHIP COMPETENCY MODEL

Behavioral Competency Assessment

Personal Dimensions Leading Others Leading in a Global Environment

•Cognitive Agility •Influencing & Supporting •Global Citizenship

•Personal Resilience •Transparent Interaction •Global Leverage

•Self-Knowledge •Relationship Building •Global Governance

Page 16: 3D GAMES & SIMULATIONS: THE FUTURE ASSESSMENT CENTER … · THE INCEPTION OF VIRBELA . LECTURE HALL . BUSINESS SIMULATIONS . THE CAMPUS . AVATAR CUSTOMIZATION . Assessment Engine

Your team will take over a large, global automobile manufacturer where your objective is to build sales, improve profitability and maximize shareholder value. You will manage the company for 20 quarters or five years.

THE CHALLENGE

Page 17: 3D GAMES & SIMULATIONS: THE FUTURE ASSESSMENT CENTER … · THE INCEPTION OF VIRBELA . LECTURE HALL . BUSINESS SIMULATIONS . THE CAMPUS . AVATAR CUSTOMIZATION . Assessment Engine

Each team was assigned a professional facilitator who observed and then lead debrief sessions around team processes (e.g., decision making, conflict management, managing cultural differences)

Team Strategy & Debrief Room

Page 19: 3D GAMES & SIMULATIONS: THE FUTURE ASSESSMENT CENTER … · THE INCEPTION OF VIRBELA . LECTURE HALL . BUSINESS SIMULATIONS . THE CAMPUS . AVATAR CUSTOMIZATION . Assessment Engine

PERFORMANCE

DATA

Page 20: 3D GAMES & SIMULATIONS: THE FUTURE ASSESSMENT CENTER … · THE INCEPTION OF VIRBELA . LECTURE HALL . BUSINESS SIMULATIONS . THE CAMPUS . AVATAR CUSTOMIZATION . Assessment Engine

Captured Data COMMUNICATION PATTERNS

Page 21: 3D GAMES & SIMULATIONS: THE FUTURE ASSESSMENT CENTER … · THE INCEPTION OF VIRBELA . LECTURE HALL . BUSINESS SIMULATIONS . THE CAMPUS . AVATAR CUSTOMIZATION . Assessment Engine

PUBLICATION

Howland, A. C., Rembisz, R., Wang-Jones, T. S., Heise, S. R., Brown, S. (2015).

Developing a virtual assessment center. Consulting Psychology Journal: Practice and

Research, 67, 110-126. doi: http://dx.doi.org/10.1037/cpb0000034

Special Section: Technology and the Consulting Psychologist.

Page 22: 3D GAMES & SIMULATIONS: THE FUTURE ASSESSMENT CENTER … · THE INCEPTION OF VIRBELA . LECTURE HALL . BUSINESS SIMULATIONS . THE CAMPUS . AVATAR CUSTOMIZATION . Assessment Engine

WHERE IS THIS ALL HEADED?

Business Simulation Competition

Team Science Competencies

Distance Education Platform

Career Counseling for Transitioning Navy SEALS

Page 23: 3D GAMES & SIMULATIONS: THE FUTURE ASSESSMENT CENTER … · THE INCEPTION OF VIRBELA . LECTURE HALL . BUSINESS SIMULATIONS . THE CAMPUS . AVATAR CUSTOMIZATION . Assessment Engine

IMMERSIVE DATA VISUALIZATIONS

Page 24: 3D GAMES & SIMULATIONS: THE FUTURE ASSESSMENT CENTER … · THE INCEPTION OF VIRBELA . LECTURE HALL . BUSINESS SIMULATIONS . THE CAMPUS . AVATAR CUSTOMIZATION . Assessment Engine

HEAT MAPS

Page 25: 3D GAMES & SIMULATIONS: THE FUTURE ASSESSMENT CENTER … · THE INCEPTION OF VIRBELA . LECTURE HALL . BUSINESS SIMULATIONS . THE CAMPUS . AVATAR CUSTOMIZATION . Assessment Engine

BIO DATA

Page 26: 3D GAMES & SIMULATIONS: THE FUTURE ASSESSMENT CENTER … · THE INCEPTION OF VIRBELA . LECTURE HALL . BUSINESS SIMULATIONS . THE CAMPUS . AVATAR CUSTOMIZATION . Assessment Engine

Keyboard & Mouse

LeapMotion Hand Gesture Recognition

Wireless EEG Headset Kinect Motion Capture

Eye Tracking

MULTI-MODAL BRAIN/BODY IMAGING

Page 27: 3D GAMES & SIMULATIONS: THE FUTURE ASSESSMENT CENTER … · THE INCEPTION OF VIRBELA . LECTURE HALL . BUSINESS SIMULATIONS . THE CAMPUS . AVATAR CUSTOMIZATION . Assessment Engine

HEALTH CARE

Page 28: 3D GAMES & SIMULATIONS: THE FUTURE ASSESSMENT CENTER … · THE INCEPTION OF VIRBELA . LECTURE HALL . BUSINESS SIMULATIONS . THE CAMPUS . AVATAR CUSTOMIZATION . Assessment Engine

NEXT ITERATIONS

● Improve assessment design and backend

● Refine activities and simulations

● Develop a robust facilitator training

● Validity evidence

● Be sustainable

● Find the right partners

● Iterate, iterate, iterate

Page 29: 3D GAMES & SIMULATIONS: THE FUTURE ASSESSMENT CENTER … · THE INCEPTION OF VIRBELA . LECTURE HALL . BUSINESS SIMULATIONS . THE CAMPUS . AVATAR CUSTOMIZATION . Assessment Engine

• Getting past the avatar

• Ethical and confidentiality implications

• Reliability/validity

• State of commodity hardware & internet speeds

• Cost / scale

• Rapidly changing technology landscape

• Working across disciplines

CHALLENGES

Page 30: 3D GAMES & SIMULATIONS: THE FUTURE ASSESSMENT CENTER … · THE INCEPTION OF VIRBELA . LECTURE HALL . BUSINESS SIMULATIONS . THE CAMPUS . AVATAR CUSTOMIZATION . Assessment Engine

• Questions?

• General reactions?

• Concerns?

• Marketability?

• Use cases?

DISCUSSION