From Students…

…to Professionals

The Capstone Experience

Beta PresentationAugmented Reality Mechanic Training

Department of Computer Science and EngineeringMichigan State University

Fall 2018

Team Union PacificJustin Barber

Jake CousineauColleen Little

Nicholas MacDonaldLuke Sperling

Project Overview

• Two immersive training experiences for mechanics

• Learn About Machinery (HoloLens + PC)

View labeled holograms of CAD models

Select parts to display information

Import CAD models through PC application

• Build a Train (Android)

Guides user through assembling a 3D printed train

Uses object recognition to locate train cars

The Capstone Experience Team Union Pacific Beta Presentation 2

System Architecture

The Capstone Experience Team Union Pacific Beta Presentation 3

System Architecture

The Capstone Experience Team Union Pacific Beta Presentation 4

Learn About Machinery: HoloLens Main Menu

The Capstone Experience Team Union Pacific Beta Presentation 5

Learn About Machinery: Key Part Information

The Capstone Experience Team Union Pacific Beta Presentation 6

Learn About Machinery: Model Manipulation

The Capstone Experience Team Union Pacific Beta Presentation 7

Learn About Machinery Portal

The Capstone Experience Team Union Pacific Beta Presentation 8

Build a Train: Instructions

The Capstone Experience Team Union Pacific Beta Presentation 9

Build a Train: User Error

The Capstone Experience Team Union Pacific Beta Presentation 10

Build a Train: Tutorial Complete

The Capstone Experience Team Union Pacific Beta Presentation 11

What’s left to do?

• More extensive error handling and optimization of Learn About Machinery networking code

• Distinctive sound/vibration when errors detected in Build a Train

• User interface cleanup

• Final style guide pass on project code

The Capstone Experience Team Union Pacific Beta Presentation 12

Questions?

The Capstone Experience Team Union Pacific Beta Presentation 13

?

? ??

?

?

?

?

?