PowerPoint Presentation

Jay MulakalaMay 5th, 2015

Bretl Research GroupNeuromuscular Adaptations to Human Computer Interfaces

Good afternoon, My name is Jay Mulakala. A senior working with David Hanley. Today I will be presenting my research on Neuromuscular adaptations to Human computer interfaces, particularly with quad copters. 1

Understand neuromuscular adaptations in a variety of applicationsUnderstand Human Computer Interfaces in a variety of applicationsResearch current issues affecting construction workersDesign a pilot in the loop controller for the Parrot AR DroneDesign a pilot in the loop controller for the Asctec HummingbirdResearch Goals

#

This research was motivated by my interest in human computer interfaces and applications of HCI using quadcopters. To conduct my research, I set out to understand 2

Neuromuscular Adaptations OverviewNeuromuscular AdaptationsAdaptive Robot Co-WorkersExercise, Training, and RehabilitationRobotic VehiclesAutonomousManualDrivers

Current human-robot interactions require physical contact between the operator and machine, creating a coupled dynamic system

Neuromuscular adaptations in human-robot interactions allow for increased control and stability through an HCI

#

Through my research, I discovered various applications of neuromuscular technologies, from adaptive robot co-workers to exercise, robot vehicles, and even drivers. This area emphasizes the importance of increased control and stability in human-robot interactions.3

Human Computer Interaction OverviewPrinciples behind HCIEarly focus on users and tasksDetermine appropriate usersEmpirical MeasurementQuantify resultsIterative DesignDesignTestAnalyzeRepeat

Human Computer Interaction is the fusion of computer technology, with a focus on interfaces between people and computers

Human Computer Interaction is situated at the intersection of computer science, behavioral sciences, design, and media study

#

I then dove into the principles behind human computer interfaces. The primary principles behind these interfaces include early focus on users and tasks, numerical or empirical measurement of results throughout the process, and overall iterative design. One recent technology that provides a seamless experience and neuromuscular feedback is the myo.4

Myo Armband Overview

Using proprietary EMG sensors, the Myo measures electrical activity from muscles to detect poses made by your hands. Using a9-axis IMU, itsenses the motion, orientation and rotation of your forearm.

#

The myo armband uses propriety emg sensors to measure electrical activity from muscles to detect poses made by your hand. It even includes 9-axis IMU to determine motion, orientation, and rotation. 5

Muscle (EMG) Activity - Electromyography

ElectromyographyMedicine techniqueEvaluates and records electrical activity from skeletal musclesUsed to detect:Medical abnormalitiesActivation levelsRecruitment orders

MyoUses electromyography as an inputUses FCU and ECU muscles as a controller

#

It uses a technique called electromyography, a medicine technique that evaluates and records electrical activity from skeletal muscles. The myo uses this feedback as inputs for the controller.6

OV1 Diagram

Myo sends inputs to computerGUI sends and receives data from quadcopter

#

My research was focused on using this technology to control the asctec hummingbird, allowing operators to much more intuitively control a quadcopter. In this project, I programmed the myo to communicate with the quadcopter through a desktop based GUI. Unfortunately, due to time constraints, I wasnt able to control the asctec hummingbird, but was able to control the Parrot AR drone. Here is a quick demo.7

#

Using the myo armband, I was successfully able to control the quadcopter using hand gestures. I had control over the yaw and pitch of the quad, while the roll and altitude were kept constant. Waving my hand left or right caused the quadcopter to yaw left or right. A closed fist caused the quadcopter to pitch backward, and an open fist caused the quadcopter to pitch forward. Using this research, construction works would be able to priciseley navigate through tight spaces and areas where autonomous control just wont be enough. Future research will use the IMUs the control the quadcopter by simply moving your arm, instead of gestures.8

Jay Mulakalammulak2@illinois.eduNeuromuscular Adaptations to Human Computer InterfacesQuestions?

Referenceshttp://www.pilarmartinescudero.es/dic13/Performance_and_Neuromuscular_Adaptations.15.pdfhttp://www.slideshare.net/danesmith_1/neuromuscular-adaptations-to-traininghttp://www.cognitiveengineering.gatech.edu/presentations/nri-pi-2014-understanding-neuromuscular-adaptations-human-robot-physical-interactionhttp://www.cognitiveengineering.gatech.edu/projects/nsf-nri-small-understanding-neuromuscular-adaptations-human-robot-physical-interactionhttp://arxiv.org/pdf/1301.0043.pdfhttp://www.cs.cmu.edu/~illah/PAPERS/ahs.pdf

#

#