31
Project: Muscle Fighter 서울대학교 의용전자연구실 박덕근,권성훈,김희찬 EMG application in GAME 생체 근전도 신호처리에 기반한 새로운 무선 HCI 개발에 관한 연구

EMG application in GAME - Weebly · 2018. 9. 6. · 0x02 EMG AccY 0x03 EMG AccZ 0x01 EMG AccX Firmware Data Format for RF transceiver To give EMG signal maximum sampling rate within

  • Upload
    others

  • View
    32

  • Download
    0

Embed Size (px)

Citation preview

Page 1: EMG application in GAME - Weebly · 2018. 9. 6. · 0x02 EMG AccY 0x03 EMG AccZ 0x01 EMG AccX Firmware Data Format for RF transceiver To give EMG signal maximum sampling rate within

Project: Muscle Fighter

서울대학교 의용전자연구실

박덕근,권성훈,김희찬

EMG application in GAME

생체근전도신호처리에기반한새로운무선 HCI 개발에관한연구

Page 2: EMG application in GAME - Weebly · 2018. 9. 6. · 0x02 EMG AccY 0x03 EMG AccZ 0x01 EMG AccX Firmware Data Format for RF transceiver To give EMG signal maximum sampling rate within

Contents

Introduction

Hardware

Software

Evaluation

Demonstration

Page 3: EMG application in GAME - Weebly · 2018. 9. 6. · 0x02 EMG AccY 0x03 EMG AccZ 0x01 EMG AccX Firmware Data Format for RF transceiver To give EMG signal maximum sampling rate within

Introduction

About EMG

About Fighting Action Games

Purpose of Project Muscle Fighter

Page 4: EMG application in GAME - Weebly · 2018. 9. 6. · 0x02 EMG AccY 0x03 EMG AccZ 0x01 EMG AccX Firmware Data Format for RF transceiver To give EMG signal maximum sampling rate within

About EMG

Electromyogram(EMG): recording of the electrical activity of muscle by means of surfaceor needle electrodesClinical EMG : investigation of the electrical activity of normal & diseased skeletal muscle

Page 5: EMG application in GAME - Weebly · 2018. 9. 6. · 0x02 EMG AccY 0x03 EMG AccZ 0x01 EMG AccX Firmware Data Format for RF transceiver To give EMG signal maximum sampling rate within

Schematic of the differential amplifier configurationfor EMG measurement

EMG measurement

Page 6: EMG application in GAME - Weebly · 2018. 9. 6. · 0x02 EMG AccY 0x03 EMG AccZ 0x01 EMG AccX Firmware Data Format for RF transceiver To give EMG signal maximum sampling rate within

Amplitude : stochastic(random), Gaussian distributionMagnitude : 0~10mV(peak-to-peak), 0 ~ 1.5mV(rms)Frequency range : 0~500 Hz with dominant energy in 50~150 Hz

Magnified EMG Signal

Frequency spectrum of the EMG signal detected from the Tibialis Anterior muscle during a constant force isometric contraction at 50% of voluntary maximum.

Characteristics of the EMG signal

Page 7: EMG application in GAME - Weebly · 2018. 9. 6. · 0x02 EMG AccY 0x03 EMG AccZ 0x01 EMG AccX Firmware Data Format for RF transceiver To give EMG signal maximum sampling rate within

CMRR : > 90dBInput impedance : > 100MOhmFiltering : 20∼500Hz with 12dB/oct roll-offElectrode position, distance, size, stability, etc.Active Electrode : differential amplifier close to electrode

The amplitude and frequency spectrum of the EMG signal is affected

by the location of the electrode DELSYS’s Active Electrode device

(www.delsys.com)

Electrical characteristics of the Electrode unit and Amplifiers for EMG

Page 8: EMG application in GAME - Weebly · 2018. 9. 6. · 0x02 EMG AccY 0x03 EMG AccZ 0x01 EMG AccX Firmware Data Format for RF transceiver To give EMG signal maximum sampling rate within

To determine the activation timing of the muscle (delay time from excitation)To estimate the force produced by the muscle (rms or avr value)To obtain an index of the rate at which a muscle fatigues(frequency spectrum analysis)

Initiation of activation of the EMG signal Force / EMG signal relationship Spectral modification during sustained contraction

Applications of the EMG Signal

Page 9: EMG application in GAME - Weebly · 2018. 9. 6. · 0x02 EMG AccY 0x03 EMG AccZ 0x01 EMG AccX Firmware Data Format for RF transceiver To give EMG signal maximum sampling rate within

The arrangement of the factors is designed to demonstrate the flow of the influences and interactions among the factors.

Factors affecting the EMG signal

Page 10: EMG application in GAME - Weebly · 2018. 9. 6. · 0x02 EMG AccY 0x03 EMG AccZ 0x01 EMG AccX Firmware Data Format for RF transceiver To give EMG signal maximum sampling rate within

Laptop computer

PDA

EMG AMPX 5000

Filtering Thresholding ComposingMorse Code

ASCII

Morse CodeTo Text

RS- 232

T e x t T o

S p e e c h

M o d u l e

Remote Controlleror Home

Automation

Text To Speech Module

– Seoul National University– EMG from jaw-moving muscle (Masseters)– Transformed to morse code– Communication, HCI, Remote control for machines

Communication Device for Disabled

Page 11: EMG application in GAME - Weebly · 2018. 9. 6. · 0x02 EMG AccY 0x03 EMG AccZ 0x01 EMG AccX Firmware Data Format for RF transceiver To give EMG signal maximum sampling rate within

University College LondonGraphic input device controlled by wrist motionEMG from 4 muscles processed by Neural Network

Position of the electrodes on the forearm

The Biofeedback Pointer

Page 12: EMG application in GAME - Weebly · 2018. 9. 6. · 0x02 EMG AccY 0x03 EMG AccZ 0x01 EMG AccX Firmware Data Format for RF transceiver To give EMG signal maximum sampling rate within

About Fighting Action Games

System ConfigurationControl

Advanced Skill

+ A

Making Force Blow

Command Input

Page 13: EMG application in GAME - Weebly · 2018. 9. 6. · 0x02 EMG AccY 0x03 EMG AccZ 0x01 EMG AccX Firmware Data Format for RF transceiver To give EMG signal maximum sampling rate within

Continued – new trend

Tekken

Body Simulator

Page 14: EMG application in GAME - Weebly · 2018. 9. 6. · 0x02 EMG AccY 0x03 EMG AccZ 0x01 EMG AccX Firmware Data Format for RF transceiver To give EMG signal maximum sampling rate within

Continue – new trend

Fighting Game – Based on motion

Page 15: EMG application in GAME - Weebly · 2018. 9. 6. · 0x02 EMG AccY 0x03 EMG AccZ 0x01 EMG AccX Firmware Data Format for RF transceiver To give EMG signal maximum sampling rate within

Project Muscle Fighter

Natural Control of Fighting Game

More intuitive than joystick

Skill System using accumulated force

Reasonable delay and lock

Pleasure of hitting

Page 16: EMG application in GAME - Weebly · 2018. 9. 6. · 0x02 EMG AccY 0x03 EMG AccZ 0x01 EMG AccX Firmware Data Format for RF transceiver To give EMG signal maximum sampling rate within

System Block Diagram

Amplifier On Electrode

RF transmitter

RFreceiver

Software for Analysis

Force

Accelerometer Acceleration

Game Input

Page 17: EMG application in GAME - Weebly · 2018. 9. 6. · 0x02 EMG AccY 0x03 EMG AccZ 0x01 EMG AccX Firmware Data Format for RF transceiver To give EMG signal maximum sampling rate within

Hardware

AOE

Accelerometer

RF transceiver

Page 18: EMG application in GAME - Weebly · 2018. 9. 6. · 0x02 EMG AccY 0x03 EMG AccZ 0x01 EMG AccX Firmware Data Format for RF transceiver To give EMG signal maximum sampling rate within

Amplifier on electrode

Cut off frequency30~300 Hz

Gain30~40dB

Size20x30 mm

No wireReduction of motion artifactImproved SNR

Page 19: EMG application in GAME - Weebly · 2018. 9. 6. · 0x02 EMG AccY 0x03 EMG AccZ 0x01 EMG AccX Firmware Data Format for RF transceiver To give EMG signal maximum sampling rate within

Accelerometer

Acceleration range-5g ~ +5g

Output range0 ~ 5V

Channels2 orthogonal x, y

Size15 X 23 mm

Page 20: EMG application in GAME - Weebly · 2018. 9. 6. · 0x02 EMG AccY 0x03 EMG AccZ 0x01 EMG AccX Firmware Data Format for RF transceiver To give EMG signal maximum sampling rate within

RF transceiver

Data rate 19200bpsSerial port1.5V AAA BatteryWork well in 5 m away

Page 21: EMG application in GAME - Weebly · 2018. 9. 6. · 0x02 EMG AccY 0x03 EMG AccZ 0x01 EMG AccX Firmware Data Format for RF transceiver To give EMG signal maximum sampling rate within

Software

Firmware

Analysis Software tool

Muscle Man

Page 22: EMG application in GAME - Weebly · 2018. 9. 6. · 0x02 EMG AccY 0x03 EMG AccZ 0x01 EMG AccX Firmware Data Format for RF transceiver To give EMG signal maximum sampling rate within

AccXEMG0x01AccZEMG0x03AccYEMG0x02

Firmware

Data Format for RF transceiver

To give EMG signal maximum sampling rate within 19200 bps

EMG signal sampling rate 500Hz

Accelerometer signal sampling rate is 500/3 for each axis

AccXEMG0x01

Page 23: EMG application in GAME - Weebly · 2018. 9. 6. · 0x02 EMG AccY 0x03 EMG AccZ 0x01 EMG AccX Firmware Data Format for RF transceiver To give EMG signal maximum sampling rate within

Analysis Software tool

Realtime display and recordingOff-line analysis

RMS valuePower spectrum analysis

Programmed withLabView

Page 24: EMG application in GAME - Weebly · 2018. 9. 6. · 0x02 EMG AccY 0x03 EMG AccZ 0x01 EMG AccX Firmware Data Format for RF transceiver To give EMG signal maximum sampling rate within

Muscle Man

EMG analysisForce

Acceleration

Mouse, Keyboard emulation

Page 25: EMG application in GAME - Weebly · 2018. 9. 6. · 0x02 EMG AccY 0x03 EMG AccZ 0x01 EMG AccX Firmware Data Format for RF transceiver To give EMG signal maximum sampling rate within

Force estimation

Root mean squareWindow size 200 msec = 100 sample

Capacitor modelUser accumulates force by contraction

Force gauge discharges with time constant

More force, more fast charging !!

RF noise and EMG difference in people is barrier to practical use.

Page 26: EMG application in GAME - Weebly · 2018. 9. 6. · 0x02 EMG AccY 0x03 EMG AccZ 0x01 EMG AccX Firmware Data Format for RF transceiver To give EMG signal maximum sampling rate within

Acceleration analysis

We just used one axis in determining when the user moved his hand.

Simple algorithm based on threshold and delay

More study is needed to determine more type of action, for example, hook.

Page 27: EMG application in GAME - Weebly · 2018. 9. 6. · 0x02 EMG AccY 0x03 EMG AccZ 0x01 EMG AccX Firmware Data Format for RF transceiver To give EMG signal maximum sampling rate within

Total System Developed

Page 28: EMG application in GAME - Weebly · 2018. 9. 6. · 0x02 EMG AccY 0x03 EMG AccZ 0x01 EMG AccX Firmware Data Format for RF transceiver To give EMG signal maximum sampling rate within

Advantage

It makes fun!

It is easy to understand and use

Page 29: EMG application in GAME - Weebly · 2018. 9. 6. · 0x02 EMG AccY 0x03 EMG AccZ 0x01 EMG AccX Firmware Data Format for RF transceiver To give EMG signal maximum sampling rate within

Drawback

Sticky electrode

Different result for different people

Wrong reaction resulting from noise

Page 30: EMG application in GAME - Weebly · 2018. 9. 6. · 0x02 EMG AccY 0x03 EMG AccZ 0x01 EMG AccX Firmware Data Format for RF transceiver To give EMG signal maximum sampling rate within

Future Works

Insert calibration module at start up to make more reasonable decision

Get more information from accelerometer signals

Make electrode easy and robust

Develop game software designed for this interface

Page 31: EMG application in GAME - Weebly · 2018. 9. 6. · 0x02 EMG AccY 0x03 EMG AccZ 0x01 EMG AccX Firmware Data Format for RF transceiver To give EMG signal maximum sampling rate within

Demonstration