Upload
others
View
8
Download
0
Embed Size (px)
Citation preview
NON-MEDICAL USES OF BCI TECHNOLOGY
NON-MEDICAL USES OF BCI TECHNOLOGY
BRAIN-COMPUTER INTERFACE
http://www.epe.tuiasi.ro/2010/pdf/EPE2010_BCI_EN.html
OUTLINE
1. Improvements in BCI technology
2. Real-time decoding of mental states
3. BCI for entertainment
DRY ELECTRODES
1. Improvements in BCI technology
http://neurogadget.com/2011/03/21/neurofocus-reveals-mynd-the-first-wireless-full-brain-eeg-headset/1416
MINIMAL USER TRAINING
1. Improvements in BCI technology
● from training the user to machine learning● with stimuli from outside, less training● machine learning helps a lot, faster calibration
STUDY (2008):● which proportion of users can use it in the first session● 14 subjects, never used BCI● SMR-based BCI● offline calibration + online feedback
MINIMAL USER TRAINING
1. Improvements in BCI technology
MINIMAL USER TRAINING
1. Improvements in BCI technology
MINIMAL CALIBRATION:
SUBJECT INDEPENDENT CLASSIFIERS
1. Improvements in BCI technology
1. No calibration:Data from previous sessions -> classifier
2. Zero-training classifier:2009SMR-basedmany subject-dependent experiments togetherset of voting classifiers
BCI DEFICIENCY
1. Improvements in BCI technology
● for some it just doesn’t work● deficiency rate about 15-30% (SMR-based BCI)● correlations with gamma-waves found
STUDY (2010):● Cat I - successful training + successful feedback (6)● Cat II - successful training + unsuccessful feedback (2)● Cat III - unsuccessful everything (3)● online feedback calibration tried with them
BCI DEFICIENCY
1. Improvements in BCI technology
BCI DEFICIENCY
1. Improvements in BCI technology
GUIDED PRACTICE FOR A FAST-DECISION BCI
1. Improvements in BCI technology
20098 subjects
3 runs (slow->fast)
GUIDED PRACTICE FOR A FAST-DECISION BCI
1. Improvements in BCI technology
EXPLOITING PRESTIMULUS MENTAL STATES FOR BETTER BCI PERFORMANCE
1. Improvements in BCI technology
● mental states affect how we perform with BCI● some states are better for some tasks
STUDY (2010):● 30 subjects● SMR-based BCI● left-right motor imagery● split in two by prestimulus band-power (high/low)
EXPLOITING PRESTIMULUS MENTAL STATES FOR BETTER BCI PERFORMANCE
1. Improvements in BCI technology
EXPLOITING PRESTIMULUS MENTAL STATES FOR BETTER BCI PERFORMANCE
1. Improvements in BCI technology
OUTLINE
1. Improvements in BCI technology
2. Real-time decoding of mental states
3. BCI for entertainment
MENTAL STATE MONITORING2. Real-time decoding of mental states
● to optimize human performance● usually done with other measures● fatigue, emotion, workload● applications:
○ medical○ user interface evaluation○ help the user
● offline vs online
ATTENTION2. Real-time decoding of mental states
● safety-critical applications● blink and heart rate monitoring● alpha-waves - no visual information processed● detect microsleep before it
ATTENTION2. Real-time decoding of mental states
STUDY (2008):● 11 male drivers● 3 tasks:
○ K0 - fixate at a cross○ K1 - cross replaced by a video○ K2 - active driving
● sound played at the same time (high-low), had to react
RESULTS:● K2 larger reaction● alpha and gamma wave power decreased from K0-K2
MONITORING PERFORMANCE CAPABILITY2. Real-time decoding of mental states
MONITORING PERFORMANCE CAPABILITY2. Real-time decoding of mental states
WORKLOAD2. Real-time decoding of mental states
● Improve design of products.● Usability studies.
STUDY (2007):● 12 male, 5 female● driving on a highway 100 km/h (primary task)● auditory reaction every 7.5 s (left/right) (secondary task)● workload task (tertiary task)
○ mental calculation○ auditory task
WORKLOAD2. Real-time decoding of mental states
WORKLOAD2. Real-time decoding of mental states
COGNITION OF MUSIC2. Real-time decoding of mental states
STUDY (2010):● 13 subjects● major triads in root position● repeated 7-11 times before changing the chord (randomly)● subject rated the fit of the new chord on scale 1-7● neuronal patterns also analyzed
COGNITION OF MUSIC2. Real-time decoding of mental states
OUTLINE
1. Improvements in BCI technology
2. Real-time decoding of mental states
3. BCI for entertainment
MEDIA APPLICATIONS3. BCI for entertainment
MEDIA APPLICATIONS3. BCI for entertainment
GAMES CONTROLLED BY BCI ONLY3. BCI for entertainment
GAMES CONTROLLED BY BCI ONLY3. BCI for entertainment
GAMES CONTROLLED BY BCI ONLY3. BCI for entertainment
GAMES WITH ADDITIONAL INPUT FROM BCI
3. BCI for entertainment
● BCI as additional input device● needs to be working well● tailor the game to the gamer
CONCLUSION
● Have to improve BCI so that it works for all● Support human performance● Usability tests● Entertainment● What has happened in 2010 - 2014?
Thanksfor
listening!