Toward Brain-Computer Interfacing

edited by Guido Domhege Jose del R. Millän Thilo Hinterberger Dennis J. McFarland Klaus-Robert Müller

foreword by Terrence J. Sejnowski

A Bradford Book

The MIT Press Cambridge, Massachusetts London, England

Contents

Foreword ix

Terrence J. Sejnowski

Preface xi

1 An Introduction to Brain-Computer Interfacing 1 Andrea Kubier and Klaus-Robert Müller

1 BCI Systems and Approaches 27

2 Noninvasive Brain-Computer Interface Research at the Wadsworth Center 31 Eric W. Seilers, Dean J. Krusienski, Dennis J. McFarland, and Jonathan R. Wolpaw

3 Brain-Computer Interfaces for Conununication in Paralysis: A Clinical Experimental Approach 43

Thilo Hinterberger, Femke Nijboer, Andrea Kubier, Tamara Matuz, Adrian Furdea, Ursula Mochty, Miguel Jordan, Thomas Navin Lal, N. Jeremy Hill, Jürgen Mellinger, Michael Bensch, Michael Tangermann, Guido Widman, Christian E. Elger, Wolfgang Rosenstiel, Bernhard Schölkopf, and Niels Birbaumer

4 Graz-Brain-Computer Interface: State of Research 65 Gert Pfurtscheller, Gernot R. Müller-Putz, Alois Schlögl, Bernhard Graimann, Reinhold Scherer, Robert Leeb, Clemens Brunner, Claudia Keinrath, George Townsend, Carmen Vidaurre, Muhammad Naeem, Felix Y. Lee, Seiina Wriessnegger, Doris Zimmermann, Eva Höfler, and Christa Neuper

VI Contents

5 The Berlin Brain-Computer Interface: Machine Learning-Based Detection of User Specific Brain States 85

Benjamin Blankertz, Guido Dornhege, Matthias Krauledat, Volker Kunzmann, Florian Losch, Gabriel Curio, and Klaus-Robert Müller

6 The IDIAP Brain-Computer Interface: An Asynchronous Multiclass Approach 103

Jose del R. Millän, Pierre W. Ferrez, and Anna Buttfield

7 Brain Interface Design for Asynchronous Control 111 Jaimie F. Borisoff, Steve G. Mason, and Gary E. Birch

II Invasive BCI Approaches 123

8 Electrocorticogram as a Brain-Computer Interface Signal Source . . . . 129 Jane E. Huggins, Bernhard Graimann, Se Young Chun, Jeffrey A. Fessler, and Simon P. Levine

9 Probabilistically Modeling and Decoding Neural Population Activity in Motor Cortex 147

Michael J. Black and John P. Donoghue

10 The Importance of Online Error Correction and Feed-Forward Adjustments in Brain-Machine Interfaces for Restoration of Movement 161

Down M. Taylor

11 Advances in Cognitive Neural Prosthesis: Recognition of Neural Data with an Information-Theoretic Objective 175

Zoran Nenadic, Daniel S. Rizzuto, Richard A. Andersen, and Joel W. Burdick

12 A Temporal Kernel-Based Model for Tracking Hand Movements from Neural Activities 191

Lavi Shpigelman, Koby Crammer, Rony Paz, Eilon Vaadia, and Yoram Singer

III BCI Techniques 203

13 General Signal Processing and Machine Learning Tools for BCI Analysis 207 Guido Dornhege, Matthias Krauledat, Klaus-Robert Müller, and Benjamin Blankertz

Contents vu

14 Classifying Event-Related Desynchronization in EEG, ECoG, and MEG Signals 235

N Jeremy Hill, Thomas Navin Lal, Michael Tangermann, Thilo Hinterberger, Guido Widman, Christian E. Elger, Bernhard Schölkopf, and Niels Birbaumer

15 Classification of Time-Embedded EEG Using Short-Time Principal Component Analysis 261

Charles W. Anderson, Michael J. Kirby, Douglas R. Hundley, and James N. Knight

16 Noninvasive Estimates of Local Field Potentials for Brain-Computer Interfaces 279

Rolando Grave de Peralta Menendez, Sara Gonzalez Andino, Pierre W. Ferrez, and Jose del R. Millän

17 Error-Related EEG Potentials in Brain-Computer Interfaces 291 Pierre W. Ferrez and Jose del R. Millän

18 Adaptation in Brain-Computer Interfaces 303 Jose del R. Millän, Anna Buttfield, Carmen Vidaurre, Matthias Krauledat, Alois Schlögl, Pradeep Shenoy, Benjamin Blankertz, Rajesh P. N. Rao, Rafael Cabeza, Gert Pfurtscheller, and Klaus-Robert Müller

19 Evaluation Criteria for BCI Research 327 Alois Schlögl, Julien Kronegg, Jane E. Huggins, and Steve G. Mason

IV BCI Software 343

20 BioSig: An Open-Source Software Library for BCI Research 347 Alois Schlögl, Clemens Brunner, Reinhold Scherer, and Andreas Glatz

21 BCI2000: A General-Purpose Software Platform for BCI 359 Jürgen Mellinger and Gerwin Schalk

V Applications 369

22 Brain-Computer Interfaces for Communication and Motor Control—Perspectives on Clinical Applications 373

Andrea Kubier, Femke Nijboer, and Niels Birbaumer

viii Contents

23 Combining BCI and Virtual Reality: Scouting Virtual Worlds 393 Robert Leeb, Reinhold Scherer, Down Friedman, Felix Y. Lee, Claudia Keinrath, Horst Bischof, Mel Slater, and Gert Pfurtscheller

24 Improving Human Performance in a Real Operating Environment through Real-Time Mental Workload Detection 409

Jens Kohlmorgen, Guido Dornhege, Mikio L. Braun, Benjamin Blankertz, Klaus-Robert Müller, Gabriel Curio, Konrad Hagemann, Andreas Bruns, Michael Schrauß and Wilhelm E. Kincses

25 Single-lrial Analysis of EEG during Rapid Visual Discrimination: Enabling Cortically Coupled Computer Vision 423

Paul Sajda, Adam D. Gerson, Marios G. Philiastides, and Lucas C. Parra

References 441

Contributors 491

Index 503