14
CNS Speech Lab Dept. of Cognitive and Neural Systems Boston University Frank Guenther, Ph.D Director

CNS Speech Lab Dept. of Cognitive and Neural Systems Boston University Frank Guenther, Ph.D Director

Embed Size (px)

Citation preview

Page 1: CNS Speech Lab Dept. of Cognitive and Neural Systems Boston University Frank Guenther, Ph.D Director

CNS Speech LabDept. of Cognitive and Neural Systems

Boston University

Frank Guenther, Ph.DDirector

Page 2: CNS Speech Lab Dept. of Cognitive and Neural Systems Boston University Frank Guenther, Ph.D Director
Page 3: CNS Speech Lab Dept. of Cognitive and Neural Systems Boston University Frank Guenther, Ph.D Director

Modeling the Neural Bases of SpeechCNS Speech Lab Boston University

Our mission: We create neural network models that characterize speech processes.

Projects: The DIVA ModelDIVA, or Directions Into Velocities of Articulators, is a neural network model of speech acquisition and production. Through psychophysical and imaging experiments, we gather information about the nature of speech processing and the mechanisms for speech motor skill acquisition. This information is integrated into the model to create a unified account of a wide range of speech data.

Page 4: CNS Speech Lab Dept. of Cognitive and Neural Systems Boston University Frank Guenther, Ph.D Director

DIVA DemosBabbling

The model produces self-generated speech sounds by randomly varying free parameters and receives auditory feedback, thus learning the relationship between motor actions and their acoustic consequences.

Page 5: CNS Speech Lab Dept. of Cognitive and Neural Systems Boston University Frank Guenther, Ph.D Director

DIVA DemosBabbling

The model produces self-generated speech sounds by randomly varying free parameters and receives auditory feedback, thus learning the relationship between motor actions and their acoustic consequences.

Page 6: CNS Speech Lab Dept. of Cognitive and Neural Systems Boston University Frank Guenther, Ph.D Director

DIVA DemosBabbling

The model produces self-generated speech sounds by randomly varying free parameters and receives auditory feedback, thus learning the relationship between motor actions and their acoustic consequences.

Page 7: CNS Speech Lab Dept. of Cognitive and Neural Systems Boston University Frank Guenther, Ph.D Director

DIVA DemosReduplicated Babbling

When DIVA moves its jaw up and down, its babbling sounds like the beginnings of real speech.

Page 8: CNS Speech Lab Dept. of Cognitive and Neural Systems Boston University Frank Guenther, Ph.D Director

DIVA DemosReduplicated Babbling

When DIVA moves its jaw up and down, its babbling sounds like the beginnings of real speech.

Page 9: CNS Speech Lab Dept. of Cognitive and Neural Systems Boston University Frank Guenther, Ph.D Director

Learning to speak

The first attempt is an approximation of the

utterance “good doggie.”

DIVA Demos

After several iterations, DIVA does a good job of repeating the utterance.

First, DIVA listens to the utterance “good doggie.”

Page 10: CNS Speech Lab Dept. of Cognitive and Neural Systems Boston University Frank Guenther, Ph.D Director

DIVA DemosStuttering

By introducing disruptions in the feedback control, we can use DIVA to study dysfluencies, or errors in speech control, such as those that occur during stuttering.

Page 11: CNS Speech Lab Dept. of Cognitive and Neural Systems Boston University Frank Guenther, Ph.D Director
Page 12: CNS Speech Lab Dept. of Cognitive and Neural Systems Boston University Frank Guenther, Ph.D Director

MGH Center forLaryngeal Surgery and

Voice Rehabilitation

Steven M. Zeitels, M.D., FACS

Robert E. Hillman, Ph.D, CCC-SLP

Director

Co-Director/Research Director

Page 13: CNS Speech Lab Dept. of Cognitive and Neural Systems Boston University Frank Guenther, Ph.D Director
Page 14: CNS Speech Lab Dept. of Cognitive and Neural Systems Boston University Frank Guenther, Ph.D Director