Vision Restoration, Neural Circuits, and Virtual RealityCenter for Visual Science

David Williams

Three Concepts:

Vision Restoration

Large Scale Recording of Neural Activity

Underlying Behavior

Virtual and Augmented Reality

Vision Restoration

Refractive error

correction

Ocular surface health

Protect Correct

Behavioral visual

rehabilitation

www.shutterstock.com

Restore

Retina

Replace

Behavioral visual

rehabilitation

www.shutterstock.com

Vision RestorationPotential synergies and expansion into Center of Excellence

Vision RestorationPotential synergies and expansion into Center of Excellence

Behavioral visual

rehabilitation

Krystel Huxlin, FEIDuje Tadin, BCS

Bogachan Sahin, Neurology

Animal modelsJude Mitchell, BCS

Tania Pasternak, NSCAnia Majewska, NSC

Human electrophysiologyJohn Foxe, Neurosci.

Richard Aslin, BCS

Advanced brain imaging

Brad Mahon, BCS

Advanced retinal imaging

David Williams, OpticsJennifer Hunter, FEI

Mina Chung, FEIBill Merigan, FEI

And its neural

substrates

Vision Restoration

Protecting cells from injury

Correctinggenetic errors

www.shutterstock.com

Restoring light detection

Retina

Replacing cells & circuits

Vision Restoration

Protecting cells from injury

Correctinggenetic errors

Restoring light detection

Retina

Replacing cells & circuits

Rick LibbyJesse Schallek

*Jennifer Hunter*Bill Merigan

(FEI)*David Williams

(Optics)

Lin GanAmy KiernanRuchira Singh

(FEI)

*Bill Merigan*Jennifer Hunter

(FEI)*David Williams

(Optics)

Ruchira Singh(FEI)

*Audacious Goals InitiativeExample of large, collaborative project grant

Jennifer Hunter, FEI

David GammUniv. Wisconsin

Connie CepkoHarvard Medical School

Botond RoskaFriedrich Miescher Institute

for Biomedical Research

National Eye InstituteAudacious Goals Initiative grant $3.8M

Bill Merigan, FEI

David Williams, PI

Large scale recording of neural activity underlying behavior

- Record 10,000+ neurons simultaneously in vivo

within and between brain areas during behavior

- Understand how single cell and network activity

interact to determine behavior in health and

disease

- Establish interdisciplinary collaborations to

develop new techniques for recording from

neural networks in behaving animals

- Capitalize on UR strengths in systems

neuroscience, in vivo imaging, optical technique

development, data analysis

- Test computational theories of neural coding with

unprecedented power

- Align with federal funding initiatives.

Recording neural activity in behaving animalsLaurel CarneyGreg DeAngelisCharles DuffyBen HaydenKen HenryChris HoltKrystel HuxlinJohn MinkJude MitchellTania PasternakLiz RomanskiMarc Schieber

In vivo imaging of single brain cellsHandy Gelbard Steve GoldmanJennifer HunterAnia MajewskaBill MeriganMaiken NedergaardKrishnan PadmanabhanJesse SchallekTakahiro TakanoDavid Williams

Optical technique/probe developmentAndrew Berger

Ed BrownJim FineupTom Foster

Wayne KnoxTodd KraussBen Miller

Duncan MooreJannick RollandLewis Rothberg

Roman SobolewskiJim Zavislan

Data analysisSandhya Dwarkadas

Ralf HaefnerHenry Kautz

Ji LiuJiebo Luo

Guarav SharmaCenter for Imaging Science, RIT

Virtual and Augmented Reality

Industry is now driving a

renaissance in multisensory science

Apple, Facebook (Oculus), Google

MagicLeap, Samsung…...

15th century eyeglasses

Side pieces for ears were

not invented until 1730

Optical te

chnolo

gy

Handheld

Detail of Hugh of St. Cheri

Crivelli, 1352

15th century eyeglasses

Side pieces for ears were

not invented until 1730

Optical te

chnolo

gy

Handheld Headmounted

Crivelli (1352)

Detail of Hugh of St. Cheri

Crivelli, 1352

15th century eyeglasses

Side pieces for ears were

not invented until 1730

Optical te

chnolo

gy

Handheld Headmounted Biointegrated

Crivelli (1352)

Detail of Hugh of St. Cheri

Crivelli, 1352

15th century eyeglasses

Side pieces for ears were

not invented until 1730

Optical te

chnolo

gy

Dig

ita

l te

chnolo

gy

Handheld Headmounted Biointegrated

Crivelli (1352)

Detail of Hugh of St. Cheri

Crivelli, 1352

15th century eyeglasses

Side pieces for ears were

not invented until 1730

Optical te

chnolo

gy

Dig

ita

l te

chnolo

gy

Handheld Headmounted Biointegrated

Crivelli (1352)

Detail of Hugh of St. Cheri

Crivelli, 1352

15th century eyeglasses

Side pieces for ears were

not invented until 1730

Optical te

chnolo

gy

Dig

ita

l te

chnolo

gy

Handheld Headmounted Biointegrated

Crivelli (1352)

Detail of Hugh of St. Cheri

Crivelli, 1352

15th century eyeglasses

Side pieces for ears were

not invented until 1730

Optical te

chnolo

gy

Dig

ita

l te

chnolo

gy

Handheld Headmounted Biointegrated

The Matrix

Crivelli (1352)

AS& E Deans OfficeDavid Williams, Dean of Research*

Brain and Cognitive SciencesGregory DeAngelis, Chairman*Jude Mitchell*Robert JacobsBradford Mahon*Michele RucciDuje Tadin*

Computer Science/Institute of Data ScienceHenry Kautz, Director, Institute for Data ScienceJeibo LuoEhsan HoqueJi LiuScott SteeleChenliang Xu

Electrical & Computer EngineeringMark Bocko, ChairmanGaurav SharmaZhuyao Duan

EnglishGregory Heyworth

Flaum Eye InstituteKrystel Huxlin*Geunyoung Yoon

HistoryMichael Jarvis

Institute of OpticsJannick RollandNick VamivakasJen KruschwitzDuncan Moore

NeuroscienceJohn Foxe*Brad BerkLaurel Carney*Edmund LalorRoss Maddox*Martina PolettiTania Pasternak*Marc Schieber*

OrthopedicsDavid Mitten, MD

Physics & AstronomyJohn Howell

*NGP Faculty

Elements of a Plan:

• Faculty Hiring.

• Establish corporate partnerships through master agreements

• Define individual and collaborative research projects

• Graduate student and postdoctoral training

• Leverage CEIS.

• Seek Federal Funds (ERC or STC?)

• Host symposia (the Engineering the Eye Series)

• Create a new research platform (Anechoic chamber for Multisensory research?)

• Create a new center?

• Kick-off meeting: December 14, Genesee Valley Club, 9-1 pm