45
MT5009 BIONIC EYES Ler Ming Lim A0098570U Coline Michele Juin A0104445N Ka Mung Chee A0098573M Hanisah Hannifah Gupta A0098462U Kah Heng Cheng A0082075H Gary Ho Wai Chi A0082062N For information on other new technologies that are becoming economically feasible, see http://www.slideshare.net/Funk98/presentations

Bionic eye

Embed Size (px)

Citation preview

Page 1: Bionic eye

MT5009 BIONIC EYES

Ler Ming Lim A0098570U

Coline Michele Juin A0104445N

Ka Mung Chee A0098573M

Hanisah Hannifah Gupta A0098462U

Kah Heng Cheng A0082075H

Gary Ho Wai Chi A0082062N

For information on other new technologies that are becoming economically feasible,

see http://www.slideshare.net/Funk98/presentations

Page 2: Bionic eye

Presentation Outline

1. How it works

2. Important technological components

i. Electrodes implanted on the eye

ii. Camera Sensor Technology

iii. Video processing unit/Interface to the brain (light-> electrical

signals)

iv. Radio transmitter/antenna

3. Important dimensions of performance

i. surgery time, overall factors

4. Important dimensions of overall cost

5. Improvements/Future opportunities

Page 3: Bionic eye

How a Human eye works

Page 4: Bionic eye

Common Vision Problems

• Problems with the eyes

• Structural

• Solved with corrective eyewear/eye surgery

• Retina / macula => affects light processing

functions

• Cannot be solved with correcive eyewear/surgery

• Bionic eye?

No cure

Page 5: Bionic eye

Types of Visual Prostheses

Based on neuronal electrical stimulation at

different locations along the visual pathway

• cortical

• optic nerve

• epiretinal

• subretinal Retinal

prosthesis is the

most advanced

visual prosthesis

to date

Page 6: Bionic eye

ARGUS II – Most Advanced Retinal Prosthesis

ARGUS II epiretinal implant

largest study of a retinal prosthesis

more than 60 subject years of implant

experience with this device

only FDA-approved study

only retinal implant to get a CE mark

to be sold as a medical device in

Europe

Developed by Second Sight Medical

Products Inc

http://www.youtube.com/watch?featur

e=player_detailpage&v=Bi_HpbFKnS

w

Page 7: Bionic eye

Argus II- How does it work?

Source/ http://youtu.be/Bi_HpbFKnSw

Page 8: Bionic eye

Argus II - How does it work?

Page 9: Bionic eye

What Do Users See?

Source: NY Times, Device Offers Partial Vision for the Blind

Page 10: Bionic eye

Components of Bionic Eye

Camera

Video

Processor

Wireless

Electrodes

Page 11: Bionic eye

Component: Camera Sensor Technology

Camera

Page 12: Bionic eye

Camera Image Sensor Technology

• CMOS Image Sensor has photo diodes (PD), same as CCD Image

Sensor. But there is difference in the mechanism of transmitting

electrons.

• CMOS transmit electrons using the wire;

• Charged Coupled Device aka CCD itself.

• The colored elements in the figure correspond the pixels; In color

cameras, they are usually filtered red, blue and green.

Page 13: Bionic eye

Monochrome (1-bit)

2-bit Grayscale

4-bit Grayscale

8-bit Grayscale

Monochrome Palettes

Page 14: Bionic eye

Camera Module Scaling

Sources: http://image-sensors-world.blogspot.sg/2011/11/st-published-its-tsv-camera-module.html

http://www.chicony.com.tw/products/cm_module/cm.html

Page 15: Bionic eye

Component: Video processing unit

Video

Processor

Page 16: Bionic eye

Video-processing process

Example of

4*4 matrix of

electrode

Current prosthetics use electrodes of optogenetic transducers to allow

users to perceive, as most, "spots of light or high-contrast edges.“ 1

Source: 1) Journal Proceedings of the National Academy of Sciences.

Step 1: simplify the

image => making

just black and white

Step 2: reduce that

image to the

number of

electrode available

Page 17: Bionic eye

Video processor will benefit from IC/SOC

improvement

• As discussed in Lectures, improvements in:

• Costs

• Performances, respond time (need to be real time)

• Size

• Power consumption

Sources: “Bionic eyes”, Anonymous, The Futurist; Sep-Oct 1993; 27, 5; ProQuest, pg. 53

Example of decrease in size: From Argus II to Multi-unit Artificial Retina Chipset

(photosensing, processing, and stimulating chip , 2mm * 2mm)

Page 18: Bionic eye

Improvement of video processing

Original image

Image (reconstructed) for a blind retina

Standard

Optogenetic

prosthetic

Encoder-ChR2

prosthetic

Source: “Retinal prosthetic strategy with the capacity to restore normal vision” Sheila Nirenberg1 and Chethan Pandarinath

Page 19: Bionic eye

Component: Wireless transmission

Wireless

Page 20: Bionic eye

Wireless transmission of Image + Power

Source: Building the bionic eye: an emerging reality and opportunity, Lotfi B. Merabet (2011)

Page 21: Bionic eye

Planned Changes to Marketed Version

of the Systems

Planned Changes:

• Edge of coil suture tab

rounded slightly

• Changed the radio

frequency at which the

glasses communicate to

meet new international

radio communication

standards

• Modified the implant chip

to improve wireless

efficiency

• Externals modified

to improve ergonomics and

ease of programming

Source: INTRAOCULAR RETINAL PROSTHESIS, BY Mark S. Humayun, MD, PhD (2011)

Page 22: Bionic eye

Key Performance Factor

• Surgical Consideration

• Feature size

• Wireless speed, Penetration

• Data integrity

Page 23: Bionic eye

512-Channel Intraocular Epiretinal Implant

Technologies Basic Methods of Improvement

Parylene Flex

Technology. IC chip

•Scale down thanks to high-density multi-channel

integration chip

•Improve wireless penetration and data integrity

•Low cost (wafer size scale up)

3-coil wireless power

transfer

and data coil

interference system

•High signal processing power

•High efficiency up to 36.5%

•Improve safety margin for surgical consideration

Source: PACKAGING STUDY FOR A 512-CHANNEL INTRAOCULAR EPIRETINAL IMPLANT, Jay Han-Chieh Chang (2012)

Page 24: Bionic eye

High-Density Multi-channel Chip

Integration - Parylene Flex Technology

Fabrication process of the Parylene-

C flexible circuit board.

Process flow of conductive epoxy

squeegee technique to make electrical

and mechanical connections between

Parylene flex and chips

Source: PACKAGING STUDY FOR A 512-CHANNEL INTRAOCULAR EPIRETINAL IMPLANT, Jay Han-Chieh Chang (2012)

Page 25: Bionic eye

3 Coil Wireless Power Transfer

and Data Coil Interference

The 3-coil scheme for inductive

power transfer. A model of the coil system is built

using HFSS for the coil

interference analysis

Source: PACKAGING STUDY FOR A 512-CHANNEL INTRAOCULAR EPIRETINAL IMPLANT, Jay Han-Chieh Chang (2012)

Page 26: Bionic eye

Component: Microelectrode Array

Electrodes

Page 27: Bionic eye

Microelectrode Array

-Electrode is implanted in the

inner surface of retina

-Conductive tips of each

electrode reside in the

ganglion cell layer

- Electrodes are made by

MEMs

Page 28: Bionic eye

Key Performance Factors

Resolution

Electrode-retina interface performance

Material biocompatibility & Stability

Page 29: Bionic eye

Resolution & Pixel size

Better vision

with smaller

pixel size

Source: Photovoltaic Retina Prosthesis for restoring sight to the blind, Daniel Palanker (2012)

Page 30: Bionic eye

How the eye sight looks, 300um

Source: Photovoltaic Retina Prosthesis for restoring sight to the blind, Daniel Palanker (2012)

Page 31: Bionic eye

How the eye sight looks, 30um

Source: Photovoltaic Retina Prosthesis for restoring sight to the blind, Daniel Palanker (2012)

Page 32: Bionic eye

How the eye sight looks, 30um

Source: Photovoltaic Retina Prosthesis for restoring sight to the blind, Daniel Palanker (2012)

Page 33: Bionic eye

How the eye sight looks, 10um

Source: Photovoltaic Retina Prosthesis for restoring sight to the blind, Daniel Palanker (2012)

Page 34: Bionic eye

How the eye sight looks, 3um

Source: Photovoltaic Retina Prosthesis for restoring sight to the blind, Daniel Palanker (2012)

Page 35: Bionic eye

No. of electrodes have Improved

Made possible by reduction in scale in MEMs manufacturing

Normal vision = more than one hundred million receptors in each eye

Source: The Artificial Retina Progress Report, Craig Blackwell MD (2011)

Page 36: Bionic eye

Are there Physical Limits to Electrode size?

• optimal size of an

electrode should be

comparable to the

cellular size (L ≈ 10

μm), i.e. its radius ro

should be about 5μm.

Electrode

• Charge transfers-

changes of the

electrodes from

positive to negative-

flow of electrons into

the tissue

Source: Electrode-cellular interface. Science .10 April 2009. Vol 324 )

Page 37: Bionic eye

Distance of Electrode to Cells

• Distance between

electrode and retina

is most critical!

• Large distance

requires high charge

for stimulation

• Causes heating of

the tissue

Source: Electrode-cellular interface. Science .10 April 2009. Vol 324 )

Page 38: Bionic eye

Improvement in MEMs Technology

1. 3D Geometry

• Pillar electrode arrays

• Penetrating electrodes

2. Coating to improve electrochemical

performance

• Polymer coating

http://neurotechzone.com/posts/292

Source: Conducting polymers for neural interfaces: Challenges in developing an effective long-term implant. Biomaterials

Volume 29, Issues 24–25, August–September 2008, Pages 3393–3399

Page 39: Bionic eye

Better Materials for Micro-electrode Arrays

Traditional New

Material Metal electrodes (Ir, Pt

or Au)

Nanocrystalline

diamond

Charge Transfer Passive, good

conductor

Good conductor

Contact to neurons Not Optimal, may

cause electrode

degeneration

Good biocompatibility

and bio stability

Does not get degraded

3D shaped mechanically flexible diamond microelectrode arrays for eye implant applications: The MEDINAS project

E - The Development of a Retinal Prosthesis: A Significant Biomaterials Challenge

Page 40: Bionic eye

Improvements and future opportunities

Page 41: Bionic eye

Entrepreneurial Opportunities

US $150,000 4 hours of surgery

Black & White Vision

Improve Resolution Performance

Improve Other Vision Problems

Page 42: Bionic eye

0

200

400

600

800

1000

1200

2000 2010 2020

Nu

mb

er

of

Ele

ctr

od

es

Year

Electrode trend

Argus I

Argus II

Bionic Vision Australia, Wide View Device

Bionic Vision Australia, High Acuity Device

Improvements in Resolution Performance

Source: Bionic Vision Australia, Argus websites

Page 43: Bionic eye

Improvements in Cost

$0

$50,000

$100,000

$150,000

$200,000

2013 2015 2020 2030

Cost Projection of Bionic Eye

Estimated Cost Breakdown

Camera

Electrode

Video Processor

Wireless

Source: McKinnon, B. J. (2013), Cochlear implant programs: Balancing clinical and financial sustainability. The Laryngoscope,

123: 233–238. doi: 10.1002/lary.23651

Page 44: Bionic eye

Potential Applications of this technology/

Future Opportunities

http://youtu.be/iUz1ScDKslk

Source: http://youtu.be/iUz1ScDKslk

Page 45: Bionic eye

Any Questions?