Silent sound technology_powerpoint

Silent SoundTechnology

…Talking Without Talking

What will happen when...

Let’s make

it

possible

Contents• INTRODUCTION• NEED FOR SILENT SOUND• ORIGINATION• SENSORS NEEDED• METHODS • EMG• IMAGE PROCESSING• SILENT FEATURES• APPLICATION• CONCLUSION

IntroductionSilent Sound is a technology which makes it possible to make calls/transmit information without using vocal cords just in 4 steps.

Monitoring muscular & lip movements Transforming them into a computer generated sound Transmit them over a phone Receiver receives the information in audio

Need for Silent Sound

To overcome with embarrassed situation such as-

To reply urgent call while meeting

For a better way of communication in noisy place

To be helpful for-

Vocally challenged People

Sharing secret information

Origination Origination of idea1968- Stanley Kubrick science-fiction film 2001 – A Space Odyssey

First demonstration2010 -At CeBIT(Centrum fiir Biiroautomation, Informationstechnologie und Telekommunikation)

Under developmentscientists of Karlsruhe Institute Of Technology (KIT), Germany

Sensors NeededThese are the sensors that are used in Silent Sound Technology :

Pressure sensor

Vibration sensors

Motion sensor

Electromagnetic sensor

Methods Silent Sound Technology is mainly processed through following methods. They are :

Electromyography (EMG) Image Processing

ELECTROMYOGRAPHY

…A method to convert lips movement into sound.

Electromyography• EMG is a technique for evaluating & recording electrical activity

produced by skeletal muscles

• The silent sound technology uses electromyography for monitoring muscular movements while speaking

• EMG detects electrical potential generated by muscle cells when they are electrically or neurologically activated

• Detected signals are converted into electrical pulses

• Electrical signals are converted into speech, without utterance of sound

History of EMGYEAR OBSERVER OBSERVATION

1666First documented experiments dealing with EMG started

1666Francesco Redi

Highly specialized muscle of the Electric Eel

generates electricity

1849Dubois-Raymond

It’s possible to record electrical activity during a

voluntary muscle contraction

1890Marey

Recorded the first actual muscular activity

Coined the term “Electromyography”

Principle of operationIn general speaking aloud

Air passes through larynx & the tongue Words are produced by articulator muscle

But when we are about to speak Articulate muscle becomes active irrespective of passage of

air Even by saying words without producing sound weak

electric currents are sent from brain to speech muscles.

EMG -Procedure– A Needle electrode is inserted through the skin into the

muscle tissue.

– Valuable information about the state of the muscle and its

innervating nerve is observed

– The electrical activity when the muscle is at rest is

observed.

– Because skeletal muscles differ in the inner structure,

the electrode has to be placed at various locations to

obtain an accurate signal

– Shape, size, and frequency of the resulting motor unit are

judged.

EMG - Techniques

ELECTRODE

AMPLIFIER

FunctioningSTEPS UNITS FUNCTIONS

I

Monitoring Unit Monitors tiny muscular movements

II

Electromyographic Sensors Records electric signals produced by the facial muscles

III

Transducers Converts the pulses into electric signals .

IV

Vocoder Converts electrical signal into speech pattern

V

Matching Unit

Compare them with pre recorded signal pattern of spoken words

Image Processing

Image Processing • Converting digital data tape into a film image with minimal correction

& calibrations• In silent sound technology its output is an audio record

Image Processing techniques

Analysis of remotely sensed data is done using various

image processing techniques and methods that includes:

Analog image processing

Digital image processing

Data collection& processingStimuli and Procedure

A list of frequently used sentences were prepared

Electromagnetic articulograph AG500 is used to register 3-D MOVEMENTS of the

tongue, lip and jaw when subject was talking

Articulograph records the movement by establishing calibrated electromagnetic

field

Data processing

Head movements were subtracted from tongue and lip locations

A zero phase low pass filter is applied for removing signal

noise

All sequences were segmented and annoted with sentences

EMA based silence speech interface

Electromagnetic Articulograph

Trained mode (SVM)

Online recognition

Sound database

Sound playback

Recognition

Dat

a se

gmen

t

Pro

bab

le Sen

tences

Data acquisition

Lip movement

Output

req

ues

t

Sou

nd

w

aveformSenten

ce

sequence

Speech Acoustics

Silent Features• Allow people to make silent calls without

bothering others.

• Helps to interpret foreign language

Applications• In Military for communicating secret/confidential matters

• A hope for people who have lost their voice due to illness

or accident

• Sharing secrets like pin, password to trusted one

ConclusionThus Silent Sound Technology, one of the recent trends in the field of Information technology implements ‘Talking Without Talking’. It will be one of the innovative and useful technology and in mere future this technology will be of use in day to day life.