Embed Size (px)
Citation preview
M.A.M COLLEGE OF ENGINEERINGSIRUGANUR, TRICHY-621105
vision to visually Challenged peopleusing embedded system
Submitted by,K.VEL MURUGANVENKATERAMANFinal year/ECE
Contact us:
MAIL ID : [email protected]
PHONE NO: 9944152058
:9585872572VISION TO VISUALLY CHALLENGED PEOPLE USING EMBEDDED
SYSTEM
ABSTRACT:Our ultimate aim to
make powerful supportivedevices to the visuallychallenged people.Nowadays visuallychallenged peoples arefacing many problems likereading, writing, manualoperation, etc, . Forthose difficulties, Weintroduce a supportivedevice using voice commandmobile accessories .Voicecommand mobile accessvoice input and itperforms arithmeticoperations, logicaloperations, mobileaccess ,text to voice andclock timing based on theaudio commands and produceoutputs in the voice form.And also that it indicatethe obstacles near tothem. It is a hard task tocompute complicatedcalculations manually;hence the use ofcalculators is essential.But it is not possible for
the blind people to usethe normal calculators inwhich the input is fedthrough the keypads and itis difficult for them toidentify the keys incalculator. It is also noteasy for the blind peopleto access mobile phoneswithout any propertraining and it is alsonot possible for them toview the time from a clock. This project workproposes the design of anovel handy device for theblind people to performcalculations, to accessmobile phones and to knowthe correct time by givingsimple voice commands. Inrecent days mobile phones,voice based calculationsare in use but it needssome keypad usage which isdifficult for visuallychallenged people. Hencethis project is aimed atdeveloping a calculator,mobile, obstacle sensor,text to speech reader and
watch based on voicealone. At last the finalvoice output is given tothe loud speaker. Thissupportive device makesrevolution among thevisually challengedpeople.
INTRODUCTION:This paper mainly uses
EMBEDDED SYSTEM. An embeddedsystem is a computer systemdesigned for specificcontrol functions within alarger system, often withreal-time computingconstraints. Embeddedsystems contain processingcores that are typicallyeither microcontrollers ordigital signal processors(DSP).Physically, embeddedsystems range from portabledevices such as digitalwatches and MP3 players, tolarge stationaryinstallations like trafficlights, factory controllers,or the systems controllingnuclear power plants.One oflatest application isAURDUINO PLATFORM.Arduino isa popular open-source single-boardmicrocontroller, desc-endantof the open-source Wiring
platform, designed to makethe process of usingelectronics inmultidisciplinary projectsas more accessible.SPEECH PROCESSING
Especially audiomanipulation and soundprocessing are commonly usedin many everyday electronicdevices. Some examples areMP3 players, digital voicerecorders, speaking GPSreceivers, electronic toys,intelligent alarm systems,speaking clocks, radio andtelevisions, mobile phones,devices used by older andblind people, and many moresimilar devices. In general,the speech processingcapabilities that can beadded to an electronicdevice are voice recording,voice playback, text-to-speech (TTS) synthesis andspeech recognition (SR).Voice recording and voiceplayback are used in digitalvoice recorders to storespeech in non-volatilememory and then replay it ata later time such as TOMCATAPPLICATION. Someintelligent recordingsystems have additionalfeatures such as searching
for a particular speech,skipping speeches,organizing recorded speechesin folders, and so on.
SPEECH RECOGNITION
Speech recognition ismainly divided into two parts:speaker dependent (SD) andspeaker independent (SI).Speaker-dependent speechrecognition systems are trainedby the person who will be usingthe system and these systemsrespond accurately only to theperson who trained the system.Such systems can achieve 99%accuracy for word recognitionand also have largevocabularies. Speaker-dependentsystems also have theadvantages that they arelanguage independent and can betrained in any language.Speaker independent systems aretrained to respond to wordsindependent of the user.
HYBRID NN/HMM-BASED SPEECHRECOGNITIONWITH ADISCRIMINANT NEURAL FEATUREEXTRACTION In this paper, present anovel hybrid architecture forcontinuous speech recognitionsystems. It consists of acontinuous HMM systemextended by an arbitrary
neural network that is usedas a preprocessor that takesseveral frames of thefeature vector as input toproduce more discriminativefeature vectors with respectto the underlying HMMsystem. This hybrid systemis an extension of a state-of-the-art continuous HMMsystem, and in fact, it isthe first hybrid system thatreally is capable ofoutperformingthese standardsystems with respect to therecognition accuracy.Experimental results show anrelative error reduction ofabout 10% that we achievedon a remarkably goodrecognition system based oncontinuous HMMs for theResource Management 1000-word continuous speechrecognition task.
voice processing algorithm
AURDUINO:
Arduino hardware isprogrammed using a Wiring-basedlanguage (syntax andlibraries), similar to C++ withsome slight simplifications andmodifications, anda Processing-based integrateddevelopment environment.Current versions can bepurchased pre-assembled;hardware design information isavailable for those who wouldlike to assemble an Arduino byhand. Additionally, variationsof the Italian-made Arduinowith varying levels ofcompatibility have beenreleased by third parties, someof them are programmed usingthe Arduino software. Arduinocan be used to develop stand-alone interactive objects orcan be connected to software onyour computer (e.g. Flash,Processing, MaxMSP). The open-source IDE can be downloadedfor free (currently for Mac OSX, Windows, and Linux).AnArduino board consists of an 8-bit AtmelAVR microcontroller withcomplementary components tofacilitate programming andincorporation into othercircuits. An important aspectof the Arduino is the standardway that connectors areexposed, allowing the CPU boardto be connected to a variety ofinterchangeable add-on modules
known as shields. OfficialArduinos have usedthe megaAVR series of chips,specifically the ATmega8,ATmega168, ATmega328,ATmega1280, and ATmega2560. Inthis project ATmega328megaAVR series used.
Easy VR(PROCESSOR):
EasyVR is a multi-purposespeech recognition moduledesigned to easily addversatile, robust and costeffective speech recognitioncapabilities to virtually anyapplication. The EasyVR modulecan be used with any host withan UART interface powered at3.3V – 5V, such as PIC andArduino boards. Someapplication examples includehome automation, such as voicecontrolled light switches,locks or beds, or adding“hearing” to the most popularrobots on the market.A host ofbuilt-in Speaker Independent(SI) commands for ready tosupport five languages, thatlanguages are English(US),Italian, German,French,Spanish, Japanese. ItSupports up to 32 user-definedSpeaker Dependent (SD) triggersor commands as well as VoicePasswords. It is easy-to-useand also a simple GraphicalUser Interface to program Voice
Commands and audio throughserial port .It also supportPWM audio output at 8Ωspeakers.
HARDWARE DESCRIPTION:
GSM MODEM:Uses the extremely popular
SIM300 GSM module .Provides theindustry standard serial RS232interface for easy connectionto computers and other devicesProvides serial TTL interfacefor easy and direct interfaceto microcontrollers Optionallyavailable USB interface foreasy interface to laptops,computers, etc. Power, RINGand Network LEDs for easydebugging.The onboard Status LED(yellow)is used to display the networkstatus a) LED Off – SIM300 not runningb) 64ms On 0.8 Sec Off - SIM300unable to find network c) 64ms On 3 Sec Off - SIM300found network
The GSM Modem consumes a lot ofcurrent during transmission,make sure your power supply canhandle large currents withoutgiving substantial voltagedrops at the output If the GSMModem is unable to connect tothe network, try coming to aplace with clear surroundingsfor best reception The SIM Cardholder used on the Modem isquite delicate and can easilybreak upon rough use. Use itwith care and caution MICROPHONE:
The microphone provided withthe EasyVR module is anomnidirectional electretscondensermicrophone.Sensitivity -38dB(0dB=1V/Pa @1KHz)2.2KLoadImpedance ,Operating Voltage3V.It used in flat frequency,the range of frequency is100Hz– 20kHz.The wavelength of soundat 10 kHz is little over aninch (3.4 cm) so the smallestmeasuring microphones are often1/4" (6 mm) in diameter, whichpractically eliminatesdirectionality even up to thehighest frequencies.Omnidirectional microphones,unlike cardioids, do not employresonant cavities as delays,and so can be considered the"purest" microphones in termsof low coloration; they addvery little to the originalsound.
CONTROLLER:
figure Layout ofArduinoDuemilanove
An Arduino board consistsof an 8-bit Atmel AVRmicrocontroller withcomplementary componentsto facilitate programmingand incorporation intoother circuits. Animportant aspect of theArduino is the standardway that connectors areexposed, allowing the CPUboard to be connected to avariety of interchangeableadd-on modules known asshields.Most boardsinclude a 5 volt linearregulator and a 16 MHzcrystal oscillator (orceramic resonator in somevariants), although somedesigns such as theLilyPad run at 8 MHz anddispense with the onboardvoltage regulator due tospecific form-factorrestrictions. An Arduino'smicrocontroller is alsopre-programmed with a bootloader that simplifies
uploading of programs tothe on-chip flash memory,compared with otherdevices that typicallyneed an externalprogrammer.At a conceptual level,when using the Arduinosoftware stack, all boardsare programmed over an RS-232 serial connection, butthe way this isimplemented varies byhardware version. SerialArduino boards contain asimple inverter circuit toconvert between RS-232-level and TTL-levelsignals. Current Arduinoboards are programmed viaUSB, implemented usingUSB-to-serial adapterchips such as theFTDIFT232. Some variants,such as the Arduino Miniand the unofficialBoarduino, use adetachable USB-to-serialadapter board or cable,Bluetoothor other methods.(When used withtraditionalmicrocontroller toolsinstead of the ArduinoIDE, standard AVR ISPprogramming is used.)
The Arduino board exposes mostof the microcontroller's I/Opins for use by other circuits.
The Diecimila, now supersededby the Duemilanove, forexample, provides 14 digitalI/O pins, six of which canproduce pulse-widthmodulatedsignals, and sixanalog inputs. These pins areon the top of the board, viafemale 0.1 inch headers.Several plug-in applicationshields are also commerciallyavailable.
The ArduinoNano, and Arduino-compatible Bare Bones Board andBoarduino boards provide maleheader pins on the underside ofthe board to be plugged intosolderless breadboard. In thisboard used ATmega328 AVR seriesis used for VCC .
ATMEGA328
PIN DIAGRAMLCD DISPLAY:
A liquid crystaldisplay (LCD) is a flatpanel display, electronicvisual display, or video
display that uses thelight modulatingproperties of liquidcrystals (LCs). LCs do notemit light directly.LCDshave replaced cathode raytube (CRT) displays inmost applications. Theyare available in a widerrange of screen sizes thanCRT and plasma displays,and since they do not usephosphors, they cannotsuffer image burn-in. LCDsare, however, susceptibleto image persistence. Itslow electrical powerconsumption enables it tobe used in battery-powered electronic equipment. It isan electronicallymodulated opticaldevice made up of anynumber of segments filledwith liquid crystals andarrayed in front ofa light source (backlight)or reflector to produceimages in coloror monochrome. The mostflexible ones use an arrayof small pixels.
1. REAL TIME CLOCK-DS1307(TALKING CLOCK)The “Talking Clock" is adevice that allows a userto set the time of ananalog clock and have that
time read back to them inwords through a speaker.The user will also havethe capability to see adigital readout of thattime.The design criteriafor the talking clock werespecified by the clientcoordinator. The clock hadto be safe for thechildren to useindependently. Also, thespeed of the voice couldnot be too fast, and thedevice had to run offbatteries.The materialused in for the enclosureis quarter inch finishedplywood. The dimensionsare as follows 24 inchesby 16 inches by 4 inches.The box is drilled and cutfor the components thatneed to be mounted to it.All of the wood is sandeddown for safety reasonsand then coated withpolyure. The power forthe project comes from twosources. There is abattery pack for 4 Dcellbatteries, which ismounted on the bottom ofthe enclosure that powersall of the circuitry.Thereis also a 9V battery whichjust powers the digitalreadout. A range of 4.5 to6V works for most digitalcircuits, but because of
the high power outputneeded to light the largeseven segment displays the9V battery was added. Thehours and minutes areactivated using anelectronic circuit thatencoded the time set buythe user and addresses itto a segment of voicerecorded to an ISD VoiceRecord/PlaybackIntergraded Circuit. Thehour voice is recoded toone IC and the minute toanother.
SPEAKER A loudspeaker (or"speaker") is an electro-acoustic transducer thatproduces sound in responseto an electrical audiosignal input. Non-electrical loudspeakerswere developed asaccessoriesto telephone system Themost common form ofloudspeaker uses a papercone supporting a voicecoil electromagnet actingon a permanent magnet.Here accurate reproductionof sound isrequired,multipleloudspeakers may be used,each reproducing a part ofthe audible frequencyrange. A subwoofer is a
woofer driver used onlyfor the lowest part of theaudio spectrum, typicallybelow 200 Hz for consumersystems, below 100 Hz forprofessional live sound,systems. Because theintended range offrequencies is limited,subwoofer system design isusually simpler in manyrespects than forconventional loudspeakers,often consisting of asingle driver enclosed ina suitable box orenclosure. Piezoelectricspeakers can have extendedhigh frequency output, andthis is useful in somespecialized circumstancesforinstance, sonar applications in which piezoelectricvariants are used as bothoutput devices (generatingunderwater sound) and asinput devices (acting asthe sensing components ofunderwater microphones).TEXT TO VOICE- TTS256
The TTS256 is an 8-bit microprocessorprogrammed with 600letter-to-sound rules forthe automatic, real-timetranslation of Englishtext to allophoneaddresses. Combined withthe Speak Jet, the TTS256
makes a complete text-to-speech solution. TheTTS256 will read Englishwords, numbers, currency,time, mathematicalexpressions and somepunctuation characters. Asthe rule set isconstrained by the amountof memory in the device,the TTS256 will be abletranslate and pronouncecorrectly roughly 90% oftext sent to it. Thetranslation quality isadequate for many embeddedapplications but isguaranteed to mispronouncesome common words fromtime to time.The TTS256 issold either as a pre-programmed microprocessorin DIP package. ANSI Csource code is alsoavailable for license toinclude text to Speak Jetcode functionality in yourown designs.
2. OBSTACLE SENSORUser can be alerted ofclosed obstacles in rangewhile travelling in theirenvironment. The system wepropose detects the nearestobstacle via a stereoscopicsonar system and sends backfibro-tactile feedback toinform the user about itslocalization. The systemaims at increasing the
mobility of visuallyimpaired people by offeringnew sensing abilities.
SOFTWARE DESCRIPTION:
EasyVR COMMANDER
It will be the test he commandto EasyVR, and trained thecommand to the EasyVR using theEasyVR commander .That softwareway to load the sound table toflash.
The EasyVR Commander softwarecan be used to easily configureyour EasyVR module connected toyour PC through an adapterboard, or by using themicrocontroller host board withthe provided “bridge”program,it define groups ofcommands or passwords andgenerate a basic code templateto handle them. Because theindependent usage the will usedword will be grouped to makeformation that only accepted inthe process.
It is required to edit thegenerated code to implement theapplication logic, but thetemplate contains allthefunctions or subroutines tohandle the speech recognitiontasks.
ARDUINO:
The Arduino IDE is a cross-platform application written inJava, and is derived from theIDE for the Processingprogramming language and theWiring project. It is designedto introduce programming toartists and other newcomersunfamiliar with software
development. It includes a codeeditor with features such assyntax highlighting, bracematching, and automaticidentification, and is alsocapable of compiling anduploading programs to the boardwith a single click. There istypically no need to edit makefiles or run programs on acommand-line interface.
Arduino programs are writtenin C/C++, although users onlyneed define two functions tomake a runnable program:
setup() – a function runonce at the start of aprogram that caninitialize settings
loop() – a function calledrepeatedly until the boardpowers off
BLOCK DIAGRAM:
Microphone
SPEAKER
CONTROLLER(Atmega328)
OBSTACLE SENSORRTC
(DS1307)
TEXT TO VOICE
EasyVRLCD DISPLAY
SIM 300
EXPLAINATION:
Here input and output both arebe the analog voice. Accordingvarious application variousprocess can be carried out.
IN MOBILE APPLICATIONSTEP 1:Voice command access bymicrophone.STEP2: voice input can berecognising by voice recognisecovert analogy into digitalvalue.STEP3:voice recogniser can betested the voice command andanalysis the controller actionusing AT COMMANDSSTEP4:in controller particularaction be taken over withrespect to AT COMMANDSExample:ATD : DIALING NEW CALL
ATP : PICKUP THE CALL
ATE : END THE CALLSTEP5:after the control theaction command can access withthe once again voice recognizerand digital value can beconvert into analog value inspeaker.
IN CALCULATOR AND TIMERAPPLICATION:
STEP 1:Voice command access bymicrophone.STEP2:Voice recogniser can betested the voice command andanalysis the controller actionlike ARTHMATIC ,LOGICAL ANDREAL TIME CLOCK operationSTEP3: in controllerparticular action be takenoverSTEP4:after the control theaction command can access withthe once again voice recogniserand digital value can beconvert into analog value inspeaker.
IN OBSTACLE SENSOR:
STEP1:transmitter and receiverof obstacle sensor can beconnected with arduino board.STEP2:It sense the object nearto sensor and it indicated byalarm in speaker
This entire application can beprogrammed by using c++ and itcan be download in arduinoboard.
APPLICATION:1.May be used for onlineexams to support blindpeople
CONCLUSION:
Thus,now a days mostof the people use mobilephones.Thus it is veryuseful for physicallychallenged people to make acall,message ,performcalculations withouttouching the keypad.It isalso useful for normalpeople if it automaticallyreads the message while weare sleeping. Voice commandcalculator serves as a noveldevice for the blind people,because of its simplicity in
operation, handy nature andeconomical cost. It is notonly a useful device for thesuper natured people (blindpeople), but it alsoincrease the comfort fornormal human beings.Implementing this novel ideaof controlling devicesthrough voice commands invarious applications lead toanother degree ofimprovement in humaninnovations
