Artificial vision based computer interface.doc

8/11/2019 Artificial vision based computer interface.doc

1/6

An Artificial Vision Based Computer Interface

Miguel Mrquez1, Erika Chacn2, ngelica Ramrez3, ngel Gil4

Universidad Nacional Experimental del Tchira (UNET). Decanato de Investigacin. Laboratorio de

rototipos. !an "ristbal # $ene%&ela. '' # *+,-'/** Ext. /+.0 mmar1&e%2&net.ed&.ve3 * eri4a.chacon2&net.ed&.ve3 angelica.ramire%2&net.ed&.ve3 / agil2&net.ed&.ve

Abstract-This research resen!s an ar!i"icial #isi$n % &ase' c$mu!er in!er"ace, (hich main $&)ec!i#e issu$r!ing han'icae' e$le (i!h m$!$r 'isa&ili!* in !he use $" ers$nal c$mu!ers+ The s*s!em "acili!a!es !heuse $" s$"!(are alica!i$ns !$ in'i#i'uals !ha! ha#e null $r limi!e' m$&ili!* $" !heir uer lim&s+ n $r'er !$acc$mlish !he $&)ec!i#es, !he s*s!em c$un!s $n a -e& camera !ha! all$(s rec$gnizing !he a!!erns $" m$#emen!$" !he su&)ec!.s "ace, (hich is l$ca!e' in "r$n! $" !he camera &* means $" real !ime image r$cessing+ Thealica!i$n carries $u! an anal*sis $" !he images "$r !he e/ecu!i$n $" !he &asic "unc!i$ns $" !he m$use such as le"!

&u!!$n clicking an'0$r 'ragging $&)ec!s in !he c$mu!er screen+ The "ace 'e!ec!i$n r$cess is carrie' $u! !hr$ugh!he imlemen!a!i$n $" an alg$ri!hm !ha! uses a casca'e s$r! ke* $" aar%ike !*e+ The in#es!iga!i$n is &ase' $n

!he resen! kn$(le'ge $" ar!i"icial #isi$n, su&%"iel' $" !he ar!i"icial in!elligence (hich $""ers !$$ls $" anal*sis an'3 image r$cessing in $r'er !$ in!erre! !he ca!ure' scenes+ The alica!i$n (as 'e#el$e' in C !$ &e use'$n -in'$(s 56 la!"$rm+ Tr*$u! $" !he alica!i$n has &een er"$rme' &* 'i""eren! users, sh$(ing e/cellen!acce!a!i$n an' sh$r! !ime !raining requiremen!s+

1. Introduction

7$(a'a*s !he ers$nal c$mu!ers ha#e &ec$me a !$$l $" 'ail* use in 'i""eren! ac!i#i!ies $" !he s$cie!*8 such !he*ha#e 'i#erse 'e#ices !ha! all$( !he in!erac!i$n (i!h !he users, am$ng !hem aears !he eriheral use' "$r 'a!ainu!, &eing !he ke*&$ar' an' !he m$use !he m$s! $ular+ The in!erac!i$n (i!h !hese eriheral requires $" aminimum h*sical user caa&ili!* !$ $&!ain an e""icien! use8 ne#er!heless a 19: $" !he ($rl'%(i'e $ula!i$n

resen!0'isla* a! leas! s$me kin' $" m$!$r 'isa&ili!* ;1


2/6

>igure 1+ General 'iagram $" !he alica!i$n

2.2 Description of the Application

sed !ools" The E/!reme 6r$gramming $r 56 is use', (hich $""ers a se! $" !echniques !ha! c$n"$rms a simle

me!h$'$l$g* "$r s$"!(are 'e#el$men! ;2


3/6

$" !he camera $nl* remains !he alica!i$n user+ ?nce !he "ace is 'e!ec!e', a circular &i! ma !rimme' image $"!he z$ne (here !he "ace (as 'e!ec!e' is s!$re' "$r la!er anal*ses A>igure 2+

>igure 2+ >ace e!ec!i$n

Detection of the pattern to $e follo%ed" ="!er !he r$ce'ure $" 'e!ec!i$n $" !he "ace is "inishe', !he s*s!emsearches in !he "ace image s!$re' !$ i'en!i"* !he c$l$re' a!!ern !ha! (ill ser#e as !arge! !$ m$#e !he curs$r!hr$ugh !he c$mu!er screen+ = green rec!angular a!!ern is use', (hich is rec$mmen'e' !$ &e l$ca!e' in !heuser.s "$rehea'+ The green c$l$r (as selec!e' 'ue !$ i!s li!!le resence (i!hin !he range $" c$l$rs !ha! can &eusuall* "$un' in !he human "ace A>igure 3+=n alg$ri!hm !$ anal*ze !he G c$m$nen! in !he RGH sace $" c$l$r (as 'e#el$e' !$ carr* $u! !he 'e!ec!i$n $"!his a!!ern+ The alg$ri!hm cr$sses !he image i/el &* i/el e/!rac!ing $" each $ne i!s c$m$nen!s RGH (i!h !hein!en!i$n $" #eri"*ing i" !he* "ul"ill !he "$ll$(ing c$n'i!i$nsI G J R, G J H, AG K R L 29 an' AG K H L 29+n case a i/el sa!is"ies !he men!i$ne' c$n'i!i$ns, !hen !ha! i/el is c$nsi'ere' as ar! $" !he !arge!, !his (a* i! ise/!rac!e' all i/els &el$nging !$ !he rec!angular a!!ern, an' !hen !$ $&!ain i!s sace c$$r'ina!es A>igure 4+

>igure 3+ 6a!!ern !$ "$ll$( >igure 4+ E/!rac!i$n $" !he a!!ern

7e/! s!e is !$ i'en!i"* !he c$$r'ina!es $" !he cen!ral $in! $" !he a!!ern, (hich (ill &e use' !$ !ransla!e !he$si!i$n $" !he image !$ an* $si!i$n in !he c$mu!er screen+ " !he in'i#i'ual.s "ace is r$!a!e' an angle'uring !he r$cess $" "ace i'en!i"ica!i$n, !hen a r$!a!i$n a')us!men! mus! &e '$ne as "$ll$(s+ =ssuming !ha! !heini!ial c$$r'ina!es $" !he a!!ern cen!ral $in! are 6A51, 1, an' !he r$!a!i$n angle $" !he $riginal image,!hen !he $riginal $si!i$n $" !he cen!ral $in! is gi#en &*I

Cc$sAN1 r5 =

A1

CAN1 senr6 =

A2

&o'ement of the Cursor" The m$#emen! $" !he curs$r is gi#en &* !he !ransla!i$n $" !he cen!ral $in! $" !hea!!ern using screen c$$r'ina!es+ 6re#i$us !$ !his calcula!i$n a mirr$r !rans"$rma!i$n is alie' !$ !he ca!ure'image s$ !here is n$! c$n"usi$n &e!(een righ! an' le"! !$ !he user+n $r'er !$ manage an e""icien! m$#emen! $" !he curs$r, an' all$( !he user !$ $si!i$n elemen!s in !he screen, a(eigh!e' a#erage $" !he las! "i#e AO m$#emen!s carrie' $u! &* !he curs$r (as use'+ This r$ce'ure !akes !he las!O l$ca!i$ns "r$m !he curs$r an' calcula!es a (eigh!e' $si!i$n+ The (eigh! assignmen! gi#es re"erence !$ !hem$s! recen! $si!i$n+ The calcula!i$n $" !he curs$r (eigh!e' $si!i$n is &ase' $n !he use $" a #ec!$r $" O (eigh!sgenera!e' as "$ll$(s ;O$r all 9 P i P 7, (here 7 is !he am$un! $" $si!i$ns !$ &e c$nsi'ere',


4/6

i

7eighti+

=1

1

A3

1+ ! is necessar* s!an'ar'ize !he c$m$nen!s $" !he #ec!$r Q7eight i !$ !he in!er#al ;9,1igure O, (hich reresen! !he $u!si'e &$r'er an' !he insi'e &$r'er $" !he lis, (hich are searche'in in"eri$r hal" $" !he image re#i$usl* "il!ere' using a Gaussian sm$$!he' $era!i$n ;igure O+ e!ec!i$n $" !he $en m$u!h

The "$un' ellises mus! "ul"ill cer!ain c$n'i!i$ns as "ar as !heir 'imensi$ns, (i!h !he in!en!i$n $" n$! c$n"using!he m$u!h (i!h an* $!her sha'e $r "$rm !ha! can &e (r$ngl* 'e!ec!e' &* !he alg$ri!hm+-i!h !he in!en!i$n $" $!imizing !he e/ecu!i$n $" !he click $era!i$n, &e"$re making an* 'ecisi$n regar'ing !heac!i$n !$ make, !he alg$ri!hm all$(s #eri"*ing cer!ain s!a!es $" !he user.s m$u!h an' acc$r'ing !$ !his resul! i!

c$n'uc!s !he ac!i$n+ ATa&le 1

+resent State +re'ious State &ouse Action

?en M$u!h Cl$se' M$u!h 6ress e"! Hu!!$n?en M$u!h ?en M$u!h T$ $si!i$n Curs$r ?en M$u!h Cl$se' M$u!h T$ $si!i$n Curs$r ?en M$u!h ?en M$u!h Release e"! Hu!!$n

Ta&le 1+ @eri"ica!i$n $" s!a!es $" !he user.s m$u!h+

=''i!i$nall*, a !imer "$r !he ac!i$n $" !he click is use' !ha! ($rks $" !he "$ll$(ing (a*I

1+ -hen an $ene' m$u!h is 'e!ec!e', !he m$#emen! $" !he curs$r s!$s 'uring O h$!$gram, !his(a* i! is $ssi&le !$ &e 'e!ermine' i" !he user (ishes !$ c$n'uc! !he clicking ac!i$n $r a''i!i$nall*he (ishes !$ 'rag an $&)ec!+


5/6

2+ " (hen assing !he O h$!$gram, !he m$u!h is cl$se', i! is c$me !$ release !he click, in !he$riginal $si!i$n (here i! (as resse'+

3+ " (hen "inalizing !he O h$!$gram !he m$u!h "$ll$(s $en, i! s!a*s resse' !he click, !$ e/ecu!e!he 'ragging ac!i$n $" !he $&)ec! selec!e' &* !he user+

,. -esults

The 'e#el$e' alica!i$n is $" !*e -in'$(s G ;Uace e!ec!i$n . International Bo&rnal o@ "omp&ter $ision , + 13U%1O4, 2993+

;O< C$ianiz T+ * T$rresani + 2 e"$rma&le M$'els "$r @isual Beech =nal*sis+ !peechreading b9 C&mans and

Aachines, + 31%3W, 1+;< 6a)ares G+, 'e la Cruz V+, M$lina V+, Cua'ra'$ V+ * ez =. Imgenes Digitales. rocesamiento prctico
http://ceu.fi.udc.es/~davidfv/ivjornadas_documentacion.htmlhttp://ceu.fi.udc.es/~davidfv/ivjornadas_documentacion.htmlhttp://ceu.fi.udc.es/~davidfv/ivjornadas_documentacion.htmlhttp://ceu.fi.udc.es/~davidfv/ivjornadas_documentacion.html


6/6

con Bava+ =l"a$mega, MX/ic$+ 2993+

;U< Microsoft Corporation.7indos I+ +B+=+ 299U+

Documents

Artificial vision based computer interface.doc