10
Hindawi Publishing Corporation Mathematical Problems in Engineering Volume 2013, Article ID 243094, 9 pages http://dx.doi.org/10.1155/2013/243094 Research Article DSP- and FPGA-Based Stair-Climbing Robot Design Ming-Shyan Wang, Che-Min Mi, Shih-Yu Wu, and Yi-Ming Tu Department of Electrical Engineering, Southern Taiwan University of Science and Technology, 1 Nan-Tai Street, Yung Kang District, Tainan 710, Taiwan Correspondence should be addressed to Ming-Shyan Wang; [email protected] Received 15 September 2013; Accepted 3 October 2013 Academic Editor: Teen-Hang Meen Copyright © 2013 Ming-Shyan Wang et al. is is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. A stair-climbing robot is equipped with a grasping arm for capturing objects to provide service for the elders. A board based on a digital signal processor (DSP) plays the role of control center to manage all actions of two brushless DC motors for locomotion, two worm gears for torque magnification, and two DC motors for arms’ pitching in the main body. e robot is steered by fuzzy logic control (FLC) which integrates the outputs of DC bus current sensor and an inclinometer. ere is a CMOS camera for vision used in the robot, and the grasping arm is controlled via the video camera for capturing objects. Simple algorithms of image processing are implemented in the field programmable gate array (FPGA) board that generates the X-axis and Y -axis commands of the grasping arm to capture/load objects. ree walking experiments of the stair-climbing robot to move up and down stairs are shown in the taped pictures from videos. e object tracking and capturing by the grasping arm and camera verifies the proposed design. 1. Introduction Research on service robots has been attended in recent years. One of the most important reasons is the growing of aging population and decreasing of working population. It is not a long-term way by hiring many foreigners with cheaper pay- ment to work at factories or to take home-caring job for the elder or disabled. As a result, for the latter, home-caring robot is an excellent candidate capable of supporting such an aging society. Specifically, the elders can control the robots directly for service. e robot designed to directly carry elders up and down stairs needs a large vehicle and the stair rail for moving. e robot “HRP-2” from Harada successfully climbed up 280 mm stairs by grasping the stair rail [1]. e robot “WL- 16RII” [2] can walk independently and allow users to build its upper body based on their requirements, such as a walking wheelchair or as a walking support machine that is able to walk up and down stairs carrying or assisting an elder. e developed biped locomotor with Stewart platform legs suc- cessfully achieved walking up and down on stairs for 250 mm continuously and carrying 60 kg man on it. Another biped- type robot, for example, “Zero Walker-1” [3], uses its two legs to assist the aged person walking and moving up and down stairs along the handrail by stepping onto the feet of the robot [4]. However, the aforementioned robots generally need tremendous effect on expense and time. Furthermore, it is very difficult to liſt an aged person by human force, and it is not very easy to have a large and heavy-weight liſt machine in a normal house. Generally, the first step of image processing for segment- ing the target is background subtraction scheme [5]. Although the background subtraction scheme works fairly well in segment foreground data from nonchanging back- ground but it will still allow objects that are paced into the workspace to be detected as potential objects. As a result, a color (or skin) detector is implemented to further filter the foreground data by converting the RGB (red, green, and blue) form of resultant image into (luminance, blueness, and redness) form [5]. Additionally, object tracking has become an important topic in robotics field [6, 7]. Some basic functions such as real time, automation, and robustness to nonideal situations are required for practical object tracking systems. e servo control structure in real-time visual track- ing systems usually belongs to the category of “image-based” and “dynamic look and move” [6]. Based on image moments, three different visual predictive control architectures are proposed [7]. However, the proposed system was verified

Research Article DSP- and FPGA-Based Stair …downloads.hindawi.com/journals/mpe/2013/243094.pdfResearch Article DSP- and FPGA-Based Stair-Climbing Robot Design Ming-ShyanWang,Che-MinMi,Shih-YuWu,andYi-MingTu

  • Upload
    doannga

  • View
    218

  • Download
    1

Embed Size (px)

Citation preview

Hindawi Publishing CorporationMathematical Problems in EngineeringVolume 2013 Article ID 243094 9 pageshttpdxdoiorg1011552013243094

Research ArticleDSP- and FPGA-Based Stair-Climbing Robot Design

Ming-Shyan Wang Che-Min Mi Shih-Yu Wu and Yi-Ming Tu

Department of Electrical Engineering Southern Taiwan University of Science and Technology 1 Nan-Tai StreetYung Kang District Tainan 710 Taiwan

Correspondence should be addressed to Ming-Shyan Wang mswangmailstustedutw

Received 15 September 2013 Accepted 3 October 2013

Academic Editor Teen-Hang Meen

Copyright copy 2013 Ming-Shyan Wang et al This is an open access article distributed under the Creative Commons AttributionLicense which permits unrestricted use distribution and reproduction in any medium provided the original work is properlycited

A stair-climbing robot is equipped with a grasping arm for capturing objects to provide service for the elders A board based on adigital signal processor (DSP) plays the role of control center tomanage all actions of two brushless DCmotors for locomotion twoworm gears for torque magnification and two DC motors for armsrsquo pitching in the main body The robot is steered by fuzzy logiccontrol (FLC)which integrates the outputs ofDCbus current sensor and an inclinometerThere is aCMOS camera for vision used inthe robot and the grasping arm is controlled via the video camera for capturing objects Simple algorithms of image processing areimplemented in the field programmable gate array (FPGA) board that generates the X-axis and Y-axis commands of the graspingarm to captureload objects Three walking experiments of the stair-climbing robot to move up and down stairs are shown in thetaped pictures from videos The object tracking and capturing by the grasping arm and camera verifies the proposed design

1 Introduction

Research on service robots has been attended in recent yearsOne of the most important reasons is the growing of agingpopulation and decreasing of working population It is not along-term way by hiring many foreigners with cheaper pay-ment to work at factories or to take home-caring job for theelder or disabled As a result for the latter home-caring robotis an excellent candidate capable of supporting such an agingsociety Specifically the elders can control the robots directlyfor service

The robot designed to directly carry elders up and downstairs needs a large vehicle and the stair rail for movingThe robot ldquoHRP-2rdquo from Harada successfully climbed up280mm stairs by grasping the stair rail [1] The robot ldquoWL-16RIIrdquo [2] can walk independently and allow users to build itsupper body based on their requirements such as a walkingwheelchair or as a walking support machine that is able towalk up and down stairs carrying or assisting an elder Thedeveloped biped locomotor with Stewart platform legs suc-cessfully achieved walking up and down on stairs for 250mmcontinuously and carrying 60 kg man on it Another biped-type robot for example ldquoZeroWalker-1rdquo [3] uses its two legsto assist the aged person walking and moving up and down

stairs along the handrail by stepping onto the feet of therobot [4] However the aforementioned robots generallyneed tremendous effect on expense and time Furthermore itis very difficult to lift an aged person by human force and it isnot very easy to have a large and heavy-weight liftmachine ina normal house

Generally the first step of image processing for segment-ing the target is background subtraction scheme [5]Although the background subtraction scheme works fairlywell in segment foreground data from nonchanging back-ground but it will still allow objects that are paced into theworkspace to be detected as potential objects As a result acolor (or skin) detector is implemented to further filter theforeground data by converting the RGB (red green and blue)form of resultant image into 119884119862119887119862119903 (luminance bluenessand redness) form [5] Additionally object tracking hasbecome an important topic in robotics field [6 7] Some basicfunctions such as real time automation and robustness tononideal situations are required for practical object trackingsystemsThe servo control structure in real-time visual track-ing systems usually belongs to the category of ldquoimage-basedrdquoand ldquodynamic look andmoverdquo [6] Based on image momentsthree different visual predictive control architectures areproposed [7] However the proposed system was verified

2 Mathematical Problems in Engineering

only by simulation results A novel two-level scheme foradaptive active visual servoing of a mobile robot equippedwith a pan camera was presented in [8] The designed activevisual servoing system shows advantages of a satisfactorysolution for the field-of-view problem global high servoingefficiency and free of any complex pose estimation algorithmusually required for visual servoing systems With respectto traditional visual servoing approaches that use geometricvisual features the visual feature used in [9] was the pixelintensity The proposed approach has been tested in termof accuracy and robustness via several experimental condi-tions A visual servoing strategy based on a novel motion-estimation technique [10] was presented for the stabilizationof a nonholonomic mobile robot The practical exponentialstability can be achieved by perturbed linear system theorydespite the lack of depth information

In the paper a stair-climbing robot equipped with an armwill be designed to provide the service of carrying objects upand down stairs or patrolling for security A control boardincluding a digital signal processor (DSP) TMS320F28335will steer the robot based on the outputs of DC bus currentsensor and an inclinometer by fuzzy logic control (FLC)Without background subtraction and complex object track-ing schemes simple algorithms such as the color filtering andlocating center of the detected target are employed in therobot system With the aid of a CMOS camera for vision therobot arm will track capture and put back the target objectThe field programmable gate array (FPGA) on DE2-70 boardwill implement the image processing

The paper is organized as follows for further discussionSection 2 describes the design steps of the proposed robotrobot mechanism describing each component and the waysof climbing up and going down stairs DSP-based controllerproviding all control signals and realizing fuzzy control logicand the FPGA-based visual servo for tracking and capturingobjects Section 3 presents the experimental results of stairmotion and visual servoing Finally Section 4 claims ourconclusions

2 Robot Design

There are three steps for the proposed robot design mecha-nism DSP-based controller and FPGA-based visual servo

Step I Mechanism Design It is well known that the mosteffective style of movement of a robot on a plane field is thewheel type As obstacles and stairs exist crawler-type and leg-type robots become better candidates for application How-ever the proposed robot is equipped with roller chains whichare attached with polyurethane rubber blocks to generatefriction with ground and stairs for climbing up and downThe stair-climbing robot consists of a main body for movinga front arm and a rear arm for moving up and down stairsThe main body is equipped with two brushless DC motors(BLDCMs) and their drives for locomotion worm gears fortorque amplification two dc motors to control two arms andDSP-based board as control center shown in Figure 1 [11]Thechassic size of themain body is 585 cm times 53 cm and each armis 48 cm times 40 cm such that the maximum length of the robot

Figure 1 Picture of the stair-climbing robot

Figure 2 Total travel of climbing-up motion

will be 1545 cm The robot is equipped with roller chainsattached with rubber blocks used to generate friction withground and stairs for moving There are 136 rubber blockswith size of 3 cm times 2 cm times 1 cm attached to the roller chains40 for each arm and 56 for main body The distance betweenany two plastic blocks is properly arranged to fix the stairbrink The moving direction of the robot is steered based onthe speed difference of two BLDCMs and the informationfrom ultrasonic sensorsThe robotmakes use of friction forcebetween the roller chainsrubber blocks and stairsground toclimb up The front arm will be pushed down to flat top sothat the main body is lifted The front arm will be pulled upfor next stair-climbing The rear arm is kept flat during therobot going up Figure 2 displays total travel of climbing-upmotion Similarly Figure 3 shows summary of going-downmotion

Step II DSP-Based Controller Design DSP provides the pulse-width modulation (PWM) signals of BLDCMs and DCmotors and realizes the fuzzy logic rules for speed control

The 119894th fuzzy rule in the fuzzy rule-base system isdescribed as [12]

119877119894 If 1199091 is 119860 1198941 and 1199092 is 119860 1198942 then 119910 is 119908119894 (1)

where 119908119894 119909119895 and 119860 119894119895 119895 = 1 2 119894 = 1 2 119899 are fuzzyoutput variables input fuzzy variables and linguistic vari-ables respectively Referring to Figure 4 for 119894th membershipfunction with isosceles triangle shape 119887119894119895 means the length of

Mathematical Problems in Engineering 3

Figure 3 Summary of going-down motion

xj

xjaij

bij

10

0

Aij(xj)

Figure 4 119894th membership function with isosceles triangle shape

the base and 119886119894119895 stands for the abscissa of the center of thebase The membership grade of input 119909119895 is calculated by

119860 119894119895 (119909119895) = 1 minus

2 sdot10038161003816100381610038161003816119909119895 minus 119886119894119895

10038161003816100381610038161003816

119887119894119895

119895 = 1 2 (2)

The bases of triangular membership function keep samefor easily programming By product operation the member-ship grade of the antecedent proposition is calculated as

120583119894 = 119860 1198941 (1199091) sdot 119860 1198942 (1199092) (3)

Then the output will be

119910 =sum119899

119894=1120583119894119908119894

sum119899

119894=1120583119894

(4)

Summarily Table 1 lists the linguistic control rules andFigure 5 displays the design scheme of fuzzy logic control

Step III FPGA-Based Visual Servo Design The graspingmultilink arm consists of three couples of gears three DCmotors four links and one clamper Referring to Figure 6the first DC motor steers the diving gear 1198781 and driven gear1198782 to determine the rotating angleThe secondmotor controlsthe gears of 1198783 1198784119889 1198784119906 and 1198785 together with belts to stretchthe length of the arm 1198784119889 and 1198784119906 are mounted in the same

Table 1 Linguistic control rule table

120579119898

IZO PS PM PB

NB ZO PS PM PBNM ZO PM PM PMNS ZO PB PS ZOZO ZO PB PS ZOPS ZO PB PS ZOPM ZO PS PM PMPB ZO PS PM PB

shaft and with the same number of gears Then the length119883can be calculated as

119883 = cos 120579 times 119897 times 2 (5)

where 119897 is the length of the link The third motor decides theopen angle of the clamper

The pixel array of CMOS camera THDB-D5Mused in therobot consists of a matrix of 2752 times 2004 pixels addressed bycolumn and row [13 14] The 2592 times 1944 array in the centercalled active region represents the default output image sur-rounded by an active boundary region and a border of darkpixels Pixels of active region are output in a Bayer patternformat consisting of four ldquocolorsrdquo green1 green2 red andblue (G1 G2 R and B) to represent three filter colors [12 13]The first row output alternates between G1 and R pixels andthe second row output alternates between B and G2 pixelsThe green1 and green2 pixels have the same color filter butthey are treated as separate colors by the data path and analogsignal chain

In order to calculate the R G and B intensity of eachpixel we relabel the Bayer pattern by the correspondingcolumn-row address shown in Figure 7 After analyzing wesummarize each expression of the color intensity for eachpixel as follows

(i) 119909 is even and 119910 is even

119877(119909119910) =

119877(119909minus1119910) + 119877(119909+1119910)

Pixel Count

Pixel Count = 2 (119909 minus 1) gt 10 (119909 + 1) lt 2681

1 others

119861(119909119910) =

119861(119909119910minus1) + 119861(119909119910+1)

Pixel Count

Pixel Count = 2 (119910 minus 1) gt 50 (119910 + 1) lt 2002

1 others

(6)

4 Mathematical Problems in Engineering

Input of IuI

1

0 2 4 6A

A1

A1

A2

A2

A3

A3

A4

A4

Ii

120579mI

B1B1

B2B2

B3B3

B4B4

B5B5

B6B6

B7

B7

C11

C12

C13

C14

C15

C16

C17

C21

C22

C23

C24

C25

C26

C27

C31

C32

C33

C34

C35

C36

C37

C41

C42

C43

C44

C45

C46

C47

Inpu

t of120579

m

u120579 m

minus6minus4minus2

02

46

V Rule table

Fuzzy inference and output

and 120579m is B4 then uf is C24Rule 2 if I is A2Rule 1 if I is A2

and 120579m is B5 then uf is C25Rule 3 if I is A3 and 120579m is B4 then uf is C34Rule 4 if I is A3 and 120579m is B5 then uf is C35

Defuzzification

W24 = minuI(A2) u 120579m(B4)

W25 = minuI(A2) u 120579m(B5)

W34 = minuI(A3) u 120579m(B4)

W35 = minuI(A3) u 120579m(B5)

uf =C24lowastW24 + C25lowastW25 + C34lowastW34 + C35lowastW35

W24 + W25 + W34 + W35

Figure 5 Design scheme of fuzzy logic control

S2

S3 S5

S1

S4dS4u

120579

120579

l

l l

l

X

Figure 6 Parameter definitions of the grasping arm

(ii) 119909 is even and 119910 is odd

119866(119909119910) =

119866(119909minus1119910) + 119866(119909+1119910) + 119866(119909119910minus1) + 119866(119909119910+1)

Pixel Count

Pixel Count =

4 (119909 minus 1) gt 10 (119909 + 1) lt 2618

3 others

119877(119909119910) =

119877(119909+1119910minus1) + 119877(119909minus1119910minus1) + 119877(119909+1119910+1) + 119877(119909minus1119910+1)

Pixel Count

Pixel Count =

4 (119909 minus 1) gt 10 (119909 + 1) lt 2618

2 others(7)

G(1450) R(1350) G(1250)

G(1351) G(1151)

G(1353) G(1153)

G(1050)

G(1452) G(1252) G(1052)

G(1454) G(1254) G(1054)

R(1150)

R(1352) R(1152)

R(1354) R(1154)

B(1451)

B(1453)

B(1251)

B(1253)

B(1051)

B(1053)

Figure 7 Bayer pattern by the corresponding column-row address

(iii) 119909 is odd and 119910 is even

119866(119909119910) =

119866(119909119910minus1) + 119866(119909119910+1) + 119866(119909minus1119910) + 119866(119909+1119910)

Pixel Count

Pixel Count =

4 (119910 minus 1) gt 50 (119910 + 1) lt 2002

3 others

119861(119909119910) =

119861(119909minus1119910minus1) + 119861(119909+1119910minus1) + 119861(119909+1119910+1) + 119861(119909minus1119910+1)

Pixel Count

Pixel Count =

4 (119910 minus 1) gt 50 (119910 + 1) lt 2002

2 others(8)

Mathematical Problems in Engineering 5

(a) (b)

Figure 8 Realized motion of (a) climbing up and (b) going down by wired control

(a) (b) (c)

Figure 9 Realized motion of climbing up by FLC

(a) (b) (c)

Figure 10 Realized motion of going down by FLC

6 Mathematical Problems in Engineering

(a) (b)

(c) (d)

(e) (f)

(g) (h)

(i) (j)

Figure 11 Continued

Mathematical Problems in Engineering 7

(k) (l)

(m) (n)

(o) (p)

Figure 11 The taped pictures of the experimental results on grasping

(iv) 119909 is odd and 119910 is odd

119877(119909119910) =

119877(119909119910minus1) + 119877(119909119910+1)

2

119861(119909119910) =

119861(119909minus1119910) + 119861(119909+1119910)

2

(9)

where 119909 and 119910 stand for the column address and row addressrespectively

The image raw data is sent from D5M to DE2-70 boardwhere the FPGA on DE2-70 board will handle image pro-cessing and convert the data to RGB format to display on theVGA display [15ndash17] As a result we first capture the imageof experiment background to find the ranges of colors ofRGB and then define their location regions for color discrim-ination In order to reduce the effect of light variation theimage in RGB space will be converted into 119884119862119887119862119903 space [5]In addition the ranges of RGB fromD5Mare four times of the

general image So those the transformation can be expressedas

[

[

119884

119862119887

119862119903

]

]

= [

[

0299 0587 0114

minus01687 minus033126 05

05 minus041869 minus008131

]

]

[

[

119877

119866

119861

]

]

+[[

[

64

512

512

]]

]

(10)

3 Experiment Results

Gear ratio used in the 45 kg stair-climbing robot is 1320 andthe rated dc input power and speed of the 200-W BLDCMare 24V and 9600 rpm A preliminary experiment that theunloaded robot climbs up and goes down a gradual stair withthe rise of 120mm and depth of 400mm by wired control istestedThe results of every motion are shown in Figure 8 [11]It qualifies the designed robot Then we conduct the secondexperiment that the robot with loading of one arm moves upand down a steeper stair with the rise of 175mm and depth

8 Mathematical Problems in Engineering

(a) (b)

(c) (d)

(e) (f)

Figure 12 Realized motion of climbing up at full loading

of 280mm The taped pictures of the experiment and everymotion are shown in Figures 9 and 10 respectively [12]

The third experiment contains image processing andgrasping armmotion In order to prevent target damagewhileclamping one pressure sensor is installed inside the clamperThe pressure output after calibrating is sent to DSP for refer-ence Figure 11 displays the sequentially taped pictures fromvideos of tracking capturing the cola can and putting it backby the robot arm Figure 11(a) presents the initial status ofthe experiment The arm tracks the corresponding directionafter the can is shifted left shown in Figures 11(b) and 11(c)Figures 11(d) and 11(e) depict the right tracking The armtracks the can back to central position shown in Figures 11(f)and 11(g) Then the robot stretches out the arm for capturingthe can and then draws the arm back presented in Figures

11(h)ndash11(l) Finally the robot puts the can back and goes backto the initial status presented in Figures 11(m)ndash11(p)

Finally we conduct the fourth experiment that the robotwith all loading moves up a stair with the rise of 150mm anddepth of 300mm The taped pictures of the experiment areshown in Figure 12 The climbing-up motion presents vari-ation in proceeding direction This is due to the plastic bellbeing almost torn into broken after long time of experimentaltest But it was not found

4 Conclusion

In the paper we have developed a stair-climbing robot andcompleted experiments of moving updown stairs and objecttracking capturing and loading In fact the stair-climbing

Mathematical Problems in Engineering 9

robot can provide service for the elders by capturing thespecific object at one floor and then climbing up or down toanother floor In addition the robot will patrol for securityby the CCD camera around the house while more imageprocessing functions are provided

Acknowledgments

The authors would like to express their appreciation toMinistry of Education and National Science Council Chinaunder Contract no NSC 100-2632-E-218-001-MY3 for finan-cial supporting

References

[1] K Harada H Hirukawa F Kanehiro et al ldquoDynamical balanceof a humanoid robot grasping an environmentrdquo in Proceedingsof the IEEERSJ International Conference on Intelligent Robotsand Systems pp 1167ndash1173 Sendai Japan October 2004

[2] Y Sugahara A Ohta K Hashimoto et al ldquoWalking up anddown stairs carrying a human by a biped locomotor with paral-lel mechanismrdquo in Proceedings of the IEEE IRSRSJ InternationalConference on Intelligent Robots and Systems pp 1489ndash1494Alberta Canada August 2005

[3] Y Konuma and S Hirose ldquoDevelopment of the stair-climbingbiped robot lsquoZero Walker-1rsquordquo in Proceedings of the 19th AnnualConference of the Robotics Society of Japan pp 851ndash852 2001

[4] Y Takahashi H Nakayama T Nagasawa et al ldquoRoboticassistance for aged peoplerdquo in Proceedings of the 37th SICEAnnual Conference pp 853ndash858 Chiba Japan July 1998

[5] AMalima E Ozgur andM Cetin ldquoA fast algorithm for vision-based hand gesture recognition for robot controlrdquo in Proceed-ings of the 14th IEEE Signal Processing and CommunicationsApplications pp 1ndash4 Antalya Turkey April 2006

[6] S Hutchinson G D Hager and P I Corke ldquoA tutorial on visualservo controlrdquo IEEE Transactions on Robotics and Automationvol 12 no 5 pp 651ndash670 1996

[7] C Copot C Lazar and A Burlacu ldquoPredictive control ofnonlinear visual servoing systems using image momentsrdquo IETControl Theory amp Applications vol 6 no 10 pp 1486ndash14962012

[8] Y Fang X Liu andX Zhang ldquoAdaptive active visual servoing ofnonholonomic mobile robotsrdquo IEEE Transactions on IndustrialElectronics vol 59 no 1 pp 486ndash497 2012

[9] B Tamadazte N L-F Piat and E Marchand ldquoA direct visualservoing scheme for automatic nanopositioningrdquo IEEEASMETransactions on Mechatronics vol 17 no 4 pp 728ndash736 2012

[10] X Zhang Y Fang and X Liu ldquoMotion-estimation-based visualservoing of nonholonomic mobile robotsrdquo IEEE Transactionson Robotics vol 27 no 6 pp 1167ndash1175 2011

[11] M-S Wang and Y-M Tu ldquoDesign and implementation of astair-climbing robotrdquo in Proceedings of the IEEE InternationalConference on Advanced Robotics and Its Social Impacts TaipeiTaiwan August 2008

[12] M-S Wang Y-S Kung and Y-M Tu ldquoFuzzy logic controldesign for a Stair-climbing robotrdquo International Journal of FuzzySystems vol 11 no 3 pp 174ndash182 2009

[13] Terasic Company THDB-D5M Hardware Specification 2008[14] Terasic Company TRDB-D5M User Guide 2008

[15] AK Benkhalil S S Sipson andWBooth ldquoReal-timedetectionand tracking of amoving object using a complex programmablelogic devicerdquo in Proceedings of the IEE Colloquium on TargetTracking and Data Fusion pp 1ndash7 Birmingham UK June 1998

[16] T Hamamoto S Nagao and K Aizawa ldquoReal-time objectstracking by using smart image sensor and FPGArdquo inProceedingsof the International Conference on Image Processing (ICIP rsquo02)pp III441ndashIII444 New York NY USA September 2002

[17] S-B Park A Teuner and B J Hosticka ldquoA motion detectionsystem based on a CMOS photo sensor arrayrdquo in Proceedingsof the International Conference on Image Processing vol 3 pp967ndash971 Chicago Ill USA October 1998

Submit your manuscripts athttpwwwhindawicom

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

MathematicsJournal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Mathematical Problems in Engineering

Hindawi Publishing Corporationhttpwwwhindawicom

Differential EquationsInternational Journal of

Volume 2014

Applied MathematicsJournal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Probability and StatisticsHindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Journal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Mathematical PhysicsAdvances in

Complex AnalysisJournal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

OptimizationJournal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

CombinatoricsHindawi Publishing Corporationhttpwwwhindawicom Volume 2014

International Journal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Operations ResearchAdvances in

Journal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Function Spaces

Abstract and Applied AnalysisHindawi Publishing Corporationhttpwwwhindawicom Volume 2014

International Journal of Mathematics and Mathematical Sciences

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

The Scientific World JournalHindawi Publishing Corporation httpwwwhindawicom Volume 2014

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Algebra

Discrete Dynamics in Nature and Society

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Decision SciencesAdvances in

Discrete MathematicsJournal of

Hindawi Publishing Corporationhttpwwwhindawicom

Volume 2014 Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Stochastic AnalysisInternational Journal of

2 Mathematical Problems in Engineering

only by simulation results A novel two-level scheme foradaptive active visual servoing of a mobile robot equippedwith a pan camera was presented in [8] The designed activevisual servoing system shows advantages of a satisfactorysolution for the field-of-view problem global high servoingefficiency and free of any complex pose estimation algorithmusually required for visual servoing systems With respectto traditional visual servoing approaches that use geometricvisual features the visual feature used in [9] was the pixelintensity The proposed approach has been tested in termof accuracy and robustness via several experimental condi-tions A visual servoing strategy based on a novel motion-estimation technique [10] was presented for the stabilizationof a nonholonomic mobile robot The practical exponentialstability can be achieved by perturbed linear system theorydespite the lack of depth information

In the paper a stair-climbing robot equipped with an armwill be designed to provide the service of carrying objects upand down stairs or patrolling for security A control boardincluding a digital signal processor (DSP) TMS320F28335will steer the robot based on the outputs of DC bus currentsensor and an inclinometer by fuzzy logic control (FLC)Without background subtraction and complex object track-ing schemes simple algorithms such as the color filtering andlocating center of the detected target are employed in therobot system With the aid of a CMOS camera for vision therobot arm will track capture and put back the target objectThe field programmable gate array (FPGA) on DE2-70 boardwill implement the image processing

The paper is organized as follows for further discussionSection 2 describes the design steps of the proposed robotrobot mechanism describing each component and the waysof climbing up and going down stairs DSP-based controllerproviding all control signals and realizing fuzzy control logicand the FPGA-based visual servo for tracking and capturingobjects Section 3 presents the experimental results of stairmotion and visual servoing Finally Section 4 claims ourconclusions

2 Robot Design

There are three steps for the proposed robot design mecha-nism DSP-based controller and FPGA-based visual servo

Step I Mechanism Design It is well known that the mosteffective style of movement of a robot on a plane field is thewheel type As obstacles and stairs exist crawler-type and leg-type robots become better candidates for application How-ever the proposed robot is equipped with roller chains whichare attached with polyurethane rubber blocks to generatefriction with ground and stairs for climbing up and downThe stair-climbing robot consists of a main body for movinga front arm and a rear arm for moving up and down stairsThe main body is equipped with two brushless DC motors(BLDCMs) and their drives for locomotion worm gears fortorque amplification two dc motors to control two arms andDSP-based board as control center shown in Figure 1 [11]Thechassic size of themain body is 585 cm times 53 cm and each armis 48 cm times 40 cm such that the maximum length of the robot

Figure 1 Picture of the stair-climbing robot

Figure 2 Total travel of climbing-up motion

will be 1545 cm The robot is equipped with roller chainsattached with rubber blocks used to generate friction withground and stairs for moving There are 136 rubber blockswith size of 3 cm times 2 cm times 1 cm attached to the roller chains40 for each arm and 56 for main body The distance betweenany two plastic blocks is properly arranged to fix the stairbrink The moving direction of the robot is steered based onthe speed difference of two BLDCMs and the informationfrom ultrasonic sensorsThe robotmakes use of friction forcebetween the roller chainsrubber blocks and stairsground toclimb up The front arm will be pushed down to flat top sothat the main body is lifted The front arm will be pulled upfor next stair-climbing The rear arm is kept flat during therobot going up Figure 2 displays total travel of climbing-upmotion Similarly Figure 3 shows summary of going-downmotion

Step II DSP-Based Controller Design DSP provides the pulse-width modulation (PWM) signals of BLDCMs and DCmotors and realizes the fuzzy logic rules for speed control

The 119894th fuzzy rule in the fuzzy rule-base system isdescribed as [12]

119877119894 If 1199091 is 119860 1198941 and 1199092 is 119860 1198942 then 119910 is 119908119894 (1)

where 119908119894 119909119895 and 119860 119894119895 119895 = 1 2 119894 = 1 2 119899 are fuzzyoutput variables input fuzzy variables and linguistic vari-ables respectively Referring to Figure 4 for 119894th membershipfunction with isosceles triangle shape 119887119894119895 means the length of

Mathematical Problems in Engineering 3

Figure 3 Summary of going-down motion

xj

xjaij

bij

10

0

Aij(xj)

Figure 4 119894th membership function with isosceles triangle shape

the base and 119886119894119895 stands for the abscissa of the center of thebase The membership grade of input 119909119895 is calculated by

119860 119894119895 (119909119895) = 1 minus

2 sdot10038161003816100381610038161003816119909119895 minus 119886119894119895

10038161003816100381610038161003816

119887119894119895

119895 = 1 2 (2)

The bases of triangular membership function keep samefor easily programming By product operation the member-ship grade of the antecedent proposition is calculated as

120583119894 = 119860 1198941 (1199091) sdot 119860 1198942 (1199092) (3)

Then the output will be

119910 =sum119899

119894=1120583119894119908119894

sum119899

119894=1120583119894

(4)

Summarily Table 1 lists the linguistic control rules andFigure 5 displays the design scheme of fuzzy logic control

Step III FPGA-Based Visual Servo Design The graspingmultilink arm consists of three couples of gears three DCmotors four links and one clamper Referring to Figure 6the first DC motor steers the diving gear 1198781 and driven gear1198782 to determine the rotating angleThe secondmotor controlsthe gears of 1198783 1198784119889 1198784119906 and 1198785 together with belts to stretchthe length of the arm 1198784119889 and 1198784119906 are mounted in the same

Table 1 Linguistic control rule table

120579119898

IZO PS PM PB

NB ZO PS PM PBNM ZO PM PM PMNS ZO PB PS ZOZO ZO PB PS ZOPS ZO PB PS ZOPM ZO PS PM PMPB ZO PS PM PB

shaft and with the same number of gears Then the length119883can be calculated as

119883 = cos 120579 times 119897 times 2 (5)

where 119897 is the length of the link The third motor decides theopen angle of the clamper

The pixel array of CMOS camera THDB-D5Mused in therobot consists of a matrix of 2752 times 2004 pixels addressed bycolumn and row [13 14] The 2592 times 1944 array in the centercalled active region represents the default output image sur-rounded by an active boundary region and a border of darkpixels Pixels of active region are output in a Bayer patternformat consisting of four ldquocolorsrdquo green1 green2 red andblue (G1 G2 R and B) to represent three filter colors [12 13]The first row output alternates between G1 and R pixels andthe second row output alternates between B and G2 pixelsThe green1 and green2 pixels have the same color filter butthey are treated as separate colors by the data path and analogsignal chain

In order to calculate the R G and B intensity of eachpixel we relabel the Bayer pattern by the correspondingcolumn-row address shown in Figure 7 After analyzing wesummarize each expression of the color intensity for eachpixel as follows

(i) 119909 is even and 119910 is even

119877(119909119910) =

119877(119909minus1119910) + 119877(119909+1119910)

Pixel Count

Pixel Count = 2 (119909 minus 1) gt 10 (119909 + 1) lt 2681

1 others

119861(119909119910) =

119861(119909119910minus1) + 119861(119909119910+1)

Pixel Count

Pixel Count = 2 (119910 minus 1) gt 50 (119910 + 1) lt 2002

1 others

(6)

4 Mathematical Problems in Engineering

Input of IuI

1

0 2 4 6A

A1

A1

A2

A2

A3

A3

A4

A4

Ii

120579mI

B1B1

B2B2

B3B3

B4B4

B5B5

B6B6

B7

B7

C11

C12

C13

C14

C15

C16

C17

C21

C22

C23

C24

C25

C26

C27

C31

C32

C33

C34

C35

C36

C37

C41

C42

C43

C44

C45

C46

C47

Inpu

t of120579

m

u120579 m

minus6minus4minus2

02

46

V Rule table

Fuzzy inference and output

and 120579m is B4 then uf is C24Rule 2 if I is A2Rule 1 if I is A2

and 120579m is B5 then uf is C25Rule 3 if I is A3 and 120579m is B4 then uf is C34Rule 4 if I is A3 and 120579m is B5 then uf is C35

Defuzzification

W24 = minuI(A2) u 120579m(B4)

W25 = minuI(A2) u 120579m(B5)

W34 = minuI(A3) u 120579m(B4)

W35 = minuI(A3) u 120579m(B5)

uf =C24lowastW24 + C25lowastW25 + C34lowastW34 + C35lowastW35

W24 + W25 + W34 + W35

Figure 5 Design scheme of fuzzy logic control

S2

S3 S5

S1

S4dS4u

120579

120579

l

l l

l

X

Figure 6 Parameter definitions of the grasping arm

(ii) 119909 is even and 119910 is odd

119866(119909119910) =

119866(119909minus1119910) + 119866(119909+1119910) + 119866(119909119910minus1) + 119866(119909119910+1)

Pixel Count

Pixel Count =

4 (119909 minus 1) gt 10 (119909 + 1) lt 2618

3 others

119877(119909119910) =

119877(119909+1119910minus1) + 119877(119909minus1119910minus1) + 119877(119909+1119910+1) + 119877(119909minus1119910+1)

Pixel Count

Pixel Count =

4 (119909 minus 1) gt 10 (119909 + 1) lt 2618

2 others(7)

G(1450) R(1350) G(1250)

G(1351) G(1151)

G(1353) G(1153)

G(1050)

G(1452) G(1252) G(1052)

G(1454) G(1254) G(1054)

R(1150)

R(1352) R(1152)

R(1354) R(1154)

B(1451)

B(1453)

B(1251)

B(1253)

B(1051)

B(1053)

Figure 7 Bayer pattern by the corresponding column-row address

(iii) 119909 is odd and 119910 is even

119866(119909119910) =

119866(119909119910minus1) + 119866(119909119910+1) + 119866(119909minus1119910) + 119866(119909+1119910)

Pixel Count

Pixel Count =

4 (119910 minus 1) gt 50 (119910 + 1) lt 2002

3 others

119861(119909119910) =

119861(119909minus1119910minus1) + 119861(119909+1119910minus1) + 119861(119909+1119910+1) + 119861(119909minus1119910+1)

Pixel Count

Pixel Count =

4 (119910 minus 1) gt 50 (119910 + 1) lt 2002

2 others(8)

Mathematical Problems in Engineering 5

(a) (b)

Figure 8 Realized motion of (a) climbing up and (b) going down by wired control

(a) (b) (c)

Figure 9 Realized motion of climbing up by FLC

(a) (b) (c)

Figure 10 Realized motion of going down by FLC

6 Mathematical Problems in Engineering

(a) (b)

(c) (d)

(e) (f)

(g) (h)

(i) (j)

Figure 11 Continued

Mathematical Problems in Engineering 7

(k) (l)

(m) (n)

(o) (p)

Figure 11 The taped pictures of the experimental results on grasping

(iv) 119909 is odd and 119910 is odd

119877(119909119910) =

119877(119909119910minus1) + 119877(119909119910+1)

2

119861(119909119910) =

119861(119909minus1119910) + 119861(119909+1119910)

2

(9)

where 119909 and 119910 stand for the column address and row addressrespectively

The image raw data is sent from D5M to DE2-70 boardwhere the FPGA on DE2-70 board will handle image pro-cessing and convert the data to RGB format to display on theVGA display [15ndash17] As a result we first capture the imageof experiment background to find the ranges of colors ofRGB and then define their location regions for color discrim-ination In order to reduce the effect of light variation theimage in RGB space will be converted into 119884119862119887119862119903 space [5]In addition the ranges of RGB fromD5Mare four times of the

general image So those the transformation can be expressedas

[

[

119884

119862119887

119862119903

]

]

= [

[

0299 0587 0114

minus01687 minus033126 05

05 minus041869 minus008131

]

]

[

[

119877

119866

119861

]

]

+[[

[

64

512

512

]]

]

(10)

3 Experiment Results

Gear ratio used in the 45 kg stair-climbing robot is 1320 andthe rated dc input power and speed of the 200-W BLDCMare 24V and 9600 rpm A preliminary experiment that theunloaded robot climbs up and goes down a gradual stair withthe rise of 120mm and depth of 400mm by wired control istestedThe results of every motion are shown in Figure 8 [11]It qualifies the designed robot Then we conduct the secondexperiment that the robot with loading of one arm moves upand down a steeper stair with the rise of 175mm and depth

8 Mathematical Problems in Engineering

(a) (b)

(c) (d)

(e) (f)

Figure 12 Realized motion of climbing up at full loading

of 280mm The taped pictures of the experiment and everymotion are shown in Figures 9 and 10 respectively [12]

The third experiment contains image processing andgrasping armmotion In order to prevent target damagewhileclamping one pressure sensor is installed inside the clamperThe pressure output after calibrating is sent to DSP for refer-ence Figure 11 displays the sequentially taped pictures fromvideos of tracking capturing the cola can and putting it backby the robot arm Figure 11(a) presents the initial status ofthe experiment The arm tracks the corresponding directionafter the can is shifted left shown in Figures 11(b) and 11(c)Figures 11(d) and 11(e) depict the right tracking The armtracks the can back to central position shown in Figures 11(f)and 11(g) Then the robot stretches out the arm for capturingthe can and then draws the arm back presented in Figures

11(h)ndash11(l) Finally the robot puts the can back and goes backto the initial status presented in Figures 11(m)ndash11(p)

Finally we conduct the fourth experiment that the robotwith all loading moves up a stair with the rise of 150mm anddepth of 300mm The taped pictures of the experiment areshown in Figure 12 The climbing-up motion presents vari-ation in proceeding direction This is due to the plastic bellbeing almost torn into broken after long time of experimentaltest But it was not found

4 Conclusion

In the paper we have developed a stair-climbing robot andcompleted experiments of moving updown stairs and objecttracking capturing and loading In fact the stair-climbing

Mathematical Problems in Engineering 9

robot can provide service for the elders by capturing thespecific object at one floor and then climbing up or down toanother floor In addition the robot will patrol for securityby the CCD camera around the house while more imageprocessing functions are provided

Acknowledgments

The authors would like to express their appreciation toMinistry of Education and National Science Council Chinaunder Contract no NSC 100-2632-E-218-001-MY3 for finan-cial supporting

References

[1] K Harada H Hirukawa F Kanehiro et al ldquoDynamical balanceof a humanoid robot grasping an environmentrdquo in Proceedingsof the IEEERSJ International Conference on Intelligent Robotsand Systems pp 1167ndash1173 Sendai Japan October 2004

[2] Y Sugahara A Ohta K Hashimoto et al ldquoWalking up anddown stairs carrying a human by a biped locomotor with paral-lel mechanismrdquo in Proceedings of the IEEE IRSRSJ InternationalConference on Intelligent Robots and Systems pp 1489ndash1494Alberta Canada August 2005

[3] Y Konuma and S Hirose ldquoDevelopment of the stair-climbingbiped robot lsquoZero Walker-1rsquordquo in Proceedings of the 19th AnnualConference of the Robotics Society of Japan pp 851ndash852 2001

[4] Y Takahashi H Nakayama T Nagasawa et al ldquoRoboticassistance for aged peoplerdquo in Proceedings of the 37th SICEAnnual Conference pp 853ndash858 Chiba Japan July 1998

[5] AMalima E Ozgur andM Cetin ldquoA fast algorithm for vision-based hand gesture recognition for robot controlrdquo in Proceed-ings of the 14th IEEE Signal Processing and CommunicationsApplications pp 1ndash4 Antalya Turkey April 2006

[6] S Hutchinson G D Hager and P I Corke ldquoA tutorial on visualservo controlrdquo IEEE Transactions on Robotics and Automationvol 12 no 5 pp 651ndash670 1996

[7] C Copot C Lazar and A Burlacu ldquoPredictive control ofnonlinear visual servoing systems using image momentsrdquo IETControl Theory amp Applications vol 6 no 10 pp 1486ndash14962012

[8] Y Fang X Liu andX Zhang ldquoAdaptive active visual servoing ofnonholonomic mobile robotsrdquo IEEE Transactions on IndustrialElectronics vol 59 no 1 pp 486ndash497 2012

[9] B Tamadazte N L-F Piat and E Marchand ldquoA direct visualservoing scheme for automatic nanopositioningrdquo IEEEASMETransactions on Mechatronics vol 17 no 4 pp 728ndash736 2012

[10] X Zhang Y Fang and X Liu ldquoMotion-estimation-based visualservoing of nonholonomic mobile robotsrdquo IEEE Transactionson Robotics vol 27 no 6 pp 1167ndash1175 2011

[11] M-S Wang and Y-M Tu ldquoDesign and implementation of astair-climbing robotrdquo in Proceedings of the IEEE InternationalConference on Advanced Robotics and Its Social Impacts TaipeiTaiwan August 2008

[12] M-S Wang Y-S Kung and Y-M Tu ldquoFuzzy logic controldesign for a Stair-climbing robotrdquo International Journal of FuzzySystems vol 11 no 3 pp 174ndash182 2009

[13] Terasic Company THDB-D5M Hardware Specification 2008[14] Terasic Company TRDB-D5M User Guide 2008

[15] AK Benkhalil S S Sipson andWBooth ldquoReal-timedetectionand tracking of amoving object using a complex programmablelogic devicerdquo in Proceedings of the IEE Colloquium on TargetTracking and Data Fusion pp 1ndash7 Birmingham UK June 1998

[16] T Hamamoto S Nagao and K Aizawa ldquoReal-time objectstracking by using smart image sensor and FPGArdquo inProceedingsof the International Conference on Image Processing (ICIP rsquo02)pp III441ndashIII444 New York NY USA September 2002

[17] S-B Park A Teuner and B J Hosticka ldquoA motion detectionsystem based on a CMOS photo sensor arrayrdquo in Proceedingsof the International Conference on Image Processing vol 3 pp967ndash971 Chicago Ill USA October 1998

Submit your manuscripts athttpwwwhindawicom

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

MathematicsJournal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Mathematical Problems in Engineering

Hindawi Publishing Corporationhttpwwwhindawicom

Differential EquationsInternational Journal of

Volume 2014

Applied MathematicsJournal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Probability and StatisticsHindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Journal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Mathematical PhysicsAdvances in

Complex AnalysisJournal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

OptimizationJournal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

CombinatoricsHindawi Publishing Corporationhttpwwwhindawicom Volume 2014

International Journal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Operations ResearchAdvances in

Journal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Function Spaces

Abstract and Applied AnalysisHindawi Publishing Corporationhttpwwwhindawicom Volume 2014

International Journal of Mathematics and Mathematical Sciences

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

The Scientific World JournalHindawi Publishing Corporation httpwwwhindawicom Volume 2014

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Algebra

Discrete Dynamics in Nature and Society

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Decision SciencesAdvances in

Discrete MathematicsJournal of

Hindawi Publishing Corporationhttpwwwhindawicom

Volume 2014 Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Stochastic AnalysisInternational Journal of

Mathematical Problems in Engineering 3

Figure 3 Summary of going-down motion

xj

xjaij

bij

10

0

Aij(xj)

Figure 4 119894th membership function with isosceles triangle shape

the base and 119886119894119895 stands for the abscissa of the center of thebase The membership grade of input 119909119895 is calculated by

119860 119894119895 (119909119895) = 1 minus

2 sdot10038161003816100381610038161003816119909119895 minus 119886119894119895

10038161003816100381610038161003816

119887119894119895

119895 = 1 2 (2)

The bases of triangular membership function keep samefor easily programming By product operation the member-ship grade of the antecedent proposition is calculated as

120583119894 = 119860 1198941 (1199091) sdot 119860 1198942 (1199092) (3)

Then the output will be

119910 =sum119899

119894=1120583119894119908119894

sum119899

119894=1120583119894

(4)

Summarily Table 1 lists the linguistic control rules andFigure 5 displays the design scheme of fuzzy logic control

Step III FPGA-Based Visual Servo Design The graspingmultilink arm consists of three couples of gears three DCmotors four links and one clamper Referring to Figure 6the first DC motor steers the diving gear 1198781 and driven gear1198782 to determine the rotating angleThe secondmotor controlsthe gears of 1198783 1198784119889 1198784119906 and 1198785 together with belts to stretchthe length of the arm 1198784119889 and 1198784119906 are mounted in the same

Table 1 Linguistic control rule table

120579119898

IZO PS PM PB

NB ZO PS PM PBNM ZO PM PM PMNS ZO PB PS ZOZO ZO PB PS ZOPS ZO PB PS ZOPM ZO PS PM PMPB ZO PS PM PB

shaft and with the same number of gears Then the length119883can be calculated as

119883 = cos 120579 times 119897 times 2 (5)

where 119897 is the length of the link The third motor decides theopen angle of the clamper

The pixel array of CMOS camera THDB-D5Mused in therobot consists of a matrix of 2752 times 2004 pixels addressed bycolumn and row [13 14] The 2592 times 1944 array in the centercalled active region represents the default output image sur-rounded by an active boundary region and a border of darkpixels Pixels of active region are output in a Bayer patternformat consisting of four ldquocolorsrdquo green1 green2 red andblue (G1 G2 R and B) to represent three filter colors [12 13]The first row output alternates between G1 and R pixels andthe second row output alternates between B and G2 pixelsThe green1 and green2 pixels have the same color filter butthey are treated as separate colors by the data path and analogsignal chain

In order to calculate the R G and B intensity of eachpixel we relabel the Bayer pattern by the correspondingcolumn-row address shown in Figure 7 After analyzing wesummarize each expression of the color intensity for eachpixel as follows

(i) 119909 is even and 119910 is even

119877(119909119910) =

119877(119909minus1119910) + 119877(119909+1119910)

Pixel Count

Pixel Count = 2 (119909 minus 1) gt 10 (119909 + 1) lt 2681

1 others

119861(119909119910) =

119861(119909119910minus1) + 119861(119909119910+1)

Pixel Count

Pixel Count = 2 (119910 minus 1) gt 50 (119910 + 1) lt 2002

1 others

(6)

4 Mathematical Problems in Engineering

Input of IuI

1

0 2 4 6A

A1

A1

A2

A2

A3

A3

A4

A4

Ii

120579mI

B1B1

B2B2

B3B3

B4B4

B5B5

B6B6

B7

B7

C11

C12

C13

C14

C15

C16

C17

C21

C22

C23

C24

C25

C26

C27

C31

C32

C33

C34

C35

C36

C37

C41

C42

C43

C44

C45

C46

C47

Inpu

t of120579

m

u120579 m

minus6minus4minus2

02

46

V Rule table

Fuzzy inference and output

and 120579m is B4 then uf is C24Rule 2 if I is A2Rule 1 if I is A2

and 120579m is B5 then uf is C25Rule 3 if I is A3 and 120579m is B4 then uf is C34Rule 4 if I is A3 and 120579m is B5 then uf is C35

Defuzzification

W24 = minuI(A2) u 120579m(B4)

W25 = minuI(A2) u 120579m(B5)

W34 = minuI(A3) u 120579m(B4)

W35 = minuI(A3) u 120579m(B5)

uf =C24lowastW24 + C25lowastW25 + C34lowastW34 + C35lowastW35

W24 + W25 + W34 + W35

Figure 5 Design scheme of fuzzy logic control

S2

S3 S5

S1

S4dS4u

120579

120579

l

l l

l

X

Figure 6 Parameter definitions of the grasping arm

(ii) 119909 is even and 119910 is odd

119866(119909119910) =

119866(119909minus1119910) + 119866(119909+1119910) + 119866(119909119910minus1) + 119866(119909119910+1)

Pixel Count

Pixel Count =

4 (119909 minus 1) gt 10 (119909 + 1) lt 2618

3 others

119877(119909119910) =

119877(119909+1119910minus1) + 119877(119909minus1119910minus1) + 119877(119909+1119910+1) + 119877(119909minus1119910+1)

Pixel Count

Pixel Count =

4 (119909 minus 1) gt 10 (119909 + 1) lt 2618

2 others(7)

G(1450) R(1350) G(1250)

G(1351) G(1151)

G(1353) G(1153)

G(1050)

G(1452) G(1252) G(1052)

G(1454) G(1254) G(1054)

R(1150)

R(1352) R(1152)

R(1354) R(1154)

B(1451)

B(1453)

B(1251)

B(1253)

B(1051)

B(1053)

Figure 7 Bayer pattern by the corresponding column-row address

(iii) 119909 is odd and 119910 is even

119866(119909119910) =

119866(119909119910minus1) + 119866(119909119910+1) + 119866(119909minus1119910) + 119866(119909+1119910)

Pixel Count

Pixel Count =

4 (119910 minus 1) gt 50 (119910 + 1) lt 2002

3 others

119861(119909119910) =

119861(119909minus1119910minus1) + 119861(119909+1119910minus1) + 119861(119909+1119910+1) + 119861(119909minus1119910+1)

Pixel Count

Pixel Count =

4 (119910 minus 1) gt 50 (119910 + 1) lt 2002

2 others(8)

Mathematical Problems in Engineering 5

(a) (b)

Figure 8 Realized motion of (a) climbing up and (b) going down by wired control

(a) (b) (c)

Figure 9 Realized motion of climbing up by FLC

(a) (b) (c)

Figure 10 Realized motion of going down by FLC

6 Mathematical Problems in Engineering

(a) (b)

(c) (d)

(e) (f)

(g) (h)

(i) (j)

Figure 11 Continued

Mathematical Problems in Engineering 7

(k) (l)

(m) (n)

(o) (p)

Figure 11 The taped pictures of the experimental results on grasping

(iv) 119909 is odd and 119910 is odd

119877(119909119910) =

119877(119909119910minus1) + 119877(119909119910+1)

2

119861(119909119910) =

119861(119909minus1119910) + 119861(119909+1119910)

2

(9)

where 119909 and 119910 stand for the column address and row addressrespectively

The image raw data is sent from D5M to DE2-70 boardwhere the FPGA on DE2-70 board will handle image pro-cessing and convert the data to RGB format to display on theVGA display [15ndash17] As a result we first capture the imageof experiment background to find the ranges of colors ofRGB and then define their location regions for color discrim-ination In order to reduce the effect of light variation theimage in RGB space will be converted into 119884119862119887119862119903 space [5]In addition the ranges of RGB fromD5Mare four times of the

general image So those the transformation can be expressedas

[

[

119884

119862119887

119862119903

]

]

= [

[

0299 0587 0114

minus01687 minus033126 05

05 minus041869 minus008131

]

]

[

[

119877

119866

119861

]

]

+[[

[

64

512

512

]]

]

(10)

3 Experiment Results

Gear ratio used in the 45 kg stair-climbing robot is 1320 andthe rated dc input power and speed of the 200-W BLDCMare 24V and 9600 rpm A preliminary experiment that theunloaded robot climbs up and goes down a gradual stair withthe rise of 120mm and depth of 400mm by wired control istestedThe results of every motion are shown in Figure 8 [11]It qualifies the designed robot Then we conduct the secondexperiment that the robot with loading of one arm moves upand down a steeper stair with the rise of 175mm and depth

8 Mathematical Problems in Engineering

(a) (b)

(c) (d)

(e) (f)

Figure 12 Realized motion of climbing up at full loading

of 280mm The taped pictures of the experiment and everymotion are shown in Figures 9 and 10 respectively [12]

The third experiment contains image processing andgrasping armmotion In order to prevent target damagewhileclamping one pressure sensor is installed inside the clamperThe pressure output after calibrating is sent to DSP for refer-ence Figure 11 displays the sequentially taped pictures fromvideos of tracking capturing the cola can and putting it backby the robot arm Figure 11(a) presents the initial status ofthe experiment The arm tracks the corresponding directionafter the can is shifted left shown in Figures 11(b) and 11(c)Figures 11(d) and 11(e) depict the right tracking The armtracks the can back to central position shown in Figures 11(f)and 11(g) Then the robot stretches out the arm for capturingthe can and then draws the arm back presented in Figures

11(h)ndash11(l) Finally the robot puts the can back and goes backto the initial status presented in Figures 11(m)ndash11(p)

Finally we conduct the fourth experiment that the robotwith all loading moves up a stair with the rise of 150mm anddepth of 300mm The taped pictures of the experiment areshown in Figure 12 The climbing-up motion presents vari-ation in proceeding direction This is due to the plastic bellbeing almost torn into broken after long time of experimentaltest But it was not found

4 Conclusion

In the paper we have developed a stair-climbing robot andcompleted experiments of moving updown stairs and objecttracking capturing and loading In fact the stair-climbing

Mathematical Problems in Engineering 9

robot can provide service for the elders by capturing thespecific object at one floor and then climbing up or down toanother floor In addition the robot will patrol for securityby the CCD camera around the house while more imageprocessing functions are provided

Acknowledgments

The authors would like to express their appreciation toMinistry of Education and National Science Council Chinaunder Contract no NSC 100-2632-E-218-001-MY3 for finan-cial supporting

References

[1] K Harada H Hirukawa F Kanehiro et al ldquoDynamical balanceof a humanoid robot grasping an environmentrdquo in Proceedingsof the IEEERSJ International Conference on Intelligent Robotsand Systems pp 1167ndash1173 Sendai Japan October 2004

[2] Y Sugahara A Ohta K Hashimoto et al ldquoWalking up anddown stairs carrying a human by a biped locomotor with paral-lel mechanismrdquo in Proceedings of the IEEE IRSRSJ InternationalConference on Intelligent Robots and Systems pp 1489ndash1494Alberta Canada August 2005

[3] Y Konuma and S Hirose ldquoDevelopment of the stair-climbingbiped robot lsquoZero Walker-1rsquordquo in Proceedings of the 19th AnnualConference of the Robotics Society of Japan pp 851ndash852 2001

[4] Y Takahashi H Nakayama T Nagasawa et al ldquoRoboticassistance for aged peoplerdquo in Proceedings of the 37th SICEAnnual Conference pp 853ndash858 Chiba Japan July 1998

[5] AMalima E Ozgur andM Cetin ldquoA fast algorithm for vision-based hand gesture recognition for robot controlrdquo in Proceed-ings of the 14th IEEE Signal Processing and CommunicationsApplications pp 1ndash4 Antalya Turkey April 2006

[6] S Hutchinson G D Hager and P I Corke ldquoA tutorial on visualservo controlrdquo IEEE Transactions on Robotics and Automationvol 12 no 5 pp 651ndash670 1996

[7] C Copot C Lazar and A Burlacu ldquoPredictive control ofnonlinear visual servoing systems using image momentsrdquo IETControl Theory amp Applications vol 6 no 10 pp 1486ndash14962012

[8] Y Fang X Liu andX Zhang ldquoAdaptive active visual servoing ofnonholonomic mobile robotsrdquo IEEE Transactions on IndustrialElectronics vol 59 no 1 pp 486ndash497 2012

[9] B Tamadazte N L-F Piat and E Marchand ldquoA direct visualservoing scheme for automatic nanopositioningrdquo IEEEASMETransactions on Mechatronics vol 17 no 4 pp 728ndash736 2012

[10] X Zhang Y Fang and X Liu ldquoMotion-estimation-based visualservoing of nonholonomic mobile robotsrdquo IEEE Transactionson Robotics vol 27 no 6 pp 1167ndash1175 2011

[11] M-S Wang and Y-M Tu ldquoDesign and implementation of astair-climbing robotrdquo in Proceedings of the IEEE InternationalConference on Advanced Robotics and Its Social Impacts TaipeiTaiwan August 2008

[12] M-S Wang Y-S Kung and Y-M Tu ldquoFuzzy logic controldesign for a Stair-climbing robotrdquo International Journal of FuzzySystems vol 11 no 3 pp 174ndash182 2009

[13] Terasic Company THDB-D5M Hardware Specification 2008[14] Terasic Company TRDB-D5M User Guide 2008

[15] AK Benkhalil S S Sipson andWBooth ldquoReal-timedetectionand tracking of amoving object using a complex programmablelogic devicerdquo in Proceedings of the IEE Colloquium on TargetTracking and Data Fusion pp 1ndash7 Birmingham UK June 1998

[16] T Hamamoto S Nagao and K Aizawa ldquoReal-time objectstracking by using smart image sensor and FPGArdquo inProceedingsof the International Conference on Image Processing (ICIP rsquo02)pp III441ndashIII444 New York NY USA September 2002

[17] S-B Park A Teuner and B J Hosticka ldquoA motion detectionsystem based on a CMOS photo sensor arrayrdquo in Proceedingsof the International Conference on Image Processing vol 3 pp967ndash971 Chicago Ill USA October 1998

Submit your manuscripts athttpwwwhindawicom

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

MathematicsJournal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Mathematical Problems in Engineering

Hindawi Publishing Corporationhttpwwwhindawicom

Differential EquationsInternational Journal of

Volume 2014

Applied MathematicsJournal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Probability and StatisticsHindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Journal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Mathematical PhysicsAdvances in

Complex AnalysisJournal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

OptimizationJournal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

CombinatoricsHindawi Publishing Corporationhttpwwwhindawicom Volume 2014

International Journal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Operations ResearchAdvances in

Journal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Function Spaces

Abstract and Applied AnalysisHindawi Publishing Corporationhttpwwwhindawicom Volume 2014

International Journal of Mathematics and Mathematical Sciences

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

The Scientific World JournalHindawi Publishing Corporation httpwwwhindawicom Volume 2014

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Algebra

Discrete Dynamics in Nature and Society

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Decision SciencesAdvances in

Discrete MathematicsJournal of

Hindawi Publishing Corporationhttpwwwhindawicom

Volume 2014 Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Stochastic AnalysisInternational Journal of

4 Mathematical Problems in Engineering

Input of IuI

1

0 2 4 6A

A1

A1

A2

A2

A3

A3

A4

A4

Ii

120579mI

B1B1

B2B2

B3B3

B4B4

B5B5

B6B6

B7

B7

C11

C12

C13

C14

C15

C16

C17

C21

C22

C23

C24

C25

C26

C27

C31

C32

C33

C34

C35

C36

C37

C41

C42

C43

C44

C45

C46

C47

Inpu

t of120579

m

u120579 m

minus6minus4minus2

02

46

V Rule table

Fuzzy inference and output

and 120579m is B4 then uf is C24Rule 2 if I is A2Rule 1 if I is A2

and 120579m is B5 then uf is C25Rule 3 if I is A3 and 120579m is B4 then uf is C34Rule 4 if I is A3 and 120579m is B5 then uf is C35

Defuzzification

W24 = minuI(A2) u 120579m(B4)

W25 = minuI(A2) u 120579m(B5)

W34 = minuI(A3) u 120579m(B4)

W35 = minuI(A3) u 120579m(B5)

uf =C24lowastW24 + C25lowastW25 + C34lowastW34 + C35lowastW35

W24 + W25 + W34 + W35

Figure 5 Design scheme of fuzzy logic control

S2

S3 S5

S1

S4dS4u

120579

120579

l

l l

l

X

Figure 6 Parameter definitions of the grasping arm

(ii) 119909 is even and 119910 is odd

119866(119909119910) =

119866(119909minus1119910) + 119866(119909+1119910) + 119866(119909119910minus1) + 119866(119909119910+1)

Pixel Count

Pixel Count =

4 (119909 minus 1) gt 10 (119909 + 1) lt 2618

3 others

119877(119909119910) =

119877(119909+1119910minus1) + 119877(119909minus1119910minus1) + 119877(119909+1119910+1) + 119877(119909minus1119910+1)

Pixel Count

Pixel Count =

4 (119909 minus 1) gt 10 (119909 + 1) lt 2618

2 others(7)

G(1450) R(1350) G(1250)

G(1351) G(1151)

G(1353) G(1153)

G(1050)

G(1452) G(1252) G(1052)

G(1454) G(1254) G(1054)

R(1150)

R(1352) R(1152)

R(1354) R(1154)

B(1451)

B(1453)

B(1251)

B(1253)

B(1051)

B(1053)

Figure 7 Bayer pattern by the corresponding column-row address

(iii) 119909 is odd and 119910 is even

119866(119909119910) =

119866(119909119910minus1) + 119866(119909119910+1) + 119866(119909minus1119910) + 119866(119909+1119910)

Pixel Count

Pixel Count =

4 (119910 minus 1) gt 50 (119910 + 1) lt 2002

3 others

119861(119909119910) =

119861(119909minus1119910minus1) + 119861(119909+1119910minus1) + 119861(119909+1119910+1) + 119861(119909minus1119910+1)

Pixel Count

Pixel Count =

4 (119910 minus 1) gt 50 (119910 + 1) lt 2002

2 others(8)

Mathematical Problems in Engineering 5

(a) (b)

Figure 8 Realized motion of (a) climbing up and (b) going down by wired control

(a) (b) (c)

Figure 9 Realized motion of climbing up by FLC

(a) (b) (c)

Figure 10 Realized motion of going down by FLC

6 Mathematical Problems in Engineering

(a) (b)

(c) (d)

(e) (f)

(g) (h)

(i) (j)

Figure 11 Continued

Mathematical Problems in Engineering 7

(k) (l)

(m) (n)

(o) (p)

Figure 11 The taped pictures of the experimental results on grasping

(iv) 119909 is odd and 119910 is odd

119877(119909119910) =

119877(119909119910minus1) + 119877(119909119910+1)

2

119861(119909119910) =

119861(119909minus1119910) + 119861(119909+1119910)

2

(9)

where 119909 and 119910 stand for the column address and row addressrespectively

The image raw data is sent from D5M to DE2-70 boardwhere the FPGA on DE2-70 board will handle image pro-cessing and convert the data to RGB format to display on theVGA display [15ndash17] As a result we first capture the imageof experiment background to find the ranges of colors ofRGB and then define their location regions for color discrim-ination In order to reduce the effect of light variation theimage in RGB space will be converted into 119884119862119887119862119903 space [5]In addition the ranges of RGB fromD5Mare four times of the

general image So those the transformation can be expressedas

[

[

119884

119862119887

119862119903

]

]

= [

[

0299 0587 0114

minus01687 minus033126 05

05 minus041869 minus008131

]

]

[

[

119877

119866

119861

]

]

+[[

[

64

512

512

]]

]

(10)

3 Experiment Results

Gear ratio used in the 45 kg stair-climbing robot is 1320 andthe rated dc input power and speed of the 200-W BLDCMare 24V and 9600 rpm A preliminary experiment that theunloaded robot climbs up and goes down a gradual stair withthe rise of 120mm and depth of 400mm by wired control istestedThe results of every motion are shown in Figure 8 [11]It qualifies the designed robot Then we conduct the secondexperiment that the robot with loading of one arm moves upand down a steeper stair with the rise of 175mm and depth

8 Mathematical Problems in Engineering

(a) (b)

(c) (d)

(e) (f)

Figure 12 Realized motion of climbing up at full loading

of 280mm The taped pictures of the experiment and everymotion are shown in Figures 9 and 10 respectively [12]

The third experiment contains image processing andgrasping armmotion In order to prevent target damagewhileclamping one pressure sensor is installed inside the clamperThe pressure output after calibrating is sent to DSP for refer-ence Figure 11 displays the sequentially taped pictures fromvideos of tracking capturing the cola can and putting it backby the robot arm Figure 11(a) presents the initial status ofthe experiment The arm tracks the corresponding directionafter the can is shifted left shown in Figures 11(b) and 11(c)Figures 11(d) and 11(e) depict the right tracking The armtracks the can back to central position shown in Figures 11(f)and 11(g) Then the robot stretches out the arm for capturingthe can and then draws the arm back presented in Figures

11(h)ndash11(l) Finally the robot puts the can back and goes backto the initial status presented in Figures 11(m)ndash11(p)

Finally we conduct the fourth experiment that the robotwith all loading moves up a stair with the rise of 150mm anddepth of 300mm The taped pictures of the experiment areshown in Figure 12 The climbing-up motion presents vari-ation in proceeding direction This is due to the plastic bellbeing almost torn into broken after long time of experimentaltest But it was not found

4 Conclusion

In the paper we have developed a stair-climbing robot andcompleted experiments of moving updown stairs and objecttracking capturing and loading In fact the stair-climbing

Mathematical Problems in Engineering 9

robot can provide service for the elders by capturing thespecific object at one floor and then climbing up or down toanother floor In addition the robot will patrol for securityby the CCD camera around the house while more imageprocessing functions are provided

Acknowledgments

The authors would like to express their appreciation toMinistry of Education and National Science Council Chinaunder Contract no NSC 100-2632-E-218-001-MY3 for finan-cial supporting

References

[1] K Harada H Hirukawa F Kanehiro et al ldquoDynamical balanceof a humanoid robot grasping an environmentrdquo in Proceedingsof the IEEERSJ International Conference on Intelligent Robotsand Systems pp 1167ndash1173 Sendai Japan October 2004

[2] Y Sugahara A Ohta K Hashimoto et al ldquoWalking up anddown stairs carrying a human by a biped locomotor with paral-lel mechanismrdquo in Proceedings of the IEEE IRSRSJ InternationalConference on Intelligent Robots and Systems pp 1489ndash1494Alberta Canada August 2005

[3] Y Konuma and S Hirose ldquoDevelopment of the stair-climbingbiped robot lsquoZero Walker-1rsquordquo in Proceedings of the 19th AnnualConference of the Robotics Society of Japan pp 851ndash852 2001

[4] Y Takahashi H Nakayama T Nagasawa et al ldquoRoboticassistance for aged peoplerdquo in Proceedings of the 37th SICEAnnual Conference pp 853ndash858 Chiba Japan July 1998

[5] AMalima E Ozgur andM Cetin ldquoA fast algorithm for vision-based hand gesture recognition for robot controlrdquo in Proceed-ings of the 14th IEEE Signal Processing and CommunicationsApplications pp 1ndash4 Antalya Turkey April 2006

[6] S Hutchinson G D Hager and P I Corke ldquoA tutorial on visualservo controlrdquo IEEE Transactions on Robotics and Automationvol 12 no 5 pp 651ndash670 1996

[7] C Copot C Lazar and A Burlacu ldquoPredictive control ofnonlinear visual servoing systems using image momentsrdquo IETControl Theory amp Applications vol 6 no 10 pp 1486ndash14962012

[8] Y Fang X Liu andX Zhang ldquoAdaptive active visual servoing ofnonholonomic mobile robotsrdquo IEEE Transactions on IndustrialElectronics vol 59 no 1 pp 486ndash497 2012

[9] B Tamadazte N L-F Piat and E Marchand ldquoA direct visualservoing scheme for automatic nanopositioningrdquo IEEEASMETransactions on Mechatronics vol 17 no 4 pp 728ndash736 2012

[10] X Zhang Y Fang and X Liu ldquoMotion-estimation-based visualservoing of nonholonomic mobile robotsrdquo IEEE Transactionson Robotics vol 27 no 6 pp 1167ndash1175 2011

[11] M-S Wang and Y-M Tu ldquoDesign and implementation of astair-climbing robotrdquo in Proceedings of the IEEE InternationalConference on Advanced Robotics and Its Social Impacts TaipeiTaiwan August 2008

[12] M-S Wang Y-S Kung and Y-M Tu ldquoFuzzy logic controldesign for a Stair-climbing robotrdquo International Journal of FuzzySystems vol 11 no 3 pp 174ndash182 2009

[13] Terasic Company THDB-D5M Hardware Specification 2008[14] Terasic Company TRDB-D5M User Guide 2008

[15] AK Benkhalil S S Sipson andWBooth ldquoReal-timedetectionand tracking of amoving object using a complex programmablelogic devicerdquo in Proceedings of the IEE Colloquium on TargetTracking and Data Fusion pp 1ndash7 Birmingham UK June 1998

[16] T Hamamoto S Nagao and K Aizawa ldquoReal-time objectstracking by using smart image sensor and FPGArdquo inProceedingsof the International Conference on Image Processing (ICIP rsquo02)pp III441ndashIII444 New York NY USA September 2002

[17] S-B Park A Teuner and B J Hosticka ldquoA motion detectionsystem based on a CMOS photo sensor arrayrdquo in Proceedingsof the International Conference on Image Processing vol 3 pp967ndash971 Chicago Ill USA October 1998

Submit your manuscripts athttpwwwhindawicom

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

MathematicsJournal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Mathematical Problems in Engineering

Hindawi Publishing Corporationhttpwwwhindawicom

Differential EquationsInternational Journal of

Volume 2014

Applied MathematicsJournal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Probability and StatisticsHindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Journal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Mathematical PhysicsAdvances in

Complex AnalysisJournal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

OptimizationJournal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

CombinatoricsHindawi Publishing Corporationhttpwwwhindawicom Volume 2014

International Journal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Operations ResearchAdvances in

Journal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Function Spaces

Abstract and Applied AnalysisHindawi Publishing Corporationhttpwwwhindawicom Volume 2014

International Journal of Mathematics and Mathematical Sciences

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

The Scientific World JournalHindawi Publishing Corporation httpwwwhindawicom Volume 2014

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Algebra

Discrete Dynamics in Nature and Society

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Decision SciencesAdvances in

Discrete MathematicsJournal of

Hindawi Publishing Corporationhttpwwwhindawicom

Volume 2014 Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Stochastic AnalysisInternational Journal of

Mathematical Problems in Engineering 5

(a) (b)

Figure 8 Realized motion of (a) climbing up and (b) going down by wired control

(a) (b) (c)

Figure 9 Realized motion of climbing up by FLC

(a) (b) (c)

Figure 10 Realized motion of going down by FLC

6 Mathematical Problems in Engineering

(a) (b)

(c) (d)

(e) (f)

(g) (h)

(i) (j)

Figure 11 Continued

Mathematical Problems in Engineering 7

(k) (l)

(m) (n)

(o) (p)

Figure 11 The taped pictures of the experimental results on grasping

(iv) 119909 is odd and 119910 is odd

119877(119909119910) =

119877(119909119910minus1) + 119877(119909119910+1)

2

119861(119909119910) =

119861(119909minus1119910) + 119861(119909+1119910)

2

(9)

where 119909 and 119910 stand for the column address and row addressrespectively

The image raw data is sent from D5M to DE2-70 boardwhere the FPGA on DE2-70 board will handle image pro-cessing and convert the data to RGB format to display on theVGA display [15ndash17] As a result we first capture the imageof experiment background to find the ranges of colors ofRGB and then define their location regions for color discrim-ination In order to reduce the effect of light variation theimage in RGB space will be converted into 119884119862119887119862119903 space [5]In addition the ranges of RGB fromD5Mare four times of the

general image So those the transformation can be expressedas

[

[

119884

119862119887

119862119903

]

]

= [

[

0299 0587 0114

minus01687 minus033126 05

05 minus041869 minus008131

]

]

[

[

119877

119866

119861

]

]

+[[

[

64

512

512

]]

]

(10)

3 Experiment Results

Gear ratio used in the 45 kg stair-climbing robot is 1320 andthe rated dc input power and speed of the 200-W BLDCMare 24V and 9600 rpm A preliminary experiment that theunloaded robot climbs up and goes down a gradual stair withthe rise of 120mm and depth of 400mm by wired control istestedThe results of every motion are shown in Figure 8 [11]It qualifies the designed robot Then we conduct the secondexperiment that the robot with loading of one arm moves upand down a steeper stair with the rise of 175mm and depth

8 Mathematical Problems in Engineering

(a) (b)

(c) (d)

(e) (f)

Figure 12 Realized motion of climbing up at full loading

of 280mm The taped pictures of the experiment and everymotion are shown in Figures 9 and 10 respectively [12]

The third experiment contains image processing andgrasping armmotion In order to prevent target damagewhileclamping one pressure sensor is installed inside the clamperThe pressure output after calibrating is sent to DSP for refer-ence Figure 11 displays the sequentially taped pictures fromvideos of tracking capturing the cola can and putting it backby the robot arm Figure 11(a) presents the initial status ofthe experiment The arm tracks the corresponding directionafter the can is shifted left shown in Figures 11(b) and 11(c)Figures 11(d) and 11(e) depict the right tracking The armtracks the can back to central position shown in Figures 11(f)and 11(g) Then the robot stretches out the arm for capturingthe can and then draws the arm back presented in Figures

11(h)ndash11(l) Finally the robot puts the can back and goes backto the initial status presented in Figures 11(m)ndash11(p)

Finally we conduct the fourth experiment that the robotwith all loading moves up a stair with the rise of 150mm anddepth of 300mm The taped pictures of the experiment areshown in Figure 12 The climbing-up motion presents vari-ation in proceeding direction This is due to the plastic bellbeing almost torn into broken after long time of experimentaltest But it was not found

4 Conclusion

In the paper we have developed a stair-climbing robot andcompleted experiments of moving updown stairs and objecttracking capturing and loading In fact the stair-climbing

Mathematical Problems in Engineering 9

robot can provide service for the elders by capturing thespecific object at one floor and then climbing up or down toanother floor In addition the robot will patrol for securityby the CCD camera around the house while more imageprocessing functions are provided

Acknowledgments

The authors would like to express their appreciation toMinistry of Education and National Science Council Chinaunder Contract no NSC 100-2632-E-218-001-MY3 for finan-cial supporting

References

[1] K Harada H Hirukawa F Kanehiro et al ldquoDynamical balanceof a humanoid robot grasping an environmentrdquo in Proceedingsof the IEEERSJ International Conference on Intelligent Robotsand Systems pp 1167ndash1173 Sendai Japan October 2004

[2] Y Sugahara A Ohta K Hashimoto et al ldquoWalking up anddown stairs carrying a human by a biped locomotor with paral-lel mechanismrdquo in Proceedings of the IEEE IRSRSJ InternationalConference on Intelligent Robots and Systems pp 1489ndash1494Alberta Canada August 2005

[3] Y Konuma and S Hirose ldquoDevelopment of the stair-climbingbiped robot lsquoZero Walker-1rsquordquo in Proceedings of the 19th AnnualConference of the Robotics Society of Japan pp 851ndash852 2001

[4] Y Takahashi H Nakayama T Nagasawa et al ldquoRoboticassistance for aged peoplerdquo in Proceedings of the 37th SICEAnnual Conference pp 853ndash858 Chiba Japan July 1998

[5] AMalima E Ozgur andM Cetin ldquoA fast algorithm for vision-based hand gesture recognition for robot controlrdquo in Proceed-ings of the 14th IEEE Signal Processing and CommunicationsApplications pp 1ndash4 Antalya Turkey April 2006

[6] S Hutchinson G D Hager and P I Corke ldquoA tutorial on visualservo controlrdquo IEEE Transactions on Robotics and Automationvol 12 no 5 pp 651ndash670 1996

[7] C Copot C Lazar and A Burlacu ldquoPredictive control ofnonlinear visual servoing systems using image momentsrdquo IETControl Theory amp Applications vol 6 no 10 pp 1486ndash14962012

[8] Y Fang X Liu andX Zhang ldquoAdaptive active visual servoing ofnonholonomic mobile robotsrdquo IEEE Transactions on IndustrialElectronics vol 59 no 1 pp 486ndash497 2012

[9] B Tamadazte N L-F Piat and E Marchand ldquoA direct visualservoing scheme for automatic nanopositioningrdquo IEEEASMETransactions on Mechatronics vol 17 no 4 pp 728ndash736 2012

[10] X Zhang Y Fang and X Liu ldquoMotion-estimation-based visualservoing of nonholonomic mobile robotsrdquo IEEE Transactionson Robotics vol 27 no 6 pp 1167ndash1175 2011

[11] M-S Wang and Y-M Tu ldquoDesign and implementation of astair-climbing robotrdquo in Proceedings of the IEEE InternationalConference on Advanced Robotics and Its Social Impacts TaipeiTaiwan August 2008

[12] M-S Wang Y-S Kung and Y-M Tu ldquoFuzzy logic controldesign for a Stair-climbing robotrdquo International Journal of FuzzySystems vol 11 no 3 pp 174ndash182 2009

[13] Terasic Company THDB-D5M Hardware Specification 2008[14] Terasic Company TRDB-D5M User Guide 2008

[15] AK Benkhalil S S Sipson andWBooth ldquoReal-timedetectionand tracking of amoving object using a complex programmablelogic devicerdquo in Proceedings of the IEE Colloquium on TargetTracking and Data Fusion pp 1ndash7 Birmingham UK June 1998

[16] T Hamamoto S Nagao and K Aizawa ldquoReal-time objectstracking by using smart image sensor and FPGArdquo inProceedingsof the International Conference on Image Processing (ICIP rsquo02)pp III441ndashIII444 New York NY USA September 2002

[17] S-B Park A Teuner and B J Hosticka ldquoA motion detectionsystem based on a CMOS photo sensor arrayrdquo in Proceedingsof the International Conference on Image Processing vol 3 pp967ndash971 Chicago Ill USA October 1998

Submit your manuscripts athttpwwwhindawicom

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

MathematicsJournal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Mathematical Problems in Engineering

Hindawi Publishing Corporationhttpwwwhindawicom

Differential EquationsInternational Journal of

Volume 2014

Applied MathematicsJournal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Probability and StatisticsHindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Journal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Mathematical PhysicsAdvances in

Complex AnalysisJournal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

OptimizationJournal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

CombinatoricsHindawi Publishing Corporationhttpwwwhindawicom Volume 2014

International Journal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Operations ResearchAdvances in

Journal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Function Spaces

Abstract and Applied AnalysisHindawi Publishing Corporationhttpwwwhindawicom Volume 2014

International Journal of Mathematics and Mathematical Sciences

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

The Scientific World JournalHindawi Publishing Corporation httpwwwhindawicom Volume 2014

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Algebra

Discrete Dynamics in Nature and Society

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Decision SciencesAdvances in

Discrete MathematicsJournal of

Hindawi Publishing Corporationhttpwwwhindawicom

Volume 2014 Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Stochastic AnalysisInternational Journal of

6 Mathematical Problems in Engineering

(a) (b)

(c) (d)

(e) (f)

(g) (h)

(i) (j)

Figure 11 Continued

Mathematical Problems in Engineering 7

(k) (l)

(m) (n)

(o) (p)

Figure 11 The taped pictures of the experimental results on grasping

(iv) 119909 is odd and 119910 is odd

119877(119909119910) =

119877(119909119910minus1) + 119877(119909119910+1)

2

119861(119909119910) =

119861(119909minus1119910) + 119861(119909+1119910)

2

(9)

where 119909 and 119910 stand for the column address and row addressrespectively

The image raw data is sent from D5M to DE2-70 boardwhere the FPGA on DE2-70 board will handle image pro-cessing and convert the data to RGB format to display on theVGA display [15ndash17] As a result we first capture the imageof experiment background to find the ranges of colors ofRGB and then define their location regions for color discrim-ination In order to reduce the effect of light variation theimage in RGB space will be converted into 119884119862119887119862119903 space [5]In addition the ranges of RGB fromD5Mare four times of the

general image So those the transformation can be expressedas

[

[

119884

119862119887

119862119903

]

]

= [

[

0299 0587 0114

minus01687 minus033126 05

05 minus041869 minus008131

]

]

[

[

119877

119866

119861

]

]

+[[

[

64

512

512

]]

]

(10)

3 Experiment Results

Gear ratio used in the 45 kg stair-climbing robot is 1320 andthe rated dc input power and speed of the 200-W BLDCMare 24V and 9600 rpm A preliminary experiment that theunloaded robot climbs up and goes down a gradual stair withthe rise of 120mm and depth of 400mm by wired control istestedThe results of every motion are shown in Figure 8 [11]It qualifies the designed robot Then we conduct the secondexperiment that the robot with loading of one arm moves upand down a steeper stair with the rise of 175mm and depth

8 Mathematical Problems in Engineering

(a) (b)

(c) (d)

(e) (f)

Figure 12 Realized motion of climbing up at full loading

of 280mm The taped pictures of the experiment and everymotion are shown in Figures 9 and 10 respectively [12]

The third experiment contains image processing andgrasping armmotion In order to prevent target damagewhileclamping one pressure sensor is installed inside the clamperThe pressure output after calibrating is sent to DSP for refer-ence Figure 11 displays the sequentially taped pictures fromvideos of tracking capturing the cola can and putting it backby the robot arm Figure 11(a) presents the initial status ofthe experiment The arm tracks the corresponding directionafter the can is shifted left shown in Figures 11(b) and 11(c)Figures 11(d) and 11(e) depict the right tracking The armtracks the can back to central position shown in Figures 11(f)and 11(g) Then the robot stretches out the arm for capturingthe can and then draws the arm back presented in Figures

11(h)ndash11(l) Finally the robot puts the can back and goes backto the initial status presented in Figures 11(m)ndash11(p)

Finally we conduct the fourth experiment that the robotwith all loading moves up a stair with the rise of 150mm anddepth of 300mm The taped pictures of the experiment areshown in Figure 12 The climbing-up motion presents vari-ation in proceeding direction This is due to the plastic bellbeing almost torn into broken after long time of experimentaltest But it was not found

4 Conclusion

In the paper we have developed a stair-climbing robot andcompleted experiments of moving updown stairs and objecttracking capturing and loading In fact the stair-climbing

Mathematical Problems in Engineering 9

robot can provide service for the elders by capturing thespecific object at one floor and then climbing up or down toanother floor In addition the robot will patrol for securityby the CCD camera around the house while more imageprocessing functions are provided

Acknowledgments

The authors would like to express their appreciation toMinistry of Education and National Science Council Chinaunder Contract no NSC 100-2632-E-218-001-MY3 for finan-cial supporting

References

[1] K Harada H Hirukawa F Kanehiro et al ldquoDynamical balanceof a humanoid robot grasping an environmentrdquo in Proceedingsof the IEEERSJ International Conference on Intelligent Robotsand Systems pp 1167ndash1173 Sendai Japan October 2004

[2] Y Sugahara A Ohta K Hashimoto et al ldquoWalking up anddown stairs carrying a human by a biped locomotor with paral-lel mechanismrdquo in Proceedings of the IEEE IRSRSJ InternationalConference on Intelligent Robots and Systems pp 1489ndash1494Alberta Canada August 2005

[3] Y Konuma and S Hirose ldquoDevelopment of the stair-climbingbiped robot lsquoZero Walker-1rsquordquo in Proceedings of the 19th AnnualConference of the Robotics Society of Japan pp 851ndash852 2001

[4] Y Takahashi H Nakayama T Nagasawa et al ldquoRoboticassistance for aged peoplerdquo in Proceedings of the 37th SICEAnnual Conference pp 853ndash858 Chiba Japan July 1998

[5] AMalima E Ozgur andM Cetin ldquoA fast algorithm for vision-based hand gesture recognition for robot controlrdquo in Proceed-ings of the 14th IEEE Signal Processing and CommunicationsApplications pp 1ndash4 Antalya Turkey April 2006

[6] S Hutchinson G D Hager and P I Corke ldquoA tutorial on visualservo controlrdquo IEEE Transactions on Robotics and Automationvol 12 no 5 pp 651ndash670 1996

[7] C Copot C Lazar and A Burlacu ldquoPredictive control ofnonlinear visual servoing systems using image momentsrdquo IETControl Theory amp Applications vol 6 no 10 pp 1486ndash14962012

[8] Y Fang X Liu andX Zhang ldquoAdaptive active visual servoing ofnonholonomic mobile robotsrdquo IEEE Transactions on IndustrialElectronics vol 59 no 1 pp 486ndash497 2012

[9] B Tamadazte N L-F Piat and E Marchand ldquoA direct visualservoing scheme for automatic nanopositioningrdquo IEEEASMETransactions on Mechatronics vol 17 no 4 pp 728ndash736 2012

[10] X Zhang Y Fang and X Liu ldquoMotion-estimation-based visualservoing of nonholonomic mobile robotsrdquo IEEE Transactionson Robotics vol 27 no 6 pp 1167ndash1175 2011

[11] M-S Wang and Y-M Tu ldquoDesign and implementation of astair-climbing robotrdquo in Proceedings of the IEEE InternationalConference on Advanced Robotics and Its Social Impacts TaipeiTaiwan August 2008

[12] M-S Wang Y-S Kung and Y-M Tu ldquoFuzzy logic controldesign for a Stair-climbing robotrdquo International Journal of FuzzySystems vol 11 no 3 pp 174ndash182 2009

[13] Terasic Company THDB-D5M Hardware Specification 2008[14] Terasic Company TRDB-D5M User Guide 2008

[15] AK Benkhalil S S Sipson andWBooth ldquoReal-timedetectionand tracking of amoving object using a complex programmablelogic devicerdquo in Proceedings of the IEE Colloquium on TargetTracking and Data Fusion pp 1ndash7 Birmingham UK June 1998

[16] T Hamamoto S Nagao and K Aizawa ldquoReal-time objectstracking by using smart image sensor and FPGArdquo inProceedingsof the International Conference on Image Processing (ICIP rsquo02)pp III441ndashIII444 New York NY USA September 2002

[17] S-B Park A Teuner and B J Hosticka ldquoA motion detectionsystem based on a CMOS photo sensor arrayrdquo in Proceedingsof the International Conference on Image Processing vol 3 pp967ndash971 Chicago Ill USA October 1998

Submit your manuscripts athttpwwwhindawicom

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

MathematicsJournal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Mathematical Problems in Engineering

Hindawi Publishing Corporationhttpwwwhindawicom

Differential EquationsInternational Journal of

Volume 2014

Applied MathematicsJournal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Probability and StatisticsHindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Journal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Mathematical PhysicsAdvances in

Complex AnalysisJournal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

OptimizationJournal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

CombinatoricsHindawi Publishing Corporationhttpwwwhindawicom Volume 2014

International Journal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Operations ResearchAdvances in

Journal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Function Spaces

Abstract and Applied AnalysisHindawi Publishing Corporationhttpwwwhindawicom Volume 2014

International Journal of Mathematics and Mathematical Sciences

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

The Scientific World JournalHindawi Publishing Corporation httpwwwhindawicom Volume 2014

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Algebra

Discrete Dynamics in Nature and Society

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Decision SciencesAdvances in

Discrete MathematicsJournal of

Hindawi Publishing Corporationhttpwwwhindawicom

Volume 2014 Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Stochastic AnalysisInternational Journal of

Mathematical Problems in Engineering 7

(k) (l)

(m) (n)

(o) (p)

Figure 11 The taped pictures of the experimental results on grasping

(iv) 119909 is odd and 119910 is odd

119877(119909119910) =

119877(119909119910minus1) + 119877(119909119910+1)

2

119861(119909119910) =

119861(119909minus1119910) + 119861(119909+1119910)

2

(9)

where 119909 and 119910 stand for the column address and row addressrespectively

The image raw data is sent from D5M to DE2-70 boardwhere the FPGA on DE2-70 board will handle image pro-cessing and convert the data to RGB format to display on theVGA display [15ndash17] As a result we first capture the imageof experiment background to find the ranges of colors ofRGB and then define their location regions for color discrim-ination In order to reduce the effect of light variation theimage in RGB space will be converted into 119884119862119887119862119903 space [5]In addition the ranges of RGB fromD5Mare four times of the

general image So those the transformation can be expressedas

[

[

119884

119862119887

119862119903

]

]

= [

[

0299 0587 0114

minus01687 minus033126 05

05 minus041869 minus008131

]

]

[

[

119877

119866

119861

]

]

+[[

[

64

512

512

]]

]

(10)

3 Experiment Results

Gear ratio used in the 45 kg stair-climbing robot is 1320 andthe rated dc input power and speed of the 200-W BLDCMare 24V and 9600 rpm A preliminary experiment that theunloaded robot climbs up and goes down a gradual stair withthe rise of 120mm and depth of 400mm by wired control istestedThe results of every motion are shown in Figure 8 [11]It qualifies the designed robot Then we conduct the secondexperiment that the robot with loading of one arm moves upand down a steeper stair with the rise of 175mm and depth

8 Mathematical Problems in Engineering

(a) (b)

(c) (d)

(e) (f)

Figure 12 Realized motion of climbing up at full loading

of 280mm The taped pictures of the experiment and everymotion are shown in Figures 9 and 10 respectively [12]

The third experiment contains image processing andgrasping armmotion In order to prevent target damagewhileclamping one pressure sensor is installed inside the clamperThe pressure output after calibrating is sent to DSP for refer-ence Figure 11 displays the sequentially taped pictures fromvideos of tracking capturing the cola can and putting it backby the robot arm Figure 11(a) presents the initial status ofthe experiment The arm tracks the corresponding directionafter the can is shifted left shown in Figures 11(b) and 11(c)Figures 11(d) and 11(e) depict the right tracking The armtracks the can back to central position shown in Figures 11(f)and 11(g) Then the robot stretches out the arm for capturingthe can and then draws the arm back presented in Figures

11(h)ndash11(l) Finally the robot puts the can back and goes backto the initial status presented in Figures 11(m)ndash11(p)

Finally we conduct the fourth experiment that the robotwith all loading moves up a stair with the rise of 150mm anddepth of 300mm The taped pictures of the experiment areshown in Figure 12 The climbing-up motion presents vari-ation in proceeding direction This is due to the plastic bellbeing almost torn into broken after long time of experimentaltest But it was not found

4 Conclusion

In the paper we have developed a stair-climbing robot andcompleted experiments of moving updown stairs and objecttracking capturing and loading In fact the stair-climbing

Mathematical Problems in Engineering 9

robot can provide service for the elders by capturing thespecific object at one floor and then climbing up or down toanother floor In addition the robot will patrol for securityby the CCD camera around the house while more imageprocessing functions are provided

Acknowledgments

The authors would like to express their appreciation toMinistry of Education and National Science Council Chinaunder Contract no NSC 100-2632-E-218-001-MY3 for finan-cial supporting

References

[1] K Harada H Hirukawa F Kanehiro et al ldquoDynamical balanceof a humanoid robot grasping an environmentrdquo in Proceedingsof the IEEERSJ International Conference on Intelligent Robotsand Systems pp 1167ndash1173 Sendai Japan October 2004

[2] Y Sugahara A Ohta K Hashimoto et al ldquoWalking up anddown stairs carrying a human by a biped locomotor with paral-lel mechanismrdquo in Proceedings of the IEEE IRSRSJ InternationalConference on Intelligent Robots and Systems pp 1489ndash1494Alberta Canada August 2005

[3] Y Konuma and S Hirose ldquoDevelopment of the stair-climbingbiped robot lsquoZero Walker-1rsquordquo in Proceedings of the 19th AnnualConference of the Robotics Society of Japan pp 851ndash852 2001

[4] Y Takahashi H Nakayama T Nagasawa et al ldquoRoboticassistance for aged peoplerdquo in Proceedings of the 37th SICEAnnual Conference pp 853ndash858 Chiba Japan July 1998

[5] AMalima E Ozgur andM Cetin ldquoA fast algorithm for vision-based hand gesture recognition for robot controlrdquo in Proceed-ings of the 14th IEEE Signal Processing and CommunicationsApplications pp 1ndash4 Antalya Turkey April 2006

[6] S Hutchinson G D Hager and P I Corke ldquoA tutorial on visualservo controlrdquo IEEE Transactions on Robotics and Automationvol 12 no 5 pp 651ndash670 1996

[7] C Copot C Lazar and A Burlacu ldquoPredictive control ofnonlinear visual servoing systems using image momentsrdquo IETControl Theory amp Applications vol 6 no 10 pp 1486ndash14962012

[8] Y Fang X Liu andX Zhang ldquoAdaptive active visual servoing ofnonholonomic mobile robotsrdquo IEEE Transactions on IndustrialElectronics vol 59 no 1 pp 486ndash497 2012

[9] B Tamadazte N L-F Piat and E Marchand ldquoA direct visualservoing scheme for automatic nanopositioningrdquo IEEEASMETransactions on Mechatronics vol 17 no 4 pp 728ndash736 2012

[10] X Zhang Y Fang and X Liu ldquoMotion-estimation-based visualservoing of nonholonomic mobile robotsrdquo IEEE Transactionson Robotics vol 27 no 6 pp 1167ndash1175 2011

[11] M-S Wang and Y-M Tu ldquoDesign and implementation of astair-climbing robotrdquo in Proceedings of the IEEE InternationalConference on Advanced Robotics and Its Social Impacts TaipeiTaiwan August 2008

[12] M-S Wang Y-S Kung and Y-M Tu ldquoFuzzy logic controldesign for a Stair-climbing robotrdquo International Journal of FuzzySystems vol 11 no 3 pp 174ndash182 2009

[13] Terasic Company THDB-D5M Hardware Specification 2008[14] Terasic Company TRDB-D5M User Guide 2008

[15] AK Benkhalil S S Sipson andWBooth ldquoReal-timedetectionand tracking of amoving object using a complex programmablelogic devicerdquo in Proceedings of the IEE Colloquium on TargetTracking and Data Fusion pp 1ndash7 Birmingham UK June 1998

[16] T Hamamoto S Nagao and K Aizawa ldquoReal-time objectstracking by using smart image sensor and FPGArdquo inProceedingsof the International Conference on Image Processing (ICIP rsquo02)pp III441ndashIII444 New York NY USA September 2002

[17] S-B Park A Teuner and B J Hosticka ldquoA motion detectionsystem based on a CMOS photo sensor arrayrdquo in Proceedingsof the International Conference on Image Processing vol 3 pp967ndash971 Chicago Ill USA October 1998

Submit your manuscripts athttpwwwhindawicom

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

MathematicsJournal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Mathematical Problems in Engineering

Hindawi Publishing Corporationhttpwwwhindawicom

Differential EquationsInternational Journal of

Volume 2014

Applied MathematicsJournal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Probability and StatisticsHindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Journal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Mathematical PhysicsAdvances in

Complex AnalysisJournal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

OptimizationJournal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

CombinatoricsHindawi Publishing Corporationhttpwwwhindawicom Volume 2014

International Journal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Operations ResearchAdvances in

Journal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Function Spaces

Abstract and Applied AnalysisHindawi Publishing Corporationhttpwwwhindawicom Volume 2014

International Journal of Mathematics and Mathematical Sciences

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

The Scientific World JournalHindawi Publishing Corporation httpwwwhindawicom Volume 2014

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Algebra

Discrete Dynamics in Nature and Society

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Decision SciencesAdvances in

Discrete MathematicsJournal of

Hindawi Publishing Corporationhttpwwwhindawicom

Volume 2014 Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Stochastic AnalysisInternational Journal of

8 Mathematical Problems in Engineering

(a) (b)

(c) (d)

(e) (f)

Figure 12 Realized motion of climbing up at full loading

of 280mm The taped pictures of the experiment and everymotion are shown in Figures 9 and 10 respectively [12]

The third experiment contains image processing andgrasping armmotion In order to prevent target damagewhileclamping one pressure sensor is installed inside the clamperThe pressure output after calibrating is sent to DSP for refer-ence Figure 11 displays the sequentially taped pictures fromvideos of tracking capturing the cola can and putting it backby the robot arm Figure 11(a) presents the initial status ofthe experiment The arm tracks the corresponding directionafter the can is shifted left shown in Figures 11(b) and 11(c)Figures 11(d) and 11(e) depict the right tracking The armtracks the can back to central position shown in Figures 11(f)and 11(g) Then the robot stretches out the arm for capturingthe can and then draws the arm back presented in Figures

11(h)ndash11(l) Finally the robot puts the can back and goes backto the initial status presented in Figures 11(m)ndash11(p)

Finally we conduct the fourth experiment that the robotwith all loading moves up a stair with the rise of 150mm anddepth of 300mm The taped pictures of the experiment areshown in Figure 12 The climbing-up motion presents vari-ation in proceeding direction This is due to the plastic bellbeing almost torn into broken after long time of experimentaltest But it was not found

4 Conclusion

In the paper we have developed a stair-climbing robot andcompleted experiments of moving updown stairs and objecttracking capturing and loading In fact the stair-climbing

Mathematical Problems in Engineering 9

robot can provide service for the elders by capturing thespecific object at one floor and then climbing up or down toanother floor In addition the robot will patrol for securityby the CCD camera around the house while more imageprocessing functions are provided

Acknowledgments

The authors would like to express their appreciation toMinistry of Education and National Science Council Chinaunder Contract no NSC 100-2632-E-218-001-MY3 for finan-cial supporting

References

[1] K Harada H Hirukawa F Kanehiro et al ldquoDynamical balanceof a humanoid robot grasping an environmentrdquo in Proceedingsof the IEEERSJ International Conference on Intelligent Robotsand Systems pp 1167ndash1173 Sendai Japan October 2004

[2] Y Sugahara A Ohta K Hashimoto et al ldquoWalking up anddown stairs carrying a human by a biped locomotor with paral-lel mechanismrdquo in Proceedings of the IEEE IRSRSJ InternationalConference on Intelligent Robots and Systems pp 1489ndash1494Alberta Canada August 2005

[3] Y Konuma and S Hirose ldquoDevelopment of the stair-climbingbiped robot lsquoZero Walker-1rsquordquo in Proceedings of the 19th AnnualConference of the Robotics Society of Japan pp 851ndash852 2001

[4] Y Takahashi H Nakayama T Nagasawa et al ldquoRoboticassistance for aged peoplerdquo in Proceedings of the 37th SICEAnnual Conference pp 853ndash858 Chiba Japan July 1998

[5] AMalima E Ozgur andM Cetin ldquoA fast algorithm for vision-based hand gesture recognition for robot controlrdquo in Proceed-ings of the 14th IEEE Signal Processing and CommunicationsApplications pp 1ndash4 Antalya Turkey April 2006

[6] S Hutchinson G D Hager and P I Corke ldquoA tutorial on visualservo controlrdquo IEEE Transactions on Robotics and Automationvol 12 no 5 pp 651ndash670 1996

[7] C Copot C Lazar and A Burlacu ldquoPredictive control ofnonlinear visual servoing systems using image momentsrdquo IETControl Theory amp Applications vol 6 no 10 pp 1486ndash14962012

[8] Y Fang X Liu andX Zhang ldquoAdaptive active visual servoing ofnonholonomic mobile robotsrdquo IEEE Transactions on IndustrialElectronics vol 59 no 1 pp 486ndash497 2012

[9] B Tamadazte N L-F Piat and E Marchand ldquoA direct visualservoing scheme for automatic nanopositioningrdquo IEEEASMETransactions on Mechatronics vol 17 no 4 pp 728ndash736 2012

[10] X Zhang Y Fang and X Liu ldquoMotion-estimation-based visualservoing of nonholonomic mobile robotsrdquo IEEE Transactionson Robotics vol 27 no 6 pp 1167ndash1175 2011

[11] M-S Wang and Y-M Tu ldquoDesign and implementation of astair-climbing robotrdquo in Proceedings of the IEEE InternationalConference on Advanced Robotics and Its Social Impacts TaipeiTaiwan August 2008

[12] M-S Wang Y-S Kung and Y-M Tu ldquoFuzzy logic controldesign for a Stair-climbing robotrdquo International Journal of FuzzySystems vol 11 no 3 pp 174ndash182 2009

[13] Terasic Company THDB-D5M Hardware Specification 2008[14] Terasic Company TRDB-D5M User Guide 2008

[15] AK Benkhalil S S Sipson andWBooth ldquoReal-timedetectionand tracking of amoving object using a complex programmablelogic devicerdquo in Proceedings of the IEE Colloquium on TargetTracking and Data Fusion pp 1ndash7 Birmingham UK June 1998

[16] T Hamamoto S Nagao and K Aizawa ldquoReal-time objectstracking by using smart image sensor and FPGArdquo inProceedingsof the International Conference on Image Processing (ICIP rsquo02)pp III441ndashIII444 New York NY USA September 2002

[17] S-B Park A Teuner and B J Hosticka ldquoA motion detectionsystem based on a CMOS photo sensor arrayrdquo in Proceedingsof the International Conference on Image Processing vol 3 pp967ndash971 Chicago Ill USA October 1998

Submit your manuscripts athttpwwwhindawicom

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

MathematicsJournal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Mathematical Problems in Engineering

Hindawi Publishing Corporationhttpwwwhindawicom

Differential EquationsInternational Journal of

Volume 2014

Applied MathematicsJournal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Probability and StatisticsHindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Journal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Mathematical PhysicsAdvances in

Complex AnalysisJournal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

OptimizationJournal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

CombinatoricsHindawi Publishing Corporationhttpwwwhindawicom Volume 2014

International Journal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Operations ResearchAdvances in

Journal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Function Spaces

Abstract and Applied AnalysisHindawi Publishing Corporationhttpwwwhindawicom Volume 2014

International Journal of Mathematics and Mathematical Sciences

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

The Scientific World JournalHindawi Publishing Corporation httpwwwhindawicom Volume 2014

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Algebra

Discrete Dynamics in Nature and Society

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Decision SciencesAdvances in

Discrete MathematicsJournal of

Hindawi Publishing Corporationhttpwwwhindawicom

Volume 2014 Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Stochastic AnalysisInternational Journal of

Mathematical Problems in Engineering 9

robot can provide service for the elders by capturing thespecific object at one floor and then climbing up or down toanother floor In addition the robot will patrol for securityby the CCD camera around the house while more imageprocessing functions are provided

Acknowledgments

The authors would like to express their appreciation toMinistry of Education and National Science Council Chinaunder Contract no NSC 100-2632-E-218-001-MY3 for finan-cial supporting

References

[1] K Harada H Hirukawa F Kanehiro et al ldquoDynamical balanceof a humanoid robot grasping an environmentrdquo in Proceedingsof the IEEERSJ International Conference on Intelligent Robotsand Systems pp 1167ndash1173 Sendai Japan October 2004

[2] Y Sugahara A Ohta K Hashimoto et al ldquoWalking up anddown stairs carrying a human by a biped locomotor with paral-lel mechanismrdquo in Proceedings of the IEEE IRSRSJ InternationalConference on Intelligent Robots and Systems pp 1489ndash1494Alberta Canada August 2005

[3] Y Konuma and S Hirose ldquoDevelopment of the stair-climbingbiped robot lsquoZero Walker-1rsquordquo in Proceedings of the 19th AnnualConference of the Robotics Society of Japan pp 851ndash852 2001

[4] Y Takahashi H Nakayama T Nagasawa et al ldquoRoboticassistance for aged peoplerdquo in Proceedings of the 37th SICEAnnual Conference pp 853ndash858 Chiba Japan July 1998

[5] AMalima E Ozgur andM Cetin ldquoA fast algorithm for vision-based hand gesture recognition for robot controlrdquo in Proceed-ings of the 14th IEEE Signal Processing and CommunicationsApplications pp 1ndash4 Antalya Turkey April 2006

[6] S Hutchinson G D Hager and P I Corke ldquoA tutorial on visualservo controlrdquo IEEE Transactions on Robotics and Automationvol 12 no 5 pp 651ndash670 1996

[7] C Copot C Lazar and A Burlacu ldquoPredictive control ofnonlinear visual servoing systems using image momentsrdquo IETControl Theory amp Applications vol 6 no 10 pp 1486ndash14962012

[8] Y Fang X Liu andX Zhang ldquoAdaptive active visual servoing ofnonholonomic mobile robotsrdquo IEEE Transactions on IndustrialElectronics vol 59 no 1 pp 486ndash497 2012

[9] B Tamadazte N L-F Piat and E Marchand ldquoA direct visualservoing scheme for automatic nanopositioningrdquo IEEEASMETransactions on Mechatronics vol 17 no 4 pp 728ndash736 2012

[10] X Zhang Y Fang and X Liu ldquoMotion-estimation-based visualservoing of nonholonomic mobile robotsrdquo IEEE Transactionson Robotics vol 27 no 6 pp 1167ndash1175 2011

[11] M-S Wang and Y-M Tu ldquoDesign and implementation of astair-climbing robotrdquo in Proceedings of the IEEE InternationalConference on Advanced Robotics and Its Social Impacts TaipeiTaiwan August 2008

[12] M-S Wang Y-S Kung and Y-M Tu ldquoFuzzy logic controldesign for a Stair-climbing robotrdquo International Journal of FuzzySystems vol 11 no 3 pp 174ndash182 2009

[13] Terasic Company THDB-D5M Hardware Specification 2008[14] Terasic Company TRDB-D5M User Guide 2008

[15] AK Benkhalil S S Sipson andWBooth ldquoReal-timedetectionand tracking of amoving object using a complex programmablelogic devicerdquo in Proceedings of the IEE Colloquium on TargetTracking and Data Fusion pp 1ndash7 Birmingham UK June 1998

[16] T Hamamoto S Nagao and K Aizawa ldquoReal-time objectstracking by using smart image sensor and FPGArdquo inProceedingsof the International Conference on Image Processing (ICIP rsquo02)pp III441ndashIII444 New York NY USA September 2002

[17] S-B Park A Teuner and B J Hosticka ldquoA motion detectionsystem based on a CMOS photo sensor arrayrdquo in Proceedingsof the International Conference on Image Processing vol 3 pp967ndash971 Chicago Ill USA October 1998

Submit your manuscripts athttpwwwhindawicom

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

MathematicsJournal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Mathematical Problems in Engineering

Hindawi Publishing Corporationhttpwwwhindawicom

Differential EquationsInternational Journal of

Volume 2014

Applied MathematicsJournal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Probability and StatisticsHindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Journal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Mathematical PhysicsAdvances in

Complex AnalysisJournal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

OptimizationJournal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

CombinatoricsHindawi Publishing Corporationhttpwwwhindawicom Volume 2014

International Journal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Operations ResearchAdvances in

Journal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Function Spaces

Abstract and Applied AnalysisHindawi Publishing Corporationhttpwwwhindawicom Volume 2014

International Journal of Mathematics and Mathematical Sciences

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

The Scientific World JournalHindawi Publishing Corporation httpwwwhindawicom Volume 2014

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Algebra

Discrete Dynamics in Nature and Society

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Decision SciencesAdvances in

Discrete MathematicsJournal of

Hindawi Publishing Corporationhttpwwwhindawicom

Volume 2014 Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Stochastic AnalysisInternational Journal of

Submit your manuscripts athttpwwwhindawicom

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

MathematicsJournal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Mathematical Problems in Engineering

Hindawi Publishing Corporationhttpwwwhindawicom

Differential EquationsInternational Journal of

Volume 2014

Applied MathematicsJournal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Probability and StatisticsHindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Journal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Mathematical PhysicsAdvances in

Complex AnalysisJournal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

OptimizationJournal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

CombinatoricsHindawi Publishing Corporationhttpwwwhindawicom Volume 2014

International Journal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Operations ResearchAdvances in

Journal of

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Function Spaces

Abstract and Applied AnalysisHindawi Publishing Corporationhttpwwwhindawicom Volume 2014

International Journal of Mathematics and Mathematical Sciences

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

The Scientific World JournalHindawi Publishing Corporation httpwwwhindawicom Volume 2014

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Algebra

Discrete Dynamics in Nature and Society

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Decision SciencesAdvances in

Discrete MathematicsJournal of

Hindawi Publishing Corporationhttpwwwhindawicom

Volume 2014 Hindawi Publishing Corporationhttpwwwhindawicom Volume 2014

Stochastic AnalysisInternational Journal of