45
Development of Humanoid Soccer Robots R o b o E re c t u s www.robo-erectus.org Dr Changjiu Zhou Dr Changjiu Zhou School of Electrical & Electronic School of Electrical & Electronic Engineering Engineering Singapore Polytechnic Singapore Polytechnic [email protected] [email protected] www.robo-erectus.org Development of Humanoid Development of Humanoid Soccer Robots Soccer Robots

Www.robo-erectus.org Development of Humanoid Soccer Robots Dr Changjiu Zhou School of Electrical & Electronic Engineering Singapore Polytechnic [email protected]

Embed Size (px)

Citation preview

Page 1: Www.robo-erectus.org Development of Humanoid Soccer Robots Dr Changjiu Zhou School of Electrical & Electronic Engineering Singapore Polytechnic zhoucj@sp.edu.sg

Development of Humanoid Soccer Robots

R o b o E r ec t

u s

www.robo-erectus.org

Dr Changjiu ZhouDr Changjiu ZhouSchool of Electrical & Electronic EngineeringSchool of Electrical & Electronic Engineering

Singapore PolytechnicSingapore [email protected]@sp.edu.sg

www.robo-erectus.org

Development of Humanoid Development of Humanoid Soccer RobotsSoccer Robots

Page 2: Www.robo-erectus.org Development of Humanoid Soccer Robots Dr Changjiu Zhou School of Electrical & Electronic Engineering Singapore Polytechnic zhoucj@sp.edu.sg

Development of Humanoid Soccer Robots

R o b o E r ec t

u s

www.robo-erectus.org

2002 FIFA World Cup Final

BrazilGermany

20?? FIFA World Cup Final

Humans XXHumanoids XX

When?

Our Dream…

Brazil vs. Robo-Erectus

Humans vs. Humanoids

Page 3: Www.robo-erectus.org Development of Humanoid Soccer Robots Dr Changjiu Zhou School of Electrical & Electronic Engineering Singapore Polytechnic zhoucj@sp.edu.sg

Development of Humanoid Soccer Robots

R o b o E r ec t

u s

www.robo-erectus.org

By the year 2050, develop a team of fully autonomous humanoid robots

that can win against the human world soccer champions.

©AP Photo

Humanoid League

Page 4: Www.robo-erectus.org Development of Humanoid Soccer Robots Dr Changjiu Zhou School of Electrical & Electronic Engineering Singapore Polytechnic zhoucj@sp.edu.sg

Development of Humanoid Soccer Robots

R o b o E r ec t

u s

www.robo-erectus.org

www.robo-erectus.org

The Robo-Erectus Project in Singapore Polytechnic

Robo-Erectus: Humanoid Soccer Robots

Page 5: Www.robo-erectus.org Development of Humanoid Soccer Robots Dr Changjiu Zhou School of Electrical & Electronic Engineering Singapore Polytechnic zhoucj@sp.edu.sg

Development of Humanoid Soccer Robots

R o b o E r ec t

u s

www.robo-erectus.org

1st Place, Free Performance, RoboCup Humanoid League 20032nd Place, Humanoid Walk, RoboCup Humanoid League 20023rd Place, FIRA HuroSot 2002

Robo-Erectus at Present

Page 6: Www.robo-erectus.org Development of Humanoid Soccer Robots Dr Changjiu Zhou School of Electrical & Electronic Engineering Singapore Polytechnic zhoucj@sp.edu.sg

Development of Humanoid Soccer Robots

R o b o E r ec t

u s

www.robo-erectus.org

Introduction

Overview of Humanoid League

Development of Robo-Erectus

Basic Research Issues in Humanoid Soccer Robotics

Conclusions - Where Are We Going?

Outline

Page 7: Www.robo-erectus.org Development of Humanoid Soccer Robots Dr Changjiu Zhou School of Electrical & Electronic Engineering Singapore Polytechnic zhoucj@sp.edu.sg

Development of Humanoid Soccer Robots

R o b o E r ec t

u s

www.robo-erectus.org

Soccer robots at ARICC, Singapore Polytechnic

RoboCup at Present

Page 8: Www.robo-erectus.org Development of Humanoid Soccer Robots Dr Changjiu Zhou School of Electrical & Electronic Engineering Singapore Polytechnic zhoucj@sp.edu.sg

Development of Humanoid Soccer Robots

R o b o E r ec t

u s

www.robo-erectus.org

Future of RoboCup

©RE Artists

Wai Yin and Phyu Phyu.

Page 9: Www.robo-erectus.org Development of Humanoid Soccer Robots Dr Changjiu Zhou School of Electrical & Electronic Engineering Singapore Polytechnic zhoucj@sp.edu.sg

Development of Humanoid Soccer Robots

R o b o E r ec t

u s

www.robo-erectus.org

©RE Artists

Wai Yin and Phyu Phyu.

Dream…

Page 10: Www.robo-erectus.org Development of Humanoid Soccer Robots Dr Changjiu Zhou School of Electrical & Electronic Engineering Singapore Polytechnic zhoucj@sp.edu.sg

Development of Humanoid Soccer Robots

R o b o E r ec t

u s

www.robo-erectus.org

FIRA HuroSot 2002

• Robot dash

• Penalty kick

• Obstacle run

• H-50

• H-80

• H-150

FIRA HuroSot

Page 11: Www.robo-erectus.org Development of Humanoid Soccer Robots Dr Changjiu Zhou School of Electrical & Electronic Engineering Singapore Polytechnic zhoucj@sp.edu.sg

Development of Humanoid Soccer Robots

R o b o E r ec t

u s

www.robo-erectus.org

FIRA HuroSot – Robot Dash

Robo-Erectus at FIRA HuroSot 2002

Page 12: Www.robo-erectus.org Development of Humanoid Soccer Robots Dr Changjiu Zhou School of Electrical & Electronic Engineering Singapore Polytechnic zhoucj@sp.edu.sg

Development of Humanoid Soccer Robots

R o b o E r ec t

u s

www.robo-erectus.org

FIRA HuroSot - Penalty Kick

Robo-Erectus at FIRA HuroSot 2002

Page 13: Www.robo-erectus.org Development of Humanoid Soccer Robots Dr Changjiu Zhou School of Electrical & Electronic Engineering Singapore Polytechnic zhoucj@sp.edu.sg

Development of Humanoid Soccer Robots

R o b o E r ec t

u s

www.robo-erectus.org

FIRA HuroSot - Obstacle Run

Page 14: Www.robo-erectus.org Development of Humanoid Soccer Robots Dr Changjiu Zhou School of Electrical & Electronic Engineering Singapore Polytechnic zhoucj@sp.edu.sg

Development of Humanoid Soccer Robots

R o b o E r ec t

u s

www.robo-erectus.org

• H-40 Class

• H-80 Class

• H-120 Class

RoboCup Humanoid League• Stand on one leg

• Walk

• Penalty Kick

• Free Performance

• 1 vs. 1

Page 15: Www.robo-erectus.org Development of Humanoid Soccer Robots Dr Changjiu Zhou School of Electrical & Electronic Engineering Singapore Polytechnic zhoucj@sp.edu.sg

Development of Humanoid Soccer Robots

R o b o E r ec t

u s

www.robo-erectus.org

Humanoid Walk

Humanoid League: Walk

Page 16: Www.robo-erectus.org Development of Humanoid Soccer Robots Dr Changjiu Zhou School of Electrical & Electronic Engineering Singapore Polytechnic zhoucj@sp.edu.sg

Development of Humanoid Soccer Robots

R o b o E r ec t

u s

www.robo-erectus.org

Humanoid Walk

Humanoid League: Walk

Page 17: Www.robo-erectus.org Development of Humanoid Soccer Robots Dr Changjiu Zhou School of Electrical & Electronic Engineering Singapore Polytechnic zhoucj@sp.edu.sg

Development of Humanoid Soccer Robots

R o b o E r ec t

u s

www.robo-erectus.org

Class(cm)

Name of team

Country1st

time2nd time

3rd time

Total time

1st 80 Nagara Japan 1'24" 1'01" 1'04" 3'29"

2nd 40Robo-Erectus

Singapore 1'10" 1'42" 0'59" 3'51"

3rd 40 Foot-Prints Japan 3'29" 1'49" 3'03" 8'21"

4th 80 The Ninja Japan 3'48" 1'25" 4'27" 9'40"

5th 80 Senchans Japan 3'53" 3'37" 1'35" 9'05"

Humanoid Walk 2002

Page 18: Www.robo-erectus.org Development of Humanoid Soccer Robots Dr Changjiu Zhou School of Electrical & Electronic Engineering Singapore Polytechnic zhoucj@sp.edu.sg

Development of Humanoid Soccer Robots

R o b o E r ec t

u s

www.robo-erectus.org

Humanoid League at Present

Robot vs Robot Human vs Robot

Page 19: Www.robo-erectus.org Development of Humanoid Soccer Robots Dr Changjiu Zhou School of Electrical & Electronic Engineering Singapore Polytechnic zhoucj@sp.edu.sg

Development of Humanoid Soccer Robots

R o b o E r ec t

u s

www.robo-erectus.org

Introduction

Overview of Humanoid League

Development of Robo-Erectus

Basic Research Issues in Humanoid Soccer Robotics

Conclusions - Where Are We Going?

Outline

Page 20: Www.robo-erectus.org Development of Humanoid Soccer Robots Dr Changjiu Zhou School of Electrical & Electronic Engineering Singapore Polytechnic zhoucj@sp.edu.sg

Development of Humanoid Soccer Robots

R o b o E r ec t

u s

www.robo-erectus.org

1996-1998 1999-2000 2000-2001

Development of the Robo-Erectus (1)

Page 21: Www.robo-erectus.org Development of Humanoid Soccer Robots Dr Changjiu Zhou School of Electrical & Electronic Engineering Singapore Polytechnic zhoucj@sp.edu.sg

Development of Humanoid Soccer Robots

R o b o E r ec t

u s

www.robo-erectus.org

Development of the Robo-Erectus (2)

RE40I – Humanoid Soccer Robot, 2002

z

y

x

yaw pitch

row

Page 22: Www.robo-erectus.org Development of Humanoid Soccer Robots Dr Changjiu Zhou School of Electrical & Electronic Engineering Singapore Polytechnic zhoucj@sp.edu.sg

Development of Humanoid Soccer Robots

R o b o E r ec t

u s

www.robo-erectus.org

Development of Robo-Erectus (3)

RE40II RE40I RE40I (PDA) RE50II

Page 23: Www.robo-erectus.org Development of Humanoid Soccer Robots Dr Changjiu Zhou School of Electrical & Electronic Engineering Singapore Polytechnic zhoucj@sp.edu.sg

Development of Humanoid Soccer Robots

R o b o E r ec t

u s

www.robo-erectus.org

Development of Robo-Erectus (4)

RE40II, 2003

Page 24: Www.robo-erectus.org Development of Humanoid Soccer Robots Dr Changjiu Zhou School of Electrical & Electronic Engineering Singapore Polytechnic zhoucj@sp.edu.sg

Development of Humanoid Soccer Robots

R o b o E r ec t

u s

www.robo-erectus.org

Development of the Robo-Erectus (5)

RE Team at Humanoid League, Padova, Italy, July 2003

Page 25: Www.robo-erectus.org Development of Humanoid Soccer Robots Dr Changjiu Zhou School of Electrical & Electronic Engineering Singapore Polytechnic zhoucj@sp.edu.sg

Development of Humanoid Soccer Robots

R o b o E r ec t

u s

www.robo-erectus.org

Development of Robo-Erectus (6)

RE25I and RE40II

Page 26: Www.robo-erectus.org Development of Humanoid Soccer Robots Dr Changjiu Zhou School of Electrical & Electronic Engineering Singapore Polytechnic zhoucj@sp.edu.sg

Development of Humanoid Soccer Robots

R o b o E r ec t

u s

www.robo-erectus.org

RE25I RE40II RE50II RE80II

HeightHeight 25 cm 40 cm 40 cm 80 cm

WeightWeight 1 kg 3 kg 4 kg 7 kg

Total DOFTotal DOF 10 22 22 22

DOF arrangementDOF arrangement Legs – 5 x 2 Neck – 2Arms – 4 x 2Legs – 6 x 2

Neck – 2Arms – 4 x 2Legs – 6 x 2

Neck – 2Arms – 4 x 2Legs – 6 x 2

SensorsSensors accelerometers, force sensors, gyros, range sensors and etc.

VisionVision stereo camera

Controller Controller Multi-control mode: (1) PC; (2) Microcontroller; (3) PDA; (4) Wireless

PowerPower NiMH batteries

Robo-Erectus Family

Page 27: Www.robo-erectus.org Development of Humanoid Soccer Robots Dr Changjiu Zhou School of Electrical & Electronic Engineering Singapore Polytechnic zhoucj@sp.edu.sg

Development of Humanoid Soccer Robots

R o b o E r ec t

u s

www.robo-erectus.org

4 force sensing sensors for each foot

Accelerometers and gyros

Camera

Configuration of Robo-Erectus (H/W)

IR and Ultrasonic sensors

Compass

Page 28: Www.robo-erectus.org Development of Humanoid Soccer Robots Dr Changjiu Zhou School of Electrical & Electronic Engineering Singapore Polytechnic zhoucj@sp.edu.sg

Development of Humanoid Soccer Robots

R o b o E r ec t

u s

www.robo-erectus.org

Schematic diagram of the hierarchical control system

PathPlanning

Gaitsynthesis

Jointcontroller

Humanoidrobot

Potentiometers/encoders

Localmotion

planning

Range sensors/gyros/forcesensors,...

Vision

Globalmotion

planning

Configuration of Robo-Erectus (S/W)

NavigationWalking Control

Actuator Control

Page 29: Www.robo-erectus.org Development of Humanoid Soccer Robots Dr Changjiu Zhou School of Electrical & Electronic Engineering Singapore Polytechnic zhoucj@sp.edu.sg

Development of Humanoid Soccer Robots

R o b o E r ec t

u s

www.robo-erectus.org

Example: Gait Planning

Y

Z

X

Lao

Ds

L

Qs

Qf

Qb

Hao

Lan

Lab Laf

Lthigh

Lshank

Lhip

t=k*Tc+ Td Tm Tc

Page 30: Www.robo-erectus.org Development of Humanoid Soccer Robots Dr Changjiu Zhou School of Electrical & Electronic Engineering Singapore Polytechnic zhoucj@sp.edu.sg

Development of Humanoid Soccer Robots

R o b o E r ec t

u s

www.robo-erectus.org

Introduction

Overview of Humanoid League

Development of Robo-Erectus

Basic Research Issues in Humanoid Soccer Robotics

Conclusions - Where Are We Going?

Outline

Page 31: Www.robo-erectus.org Development of Humanoid Soccer Robots Dr Changjiu Zhou School of Electrical & Electronic Engineering Singapore Polytechnic zhoucj@sp.edu.sg

Development of Humanoid Soccer Robots

R o b o E r ec t

u s

www.robo-erectus.org

Intelligence

Perception

Communication

Power Supply

Manipulation

Bipedal Walking

Material

Research Issues of Humanoid Robotics

Page 32: Www.robo-erectus.org Development of Humanoid Soccer Robots Dr Changjiu Zhou School of Electrical & Electronic Engineering Singapore Polytechnic zhoucj@sp.edu.sg

Development of Humanoid Soccer Robots

R o b o E r ec t

u s

www.robo-erectus.org

Scientific Challenges

• Materials

• Locomotion

• Sensor fusion

• High-level cognitive system

• Team coordination

Basic Research Issues

Page 33: Www.robo-erectus.org Development of Humanoid Soccer Robots Dr Changjiu Zhou School of Electrical & Electronic Engineering Singapore Polytechnic zhoucj@sp.edu.sg

Development of Humanoid Soccer Robots

R o b o E r ec t

u s

www.robo-erectus.org

• High-level cognitive systems: issues of brain and cognitive science; gesture recognition, …

• Real-time 3D recognition must work outdoors in unconstrained lighting condition.

• Safety of the human/humanoid players?

• …

Challenges (example)

Page 34: Www.robo-erectus.org Development of Humanoid Soccer Robots Dr Changjiu Zhou School of Electrical & Electronic Engineering Singapore Polytechnic zhoucj@sp.edu.sg

Development of Humanoid Soccer Robots

R o b o E r ec t

u s

www.robo-erectus.org

Kitano and Asada (1998)

Benchmark of the Humanoid League

Page 35: Www.robo-erectus.org Development of Humanoid Soccer Robots Dr Changjiu Zhou School of Electrical & Electronic Engineering Singapore Polytechnic zhoucj@sp.edu.sg

Development of Humanoid Soccer Robots

R o b o E r ec t

u s

www.robo-erectus.org

Introduction

Overview of Humanoid League

Development of Robo-Erectus

Control and Learning in Humanoid Walk and Kick

Conclusions - Where Are We Going?

(Humanoid League Roadmap and Challenges)

Outline

Page 36: Www.robo-erectus.org Development of Humanoid Soccer Robots Dr Changjiu Zhou School of Electrical & Electronic Engineering Singapore Polytechnic zhoucj@sp.edu.sg

Development of Humanoid Soccer Robots

R o b o E r ec t

u s

www.robo-erectus.org

Collaboration between HL and other leagues

SS

L

MS

L

Leg

ge

d

Re

scue

Re

scue

S

imu

Sim

uL

Junior

HL

Intelligence √ √ √ √ √ √ √ √Perception √ √ √ √ √ √Communication √ √ √ √ √ √ √ √Power Supply √ √ √ √ √ √Manipulation √ √ √ √Bipedal Walking √Material √ √

Page 37: Www.robo-erectus.org Development of Humanoid Soccer Robots Dr Changjiu Zhou School of Electrical & Electronic Engineering Singapore Polytechnic zhoucj@sp.edu.sg

Development of Humanoid Soccer Robots

R o b o E r ec t

u s

www.robo-erectus.org

Roadmap: Technical Issues41-50 yrs Artificial soccer-player

31-40 yrs

21-30 yrs

11-20 yrs

6-10 yrs Run Passing Human-like gripping

6 hrs duration

Body and natural language processing

Navigation in human environ-ments

Task understan-ding

1-5 yrs Jump, dynamic walk

Moving ball

Forecas-ting movement

Today Static walk

Station-ary ball

Walk Kick Manipu-lation

Power Commu-nication

Percep-tion

Intelli-gence

Page 38: Www.robo-erectus.org Development of Humanoid Soccer Robots Dr Changjiu Zhou School of Electrical & Electronic Engineering Singapore Polytechnic zhoucj@sp.edu.sg

Development of Humanoid Soccer Robots

R o b o E r ec t

u s

www.robo-erectus.org

Humanoid Walk• Current

– Basic walking patterns (humanoid walking pattern library)

• Forward, Backward, Side, Turn, …• Variable stepsize, variable speed, …

– Online gait generating– Online footprint planning

• Near future– Jump

• Artificial muscles• Flexible joints

– (True) dynamic walk– Run

Page 39: Www.robo-erectus.org Development of Humanoid Soccer Robots Dr Changjiu Zhou School of Electrical & Electronic Engineering Singapore Polytechnic zhoucj@sp.edu.sg

Development of Humanoid Soccer Robots

R o b o E r ec t

u s

www.robo-erectus.org

Humanoid Kick

• Current– Basic kicking patterns (humanoid kicking

pattern library)• Stationary ball

• Near future– Moving ball– Passing– New ways of ball manipulation

• Playing the ball in 3D

Page 40: Www.robo-erectus.org Development of Humanoid Soccer Robots Dr Changjiu Zhou School of Electrical & Electronic Engineering Singapore Polytechnic zhoucj@sp.edu.sg

Development of Humanoid Soccer Robots

R o b o E r ec t

u s

www.robo-erectus.org

Humanoid Challenges

• To implement a set of biped walking and kicking skills that can be integrated in humanoids

• To coordinate perception and locomotion

• To integrate the soccer-playing skills in a humanoid

Page 41: Www.robo-erectus.org Development of Humanoid Soccer Robots Dr Changjiu Zhou School of Electrical & Electronic Engineering Singapore Polytechnic zhoucj@sp.edu.sg

Development of Humanoid Soccer Robots

R o b o E r ec t

u s

www.robo-erectus.org

Humanoid League Challenges• 2004-

– Balancing challenge– Passing challenge– Obstacle walk challenge

• 2005-– 1 vs 1

• Object following• Multiple objects tracking

• 2007-– 2 vs 2

• Collision avoidance• Safety issue

• 2010-– Start cognitive issues

• Coordination of perception and locomotion• Integration

Page 42: Www.robo-erectus.org Development of Humanoid Soccer Robots Dr Changjiu Zhou School of Electrical & Electronic Engineering Singapore Polytechnic zhoucj@sp.edu.sg

Development of Humanoid Soccer Robots

R o b o E r ec t

u s

www.robo-erectus.org

Where Should Humanoid League Go?

• Collaboration with other leagues– Small-size Humanoid League (SHL)

• Global vision?• To focus on walking and kicking issues

– Mid-size Humanoid League (MHL)• Local vision• To focus on integration

• Humanoid simulation

Page 43: Www.robo-erectus.org Development of Humanoid Soccer Robots Dr Changjiu Zhou School of Electrical & Electronic Engineering Singapore Polytechnic zhoucj@sp.edu.sg

Development of Humanoid Soccer Robots

R o b o E r ec t

u s

www.robo-erectus.org

References

• H. Kitano and H. Asada, “The RoboCup humanoid challenge as the millennium challenge for advanced robotics,” Advanced Robotics 13(8) (2000) 723-736.

• C. Zhou and Q. Meng, “Dynamic balance of a biped robot using fuzzy reinforcement learning agents,” Fuzzy Sets and Systems 134(1) (2003) 169-187.

• C. Zhou, P.K. Yue, Z. Tang, Z. Sun, “Development of Robo-Erectus: A soccer-playing humanoid robot,” Proc. IEEE-RAS Intl. Conf. on Humanoid Robots, CD-ROM, 2003.

• http://www.ais.fraunhofer.de/robocup/HL2004/• http://www.robocup.org/

Page 44: Www.robo-erectus.org Development of Humanoid Soccer Robots Dr Changjiu Zhou School of Electrical & Electronic Engineering Singapore Polytechnic zhoucj@sp.edu.sg

Development of Humanoid Soccer Robots

R o b o E r ec t

u s

www.robo-erectus.org

Acknowledgements

• Staff Member

P.K. Yue, F.S. Choy, Nazeer Ahmed

M.F. Ercan, Mike Wong, H. Li• Research Associate

Z. Tang (Tsinghua U.), J. Ni (Shanghai Jiao Tong U.)• Technical Support Officer

H.M. Tan, W. Ye• Students

P.P. Khing, H. W. Yin, H.F. Lu, H.X. Tan, J.X. Teo,

Stephen Quah, H.M. Tan, Y.T. Tan

Page 45: Www.robo-erectus.org Development of Humanoid Soccer Robots Dr Changjiu Zhou School of Electrical & Electronic Engineering Singapore Polytechnic zhoucj@sp.edu.sg

Development of Humanoid Soccer Robots

R o b o E r ec t

u s

www.robo-erectus.org

Thanks!

Dr Changjiu ZhouDr Changjiu ZhouSchool of Electrical and Electronic EngineeringSchool of Electrical and Electronic Engineering

Singapore PolytechnicSingapore [email protected]@sp.edu.sg

www.robo-erectus.orgwww.robo-erectus.org