Hospital, Edmonton, Alberta USING ROBOTS TO ASSESS SKILLS

Using robots to assess skills and access play and problem solving for children with severe disabilities © Kim Adams

LUDI meeting, Vilnius October 27, 2014

1

USING ROBOTS TO ASSESS SKILLS AND ACCESS PLAY AND PROBLEM SOLVING

FOR CHILDREN WITH SEVERE

University of Alberta and Glenrose Rehabilitation Hospital, Edmonton, Alberta

DISABILITIES

Al CookAdriana Rios

Kim AdamsLiliana Alvarez

Lina Becerra, Paola Esquivel

1

University of Alberta, Edmonton, Canada



2

ALBERTA:• Western Canada• Population: 3,645,257 (2011)• Area: 661,848 km2

Welcome to Alberta

https://www.google.ca/search?q=alberta+canada&hl=en&tbm=isch&tbo=u&source=univ&sa

1908…



3

Today!

I Can Centre for Assistive Technology



4

Children who have disabilities may have limited opportunities to develop skillsopportunities to develop skills

• cognitive, linguistic, social and motor skills

• through manipulative play and learning activities

Augmentative manipulation – Assistive robots

The problem

RhinoMini-mover 5

Robot:

Early work - Al Cook

“An automatically controlled, “An automatically controlled, reprogrammablereprogrammable, , multipurposemultipurpose, manipulator , manipulator programmable in three or more axes, which may be either fixed in place or programmable in three or more axes, which may be either fixed in place or mobile for use in industrial automation applications." International standard mobile for use in industrial automation applications." International standard ISO 8373ISO 8373



5

Themes Streams

Children's Using robots in playdevelopment of cognitive, linguistic, social and motor skills

Using robots in academics (math concepts)

Using robots as a way to measure cognitive skills

Assistive technology development

Development of virtual and physical robots (ENCARNAÇÃO)

Research themes and streams

p ( Ç )

Development of adaptive and haptic interface for robots

Children can use robots to do manipulative play activities and increase their play experiences.activities and increase their play experiences.

Using robots in play

Schulmeister, J., Wiberg, C., Adams, K., Harbottle, N., & Cook, A. (2006). Cook, A., Adams, K. (2010).



6

Adriana Rios, PhD, OT, MSc BMEAssistant Professor, University of Rosario,

Bogota, ColombiaBogota, Colombia

Identify changes in playfulness

Using robots in play

Using robots in academics (pilot study)



7

Using robots in academics (math concepts)

Adams Cook K. (2013).

Performance tasks reveal level of cognitive understanding

Robots and cognitive development

Cook, A., Adams, K., Volden, J., Harbottle, N., & Harbottle, C. (2011).



8


Typically developingdeveloping children

Poletz, L., Encarnação, P., Adams, K., & Cook, A. (2010).




9


• Liliana Alvarez, PhD, OT, MSc BME

– Professor, University of Rosario, Bogota, ColombiaColombia

– Post Doc, University of Western Ontario

• Cognitive skills associated with motor experience:

• typically developing infants and one child with with motor impairments

• EEG, ERP and behavior analysis

Robots and cgnitive development

• with and without a robot

• A not B task

• Dr Sandra Wiebe www.infantile-spasms.org



10

Controlling robots through communication devices provides an integrated talking and doing experience, more like that of a typical child.

Integrated communication and manipulation

Adams, K., & Cook, A. M. (2014). ISAAC, Lisbon, Portugal

Virtual robots may provide the same benefits as physical robots – easier to disseminate widely

Virtual robots

ENCARNAÇÃO, P., PIEDADE, G., COOK, A., ADAMS, K., GIL, I., MAYA, C., et al. (2011). Virtual robot and virtual environments for cognitive skills assessment. AAATE, The Netherlands.



11

Play and Problem Solving

• Children need a means for manipulating toysto develop symbolic play and problem solving skills1– to develop symbolic play and problem solving skills1.

• Children with disabilities have controlled robotsto:– access play activities2

– demonstrate cognitive skills3

(1) Cook, A., Adams, K., Volden, J., Harbottle, N., & Harbottle, C. (2011).(2) Cook, A & Adams, K (2010)(3) Poletz. L, Encarnação.P, Adams. K, and Cook. A.M (2010).

21

Purpose

Develop robotic tasks that will allow children tto:

• perform symbolic play and

• problem solving activities

using skills that correspond to their

cognitive age.

22



12

Materials

LEGO Mindstorm Robots

L ft d i ht l di Left and right color coding

Set up Plastic screen (hands-off)

23

Participants

• Typically developing children

Pilot # Age Male Female3

31

2 15 4 11

51

54 17

61

8 16 7 1

24



13

Methods

Robot skills

Ses

sio

n 1

Problem Solving

Training

Pla ith

2Play with

conventional toys

Play with unstructured

materials

Ses

sio

n

25

Session 1- Robot Skills Tasks

26



14

Session 1 - Problem Solving

Level 4

Level 1

Level 2

Level 3

Level 4

Truck Loading Activity4

4)Atance, C & Jackson, L. (2009)

Truck Loading Activity4

27

28



15

Session 2- Training

Task 1- Orientation 1

Task 2

Orientation 1- Orientation 2

Task 3A Task 3B

29

Using the scoop

Session 2- Training

30



16

Session 2- Play

Conventional Toys

Robot No Robot

Before Modeling

After Modeling

No Modeling

Play is observed 31

Set up

32



17

Session 2- Play

Unconventional Toys

Robot No Robot

Play is observed

Before Modeling

After Modeling

No Modeling

33

Set up

34



18

Play Coding System Type of Play

0. No Play

1. Functional Play one objectna

l Pla

y

object

1.1 Functional Play with two or more objects

2.1 Functional play with pretense:

2.2 Pretend play with verbal confirmation

2.3 Object Substitution: the child uses of an object

Fun

ctio

nd

Pla

y

jas if it was a different object2.4 Imagining absent objects

2.5 Assigning absent attributes

Based on: Barton (2010)

Pre

tend

35

Results - Play

36



19

Results – Problem solving

Participant Age Condition Robot Truck

Pilot 3* 3 24 with

prompting 0Pilot 2 3 1 1 2Pilot 5 4 both 0 0Pilot 1 5 2 4 4

1Pilot 4 5 1 4 4Pilot 6 7 1 4 4

37

Play: --more symbolic play without the robot- after modeling,

Results Results

g,children can achieve a higher level with robot

Problemsolving:solving:?

38



20

Plans

Validate tasks

30 participants

Data analysis

tasks

39

Acknowledgements

Alberta Teacher’s Association

CIHR/NSERC Collaborative Health Research Program

40



21

Contact Information

Kim Adams F lt f R h bilit ti M di iFaculty of Rehabilitation Medicine

University of Alberta. 3-48 Corbett Hall Edmonton, Alberta Canada

Tel: 780-492-0309E-mail: [email protected]@

41

Documents

Hospital, Edmonton, Alberta USING ROBOTS TO ASSESS SKILLS