From

Smart

Home to

Smart

Care :

Pervasive

Assistance for

Cognitively I

mpaired People

Sylvain

Giroux

Plan

Context

Objectives and Approach

Pervasive computingTangible User interfaceMobile computing

From smart homes

Hardware : the labT

o smart careMiddleware

A pervasive reminder systemCognitive assistance

Plan recognitionI

n situ clinical studiesC

onclusion

ContextP

eople suffering of cognitive impairments in Quebec Alzheimer disease : 5.1% of people over 65 years old Head trauma : 3000 new cases each yearSchizophrenia : 1% of the population

They would be able to stay at home

if light assistance was provided.

But healthcare resources are scarce. So relatives have to take responsibility for care.

turns to an exhausting burden.Hence relatives and caregivers urge for help.

Objectives

Provide adapted and personalized environmental cues to

Foster the autonomy of cognitively impaired people at homeLessen risks and hazards at home

Pervasive computingTangible user interfaces

Keep ensuring continuous cognitive assistance outside people’s home

Mobile computingLocation-based services

Help relatives and caregivers to keep in touch at distance with cognitively impaired people

General architecture

From smart homes…

Smart homes are augmented environments

Heterogeneous networksSensors networksEmbedded computers Information appliances Networked communicating objects

An augmented apartment

A intégrer

Ariane Controls Contrôle de l’éclairage

CrestronContrôle audio/vidéo

Multi-affichage sur écranContrôle du débit d’eau

X10

From smart homes…

Smart homes are augmented environments

Heterogeneous networksWireless

WiFi, Bluetooth, RFID, UWB, etc.

WiredEthernet, Electrical wires

ServersControls over sounds and video streams

From smart homes…

Smart homes are augmented environments

Sensors networks

Identification and localization of objects and people

Ubisense, UWBSmart tags (RFID)

From smart homes…

Smart homes are augmented environments

Embedded computers Not yet investigated

From smart homes…

Smart homes are augmented environments

Information appliances

From smart homes…

Smart homes are augmented environments

Networked communicating objects

… to smart care

Smart homes can assist cognitively impaired people and foster their autonomy.

Indeed such augmented homes can become true cognitive prostheses.

As well, smart homes can

help caregivers to grant better care give a sense of security to residents and their relatives.

MiddlewareS

pontaneous networkingH

eterogeneous networks

Autonomic computing

Mobile code and agents

Location and context awareness

Security and privacy

A

Pervasive

Reminder

System

for

Smart

Homes

Identification and localization of a user

Transitory coalition of devices

Pervasiveness:

Integration in a real living environmentFluid usage Transparent user friendly migration of sessions Zero-configuration

Spontaneous networking and service discovery

To cope with heterogeneity of devices and hardware, networks

Keeping the system in a clean state

Simon Guertin, M. Sc.

Multi-channel delivery

of geo-referenced services

Thèse de Davide

Cognitive assistance

What are the primitive information needed

What are the objects involved in an activity ?Track primitive actions

What is the user doing or wants to do ?Plan recognition

Hierarchical modelsLattice

Assist the userHighligth objectsTangible user interfaces

Plan recognition

Hierarchical models

Lattice-based models

No action models

Kautz

Personnalization

Appli de Jérémie en maîtrise

Cognitive deficits Attention

Memory

Planing

Initiation

Attention deficitsD

uring task completion, the person shifts her attention from the activity under progress to a stimulus causing interference.

The person demonstrates difficulty to focus on the activity to be performed and as a consequence, the current activity should be forgotten and never completed.

Planning deficitsT

he planning deficit leads to the difficulty to perform an appropriate sequence of actions in order to achieve a goal.

Memory deficitsT

he memory processes refer to information storage and retrieval. Suffering from memory deficits could lead to difficulties to remember the activity to perform, the steps of the activity or the locations of the tools and materials involved in that activity.

Follow-me

The lamp turns off when the object is too far away.

The lamp turns on to highlight the searched object (red book)

Initiation deficitsThe initiation deficit leads to inactive periods whereas the person is supposed to perform actions

For example, during breakfast time, standing in the kitchen for a long time could be attributed to an initiation deficit.

Clinical studies

Centre de recherche Fernand-Séguin,

Dr Emmanuel Stip, psychiatristExpérimentation pageurs JF moreau

Centre de résadaptation Estrie

Head trauma

Conclusion

At the DOMUS laboratory, on-going research projects aim at building the theory and praxis of pervasive computing and tangible user interfaces (TUI) compulsory to create smart homes for cognitively impaired people.

Pervasive computing enables a seamless integration of assistance in residents’ everyday life

while TUI turn the whole house into a cognitive prosthesis.

Prototypes are used to investigate how pervasive services and TUI can support and enhance healthcare and communication between people and caregivers.

A fully-equipped experimental apartment can accommodate cognitively impaired people and their caregivers for day and night.

The middleware provides for spontaneous networking, distributed and mobile computing, and sensor networks.

Cognitive assistants use descriptions of activities of daily living to reason upon resident actions. They then rely on context awareness and TUI to interact with people.

Finally the assistance systems remotely share information with caregivers.

Our team

Researchers

Faculty of scienceSylvain Giroux,

Ph. D. in Computer scienceHélène Pigot,

Ph. D. in Computer science and B. in occupational therapy André Mayers,

Ph. D. in Computer science and M. inpsychologyFaculty of engineering

Philippe Mabilleau, Ph.D. in engineering

Faculty of administrationClaude Caron (geo-business)

Analyst

Francis Bouchard

Students

6 Ph. D. students12 M. Sc. students6 B.Sc. students, 2 international trainees (M. Sc. level)

Collaborations

Medical aspects

CRE, Centre de réadaptation Estrie (head trauma)Institut de gériatrie de SherbrookeCentre de recherches Fernand Séguin, Université de Montréal (schizophrenia)Institut de réadaptation, Université de Montréal

Alzheimer disease

Computer science

France TelecomAriane Controls, CanadaUniversité Joseph Fourier, GrenobleUQAM

Thank you for your attention

http://domus.usherbrooke.ca/

Collaborations•Medical aspects

•CRE, Centre de réadaptation Estrie (head trauma)

•Institut de gériatrie de Sherbrooke

•Centre de recherches Fernand Séguin, Université de Montréal (schizophrenia)

•Institut de réadaptation, Université de Montréal

•Alzheimer disease

•Computer science

•France Telecom

•Ariane Controls, Canada

•Université Joseph Fourier, Grenoble

•UQAM

• At the DOMUS laboratory, on-going research projects aim at building the theory and praxis of pervasive computing and tangible user interfaces (TUI) compulsory to create smart homes for cognitively impaired people.

• Pervasive computing enables a seamless integration of assistance in residents’ everyday life

• while TUI turn the whole house into a cognitive prosthesis.

• Prototypes are used to investigate how pervasive services and TUI can support and enhance healthcare and communication between people and caregivers.

• A fully-equipped experimental apartment can accommodate cognitively impaired people and their caregivers for day and night.

• The middleware provides for spontaneous networking, distributed and mobile computing, and sensor networks.

• Cognitive assistants use descriptions of activities of daily living to reason upon resident actions. They then rely on context awareness and TUI to interact with people.

• Finally the assistance systems remotely share information with caregivers.