51
Realizing real time monitoring and controlling bio-signals Daniel Berckmans M3 – BIORES Katholieke Universiteit Leuven Belgium Philips Eindhoven April 11 2008

Realizing real time monitoring and controlling bio-signals · Realizing real time monitoring and controlling bio-signals Daniel Berckmans M3 – BIORES Katholieke Universiteit Leuven

Embed Size (px)

Citation preview

Realizing real time monitoring and controlling bio-signals

Daniel BerckmansM3 – BIORES

Katholieke Universiteit LeuvenBelgium

Philips EindhovenApril 11 2008

M3-BIORES, K.U.LEUVEN2

Ing. KAREL DE BODT

2

Head: Prof. Daniel Berckmans

K.U.Leuven DIVISION M3-BIORESMeasure, Model and Manage Bioresponses

Ir. VO TAN THANH

Ir. NILA ALBAN

Dr. TADIWOS ZERIHUN DESTA

Ir. SEZIN EREN OZCAN

Ir. SARA FERRARI

Ir. JAN DEKOCK

Ir. TOON LEROY

Ir. JORIS LEFEVER

Ir. GUIDO DE BRUYNE

Ir. KRISTIEN VAN LOON

Prof. JEAN-MARIE AERTS

Prof. ERIK VRANKEN

Ir. OZLEM CANGAR

Ir. SONG XIANGYU

Ir. X

Ir. X

Dr. Claudia Bahr

Technical assistance

PRIVATE COMPANIES

LUDO HAPPAERTS

Ing. JEAN-LOUIS LEMAIRE

Imperfectly mixed fluids Bioresponses 1 Process output & environment

SecretaryANN VAN

GINDERACHTER

Ir. DRAGANA MILJKOVIC

Ir. PIETER SCHIEPERS

Dr. STIJN QUANTEN

CoordinatorsBioresponses 2

Ir. SEBASTIAN DE BOODT

BioRICS NV, Belgium

Ir. X

BioRICS NVIr. KIM BATSELIER

Ir. FREDERIK JANSEN

Ing. MIHAJLO MILUTINOVIC

Ir. X

Ir. X

Ir. X

Ir. X

Dr. VASILEIOS EXADAKTYLOS

Ir. MITCHELL SILVA

Sound analysis and bioresponses

Ir. X

M3-BIORES, K.U.LEUVEN3

BioRICS n.v.

- 2006:

- K.U. Leuven, LRD (o1972): 56 spin-offse.g. LMS, Ubizin, Thromb-X, ....

M3-BIORES, K.U.LEUVEN4

Problem• Livestock farming in the past …

Farmer had the time to use audio-visual scoring

M3-BIORES, K.U.LEUVEN5

•Today however…

Low price of product

High number of animals

More welfare problemsLess available time per animal

M3-BIORES, K.U.LEUVEN6

Market numbers

258 million ton meat/year

7 billion pigs

40 billion chicken

M3-BIORES, K.U.LEUVEN77

A living organism:Complex

M3-BIORES, K.U.LEUVEN88

Complex Individual

Hea

rtbe

at (b

pm)

Time (s)

A living organism:

M3-BIORES, K.U.LEUVEN9

Identical Individually different

M3-BIORES, K.U.LEUVEN1010

Complex Individual Time-Varying

A living organism:

TIME (HOURS)

0 1 2 3 4 5

HEA

T PR

OD

UC

TIO

N (W

/KG

)

11

12

13

14

15

16

17

MEASUREDMODELLED (1ST ORDER)MODELLED (2ND ORDER)

5 days old

TIME (HOURS)

0 1 2 3 4 5

HEA

T PR

OD

UC

TIO

N (W

/KG

)7

8

9

10

11

12

13

MEASUREDMODELLED (1ST ORDER)

30 days oldExample: Heat production of broiler chickens

Different model order

M3-BIORES, K.U.LEUVEN1111

Complex Individual Time-Varying Dynamic

A living organism:

Measure

Model

Manage

In an on-line way

Living organism = CITD - system

Complex Individual Time-Varying Dynamic

M3-BIORES

M3-BIORES, K.U.LEUVEN1212

What happens today in other process control

M3-BIORES, K.U.LEUVEN1313

Desired direction

General methodology: Conditions for process control

1FEEDBACK

2PREDICTION

MODEL-BASED CONTROLLER

3

ProcessPosition Steering

wheel Direction

MEASUREMEASURE

M3-BIORES, K.U.LEUVEN14

Control of “Biological Responses”

MODEL BASED CONTROLLER

DESIRED BIORESPONSE

DYNAMICBIORESPONSE

MICRO-ENVIRONMENT

Process

1FEEDBACK

PREDICTION

2

3

M3-BIORES, K.U.LEUVEN1515

Examples

M3-BIORES, K.U.LEUVEN16

Control of the crawl trajectory of larvae of Calliphora vicina

M3-BIORES, K.U.LEUVEN1717

Light intensity crawl trajectory

Control of the crawl trajectory of larvae of Calliphora vicina

M3-BIORES, K.U.LEUVEN1818

t t

y(t)u(t)

Response of crawl direction to variations in ligth

Light intensity crawl trajectory

MEASURE MEASURE

M3-BIORES, K.U.LEUVEN1919

-45.00

0.00

45.00

90.00

135.00

180.00

225.00

270.00

315.00

360.00

0 3 6 9 12 15 18 21 24 27 30 33 36

Time

Cra

wl d

irect

ion

(°)

270.00 180.00 12.55

315.00 270.00 9.72

45.00 90.00 13.59

90.00 180.00 15.77

225.00 90.00 12.77

135.00 270.00 9.60

0.00 0.00 15.60

180.00 0.00 15.61

Responses of crawl direction to steps in light direction

M3-BIORES, K.U.LEUVEN2020

PREDICTION

Light intensity crawl trajectory

FEEDBACK

MODEL-BASED CONTROLLER

Active control of crawl direction of larvae

MEASURE MEASURE

M3-BIORES, K.U.LEUVEN2121

Active control of crawl direction of 6 larvae

M3-BIORES, K.U.LEUVEN22

Control of the growth trajectory of chickens

M3-BIORES, K.U.LEUVEN23

Day 1

Day 42

Weight

40 g

> 2000 g

Problems!

Leg disordersAscitesSudden death syndrome…

Active on-line growth trajectory control• Chickens

M3-BIORES, K.U.LEUVEN24

Possible solution:Growth restriction + compensatory growth

= growth control

Day 1 Day 42

Weight

Growth restrictionCompensatory growth

M3-BIORES, K.U.LEUVEN25

Control diagram

TemperatureLight scheduleFeed quantityFeed quality

Weight trajectory

t

Prediction

Model

Model based controller

Feedback

M3-BIORES, K.U.LEUVEN26

EXP2001-3 - afdeling2

Tijd (dagen)0 10 20 30 40

Gew

icht

(gra

m)

0

500

1000

1500

2000

2500

Gestuurd groeitrajectReferentie groeitrajectGroeitraject controle groep

Time (days)

Wei

ght (

gram

s)

Controlled growth trajectoryReference growth trajectoryGrowth trajectory of control group

PLF control results in reduction of mortality (12 exp, 2900 animals each) of 4%

∆ = 3.7% - 6.0%

M3-BIORES, K.U.LEUVEN27

Optimisation of physicaltraining of race horses

M3-BIORES, K.U.LEUVEN28

v

Heart rate

Lactate conc.

VO2

Running speed Heart rate

Optimisation of physical training of race horses

M3-BIORES, K.U.LEUVEN29

Polar equine HR monitor

Sensors

Garmin forerunner GPS

M3-BIORES, K.U.LEUVEN30

Velocity and Heart rate - Kyrielle (Bert) 01-01

0

5

10

15

20

25

30

0:00:00 0:05:00 0:10:00 0:15:00 0:20:00 0:25:00

time (u:mm:ss)

velo

city

(km

/u)

0

20

40

60

80

100

120

140

hear

t rat

e (b

pm)

VelocityHeart rate

Optimisation of physical training of race horses

M3-BIORES, K.U.LEUVEN31

40

50

60

70

80

90

100

110

120

0:00:00 0:10:00 0:20:00 0:30:00 0:40:00 0:50:00 1:00:00

time(h:mm:ss)

hear

t rat

e (b

pm

Controlled heart rateTarget heart rate

Optimisation of physical training of race horses

M3-BIORES, K.U.LEUVEN32

Time-constant of HR over time

0

10

20

30

40

50

60

70

Week 0 Week 1 Week 2 Week 3 Week 4Time (date)

TC (s

ec)

TC

Optimisation of physical training of race horses

M3-BIORES, K.U.LEUVEN3333

Model based monitoring of physical & mental performance

(AC Milan)

M3-BIORES, K.U.LEUVEN3434

Physical trainingPhysical

performance

Perf

orm

ance

Total performance = a. Mental performance + b. Physical performance

Mental performance

Mental training

Process

CITD

CITD

M3-BIORES, K.U.LEUVEN3535

Training exercises Performance

Body

Process

MEASURE(Inmotio)

MEASURE(Inmotio + Hosand)

M3-BIORES, K.U.LEUVEN3636

Heart Rate

Physical Activity

Reference mental status

???

Time

On-line mental monitor

Mental algorithm

Mental monitoring

M3-BIORES, K.U.LEUVEN3737

MINDROOM

Reference mental status

M3-BIORES, K.U.LEUVEN3838

Demo: mental monitoring

M3-BIORES, K.U.LEUVEN3939

Mindroom data (1133 and 1156)

-1.5

-1

-0.5

0

0.5

1

1.5

27/0

3/20

06

31/0

3/20

06

3/4/

2006

7/4/

2006

13/4

/200

6

19/4

/200

6

24/4

/200

6

27/4

/200

6

1/5/

2006

2/5/

2006

3/5/

2006

4/5/

2006

10/5

/200

6

27/0

3/20

06

31/0

3/20

06

7/4/

2006

11/4

/200

6

Date (ddmmyy)

Men

tal s

tatu

s [

pos,

neg

or n

eutr

al]

MINDROOM

11561133

Mindroom vs. Mental algorithm

M3-BIORES, K.U.LEUVEN4040

Mindroom vs. Mental algorithmMental algo vs Mindroom

-1.5

-1

-0.5

0

0.5

1

1.5

27/0

3/20

06

31/0

3/20

06

3/4/

2006

7/4/

2006

13/4

/200

6

19/4

/200

6

24/4

/200

6

27/4

/200

6

1/5/

2006

2/5/

2006

3/5/

2006

4/5/

2006

10/5

/200

6

27/0

3/20

06

31/0

3/20

06

7/4/

2006

11/4

/200

6

Date (ddmmyy)

Men

tal s

tatu

s [

pos,

neg

or n

eutr

al]

MINDROOM

MENTAL ALGO

11561133

M3-BIORES, K.U.LEUVEN4141

Physical trainingPhysical

performance

Perf

orm

ance

Total performance = a. Mental performance + b. Physical performance

Mental performance

Mental training

Real-time process control

CITD

BioRICS

BioRICSCITD

M3-BIORES, K.U.LEUVEN4242

Application Examples

M3-BIORES, K.U.LEUVEN43

Stressmonitoring

AccelerometerECGMobile phone

BioRICS serverUSB

transceiver

M3-BIORES, K.U.LEUVEN44

Monitoring and control of physical performance

AccelerometerECGMobile phone

BioRICS serverUSB

transceiver

M3-BIORES, K.U.LEUVEN45

Weight Control

AccelerometerECGMobile phone

BioRICS serverUSB

transceiver

M3-BIORES, K.U.LEUVEN46

Driver Sleepiness

Temperature sensorECG

BioRICS serverUSB

transceiver

Pedal + steer input

M3-BIORES, K.U.LEUVEN47

Bidirectional Wireless link 2

Bidirectional Wireless link 1

Sensor Modules Central ModuleECG module

Accelerometer module1

Accelerometer module 3

…PDA

orMobile w

ww

.bio

rics.

com

Temp. module

Central Module :

• Transceiver connected to PDA or mobile (mini-USB)

• Responsible for synchronization of the signals from the different sensor modules

General hardware scheme

2m

M3-BIORES, K.U.LEUVEN48

ECG sensor module : sampling freq : 300 Hz

Temperature module : sampling freq : 1/60Hz (1 sample/minute)

Accelerometer modules : sampling freq : 200 Hz

g – range : 6g ; 10g ; 25g

└ Strongly dependent on application field

Bidirectional Wireless link 1 : wireless range : 2m

low power (e.g. recharging after 1 week)

Central Module : USB transceiver

Synchronization of the different signals form the sensor modules

Data transmission via mobile network to BioRICS server

Specifications

M3-BIORES, K.U.LEUVEN49

Complex Algorithms (high level language, e.g. Matlab)

Low level language (C)

Translation

Compiler

M3-BIORES, K.U.LEUVEN5050

10 Products

11 Patents

applications

Bicycle helmets

Race horses

Chickens

Mussels

Professional Cyclists

Intensive Care

ESA

Daphnia

Tubifex

M3-BIORES, K.U.LEUVEN5151

Thank you for your attention…

• For more information you can always check our website:

• http://www.m3-biores.be• http://www.biorics.com