Remote sensing of heart rate and blood oxygenation level using gaming camera based technology

1

Remote sensing of heart rate and blood oxygenation level using

gaming camera-based technologyDavid Harris-Birtill1*, David Morrison1, Devesh Dhasmana2,3 1School of Computer Science, University of St Andrews, Fife, KY16 9SX, Scotland, UK2School of Medicine, University of St Andrews, Fife, KY16 9TJ, Scotland, UK3NHS Fife, Victoria Hospital, Hayfield Road, Kirkcaldy, KY2 5AH, Scotland, UK

*dcchb@st-andrews.ac.uk

2

Pulse Oximetry• Heart Rate (less than 40, or more than 130

beats per minute = bad)*• Blood Oxygenation level (less than 90% =

bad)*

* Taenzer et al. “Impact of pulse oximetry surveillance on rescue events and intensive care unit transfers: a before-and-after concurrence study.” Anesthesiology. 112 (2010): 282-7.

3

Kinect: what data does it give us?• Colour image (RGB)

• Infrared (IR) image

• Depth map

• Joint positions (head arms legs etc.)

4

Reflectance measurement setup

PCSpectrometer

White light

source

USB

Fibre optic cableUSB

Pulse oximeter

PCKinect

v2USB

USB

Pulse oximeter

Imaging area

Spectrometer setup

Kinect setup

5

Calculation of heart rate

Peak frequency:72 beats per minute

Integrated intensity over time(across all wavelengths)

Frequency content (using FFT) after high pass filter

6

Calculated heart rate at each wavelength

High accuracy

7

Automated extraction of colour and IR skin reflectance

8

Remote pulse oximetry

9

David Harris-Birtilldcchb@st-andrews.ac.uk

Questions?

Acknowledgements:- Co-authors: David Morrison, Devesh Dhasmana- St Andrews Human Computer Interaction (SACHI) lab

Institutions: Funding: