32
Interactive Visualization of Muscle Activity During Limb Movements : Towards Enhanced Anatomy Learning Armelle Bauer, Florent Paclet, Violaine Cahouet, Ali-Hamadi Dicko, Olivier Palombi, François Faure, Jocelyne Troccaz INRIA, LJK-CNRS, TIMC-IMAG, GIPSA-lab, Persyval-Lab, Univ. Grenoble Alpes, LADAF

Interactive Visualization of Muscle Activity During Limb … · 2018-06-19 · Embodiment Theory Interactive Visualization of Muscle Activity During Limb Movements : Towards Enhanced

  • Upload
    others

  • View
    2

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Interactive Visualization of Muscle Activity During Limb … · 2018-06-19 · Embodiment Theory Interactive Visualization of Muscle Activity During Limb Movements : Towards Enhanced

Interactive Visualization of Muscle Activity

During Limb Movements :Towards Enhanced Anatomy Learning

Armelle Bauer, Florent Paclet, Violaine Cahouet, Ali-Hamadi Dicko, Olivier Palombi, François Faure, Jocelyne Troccaz

INRIA, LJK-CNRS, TIMC-IMAG, GIPSA-lab, Persyval-Lab, Univ. Grenoble Alpes, LADAF

Page 2: Interactive Visualization of Muscle Activity During Limb … · 2018-06-19 · Embodiment Theory Interactive Visualization of Muscle Activity During Limb Movements : Towards Enhanced
Page 3: Interactive Visualization of Muscle Activity During Limb … · 2018-06-19 · Embodiment Theory Interactive Visualization of Muscle Activity During Limb Movements : Towards Enhanced

Overview

Interactive Visualization of Muscle Activity During Limb Movements : Towards Enhanced Anatomy Learning 2

Related Work- Learning Anatomy- Related Work

LBA Architecture- LBA Project- Kinect & User-Specific 3D Avatar- Muscle Activity data- Model & Results

Conclusion & Future Work

Page 4: Interactive Visualization of Muscle Activity During Limb … · 2018-06-19 · Embodiment Theory Interactive Visualization of Muscle Activity During Limb Movements : Towards Enhanced

Overview

Interactive Visualization of Muscle Activity During Limb Movements : Towards Enhanced Anatomy Learning 3

Related Work- Learning Anatomy- Related Work

LBA Architecture- LBA Project- Kinect & User-Specific 3D Avatar- Muscle Activity data- Model & Results

Conclusion & Future Work

Page 5: Interactive Visualization of Muscle Activity During Limb … · 2018-06-19 · Embodiment Theory Interactive Visualization of Muscle Activity During Limb Movements : Towards Enhanced

Learning Anatomy : Classic Methods

Interactive Visualization of Muscle Activity During Limb Movements : Towards Enhanced Anatomy Learning 4

Gray’s Anatomy CAT Scan (CT) Anatomical Model

Page 6: Interactive Visualization of Muscle Activity During Limb … · 2018-06-19 · Embodiment Theory Interactive Visualization of Muscle Activity During Limb Movements : Towards Enhanced

Learning Anatomy : 3D Visualization

Interactive Visualization of Muscle Activity During Limb Movements : Towards Enhanced Anatomy Learning 5

Medicine [InnerBODY, 2013] BioDigital Human [https://www.biodigitalhuman.com/]

Page 7: Interactive Visualization of Muscle Activity During Limb … · 2018-06-19 · Embodiment Theory Interactive Visualization of Muscle Activity During Limb Movements : Towards Enhanced

Learning Anatomy : Animation

Interactive Visualization of Muscle Activity During Limb Movements : Towards Enhanced Anatomy Learning 6

(1) Effectiveness of Three-Dimensional Digital Animation in Teaching Human Anatomy in an Authentic Classroom Context Nady Hoyek, Christian Collet, Franck Di Rienzo, Mickael De Almeida, Aymeric GuillotAnatomical Science Education, 2014 mar 27

Fovea MOOC[anatomie3d.univ-lyon1.fr/]

(1) [Nady Hoyek & all, 2014]

Page 8: Interactive Visualization of Muscle Activity During Limb … · 2018-06-19 · Embodiment Theory Interactive Visualization of Muscle Activity During Limb Movements : Towards Enhanced

Embodiment Theory

Interactive Visualization of Muscle Activity During Limb Movements : Towards Enhanced Anatomy Learning 7

“Our Motor System Influences our Cognition”

Eroding the Boundaries of Cognition: Implications of EmbodimentAnderson ML, Richardson MJ, Chemero ATopics in cognitive science, 4(4): 717–730, 2012

Embodied Cognition and Virtual Reality in Learning to Visualize AnatomySusan Jang, John B. Black, Robert W. JyungProc. CogSci, 2010

Being there: Putting brain, body, and world together againClark, A..MIT press, 1998

Embodied cognition is not what you think it isWilson AD, Golonka SFrontiers in psychology, 4., 2013

Page 9: Interactive Visualization of Muscle Activity During Limb … · 2018-06-19 · Embodiment Theory Interactive Visualization of Muscle Activity During Limb Movements : Towards Enhanced

Related Work : Augmented Reality

Interactive Visualization of Muscle Activity During Limb Movements : Towards Enhanced Anatomy Learning 8

(1) Kinect for Interactive AR Anatomy LearningMa Meng, Pascal Fallavollita, Tobias Blum, Ulrich Eck, Christian Sandor, Simon Weidert, Jens Waschke, Nassir Navab1IEEE Virtual Reality, 2012

Digital Mirror [University of Paris-South, 2014](1) Magic Mirror [Ma Meng & all, 2013]

Page 10: Interactive Visualization of Muscle Activity During Limb … · 2018-06-19 · Embodiment Theory Interactive Visualization of Muscle Activity During Limb Movements : Towards Enhanced

Related Work : Anatomy in Motion

Interactive Visualization of Muscle Activity During Limb Movements : Towards Enhanced Anatomy Learning 9

(1) Biomechanical Analysis of Typical Upper Limb Movements Based on Kinect-LifeMODMing Zeng, Changwei Chen, Qinghao Meng, Honglin Ren, Shugen MaApplied Mechanics and Materials, Vols, 599-601 (2014) pp 534-538

(1) [Ming Zeng & all, 2014]Medical Simulator[LapSim, 2012]

Page 11: Interactive Visualization of Muscle Activity During Limb … · 2018-06-19 · Embodiment Theory Interactive Visualization of Muscle Activity During Limb Movements : Towards Enhanced

Overview

Interactive Visualization of Muscle Activity During Limb Movements : Towards Enhanced Anatomy Learning 10

LBA Architecture- LBA Project- Kinect & User-Specific 3D Avatar- Muscle Activity data- Model & Results

Conclusion & Future Work

Related Work- Learning Anatomy- Related Work

Page 12: Interactive Visualization of Muscle Activity During Limb … · 2018-06-19 · Embodiment Theory Interactive Visualization of Muscle Activity During Limb Movements : Towards Enhanced

Key Contribution

Interactive Visualization of Muscle Activity During Limb Movements : Towards Enhanced Anatomy Learning 11

Capture user Motion

Visualize Muscles

&

Muscle Activation

Improve Learning Process

Page 13: Interactive Visualization of Muscle Activity During Limb … · 2018-06-19 · Embodiment Theory Interactive Visualization of Muscle Activity During Limb Movements : Towards Enhanced

Collaboration Work

Interactive Visualization of Muscle Activity During Limb Movements : Towards Enhanced Anatomy Learning 12

User-Specific3D

AnatomicalModel

AnatomyKnowledgeDatabase

Validation of the

EmbodimentTheroy

Capture and Identification

AugmentedReality :

Interaction

LBA

Page 14: Interactive Visualization of Muscle Activity During Limb … · 2018-06-19 · Embodiment Theory Interactive Visualization of Muscle Activity During Limb Movements : Towards Enhanced

Pipeline

Interactive Visualization of Muscle Activity During Limb Movements : Towards Enhanced Anatomy Learning 13

User Tracking

Muscle Activation Experimental Data

User CalibrationMotion

&Muscle Activation

VisualFeedback

Page 15: Interactive Visualization of Muscle Activity During Limb … · 2018-06-19 · Embodiment Theory Interactive Visualization of Muscle Activity During Limb Movements : Towards Enhanced

Pipeline

Interactive Visualization of Muscle Activity During Limb Movements : Towards Enhanced Anatomy Learning 13

User Tracking

Muscle Activation Experimental Data

User CalibrationMotion

&Muscle Activation

VisualFeedback

Page 16: Interactive Visualization of Muscle Activity During Limb … · 2018-06-19 · Embodiment Theory Interactive Visualization of Muscle Activity During Limb Movements : Towards Enhanced

User Tracking

Interactive Visualization of Muscle Activity During Limb Movements : Towards Enhanced Anatomy Learning 14

+ Filtering

Page 17: Interactive Visualization of Muscle Activity During Limb … · 2018-06-19 · Embodiment Theory Interactive Visualization of Muscle Activity During Limb Movements : Towards Enhanced

Pipeline

Interactive Visualization of Muscle Activity During Limb Movements : Towards Enhanced Anatomy Learning 15

User Tracking

Muscle Activation Experimental Data

User CalibrationMotion

&Muscle Activation

VisualFeedback

Page 18: Interactive Visualization of Muscle Activity During Limb … · 2018-06-19 · Embodiment Theory Interactive Visualization of Muscle Activity During Limb Movements : Towards Enhanced

User calibration

Interactive Visualization of Muscle Activity During Limb Movements : Towards Enhanced Anatomy Learning 16

Page 19: Interactive Visualization of Muscle Activity During Limb … · 2018-06-19 · Embodiment Theory Interactive Visualization of Muscle Activity During Limb Movements : Towards Enhanced

Title….

Interactive Visualization of Muscle Activity During Limb Movements : Towards Enhanced Anatomy Learning 17

Page 20: Interactive Visualization of Muscle Activity During Limb … · 2018-06-19 · Embodiment Theory Interactive Visualization of Muscle Activity During Limb Movements : Towards Enhanced

Pipeline

Interactive Visualization of Muscle Activity During Limb Movements : Towards Enhanced Anatomy Learning 18

User Tracking

Muscle Activation Experimental Data

User CalibrationMotion

&Muscle Activation

VisualFeedback

Page 21: Interactive Visualization of Muscle Activity During Limb … · 2018-06-19 · Embodiment Theory Interactive Visualization of Muscle Activity During Limb Movements : Towards Enhanced

Experiment (EMG)

Interactive Visualization of Muscle Activity During Limb Movements : Towards Enhanced Anatomy Learning 19

Healthy subject :- 48 years old- 186 cm- 77 kg

Right Leg : Flexion/Extension cycle in no-load conditions

% time

% Activation

Page 22: Interactive Visualization of Muscle Activity During Limb … · 2018-06-19 · Embodiment Theory Interactive Visualization of Muscle Activity During Limb Movements : Towards Enhanced

Output of Experiment

Interactive Visualization of Muscle Activity During Limb Movements : Towards Enhanced Anatomy Learning 20

Intersegmental angles were calculated at ankle, knee and hip joints

Page 23: Interactive Visualization of Muscle Activity During Limb … · 2018-06-19 · Embodiment Theory Interactive Visualization of Muscle Activity During Limb Movements : Towards Enhanced

Pipeline

Interactive Visualization of Muscle Activity During Limb Movements : Towards Enhanced Anatomy Learning 21

User Tracking

Muscle Activation Experimental Data

User CalibrationMotion

&Muscle Activation

VisualFeedback

Page 24: Interactive Visualization of Muscle Activity During Limb … · 2018-06-19 · Embodiment Theory Interactive Visualization of Muscle Activity During Limb Movements : Towards Enhanced

Motion and Muscular Validation

Interactive Visualization of Muscle Activity During Limb Movements : Towards Enhanced Anatomy Learning 22

Flexion

Extension

Page 25: Interactive Visualization of Muscle Activity During Limb … · 2018-06-19 · Embodiment Theory Interactive Visualization of Muscle Activity During Limb Movements : Towards Enhanced

Visualization of Activation

Interactive Visualization of Muscle Activity During Limb Movements : Towards Enhanced Anatomy Learning 23

Page 26: Interactive Visualization of Muscle Activity During Limb … · 2018-06-19 · Embodiment Theory Interactive Visualization of Muscle Activity During Limb Movements : Towards Enhanced

Pipeline

Interactive Visualization of Muscle Activity During Limb Movements : Towards Enhanced Anatomy Learning 24

User Tracking

Muscle Activation Experimental Data

User CalibrationMotion

&Muscle Activation

VisualFeedback

Page 27: Interactive Visualization of Muscle Activity During Limb … · 2018-06-19 · Embodiment Theory Interactive Visualization of Muscle Activity During Limb Movements : Towards Enhanced

Results

Interactive Visualization of Muscle Activity During Limb Movements : Towards Enhanced Anatomy Learning 25

Page 28: Interactive Visualization of Muscle Activity During Limb … · 2018-06-19 · Embodiment Theory Interactive Visualization of Muscle Activity During Limb Movements : Towards Enhanced

Results

Interactive Visualization of Muscle Activity During Limb Movements : Towards Enhanced Anatomy Learning 26

Page 29: Interactive Visualization of Muscle Activity During Limb … · 2018-06-19 · Embodiment Theory Interactive Visualization of Muscle Activity During Limb Movements : Towards Enhanced

Overview

Interactive Visualization of Muscle Activity During Limb Movements : Towards Enhanced Anatomy Learning 27

LBA Architecture- LBA Project- Kinect & User-Specific 3D Avatar- Muscle Activity data- Model & Results

Conclusion & Future Work

Related Work- Learning Anatomy- Related Work

Page 30: Interactive Visualization of Muscle Activity During Limb … · 2018-06-19 · Embodiment Theory Interactive Visualization of Muscle Activity During Limb Movements : Towards Enhanced

Anatomy Lesson

Interactive Visualization of Muscle Activity During Limb Movements : Towards Enhanced Anatomy Learning 28

Purpose : Ease the Learning Process of the lower limb musculoskeletal system.

Muscular Activity is essentially studied by :

Requirements : Osteology and Arthrology of lower limb

Lesson :1- Explain the lower limb movement2- During motion : show bones3- During motion : show a muscle4- During motion : show region of muscles name, function and distribution

name, morphology, function, insertion, and innervation name, joint

- Physiotherapy Students

- Medical Students

Same knowledge but different level of details

5- Same movement with different Velocities

Page 31: Interactive Visualization of Muscle Activity During Limb … · 2018-06-19 · Embodiment Theory Interactive Visualization of Muscle Activity During Limb Movements : Towards Enhanced

Conclusion

Interactive Visualization of Muscle Activity During Limb Movements : Towards Enhanced Anatomy Learning 29

Conclusion :

Future Work :

With accurate anatomically-based models and realistic motion learning anatomy will be eased

- Validate the theory of Embodiment

- Innovative Aplication : Visualization of Human Body Kinetics

- Displaying Muscle Activation

- AR Visual Feedback

- Improve the avatar personalization to reinforce embodiment

- Visualize information on other limbs motions

- Automatically detect the user motion and deliver knowledge accordingly

Page 32: Interactive Visualization of Muscle Activity During Limb … · 2018-06-19 · Embodiment Theory Interactive Visualization of Muscle Activity During Limb Movements : Towards Enhanced

Thank you for your attention!

Interactive Visualization of Muscle Activity

During Limb Movements :Towards Enhanced Anatomy Learning