Validation of Avatar-Based Animations

Valida&on of Avatar-‐Based Anima&ons for the Development of a Nursing

Simula&on

Authors Enilda Romero-‐Hall, Ph.D. (@RomeroEnilda) Assistant Professor The University of Tampa Ginger S. Watson, Ph.D. Associate Professor Old Dominion University Yiannis Papelis, Ph.D. Research Professor Virginia Modeling, Analysis and Simula@on Center

Introduc&on

A valida@on study was conducted to corroborate the pain rendering of animated agents in a 3D simula@on focusing on pain management. Pain Rendering = Emo&on Intensity •  body movement •  verbal communica@on •  behaviors

Visual Analog Scale

Pain in Pa&ents

Low Emo@on Intensity -‐  Pain Score 3

The behaviors: -‐  neutral expression -‐  able to talk normally

Pain in Pa&ents

Moderate Emo@on Intensity -‐  Pain Score 6

The behaviors: -‐  protec&ve of affected area -‐  less movement -‐  complaining of pain.

Pain in Pa&ents

High Emo@on Intensity -‐  Pain Score 9

The behaviors: -‐  restless unseRled -‐  complains about lots of pain -‐  cries inconsolably.

Forma&ve Evalua&on Research

The valida@on study was part of a forma@ve evalua@on to assess the effec@veness of the scenarios prior to the use of the nursing simula@on. Since the simula@on was available through web-‐based 3D soMware, the valida@on process was conducted using the Internet.

METHODS

Par&cipants

Total of 10 nursing professionals

20%

80%

Gender

Males

Females

Par&cipants

10%

10%

50%

30%

Age Groups

Age (25 -‐ 34)

Age (35 -‐ 44)

Age (45 -‐ 54)

Age (55 -‐ 64)


Par&cipants

70%

30%

Status

Full-‐Time

Part-‐Time


Par&cipants

30%

50%

10%

10%

Rank

Registered Nurse

Advance Prac@ce Nurse

Pain Consultant

Graduate Nursing Student


Par&cipants

90%

10%

Years of Clinical Experience

Years (3 or more)

Years (1to 2)


Par&cipants

90%

10%

Experience with Pain Assessment and Management

Experts

Novice


Materials

Nine simulated pa@ent anima@ons with different pain intensity levels were presented through a web-‐based interface.

Instruments

A visual analog scale was used to rate the pain level portrayed by the animated agent in each anima@on and to explain the observed cues that lead to this ra@ng.

Procedure The email included: •  detailed instruc@ons •  a link to the anima@ons •  a link to the visual analog scale (VAS) instrument Par@cipants were asked to: •  Read the instruc@ons provided in the email •  Interact with the nine simulated pa@ent anima@ons •  Select the VAS ra@ng the observed pain •  Answer the open-‐ended ques@on

Procedure

Web Interface: Nursing Scenario Valida@on

Results

The ra@ngs for each anima@on were evaluated using the average ra@ng across all responses.

Results

Scene1 6.30

Scene2 5.60

Scene3 6.00

Three videos with an animated agent portraying a pain level equal to 3 (VAS)

Average for the Videos = 5.97

Results

Scene4 4.71

Scene5 5.33

Scene6 6.33



Results

Scene7 6.13

Scene8 6.13

Scene9 5.89



Results

Videos: •  None were given very low or high pain level ra@ng

•  In their majority were rated as moderate pain level

The comments provided by the par@cipants shed light on the results for each video anima@on

Comments (Pain Level 3)

“If this was a non-‐verbal/non-‐English speaking pa@ent and you were looking for facial cues-‐ I would need to see facial grimace.” “Very short scene! only 6 seconds!” “Very difficult to say. He is clearly uncomfortable. I would need to ask the pa&ent a few more ques&ons.”


“Unable to assess-‐ ‘no not really’ means what? Is it an answer to a ques&on?” “Too short scene, it is not realis&c. For pain observa@on you do have more than 6 seconds! I rated a 7 but I should not know why”


“Frustra&on expressed but he s@ll has guarding body movements” “Looking for service -‐ But difficult to assess pain” “Again a too short scene, not as in prac&ce!”

Discussion

Modifica@ons and improvements were made to the nursing simula@on based on the input from the nursing professionals.

QUESTIONS OR COMMENTS Email: [email protected] TwiRer: @RomeroEnilda

Education

Validation of Avatar-Based Animations