QCopiQuality Control of

patient information Final Presentation

December 4, 2002

Anna TsukermanElizabeth Yang

Jack LiMatthew Lee

Sarah Boaz

Overview

Overall Problem and Solution How we got to the final UI?

Lo Fi PrototypeInteractive PrototypeFinal Prototype

User StudyFinal study description and experimental designResults

Conclusions

Overall Problem and Solution How can we simplify the

complexity of maintaining the quality of patient’s records, for medics?

We offer a friendly front-end interface for automating this administrative task.

The medics will be able to then improve accuracy and efficiency of maintaining records.

Lo Fi Prototype

Our Lo Fi prototype automated the task of reviewing the charts for completeness

We first designed an interface that would check the completeness of the charts in the database

When we tested the lo-fi prototype on a representative medic, she could not easily locate the completeness warnings, so we made the warnings clearer for the next implementation

Initial Prototype We solved the previous problem by highlighting

the warnings section.

Three major problems found through Heuristic Evaluation

1. System forces user to make update2. The user could only exit from the Index Page 3. Unclear representation of status

1. System forces user to make updates when exiting charto Major design change of adding

edit/view modes

2. User could only exit from the index pageo Added exits, and exit checks at

every screen

3. Unclear mapping of status numbers and their meaningso Conversion to a three value

status representation

Final Prototype – HE and Solutions

1. System forces user to make updates when exiting charto Major design change of adding

edit/view modes

2. User could only exit from the index pageo Added exits, and exit checks at

every screen

3. Unclear mapping of status numbers and their meaningso Conversion to a three value

status representation

Final Prototype – HE and Solutions

1. System forces user to make updates when exiting charto Major design change of adding

edit/view modes

2. User could only exit from the index pageo Added exits, and exit checks at

every screen

3. Unclear mapping of status numbers and their meaningso Conversion to a three value

status representation

Final Prototype – HE and Solutions

Final Prototype – HE and Solutions

1. System forces user to make updates when exiting charto Major design change of adding

edit/view modes

2. User could only exit from the index pageo Added exits, and exit checks at

every screen

3. Unclear mapping of status numbers and their meaningso Conversion to a three value

status representation

User Study Description

Participants 3 medics from a non-profit clinic Recruitment by asking for volunteers

Tasks Completeness Check Correctness Check Printing out lab form

Method: Think Aloud Study

User Study Description (cont.)

Test Metrics Productivity

Number of steps Remarked feature was helpful or “cool” Subjective ratings

Minimal Error Rates“Wrong” clicks Visibly searching for more than 10 seconds Confused for more than 10 seconds Asked for help Visibly frustrated

Results - Productivity

Bottom-Line Data 2 out of 3

participants rated QCopi high in productivity

Process Data“It’s neat that it can print [lab forms]…That’s cool.”

(Participant A)“The check mark for completeness is kind of

cool.” (Participant C)

How much will QCopi increase your productivity? (0=not at all, 5=a lot)

0

1

2

3

4

5

Participant A Participant B Participant C

Results – Minimal Errors

Bottom-Line Data All participants had

approx. 3 or fewer “wrong” clicks per task

Process Data“I guess that’s a safety saving me from changing

everything when I don’t want to…” (Participant C)“Computers take a little while to get used to.”

(Participant B)

Average Number of "Wrong" Clicks Per Task

0

1

2

3

4

5

Task 1 Task 2 Task 3

Number of Clicks

ConclusionUseful functions help increase productivity at the

clinicAutomated checks help decrease errors in

patient recordsSubjective reactions:

thought was useful and “cool”affinity for traditional paper and pen

Questions, Comments, or

Concerns?

Thank You!