Heuristic Evaluation of SocialNet

the Private Social Network for Psychiatric

Patients and their Relatives

Authors: José Miguel Toribio-Guzmán

Alicia García-HolgadoFelipe Soto Pérez

Francisco J. García-PeñalvoManuel A. Franco Martín

Introduction

>Psiquiatric treatment:

hospitalization only in especific cases

Mental Health Care: Rehabilitation and social integration in Day centers, Shelter flats or Community rehabilitation centers

Family: lack of information about the daily activities of patients

Need: Connect family with patients

a private social network for monitoring daily progress of patients by their relatives

Each patient has a private area accessible only to their caregivers and to authorized persons, where these can share images, videos or texts about activities, meetings, achievements, etc..

Management of users through a hierarchy of roles, combined with a careful definition of the permissions associated with each role.

Roles

General Manager

Caregiver Manager

Caregiver

Family Member/Autorizhed

Patient

Objective

PROTOTYPE SOCIALNET

USABILITY EVALUATION

EASY TO USE

INTERACTION

SATISFACTORY

EFFICIENT

EFFECTIVE

USER OBJECTIVE

Methodology

Criticism about the reliability of their findings and recommendations.

Difficult to reliably interpret the guidelines and identify the same

usability issues

Generating a lot of “false positives”

Zaze

lenc

huc

k (2

006)

The heuristic evaluation method consists of one or more experienced evaluators (three to five recommended), applying an established set of guidelines (or heuristics) as they review a given system (Zazelenchuck ,2006 ; Wilson, 2013)

STRATEGY: double heuristic evaluationONE EXPERT

EVALUATOR

Expert = With experience on SocialNet

Expert = Whithout experience on

SocialNet

STUDY 1

STUDY 2

REDESIGN 1 REDESIGN 2

• 10 heuristic rules proposed by Nielsen + Privacy by Pierotti

• Previous explanation of its usefulness and different roles: GM, CM, C, F, P

• Check list

• Criticality level (low-medium-high)

• Whithout support

• Sessions: max. 2 hours

Results

Study 1

Profiles

1 2 3 4 5 6 7 802468

10121416

Profiles Study 1

GMCMCF

Heuristics

Nº

of p

robl

ems

1 2 3 4 5 6 7 8 9 10 110

5

10

15

20Study 1

Heuristics

Nº

of p

robl

ems

Consistency and standards

Aesthetic and minimalist

Design

Privacy0%

10%20%30%40%50%60%70%80%90%

100%

Criticality Level (1)

High criticality: serious usability problem should be solved Medium criticality: usability problem, important fix Low criticality: minor usability problem, fix it low priority

Study 2

Profiles

1 2 3 4 5 6 7 8 9 10 1102468

101214

Study 2

Heuristics

Nº

of p

robl

ems

1 2 3 4012345678

Profiles Study 2

GMCMCF

Heuristics

Nº

of p

robl

ems

Consistency and standards

Aesthetic and minimalist

Design

Privacy0%

10%20%30%40%50%60%70%80%90%

100%

Criticality Level (2)

High criticality: serious usability problem should be solved Medium criticality: usability problem, important fix Low criticality: minor usability problem, fix it low priority

Conclusions

1. The results suggest that the double heuristic evaluation methodology involving just one evaluator is very useful, practical, low cost and easy to implement.

2. This technique has provided us with valuable data about the usability of SocialNet. Aspects to improve included consistency, design and privacy issues. Those aspects were redisigned and included in the programme as part of an iterative process.

3. We also found that the second evaluation of usability performed by the same evaluator led to new findings, which might suggest that there could be a relationship between previous experience with the application and a better capacity of the evaluator to find aspects to improve in the application.

4. We should compare the reliability of the double assessment carried out by one evaluator with the one carried out by more than one evaluators, analyzing pros and cons.

Heuristic Evaluation of SocialNet

the Private Social Network for Psychiatric

Patients and their Relatives

Authors: José Miguel Toribio-Guzmán

Alicia García-HolgadoFelipe Soto Pérez

Francisco J. García-PeñalvoManuel A. Franco Martín

Heuristic Evaluation of SocialNet

the Private Social Network for Psychiatric

Patients and their Relatives

Authors: José Miguel Toribio-

Guzmán Alicia García-Holgado

Felipe Soto Pérez Francisco J. García-

PeñalvoManuel A. Franco Martín

PhD. José Miguel Toribio-Guzmán

Iberian Institute for Research in Psychosciences.

INTRAS Foundationinvestigacion4@intras.es