Cd2 Usability Final Presentation V1.0

© Semantico Ltd. 20084 November 2008

CAB Direct II - Usability testing

CAB Direct II

Usability testing - final report



Overview

MethodologyParticipationHighlightsFindingsRecommendations



Methodology

Discover objectives and usersDesign testsRecruit usersConduct sessionsAnalyse resultsReport results and recommend solutions



MethodologyObjectives and Users

The project sought to:•Allow users to discover quality-assured recommendations for

reading, based on topics•Collate, store and retrieve lists of results•Create a mental map of the CAB Direct website and collection

For the following users:•Undergraduate students (potential users)•Institutional librarians (existing users)



Methodology

Design tests-Task 1 - Search for (topic or resource)-Task 2 - Save or bookmark documents or searches

-Task 3 - Identify site name-Task 4 - Identify site content-Task 5 - Identify site purpose



Methodology

Recruit Users Existing users - 3 participants selected by CABI Potential users - 4 participants selected by Semantico (from a

response of 8)

recruitedthroughuniversitymessageboards,facebook,andpersonalcontacts



Methodology Conduct sessions

3 observed sessions (London)3 individual unobserved sessions (2 at

Semantico, 1 offsite)Consistent test scriptConsistent platformFace-to-face facilitated and recordedOpen style - not time on task assessment



Methodology

Analyse resultsMorae Software - annotate and analyse

recordingsObservers’ commentsFacilitators’ observations





Methodology

Analyse resultsMorae Software - annotate and analyse

recordingsObservers’ commentsFacilitators’ observations



Methodology

Report and recommend solutionsAssess all findings and prioritise against goalsIntegrate our knowledge of the project, the product

and the clientIntegrate our knowledge of user behaviour and

technologyPeer review recommendations



Participation

3 CABI Advisory Board membersDid not participate - internal awareness only

3 Existing users (institutional librarians)Elizabeth, Nick, Jil

3 Potential users (undergraduate students)Kate, Niamh, John

Highlights



Findings

DiscoveryKey discovery tools (e.g. search box, refinements)

not optimally availableUsers discovery behaviour variesDiscovery behaviour is affected by ‘mental map’



Findings

Collate, store and retrieve resultsPriority for librarians to export, not savePositioning of tools not yet optimal



Findings

Create a mental mapSite scope and content was not clearVisual design, content and labelling could improve

thismental map very important to support discovery

activity



Recommendations

Prioritise changes that improve the understanding of the site’s purpose and content

Promote the availability of search toolsRevise the function and presentation of tools



Technology

Cd2 Usability Final Presentation V1.0