View
35
Download
2
Category
Preview:
Citation preview
© Semantico Ltd. 20084 November 2008
CAB Direct II - Usability testing
CAB Direct II
Usability testing - final report
© Semantico Ltd. 20084 November 2008
CAB Direct II - Usability testing
Overview
MethodologyParticipationHighlightsFindingsRecommendations
© Semantico Ltd. 20084 November 2008
CAB Direct II - Usability testing
Methodology
Discover objectives and usersDesign testsRecruit usersConduct sessionsAnalyse resultsReport results and recommend solutions
© Semantico Ltd. 20084 November 2008
CAB Direct II - Usability testing
MethodologyObjectives and Users
The project sought to:•Allow users to discover quality-assured recommendations for
reading, based on topics•Collate, store and retrieve lists of results•Create a mental map of the CAB Direct website and collection
For the following users:•Undergraduate students (potential users)•Institutional librarians (existing users)
© Semantico Ltd. 20084 November 2008
CAB Direct II - Usability testing
Methodology
Design tests-Task 1 - Search for (topic or resource)-Task 2 - Save or bookmark documents or searches
-Task 3 - Identify site name-Task 4 - Identify site content-Task 5 - Identify site purpose
© Semantico Ltd. 20084 November 2008
CAB Direct II - Usability testing
Methodology
Recruit Users Existing users - 3 participants selected by CABI Potential users - 4 participants selected by Semantico (from a
response of 8)
recruitedthroughuniversitymessageboards,facebook,andpersonalcontacts
© Semantico Ltd. 20084 November 2008
CAB Direct II - Usability testing
Methodology Conduct sessions
3 observed sessions (London)3 individual unobserved sessions (2 at
Semantico, 1 offsite)Consistent test scriptConsistent platformFace-to-face facilitated and recordedOpen style - not time on task assessment
© Semantico Ltd. 20084 November 2008
CAB Direct II - Usability testing
Methodology
Analyse resultsMorae Software - annotate and analyse
recordingsObservers’ commentsFacilitators’ observations
© Semantico Ltd. 20084 November 2008
CAB Direct II - Usability testing
© Semantico Ltd. 20084 November 2008
CAB Direct II - Usability testing
Methodology
Analyse resultsMorae Software - annotate and analyse
recordingsObservers’ commentsFacilitators’ observations
© Semantico Ltd. 20084 November 2008
CAB Direct II - Usability testing
Methodology
Report and recommend solutionsAssess all findings and prioritise against goalsIntegrate our knowledge of the project, the product
and the clientIntegrate our knowledge of user behaviour and
technologyPeer review recommendations
© Semantico Ltd. 20084 November 2008
CAB Direct II - Usability testing
Participation
3 CABI Advisory Board membersDid not participate - internal awareness only
3 Existing users (institutional librarians)Elizabeth, Nick, Jil
3 Potential users (undergraduate students)Kate, Niamh, John
Highlights
© Semantico Ltd. 20084 November 2008
CAB Direct II - Usability testing
Findings
DiscoveryKey discovery tools (e.g. search box, refinements)
not optimally availableUsers discovery behaviour variesDiscovery behaviour is affected by ‘mental map’
© Semantico Ltd. 20084 November 2008
CAB Direct II - Usability testing
Findings
Collate, store and retrieve resultsPriority for librarians to export, not savePositioning of tools not yet optimal
© Semantico Ltd. 20084 November 2008
CAB Direct II - Usability testing
Findings
Create a mental mapSite scope and content was not clearVisual design, content and labelling could improve
thismental map very important to support discovery
activity
© Semantico Ltd. 20084 November 2008
CAB Direct II - Usability testing
Recommendations
Prioritise changes that improve the understanding of the site’s purpose and content
Promote the availability of search toolsRevise the function and presentation of tools
© Semantico Ltd. 20084 November 2008
CAB Direct II - Usability testing
Recommended