Test, Test, and Test Some MoreTest, Test, and Test Some MoreJulie M. Davis, PhDDirector of Web Development, Clarkson UniversityJulie M. Davis, PhDDirector of Web Development, Clarkson University

Image Courtesy of Shutterstock

“You can use an eraser on the drafting table or a sledge hammer on the construction site”

- Frank Lloyd Wright

Image Courtesy of Shutterstock

What we are going to talk about• What to test?

• When you should test?

• How do you get testing subjects?

• Asking the right questions to make accurate decisions.

Image Courtesy of Shutterstock

That really depends…

Where are you in the life-cycle of your site?

How do you decide what to test?

Image Courtesy of Shutterstock

What do you test - Redesigning

• Wireframe low-fidelity versions of your site• Page layout• Interface elements• Navigation• Functionality

• A high-fidelity site prototype• Visual layout• Interface design• Logical Flow• Behavior

• Alpha and beta versions - pre-launch/launch status• User Experience

• Navigational flow• Feature functionality• Image choice

Image Courtesy of Shutterstock

Wireframe Testing – Questions?• Where would you find [X]?• If you could move one thing what would it be and where would you

move it?• What is this site about?• What three things do you expect to find on a page like this, can you find

them? Did you have any difficulties?• What features are missing?• Perform A/B testing of image placement

Wireframe Testing Focus Reminder• Page layout• Interface elements• Navigation• Functionality Image Courtesy of Shutterstock

Prototype Testing – Questions?• What is your first impression of the homepage?• Look at the site for 5 seconds, now look away, tell me what you think of

the site?• If you clicked on this [element] what do you expect it to do? Where

would it take you?• Do you trust this site? Do you think it is professional?• Is there anything you would change?• What did you like about the website?

Prototype Testing Focus Reminder• Visual layout• Interface design• Logical Flow• Behavior

Image Courtesy of Shutterstock

Alpha/Beta Site– Questions?• If you clicked on this [element] what do you expect it to do? Where would

it take you?Alpha/Beta Focus Reminder• User Experience

• Navigational, feature functionality, image choice

Image Courtesy of Shutterstock

Who, What, Where and HowWireframe Prototype Alpha/Beta

How many? 5-20 users 5-20 users 5-10 usersWhy Focus on layout &

functionalityFocus on visual elements & navigational flow

Focus on user experience & problem solving

When Early in the process before design

After wireframes but before coding begins

Pre-launch/launch

How often Once Iterative At least onceMethod Online/Onsite Online/Onsite Onsite

Who Demographic audience/site users

Demographic audience/site users

Site users

Image Courtesy of Shutterstock

That really depends…

Where are you in the life-cycle of your site?

How do you decide what to test?

Image Courtesy of Shutterstock

What do you test – 6 months+• Problematic Areas

• Google Analytics• Search Results

• New Features/Elements you want to add• Features/Elements you want to move or remove• User satisfaction

Image Courtesy of Shutterstock

That really depends…

Where are you in the life-cycle of your site?

How do you decide what to test?

Image Courtesy of Shutterstock

What do you test – About to Redesign

• Problematic Areas• Google Analytics• Search Results

• New Features/Elements you want to add• Features/Elements you want to move or remove• User satisfaction

Image Courtesy of Shutterstock

Enticing Participants• Onsite Testing

• Current Students• Employed• Incentivized (t-shirts, food,

experience)• Non-incentivized (just ask)

• Perspective Students• Incentivized (t-shirts, food,

experience)

• Online Testing• Demographic audience

Image Courtesy of Shutterstock

Usability Testing ToolsWireframe Testing • Axure• Balsamiq• Cacoo• FlairBuilder• Gliffy• HotGloo• iPlotz • Lovely Charts• Lucid Chart

• MockFlow• Mockingbird• Mochup Builder• Mockup Tiger• OmniGraffle• Pencil Project• Power Mockup• Simulify• Wireframe Sketch

er

Prototype Testing • Axure• DesignerVista• ForeUi• Justinmind• Keynotopia• Lumzy• Protoshare• Proto.io• SketchFlow

Alpha/Beta Testing • Morae• UsabilityHub• AppSee• UsersThink• UsabilityTools• UserTesting• Trymyui

Plus Many Many More

Image Courtesy of Shutterstock