Testing Frameworks And Methodologies

Testing Framework and Methodologies

Testing Frameworks and Methodologies• Unlike posters or brochures, websites are

designed to be used. So, it’s important to get real people to test your site, in order to identify any usability problems early on.

• Types of Tests• Testing Tools• Creating a Testing Schedule

Testing Frameworks and Methodologies• Remember, your site will be your first point

of contact with many customers. If they find the experience slow and frustrating, that’s how they’re going to think about your company. Do small amounts of testing throughout the web design process. Even on small sites, it’s important to do at least a little bit. If you can’t afford a full-scale usability test, ask a few friends to look at it.


Testing Frameworks and Methodologies• Once you’ve uploaded your site to the

server, it’s important to test it on as many computers and web browsers as possible, in order to check everything’s working as you expect.

• You should have done regular testing while you were building your site, to ensure it worked in the major web browsers. This is your chance to make sure there are no remaining problems.


Testing Frameworks and MethodologiesThere are a variety of tests you can perform on

your website, including:– Card Sorting– Wireframe Testing– Design Testing– Acceptance Testing– Usability Testing


Testing Frameworks and MethodologiesCard Sorting• Card sorting is a really useful way to help

you decide how to structure your site and, what to call the sections.

• Write down the name of each page on a card, shuffle them, and ask a few potential customers to sort them into groups and to come up with names for each group.

• The results can help you decide which sections to have on your site and what to call each one.


Testing Frameworks and MethodologiesWireframe Testing• A wireframe is a working prototype of your

site( or a section of it), without any colours or images.

• By asking potential customers to try performing key tasks, you can uncover any usability problems early in the design process.

• For example, you could ask them to send you an email through your “contact us” page, or you could ask them to buy a digital camera.


Testing Frameworks and MethodologiesWireframe Testing• Spotting usability problems makes a huge

difference to the success of your site.• Over half of the people who visit online

shops, give up half way through the buying process, often because they found the site difficult to use.

• Can you afford to let that happen to you?


Testing Frameworks and MethodologiesDesign Testing• Once you’ve completed your designs in

Photoshop, you can ask potential customers to look at them, for feedback.

• Don’t ask them if they like the fonts or colours as that’s subjective.

• Instead, ask them to tell you about the page.


Testing Frameworks and MethodologiesDesign Testing• For example, you could ask questions like,

“Are there any contact details on this page?”

• Ask them to list words that describe the design.

• If people think your snowboard site is “conservative” and “dull”, then perhaps you need to rethink the design.


Testing Frameworks and MethodologiesAcceptance Testing• Acceptance Testing is one phase in a

project, where the project may be:– Development and implementation of a new,

custom-built system;– Implementation of new system based on a

package; or– Minor or major upgrades to an existing system


Testing Frameworks and MethodologiesAcceptance Testing• Acceptance Testing is independent of the

website development process and performed by end-users and stakeholders before formally accepting the delivered product.

• It is where the website is tested to ensure it meets all specified requirements of the website.

• These requirements are usually determined prior to the website being purchased and/or implemented.


Testing Frameworks and MethodologiesAcceptance Testing• There are key steps in Acceptance Testing

that must be considered no matter the size or complexity of the project.

• The extent of an Acceptance Test may range from testing a small change to an existing website, to implementing a large new package or custom-built website. Whatever the extent, there are fundamental steps to be followed.


Testing Frameworks and MethodologiesAcceptance Testing• It is important the person responsible for

Acceptance Testing formalises the testing process and arranges for the necessary personnel and resources to be available. This requires preparation and planning, and quite often training as well.


Testing Frameworks and MethodologiesAcceptance Testing• There are four phases to the Acceptance

Test:1. Planning2. Preparing Tests, Test Data and Training3. Executing and Controlling4. Closure


Testing Frameworks and MethodologiesUsability Testing• Usability Testing is a technique used to

evaluate a product by testing it on users.• Usability testing is a black-box testing

technique.• The aim is to observe people using the

product to discover errors and areas of improvement.

• Usability testing generally involves measuring how well test subjects respond in four areas: efficiency, accuracy, recall, and emotional response.


Testing Frameworks and MethodologiesUsability Testing• The results of the first test can be treated as

a baseline or control measurement; all subsequent tests can then be compared to the baseline to indicate improvement.


Testing Frameworks and MethodologiesUsability Testing• Performance -- How much time, and how

many steps, are required for people to complete basic tasks? (For example, find something to buy, create a new account, and order the item.)

• Accuracy -- How many mistakes did people make? (And were they fatal or recoverable with the right information?)


Testing Frameworks and MethodologiesUsability Testing• Recall -- How much does the person

remember afterwards or after periods of non-use?

• Emotional response -- How does the person feel about the tasks completed? Is the person confident, stressed? Would the user recommend this system to a friend?


Testing Frameworks and MethodologiesThere are a variety tools available for use in

testing websites and web pages, tools can be as simple as a spell checker, to validation services that validates the mark-up of web documents.

• W3C (X)HTML Validation Service• W3C CSS Validation Service• W3C Link Checker


Testing Frameworks and MethodologiesW3C (X)HTML Validation Service• The W3C Mark-up Validation Service is a

free service that helps check the validity of web documents.

• Most Web documents are written using mark-up languages, these languages are defined by technical specifications which usually include a machine-readable formal grammar.


Testing Frameworks and MethodologiesW3C (X)HTML Validation Service• The act of checking a document against

these constraints is called validation.• Validating Web documents is an important

step which can dramatically help improve and ensure the quality of a website.


Testing Frameworks and MethodologiesW3C CSS VALIDATION SERVICE• The W3C CSS Validation service is a free

software created by the W3C to help Web designers and web developers check CSS.

• Not only will it compare your style sheets to the CSS specification, helping you find errors, typos or incorrect uses of CSS, it will also tell you when your CSS poses some risks in terms of usability.


Testing Frameworks and MethodologiesW3C LINK CHECKER• The link checker reads a (X)HTML document

and extracts a list of anchors and links.• It then checks that no anchor is defined

twice. It then checks that all the links are dereferencable, including the fragments.

• It warns about HTTP redirects, including directory redirects. It can also check recursively a part of a web site.

• The W3C also provide more specific tools, you can find these tools in the W3C QA Toolbox.


Testing Frameworks and MethodologiesTesting MethodologiesTesting Methodologies may include:

– Unattended Testing– Background Testing– Exhaustive Testing– Functional Testing– User Acceptance Testing– Distributed Testing Performance Testing– Random Testing– Error Recovery Methodologies


Testing Frameworks and MethodologiesWhat is to be tested?

– Individual Pages– Page Relationships– Style Guides– Navigation– Accessibility / Usability– Security


Testing Frameworks and MethodologiesWhat is to be tested?

– Individual Pages– Page Relationships– Style Guides– Navigation– Accessibility / Usability– Security


Testing Frameworks and MethodologiesHow many users should you test?Steve Krug determines that three or four users

would be an adequate testing panel:"Testing only three or four users also makes it

possible to test and debrief in the same day, so you can take advantage of what you've learned right away. Also, when you test more than four at a time, you usually end up with more notes than anyone has time to process - many of them about things that are really 'nits,' which can actually make it harder to see the forest for the trees" (2006, Krug, S.)


Produced by Steven [email protected]

Technology

Testing Frameworks And Methodologies