Testing Principles and Concepts - Overview

Test Principles and Test Principles and ConceptsConcepts

CSTE Body of KnowledgeCSTE Body of KnowledgeCategory II: Test Category II: Test Skills/ApproachesSkills/Approaches

Domain 5: Testing Principles and Domain 5: Testing Principles and ConceptsConcepts

Testing Principles and Testing Principles and ConceptsConcepts

• Definition of Test SpecificationsDefinition of Test Specifications

• Testing Techniques (Not covered)Testing Techniques (Not covered)

• Testing Methods (Not covered)Testing Methods (Not covered)

• Independent Testing (Not covered)Independent Testing (Not covered)

• Commercial Off The Shelf (COTS) Commercial Off The Shelf (COTS) Software (Not covered)Software (Not covered)

Testing Principles and Testing Principles and ConceptsConcepts

• Testing Code Developed Under Testing Code Developed Under Outside Contract (Not covered)Outside Contract (Not covered)

• Test Quality (Not covered)Test Quality (Not covered)

• Testing Life Cycle (Not covered)Testing Life Cycle (Not covered)

• VocabularyVocabulary

Definition of Test Definition of Test SpecificationsSpecifications

• Establishing test objectivesEstablishing test objectives

• PurposePurpose

• ApproachesApproaches

• Pass/fail criteria Pass/fail criteria

• Entrance/exit criteriaEntrance/exit criteria

Establishing Test ObjectivesEstablishing Test Objectives

• ““The process of exercising software The process of exercising software to verify that it satisfies specified to verify that it satisfies specified requirements and to detect errors” requirements and to detect errors” Glossary of The British Computer Society Specialist Interest Glossary of The British Computer Society Specialist Interest Group in Software TestingGroup in Software Testing

Establishing Test ObjectivesEstablishing Test Objectives

• Factors for determining objectivesFactors for determining objectives– Nature of applicationNature of application– Code CoverageCode Coverage– TechnologyTechnology– PlatformPlatform– User RequirementsUser Requirements– Government RegulationsGovernment Regulations

Establishing Test ObjectivesEstablishing Test ObjectivesExamplesExamples

• To obtain a 85% passing rate on all To obtain a 85% passing rate on all assigned tests casesassigned tests cases

• To ensure software is compliant with To ensure software is compliant with current HIPPA codecurrent HIPPA code

• To verify database access time is To verify database access time is reduced by 35%reduced by 35%

Purpose of TestingPurpose of Testing

• ““The purpose of testing is to discover The purpose of testing is to discover errors. Testing is the process of errors. Testing is the process of trying to discover every conceivable trying to discover every conceivable fault or weakness in a work product.” fault or weakness in a work product.” The Art of Software Testing, Glenford MyerThe Art of Software Testing, Glenford Myer

• ““The purpose of testing is to ensure The purpose of testing is to ensure the customers spoken and unspoken the customers spoken and unspoken expectations are met.”expectations are met.” Mark Curtiss, VeriTest Mark Curtiss, VeriTest

Purpose of TestingPurpose of Testing

• Detect the existence of defectsDetect the existence of defects

• Ensure functionality and usabilityEnsure functionality and usability

• Increase customer satisfactionIncrease customer satisfaction

• Reduce legal liabilityReduce legal liability

• Ensure compliance with government Ensure compliance with government regulationsregulations

Purpose of TestingPurpose of TestingExamplesExamples

• To reduce support calls on new To reduce support calls on new product releases by 25% over product releases by 25% over previous yearsprevious years

• Find and fix all critical defects prior Find and fix all critical defects prior to releaseto release

• Verify boundary conditions are not Verify boundary conditions are not exceeded on a given fieldexceeded on a given field

Testing ApproachesTesting Approaches

• Black-box testingBlack-box testing

• White-box testingWhite-box testing

• Regression testingRegression testing

• Stress testingStress testing

• Load testingLoad testing

• Configuration testingConfiguration testing

Pass / Fail CriteriaPass / Fail Criteria

• Ensure textbox will not recognize Ensure textbox will not recognize numbersnumbers

• Ensure Next button will take user to Ensure Next button will take user to the next pagethe next page

• Ensure all components are removed Ensure all components are removed after an Uninstallafter an Uninstall

Entrance / Exit CriteriaEntrance / Exit Criteria

• Vendor Validation testing has been Vendor Validation testing has been completed without any failurescompleted without any failures

• All tests have been run successfullyAll tests have been run successfully

• Code Complete has been reachedCode Complete has been reached

Sample Exam QuestionsSample Exam QuestionsCritical Skills QuestionsCritical Skills Questions

• What is COTS?What is COTS?– Commerical off-the shelf software Commerical off-the shelf software

(shrink-wrapped)(shrink-wrapped)


• The purpose of software testing is The purpose of software testing is to :to :

a)a) Demonstrate that the application Demonstrate that the application works properlyworks properly

b)b) Detect the existence of defectsDetect the existence of defects

c)c) Validate the logical designValidate the logical design


• The purpose of software testing is The purpose of software testing is to :to :

a)a) Demonstrate that the application Demonstrate that the application works properlyworks properly

b)b) Detect the existence of defectsDetect the existence of defects

c)c) Validate the logical designValidate the logical design


• For black-box testing:For black-box testing:a)a) The tester is completely unconcerned The tester is completely unconcerned

about the internal behavior of the about the internal behavior of the programprogram

b)b) The tester is concerned with finding The tester is concerned with finding circumstances in which the program does circumstances in which the program does not behave according to specificationsnot behave according to specifications

c)c) Test data is derived solely from Test data is derived solely from specificationsspecifications

d)d) All the aboveAll the above


• For black-box testing:For black-box testing:a)a) The tester is completely unconcerned The tester is completely unconcerned

about the internal behavior of the about the internal behavior of the programprogram

b)b) The tester is concerned with finding The tester is concerned with finding circumstances in which the program does circumstances in which the program does not behave according to specificationsnot behave according to specifications

c)c) Test data is derived solely from Test data is derived solely from specificationsspecifications

d)d) All the aboveAll the above


• Boundary value testing:Boundary value testing:a)a) Is the same as equivalence partitioning Is the same as equivalence partitioning

teststests

b)b) Test boundary conditions on, above, and Test boundary conditions on, above, and below the edges of input and output below the edges of input and output equivalence classesequivalence classes

c)c) Tests combinations of input Tests combinations of input circumstancescircumstances

d)d) Is used in white-box testing strategyIs used in white-box testing strategy


• Boundary value testing:Boundary value testing:a)a) Is the same as equivalence partitioning Is the same as equivalence partitioning

teststests

b)b) Test boundary conditions on, above, and Test boundary conditions on, above, and below the edges of input and output below the edges of input and output equivalence classesequivalence classes

c)c) Tests combinations of input Tests combinations of input circumstancescircumstances

d)d) Is used in white-box testing strategyIs used in white-box testing strategy


• Decision/branch coverage strategy:Decision/branch coverage strategy:a)a) Always satisfies statement coverageAlways satisfies statement coverage

b)b) Is used in black-box testingIs used in black-box testing

c)c) Means that every branch direction is Means that every branch direction is traversed at least oncetraversed at least once

d)d) Is the same as condition coverageIs the same as condition coverage


• Decision/branch coverage strategy:Decision/branch coverage strategy:a)a) Always satisfies statement coverageAlways satisfies statement coverage

b)b) Is used in black-box testingIs used in black-box testing

c)c) Means that every branch direction is Means that every branch direction is traversed at least oncetraversed at least once

d)d) Is the same as condition coverageIs the same as condition coverage


• Acceptance testing means:Acceptance testing means:a)a) Testing performed on a single stand-Testing performed on a single stand-

alone module or unit of codealone module or unit of code

b)b) Testing after changes have been made Testing after changes have been made to ensure that no unwanted changes to ensure that no unwanted changes were introducedwere introduced

c)c) Testing to ensure that the system Testing to ensure that the system meets the needs of the organization meets the needs of the organization and the end userand the end user


• Acceptance testing means:Acceptance testing means:a)a) Testing performed on a single stand-Testing performed on a single stand-

alone module or unit of codealone module or unit of code

b)b) Testing after changes have been made Testing after changes have been made to ensure that no unwanted changes to ensure that no unwanted changes were introducedwere introduced

c)c) Testing to ensure that the system Testing to ensure that the system meets the needs of the organization meets the needs of the organization and the end userand the end user


• Joe is performing a test to see that it Joe is performing a test to see that it complies with the user requirements that complies with the user requirements that a certain field be populated by using a a certain field be populated by using a dropdown box containing a list of values. dropdown box containing a list of values. Joe is performing:Joe is performing:a)a) White-box testingWhite-box testing

b)b) Black-box testingBlack-box testing

c)c) Load testingLoad testing

d)d) Regression testingRegression testing


• Joe is performing a test to see that it Joe is performing a test to see that it complies with the user requirements that complies with the user requirements that a certain field be populated by using a a certain field be populated by using a dropdown box containing a list of values. dropdown box containing a list of values. Joe is performing:Joe is performing:a)a) White-box testingWhite-box testing

b)b) Black-box testingBlack-box testing

c)c) Load testingLoad testing

d)d) Regression testingRegression testing

Documents

Testing Principles and Concepts - Overview