Software testing basic concepts

  • Published on
    29-Nov-2014

  • View
    52

  • Download
    0

Embed Size (px)

DESCRIPTION

its valuable slide presentation for softewere testing

Transcript

<ul><li> 1. Copyright 2006 FPT Software 1 FPT SOFTWARE TRAINING MATERIAL Internal use 04e-BM/NS/HDCV/FSOFT v2/2 Software TestingSoftware Testing Basic ConceptsBasic Concepts Instructor: Dang Tu LinhInstructor: Dang Tu Linh </li> <li> 2. Copyright 2006 FPT Software 2 FPT SOFTWARE TRAINING MATERIAL Internal use 04e-BM/NS/HDCV/FSOFT v2/2 AgendaAgenda Duration: 1.5 Hours Purpose: Understand basic Test concepts Audience: All Members Content: 1. Introduction 2. Defect concepts 3. Test process 4. Test plan &amp; test design 5. Testing strategy </li> <li> 3. Copyright 2006 FPT Software 3 FPT SOFTWARE TRAINING MATERIAL Internal use 04e-BM/NS/HDCV/FSOFT v2/2 IntroductionIntroduction Objectives: To arrive at a common understanding of the scope of testing activity To familiarize the audience with the terminology used in the testing work Understand the required test skills of developers </li> <li> 4. Copyright 2006 FPT Software 4 FPT SOFTWARE TRAINING MATERIAL Internal use 04e-BM/NS/HDCV/FSOFT v2/2 Typical Project BluesTypical Project Blues </li> <li> 5. Copyright 2006 FPT Software 5 FPT SOFTWARE TRAINING MATERIAL Internal use 04e-BM/NS/HDCV/FSOFT v2/2 Testing definitionTesting definition Testing is the process of exercising or evaluating a system or system component by manual or automated means to verify that it satisfies specified requirements - (IEEE 83a) Process: Sequence of steps performed for a given purpose. (IEEE) Software Process A set of activities, methods, practices, and transformations that people use to develop and maintain software and associated products.(SEI-CMM) </li> <li> 6. Copyright 2006 FPT Software 6 FPT SOFTWARE TRAINING MATERIAL Internal use 04e-BM/NS/HDCV/FSOFT v2/2 Testing ObjectivesTesting Objectives Primary: Execute a program with the intent of finding errors to Determine whether system meets specifications Determine whether system meets users needs Secondary Continuously improve the testing process </li> <li> 7. Copyright 2006 FPT Software 7 FPT SOFTWARE TRAINING MATERIAL Internal use 04e-BM/NS/HDCV/FSOFT v2/2 MisunderstandingsMisunderstandings about testingabout testing Testing is debugging Testing is not the job of a programmer If programmers were more careful testing would be unnecessary Testing never ends Testing activities start only after the coding is complete Testing is not a creative task </li> <li> 8. Copyright 2006 FPT Software 8 FPT SOFTWARE TRAINING MATERIAL Internal use 04e-BM/NS/HDCV/FSOFT v2/2 Theory &amp; RealityTheory &amp; Reality Theory Need sufficient time Baselined &amp; freezed requirements Automation testing Have trained testers: test process, business flow, Reality Time Pressures to keep delivery date Continuously updated requirements Dont know when to stop: Update &amp; update Requirement continuously (CRs) Tester updates TC and re-tests Manual testing Lack of dedicated software test environment: share, steal Inexperienced testers without appropriate training </li> <li> 9. Copyright 2006 FPT Software 9 FPT SOFTWARE TRAINING MATERIAL Internal use 04e-BM/NS/HDCV/FSOFT v2/2 Defect conceptsDefect concepts Objectives: Understand the definition of defect Understand the cost of a bug to software development Understand the common types of defects and their perceived severity What is defect?What is defect? A defect is any error found by testing and reviewing activities (All errors found by internal reviewer, external reviewer and customer). </li> <li> 10. Copyright 2006 FPT Software 10 FPT SOFTWARE TRAINING MATERIAL Internal use 04e-BM/NS/HDCV/FSOFT v2/2 Where defects come from?Where defects come from? Products SRS, DD, Source code, Test cases, etc. Quality Control Review, Test, Audit, Inspection Processes Requirements, Design, Coding, Test, etc. Other sources: Change requests, misunderstanding, carelessness, planning, etc. </li> <li> 11. Copyright 2006 FPT Software 11 FPT SOFTWARE TRAINING MATERIAL Internal use 04e-BM/NS/HDCV/FSOFT v2/2 Cost of defectsCost of defects </li> <li> 12. Copyright 2006 FPT Software 12 FPT SOFTWARE TRAINING MATERIAL Internal use 04e-BM/NS/HDCV/FSOFT v2/2 Defect still exists in the product, change status to ERROR FSoft Defect lifecycleFSoft Defect lifecycle Defect classification: Open defects Closed defects Leakage Log defects Analyze defects Fix defects Re-test Step 1 Step 2 Step 3 Step 4 What: To log defect into DMS with clear information: project, module, stage, QC activity, severity, type, due date, tester, created date ... Who: Tester Defects status: ERROR What: -To analyze the causes of the defect, find- out solution and assign to person who is responsible for correcting it. - To accept the defect if its acceptable (by concession of authority or customer). Who: Project Leader Defects status: ASSIGNED / ACCEPTED What: To correct the defect and perform unit testing to make sure the defect has been removed. Who: Developer Defects status: CORRECTED What: To retest the function(s) containing the defect and make sure that the defect has been corrected completely Who: Tester Defects status: CLOSED </li> <li> 13. Copyright 2006 FPT Software 13 FPT SOFTWARE TRAINING MATERIAL Internal use 04e-BM/NS/HDCV/FSOFT v2/2 Defect status: Error Assigned Corrected Cancelled Accepted: by PM/PTL/Customer Closed: by tester/PM/PTL Leakage Defects: Acceptance test After Release test After Release review Fsoft Defect classificationFsoft Defect classification </li> <li> 14. Copyright 2006 FPT Software 14 FPT SOFTWARE TRAINING MATERIAL Internal use 04e-BM/NS/HDCV/FSOFT v2/2 Fsoft Defect classificationFsoft Defect classification Defect type Functionality o Requirement misunderstanding o Feature missing o Coding logic o Business logic User Interface Performance Design issue Coding standard Severity: How bad the problem is (some time disagreement btw. Dev &amp; Tester) Fatal: the system is broken Serious: can not work around Medium: impact the function Cosmetic: not impact the function </li> <li> 15. Copyright 2006 FPT Software 15 FPT SOFTWARE TRAINING MATERIAL Internal use 04e-BM/NS/HDCV/FSOFT v2/2 Fsoft Defect classificationFsoft Defect classification Defect origin Requirement Design Coding Test CM Document control Priority Immediately High priority Normal priority Low priority Work product Software module Software Package ADD DDD Test Cases (UT/IT/ST) Quality control activity Code review Unit test Integration test System test Document review Inspection Audit </li> <li> 16. Copyright 2006 FPT Software 16 FPT SOFTWARE TRAINING MATERIAL Internal use 04e-BM/NS/HDCV/FSOFT v2/2 Test ProcessTest Process Objectives: Understand the steps followed for a test process Understand test planning process FSoft Test Process </li> <li> 17. Copyright 2006 FPT Software 17 FPT SOFTWARE TRAINING MATERIAL Internal use 04e-BM/NS/HDCV/FSOFT v2/2 Tester CompetencyTester Competency Soft skills (non-technical attributes) Discipline and Perseverance Testing is repetitive and requests a lot of manual effort Have the ability to withstand pressures and workload Say no to managers when quality is insufficient Reading skills: study many docs of specs, design Communication &amp; Interpreter skills Both Verbal and Written communication Diplomatic skill Be able to communicate with technical and non-technical people, engineers, managers, customers Negative thinking: foresee things that can go wrong, evaluate risks Attitude: test to break attitude Time management and Effort prioritization </li> <li> 18. Copyright 2006 FPT Software 18 FPT SOFTWARE TRAINING MATERIAL Internal use 04e-BM/NS/HDCV/FSOFT v2/2 Tester CompetencyTester Competency Technical skills Familiarity with software development architectures, processes Familiarity with testing methodologies Very clearly articulate specs, designs, business rules, inspection reports, configurations, code changes, TP, TC, bug reports, user manuals, Know how and where to look for bugs Know how to report the defects effectively for quickly reproduce </li> <li> 19. Copyright 2006 FPT Software 19 FPT SOFTWARE TRAINING MATERIAL Internal use 04e-BM/NS/HDCV/FSOFT v2/2 The Test ProcessThe Test Process Data Analysis - Analyze root Causes of defects - Identify actions Test Execution Perform testing Bug Reporting - Bug Fixing - TC Updating Bug Tracking (Re-test) Test Report Test Preparation SRS study Create Test Design Review &amp; Approval - Develop test cases, test scripts - Prepare test data Test Planning Create Test Plan (by Test leader) Definition Solution Construction Transition Termination Initiation Project life cycle Test process </li> <li> 20. Copyright 2006 FPT Software 20 FPT SOFTWARE TRAINING MATERIAL Internal use 04e-BM/NS/HDCV/FSOFT v2/2 Input/Output for testingInput/Output for testing Input: Customer requirements and Acceptance criteria Change requests Software Requirement Specification (SRS) Design documents (ADD, DDD) Programs (Modules) Output: Test documents: Test plan, Test cases and procedures, Test script, Test data Defect list Test report (Pass/Fail of each TC, Summary report) </li> <li> 21. Copyright 2006 FPT Software 21 FPT SOFTWARE TRAINING MATERIAL Internal use 04e-BM/NS/HDCV/FSOFT v2/2 FSoft Test resourcesFSoft Test resources Guideline: Test process &amp; Test guideline Templates for test documents Test Plan Test case specification Test report Defect analysis report FSOFT tools Defect tracking tool: DMS Test Effort tracking tool: Timesheet Test schedule: FSoft Insight Test automation tools Rational Robot (Functional &amp; Performance test) OpenSTA (Open source) Witir (Open source) FATA: Test Council </li> <li> 22. Copyright 2006 FPT Software 22 FPT SOFTWARE TRAINING MATERIAL Internal use 04e-BM/NS/HDCV/FSOFT v2/2 Test strategyTest strategy Objectives Understand Unit Testing concept Understand Integration Testing concept Understand System Testing concept Understand Acceptance Testing concept Overview of Test types </li> <li> 23. Copyright 2006 FPT Software 23 FPT SOFTWARE TRAINING MATERIAL Internal use 04e-BM/NS/HDCV/FSOFT v2/2 V-ModelV-Model </li> <li> 24. Copyright 2006 FPT Software 24 FPT SOFTWARE TRAINING MATERIAL Internal use 04e-BM/NS/HDCV/FSOFT v2/2 Testing stagesTesting stages There are 4 stages of Testing: Unit Test Integration Test System Test Acceptance Test </li> <li> 25. Copyright 2006 FPT Software 25 FPT SOFTWARE TRAINING MATERIAL Internal use 04e-BM/NS/HDCV/FSOFT v2/2 Unit TestUnit Test Purpose: to verify that the component/module functions properly Check: internal data structures Logic boundary conditions for input/output data Normally: White box oriented Doer: Development team Metrics: Test coverage: Statement Branch Path Condition </li> <li> 26. Copyright 2006 FPT Software 26 FPT SOFTWARE TRAINING MATERIAL Internal use 04e-BM/NS/HDCV/FSOFT v2/2 Integration TestIntegration Test Purpose: To ensure that code is implemented and designed properly to take unit tested modules and build a program structure that has been dictated by design IT only after UT Combining the individual components to uncover errors associated with interfacing Normally: Black box oriented Doer: independent Test team </li> <li> 27. Copyright 2006 FPT Software 27 FPT SOFTWARE TRAINING MATERIAL Internal use 04e-BM/NS/HDCV/FSOFT v2/2 System TestSystem Test Purpose: To ensure that the system does what the requirement specifies Types Function Testing Performance Testing Installation Testing N...</li></ul>