Embed Size (px)
Citation preview
3 W’S BOTHERING MANAGEMENT
WHY, WHAT AND WHEN TO
AUTOMATE?
M C Nagaraj
Director – Customer Excellence
in.linkedin.com/in/mcnagaraj
Copyright STAG Software Private Limited, 2009 2
Six-stage evaluation model (S1-S6)
Hypothesis Based Testing (HBT)A goal focused methodology to validation
Understand
EXPECTATIONS
Understand
CONTEXT
Formulate
HYPOTHESISDevise
PROOF
Tooling
SUPPORT
Assess &
ANALYZE
S1
S2
S3S3
S5
S6
HBT
The central theme of HBT is
“hypothesize potential defects that
can cause loss of expectations
and
prove that they will not exist”
The focus is on the goal and
how we shall achieve it
rather than the various activities
“goal-centric vs. activity-based”
Copyright STAG Software Private Limited, 2009 3
HBT and STEM
Understand
EXPECTATIONS
Understand
CONTEXT
Formulate
HYPOTHESISDevise
PROOF
Tooling
SUPPORT
Assess &
ANALYZE
S1
S2
S3S3
S5
S6
D1
D2
D3
D4D5D6
D7STEM
D8
STEM
HBT
“method”
“methodology”
GOAL
a particular way of doing something
‘defect detection technology
from STAG’
a system of ways of doing
‘goal centered scientific
approach to validation’
‘deliver clean software
quickly & cost-effectively’
“outcome”
• Key focus in each stage
• Empowered by scientific approach using eight disciplines (D1 to D8) of STEM
• 32 core concepts address factors like effectiveness, consistency, scalability, efficiency, visibility and agility of test methodology
• The outcome of each stage are well defined
HBT - six stage personal test methodology
Copyright 2011. STAG Software Pvt Ltd. All rights reserved. 4
Key focus: STEM discipline D5(Tooling)
Problems addressed:• Organization is not sure on which tool they should make investment
• Functional test or non-functional test or both? What to automate?
• We have so many test cases. Where to start focusing on automation?
• We had excellent automation team who did some automation but not working on latest version of product but no band width to look at it
• We have legacy tool used for automation it is not supported by vendor anymore. Can we port it to another tool?
• Open source / commercial tools? Which will fit our automation strategy?
• Can you help us accelerate our automation project?
• Many things automated but product quality is still a concern!
HBT Stage 5 (Tooling)
Copyright 2011. STAG Software Pvt Ltd. All rights reserved. 5
Using D5 (Tooling ) we were able to address problems stated in previous slides
• This discipline has well defined 7 steps for Functionality assessment tooling and 6 steps for NF (LSPS – Load, Stress, Performance and Scalability) assessment tooling
• Key deliverables: Needs and benefits document, Complexity assessment report, Automation architecture, Tool requirements, Automation phasing and scope, Automated scripts
• STEM core concepts: Automation complexity assessment, Minimal baby sitting principle, Clear separation of concerns principle, Tooling needs analysis
Summary
Copyright 2011. STAG Software Pvt Ltd. All rights reserved. 6
Achieve effectiveness first before looking at efficiency. Certain test we cannot execute manually
