Upload
knowit-oy
View
406
Download
0
Tags:
Embed Size (px)
DESCRIPTION
Janet Gregory's presentation at Knowit's Agile testing challenges -seminar 22.5.2014
Citation preview
Janet Gregory, DragonFire Inc. Copyright 2014
Knowit, Helsinki
2014
Copyright 2014 DragonFire Inc.
First agile team – 2000
Currently – coaching, testing
Agile Testing; January 2009
Working on 2nd book: Fall 2014 2
Copyright 2014 DragonFire Inc.
• Testing and agile
• Challenges and suggestions
• Importance of collaboration
• Wrap-up
3
Copyright 2014 DragonFire Inc.
• have short feedback loops
• active customer participation
• demand whole team collaboration
• test features as they are coded
• deliver business value at regular intervals
• adapt their processes based on feedback
…and so on………….
Agile teams:
produce a continuous stream of value at a sustainable pace, while adapting to the changing needs of the business.
http://testobsessed.com/blog/2010/12/14/the-agile-acid-test/
Copyright 2014 DragonFire Inc.
• more than “just” testing code
• an activity; not a phase
6
Potentially shippable product
Potentially shippable product
Copyright 2014 DragonFire Inc.
1. Testing doesn’t keep up with coding
2. Forgetting the big picture
3. Testers aren’t really part of the team
4. Trying to test everything manually
7
Copyright 2014 DragonFire Inc. 8
Risk: The Mini-Waterfall
10
• Stories aren’t tested completely
• Testers lose credibility
• Technical debt increases
• Team changes meaning of ‘DONE’
Copyright 2014 DragonFire Inc.
• Include testing tasks in the velocity
• Involve whole team in story creation
◦ ensure stories are small and testable
• Get your developers used to immediate feedback
11
Copyright 2014 DragonFire Inc.
• Know your build pipeline
• Provide adequate test infrastructure
12
Copyright 2014 DragonFire Inc.
Instead of saying NO,
or being the gatekeeper
Be the information provider so business can make the decisions
Questions… about not testing stories
13
Copyright 2014 DragonFire Inc.
The red flags
• Testing only individual stories
• Finding integration bugs late
• Testing is based on what developers code
• Testing finds requirements type bugs
• Developers add extra code after they are finished
14
Copyright 2014 DragonFire Inc.
We only see the tip of the Iceberg We don’t think of big systems We only looking at our own team.
The Risks
15
Copyright 2014 DragonFire Inc.
• Think system impacts
• Test data to reflect real world ◦ Examples, exploratory tests
• Draw pictures / workflows
• Understand the story before coding starts
16
Copyright 2014 DragonFire Inc. 17
Copyright 2014 DragonFire Inc.
• Define “Release DONE” ◦ What needs to be in place?
• Define “Feature DONE” ◦ Acceptance tests for bigger picture
• Define “story DONE” ◦ Acceptance tests – expected behaviour,
misbehaviours
18
Understand the business value !
ATDD (Acceptance Test Driven Development)
Copyright 2014 DragonFire Inc.
Instead of saying NO,
or being the gatekeeper
Be the information provider so business can make the decisions
Questions… Remembering the Big Pic?
22
Copyright 2014 DragonFire Inc.
• Testers aren’t in iteration planning sessions
• Testers test what the developers code
• Testers don’t understand the stories
Testers don’t actively participate
23
• Wrong assumptions are made
• Impacts to the system are found too late
• Everyone’s skills are not utilized
• The team becomes divided
• Testers don’t know what is going on
Copyright 2014 DragonFire Inc.
• Communication is through the defect tracking system
• Developers use testers as a safety net
• The team never ‘gels’
25
• Project team doesn’t buy the ‘build quality in’ concept
26
Tips for Tester Involvement
Copyright 2014 DragonFire Inc. Copyright 2009 Janet Gregory, DragonFire 27
The Agile Testing Quadrants (adapted from Brian Marick)
Copyright 2014 DragonFire Inc.
Instead of saying NO,
or being the gatekeeper
Be the information provider so business can make the decisions
Questions about whole team?
28
Copyright 2014 DragonFire Inc.
• Spending time retesting features already tested
• Not testing new features
• Not contributing to implementation / design discussions
29
• Testers miss meetings – too busy
• Regression suite not run regularly
Copyright 2014 DragonFire Inc.
• Testing cannot keep up with new stories
• Features that used to work, are broken and not noticed
• Testers don’t learn new technology
• Testers get stuck in a rut
30
Copyright 2014 DragonFire Inc.
• Automate as you go
• Include automation time in your estimates
• Design for testability
• Chose tools that encourage collaboration
• Understand the power & risks of automation
31
Common automation model
Automation through the
GUI
Unit Tests
push the tests lower
34
“Living
Documentation” David Evans, Gojko Adzic
Copyright 2014 DragonFire Inc. 35
**Automation does not exclude the need for exploratory testing*
Copyright 2014 DragonFire Inc.
Instead of saying NO,
or being the gatekeeper
Be the information provider so business can make the decisions
Questions… Automation?
36
Copyright 2014 DragonFire Inc.
• Can’t “test quality in”
• Whole team thinks testing
• Team is committed to quality
• Whole team solves problems
• Everyone collaborates
37
Copyright 2014 DragonFire Inc.
Agile testing is full of challenges
• Problems happen faster, so impact is felt faster
• Be courageous – be a change agent
• Adapt, Learn
Mostly, have fun and enjoy the
challenge!
38
Copyright 2014 DragonFire Inc.
Agile Testing: A Practical Guide for Testers and Agile Teams
By Lisa Crispin and Janet Gregory www.agiletester.ca
Contact info
www.janetgregory.ca
Email: [email protected]
Twitter: janetgregoryca
39
Copyright 2014 DragonFire Inc.
• www.lisacrispin.com
• www.testobsessed.com (heuristics cheat sheet)
• Gojko Adzic, Specification by Example, 2011, Bridging the Communication Gap, 2009, Impact Mapping 2013
• www.stickyminds.com/ Pragmatic Personas - Jeff Patton’s weekly column 1/25/2010
• www.mountaingoatsoftware.com – Mike Cohn’s web site
• http://www.exampler.com - Brian Marick’s web site
• Ester Derby and Dianne Larsen, Agile Retrospectives
• Agile Manifesto: http://agilemanifesto.org/
• Mary Poppendieck and Tom Poppendieck, Lean Software Development, Addison-Wesley (series of 3)
• Photos – Janet’s vacations or Microsoft office
40