Upload
others
View
1
Download
0
Embed Size (px)
Citation preview
phone: (408) 727-1101 | website: www.QMetry.com | email: [email protected]
©2008-2012 InfoStretch Corporation. All rights reserved.
Managing Coverage in an Agile World
phone: (408) 727-1101 | website: www.QMetry.com | email: [email protected]
©2008-2012 InfoStretch Corporation. All rights reserved.
QMetry Customer Profile
QMetry Helps
Small Companies: Transition from Excel to a test management solution
Mid-Sized Companies: Integrate test efforts, Reduce Costs
Large Companies: Replace Legacy systems
Target Audience: QA Managers Testers Developers Automation leads QA directors
phone: (408) 727-1101 | website: www.QMetry.com | email: [email protected]
©2008-2012 InfoStretch Corporation. All rights reserved.
Our User Story
• Challenge – Shorter time frame to respond – Need to resolve issues quickly
• Solution – Moved from Mantis to JIRA and integrated our
systems
• Results – Increased Visibility, Collaboration and Flexibility
phone: (408) 727-1101 | website: www.QMetry.com | email: [email protected]
©2008-2012 InfoStretch Corporation. All rights reserved.
What is Agile?
The Agile Manifesto: “We are uncovering better ways of developing software by doing it and helping others do it. Through this work we have come to value:
• Individuals and interactions over processes and tools • Working software over comprehensive documentation • Customer collaboration over contract negotiation • Responding to change over following a plan
That is, while there is value in the items on the right, we value the items on the left more.”
phone: (408) 727-1101 | website: www.QMetry.com | email: [email protected]
©2008-2012 InfoStretch Corporation. All rights reserved.
Our Agile Goals
• Improve communication between departments
• Improve communication with customers • Be more responsive to changing demands • Improve software stability and compatibility – Improve Coverage – Automate regression
phone: (408) 727-1101 | website: www.QMetry.com | email: [email protected]
©2008-2012 InfoStretch Corporation. All rights reserved.
What is Coverage?
• Functional testing of the User Stories • Regression testing of Core Functionality • Platform / Configuration testing
(Hardware configurations, software settings, Browsers, Mobile platforms, etc.) “In the increasingly splintered world of the cloud and mobile the need to perform platform coverage grows.”
phone: (408) 727-1101 | website: www.QMetry.com | email: [email protected]
©2008-2012 InfoStretch Corporation. All rights reserved.
Managing Coverage
• The Holy Grail is Complete traceability – Verify Functional testing of the User Stories
• Internal Bug Fixes vs. Customer based Bug Fixes
– Verify functionality against Platforms – Verify stability – Reporting results
phone: (408) 727-1101 | website: www.QMetry.com | email: [email protected]
©2008-2012 InfoStretch Corporation. All rights reserved.
How we Use JIRA for Agile • Log and define all Issues – Bugs
• Customer related bugs are created by Zendesk
– Improvements – New Features
• Sub-tasks to create “epics” • Link “guidelines” (custom issue type) that define general
standards (mostly UI). • Link related bugs
phone: (408) 727-1101 | website: www.QMetry.com | email: [email protected]
©2008-2012 InfoStretch Corporation. All rights reserved.
How we Use JIRA for Agile (2) • Converting Issues to Requirements – Using comments in JIRA we define issue
• When issue defined we update description
– Add “Affected Version/s” to define Release – Added new “Planned Sprint” field to define Sprint
• Import Requirements to QMetry – Queries are setup based on Planned Sprint – One to one mapping
phone: (408) 727-1101 | website: www.QMetry.com | email: [email protected]
©2008-2012 InfoStretch Corporation. All rights reserved.
What Does QMetry Add?
• Test Cases • Test Suites • Platforms • Test Results and Reports • Easy way to log new issues against
Requirements
• How is all of this extra documentation / process Agile???
phone: (408) 727-1101 | website: www.QMetry.com | email: [email protected]
©2008-2012 InfoStretch Corporation. All rights reserved.
Recycle and Reuse • Test Cases
– Created directly from Requirements • Most have Steps to Reproduce • Ad hoc
• Test Suites – Regressions are easily imported from past sprints. – Functional Test Suites help organize testing
• Platforms – Simple to identify and add to Test Suites – Create once and re-use.
• Test Results and Reports – Automatically generated and updated – Integrated Manual & Automated
• New Defects can be traced back to the original requirement / issue.
phone: (408) 727-1101 | website: www.QMetry.com | email: [email protected]
©2008-2012 InfoStretch Corporation. All rights reserved.
ASAP and Continuous Testing
• As Soon as Programmed Testing and Tracking – Verify features early to allow you to close issues
quickly. – Identify when a feature was verified resolved – Identify regressions early
• Continuous Testing – For every sprints there are often many builds – Fixes between sprints should be tested – Progress through the sprint cycle should be
tracked
phone: (408) 727-1101 | website: www.QMetry.com | email: [email protected]
©2008-2012 InfoStretch Corporation. All rights reserved.
Regression Testing
• The Reason and Purpose of Regression Testing – To test for the unexpected
bugs bugs bugs
• Regression can be boring, automate it whenever possible – Manual tests can easily be linked with future
automated tests.
Hey Morgan. Can I get some bug images here??? J Thanks!