Embed Size (px)
Citation preview
© 2014 IBM Corporation
Streamlining QA process for Mobile Apps: Strategies and Technologies
Continuously deliver high quality mobile appAlan [email protected]@alankannet
© 2014 IBM Corporation2 #IBMMobile
Mobile?
© 2014 IBM Corporation3 #IBMMobile
Mobile?
Challenges to assure quality?
© 2014 IBM Corporation4 #IBMMobile
So many combinations, so little time
© 2014 IBM Corporation5 #IBMMobile
Slow manual process to log a defect for an app
© 2014 IBM Corporation6 #IBMMobile
Integrations not available delays testing
Web Services integration
Mainframe integration
3rd party integration
Database integration
Front-end app
© 2014 IBM Corporation7 #IBMMobile
Performance testing sometimes skipped
© 2014 IBM Corporation8 #IBMMobile
Do not receive end users feedback in time (or at all)
© 2014 IBM Corporation9 #IBMMobile
Some common ways of mobile apps QA leading to these issues
Manual testing of mobile appsSeparate automation tools for testing different
OS/configurationsUse a PC based defect trackerWhen integration not available, delay test, or write stubs
manuallyNo perf test tool or no reuseDifficult for users to submit feedback or feedback is not
monitored/analysed
© 2014 IBM Corporation10 #IBMMobile
Strategies and Technologies
© 2014 IBM Corporation11 #IBMMobile
Mobile Test Automation across Platforms
Mobile Test Automation Capture and Playback including multi-touch events Object recognition Visual Test Editing
Cross platform• Web tests run across mobile devices and desktop• Support native and hybrid apps on Android and iOS
Mobile performance: Reuse functional tests for performance testing Monitor device resource utilisation counters for Android and iOS Capture response time measurements for Android applications
End to end mobile testing Testing of middle-tier and back-end services Performance testing of integration infrastructure
© 2014 IBM Corporation12 #IBMMobile
IBM Rational Test Workbench
Recording
Playback
Authoring
Reporting
© 2014 IBM Corporation13 #IBMMobile
Deliver feedback from test to development
Testers send bug reports from “in app”Apps report their own crashes, and send logsDevelopers diagnose and fix context rich bugs / crashesOwners prioritize and direct resolution of bugs / crashes
Dev
Owner
User
Test
Cra
shes
Bug
re
port
s
Log
ging
Enables testers to submit bug reports directly from their phone
In-app bug reporting
© 2014 IBM Corporation14 #IBMMobile
Build user feedback into the app and analyse feedback quickly
Deliver feedback from users to development
Users send feedback “in app”Apps report their own crashes, and send logsOwners assess feedback and direct developmentDevelopers diagnose and fix crashes
Dev
Owner
User
Test
CrashesFeedback reports
Logging
Enables developers to connect with users
© 2014 IBM Corporation15 #IBMMobile
Tester End UsersDeveloper
Over the air build distribution 1 In app bug reporting 2
Crash log reporting
4
In app user feedback 3
LOB/Digital Marketer
User Sentiment5
Builds
User Feedback Crash logs
BugsBugs vs. Crashes
IBM MobileFirst Quality Assurance
© 2014 IBM Corporation16 #IBMMobile
Simulate the mobile middle tier and back office systems
Reuse integration tests to verify scalability of middleware and services infrastructure
Virtualise app services to enable continuous testing and reduce application integration risk
Test mobile and non-mobile components of your infrastructure using same intuitive environment
Continuous testing through Service VirtualizationIBM Rational Test Virtualization Server
Client Tier
Middle TierBackend Data and Services
Virtual component or service
© 2014 IBM Corporation17 #IBMMobile
Alan [email protected]
@alankannet
Streamline mobile app QA process with• Cross Platform mobile test automation
• In-app bug reporting and sentiment analysis
• Service virtualisation
