Upload
perfecto-mobile
View
254
Download
0
Embed Size (px)
DESCRIPTION
Citation preview
Mobile Testing Center of Excellence GroupPerfectomobile
Effective mobile test automation using
the hybrid approach & live demo
Enabling Enterprise mobility
Extending Software Quality to Mobile
We will be starting momentarily
Webinar Agenda
4
• Q&A
3
• Mobile automation live demo
2
• Mobile testing challenges
• Native and Visual Objects explained
1
• Intro
∙ Founded 2006
∙ 80+ employees
∙ Office in Boston, London, Israel
∙ Over 600 customers
∙ Fortune 500 enterprises, Telcos, SMBs
∙ SaaS Platform + Licenses
∙ Recurring revenue model
Mobile Application Qualityacross the mobile application lifecycle
MonitoringMonitoring TestingTesting AutomationAutomation
ALM Integration
ALM Integration
OffshoringOffshoringContinuous IntegrationContinuous Integration
Public Cloud Private Cloud
Solution - The MobileCloud™ Platform
SEND SMS NOW to…
First wins Appnificent Air X Racer!
SEND SMS NOW to…1–781-572-7808
First wins Appnificent Air X Racer!
Mobile testing
challenges
Extremely Dynamic & Fragmented Market
Jelly Bean
Jun 2012
ICS
Oct 2011
Honeycomb
Feb 2011
Gingerbread
Dec 2010
Froyo
May 2010
Eclair
Oct 2009Donut
Sep 2009
Cupcake
Apr 2009
iOS 6
Sep 2012
iOS 6
Sep 2012
iOS 5.1
Mar 2012
iOS 5.1
Mar 2012
iOS 5.0
Oct 2011
iOS 5.0
Oct 2011
iOS 4.3
Mar 2011
iOS 4.3
Mar 2011
iOS 4.2
Nov 2010
iOS 4.1
Sep 2010
iOS 4.1
Sep 2010
iOS 4.0
Jun 2010
iOS 4.0
Jun 2010iOS 3.2
Apr 2010
iOS 3.2
Apr 2010
iOS 3.1
Sep 2009
iOS 3.1
Sep 2009
iOS 3.0
Jun 2009
iOS 3.0
Jun 2009
20132012201120102009
Windows 8
Oct 2012
Windows 7
Oct 2009
Mobile web – Browser fragmentation
Difficult to test
Hard to automate dynamic complex environments and apps
Difficult to determine the devices to test on
Need to meet AGILE time frames
Decide when to stop testing (What is the adequate coverage criteria)
Manual testing is imperative as well
Meet external dependencies
OS UI guidelines
Devices availability
Mobile environment - Continue
Mobile Quality
IS a serious
Challenge…
Poll
What is the most complex
aspect around mobile test
automation
Native Objects and
Visual Objects
Objects are the ‘building blocks’ of an application
Buttons, Edit boxes, Lists etc.
Developing mobile automation requires access and robust object recognition
All use cases and test scenario's leverage the application objects (Pressing buttons,
selecting from lists, entering text into textbox’s etc.)
In mobile it is important to use OS Object level analysis
Web objects are critical for web based mobile applications (DOM)
Objects Introduction
Represents the available UI controls
Returns the texts of the current application
Complete control text is returned, including partially displayed text located outside
Supports all languages - information about the text language is not required
Text compare is completed with a simple string compare. Provides 100% accuracy that is
sensitive to small characters, such as punctuation marks
Match grade is either 0% or 100%
Control region and text are known, but not the order or the exact structure on the screen
Native control text retrieval is fast!
Performs the operation on the found control
Object Level Analysis – Pro’s/Con’s
In this example, the retrieved text is "name123"
Represents the actual real user experience (WYSIWYG)
Detects visual problems such as button heights, incomplete text, overwrite elements, etc…
Best when used to analyze images or complex applications (Games)
Indifferent to the device OS, Supports all languages
Returns the texts that appear on the screen:
Includes everything
Control text that is too long to display in the control region on the screen is partially displayed
followed by ‘…’
Visual analysis is more time consuming than native control analysis
Performs the operation on the found region
Link to a useful white paper on mobile objects can be found here:
http://help.perfectomobile.com/article/AA-01248/
Visual Objects (OCR) Pro’s/Con’s
In this example, the retrieved text is "name123 x"
Examples of OCR vs. Object Level analysis
In the above image, Object level
analysis won’t detect the Logon
button issue on the HTC device,
OCR will
In the above image, Object level
analysis won’t detect the
Truncated ‘Time’ label, OCR will
Live Demo
Sveta Kostinsky
Questions &
Answers
If you have any further questions,
please contact:
Perfecto [email protected]
Thank You!
Join us on LinkedIn
Mobile Testing Center of Excellence