Mobile Test Automation - 10 Questions to Ask when Picking The Right Tool

Next Gen Testing Conference Singapore

Mobile Test Automation :Questionsto Ask when

Picking the Right Tool

Brynley Scully, Head of Testing, Singapore

Rupesh More, Test Lead

Hewlett-Packard

Oct-2014

www.unicomlearning.com

10

2

Mobile Test Automation

Growth in Mobility

4

Growth in Mobility

5

Mobile Devices in our Daily Life

PCs dominate working hours

Tabletsrule the home

Smartphonesbridge the gaps

Tablets

Smartphones

PCs

6

Growth in Mobility2014 total smartphone subscribers

1,064 million

394 million

213 million

US Europe Asia Pacific

Source: Forrester. “The State of Digital Business in Asia Pacific in 2014”, dated August 2014.

The Need for Mobility Testing

8

Mobility App Testing Coverage

9

Why Automate Mobile Testing?

SpeedFaster Regression test cycles

Unattended test execution

ScopeRepeated execution of test cases across devices, OS, network, browsers

Many checkpoints and validation points in test steps

RiskReduced risk of human errors in test execution

Mobile Test Automation10 Questions to Ask whenPicking The Right Tool

11

Picking the Right ToolChoices, choices, choices

Mobile Automation Tool

?

12

1. Software License Type & Costs ?

Open Source vs Commercial

Seat vs Concurrent

Single vs Multiple Platform

Term vs Annual

AddOn Costs

13

2. Compatible with Automation Scripting Tools ?

Mobile Automation Tool

HP UFT

HP UFT

14

3. Test on Real Devices and/or Emulators ?

Mobile Automation Tool

Real Device

Emulator

15

4. Test on Single or Multiple Mobile Platforms ?

Mobile Automation Tool

16

5. Type of Mobile Application ?

Mobile Automation Tool

Native

Web / HTML5

Hybrid

17

6. Type of Connectivity to Real Devices ?

Mobile Automation Tool

Cloud

WIFI

USB

18

7. Need Additional Hardware and/or Software ?

Mobile Automation Tool

Cloud

WIFI

USB

iOS

emulator

Android emulator

No additional hardware

No additional hardware

USB cables

Mac machine

Windows PC

19

7. Need Additional Hardware and/or Software ?

Mobile Automation Tool

Additional Software

Instrument the App

Why ?

How ?

− By developer

− Self instrument

− SDK needed

− Mac needed for IOS devices

− PC needed for Android devices

20

7. Need Additional Hardware and/or Software ?

Mobile Automation Tool

Additional Software

Instrument the App

Why ?

How ?

− By developer

− Self instrument

− SDK needed

− Mac needed for IOS devices

− PC needed for Android devices

21

7. Need Additional Hardware and/or Software ?

Mobile Automation Tool

Need to install agent software on devices or emulators?

22

8. Object Recognition Methods ?

Mobile Automation Tool

OCR – based on text displayed in application.

Object ID Recognition – based on object properties. Unique ID used to locate and tag the object.

23

9. Same Script on Multiple Platforms ?

Mobile Automation Tool

Same Script

No editing

Runs on multiple platforms

24

10. Results with Screenshots and/or Videos ?

Mobile Automation Tool

Screen shots

Videos

25

10 Questions To Ask when Picking the Right Tool

1. Software License Type & Costs ?

2. Compatible with Automation Scripting Tools ?

3. Test on Real Devices and/or Emulators ?

4. Test on Single or Multiple Mobile Platforms ?

5. Type of Connectivity to Real Devices ?

6. Type of Mobile Application ?

7. Need Additional Hardware and/or Software ?

8. Object Recognition Methods ?

9. Same Script on Multiple Platforms ?

10. Results with Screenshots and/or Videos ?

26

Harness Benefits from the Tool

1. Do not use Record-and-Playback

2. Use Advanced Frameworks ; Insert many checkpoints

3. Script for compatibility across multiple platforms

4. Repeat execution runs across different devices, browsers, OS versions

5. Complement automation testing with manual testing and emulator testing

27

Select your Testing Service Vendor

1 Where to Test? Onshore / Offshore

2 Testers Experience Mobile test tools; mobile testing projects; relevant industry

3 Testing Commercial Models Staff Augmentation, Managed Service, Testing-as-a-Service

4 Mobile Test Strategy Manual testing, automated testing, performance & load testing, network testing, security testing, emulator testing

Demo

29

Demo : Overview

Mobile Test Automation Tool

HP UFT HP UFT Mobile Airline Ticket Booking Mobile App

Devices on Cloud

Screenshots

Videos

30

Demo : Addressing the 10 Questions

1. Software License Type & Costs ? Annual, Concurrent, Multiple Platforms

2. Compatibility with Automation Scripting Tools ? Yes. HP-UFT, HP-ALM

3. Test on Real Devices and/or Emulators ? Yes. Testing on Real device.

4. Test on Single or Multiple Mobile Platforms ? Yes. iOS, Android, Windows

5. Type of Mobile Application Supported? All. Native, Hybrid & Web

6. Type of Connectivity to Real Devices ? Cloud, USB, WIFI

7. Need Additional Hardware and/or Software ? No

8. Object Recognition Methods ? OCR, Object ID

9. Same script on multiple platforms ? Yes

10. Results with screenshots and/or videos ? Screenshots and Videos

Next Gen Testing Conference Singapore

Mobile Test Automation :Questionsto Ask when

Picking the Right Tool

Brynley Scully, Head of Testing, Singapore

Rupesh More, Test Lead

Hewlett-Packard

Oct-2014

www.unicomlearning.com

10