Persona Testing - Deep Dive

Wind Tunnel

2

Agenda

• Digital Challenges• Overview of Wind Tunnel• Personas

• What is a Persona?• Existing and Custom Personas

• Adding Wind Tunnel capabilities to your test• Persona• Points of Interest• Rotation

• Sample Test using Wind Tunnel• Eclipse/Java/Selenium• BB&T U app and Perfecto sample website• Viewing results

© 2016, Perfecto Mobile Ltd. All Rights Reserved.

3

Digital Reality Challenges

Digital Reality Challenges

Users are expecting apps to work in the mobile moment

(regardless of conditions)

Failure to satisfy is costly


4

Mobile Experience Quality Challenge

The Mobile ExperienceQuality Challenge

1) Building common user environment condition profiles into test suites

2) Assembling multiple solutions to execute tests across profiles

3) Seamlessly integrating user condition testing within Continuous integration pipelines

4) Analyzing app performance blind spots

5) How to set up a lab and these various conditions?


5

Example of Changes – In Person vs. Online


6

User Centric Quality Lab with End User Conditions

Using a Banking/Financial App

1 2

Network QualityCellular, Wi-Fi

3

Varied Device Conditions

4

Multiple devicesSpecific profiles

5

Location

6

Resource Conflicts

7

Interacting with sensorsPeak time -

Millions of transactions

8

Simple Functional Testing Is Not Enough© 2016, Perfecto Mobile Ltd. All Rights Reserved.

7

Overview of Perfecto Wind Tunnel

Wind Tunnel

Profile Selector

Usage Patterns1. Login2. Search3. Select4. Payment5. Logout

Unchanged Test FlowsExample: User Journey

on Banking/Financial App

Existing Flows

Analyze & Optimize

• Lives in NY• iPhone 6S • Verizon Customer• Constant WhatsApp msg

Georgia

12

3 4

PersonaPoints of Interest

Wind Tunnel Testing

Wind Tunnel Report


8

The Personas

• The Perfecto Wind Tunnel personas define the test environment

• A Persona is defined by a set of capabilities• There are 5 available pre-defined personas• Personas can be created and edited

• Georgia• 47 year old high income, corporate road warrior living in Manhattan

traveling to San Fran & London• Traits

• Network: Constantly connected, frequent network switches across various WiFi and cellular networks

• Brands of choice: Apple & Verizon• Device(s): iPhone 6S, Smartwatch & iPad Pro• App loyalty: Intense social user, WhatsApp, Mobile Banking and PO &

Expense Report approvals

Location

Carrier & Brands

Device coverage Background

apps


5 Pre-Defined Personas

9© 2016, Perfecto Mobile Ltd. All Rights Reserved.

Wind Tunnel – Languages & Frameworks


11

Using & Tailoring Personas

• Set a persona using the windTunnelPersona capability

• Tailor an existing persona by defining new capabilities

capabilities.setCapability("windTunnelPersona", "Georgia");

capabilities.setCapability("windTunnelPersona", "Georgia");//Add location either by an address or lat,long coordinatescapabilities.setCapability("windTunnelLocation", "New York City,NY");//Set orientation to landscape and portraitcapabilities.setCapability("windTunnelOrientation", "portrait");//list the apps running in the backgroundcapabilities.setCapability("windTunnelBackgroundRunningApps", "Candy Crush Saga");


12

Persona JSON file

• Example persona JSON file{ "settings":{ "windTunnelLocationAddress":"New York, NY", "windTunnelBackgroundRunningApps":"United,Twitter,Outlook,Marriott,BofA", "windTunnelVNetwork":"4G LTE Poor", "windTunnelOrientation":"landscape" }, "properties":{ "description":"Corporate Road Warrior, Age 47", "name":"Georgia", "image":"PUBLIC:Personas/Georgia.png"}, "device":{ "model":"iPhone-6S||iPad Mini 4" }}


Rotation Snippet


Map<String, Object> params = new HashMap<>();params.put("state", "landscape");params.put("method", "device");driver.executeScript("mobile:device:rotate", params);

14

Points of Interest

•The focus points that are part of your Wind Tunnel execution and reports•The app issues that are being tested in real user

conditionsExamples:• Purchase transaction that takes too long• CPU consumption of the running Facebook app


15

Adding Points of Interest to the test

•Java Example• Following code adds a Point of Interest that will add

an indication of a successful page load.•Will be selectable in the wind tunnel report

...// Wind Tunnel: Add success point of interest to the Wind Tunnel reportWindTunnelUtils.pointOfInterest(driver, "Point Of Interest 1: Page load","Success");


16

Single Test Report

The Single Test Report timeline includes:

• Points of interest• Wind Tunnel events• Checkpoints

(validation)


17

Example Script

• Create a new Perfecto Lab Project in Eclipse• Add sample java code to your project• Run the test• Review the run results• The Perfecto report ("C:\test\report.pdf") contains a link to the new

Wind Tunnel report


Demo

19

References

• Complete Wind Tunnel Guidehttps://community.perfectomobile.com/series/24692 • Defining Capabilities

https://community.perfectomobile.com/series/20208/posts/945255 • Network Conditions https://community.perfectomobile.com/posts/1110522 • Sample Script https://community.perfectomobile.com/series/25427/posts/1114150


https://community.perfectomobile.com/series/24692

https://community.perfectomobile.com/series/20208/posts/945255

https://community.perfectomobile.com/posts/1110522

https://community.perfectomobile.com/series/25427/posts/1114150

20

Next Steps…Get Certified!

Become a Perfecto Specialist in Selenium RemoteWebDriver and Appium!

HOW?• Log into www.perfectomobileacademy.com and register.• Click on Self-Paced eLearning and select the Selenium

RemoteWebDriver and Appium course.• Take the FINAL EXAM for Specialist Certification in Selenium RWD

and Appium (SRA)

Good Luck!© 2016, Perfecto Mobile Ltd. All Rights Reserved.

http://www.perfectomobileacademy.com/

Thank You

Technology

Persona Testing - Deep Dive