A Data-Driven Approach to Testing the Right Devices, Platforms, and User Conditions

A Data-Driven Approach to Testing the Right Devices, Platforms & User Conditions

Today’s Speakers

Eran KinsbrunerMobile Technical EvangelistPerfecto

Amir GhodratiSr. Manager of Marketing InsightsApp Annie

Agenda

05/03/2023 3© 2015, Perfecto Mobile Ltd. All Rights Reserved.

01 Digital Test Coverage Overview

02

Introduction to Real User Condition Testing03

New Index Edition Insights

04 App Annie Coverage Perspective

05 Q & A

Introduction to User Condition TestingBringing the End User Into The Test Lab

Using a retail App

1 2

Network QualityCellular, Wi-Fi

3

Varied Device Conditions

4

Multiple devicesSpecific profiles

5

Location

6

Resource Conflicts

7

Interacting with sensorsPeak time -

Millions of transactions

8

Simple Functional Testing Is Not Enough05/03/2023 © 2015,Perfecto Mobile Ltd. All Rights Reserved. 4

The Test Coverage Conversation – What To Answer?

Which Devices & Browsers? Which OS Versions? How Many platforms are enough? Under what user condition to test my app? When should I refresh my test lab? Who is in charge of coverage? How to size my lab across projects and teams?


Mobile Test Coverage Method

Mobile Device Coverage - Attributes• Device and OS popularity (market share/usage)• Screen sizes, resolution and other screen attributes such as pixel per inch (PPI)• Device age (launch date)• Quality related issues (e.g. Android 5.1.1/Samsung S6)• New and trending devices and platforms• Operating system version update rate (e.g. reference devices like Android Nexus get a

higher score)• Unique device properties important for testing purposes – chipset, CPU, memory• Audience demographics


Reference Devices/OS

Popular Devices/OS

Legacy Devices/OS

Emerging Devices/OS

What’s new?• App Annie App Usage• India Index Coverage

Digital Test Coverage Index 5th Edition

2016 Calendar and Forecast


Top Used Android Apps May 2016 (U.S. Example)


Installing and Launching highly used apps per

regions as pre-condition test step for your App

Index 5th Edition General Insights

• iOS 10 (iPhone 7) & Android N• Beta Testing Importance• Samsung Market Recovery• iOS vs. Android Tablet Market Diffs


We help build better app businesses

delivers data and insights to succeed in

the app economy

16 Offices & 450+ Employees Worldwide

Raised $157M in Financing

Most Trusted Partner in the App Economy

And many more…

Social

Investors

Platforms/ Mobile

Additional Industries

Games

Media/ Entertainment

Why Mobile Apps?

App Downloads Will Reach Over 288B by 2020

App Economy will reach $102B in 2020

Entertainment Apps Will Grow to Over $6B in Revenue in 2020

Emerging Countries Will Account for 40% of App Store Revenue by 2020

Apps Are Eating the Web

85% of Consumers’ Time Spent in Apps

9 min.

Top 10 Mobile Browsers

Other Apps

Time Spent in New Categories is Growing

Apps Are Succeeding Across Multiple Sectors

Nearly All B2C Industries Turning to Apps

Sector Companies Sales and Marketing

Product/Service Usage

Customer Service

Consumer Packaged Goods (CPG)

— —

Consumer Devices

Transport

Retail

Media

Financial Services —

MatureApp Usage

EmergingApp Usage

Apps Cover Every Aspect of Our Daily Lives

Eat Social Work Travel

Dating Entertainment

Learn

Shop

Games Pay News Health

Quick Service Restaurants

McDonald’s Japan Ties Up with Pokémon Go

X

Retail

Walgreens Engages With “Print From Facebook” Ad Impressions Boost

#1 Advertiser by Share of Supersonic Ad Impressions

#32 Advertiser by Share of Supersonic Ad Impressions

Android Pay adds Walgreens for first retail store loyalty card integration

Aug 01 Aug 07 Aug 14 Aug 211

100

200

300

400

500

Download Rank HistoryUnited States - Aug 1, 2016 - Aug 27, 2016

Retail Banking

Consumers Banking on Apps Continues To Grow

Total Sessions in the Top 10 Retail Banking Apps*Android Phone

*Top Apps by monthly active users in each age group

High Engagement for Retail Banking Apps Among Younger Users

Daily Sessions in Top 10 Retail Banking Apps* Per User

Android Phone, H1 2016

*Top Apps by monthly active users in each age group

Media & Entertainment

On-Demand Music and Video Apps Grow in Share of Wallet

Usage Patterns Show Local Preferences for Music & Audio Apps

User Conditions Affect Your App Testing

Strategy

Test Most Used Apps No Longer Available in the App Store

Most Used Retail Apps in Germany Android Phone, May 2016

Prioritize Apps that Cater to Local Preferences

Most Used M&E Apps in the United States Android Phone, May 2016

Pre-installed Apps are Important to Overall User Experience

Most Used M&E Apps in Brazil Android Phone, May 2016

http://info.perfectomobile.com/digital-test-coverage-index.html

Audience Give Away – Free Index Download

http://info.perfectomobile.com/digital-test-coverage-index.html