Upload
phamngoc
View
251
Download
2
Embed Size (px)
Citation preview
SOLUTIONS BRIEF
M O B I L E T E S T I N G R E F E R E N C E G U I D E
If you develop mobile applications, you already understand the why
of software testing. You know that testing ensures your applications
will perform as expected in production and deliver a consistent
experience to end users that will earn you 5-star ratings in app stores.
This reference guide offers comprehensive guidance for planning
a mobile application testing strategy.
3 Devices and Operating Systems to Target for
Mobile Application Testing
3 Mobile Device and Operating System
Usage Trends
4 Recommendations by Business Size
5 Rankings by User Characteristics
6 Rankings by Geographic Region
7 Android Device Rankings
8 iOS Device Rankings
9 OS Versions: Android and iOS
10 Conclusion
TABLE OF CONTENTS
DEVICES AND OPERATING SYSTEMS TO TARGET FOR MOBILE
APPLICATION TESTING
If you develop mobile applications, you already understand the why of software
testing. You know that testing ensures your applications will perform as expected
in production and deliver a consistent experience to end users that will earn you
5-star ratings in app stores.
Yet the how of mobile application testing can be more complicated. While an
automated testing solution like Sauce Labs handles many of the tedious tasks
for you, you still have to decide which types of devices and operating system
versions to test across. That choice will be based on several factors, including:
• The geographic locations of your users.
• The industry in which you operate.
• The size of your organization.
• The gender, education level, income range and other personal
characteristics of your users.
Using this information to determine which types of devices and operating
systems to prioritize for the testing market is essential for making optimal use of
your testing resources.
That’s why we’ve created this reference for you. It offers comprehensive
guidance for planning a mobile application testing strategy. We have collected
and organized device and OS data based on popularity with consumers in North
America, EMEA and the rest of the world based on our analysis of mobile usage
trends from several sources.
While we can’t tell you exactly which hardware and software platforms to test
(that’s of course a decision that varies from organization to organization), we can
help you to clarify the biggest unknowns and get started in designing a mobile
application testing strategy that meets all of your needs.
MOBILE DEVICE AND OPERATING SYSTEM USAGE TRENDS
The following are recommendations on mobile device hardware and software
trends in today’s market. The information is based on research and data
collection from several sources, including Sauce Labs customer testing and
anonymized user data, collected in collaboration with external vendors.
Learn more at saucelabs.com
3
RECOMMENDATIONS BY BUSINESS SIZE
Your test strategy should reflect not only market trends, but also the size of your
business and the scale of your testing resources.
We recommend that small and medium-sized businesses focus on testing for
the devices and OS versions listed in the top 10 chart below. Larger businesses
should focus on those in the top 25 chart.
6.0.1
7.1.2
7.1.2
5.0.2
7.0
4.4
7.1.2
10.3.3
5.0.2
6.0
5.0.1
4.4.4
7.0
9.3.5
10.3.3
5.0.2
7.0
7.0
6.0.1
10.3.3
10.3.3
9.3.5
7.0
10.3.3
10.3.3
Samsung Galaxy J5
Google Nexus 6P
Samsung Galaxy S3 Mini
HTC One M7
Samsung Galaxy Tab S2
Samsung Galaxy S3
Google Nexus 5X
iPhone 7 Plus
Huawei P8
Sony Xperia Z3
Samsung Galaxy S4
Samsung Galaxy S4 Mini
Samsung Galaxy S6 Edge
iPad 3
iPhone 7
Samsung Galaxy Tab S4
Samsung Galaxy S7
Samsung Galaxy S7 Edge
Samsung Galaxy S5
iPhone 5
iPhone 6 Plus
iPad 2
Samsung Galaxy S6
iPhone 5s
iPhone 6
25 25
24 24
23 23
22 22
21 21
20 20
19 19
18 18
17 17
16 16
15 15
14 14
13 13
12 12
11 11
10 10
9 9
8 8
7 7
6 6
5 5
4 4
3 3
2 2
1 1
Large Businesses & EnterprisesEmployees: 500+
OS VersionDevice
5.0.2
7.0
7.0
6.0.1
10.3.3
10.3.3
9.3.5
7.0
10.3.3
10.3.3
Samsung Galaxy Tab S4
Samsung Galaxy S7
Samsung Galaxy S7 Edge
Samsung Galaxy S5
iPhone 5
iPhone 6 Plus
iPad 2
Samsung Galaxy S6
iPhone 5s
iPhone 6
10 10
9 9
8 8
7 7
6 6
5 5
4 4
3 3
2 2
1 1
SMBsEmployees: 100-500
OS VersionDevice
10.3.3
9.3.5
7.0
10.3.3
10.3.3
iPhone 6 Plus
iPad 2
Samsung Galaxy S6
iPhone 5s
iPhone 6
5 5
4 4
3 3
2 2
1 1
StartupsEmployees: <100
OS VersionDevice
Learn more at saucelabs.com
4
RANKINGS BY USER CHARACTERISTICS
Hold graduate degree Very likelyLikely
Live in an urban area LikelyNo significant effect
High technical skillset LikelyVery likely
Age No significant effectNo significant effect
Impact on Adroid Adoption Impact on iOS Adoption
Other Factors Affecting Platform Preference
69% 69%21% 21%$125,000+
60% 60%30% 30%$100,000-$125,000
51% 51%39% 39%$75,000-$100,000
35% 35%55% 55%$50,000-$75,000
Household Income
FEMALE
45% 45%
50% 50%
5% 5%
MALE
40% 40%
53% 53%
7% 7%
Other
iOS
Android
Gender
Rankings by User Characteritics
Learn more at saucelabs.com
5
RANKINGS BY GEOGRAPHIC REGION
The following charts display recommendations for the leading mobile device
vendors in specific countries and regions.
○
○
○
7%
9%
10%
15%
45%
Huawei
Apple
LG
Motorola
Samsung
5 5
4 4
3 3
2 2
1 1
SouthAmerica
○
○
○
○
○
4%
5%
6%
9%
30%
Infinix
Tecno
Nokia
Huawei
Samsung
5 5
4 4
3 3
2 2
1 1
Africa
○
○
○
○
4%
5%
10%
28%
35%
Sony Ericsson
LG
Huawei
Apple
Samsung
5 5
4 4
3 3
2 2
1 1
Europe
○
○
○
○
○
5%
6%
7%
8%
25%
Oppo
Nokia
Lenovo
Xiaomi
Samsung
5 5
4 4
3 3
2 2
1 1
India
○
○
○
○
○
7%
10%
10%
17%
30%
BBK
Oppo
Xiaomi
Huawei
Apple
5 5
4 4
3 3
2 2
1 1
China
TrendMarket Share*Vendor
○
○
○
○
2%
3%
8%
25%
50%
ZTE
Motorola
LG
Samsung
Apple
5 5
4 4
3 3
2 2
1 1
UnitedStates
Top Device Vendors by Region
Learn more at saucelabs.com
6
ANDROID DEVICE RANKINGS
The following are recommendations for Android devices across all regions.
Learn more at saucelabs.com
7
10 10
9 9
8 8
7 7
6 6
5 5
4 4
3 3
2 2
1 1 Samsung Galaxy S6
Samsung Galaxy S5
Samsung Xperia Z3
Samsung Galaxy S6 Edge
Samsung Galaxy S7
Samsung Galaxy S4 Mini
Samsung Galaxy S4
Samsung Galaxy S7 Edge
Huawei P8
HTC One
Top 10 Smartphones
TabletsSmartphones
Top 10 Vendors
10 10
9 9
8 8
7 7
6 6
5 5
4 4
3 3
2 2
1 1
Learn more at saucelabs.com
8
10 10iPhone 7
9 9iPad Mini
8 8iPad Air 2
7 7iPhone 5c
6 6iPhone 6s
5 5iPhone 5
4 4iPad 2
3 3iPhone 6 Plus
2 2iPhone 5s
1 1iPhone 6
iOS: Top 10 Devices
iPad Mini 3 iPad Mini 3
10 10
iPad Mini 4 iPad Mini 4
9 9
iPad Mini iPad Mini
8 8
iPad Mini 2 iPad Mini 2
7 7
iPad 3 iPad 3
6 6
iPad 4 iPad 4
5 5
iPad Pro iPad Pro
4 4
iPad 2 iPad 2
3 3
iPad Air iPad Air
2 2
iPad Air 2 iPad Air 2
1 1
iPads: Top 10 Device Variants
IOS DEVICE RANKINGS
The following are recommendations for iOS devices (including iPhones as
well as iPads) across all regions.
Learn more at saucelabs.com
9
OS VERSIONS: ANDRIOD AND IOS
4.4.3
4.0.3
4.2.1
4.0.4
4.1.1
4.4.4
4.3
4.4.2
4.2.2
4.1.2
.x4
-
-
-
-
-
-
-
6.1
6.0
6.0.1
.x6
-
-
-
-
-
-
7.1
7.1.2
7.1.1
7.0
.x7
10 10
9 9
8 8
7 7
6 6
5 5
4 4
3 3
2 2
1 1
Top OS Versions
9.3
9.0.2
9.1
9.2
9.3.1
9.3.3
9.2.1
9.3.4
9.3.2
9.3.5
iOS 9iOS 9
10.0
10.0.3
10.1
10.3
10.0.1
10.0.2
10.3.3
10.1.1
10.2
10.2.1
iOS 10iOS 10
iOS Top OS Versions
10 10
9 9
8 8
7 7
6 6
5 5
4 4
3 3
2 2
1 1
Learn more at saucelabs.com
10
CONCLUSION
The best approach to selecting the right devices and operating systems to
test your mobile app across is to know your users and understand the latest
usage trends. These trends change constantly as new devices are released
and OS versions are updated. The primary goal is to ensure that maintenance
of physical devices and lab management is not time consuming and costly.
A sound mobile strategy includes real devices, emulators/simulators, and
the ability to meet the needs of mobile app testing for the user base and
demographics.
SB-03-072017
Sauce Labs ensures the world’s leading apps and websites work fl awlessly on every browser, OS and
device. Its award-winning Continuous Testing Cloud provides development and quality teams with
instant access to the test coverage, scalability, and analytics they need to deliver a fl awless digital
experience. Sauce Labs is a privately held company funded by Toba Capital, Salesforce Ventures,
Centerview Capital Technology, IVP and Adams Street Partners. For more information, please visit
saucelabs.com.
ABOUT SAUCE L ABS
SAUCE LABS INC. - HQ
116 NEW MONTGOMERY STREET, 3RD FL
SAN FRANCISCO, CA 94105 USA
SAUCE LABS EUROPE GMBH
NEUENDORFSTR. 18B
16761 HENNIGSDORF GERMANY
SAUCE LABS INC. - CANADA
134 ABBOTT ST #501
VANCOUVER, BC V6B 2K4 CANADA
Find out how Sauce Labscan accelerate your testingto the speed of awesome.
For a demo, please visit saucelabs.com/demoEmail [email protected] or call (855) 677-0011 to learn more.
B E F O R E S A U C E L A B SDevices. Delays. Despair.
A F T E R S A U C E L A B SAutomated. Accelerated. Awesome.
A brief history of mobile app testing.