Upload
keynote-systems
View
21
Download
3
Embed Size (px)
Citation preview
Collaborative Mobile Test Automation
July 14, 2015
Uber, the world’s largest taxi company, owns no vehicles. Facebook, the world’s most popular media owner, creates no content. Alibaba, the most valuable retailer, has no inventory. And Airbnb, the world’s largest accommodation provider, owns no real estate.
Something interesting is happening.
– Tom GoodwinTech Crunch
3/3/15
toddler apps by jenny downing on Flickr
Today’s technology priority: growth
5%
6%
10%
11%
8%
9%
16%
12%
23%
3%
6%
11%
7%
15%
14%
13%
15%
15%
6%
9%
8%
12%
9%
10%
12%
19%
16%
Hire a C-level executive who is focused…
Invest in more outsourced resources to…
Improve usability
Reduce IT costs
Increase proportionate investment in…
Develop or acquire new skills in IT
Invest in more external digital services…
Expand the breadth of digital assets…
Improve the quality and performance of…
Top strategies for digital success next 18 mos.
1 2 3
16%
12%
23%
13%
15%
15%
12%
19%
16%
More external digitalservices
Expand digitalassets (e.g. mobile)
Improve customerexperience qualityand performance
1 2 3
Top 3
210 IT and LOB decision-makers in the US, UK, and Germany from organizations with 1000+ employees
Source: A commissioned study conducted by Forrester Consulting on behalf of Keynote, March, 2015
Innovation… faster
Higher release frequency, user expectations
28 DAYS
59 DAYS
iOS vs Android App Update Management Insights, UEA/CCP, 2015
ONLY 16% OF CUTOMERS
willing to give a bad app more than one attempt
20% of apps are used once, then deleted
Localytics, 2014
Development realities
Specialization Open Source Testing
“Open Source Water” by schoschie on flickr"TIO
BE
ind
ex"
on
Wik
iped
ia
Units
Feature validation
Development environment
Mix of emulators, personal devices
Testing in Development
End-to-end, exploratory
Coverage, regression
Application lifecycle management, build acceptance/automation
Higher reliance on real devices
Testing in QA
Bridging approaches
Collaboration
Dev -> QA
1. Leverage assets without sacrificing capability
2. Enhance narrow units with additional coverage E.g., modify unit testing registration functionality based on single data
value to run on broad data arrays
3. Combine multiple units into full cases
Collaboration
QA -> Dev
1. Reduce “source of truth” conflicts
2. Improve defect fix veracity
3. Improve test validity with the accuracy of same real device(s)
Shortcomings
“bridge-to-nowhere” by careax on wikiality
Real Device Technology
Perform cloud-based testing and monitoring of any app or website on the largest library of real mobile devices, or your own private devices.
Shared Devices
24X7 access to hundreds of smart devices
Use for manual, compatibility, “untrusted device” testing
Private Devices
Managed and hosted by Keynote or on premise Inside corporate firewall
Enterprise only
Best for automation
Local Devices
Plug your smart devices on hand directly into your local computer
Make use of existing assets, great for local teams
Enterprise only
Android only (iOS on roadmap)
Flexible device options
© 2015 Keynote, LLC
Keynote + Appium
Run Appium scripts on real Android and iOS smartphones and tablets remotely
Test on demand
Execute multiple tests on multiple devices without the need to manage them
Run test sequences with hundreds of test cases, across multiple devices
Manage your tests online:
View device interactions in real-time and share with colleagues using built-in collaborative screencasting
Leverage results directly in Appium
© 2015 Keynote, LLC
Live Appium testLet’s watch a test case run on a real iPhone
Collaboration—the sooner the better!
User expectations are higher than ever—quality is critical
Seek integrated approaches for both developers and quality assurance teams
Prioritize consistency in testing, and foster connection across testing teams
Questions?
Thank youLearn more about Keynote Mobile Testing with Appium:http://www.keynote.com/solutions/testing/appium-integration