Upload
soasta
View
845
Download
3
Tags:
Embed Size (px)
Citation preview
1Webinar
Presents
Continuous Integration and Automation for Mobile Development & Test
2
Where to automate for rapid mobile dev and test
TODAY’S PRESENTERS
• Dave Meyer: Product Marketing Manager, Atlassian - @d_meyer• Sanjay Zalavadia: Director of Professional Services, Zephyr - @ZalinCal• Brad Johnson: VP Product & Channel Marketing, SOASTA - @bradjohnsonsv
Leading Innovators in Software Development!
- Helping teams build amazing software
- Delivering real-time test management
- The leader in mobile and cloud testing
Aligned with a Common Goal
High Speed Software Delivery
3
o Introductiono Poll Questiono Continuous Integration and Bamboo for Mobileo Test Management and the CI processo Automation for continuous mobile testing
Questions: - Please submit via Chat during event
4
o Shear Number of Devices (953M Smartphones)
o Different Operating Systems
o Scale of Global Customers (6B)
o Dynamic Content (Video, Animation)
o Rapid development driven by demand
Manual Processes Can Not Keep Up
5
Fingers and Eyeballs VS.Pace and Scale of Mobile
Development
6
SDLC tasks are a constant. Pace Isn’t
7
The Mobile Need is Elementary> More Progress in Less Time <
8
99
We help plan, build, and launch great software
Team Collaboration
Track projects, events, & people Group Chat
Track, Plan, Analyze
Agile project tracking Exploratory Testing
...and more!
• 23,000 customers in over 130 countries
• Offices in Sydney, San Francisco & Amsterdam
• A “leader” in ALM according to Gartner
10
Dave Meyer
@d_meyer@d_meyer
Why does Continuous Integration matter?
Find bugs faster
Make merging suck less
Faster feedback loops
Less lag time
x 2 for Mobile
If you’re going to fail, fail fast!
#atlassian
Principles of CI
oOne (1) repo
o Automate your builds!
o Builds all the time!
o Automate your tests!
oDeploy, deliver, distribute, deploy, deliver ....
14
What does a CI tool do?
Clone repo Build Unit Tests Deploy to QAUI TestsIntegration TestsAPI TestsPerformance/Load Tests
Deploy to Production
Smoke tests
15
Plan
16
Plan
Stage StageStage
17
Plan
Stage StageStage
Job
Job
Job
JobJob
18
Task
Task
Task
Task
Task
Task
Task
Task
Task
Plan
Stage StageStage
Job
Job
Job
JobJob
19
• Checkout from Source Control
• SVN, Git, Hg, Perforce, CVS
• Build Engine
• Ant, Maven, MSBuilder, Rake, Grails, Ivy
• Analysis & Reports
• code coverage, static analysis, performance
• Deployment
• Tomcat, Heroku, Deploy It, LiveRebel, Artifactory, SCP, Script
Tasks run sequentially inside their container: a Job
20
Task
Task
Task
Task
Task
Task
Task
Task
Task
Plan
Stage StageStage
Job
Job
Job
JobJob
21
JobsJobs
Jobs run in parallel inside their container: a Stage
• Group dependent Tasks together inside a Job to ensure order of execution• “Build & Package” Job = SCM Checkout Task + Checkstyle Task + Ant
Task
• Place independent Tasks in their own Jobs to tighten the feedback loop• “Integration Tests” Job = Maven Task
• “UI Tests” Job = Maven Task
• These two Jobs can run in any order, or simultaneousl
22
Task
Task
Task
Task
Task
Task
Task
Task
Task
Plan
Stage StageStage
Job
Job
Job
JobJob
23
PlansPlans
• Represents the complete set of actions taken with each build• Variety of triggers:
• Change in SCM
• Cron
• Manual (push-button)
• Parent Plans
• Global elements you can fine-tune at the Plan level:• Variables
• Repositories
• Notifications
• Permissions
• Build Expiry
24
Up your Mobile Dev speed
1. Start failing faster
25
Up your Mobile Dev speed
1. Start failing faster
2. Don’t build alone
26
Up your Mobile Dev speed
1. Start failing faster
2. Don’t build alone
3. Atlassian <3 mobile devs
27
Up your Mobile Dev speed
1. Start failing faster
2. Don’t build alone
3. Atlassian <3 mobile devs
Blog: http://atlss.in/mobileCI
28
Up your Mobile Dev speed
1. Start failing faster
2. Don’t build alone
3. Atlassian <3 mobile devs
Blog: http://atlss.in/mobileCI
29
Up your Mobile Dev speed
1. Start failing faster
2. Don’t build alone
3. Atlassian <3 mobile devs
Blog: http://atlss.in/mobileCI
30
Company overview
profileo Founded in 2007o 900+ global customerso Atlassian Integration Partnero Headquartered in Silicon Valley, CA
CONTACT o Email: [email protected] o Office: (510) 400-8656o Home: getzephyr.com
31
Sanjay Zalavadia
@ZalinCal@ZalinCal
Challenges with Mobile App testing
Transitional testing team•Seasonal testers•Globally distributed teams
Huge testing footprint•Wide variety of platforms, devices, OS, languages, browser versions, MODS, carriers•Dealing with multiple marketplaces / ecosystems / product catalogs•Can’t write and manually execute separate tests
Keeping track of what’s going on …•Hard to know where you are in your testing•Constant updates needed for the Business, Executives, PMs, etc.
Consequences if left unaddressed
Lack of organized, re-useable systems:•Missed Deadlines•App certification process - rejection•Re-inventing the wheel
Lack of Coverage•Quality issues•Low ratings, Poor reviews
Lack of visibility•Lose track of where you are in your testing•QA = black hole
Get organized
•3
Centralize your test assets•Single test repository•Accessible and useable globally•Manual, automation and performance
Achieve test completion with Quality
Automate•Build time verification•Utilize the cloud
Performance testing•Not optional
Maintain Consistency
Provide complete Visibility
Accessibility to entire Project Team
Metrics Availability 24 x 7
Real-time updates
Provide complete Visibility
•5
Accessibility to entire Project Team
Metrics Availability 24 x 7
Real-time updates
Provide complete Visibility
Accessibility to entire Project Team
Metrics Availability 24 x 7
Real-time updates
Provide complete Visibility
Accessibility to entire Project Team
Metrics Availability 24 x 7
Real-time updates
40
o First End-to-End Mobile App Test Platform
• First Cloud-Based Load Testing Solution
• First Global Test Cloud (17 Countries, 100 Cities)
• First Mobile Test Automation “Platform”
• First real time RUM for web and mobile
o Over 350 Global Corporate Customers
• 10,000 Mobile Developers and Testers use CloudTest
• Over 1,000 Mobile and Web Apps are Tested with CloudTest
o Award Winning & Patented Technology
• Named by Wall Street Journal Top 50 Hottest Companies three years running
• Gartner Visionary Leader
o Over 100+ Employees US, EMEA
41
Brad Johnson
@bradjohnsonsv@bradjohnsonsv
42
Functional Test Automation
Real User Monitoring
Performance & Load Testing
Development & Build
Application
Application Development Lifecycle
43
Application Development Lifecycle
Application
TouchTest
CloudTestmPulse
mobilev
Development & CI
44
45
Source Code Repository
Devs
Build Server
Check out
Test Results
Check in
Run Tests
Unit Tests
☐Pass
☐ Fail
✓
To QA or Users
46
Source Code Repository
Real Devices
Bamboo Build Server
Check out
Test Results
Check in
Push to devices
In parallel
Run Tests
Execute on devices
☐Pass
☐ Fail
✓
Bamboo Mac Agent
DevsToor
Beta Users
47
Source Code Repository
Devs
Real Devices
Bamboo Build Server
Check out
Test Results
Check in
Push to devices
In parallel
Run Tests
Execute on devices
☐Pass
☐ Fail
✓
Bamboo Mac Agent
Toor
Beta Users
48
Source Code Repository
Devs
Real Devices
Bamboo Build Server
Check out
Test Results
Check in
Push to devices
In parallel
Run Tests
Execute on devices
☐Pass
☐ Fail
✓
Bamboo Mac Agent
Toor
Beta Users
49
Source Code Repository
Devs
Real Devices
Bamboo Build Server
Check out
Test Results
Check in
Push to devices
In parallel
Run Tests
Execute on devices
☐Pass
☐ Fail
✓
Bamboo Mac Agent
Toor
Beta Users
50
Source Code Repository
Devs
Real Devices
Bamboo Build Server
Check out
Test Results
Check in
Push to devices
In parallel
Run Tests
Execute on devices
☐Pass
☐ Fail
✓
Bamboo Mac Agent
Toor
Beta Users
51
Source Code Repository
Devs
Real Devices
Bamboo Build Server
Check out
Test Results
Check in
Push to devices
In parallel
Run Tests
Execute on devices
☐Pass
☐ Fail
✓
Bamboo Mac Agent
Toor
Beta Users
52
Source Code Repository
Devs
Real Devices
Bamboo Build Server
Check out
Test Results
Check in
Push to devices
In parallel
Run Tests
Execute on devices
☐Pass
☐ Fail
✓
Bamboo Mac Agent
Toor
Beta Users
53
Source Code Repository
Devs
Real Devices
Bamboo Build Server
Check out
Test Results
Check in
Push to devices
In parallel
Run Tests
Execute on devices
☐Pass
☐ Fail
✓
Bamboo Mac Agent
Toor
Beta Users
54
Source Code Repository
Devs
Real Devices
Bamboo Build Server
Check out
Test Results
Check in
Push to devicesIn parallel
Run Tests
Execute on devices
☐Pass
☐ Fail
✓
Bamboo Mac Agent
Toor
Beta Users
55
Source Code Repository
Devs
Real Devices
Bamboo Build Server
Check out
Test Results
Check in
Push to devicesIn parallel
Run Tests
Execute on devices
☐Pass
☐ Fail
✓
Bamboo Mac Agent
Toor
Beta Users
56
Source Code Repository
Devs
Real Devices
Bamboo Build Server
Check out
Test Results
Check in
Push to devices
In parallel
Run Tests
Execute on devices
☐Pass
☐ Fail
✓
Bamboo Mac Agent
Toor
Beta Users
57
• No jailbreak required• No tethering required• iOS 5.0, 5.1, 6.0• iPhone 3GS, 4, 4S, and 5• iPad 1, 2, 3, 4• iPad mini• Simulators
• No “rooting” required• No tethering required• Android 2.3.3
(Gingerbread) and later• Phones, tablets, and
emulators
58
• Download CloudTest Lite (http://www.soasta.com)• Includes TouchTest technology
• Free for a single device• No expiration• Free support via CloudLink forums
59
It Doesn’t Matter Where You Start.JUST START!
60
Q&A
Contact SOASTA:
866.344.8766
Follow us:
twitter.com/cloudtesttwitter.com/cloudtest
facebook.com/cloudtestfacebook.com/cloudtest
Knowledge Center•White Papers•Webinar Recordings•Case Studies
CloudLink Community•Support•Tutorials•Video
RESOURCES
www.SOASTA.com www.Atlassian.comwww.GetZephyr.com
Products•Zephyr Enterprise•Zephyr Community•Zephyr for JIRA
Support Center•Knowledge Base•ZephyrTV•Community Forums