CLR/H78 CI at iOS

#CLRH78Tsuyoshi Maehana

@sandinist

継続的インテグレーション

iPhoneアプリ開発でも

仕事で使える！

13年1月20日日曜日

Self Intro

• Tsuyoshi Maehana

• @sandinist

• Objective-C, Ruby, C#, VB.net

• ♥Ruby

• ♥Agile


@sandinist

@jcoplien


侍SamuraiEpisode


RubySapporo


Agile

Sapporo


SoupCurry♥


#CLRH78Tsuyoshi Maehana

@sandinist

継続的インテグレーション

iPhoneアプリ開発でも

仕事で使える！


チームに感謝を


Table of Contents

• Unit Tests

• Acceptance Tests

• Continuous Integration

iOSin13年1月20日日曜日

iOS Development

• XCode

• iOS Developer Program

• Objective-C

Note


Use Version Control?

•Git•Mercurial•Bazaar• ...etc

!


AutomationTestingVersionControl

Three Pillar


Use Version Control.

•Git•Mercurial•Bazaar• ...etc

XCode Standard


Table of Contents

• Unit Tests




Overview - Team Continuous Integration

Dev Mac CI Mac

Jenkinsgit

(bare)git

XCode &Instruments

ircdirc

VC& irc Linux



Dev Mac CI Mac

Jenkinsgit

(bare)git

XCode &Instruments

ircdirc

VC& irc Linuxpush



Dev Mac CI Mac

Jenkinsgit

(bare)git

XCode &Instruments

ircdirc

VC& irc Linuxhook



Dev Mac CI Mac

Jenkinsgit

(bare)git

XCode &Instruments

ircdirc

VC& irc Linux

Run Tests



Dev Mac CI Mac

Jenkinsgit

(bare)git

XCode &Instruments

ircdirc

VC& irc Linux

Notify



Dev Mac CI Mac

Jenkinsgit

(bare)git

XCode &Instruments

ircdirc

VC& irc Linux

Notify



Dev Mac CI Mac

Jenkinsgit

(bare)git

XCode &Instruments

ircdirc

VC& irc Linux



Dev Mac CI Mac

Jenkinsgit

(bare)git

XCode &Instruments

ircdirc

push hook

Run Tests

NotifyNotify

VC& irc Linux


Table of Contents

• Unit Tests





Three Pillar


what’s kinds of?

•Unit

• Integration

• Functional

• Join

•Acceptance


what’s kinds of?

•Unit

• Integration

• Functional

• Join

•Acceptance

For Developer


what’s kinds of?

•Unit

• Integration

• Functional

• Join

•Acceptance For Customer


what’s kinds of?

•Unit

• Integration

• Functional

• Join

•Acceptance

•NonFunctional For QA13年1月20日日曜日

To Do in the UnitTests

•Models

•Own Libraries

•Communications


Not Do the UnitTests

•Views

•ViewControllers

•External Libraries

•Built-in Libraries


Table of Contents

• Unit Tests




Unit Tests Frameworks.

•SenTestingKit

•GHUnit

•Cedar

•Kiwi


Unit Tests Frameworks.

•SenTestingKit

•GHUnit

•Cedar

•Kiwi


We use.

SenTesting

GHUnitKiwi

2010 2011 2012 2013

Is troublesome..


SenTestingKit

• XCode Standard

•Poor Matcher?

•Can’t Mocking?

•Async Difficult?

• Fixture there?


Poor Matcher?

•OCHamcrest • https://github.com/hamcrest/OCHamcrest

allOfequalTosameInstancehasItemcloseTolessThanendsWith...


https://github.com/hamcrest/OCHamcrest





Can’t Mocking?

•OCMock• https://github.com/erikdoe/ocmock




https://github.com/erikdoe/ocmock

https://github.com/erikdoe/ocmock

OCMock Attention

• Can’t Partial Mocking toll-free bridge Classes.

• Use mockForClass


• Double Pointer Argument

• Use OCMOCK_ANYPTR Macro.

• ex)• error:OCMOCK_ANYPTR(NSError *)

OCMock Attention


• union Argument is Can’t Stub.

OCMock Attention


Async Difficult?

•SenAsyncTestCase • https://github.com/akisute/SenAsyncTestCase


https://github.com/akisute/SenAsyncTestCase%0A%0A%0A%0A

https://github.com/akisute/SenAsyncTestCase%0A%0A%0A%0A

Fixture there?

Tell me!


Fixture there?

Make It!


Other Topic

•Method Swizzling

• ex) NSDate date

•Use JRSwizzle• https://github.com/rentzsch/jrswizzle


https://github.com/rentzsch/jrswizzle

https://github.com/rentzsch/jrswizzle

Our Rule

• 1 to 1 test class to class

• No Device Access (In Mock All)

• No Really Communicate (In Mock All)

• To Succeed xcodebuild

• Wait during asynchronous test as short as possible

• Do not write tests of getter / setter




Take a Break..



＿人人人人人人＿＞　突然の縄　＜‾Y^Y^Y^Y^Y‾



Table of Contents

• Unit Tests




To Do in the Acceptance Tests

•User Action

•Running the Scenario


Acceptance Tests Framework

•UIAutomation

•Kif

• Frank

• FoneMonkey

•Zucchini13年1月20日日曜日


•UIAutomation +tuneup.js

•Kif

• Frank

• FoneMonkey


Instruments


UIAutomation + tuneup.js


UIAutomation + tuneup.js



•UIAutomation +tuneup.js

•Kif

• Frank

• FoneMonkey


KIF

• KIF iOS Integration Testing Framework

• https://github.com/square/KIF


https://github.com/square/KIF

https://github.com/square/KIF


Three Pillar



Dev Mac CI Mac

git(bare)git

XCode &Instruments

push

Run Tests

VC& irc Linux



Dev Mac CI Mac

Jenkinsgit

(bare)git

XCode &Instruments

ircdirc

push hook

Run Tests

NotifyNotify

VC& irc Linux


Automation

• Jenkins

• TeamCity

•CruiseControl.rb

• zapp

• buildbot13年1月20日日曜日

Jenkins


Jenkins

• Building/testing software projects continuously

• Work with version controls

• Many Plug-in

• Easy to Install & Configure

• Run Any Scripts13年1月20日日曜日

Jenkins Plug-ins

• Jenkins Git Plugin

• Jenkins IRC Plugin

• Parameterized Job Plugin


Proxy Setting

• Manage Jenkins

• System Setting

• Global Properties

• Environment Variable ON

• set http_proxy etc

!


Run Test from the Command Line

• xcodebuild

• instruments

• xcrun


Run Unit Tests

xcodebuild -scheme CLRHTest -sdk iphonesimulator TEST_AFTER_BUILD=YES -configuration Release

clean build


Run Unit Tests

xcodebuild -scheme CLRHTest -sdk iphonesimulator TEST_AFTER_BUILD=YES -configuration Release

clean build

CleanSetting Build Test


Run Acceptance Tests

APP="$(pwd)/build/Release-iphonesimulator/CLRH.app"

TEMPLATE=`instruments -s 2>&1 > /dev/null |sed -n 's/ *"$[^",]*\/Automation.tracetemplate$",*/\1/p'`

SCRIPTS="$(pwd)/AcceptanceTest/*.js"

for SCRIPT in $SCRIPTSdo instruments -t $TEMPLATE $APP -e UIASCRIPT $SCRIPT if [ "$?" -ne 0 ]; then exit $? fidone13年1月20日日曜日

Run Acceptance Tests

APP="$(pwd)/build/Release-iphonesimulator/CLRH.app"

TEMPLATE=`instruments -s 2>&1 > /dev/null |sed -n 's/ *"$[^",]*\/Automation.tracetemplate$",*/\1/p'`

SCRIPTS="$(pwd)/AcceptanceTest/*.js"

for SCRIPT in $SCRIPTSdo instruments -t $TEMPLATE $APP -e UIASCRIPT $SCRIPT if [ "$?" -ne 0 ]; then exit $? fidone

"/Applications/Xcode.app/Contents/Applications/Instruments.app/Contents/PlugIns/

AutomationInstrument.bundle/Contents/Resources/Automation.tracetemplate"



Dev Mac CI Mac

Jenkinsgit

(bare)git

XCode &Instruments

ircdirc

push hook

Run Tests

NotifyNotify

VC& irc Linux


git hook


Eco!

#!/bin/bashwol '[MAC ADDRESS]'

for i in {0..5} doping -c1 host > /dev/nullif [ $? == 0 ]; then

breakfi

sleep 1done

wget --no-proxy -q "http://host:8080/job/Start/build?token=[token]&delay=0" if [ "$?" -eq 0 ]; then

echo "Jenkins build run."else

echo "Jenkins build failed."fi


http://york.local:8080/job/Start/build?token=1dbf65052a03f5bf90785cbc5649eb02&delay=0





Dev Mac CI Mac

Jenkinsgit

(bare)git

XCode &Instruments

ircdirc

push hook

Run Tests

NotifyNotify

VC& irc Linux


xcrun?

xcodebuild -project ./CLRH.xcodeproj clean build

xcrun -sdk iphoneos PackageApplication -v ./build/Release-iphoneos/CLRH.app -o "`pwd`/CLRH.ipa"

Set Valid Distribution Identifier for Release Build.


Continuous Delivery

• Use xcrun our case is all done manually.

• In no constraint case, you can use Testflight.


Overview - Release Continuous Delivery

Dev Mac VC Linux CI Mac

Jenkinsgit

(bare)git

XCode &Instrumentsweb

browser

VC Linux

git

Repositorybrowser

Destination


Overview - Release Continuous Delivery

Dev Mac VC Linux CI Mac

Jenkinsgit

(bare)git

XCode &Instrumentsweb

browser

push polling

VC Linux

Run Tests

git

Repositorybrowser

push

DLDestination



Any Auestion?

;-)


Technology

CLR/H78 CI at iOS