10
Design for Next 12th EAD Conference Sapienza University of Rome 12-14 April 2017 Copyright © 2016. The copyright of each paper in this conference proceedings is the property of the author(s). Permission is granted to reproduce copies of these works for purposes relevant to the above conference, provided that the author(s), source and copyright notice are included on each copy. For other uses please contact the author(s). The Value of Agile Methods in Designing for Behavioural Change: A Case Study Dirk Ploos van Amstel a , Martine Heemskerk a , Reint Jan Renes a,b , Sander Hermsen a* a Utrecht University of Applied Sciences, Netherlands b Wageningen University, Netherlands *Corresponding author e-mail: [email protected] Abstract: Past research on designing for behavioural change mostly concerned linear design processes, whereas in practice, Agile design methods are increasingly popular. This paper evaluates the possibilities and limitations of using Agile design methods in theory-driven design for behavioural change. We performed a design case study, consisting of a student design team working on improving waiting experiences at Schiphol Airport security and check-in. Our study showed that Agile design methods are usable when designing for behavioural change. Moreover, the Behavioural Lenses toolkit used in the design process is beneficial in facilitating theory-driven Agile design. The combination of an Agile design process and tools to evidentially inform the design enabled the design team to formulate viable and interesting concepts for improving waiting-line experiences. However, limitations also occurred: a mismatch between the rate at which the Scream method proceeded and the time and momentum needed to conduct in-depth research. Keywords: Agile design, theory-driven design, behavioural change, waiting line behaviour 1. Introduction Designing for behavioural change is currently on the rise in the public and the commercial sector, not least because of the growing insights into the effect of our behaviour on our health (Free et al., 2013) and our planet (Griggs et al., 2013). The rise of phenomena such as nudging (Thaler & Sunstein, 2008), social design (Van der Zwaag, 2016), and service design (Stickdorn & Schneider, 2012) in professional and educational practice typify this development. Designing for behavioural change is complex and, therefore, needs theoretical grounding, increasing the design’s efficacy (see Michie et al., 2009; Noar, Benac & Harris, 2007; Taylor, Connor, & Lawton, 2011) and the designers' decisional accountability (Van Woerkum & Aarts, 2012). In recent years, linear design processes, such as the Double Diamond (Design Council, 2015; Van Essen, Hermsen, & Renes, 2016), have informed design research projects aimed at behavioural

The Value of Agile Methods in Designing for Behavioural ......During sprint one, we conducted an introductory workshop, informing the design team about the Behavioural Lenses toolkit’s

  • Upload
    others

  • View
    1

  • Download
    0

Embed Size (px)

Citation preview

Page 1: The Value of Agile Methods in Designing for Behavioural ......During sprint one, we conducted an introductory workshop, informing the design team about the Behavioural Lenses toolkit’s

DesignforNext

12thEADConferenceSapienzaUniversityofRome

12-14April2017

Copyright©2016.Thecopyrightofeachpaperinthisconferenceproceedingsisthepropertyoftheauthor(s).Permissionisgrantedtoreproducecopiesoftheseworksforpurposesrelevanttotheaboveconference,providedthattheauthor(s),sourceandcopyrightnoticeareincludedoneachcopy.Forotherusespleasecontacttheauthor(s).

TheValueofAgileMethodsinDesigningforBehaviouralChange:ACaseStudy

DirkPloosvanAmstela,MartineHeemskerka,ReintJanRenesa,b,SanderHermsena*

aUtrechtUniversityofAppliedSciences,NetherlandsbWageningenUniversity,Netherlands*Correspondingauthore-mail:[email protected]

Abstract: Past research on designing for behavioural change mostly concernedlineardesignprocesses,whereasinpractice,Agiledesignmethodsareincreasinglypopular.ThispaperevaluatesthepossibilitiesandlimitationsofusingAgiledesignmethods in theory-driven design for behavioural change.Weperformed a designcase study, consisting of a student design team working on improving waitingexperiencesatSchipholAirportsecurityandcheck-in.Our study showed that Agile design methods are usable when designing forbehavioural change.Moreover, theBehavioural Lenses toolkit used in the designprocessisbeneficialinfacilitatingtheory-drivenAgiledesign.ThecombinationofanAgiledesignprocessandtoolstoevidentiallyinformthedesignenabledthedesignteam to formulate viable and interesting concepts for improving waiting-lineexperiences.However, limitations alsooccurred: amismatchbetween the rate atwhich the Scream method proceeded and the time and momentum needed toconductin-depthresearch.

Keywords: Agile design, theory-driven design, behavioural change, waitinglinebehaviour

1.IntroductionDesigningforbehaviouralchangeiscurrentlyontheriseinthepublicandthecommercialsector,notleastbecauseofthegrowinginsightsintotheeffectofourbehaviouronourhealth(Freeetal.,2013)andourplanet(Griggsetal.,2013).Theriseofphenomenasuchasnudging(Thaler&Sunstein,2008),socialdesign(VanderZwaag,2016),andservicedesign(Stickdorn&Schneider,2012)inprofessionalandeducationalpracticetypifythisdevelopment.Designingforbehaviouralchangeiscomplexand,therefore,needstheoreticalgrounding,increasingthedesign’sefficacy(seeMichieetal.,2009;Noar,Benac&Harris,2007;Taylor,Connor,&Lawton,2011)andthedesigners'decisionalaccountability(VanWoerkum&Aarts,2012).

Inrecentyears,lineardesignprocesses,suchastheDoubleDiamond(DesignCouncil,2015;VanEssen,Hermsen,&Renes,2016),haveinformeddesignresearchprojectsaimedatbehavioural

Page 2: The Value of Agile Methods in Designing for Behavioural ......During sprint one, we conducted an introductory workshop, informing the design team about the Behavioural Lenses toolkit’s

DirkPloosvanAmstel,MartineHeemskerk,ReintJanRenes,SanderHermsen

2

change.However,inbusinesspracticeandeducation,Agileprojectsareincreasinglyprevalent.Inshort,Agileisamethodderivedfromsoftwaredevelopment.Itembraceschangeratherthanfollowingapre-determinedplan(Jongerius&Berghuis,2012).Awell-knownexampleofanAgileworkingmethodisScrum.Usedbyagenciesinthecreativesectortodevelopinteractiveproducts(Chicken,2015),Scrumcontraststhelinearapproachesassociatedwithtraditionallinearworkingmethodsbyusinganiterativeprocess;itincorporates‘sprints’insteadofworkingstepbystep.Thesprintscompriseaniterativesequenceofstepstoimprovethedesign(Lee,2012).

Scrum’sbasicprinciples–user-orientedapproach,aself-propelledteam,flexiblescope–arepotentiallyverysuitablefordesigningforbehaviouralchange.Theuser-orientedapproach–prioritisingrelevancetotheenduserandnottheteam,customer,orproduct(Jongerius&Berghuis,2012)–mirrorsasimilaruserorientationindesigningforbehaviouralchange.Astrongemphasisofthisapproachisthetargetaudience(enduser)andtheaccompanyinggoal(changingspecificbehaviour).Theuser-orientedapproachdoesnotcommentonortrytoinfluencethechoiceofinstruments(Hermsen,Renes&Frost,2014,Hermsenetal.,2015).

AnothersimilaritybetweenScrum’sprinciplesanddesigningforbehaviouralchangeisthe'flexiblescope'principle,whichdoesn’tdeterminetheresultinadetailedwayattheprocess’sbeginning;theproductshouldinsteadfittheclient’svisionandgoals(Jongerius&Berghuis,2012).Designingforbehaviouralchangesimilarlyfocusesonregularevaluationandadjustingconceptsaccordingly.

DifferencesalsoexistbetweenScrum’sprinciplesanddesigningforbehaviouralchange.Scrumhasapoortrackrecordinencouragingcreativityandconductingappliedresearch(VanHout&Gootjes,2015;Lee,2012).Thelattercanadverselyimpactontheapplicationofdesigningforbehaviouralchangebecauseusingevidencetoinformdesignscanbetime-consuming(Hermsen,Renes&Frost,2014,Hermsenetal.,2015).

Inthispaper,weevaluate(1)towhatextentnon-lineardesignmethods,suchasAgileandScrum,applytodesigningforbehaviouralchange,and(2)towhatextenttheorycaninformtheAgiledesignprocess.Todoso,weconductacasestudyinwhichagroupofdesignstudentsworkedonimprovingwaiting-lineexperiencesatSchipholAirport,theNetherlands.ThiscasestudycandemonstratehowtopursuethesegoalsbyapplyingAgiledesignprocessesforbehaviouralchangeinbusiness

2.Method2.1Thecasestudy:improvingairportwaitinglineexperienceOurdesigncasestudywascommissionedbytheAmsterdamAirportSchiphol,andconsistedofastudentdesignteamworkingonadesignquestionaboutimprovingwaitingexperiencesattheairport’ssecuritycheck.AsoneofEurope’sbiggestandmostpopularairports,SchipholAirportattachesgreatimportancetoenhancingtheirservices,implementingcentralisedsecurityintheentireterminalinJune2015.Travellersqueuebeforeenteringthesecuritycheck,whichisconsideredachallengetomakingitamorepositiveexperience.Schiphol’scommissionsoughtsolutionstopositivelyinfluencethewaitingexperienceofpassengerswaitinginthisqueue.Aconsortiumof[LeftBlankforPeerReview]assembledamultidisciplinaryteamofinternationalstudentswithdifferentacademicbackgroundstofulfiltheassignment.TheteamworkedaccordingtoScream,anAgiledesignprocessbasedontheScrummethod(VanHout&Gootjes,2015).TheteamusedtheBehaviouralLensestoolkit(Hermsen,Renes&Frost,2014,Hermsenetal.,2015)foruserexperienceresearchandconceptevaluation,asameansofinformingthedesignprocesswiththeoryfromthebehaviouralsciences.

Page 3: The Value of Agile Methods in Designing for Behavioural ......During sprint one, we conducted an introductory workshop, informing the design team about the Behavioural Lenses toolkit’s

TheValueofAgileMethodsinDesigningforBehaviouralChange

3

2.2.1ScreamMethod

TheScreammethodisaversionofScrumespeciallyadaptedforcreativeprocesses.IthasthreedistinctadditionstothemoregeneralAgileworkflow:(1)implementingIdeationinthesprintplanning,(2)useoftheDesignMethodToolkit(MediaLabAmsterdam,2016),and(3)implementingTranslatesessionshalfwaythrougheverysprinttofilterandtranslateallresults(VanHout&Gootjes,2015).TheSchipholprojectinvolvedseventhree-weeksprints,eachstartingwithanIdeationbrainstormingsessionforidentifyinganddraftingideas.Themostpromisingideasareselectedanddividedintotasks,andtheteamdefinesclearsprintgoals(VanHout&Gootjes,2015).Deliverdesignproducts(prototypes)thatprovideanswerstothemainquestion,definedattheproject’sstart,isthemaingoalofeachScreamsprint.Duringasprint,theindividualdesignproductsareaccomplishedusingtheiterativeprincipleof‘research,create,andtranslate’(VanHout&Gootjes,2015).Creatingadesignproductinvolvesresearchandcreation.Thecreateddesignproductisevaluatedusingstakeholders’theoreticalinput.Ideally,atthisevaluation,thedesignproductisadaptedtoamoreaccurateversionorendproduct.Duringtheoverallprocess,theseinstrumentsadaptandimprovethroughiterativerepetitioninthesprints.

Totranslateresearchinsightsintoconcretedesignrequirements,halfwaythrougheachsprint,atranslatesessioninvolvingalltheproject’sstakeholderstookplace,definingessentialdemandsfortheoptimisedsolution(VanHout&Gootjes,2015).

2.2.2BehaviouralLensestoolkit

Togroundthedesignprocessintheoryfromthebehaviouralsciences,theteamusedtheBehaviouralLensestoolkit(Hermsenetal.,2015;VanEssen,Hermsen&Renes,2016),whichenablesdesignerstoconducttheory-drivenuserresearchandconceptevaluations.ItisbasedonthemainprinciplesofthePersuasivebyDesignModelofBehaviourChange(Hermsen,Renes&Frost,2014),whichhasaproventrackrecord(Hermsen,Renes&Frost,2014;Hermsenetal.,2015,2016;VanEssen,Hermsen&Renes,2016)inusingtheorytoinformdesigns.TheBehaviouralLensestoolkitwasfreelyavailabletothedesignteamthroughouttheproject,aspartofthelargerDesignMethodToolkit(MediaLabAmsterdam,2016;seefigure1).ThedesignteamcouldusetheBehaviouralLensestoolkitastheysawfit.Duringsprintone,weconductedanintroductoryworkshop,informingthedesignteamabouttheBehaviouralLensestoolkit’sbasicprinciplesandapplication.

Thedesignteamcreatedthedesignproductusingtheiterativeprincipleof‘research,create,andtranslate’.Creatingadesignproductinvolvesresearchandcreation.Thecreateddesignproductisevaluatedusingthestakeholders’theoreticalinput.Ideally,atthisevaluation,thedesignproductisadaptedtoamoreaccurateversion.

2.2MeasuresWeconductedovertparticipatoryobservationthroughouttheproject.Inourroleastutors,wehelpedthestudentdesignteamtheoreticallygroundtheirdesignsusingtheBehaviouralLensestoolkit,butonlyifrequested.Weattendedtranslateandreviewsessions,providingtheteamwithcriticalquestionsfortheoreticallygroundingtheirresearchresultsandconcepts.Thestudentdesignteamcouldalsocorrespondwithusbyemailorphone.

Duringthesessions,wetookunstructuredfieldnotes,collectedemailswithquestionsfromthedesignteam,andkeptadiary,notingwhenthedesignteamrequestedsupport.Subsequently,weconductedtri-weekly,semi-structuredinterviews(ateachsprint'send)withtheteam‘experts’onthetopicofdesigningforbehaviouralchange.Theinterviews’mostimportanttopicsandaccompanyingquestionsregardedtheAgileworkflowandapplyingtheBehaviouralLenses.We

Page 4: The Value of Agile Methods in Designing for Behavioural ......During sprint one, we conducted an introductory workshop, informing the design team about the Behavioural Lenses toolkit’s

DirkPloosvanAmstel,MartineHeemskerk,ReintJanRenes,SanderHermsen

4

askedthedesignteamwhereandhowtheypractisedthesetools,whattheirexperienceswere,towhatleveltheyappliedandappropriatedthetools,andtowhatextenttheyfelttheywereexpertsofbehaviourchangedesignwithintheteam.Wealsousedavisualanaloguescale(VAS,Funke&Reips,2012)tomeasuretheperceivedvalueoftheusageofTheBehaviouralLensespersprint(regardingresearchonthetargetaudience,thegroundingoftheprototypesandthebehaviourallensesasevaluationtool):ona10cmline,withoneendcorrespondingto'notatall'andtheotherendcorrespondingto'verymuchso',thedesignteammemberscouldindicatetheirpositionregardingtheirexpertiseandtheusabilityoftheBehaviouralLensestoolkit.

Figure1:TheBehaviouralLensesasdescribedintheMediaLabDesignToolkit

3.Results3.1Stages,sprintsanddesignedproductsInfigure2,thearrowfromlefttorightindicatestheproject’soverallprogress.Thefirstthreesprintsaresprintsaimedatanalysis,tozoominonthetargetgroupandtheirbehaviour.Thefourthsprintistransitional;startingwithmakingdefinitivechoicesregardingthespecificchoiceforatargetgroup.Inthiscase,thedesignteamchosetoworkwiththeleisureflyerratherthanabusinessaudience.Inthisfourthsprint,thefinalconcepttosolvethemainquestionwasalsoselected.Thefifthsprintisanintervention-developingphase,translatingtheselectedconceptintopracticalinterventionsforbehaviourchange.Thesixthsprintisevaluative,validatingtheconceptandinterventions.

Sprintsonetosixresultedinseveraldesignedproducts.Sincethefirstsprintisintroductory,therewerenotmanyproducts.Duringsprinttwo,aculturalprobeandauserprofileweredeveloped,gaininginsightsintothetargetgroup.Aculturalprobe(Stickdorn&Schneider,2012)isamethodforgaininguserinsightsfromauserperspective,withoutthepresenceofthedesigner,whereasauserprofileisadesignproductcomprisingacollectionofalluserinsights.Theculturalprobe’sanduserprofile'smaingoalistotranslateinsightsintoacustomerjourneymap,inthiscasearichoverviewoftheprocessatravellergoesthroughwhenpassingthroughsecurity,inspiringthenextsprint.

Insprintthreethedesignteammadeobservationsatthewaitingline,tomaptheleisureflyer’scurrentbehaviourandanalysefrictionsbetweenmeaningfulandunfilledtime.Insprintfour,thedesignteamorganisedabrainstormsession.OnestudentdevelopedaHarrisProfile(Harris,1982)usinginsightsfromtheBehaviouralLenses.Thegoalofthisdesignproductistotesttowhatextentthedifferentconceptscorrespondwiththerequirementsofsuccessfulconceptsingeneral.Atthe

Page 5: The Value of Agile Methods in Designing for Behavioural ......During sprint one, we conducted an introductory workshop, informing the design team about the Behavioural Lenses toolkit’s

TheValueofAgileMethodsinDesigningforBehaviouralChange

5

endofsprintfour,thedesignteamdeliveredthreeconceptualprototypesasananswertothemainquestion,validatedbytheHarrisProfile.Theconceptualprototypetheychoseforfurtherdevelopmentwas‘LeaveYourWorriesBehind’Usingamobileapplicationandseveralscreens,theleisureflyercan(1)receiveinformationaboutthesecurityprocessand(2)beentertainedwhilewaiting.

Figure2:Stagesandsprintsduringtheproject,designproductspersprint,anddirectandindirectapplicationoftheBehaviouralLensesduringseveralsprints

Insprintfive,thedesignteamdeveloped'preparatoryscreens'–screensplacedinthearealeadingtothesecuritycheckgates,withtheintentofhelpingtravellersduringthesecurityprocess.Insprintsix,evaluatingtheuser’swillingnesstoparticipateinthefinalconceptatthewaitinglinewasthemaingoal.Thedesignteamconstructedatestplanandupdatedadiarylogontheresponsestotheconcept.Thisfinalevaluationdidnotleadtofurtheriterations.

3.2Designingforbehaviouralchange,theAgilewayTheteamstartedwithmanypreconceivedideasaboutthebehaviouroftheirtargetaudience.Theyfeltobligedtoprovetheseassumptionsandusethemasastartingpointfortheirresearch.Intheinitialsprints,theteamusedthefirsthalfofthesprint(thefirst1.5weeksfromstarttotranslatesession)toconductresearch,mainlytryingtofillinformationgapsthathadbecomeapparentintheprevioussprint.Inthemid-sprinttranslatesession,thedesignteamsoughttofilterandcategorisetheirresearchresults,turningthemintoideasforthesprint’ssecondhalf,wheretheycreatedorimprovedaprototype.

Page 6: The Value of Agile Methods in Designing for Behavioural ......During sprint one, we conducted an introductory workshop, informing the design team about the Behavioural Lenses toolkit’s

DirkPloosvanAmstel,MartineHeemskerk,ReintJanRenes,SanderHermsen

6

Figure3:initial(left)andadapted(right)versionoftheculturalprobe

ThisAgiledesignmethodhelpedthedesignteamfocusonapracticalapproach,translatingresearchintoanactualprototype.Byinvolvingtheclientinthedesignprocess,theAgileapproachalsopreventedapossibleexpectationgapbetweenthedesignerandtheclient.Attheendoftheproject,theclientstatedtheirsatisfactionwiththeendresultofthedesignprocess.

AnexampleoftheiterativenatureoftheAgiledesignprocessisthecreationoftheculturalprobeinsprintthree.Figure3demonstrateshowtheculturalprobeevolvedfromitsinitialformtoitsfinalversion.Atfirst,thedesignteamconductedresearchonthepsychologyofwaitinglines(Norman,2008).Basedonprinciplesfromthisresearch,thedesignteamcreatedaninitialculturalprobe,retrievingexpectationsandmemoriesofwaitinglineexperiencesandfrictionsbetweenexpectationsandreality.Theinitialversionoftheculturalprobewasevaluatedbypresentingittoourteamofresearchers.Duringtheevaluation,itbecameapparentthattheinitialculturalprobewasoverlybiasedbyhowthedesignteamperceivedthewaitinglineexperience,ratherthanactualbehaviourdisplayedbythetargetgroup.ThedesignteamappliedtheBehaviouralLensesasanevaluativetool,translatingtheinitialversiontoonemorebasedonactualbehaviour.

Unfortunately,theAgileworkingmethodhadatendencytoleadtoareducedfocusonresearch.Becauseofthepracticalgoalsetatthebeginningofeachsprint,theteamfeltpressuredtocreateadesignedartefactineverysprint.Thesprintsonlyhadathree-weekduration,sothedesignteamperceivedtimepressureasalimitingfactor.Theresultingpressurereducedtheirwillingnesstoconductresearchandincreasedthetendencytocreateconceptsbasedonpremises,evenwhenconfrontedwiththepossiblenegativeeffectsofminimalresearch.Attheproject'send,theteamfeltthatanincreasedfocusoncreationandalesserfocusonresearchcouldverywellhavehadconsequencestotheconcept'spotentialefficacy,becausetheylackedcrucialinformationabouttheirtargetaudience.

TheplacementoftheTranslatesessions(inthemiddleofeachsprint)furtheraugmentedthedetrimentaleffectoftimepressure.Althoughthesesessionsaffordedthedesignteamnewinsights,

Page 7: The Value of Agile Methods in Designing for Behavioural ......During sprint one, we conducted an introductory workshop, informing the design team about the Behavioural Lenses toolkit’s

TheValueofAgileMethodsinDesigningforBehaviouralChange

7

thesessionswerelesseffectivethanexpected.Theteamhadalreadyfinishedtheirresearchwhenthesesessionsoccurred,andtherewasnotmuchadditionaltimeforresearchinthesecondhalfofthesprint,afterthetranslatesession.Moreover,intheTranslatesessionsexpertsfromoutsidetheteamwereinvitedtoprovidefeedback.Becauseofthetimingofthisfeedback,itwasnotalwaysfollowedup.

3.3AgiledesignusingtheBehaviouralLensesDuringthesprints,TheBehaviouralLensestoolkitwasusedtogroundthedesignoftheprototypesintheoryfromthebehaviouralsciences.Figure2showswhereandhowthedesignprocessusestheBehaviouralLensestoolkit.

Insprinttwo,thedesignteamattemptedtogaininsightintothetargetaudienceusingaculturalprobeandbycreatingauserprofile.Beforemakingtheobservationsrequiredforcreatingthesedesignresearchproducts,thedesignteamusedtheBehaviouralLensesforgeneratinghypothesesandresearchdesign.TheymadeanobservationlistandsurveypartlybasedonthreeBehaviouralLenses:‘WantingandBeingAbleTo’,‘KnowingandBelieving’and‘HabitsandImpulses’.ThedesignteamparticipatedinasessionaboutobservationusingtheBehaviouralLensesanddecidedtofocusontheleisureflyerasthespecifictargetaudience.

ThedesignteamchosetousetheBehaviouralLensesasamethodinsprintthreetoconductactionresearchbycreatingandtestingonefriction-relievingconcept,particularlybetweencurrentbehaviourandtargetbehaviour.Duringthetranslatesessiontheirresultswerediscussedfromabehaviouralchangeperspective;however,unliketheinitialplan,categorisingresearchresultsusingtheBehaviouralLenseswascancelledduetotimeconstraints.

Insprintfour,thedesignteamusedtheBehaviouralLensestocategorisetheirearlierresearchresultsandevaluateconceptsdevelopedinprevioussprints.Thissessionprovidedaclearoverviewofchallengesandopportunities,andthedesignteamusedthesetoimprovetheirconcept.Itledtoasignificantchangeintheconcept,forcingthedesignteamtochoosebetweentwokindsoftargetbehaviour,andselectingamorespecifictargetgroup.Lateroninthesprint,abrainstormsessionusingtheBehaviouralLensestookplace.Timeconstraintsmeantthedesignteamcouldnotprocessallfindingsintotheconceptsinsprintfour;however,theydidmanagetomakeaHarrisprofile,incorporatingsomeoftheopportunitiesandchallenges.

Insprintfive,preparatoryscreenswerecreatedasoneofthefinalconcept’sdeliverables:aconsequenceofachallenge(thefriction)foundinsprintfour.TheBehaviouralLenseswereindirectlyapplied:thedesignteamstudiedandappliedtheunderlyingtheoryoftheBehaviouralLenses.

Duringthesixthandfinalsprint,thedesignteamtestedthehigh-fidelityprototype.Theydecidednottotestthecreativeconcept,butthewillingnessofleisureflyersinthewaitingareaforsecuritytoparticipateintheconcept.ThedesignteamdidnotusetheBehaviouralLensesfortheirtestdesign,butwhileobserving,theyfoundtheBehaviouralLens‘WantingandBeingAbleTo’verysuitableforinterpretingtheresults.Mosttestpersonsdidnothavethetimetoparticipateintheconcept,andtheycouldnotscantherequiredQRcode.Thesetestresultsarenotprocessedinthefinalconceptbutareincludedfordiscussionintheresearchpaperasafinaldeliverable.

Atthebeginningoftheproject,thedesignteamdidnotusetheBehaviouralLensestoolkittoitsfullpotentialforresearchingthetargetaudience.ThedesignteamfeltthiswasduetotheirlackofknowledgeoneffectivelyusingtheBehaviouralLensesfortheirresearch.ThedesignteamalsostatedtheyfounditdifficulttocombinetheBehaviouralLenseswithotherdesignmethodsfromtheDesignMethodToolkit.However,oncethedesignteamlearnedmoreabouttheBehaviouralLenses,

Page 8: The Value of Agile Methods in Designing for Behavioural ......During sprint one, we conducted an introductory workshop, informing the design team about the Behavioural Lenses toolkit’s

DirkPloosvanAmstel,MartineHeemskerk,ReintJanRenes,SanderHermsen

8

theynotedthattheirperceivedvalueofthemincreased.Additionally,interviewswithtwostudentsfromtheteamconfirmedincreasedappreciationoftheBehaviouralLensesaftermappingoutchallengesandopportunitiesconcerningtheirprototype.

4.DiscussionThecurrentpaperevaluateswhether(1)Agileisapplicableasamethodtodesigningforbehaviouralchangeand(2)toolssuchastheBehaviouralLensesarevaluableforinformingtheAgiledesignprocess.Todoso,weanalysedtheuseoftheBehaviouralLensesduringaprojectwithSchipholAirport.Inthisproject,adesignteamofstudentsfromdifferentbackgroundsresearchedanddevelopedadiversityofconceptstocreateamorepositiveexperienceatwaitinglinesofaspecifictargetgroup:LeisureFlyers.TheconceptsweredeliveredtoSchipholstakeholdersaftertesting.Duringthesixdesignsprints,weconductedobservatoryresearchandinterviewsabouttheAgileworkflowandtheuseoftheBehaviouralLensestoolkit.

OurresearchdemonstratedthattheBehaviouralLensesweresometimesappliedinadirectwayatfirst(e.g.intheuserprofile,culturalprobe,whichwerecreatedusingtheBehaviouralLenses),andthen,lateron,inamoreindirectway(e.g.thecustomerjourneymap,whichwascreatedwithoutdirectapplicationoftheBehaviouralLenses,butwiththeLensesinmind).TheapplicationoftheBehaviouralLensesinthefirstphaseof‘targetgroupanalysis’wereappliedinadirectway,whereasatlaterstages‘conceptualizing’,‘development’and‘evaluation’theirapplicationwasmoreindirect,notbyusingtheLensesbutbykeepingtheLensesinmind.Duringtheproject,theBehaviouralLensesdemonstratedtheirimportanceinthetheoreticalvalidationofthepresenteddesignproducts.However,theprojectshowedsomeshortcomingswhenresearchingthetargetgroup.Thespecifictargetgroupandtargetbehaviourweredefinedrelativelylateandindirectlybecauseoftheproduct-orientedapproachandthehighspeedofthesprints.Subsequently,theactualdesigningwaslessfocusedthandesired.

TheBehaviouralLenseswereappliedmoreeffectivelyrelativelylateinthedesignprocess:insprintthreeandfurtheron.Ourresearchshowedthatthiswasaconsequenceofaknowledgeandexperiencegapinhowandwherethetoolsareapplied.Duringtheinterviewattheendofthesecondsprint,thedesignteaminformedustheyconsideredtheBehaviouralLensestobeasubstituteforothertoolsintheMediaLabToolkit.Furthermore,thedesignteamfeltitwashardtotranslateinsightsfromtheBehaviouralLensesintootherresearchmethods,suchastheculturalprobe.ThelearningcurveoftheBehaviouralLensestoolkitseemstoosteepforinexperiencedusers,resultinginthembeingunabletostarttheirresearchwithouthelpfromexpertsinthefieldofbehaviouralchangeorpeoplewhousetheBehaviouralLensesonaregularbasis.

4.1.ConclusionsandrecommendationsforfurtherresearchFirstly,thisresearchcombinestwoelements:designresearchpractice–especiallywithinthefieldofdesigningforbehaviouralchange–inwhichdevelopingmethodswheretheoryinformsthedesignprocesshasseenmuchprogress;andindustrypracticeinwhichnewandAgiledesignmethodsaregainingtraction.Secondly,thisresearchdemonstratesthecomplexitiesofusingAgiledesignforbehaviouralchange,showstherearelimitstoaviablespeedofworking,andstressestheimportanceofevaluation.Thirdly,ourresearchprovidessomestartingpointstodevelopmoreadaptivetoolstomakeiteasiertousetheBehaviouralLensesinAgiledesignprocesses.

TosignificantlyimproveAgiledesignprocessesforbehaviouralchange,werecommend:(1)implementanexplanatorypre-sprinttofosterthinkingaboutwaysofusingtheorytoinformthe

Page 9: The Value of Agile Methods in Designing for Behavioural ......During sprint one, we conducted an introductory workshop, informing the design team about the Behavioural Lenses toolkit’s

TheValueofAgileMethodsinDesigningforBehaviouralChange

9

designprocess–itwouldmakesensetoinviteexpertsduringthisphase.(2)Includeresearchers(preferablywithabackgroundinthebehaviouralsciences)asparticipantsoftheScrumteam.(3)Adaptorrewriteuserstories(analreadyexistingprocedureatthestartofasprint),makingthetargetbehaviouranexplicitgoalofthesprint.And(4)beforesprintone,informusersoftheBehaviouralLensesandtheircomplementaryandconstructiveapplicationsforotherdesignproducts,suchasuserprofiles,culturalprobes,customerexperiencemaps,andcustomerjourneys.

ReferencesHermsen,S.,Mulder,S.,Renes,R.J.,&VanderLugt,R.(2015):UsingthePersuasivebyDesignModel

toinformthedesignofcomplexbehaviourchangeconcepts:twocasestudies.In:Proceedings,11thConferenceoftheEuropeanAcademyofDesign.Paris,UniversitéParisRenéDescartes.

Hermsen,S.,Renes,R.J.,&Frost,J.H.(2014).PersuasivebyDesign:aModelandToolkitforDesigningEvidence-BasedInterventions.In:MakingtheDifference.Proceedings,CHISparks2014.TheHague,Netherlands:TheHagueUniversityofAppliedSciences.

VanEssen,E.,Hermsen,S.,&Renes,R.J.(2016).Developingatheory-drivenmethodtodesignforbehaviourchange:twocasestudies.in:P.Lloyd&E.Bohemia,eds.,ProceedingsofDRS2016:Design+Research+Society–Future-FocusedThinking,Volume4,pp1323-1338.

Hermsen,S.,VanderLugt,R.,Mulder,S.,&Renes,R.J.(2016).HowIlearnedtoappreciateourtamesocialscientist:experiencesinintegratingdesignresearchandthebehaviouralsciences.in:P.Lloyd&E.Bohemia,eds.,ProceedingsofDRS2016:Design+Research+Society–Future-FocusedThinking,Volume4,pp1375-1389.

Chicken,S.(2015).Leanandgooddesign–amarriagemadeinheaven?URL:http://www.designcouncil.org.uk/news-opinion/lean-and-good-design-marriage-made-heaven.Accessed:2016-12-21.(ArchivedbyWebCite®athttp://www.webcitation.org/6mvBDfEsj)

DesignCouncil,(2015).Doublediamonddesignprocess.In:InnovationbyDesign.URL:http://www.designcouncil.org.uk/sites/default/files/asset/document/innovation-by-design.pdf.Accessed:2016-12-21.(ArchivedbyWebCite®athttp://www.webcitation.org/6mvBx6dh5)

Free,C.,Phillips,G.,Galli,L.,Watson,L.,Felix,L.,Edwards,P.,…Haines,A.(2013).TheEffectivenessofMobile-HealthTechnology-BasedHealthBehaviourChangeorDiseaseManagementInterventionsforHealthCareConsumers:ASystematicReview.PLoSMedicine,10(1),e1001362.doi:10.1371/journal.pmed.1001362

Funke,F.,&Reips,U.-D.(2012).WhysemanticdifferentialsinWeb-basedresearchshouldbemadefromvisualanaloguescalesandnotfrom5-pointscales.FieldMethods24,310–327.doi:10.1177/1525822X12444061.

Griggs,D.,Stafford-Smith,M.,Gaffney,O.,Rockström,J.,Öhman,M.C.,Shyamsundar,P.,…Noble,I.(2013).Policy:Sustainabledevelopmentgoalsforpeopleandplanet.Nature,495(7441),305–307.doi:10.1038/495305a

Harris,J.S.(1982).NewProductProfileChart.IEEEEngineeringManagementReview,10(3),17–25.doi:10.1109/emr.1982.4305929

JongeriusP.&BerghuisG.(2012).GetAgile.ScrumforUX,design&development.Amsterdam:BISPublishers.

Lee,R.C.(2012).TheSuccessFactorsofRunningScrum:AQualitativePerspective.JournalofSoftwareEngineeringandApplications,05(06),367–374.doi:10.4236/jsea.2012.56043

MediaLabAmsterdam(2016).DesignMethodToolkit.URL:http://medialabamsterdam.com/toolkit/.Accessed:2016-12-21.(ArchivedbyWebCite®athttp://www.webcitation.org/6mvARqFur)

Page 10: The Value of Agile Methods in Designing for Behavioural ......During sprint one, we conducted an introductory workshop, informing the design team about the Behavioural Lenses toolkit’s

DirkPloosvanAmstel,MartineHeemskerk,ReintJanRenes,SanderHermsen

10

Michie,S.,Abraham,C.,Whittington,C.,McAteer,J.,&Gupta,S.(2009).Effectivetechniquesinhealthyeatingandphysicalactivityinterventions:Ameta-regression.HealthPsychology,28(6),690–701.doi:10.1037/a0016136

Noar,S.M.,Benac,C.N.,&Harris,M.S.(2007).Doestailoringmatter?Meta-analyticreviewoftailoredprinthealthbehaviorchangeinterventions.PsychologicalBulletin,133,673–693.doi:10.1037/0033-2909.133.4.673

Norman,D.(2008).ThePsychologyofWaitingLines.URL:http://www.jnd.org/ms/Norman%20The%20Psychology%20of%20Waiting%20Lines.pdf.Accessed:2016-12-21.(ArchivedbyWebCite®athttp://www.webcitation.org/6mvCIoEz8)

Stickdorn,M.,&Schneider,J.(2012).Thisisservicedesignthinking.Oxford,UK:Wiley&Sons.Taylor,N.,Conner,M.,&Lawton,R.(2011).Theimpactoftheoryontheeffectivenessofworksite

physicalactivityinterventions:Ameta-analysisandmeta-regression.HealthPsychologyReview,6,33–73.doi:10.1080/17437199.2010.533441

Thaler,R.,&Sunstein,C.(2008).Nudge:Thegentlepowerofchoicearchitecture.NewHaven,Conn.:Yale.

VanderZwaag,A.(2016).Looksgood,feelsgood,isgood.Howsocialdesignischangingourworld.Eindhoven,NL:Lecturis.

VanHout,M.&Gootjes,G.(2015).Scream!AnIntegratedApproachforMultidisciplinaryDesignTeamsinHigherEducation.Edulearn15Proceedings,2157-2167.

Woerkum,C.van,&Aarts,N.(2012).Accountability:Newchallenges,newforms.JournalofOrganisationalTransformation&SocialChange,9(3),271–283.doi:10.1386/jots.9.3.271_1

AbouttheAuthors:

DirkPloosvanAmstelisresearcherattheResearchGroupCrossmedialCommunicationinthePublicDomain(Publab)attheUtrechtUniversityofAppliedSciences;hisworkfocusesonevaluatingthepracticalapplicationofmodelsandtoolsindesignsforbehaviouralchangebyreflectivepractitioners(studentsandprofessionals)intheirdailypractice.

MartineHeemskerkisresearcherinthefieldofdesignforbehaviouralchange,campaignstrategies,humanengagementandsocialmediaatUtrechtUniversityofAppliedSciences(Publab&CrossmediaBusinessResearchGroup).

ReintJanRenesisprofessor(lector)ofcross-mediacommunicationinthepublicdomainatPublab.Hespecializesinresearchinto(health)communicationandbehaviouralchange.

SanderHermsenisseniorresearcheratPublab;hisworkfocusesonevaluatingdesignsforbehaviouralchangeandincreasingtheirefficacy,andondevelopingmodelsandtoolkitsthatmakeinsightsfromthebehaviouralsciencesavailablefordesigners.

Acknowledgements:Wewouldliketothankthecommissioner,SchipholAirport,themembersofthestudentDesignTeams,especiallyLizzaKempeandMyrtheKoops,andourcolleaguesfromtheMedialabattheAmsterdamUniversityofAppliedSciences