STPCon Fall 2012

CONFERENCE FALL 2 012

Leadership Perspectives for Testers

Test Strategy, Process and

Design

Agile Testing

Performance Testing

Test Automation

Mobile Application

Testing

Strategic Business

Alignment

Hands-OnPracticals

T H e L e A D i n g C O n f e r e n C e O n S O f T w A r e T e S T i n g

www. ST P Co n .co m 8 7 7 . 2 5 7 . 9 5 3 1

Conference Tracks

OCTOber 15-18 MiaMi , flOridaTh

e Le

ad

ing

Co

nf

er

en

Ce

P a g e 2

regiSTer www.STPCon.com or call 877.257.9531

Conference Packages and PricingMain Conference Package Dates:Wednesday,October16–Friday,October18Price: $1,295.00onorbeforeSeptember7OR

$1,695.00afterSeptember7

n4ExceptionalKeynotesn50ConferenceBreakoutSessionsin

8ComprehensiveTracksnComprehensiveOnlineWebAccesstoAll

ConferenceSessionsandKeynotesnNetworkingActivitiesIncluding:SpeedGeeking

Sessions;Wrap-UpRoundtablesandSponsoredTopicRoundtableDiscussions

nTopIndustryVendorsandParticipationintheSponsorPrizeGiveaway

nThreeBreakfasts,TwoLunchesandHappyHourWelcomeReception

Main Conference Package PLUS 1-Day Dates:Tuesday,October15–Friday,October18Price: $1,695.00onorbeforeSeptember7OR

$2,095.00afterSeptember7

nIncludesALLoftheMainConferencePackageOfferings

nIncludeschoiceofa1-daypre-conferenceworkshopnIncludesapre-conferencebreakfastandlunch

RegistRation I N F O R M A T I O NDiscountsEarlyBirdDiscount:RegisteronorbeforeSeptember7toreceive$400.00offanyfullconferencepackage

Team Discounts

Number of Attendees

Rate Before Early Bird (9/7)

Rate After Early Bird (9/7)

1-2 $1,295 $1,695

3-5 $1,195 $1,395

6-9 $1,095 $1,295

10-14 $995 $1,195

15+ $895 $1,095

*Price above is for access to the Main Conference Package. Please add $400 to your registration if you are registering for the Main Conference Package PLUS 1-Day.

**Team discounts are not combinable with any other discounts/offers. Teams must be from the same company and should be submitted into the online registration system on the same day.

Coast to CoastCoast to CoastCONFERENCE & EXPO 2012

P a g e 3

Registration..........................................2-3

KeynotePresentations..........................4-5

ScheduleataGlance............................6-7

ConferenceTracks................................8-9

Pre-ConferenceWorkshops..............10-11

SessionBlock1................................12-13

SessionBlock2................................14-15

SessionBlock3................................16-17

SessionBlock4................................18-19

SessionBlock5................................20-21

SessionBlock6................................22-23

SessionBlock7................................24-25

SessionBlock8................................26-27

SessionBlock9................................28-29

SessionBlock10..............................30-31

Cancellation Policy:All cancellations must be made in writing. You may cancel without penalty until September 14, 2012 after which a $150 cancellation fee will be charged. No-shows and cancellations after September 28, 2012 will be charged the full conference rate. Cancellation policies apply to both conference and pre-conference workshop registrations.

Table of ConTenTs

Hilton Miami Downtown1601BiscayneBoulevard|Miami,FL33132

Adiscountedconferencerateof$129.00isavailableforconferenceattendees.Call1-800-HILTONSandreferenceGROUP CODE:STP2 / Software Test Professionals Conference rate orvisittheeventwebsiteatwww.stpcon.com/hoteltoreserveyourroomonline.RoomsareavailableuntilSeptember25oruntiltheysellout.Don’tmissyouropportunitytostayattheconferencehotel.

Platinum Sponsor

Conference Hotel

Coast to Coast Conferences Package(For 6 or More Registrations Only – Book Now and Choose Between 2 Conferences)

Dates: Software Test Professionals Conference Fall 2012 (October 16-18, 2012) AND Software Test Professionals Conference Spring 2013 (April 22-24, 2013)

Price: Take advantage of the team discounts listed below – but choose which conference each team member should attend. Register your entire team at the discounted rates listed on the Team Discount Chart below – and then decide which conference they should attend:

n Software Test Professionals Conference Fall 2012in Miami, FL on October 16-18, 2012 OR

n Software Test Professionals Conference Springin San Diego, CA on April 22-24, 2013

9 : 3 0 a m – 1 0 : 3 0 a m

P a g e 4

Tuesday, 16 octoberLEE HensonLEE HensonChiefAgileEnthusiastn AgileDad

Testing agility leads to business fragilityItcomesasnosurprisethatwiththedownfalloftheeconomyintheUS,manyorganizationshavemadetestinganafterthought.Somehavescaledtestingeffortsbacksofarthattheend

producthassufferedmoregreatlythanonecanimagine.Thisisresultinginmajorconsumerfrustrationandagreatlackoforganizationalunderstandingofhowbesttotacklethisissue.Agiledoesnotmeandomorewithless.Aswejourneyintoanewfrontierwheresmallerisbetter,lessismore,andfasterisalwaystherightanswer,traditionaltestingeffortshavebeenmorphedandpickedaparttoonlyincludethepartsthatpeoplewanttoseeandhear.Effectivetestingcanbedoneinanefficientmannerwithoutsacrificingqualityattheendoftheday.Learnbasedonrealworldscenarioshowothershavelearnedaboutandconqueredthisissue.Embarkonajourneywith‘ElyExecutive’asherealizesthevalueandimportanceofqualitytobothhisinternalandexternalcustomer.DiscoverhowahostofinternalandexternalplayershelpElyreachhisconclusionandbaskinthe‘Icanrelatetothat’syndromethisscenariopresents.Thisepicadventurewillsurelyprovememorableandwillbeoneyoudonotwanttomiss!

Lee Henson is currently one of just over 100 Certified Scrum Trainers (CST) worldwide. He is also a Project Management Professional (PMP) and a PMI-Agile Certified Practitioner and has worked as a GUI web developer, quality assurance analyst, automated test engineer, QA Manager, product manager, project manager, ScrumMaster, agile coach, consultant, & training professional. Lee is a graduate of the Disney Management Institute and is the author of the Definitive Agile Checklist. He publishes the Agile Mentor Newsletter.

Wednesday, 17 octoberjEff Havensjeff HavensSpeakern Trainern Author

Uncrapify Your life!Thisaward-winningkeynoteisastudyinexactlywhatnottodo.Promisingtogivehisaudiencespermissionratherthanadvice,Jeffwill‘encourage’yourteamtocriticizeothersandoutsourceblame

beforebringingitallhomewithaseriousdiscussionaboutpropercommunication,customerservice,andaccountabilitypractices.Tiredofbeingtoldwhattodo.Sickofattendingsessionsthattellyouhowtobecomeabettercommunicatororamoreeffectiveleader,andyoudefinitelydon’twanttohearanymoregarbageabouteffectivechangemanagement.Experiencesomethingdifferent.Youwon’tbetoldwhattodo.Instead,youwillbegivenpermissiontodoallofthethingsyou’vealwayswantedtodo–tobecometheworstpersonyoucanpossiblybe–tobesurethatyouareconvenientlyleftoffofcompanyemailsinvitingyoutosocialfunctions.Andifyou’renotcareful,youmightactuallylearnsomething.

Session Takeaways:

n Howtoavoidnegativeandunproductiveconversationsn Thepowerofsincere,straightforwardcommunicationn Howtoapproachchangeinordertoachieveseamlessintegration

A Phi Beta Kappa graduate of Vanderbilt University, Jeff Haven began his career as a high school English teacher before branching into the world of stand-up comedy, where he worked with some of the brightest lights in American comedy and honed the art of engaging audiences through laughter. But his impulse to teach never faded, and soon he began looking for an avenue to combine both of his passions into entertaining and meaningful presentations.

P a g e 4

keynotes9 : 0 0 a m – 1 0 : 1 5 a m


P a g e 5

Thursday, 18 october(9:00am – 10:00am)

KarEn n. JohnsonKaren n. JohnsonFoundern Software Test Management, Inc.

The Discipline aspect of software TestingYourmissionistoregressiontestawebsitefortheumpteenthtime,preferablywithfresheyesandathoroughreview.Afterall,you’retheoneholdingupthissoftwarefrombeingusedby

payingcustomers.Thepressuremountsandyetprocrastinationtakeshold.

It’stime,timetorollupyoursleevesandfinishtheworkathandandyet,youjustdon’tfeellikeit.Howdoyoudisciplineyourselftogetthejobdone?Discipline.Focus.Howdoyoupullonthereservoirsofthesenecessaryskills?Howdoweinvokedisciplinetogetthejobdone?Tobeginwith,youhavetoadmityouhaveachallengetoovercomeandinthispresentation,therealityofneedingtobedisciplinedandfocusedtogetworkdone,mostespeciallygettingworkdoneunderpressure,willbediscussed.

Tacticswillbesharedforgettingthroughstacksofworkwhenyoudon’tfeelinspired.Wewilllookathowtobuildrigoranddisciplineintoyourpracticeinsoftwaretesting.Softwaretestingtakesacertainamountofdisciplineandrigor;ittakestheabilitytofocusandthinkwhilefrequentlyunderstressfulconditions.Thispresentationwillprovideanhonestlookat(aswellaspracticaltips)howtobuildrigoranddisciplineintoyourpracticeinsoftwaretesting.

Karen N. Johnson is an independent software test consultant. She is a frequent speaker at conferences. Karen is a contributing author to the book, Beautiful Testing released by O’Reilly publishers. She is the co-founder of the WREST workshop, more information on WREST can be found at: http://www.wrestworkshop.com/Home.html. She has published numerous articles and blogs about her experiences with software testing. You can visit her website at: http://www.karennjohnson.com.

Wednesday, 17 october(This keynote will be offered immediately following lunch from 2:00pm – 2:45pm)

Matt JohnstonMatt Johnston

P a g e 5


CMOn uTest

Mobile Market Metrics: breaking Through the HypeServingconsumers’voraciousappetiteforsmartphones,tablets,e-readers,gamingconsoles,connectTVsandapps–advancementsinmobiletechnologyarehappeningatwarpspeed.

Manufacturers,carriersandappmakershavealltheirchipsonthetable,launchingdozensofuniquedevicesperyear,releasingnewandimprovedoperatingsystems,andaligningbehindamultitudeofbrowsersandOSstandards.It’sadizzyingtaskfortestandengineeringprofessionalstokeepupwithallthechanges,letalonefigureoutwhichonesneedtobesupportedintheirindustry,intheircompany,andintheirdepartment.Yet,despiteallthefragmentationintoday’smobileuniverse,techprofessionalshavetomakedifficultchoices.Daunting?Yes.Butthere’ssomethingbetterthantealeavesandacrystalballtotakesomeofthe“guess”outofourguesstimations:mobilemarkettrendsandstatistics.

We’lllookatawidevarietyofmobilemetricsthatcutthroughthehype,comparingthegrowing(andwaning)popularityofdifferentdevices,operatingsystemsandrelatedtechthatmayinfluenceattendees’testinganddevelopmentdecisions.Roundingoutthediscussion,we’llendwithforward-lookinginsightsintothemostpromising,emergingtechnologies.

Matt Johnston leads uTest’s marketing and community efforts as CMO, with more than a decade of marketing experience at companies ranging from early-stage startups to publicly traded enterprises. He continues to lead uTest’s efforts in shaping the brand, building awareness, generating leads and creating a world-class community of testers. Matt earned a B.A. in Marketing from Calvin College, as well as an MBA in Marketing & Technology from New York University’s Stern School of Business.

P a g e 6


Monday, october 15, 2012 8:00am-4:00pm Registration&Information

8:00am-9:00am ContinentalBreakfast&Networking

9:00am-4:00pm Pre-Conference Workshops Pre-1:MobileTestAutomation (Brad Johnson, Fred Beringer) Pre-2:TestingMetrics:Process,Project,andProduct (Rex Black) Pre-3:NewWorldPerformance(Mark Tomlinson) Pre-4:Hands-on:RemoteTestingforCommonWebApplicationSecurityThreats(David Rhoades)

10:30am-11:00am MorningBeverageBreak

12:30pm-1:30pm Lunch

3:00pm-3:30pm AfternoonBeverageBreak

Tuesday, october 16, 20128:00am-8:00pm Registration&Information

8:00am-9:00am Breakfast

9:00am-10:15am General Session: TestingAgilityLeadstoBusinessFragility(Lee Henson)

10:30am-11:45am Session Block 1 101:PreparingtheQABudget,Effort&TestActivities–Part1(Paul Fratellone) 102:TestingwithChaos(James Sivak) 103:AtoZTestinginProduction:IndustryLeadingTechniquestoLeverageBigDataforQuality (Seth Elliott) 104:MobileTestAutomationforEnterprise&BusinessApplications(Sreekanth Singaraju) 105:TestLikeaNinja:Hands-OnQuickAttacks(Andy Tinkham)

11:45am-12:00pm MorningBeverageBreak

12:00pm-1:15pm Session Block 2 201:PreparingtheQABudget,Effort&TestActivities–Part2(Paul Fratellone) 202:SoftwareReliability,theDefinitiveMeasureofQuality (Lia Johnson) 203:CSI:Miami–SolvingApplicationPerformanceWhodunits(Kerry Field) 204:BuildingaSolidFoundationforAgileTesting (Robert Walsh) 205:ComplementVirtualTestLabswithServiceVirtualization (Wayne Ariola)

1:15pm-2:30pm Lunch&SpeedGeeking

2:30pm-3:45pm Session Block 3 301:LeadingCulturalChangeinaCommunityofTesters(Keith Klain) 302:SoftwareTestingHeuristics&Mnemonics(Karen Johnson) 303:InterpretingandReportingPerformanceTestResults–Part1(Dan Downing) 304:FindingtheSweetSpot–MobileDeviceTestingDiversity(Sherri Sobanski) 305:TheTroublewithTroubleshooting(Brian Gerhardt)

4:00pm-4:30pm ToolsandTrendsShowcase


4:45pm-6:00pm Session Block 4 401:Don’tIgnoretheManBehindtheCurtain(Bradley Baird) 402:OptimizingModularTestAutomation(David Dang) 403:InterpretingandReportingPerformanceTestResults–Part2(Dan Downing) 404:Agilevs.Fragile:ADisciplinedApproachoranExcuseforChaos (Brian Copeland) 405:MobileSoftwareTestingExperience (Todd Schultz)

6:00pm-8:00pm ExhibitorHours

6:00pm-8:00pm HappyHourWelcomeReception

O c t o b e r 1 5 – 1 8 , 2 0 1 2

schedule at a glance

CONFERENCE FALL 2012

P a g e 7

Wednesday, october 17, 20128:00am-6:00pm Registration&Information

8:00am-9:00am Breakfast&SponsorRoundtables

9:00am-10:15am General Session & Sponsor Prize Giveaway: UncrapifyYourLife(Jeff Havens)

10:30am-11:45am Session Block 5 501:BuildingASuccessfulTestCenterofExcellence–Part1(Mike Lyles) 502:HowtoPreventDefects(Dwight Lamppert) 503:TheTestingRenaissanceHasArrived–OnaniPadintheCloud(Brad Johnson) 504:Non-RegressionTestAutomation–Part1(Doug Hoffman) 505:Slow-MotionPerformanceAnalysis(Mark Tomlinson)

11:45am-12:00pm MorningBeverageBreak

12:00pm-1:15pm Session Block 6 601:BuildingASuccessfulTestCenterofExcellence–Part2(Mike Lyles) 602:AetnaCaseStudy–ModelOffice(Fariba Marvasti) 603:ApplicationPerformanceTestPlanningBestPractices(Scott Moore) 604:Non-RegressionTestAutomation–Part2(Doug Hoffman) 605:KeepingUp!(Robert Walsh)

1:15pm-2:45pm Lunch

2:00pm-2:45pm General Session:MobileMarketMetrics:BreakingThroughTheHype(Matt Johnston)

3:00pm-4:15pm Session Block 7 701:TechnicalDebt:ATreasuretoDiscoverandDestroy(Lee Henson) 702:DependenciesGoneWild:TestingCompositeApplications(Wayne Ariola) 703:Top3PerformanceLandMinesandHowtoAddressThem(Andreas Grabner) 704:BuildingAutomationFromtheBottomUp,NottheTopDown(Jamie Condit) 705:ThereCanOnlyBeOne:ATestingCompetition–Part1(Matt Heusser)


4:30pm-5:45pm Session Block 8 801:MaintainingQualityinaPeriodofExplosiveGrowth–ACaseStudy (Todd Schultz) 802:TestingintheWorldofKanban–TheEvolution(Carl Shaulis) 803:RefocusingTestingStrategyWithintheContextofProductMaturity (Anna Royzman) 804:MobileTesting:Tools,Techniques&TargetDevices(Uday Thongai) 805:ThereCanOnlyBeOne:ATestingCompetition–Part2(Matt Heusser)

Thursday, october 18, 20128:00am-1:00pm Registration&Information

8:00am-9:00am Breakfast&WrapUpRoundtables

9:00am-10:00am General Session: TheDisciplineAspectofSoftwareTesting(Karen N. Johnson)

10:15am-11:30am Session Block 9 901:7HabitsofHighlyEffectiveTesters (Rakesh Ranjan) 902:AdvancesinSoftwareTesting–APanelDiscussion (Matt Heusser) 903:PerformanceTestingMetricsandMeasures (Mark Tomlinson) 904:HowandWheretoInvestYourTestingAutomationBudget(Sreekanth Singaraju) 905:Memory,PowerandBandwidth–ohMy!MobileTestingBeyondtheGUI(JeanAnn Harrison)

11:30am-11:45am MorningBeverageBreak

11:45am-1:00pm Session Block 10 1001:RedefiningthePurposeofSoftwareTesting (Joseph Ours) 1002:EvaluatingandImprovingUsability(Philip Lew) 1003:RealWorldPerformanceTestinginProduction(Dan Bartow) 1004:ScalingGracefullyandTestingResponsively(Richard Kriheli) 1005:Quick,Easy&UsefulPerformanceTesting:NoToolsRequired(Scott Barber)

P a g e 8

a d v a n c e d e d u c a t i o n

conference tracksleadership Perspectives for Testers

Understandingthebusinesssideoftestingisasimportantasamplifyingourapproachesandtechniques.Inthistrackyouwilllearnhowtobuildatestingbudget,effectivelymanagetestteams,communicatewithstakeholders,andadvocatefortesting.

101: PreparingtheQABudget,Effort&TestActivities–Part1201: PreparingtheQABudget,Effort&TestActivities–Part2401: Don’tIgnoretheManBehindtheCurtain701: TechnicalDebt:ATreasuretoDiscoverandDestroy801: MaintainingQualityinaPeriodofExplosiveGrowth–ACaseStudy901: 7HabitsofHighlyEffectiveTesters1001:RedefiningthePurposeofSoftwareTesting

strategic business alignment

Thebestwaytoensurethatthegoalsofyourprojectandtheorganizationaremetattheendofproduction,istomakesuretheyarealignedfromthebeginning.Thiswillrequireanabilitytoeffectivelyleaddiverseteamsandgainbuy-inandagreementthroughoutthelifeoftheproject.Thistrackwilloffersessionsbasedonreallifeexperiences

andcasestudieswheretruebusinessalignmentwasachievedresultinginasuccessfuloutcome.

202: SoftwareReliability,TheDefinitiveMeasureofQuality301: LeadingCulturalChangeinaCommunityofTesters501: BuildingASuccessfulTestCenterofExcellence–Part1601: BuildingaSuccessfulTestCenterofExcellence–Part2

Test strategy, Process and Design

Beforeyoubegintestingonaproject,yourteamshouldhaveaformalorinformalteststrategy.Therearekeyelementsyouneedtoconsiderwhenformulatingyourteststrategy.Ifnot,youmaybewastingvaluabletime,moneyandresources.Inthistrackyouwilllearnthestrategicandpracticalapproachestosoftwaretestingand

testcasedesign,basedontheunderlyingsoftwaredevelopmentmethodology.

102: TestingwithChaos302: SoftwareTestingHeuristics&Mnemonics502: HowtoPreventDefects602: AetnaCaseStudy–ModelOffice702: DependenciesGoneWild:TestingCompositeApplications802: TestingintheWorldofKanban–TheEvolution902: AdvancesinSoftwareTesting–APanelDiscussion1002:EvaluatingandImprovingUsability

Performance Testing

PerformanceTestingisaboutcollectingdataonhowapplicationsperformtoassistthedevelopmentteamandthestakeholdersmaketechnicalandbusinessdecisionsrelatedtoperformancerisks.Inthistrackyouwilllearnpracticalskills,tools,andtechniquesforplanningandexecutingeffectiveperformancetests.Thistrackwillinclude

topicssuchas:performancetestingvirtualizedsystems,performanceanti-patterns,howtoquantifyperformancetestingrisk,allillustratedwithpractitioners’actualexperiencesdoingperformancetesting.

103: AtoZTestinginProduction:IndustryLeadingTechniquestoLeverageBigDataforQuality203: CSI:Miami–SolvingApplicationPerformanceWhodunits303: InterpretingandReportingPerformanceTestResults–Part1403: InterpretingandReportingPerformanceTestResults–Part2603: ApplicationPerformanceTestPlanningBestPractices703: Top3PerformanceLandMinesandHowtoAddressThem903: PerformanceTestingMetricsandMeasures1003:RealWorldPerformanceTestinginProduction

CONFERENCE FALL 2012

P a g e 9

Test automation

Whichtestscanbeautomated?Whattoolsandmethodologycanbeusedforautomatingfunctionalityverification?Chancesarethesearesomeofthequestionsyouarecurrentlyfacingfromyourprojectmanager.Inthistrackyouwilllearnhowtoimplementanautomationframeworkandhowtoorganizetestscriptsformaintenance

andreusability,aswellastakeawaytipsonhowtomakeyourautomationframeworkmoreefficient.

205: ComplementVirtualTestLabswithServiceVirtualization402: OptimizingModularTestAutomation504: Non-RegressionTestAutomation–Part1604: Non-RegressionTestAutomation–Part2704: BuildingAutomationFromtheBottomUp,NottheTopDown904: HowandWheretoInvestYourTestingAutomationBudget

agile Testing

TheManifestoforAgileSoftwareDevelopmentwassignedoveradecadeago.TheAgileframework’sfocusonagilityisanythingbutundisciplined.ThistrackwillhelpparticipantsunderstandhowtheycanfittraditionaltestpracticesintoanAgileenvironmentaswellasexplorereal-worldexamplesoftestingprojectsandteams

invaryingdegreesofAgileadoption.

204: BuildingaSolidFoundationForAgileTesting404: AgilevsFragile:ADisciplinedApproachoranExcuseforChaos605: KeepingUp!803: RefocusingTestingStrategyWithintheContextofProductMaturity

Mobile application Testing

Therapidexpansionofmobiledevicesoftwareisalteringthewayweexchangeinformationanddobusiness.Thesedayssmartphoneshavebeenintegratedintoagrowingnumberofbusinessprocesses.Developingandtestingsoftwareformobiledevicespresentsitsownsetofchallenges.Inthistrackparticipantswilllearnmobile

testingtechniquesfromreal-worldexperiencesaspresentedbyaselectionofindustryexperts.

104: MobileTestAutomationforEnterprise&BusinessApplications304: FindingtheSweetSpot–MobileDeviceTestingDiversity503: TheTestingRenaissanceHasArrived(onaniPadintheCloud)804: MobileTesting:Tools,Techniques&TargetDevices1004:ScalingGracefullyandTestingResponsively

Hands-on Practicals

Thistrackisuniquelydesignedtocombinethebestsoftwaretestingtheorieswithreal-worldtechniques.Participantswillactuallylearnbydoinginthishands-onformatsimulatingrealistictestenvironments.Afterall,applyingtechniqueslearnedinaclassroomtoyourindividualneedsandrequirementscanbe

challenging.Seventechnicalsessionscoveringawiderangeoftestingtopicswillbepresented.Participantsmustbringalaptopcomputerandpowercord.

105: TestLikeaNinja:Hands-OnQuickAttacks305: TheTroublewithTroubleshooting405: MobileSoftwareTestingExperience505: Slow-MotionPerformanceAnalysis705: ThereCanBeOnlyOne:ATestingCompetition(Part1)805: ThereCanBeOnlyOne:ATestingCompettition(Part2)905: Memory,PowerandBandwidth–OhMy!MobileTestingBeyondtheGUI

P a g e 1 0


Monday15 october9 : 0 0 a m – 4 : 0 0 p m

Pre-1 Fred Beringer, VP, Product Management,SOASTA

Brad Johnson, VP Product and Channel Marketing,SOASTA Mobile Test automation Inthisfull-dayworkshop,youwillleavewiththeskillsandtoolstobeginimplementingyourmobilefunctionaltestautomationstrategy.SOASTA’sFredBeringerandBradJohnsonwillwalkyouthroughthebasics:

nCreatingyourplanof“WhattoTest”nEnablingamobileapptobetestablenCapturingyourfirsttestcasesnSettingvalidationsanderrorconditionsnRunningandexecutingmobilefunctionaltestcasesnFunandGames:MobileTestAutomationHackathon!

AttendeeswillbeprovidedfreeaccessandcredentialstotheCloudTestplatformforthissession.Testswillbebuiltandexecutedusingattendees’ownIOSorAndroidmobiledevices,socomewithyoursmartphoneschargedandreadytobecomepartoftheSTPConFallMobileDeviceTestCloud!

Brad Johnson joined the front lines of the Testing Renaissance in 2009 when he signed on with SOASTA to deliver testing on the CloudTest platform to a skeptical and established software testing market.

Fred Beringer has 15 years ofsoftware development and testing experience managing large organizations where he was responsible for developing software and applications for customers.

Pre-2 Rex Black, President,RBCS

Testing Metrics: Process, Project, and Product Someofourfavoriteengagementsinvolvehelpingclientsimplementmetricsprogramsfortesting.Factsandmeasuresarethefoundationoftrueunderstanding,butmisuseofmetricsisthecauseofmuchconfusion.Howcanweusemetricstomanagetesting?Whatmetricscanweusetomeasurethetestprocess?Whatmetricscanweusetomeasureourprogressintestingaproject?Whatdometricstellusaboutthequalityoftheproduct?Inthisworkhop,Rexwillsharesomethingshe’slearnedaboutmetricsthatyoucanputtoworkrightaway,andyou’llworkonsomepracticalexercisestodevelopmetricsforyourtesting.

Workshop Outline

1.Introduction

2.TheHowandWhyofMetricsnPresentationnExercise

3.ProcessMetricsnPresentationnCasestudynExercise

4.ProjectMetricsnPresentationnCasestudynExercise

5.ProductMetricsnPresentationnCasestudynExercise

6.Conclusion

Learning Objectives

nUnderstandtherelationshipbetweenobjectivesandmetrics

nForagivenobjective,createoneormoremetricsandsetgoalsforthosemetrics

nUnderstandtheuseofmetricsforprocess,project,andproductmeasurement

nCreatemetricstomeasureeffectiveness,efficiency,andstakeholdersatisfactionforatestprocess

nCreatemetricstomeasureeffectiveness,efficiency,andstakeholdersatisfactionforatestproject

nCreatemetricstomeasureeffectiveness,efficiency,andstakeholdersatisfactionforaproductbeingtested

Rex Black is a prolific author, practicing in the field of software testing today. His first book, Managing the Testing Process, has sold over 50,000 copies.

workshopsP r e - C o n f e r e n c e

P a g e 1 1


Pre-2 Testing Metrics: Process, Project, and Product Someofourfavoriteengagementsinvolvehelpingclientsimplementmetricsprogramsfortesting.Factsandmeasuresarethefoundationoftrueunderstanding,butmisuseofmetricsisthecauseofmuchconfusion.Howcanweusemetricstomanagetesting?Whatmetricscanweusetomeasurethetestprocess?Whatmetricscanweusetomeasureourprogressintestingaproject?Whatdometricstellusaboutthequalityoftheproduct?Inthisworkhop,Rexwillsharesomethingshe’slearnedaboutmetricsthatyoucanputtoworkrightaway,andyou’llworkonsomepracticalexercisestodevelopmetricsforyourtesting.

Workshop Outline

4.ProjectMetricsnPresentationnCasestudynExercise

5.ProductMetricsnPresentationnCasestudynExercise

6.Conclusion

Learning Objectives

nUnderstandtherelationshipbetweenobjectivesandmetrics

nForagivenobjective,createoneormoremetricsandsetgoalsforthosemetrics

nUnderstandtheuseofmetricsforprocess,project,andproductmeasurement

nCreatemetricstomeasureeffectiveness,efficiency,andstakeholdersatisfactionforatestprocess

nCreatemetricstomeasureeffectiveness,efficiency,andstakeholdersatisfactionforatestproject

nCreatemetricstomeasureeffectiveness,efficiency,andstakeholdersatisfactionforaproductbeingtested

Pre-3 Mark Tomlinson, President,West Evergreen Consulting, LLC

new World PerformanceIt’salwaysasignificantchallengeperformancetestersandengineerstokeepupwiththebreadthofhotnewtechnologiesandinnovationscomingataferociouspaceinourindustry.Notonlyhasthetechnologyandsystemlandscapechangedinthelastfewyears,butthemethodsandtechniquesforperformancetestingarealsoupdatingrapidly.Ourresponsibilityasperformancetestersandengineersistolearnandmasterthesenewapproachestoperformancetesting,optimizationandmanagementandserveourorganizationswiththemostvaluableknowledgeandskillpossible.InmytravelsI’veoftenheardquestionsfromfellowperformancetesters:Outofallthenewtechnologiesoutthere,whatshouldIbelearning?Whatnewtoolsforperformanceareoutthere?HowdoIbetterfitinwithagiledevelopmentandoperations?HowdoIupdatedandrefreshmyskillstokeepcurrentandvaluabletomycompany?SpendadaywithMarkandyouwillfindanswerstothesequestions.

Mark’sworkshopwillhelpyoutobebetterpreparedtochartyourowncourseforthefutureofperformanceandyourcareer.Markwillsharewithyouthemostrecentdevelopmentsinperformancetestingtools,approachesandtechniques;howtobestconsideryourcurrentandfuturestrategyaroundperformance.

Workshop Outline

nIntroductiontotheNewWorldofPerformancenNewApproachesandMethodsnNewPerformanceRolesnNewSkillsandTechniquesnNewPerformanceToolsnConclusion

Mark Tomlinsonis a software tester and test engineer. His first test project in 1992 sought to prevent trains from running into each other – and Mark has metaphorically been preventing “train wrecks” for his customers for the past 20 years.

Pre-4 David Rhoades, Senior Consultant,Maven Security Consulting, Inc.

Hands-on: Remote Testing for Common Web application security ThreatsTheproliferationofweb-basedapplicationshasincreasedtheenterprise’sexposuretoavarietyofthreats.Thereareoverarchingstepsthatcanandshouldbetakenatvariousstepsintheapplication’slifecycletopreventormitigatethesethreats,suchasimplementingsecuredesignandcodingpractices,performingsourcecodeaudits,andmaintainingproperaudittrailstodetectunauthorizeduse.

Thisworkshop,throughhands-onlabsanddemonstrations,willintroducethestudenttothetoolsandtechniquesneededtoremotelydetectandvalidatethepresenceofcommoninsecurityforweb-basedapplications.Testingwillbeconductedfromtheperspectiveoftheenduser(asopposedtoasourcecodeaudit).Securitytestinghelpstofulfillindustrybestpracticesandvalidateimplementation.Securitytestingisespeciallyusefulsinceitcanbedoneatvariousphaseswithintheapplication’slifecycle(e.g.duringdevelopment),orwhensourcecodeisnotavailableforreview.

Thisworkshopwillfocusonthemostpopularandcriticalthreatsfacingwebapplications,suchascross-sitescripting(XSS)andSQLinjection,basedontheindustrystandardOWASP“TopTen.”Thefoundationlearnedinthisclasswillenablethestudenttogobeyondthetoptenviaself-directedlearningusingotherindustryresources,suchastheOWASPTestingGuide.

David Rhoadesis a senior consultant with Maven Security Consulting Inc. which provides information security assessments and training services to a global clientele. His expertise includes web application security, network security architectures, and vulnerability assessments.

P a g e 1 2

session block 1


Andy Tinkhamisanexpertconsultant,focusingonallaspectsofqualityandsoftwaretesting(butmostofall,testautomation).Currently,heconsultsforaMagenic,aleadingproviderof.NETandtestingservices.

James Sivakhasbeeninthecomputertechnologyfieldforover35years,beginningwiththeSpaceShuttleandovertheyearshasencompassedwarehousesystems,cyclotrons,operatingsystems,andnowvirtualdesktops.

Sreekanth Singarajuhasmorethan12yearsofseniortechnologyleadershipexperienceandleadsAlliance’sQA&Testingorganizationindevelopingcuttingedgesolutions.

Paul Fratellone,a25yearcareerveteraninqualityandtesting,hasbeenaDirectorofQAandiswell-seasonedinpreparingdepartmentwidebudgets.

Seth EliotisSeniorKnowledgeEngineerforMicrosoftTestExcellencefocusingondrivingbestpracticesforservicesandclouddevelopmentandtestingacrossthecompany.

1 0 : 3 0 a m – 1 1 : 4 5 a m

Tuesday16 october

101 Paul Fratellone, ProgramDirectorQuality&TestConsulting,MindTree Consulting

Preparing the Qa budget, effort & Test activities – Part 1Thissessionwillbeanintroductiontopreparingatestteambudgetnotonlyfromamanpowerperspectivebutalsofromtheperspectiveoftestingeffortestimationandforecasting.Thespeakerwillbepullingfromreal-lifescenariosthathavecoveredamyriadofsituationsofcreatingorinheritingabudgetfortestingservices.Usingtheseexperiences,thespeakerwillhighlightgoodpracticesandsuccessesinadditiontopitfallstoavoid.Howtodevelopabudgetforbothprojectbased(largeenterprisewideprojectsthroughmid-sized)andportfolio/programtestingservicessupportacrosstheorganizationwillbepresented.Inpartone,thefinancial/accountingaspectsofabudget(high-level)willbediscussedandhowfull-timeequivalents(FTEs)aretrulyaccounted;thedetailsofa“fullyloaded”resourcewillbeexplained;andthedifferencebetweencapitalandoperationalexpendituresandpotentialtaxeffectswillbepresented.Wewillalsodeveloparesourceestimationmodelthatrepresentsreal-worldsituationsandintroduceconfidenceandlevels/iterationsofabudget/resourceplan.

Session Takeaways:

nHowtoprepareaQA/TestingDepartmentBudgetnHowtocreateanestimationmodel

102 James Sivak,DirectorofQA,Unidesk

Testing with ChaosTesterscanbecomesofocusedonthetestingathandandhowtomakethatasefficientaspossible(generallydrivenbymanagementdirectives)thatenvironmentsandtestsunconsciouslygetmissed.Broadeningthevisiontoincludeideasfromchaosandcomplexitytheoriescanhelptodiscoverwhycertainclassesofbugsonlygetfoundbythecustomer.Thispresentationwillintroducetheseideasandhowtheycanbeappliedtotestsandtestenvironments.Incorporatingrandomnessintotests

P a g e 1 3


andthetestenvironmentswillbediscussed.Inaddition,thoughtsonwhattoanalyzeincustomerenvironments,lookingthroughthelensofcomplexity,willbepresented.Comparisonsofenvironmentswithandwithoutfacetsofchaoswillbedetailedtogivetheaudienceconcreteexamples.Otherexamplesofintroducingrandomnessintotestswillbeprovided.Youwillwalkawaywithideasonwhyandhowtoaddchaostoyourtesting,catchinganotherclassofbugsbeforeyourcustomersdo.

Session Takeaways:

nIdeasonwhatmakestestingandtestenvironmentscomplex

nBenefitsofaddingchaostothetestingnVisionperspectivesinviewingcurrenttest

environmentsandhowtodisruptthetestingparadigm

103 Seth Eliot, SeniorKnowledgeEngineerinTest,Microsoft

a to Z Testing in Production: Industry leading Techniques to leverage big Data for QualityTestinginproduction(TiP)isasetofsoftwaremethodologiesthatderivequalityassessmentsnotfromtestresultsruninalabbutfromwhereyourservicesactuallyrun–inproduction.Thebigdatapipefromrealusersandproductionenvironmentscanbeusedinawaythatbothleveragesthediversityofproductionwhilemitigatingriskstoendusers.Byleveragingthisdiversityofproductionweareabletoexercisecodepathsandusecasesthatwewereunabletoachieveinourtestlabordidnotanticipateinourtestplanning.

ThissessionintroducestestmanagersandarchitectstoTiPandgivesthesedecisionmakersthetoolstodevelopaTiPstrategyfortheirservice.MethodologieslikeControlledTestFlights,SyntheticTestinProduction,Load/CapacityTestinProduction,DataMining,DestructiveTestingandmoreareillustratedwithexamplesfromMicrosoft,Netflix,Amazon,andGoogle.ParticipantswillseehowthesestrategiesboostROIbymovingfocustolivesiteoperationsastheirsignalforquality.

104 Sreekanth Singaraju, VPofTestingServices,Alliance Global Services

Mobile Test automation for enterprise & business applications

WiththecommercializationofIT,mobileappsareincreasinglybecomingastandardformatofdeliveringapplicationsinenterprisesalongsideWebapplications.Testingorganizationsintheseenterprisesarefacingtheprospectofaddingnewtestinginterfacesanddevicestothelonglistofexistingneeds.Thissessionwillshowcaseanapproachandframeworktodevelopingasuccessfulmobiletestautomationstrategyusingreallifeexamples.UsingaframeworkdevelopedbyintegratingRobotiumandSelenium,thissessionwillwalkparticipantsthroughanapproachtodevelopinganintegratedtestautomationframeworkthatcantestapplicationswithwebandmobileinterfaces.

Thissessionhighlightsthefollowingkeyaspectsofdevelopinganintegratedautomationframework:

nMobiletestautomationstrategynTestdatamanagementnReportingnTestLabconfiguration,includingmulti-device

managementnChallenges,lessonslearnedandbestpractices

todevelopasuccessfulframework

105 Andy Tinkham, PrincipalConsultant,Magenic

Test like a ninja: Hands-on Quick attacksInthissession,we’lltalkaboutquickattacks–smallteststhatcanbedonerapidlytofindcertainclassesofbugs.Thesetestsareeasytorunandrequirelittletonoupfrontplanning,whichmakesthemidealforquicklygettingfeedbackonyourapplicationundertest.Inthissession,we’llbrieflytalkaboutwhatquicktestsareandthendiveintospecificattacks,tryingthemonsampleapplications(ormaybeevensomerealapplications!).Thisisahands-onsession,sobringalaptoporpairwithsomeonewhohasone,andtrythesetechniquesliveinthesession!

Session Takeaways:

nAknowledgeofsomequickteststhatyoucanuseimmediatelyinyourowntesting

nSpecifictoolsandtechniquestoexecutethesequicktests

nExperienceexecutingthequicktestsnReferencesforfurtherexplorationofquick

testsandhowtheycanbeapplied

session block

P a g e 1 4


Tuesday16 october

201 Paul Fratellone,ProgramDirectorQuality&TestConsulting,MindTree Consulting

Preparing the Qa budget, effort & Test activities – Part 2InPart2ofthissession,thespeakerwillshowcaseexcel-basedworksheetstodemonstratetesteffort,testcyclesandtestcasemodelingtechniquesandhowtointroduceconfidenceinescalatinglevels/iterationsofabudgetasinformationincreasesinstabilityandaccuracythroughoutaproject/testingsupportactivity.Coveredwillalsobetheeffectsofthedeliverylifecyclemethodsandbudgeting.Howwilltestingbudgetsdifferbetweenwaterfallandagiledeliverymethods/lifecycles?

Session Takeaways:

nHowtobudgetfortestcyclesnDealingwithAgilevs.Waterfallprojectbudgets

202 Lia Johnson,Manager,Drilling&EvaluationSoftwareTesting,Baker Hughes Inc.

software Reliability, The Definitive Measure of QualityThroughouttheprojectlife-cycle,measuresofquality,testsuccess,andtestcompletionareindicativeofprogress.Theculminationofthesemetricsisoftendifficultforsomestakeholderstotranslateforacceptance.Softwarereliabilitydependenciesbeginwithmodeldriventestsderivedfromuse-cases/userstoriesiniterativeoragiledevelopmentmethodologies.Aligningthetestprocesswithaproject’sdevelopmentmethodologyandinmanycasesPDMisintegraltoachievingacceptablelevelsofsoftwarereliability.Relevantdependenciesthatimpactsoftwarereliabilitybeginwithtestfirst,testcontinuously.Somedependenciesarewithinthescopeofresponsibilityforsoftwaretestprofessionals.Othersrequirecollaborationwiththeentireprojectteam.Developingapplicationsaccordingtostandardcodingpracticesisalsoessentialtoattainsoftwarequality.Unittestsdevelopedandexecutedsuccessfullyimpactsoftwarequality.Thesedependenciesandmorewillbediscussedasweexplorethedefinitivemeasureofquality,softwarereliability.

Robert Walsh, aproponentofAgilesoftwaredevelopmentprocessesandtechniques,believesstronglyindeliveringqualitysolutionsthatsolverealcustomerproblemsandprovidetangiblebusinessvalue.

Lia JohnsonbeganhercareerattheCIAandNASAasasoftwaredeveloperupongraduationfromLamarUniversitywithaBBAinComputerScienceandisnowworkingforBakerHughesIncorporatedasaSoftwareTestingManager.

Paul Fratellone,a25yearcareerveteraninqualityandtesting,hasbeenaDirectorofQAandiswell-seasonedinpreparingdepartmentwidebudgets.

Kerry Fieldhasover35yearsofexperienceinIT,includingapplicationsdevelopment,productandservicesupport,systemsandnetworkmanagement,functionalQA,capacityplanning,andapplicationperformance.

Wayne AriolaisVicePresidentofStrategyandCorporateDevelopmentatParasoft,aleadingproviderofintegratedsoftwaredevelopmentmanagement,qualitylifecyclemanagement,anddev/testenvironmentmanagementsolutions.

21 2 : 0 0 p m – 1 : 1 5 p m


P a g e 1 5

Session Takeaways:

nTheDefinitiveMeasureofQualitynTheImportanceofProcessAlignmentto

DevelopmentMethodologiesnDependenciesofSoftwareReliability

203 Kerry Field,APMSpecialist,CSSManagementTeam,US Bank

CsI: Miami – solving application Performance WhodunitsApplicationperformanceproblemscontinuetohappendespitealltheresourcescompaniesemploytopreventthem.Whentheproblemisdifficulttosolve,theorganizationwilloftenbringinoutsideexpertise.WeseeasimilarthemeplayedoutonTVdetectiveshows.Whenthelocalauthoritiesarebaffled,thelikesofaJimRockford,Lt.Columbo,orAdrianMonkarebroughtin.Thesefictionaldetectivesroutinelysolveddifficultcasesbyapplyingtheiruniquepowersofobservation,intuition,anddeductivereasoning.Thewritersalsogaveeachcharacterauniquebackgroundoroddpersonalitytraitthatenhancedtheirentertainmentvalue.Solvingrealworldperformanceproblemsrequiresmuchmorethanacombinationofindividualskillsandanentertainingpersonality.Thissessionwillpresentexamplesofreallifeapplicationperformanceissuestakenfromtheauthor’scasefilestoillustratehowsuccessfulresolutiondependsoneffectiveteamwork,soundtroubleshootingprocess,andappropriateforensictools.

204 Robert Walsh,SeniorConsultant,Excalibur Solutions, Inc.

building a solid foundation for agile TestingSoftwaretestinginAgiledevelopmentenvironmentshasbecomeapopulartopicrecently.SomebelievethatconventionaltestingisunnecessaryinAgileenvironments.Further,somefeelthatalltestinginAgileshouldbeautomated,diminishingboththeroleandthevalueoftheprofessionaltester.WhileautomatedtestingisessentialinAgilemethodologies,manualtestinghasasignificantparttoplay,too.

SuccessfulAgiletestingdependsonastrategybuiltonfourpillars:automatedunittesting,automatedacceptancetesting,automatedregressiontesting,andmanualexploratorytesting.Thefourareinterdependent,andeachprovidesbenefitsthatarenecessaryforthe

otherstosucceed.EachpillaristheresponsibilityofadifferentgroupwithintheAgiledevelopmentteam,andwheneveryonedoeshispart,theresultisasolutionwherethewholeisgreaterthanthesumoftheparts.

Session Takeaways:

nGainanunderstandingofthechallengesfacedwhentestinginAgileenvironments

nLearnhowthefourpillarsprovideasolidfoundationonwhichasuccessfultestingorganizationcanbebuilt

nLearnwhythepillarsareinterdependentandunderstandwhytheabsenceofoneleavesagapinthetestingeffort

205 Wayne Ariola, VP of Strategy,Parasoft

Complement Virtual Test labs with service VirtualizationThissessionexplainswhyservicevirtualizationistheperfectcomplementtovirtualtestlabs–especiallywhenyouneedtotestagainstdependentapplicationsthataredifficultorcostlytoaccessand/ordifficulttoconfigureforyourtestingneeds.

Virtualtestlabsareidealfor“staging”dependentapplicationsthataresomewhateasytoaccessandhavelowtomediumcomplexity.However,ifthedependentapplicationisverycomplex,difficulttoaccess,orexpensivetoaccess,servicevirtualizationmightbeabetterfitforyourneeds.Servicevirtualizationfillsthegaparoundthevirtualtestlabbygivingyourteamavirtualendpointinordertocompleteyourtestenvironment.Thisway,thedevelopersandtesterscanaccessthenecessaryfunctionalitywhenevertheywant,asfrequentlyastheywant,withoutincurringanyaccessfees.Foranotherexample,assumeyouhaveamainframethat’seasilyaccessible,butdifficulttoconfigurefortesting,servicevirtualizationfillsthegapbyprovidingflexibleaccesstothecomponentsofthemainframethatyouneedtoaccessinordertoexercisetheapplicationundertest.Itenablestheteamtotestvs.abroadarrayofconditions–withminimalsetup.

Session Takeaways:

nRemoveroadblocksforperformancetesting,functionaltesting&Agile/paralleldevelopment

nClosethegapthatexistswithincompleteorcapacity-constrainedstagedtestenvironments

nStreamlinetestenvironmentprovisioningtimeandcostsbeyondtraditionalvirtualization

P a g e 1 6

session block


Tuesday16 october

301 Keith Klain, Director,HeadofGlobalTestCenter,Barclays

leading Cultural Change in a Community of TestersWhenKeithKlaintookovertheBarclaysGlobalTestCenter,hefoundanorganizationfocusedentirelyonmanagingprojects,managingprocesses,andmanagingstakeholders–thelastmostunsuccessfully.Althoughtheteamwasextremelyproficientintestmanagement,theirmisalignedprioritieshadtheeffectofcontinuallyhittingthebullseyeonthewrongtarget.Keithimmediatelyimplementedchangestoputasysteminplacetofostertestingtalentanddriveoutfear–abandoningworthlessmetricsandmaturityprograms,overhaulingthetrainingregime,andinvestinginaculturethatrewardsteamworkandinnovation.Thechallengesofthesemonumentalchangesrequiredanewkindofleadership–somethingquitedifferentfromtraditionalmanagement.

FindouthowKeithisleadingtheBarclaysGlobalTestCenterandhearhispracticalexperiencesdefiningobjectivesandrelatingthemtopeople’spersonalgoals.LearnabouttheBarclaysCapitalGlobalTestCenter’s“ManagementGuidingPrinciples”andhowyoucanadapttheseprinciplestoleadyouandyourteamtoanewandbetterplace.

302 Karen N. Johnson,Founder,Software Test Management, Inc.

software Testing Heuristics & MnemonicsAreyoucuriousaboutheuristicsandhowtousethem?Inthissession,KarenJohnsonexplainswhataheuristicis,whatamnemonicis,andhowheuristicsandmnemonicsaresometimesusedtogether.AnumberofbothheuristicsandmnemonicshavebeencreatedinthesoftwaretestingcommunityandKarenreviewsseveralofeachandgivesexamplesofhowtouseandapplyheuristicsandmnemonics.Inthissession,Karenoutlineshowtocreateyourownmnemonicsandheuristics.Shealsoexploreswaystousebothasawaytoguideexploratorytestingefforts.

Sherri SobanskiiscurrentlytheSeniorStrategicArchitectAdvisorfocusingontechnicalteststrategyandinnovationsupportingAetna’stestingteam.SherriisalsotheactingheadofAetna’sMobileTestingCapabilityCenter.

Keith KlainistheheadoftheBarclaysGlobalTestCenter,whichprovidesfunctionalandnon-functionalsoftwaretestingservicestotheinvestmentbankingandwealthmanagementbusinesses.

Karen N. Johnsonisanindependentsoftwaretestconsultantandacontributingauthortothebook,BeautifulTestingandistheco-founderoftheWRESTworkshop.

ASoftwareTesterforthepast15years,Brian GerhardtstartedoffinproductionsupportwherehistroubleshootingskillsandrelentlesssearchforanswersleadtoacareerinQualityAssurance.HeiscurrentlywithLiquidnet.

Dan Downingteachesloadtestingandoverthepast13yearshasledhundredsofperformanceprojectsonapplicationsrangingfromeCommercetoERPandcompaniesrangingfromstartupstoglobalenterprises.

2 : 3 0 p m – 3 : 4 5 p m

3

P a g e 1 7


303 Dan Downing, PrincipalConsultant,Mentora Group

Interpreting Performance Test Results – Part 1You’veworkedhardtodefine,developandexecuteaperformancetestonanewapplicationtodetermineitsbehaviorunderload.Yourinitialtestresultshavefilledacoupleof52gallondrumswithnumbers.Whatnext?Crankoutastandardreportfromyourtestingtool,senditout,andcallyourselfdone?NOT.Resultsinterpretationiswhereaperformancetesterearnstherealstripes.

Inthefirsthalfofthisdoublesessionwe’llstartbylookingatsomeresultsfromactualprojectsandtogetherpuzzleouttheessentialmessageineach.ThiswillbeahighlyinteractivesessionwhereIwilldisplayagraph,providealittlecontext,andask“whatdoyouseehere?”Wewillformhypotheses,drawtentativeconclusions,determinewhatfurtherinformationweneedtoconfirmthem,andidentifykeytargetgraphsthatgiveusthebestinsightonsystemperformanceandbottlenecks.Feelfreetobringyourownsampleresults(on a thumb drive soI can load and display)thatwecanengageparticipantsininterpreting!

304 Sherri Sobanski, SeniorStrategicArchitectAdvisor,Aetna

finding the sweet spot – Mobile Device Testing DiversityHowcanyoupossiblydoitall?!Infinitehardware/softwarecombinations,BYOD,crowdsourcing,virtualcapabilities,datasecurity...thelistgoesonandon.Companiesarestrugglingwithinsecure,complicatedandexpensiveanswerstothemobiletestingchallenges.TheAetnatechnicalteamshavecreatedaninnovativemobiletestingsetofsolutionsthatnotonlyprotectdatabutallowformanydifferentapproachestomobiletestingacrossthelifecycle.WhetheryouwanttotestfromtheCorporateLab,fromyourownbackyardorhalfwayaroundtheworld,wehaveasolution…youchoose.

Session Takeaways:

nHowtotacklethecomplexnatureofmobiletestingnTechniquestoaddressBYOD,OffshoreVendors,

CrowdsourcingnSoftwarecapabilitiesforvirtualtestingofmobiledevicesnPrivateandpublictestingclouds

305 Brian Gerhardt, OperationsandQualityLead, Liquidnet

The Trouble with TroubleshootingOneofthemostvaluableskillsetsasoftwaretestercanpossessistheabilitytoquicklytrackdowntherootcauseofabug.Atestermaydescribewhatthebugappearstobedoing,butfartoooftenitisnotenoughinformationfordevelopers,causingarepetitivecode/build/test/re-code/re-build/re-testcycletoensue.Inthisinteractivesession,youwillrotatebetweenlearninginvestigativetechniquesandapplyingthemtoactualexamples.Youwillpracticereproducingthebug,isolatingit,andreportingitinaconcise,clearmanner.

Thissessionwillpresentseveralinvestigativemethodsandshowhowtheycanbeusedasameansofinformationgatheringindeterminingtherootcauseofbugs.Commonteststhataredesignedtoeliminatefalseleadsaswellasteststhatcanbeusedtofocusinonthesuspectcodewillbeshownanddiscussedininteractiveexamples.

Session Takeaways:

nBuildaframeworkaroundtheirsoftwaretoeasefindingrootcausesofsoftwareissues

nQuicklyidentifywherethemostlikelycauseoftheerrorsare

nUseanew,empiricalinvestigativemethodforsoftwaretesting

nDelivermoreconcise,relevantinformationtodevelopersandprojectmanagerswhendescribinganddetailingissuesinthesoftware,becomingmorevaluableinmakingfix/shipdecisions

session block

P a g e 1 8


Tuesday16 october

401 Bradley Baird,SeniorManagerProductQuality,Harman International

Don’t Ignore the Man behind the CurtainJustasintheWizardofOzwhereallthegreatpyrotechnicsgoingoninpublicwerecontrolledbythewizardhiddenbehindsthecurtain,soitisinQAwhereallthegreatqualitythatthecustomersseeiscontrolledbytheQAprofessional.Ifyouignorethe“Wizard”youdosoattheriskofcompromisingQuality.ThissessionwillcovertheperilsofignoringtheQAprofessionalbehindthecurtain.WespendmonthsorevenyearstrainingaQAengineeronlytoseethemwalkoutthedoorbecauseabetteropportunitycamealong.Youdon’tjustloseapersonyouloseknowledgethatissometimeshardtoreplace.

Inthissessionwewillexploreideasonhowtodevelopmanagementtraitsandskillsthatweperformonadailybasistomakesureourwizardskeeppullingthoseleversandtootingthosehornsforusinsteadofourcompetitor.

Session Takeaways:

nIdeasonmanagingorleadingaQAteamnHowtotreatahumanasapersonnotaresourcenHowtogiveincentiveswithlimitedtonoresourcesnHowtoaddvaluethroughhappyteammembersnHowtoshowyourvaluetouppermanagement

402 David Dang,SeniorAutomationConsultant,Zenegy Technologies

optimizing Modular Test automationManycompanieshaverecognizedthevalueoftestautomationframeworks.AppropriatetestautomationframeworksmaximizeROIonautomationtoolsandminimizescriptmaintenance.Oneofthemostcommonframeworksisthemodulartestautomationapproach.Thisapproachusesthesameconceptassoftwaredevelopment:buildingcomponentsormodulessharedwithinanapplication.Fortestautomation,themodularapproachdecomposestheapplicationundertestintofunctionsormodules.Thefunctionsormodulesarelinkedtogethertoformautomatedtestcases.Whilethis

44 : 4 5 p m – 6 : 0 0 p m

Overthepast15yearsTodd Schultzhastestedmanytypesofsoftware,inmanyindustries.ToddSchultzispassionateaboutprofessionaldevelopment;mentoringQualityAssuranceEngineerswhoseeQAasacareer,andnotjustajob.

Dan Downingteachesloadtestingandoverthepast13yearshasledhundredsofperformanceprojectsonapplicationsrangingfromeCommercetoERPandcompaniesrangingfromstartupstoglobalenterprises.

David DangisanHP/MercuryCertifiedInstructor(CI)forQuickTestProfessional,WinRunner,andQualityCenterandhasprovidedautomationstrategyandimplementationplanstomaximizeROIandminimizescriptmaintenance.

Brian Copelandhasbeeninstrumentalinthetestingofcriticalbusinesssystems,frommissioncriticalapplicationstocommercialsoftware.

Bradley BairdisanSQAprofessionalandhasworkedatseveralsoftwarecompanieswherehehascreatedSQAdepartmentstestlabsfromscratch,trainedtestteamsandeducatedstakeholderseverywhereonthevaluesofSQA.


P a g e 1 9

approachencouragesreusabilityandmaintainability,therearemanychallengesthatmustbeconsideredandaddressedatthestartofaproject.

ThispresentationdescribesthekeyfactorstheQAgroupneedstoconsiderduringthedesignphaseofimplementingamodulartestautomationapproach.TheQAgroupwilllearntheaspectsofthemodulartestautomationapproach,thebenefitsofimplementingamodularapproach,thepitfallsofamodularapproach,andbestpracticestofullyutilizethemodularapproach.

403 Dan Downing,PrincipalConsultant,Mentora Group

Interpreting Performance Test Results – Part 2Inthesecondpartofthissession,wewilltrytocodifytheanalyticstepswewentthroughinthefirstsessionwherewelearnedtoobserve,formhypotheses,drawconclusionsandtakestepstoconfirmthem,andfinallyreporttheresults.TheprocesscanbestbesummarizedinaCAVIARapproachforcollectingandevaluatingperformancetestresults:

nCollectingnAggregating

nVisualizingnInterpreting

nAnalyzingnReporting

Wewillalsodiscussanapproachforreportingresultsinaclearandcompellingmanner,withdata-supportedobservations,conclusionsdrawnfromtheseobservations,andactionablerecommendations.Alinkwillbeprovidedtothereportingtemplatethatyoucanadoptoradapttoyourowncontext.Comepreparedtoparticipateactively!

404 Brian Copeland,QAPracticeDirector,Northway Solutions Group

agile vs fragile: a Disciplined approach or an excuse for ChaosTheManifestoforAgileSoftwareDevelopmentwassignedoveradecadeagoandestablishesasetofprinciplesaimedatincreasingthespeedatwhichcustomerscanrealizethevalueofadevelopmentundertaking.WhiletheprinciplesofAgilearearefreshingfocusondelivery,theyareoftenhijackedtobecomeanexcusefortheundisciplineddevelopmentorganization.TheAgileframework’sfocusonagilityisanythingbutundisciplinedwithprinciplessuchasTestDrivenDevelopment(TDD);howeverroguedevelopment

organizationshavepointedtoAgileastheimpetustoabandonallvestigesofprocess,documentation,andinmanywaysquality.Theseorganizationshaveaddedafifthprincipletothemanifesto:SpeedoftheDeliveryoverqualityofthedelivered.

Session Takeaways:

nAgileorFragile:HowtotellwhichyourorganizationisnAgileCharacteristics:Thecharacteristicsof

excellentAgileteamsnAgileManifesto:Whatdoesitmeanforprocesses

anddocumentation?nAgileTesting:Theroleof“independent”testingin

theAgileframeworknAgileTools:Dotestingtoolshaveaplacein

Agiledevelopment?nAgileFaçade:Strategiesforbreakingdownthefaçade

405 Todd Schultz,ManagingSeniorQualityAssuranceEngineer,Deloitte Digital

Mobile software Testing experienceInthishands-onsession,withdevicesinhand,wewillinvestigatetheissuesthatmobiletestersdealwithonadailybasis.Wewillexplorebothmobileoptimizedwebsitesandnativeapplications,inthenameofconsumeradvocacyandcontinuousimprovementandgainanewperspectiveonthemobilecomputingeraaswearmourselveswiththeknowledgeneededtousherinaqualityfutureforthisemergingmarket.

Thissessionwillfocusonthreeofthebiggestchallengesinmobileapplicationtesting:

nDeviceTesting–Devicefragmentationisachallengethatwillcontinuetoincrease,andfulldevicecoverageisoftencostprohibitive.Wewillinvestigatehowdevicefragmentationaffectsqualityandlearntheconsiderationsinvolvedindevicesamplingsize.

nConnectivityTesting–Althoughsomeapplicationshavesomeformofofflinemode,mostweredesignedwithconstantconnectioninmindandcanbenearuselesswithoutaconnectiontotheinternet.Wewillinvestigatehowvitalconnectivityistotheproperfunctioningofmanymobileapplicationsandexplorevarioustestingmethodologies.

nInterruptTesting–Phonecalls,textmessages,alarms,pushnotificationsandotherfunctionalitywithinourdevicescanhaveaseriousimpactontheapplicationundertest.Wewillinvestigatethetypesofissuestheseinterruptionscancauseandsomestrategiesfortesting.

P a g e 2 0

session block


partofthisinauguraleffort.ThepurposeofthistwopartsessionistoreviewahighlevelstudyofthebuildingofaTestCenterofExcellencewithinamatureITorganizationthatwillbeinformativeforcompaniesofvarioussizesandgrowthrelatedtoQualityAssurancematurity.

Session Part 1

nTheStartup–thissessionwilldescribehowthetestingcenterwasformedinitially,stepstakentobuildtheteam,baseliningtheprocessandmethodologydocumentation,initialmetricsplannedforreporting,theprocessinvolvedinselectingthepilotbusinessareasthatwouldbesupportedandhowwepreparedtheorganizationforthechanges.

nWhatWorked–wewillreviewthedecisionsmadeduringtheinitialstages,thosedecisionsthatstoodwiththeteamthroughouttheprocess,andhowtheorganizationwassocializedwiththestakeholders

Session Takeaways:

nDocumentingcoreprocessesrequiredtobuildateamnSelectingtheappropriateteammemberskillsets

whenbuildingateamnIdentifyingcorerequirementswhenselectinga

testingvendornEstablishingcoremetricsneededfortheorganizationnSelectingthepilotgroup/businessareafortestingservices

502 Dwight Lamppert,SeniorTestManager,Franklin Templeton

How to Prevent DefectsThesessionshowshowtopreventdefectsfromleakingtolaterstagesoftheSDLC.Thisisasuccessfulcasestudyinwhichawarenessandfocusonstatictestingwasincreasedoveraperiodof2years.Defectdetectionandleakageremovalmetricsweretrackedforeachoftheprojects.Thefirst2projectsexposedsomeissues.Themetricsweresharedanddiscussedwithbusinesspartners–andvariousprocessimprovementswereimplemented.Theresultsonthe4subsequentprojectsshowedmarkedreductionsindefectsthatleakedintosystemtestingandproduction.Thequalityimprovementalsocontributedtolesscostandshortertimelinesbecausere-workwascontrolled.

Session Takeaways:

nAfocusondocumentationreviews,walk-throughs,andinspectionsisacriticalfirststepforbuildingqualityintothecodeearlyintheSDLC

Mark Tomlinsonisasoftwaretesterandtestengineer.Hisfirsttestprojectin1992soughttopreventtrainsfromrunningintoeachother–andMarkhasmetaphoricallybeenpreventing“trainwrecks”forhiscustomersforthepast20years.

Mike Lyleshas19yearsofITexperience.HiscurrentrolecomprisesTestManagementresponsibilitiesforamajorcompanydomaincoveringStoreSystems,SupplyChain,MerchandisingandMarketing.

Dwight Lampperthasover15yearsofsoftwaretestingexperienceinthefinancialservicesindustryandcurrentlymanagesSoftwareTestingProcess&MetricsatFranklinTempleton.

Brad Johnsonhasbeensupportingtesterssince2000asheadofmonitoringandtestproductsatCompuware,MercuryInteractiveandBorlandandisnowwithSOASTAwherehedeliverscloudtestingontheCloudTestplatform.

Doug HoffmanisatrainerinstrategiesforQAwithover30yearsofexperience.Histechnicalfocusisontestautomationandtestoracles.Hismanagementfocusisonevaluating,recommending,andleadingofqualityimprovementprograms.

1 0 : 3 0 a m – 1 1 : 4 5 a m

5

Wednesday17 october

501 Mike Lyles, QAManager,Lowe’s Companies, Inc.

building a successful Test Center of excellence – Part 1In2008,Lowe’sinitiatedaQualityAssurancegroupdedicatedtoindependenttestingforIT.ThiswasLowe’sfirsttimeseparatingdevelopmentandtestingeffortsforthe62-year-oldcompany.MikeLyleswasprivilegedtobe

P a g e 2 1


nDefectmetricsareessentialtosupportthingsthattestingexposeseverydayandarethebasisforinitiatingprocessimprovementdiscussions

nWhenawarenessofstatictestingisincreasedontheprojectteam,theindividualsparticipatingoftenstopcreatingdefectsastheyspecify,program,andtestthenewfunctionality

nTheQAorganizationisthebestgrouptopromoteprocessesthatbuildqualityintocodeearlyintheSDLC

503 Brad Johnson,VPProductandChannelMarketing,SOASTA

The Testing Renaissance Has arrived (on an iPad in the Cloud)Thisisthebesttimeinhistorytobeatester!Emergingfromthemostsignificanteconomic“darkage”sincetheGreatDepression,theworldtestersnowfaceisoneofimmenseopportunityandchallengeascloudcomputinghasblowninovernightandmobiledeviceshaveovertakentheplanet.Inthenewworldofspeedandscale,RenaissanceTestersarelaunching(orre-launching)theircareersbytestingtransformationaltechnologiesbyeffectivelyutilizingthosesametransformationaltechnologies.

Attendthissessiontolearnhowyoucancatapultyourcareerwithcloud-basedtestautomationandmobiletestingtechniquesthatareasexcitingtolearnanduseastheyareimpactfultoyourendresultsandpersonalsuccess!

Attendees Will Learn To:

nBecomeacloudtestingexpertnBuildandarticulateadistributedmobile

testingstrategynChampionanewapproachtorealistic,repeatable

webandmobileperformancetestingnEstablishyourselfasanagiletestingexpert

withContinuousTestingnDefend“Test”inaworldheadingtoward“DevOps”

Learnthenew“arts”–embracethisnewworld–andbecomeaRenaissanceTester!

Session Takeaways:

nLearnwheretestersaremakingalastingimpactonstrategicprojects

nIdentifyareastofocusonforcareergrowthnLearntoseekoutstrategicprojectsnGainperspectiveandoptimismaboutthefuture

504 Doug Hoffman, Consultant,Software Quality Methods

non-Regression Test automation – Part 1Theprincipleadvantagesofautomatedtestsarerepeatabilityandspeed.Theprincipledisadvantagesarethattheyarerelativelymoreexpensivetocreatethanmanualtests,requiremoremaintenancethanmanualtests,andaremorelimitedinthespecificityofthingstheycancomparecomparedwithmanualtests.Part1ofthispresentationdescribesanotherwaytoapproachtestautomation:totestthingsthatcannotbetestedmanually.Thesetestsenableustofocusonlearningaboutthesoftware,cangobehindtheUItoextendourreach,arenotlimitedtodoingthesamethingeachtimeandcanperformhugenumbersofiterationsandcombinationsunthinkableusingmanualtestingorautomatedregressiontests.Thisapproachalsoencouragescheckingbroaderclassesoftestoutcomes,thusimprovingthetypesoferrorsthatcanbediscovered.

Session Takeaways:

nHowtouseautomatedteststoextendtesters’capabilitiesnThevirtues/drawbackstoautomatedregressiontestsnDesignofautomatedtestsforexplorationnAmodelforunderstandingoutsideinfluencesand

hiddenoutcomesduringtesting

505 Mark Tomlinson,OwnerandCEO,West Evergreen Consulting, LLC

slow-Motion Performance analysisEverymodern-dayperformanceengineerisnowroutinelyaskedtodiagnosetheclientsidesensitivityandvulnerabilitytoperformancefailureduetoslowpageloading,high-latencyandlimitedbandwidth.Andifyou’vereadSteveSoudersbooksyouknowthatbehindeverybrowserisawhole-lottaloadingactivitygoingon–activitywhichobeysasomewhatbizarresetoflogicalrules,dependingonthebrowsertypeandversion.Thishands-onsessionwillhelpyoulearnhowtoinvestigateclient-sideperformanceissuesbyconfiguringthebrowserandafewdifferenttoolstomakethepagerenderinslowmotion.Wewillcoverhowtoanalyzethepagesequencerenderingtohighlightobjectsormilestonesintherenderingthataresensitivetohigh-latencyperformanceissues.Wewillcoverhowtofindfunctionalityissueswiththepagethatarecausedbyslowloadingconditions.Thetechniqueslearnedinthissessionwillhelpyouinthecorecompetencyforperformanceroot-causeanalysisandtroubleshooting.

session block

P a g e 2 2


Wednesday17 october

601 Mike Lyles, QAManager,Lowe’s Companies, Inc.

building a successful Test Center of excellence – Part 2In2008,Lowe’sinitiatedaQualityAssurancegroupdedicatedtoindependenttestingforIT.ThiswasLowe’sfirsttimeseparatingdevelopmentandtestingeffortsforthe62-year-oldcompany.MikeLyleswasprivilegedtobepartofthisinauguraleffort.ThepurposeofthistwopartsessionistoreviewahighlevelstudyofthebuildingofaTestCenterofExcellencewithinamatureITorganizationthatwillbeinformativeforcompaniesofvarioussizesandgrowthrelatedtoQualityAssurancematurity.

Session Part 2

nTheEvolution–thissessionwilldiscussthemanychangesthatanevolvingtestingteamtypicallytakes,thestepstowardmaturityinsomeareas,theprocessesusedtobuildanonboardingroadmap,andsocializingthebenefitsandvalueoftheorganizationtootherITandbusinessgroups.

nWhatWorked–wewillreviewwhattheteamlearnedalongthewayandalsoevaluatehighlevelprocessesandproceduresthatwereeffectivefromthebeginningbutevolvedastheteamgrewovertheyears

Session Takeaways:

nBuildinganeffectiveroadmapforonboardingadditionalgroups/areas

nBestpracticesforsocializingthetestinggroupwithotherITteamsandobtainingbuy-in

nEstablishingaQualityBoardtomonitor,govern,andapprovechangestotheprocessesandtestingmethodologies

nIntegratingothergroupswithtestingorganizationsnSpotlightingtheneedforrelevance–growingthe

testingorganizationwithemergingtechnologies

602 Fariba Marvasti, Sr.QAManagerII,Aetna

aetna Case study – Model officeTheModelOfficeProgramcameintoexistenceduetoacontractualstipulationofanewlyforgedAetna

61 2 : 0 0 p m – 1 : 1 5 p m

Robert Walsh, aproponentofAgilesoftwaredevelopmentprocessesandtechniques,believesstronglyindeliveringqualitysolutionsthatsolverealcustomerproblemsandprovidetangiblebusinessvalue.

Scott Moore hasover18yearsofITexperiencewithvariousplatformsandtechnologiesandhastestedsomeofthelargestapplicationsandinfrastructuresintheworld.

Mike Lyleshas19yearsofITexperience.HiscurrentrolecomprisesTestManagementresponsibilitiesforamajorcompanydomaincoveringStoreSystems,SupplyChain,MerchandisingandMarketing.

Doug HoffmanisatrainerinstrategiesforQAwithover30yearsofexperience.Histechnicalfocusisontestautomationandtestoracles.Hismanagementfocusisonevaluating,recommending,andleadingofqualityimprovementprograms.

Fariba Alim-MarvastileadsaninnovativeorganizationdrivingProcessimprovementsacrossAetnawithdeliveryresponsibilityfortesting/qualityassurancewithintheInformaticsandMedicalManagementdomains.


P a g e 2 3

partnershipwithakeyvendorpartner.TheProjectteamrecognizedthatModelOfficewasnottraditionalITtesting.ThisnewtestinghadverylittletodowiththeconventionalITaspectbutinsteadwasallaboutBusinessProcessvalidation.Itwaspromptlyidentifiedthatthistypeoftestingwasnotinthecurrentportfoliooftestingservicesandthereforewouldrequireanewmethodologyandanewteamtoexecuteit.

ThenewlyestablishedModelOfficeteamsuccessfullyexecutedModelOfficetestingforseveraloftheProgram’sworkstreamssinceitsinceptioninearly2011.ModelOfficetestingisaninnovativefocusonBusinessprocessanalysisandconcentrationonriskidentification.Itwasrecognizedthatthereisobviousbenefitinprogramscomprehendingrisksandenablingproactivemitigation.AsaresultitwasdeterminedthatModelOfficetestingbeanavailableoptiontoallprogramsacrosstheenterprise.

TheModelOfficeProcesscanbedescribedintofourphases:Engagement;Assessment;Execution;andMonitorandReview.

603 Scott Moore,President&CEO,Northway Solutions Group

application Performance Test Planning best PracticesManycompaniesexperienceperformanceissuesinproductionevenaftertheyhavetestedittoendureload.Why?Thissessionwilldemonstratethevalueofperformancetestingforreal-worldscenariosandhowtoproperlyplanforyourapplication’s“perfectstorm”.Howtocreateandreacttochaosbeforeithappensinproductionwillbeexplored.Attendeeswilllearntriedandtrueguidelinesthatcanusedtoplanforrealisticpeakloadsandunderstandwhatworstcaselookslikebeforecustomersdo.Inaddition,wewilldiscusshowcloudarchitectureandSoftware-As-A-Serviceintroducesnewproblems.Attendeeswillwalkawaywitharepeatabletestexecutionmethodologytouseonanyperformancetestingprojectinthefuture.

604 Doug Hoffman,Consultant,Software Quality Methods

non-Regression Test automation – Part 2Automatedsoftwaretestinghashistoricallymeanthavingthecomputerrunindividuallycraftedtestcasesthat

performthesameexercisesasmanualtests,onlyrunbyamachine.Theprincipleadvantagesfortheseautomatedtestsarerepeatabilityandspeed.Theprincipledisadvantagesarethattheyarerelativelymoreexpensivetocreatethanmanualtests,requiremoremaintenancethanmanualtests,andaremorelimitedinthespecificityofthingstheycancomparecomparedwithmanualtests.

Part2ofthispresentationdescribesoraclemechanismsthatenabletesterstotakeadvantageofnon-regressionautomation.Theoraclesdeterminewhetherthesoftware’sbehaviorappearstobenormalorerroneous.Theoraclesallownon-regressionteststovarytheirbehaviorandstillhavepredictable,checkableoutcomes.Thissessionpresentsoveradozendifferenttypesoforaclemechanisms.

Session Takeaways:

nTestoraclemechanismsforautomatedtests

605 Robert Walsh,SeniorConsultant,Excalibur Solutions, Inc.

Keeping Up!OneofthechallengesmanyorganizationsfacewhenadoptingAgileprocessesishavingenoughtimeineachiterationtotestwhatwasdevelopedinthatiteration.Developerswanttoworkuptothelastminuteintheiterationtofinishstoriesandmaximizebusinessvalue.Further,astheprojectgrowsovertime,thescopeofthetestingeffortgrowswithit.HowcananorganizationensureitremainstruetoAgilewithoutsacrificingquality?

Thissessionwillprovidesomehelpfultipstogivetestersthebestchanceofkeepingpacewithdevelopment.Additionally,thepresenterwilldiscussseveralstrategiesthatmaybeemployedif,despitevaliantefforts,testingfallsbehind.Whilenosingleapproachmayprovidethesilverbulletsolution,attendeeswillleavethesessionarmedwithideasandconceptsfordealingwiththeproblembothproactivelyandreactively.

Key Takeaways – You will learn:nGainanunderstandingofthechallengestestersfacein

fast-pacedAgile/iterativedevelopmentenvironmentsnLearnseveralstrategiestohelpthemhaveabetter

chanceofkeepingpacewithdevelopmentnLearntwospecificwaystoadapttheirprocessesif

theydiscovertheycannotkeeppacewithdevelopmentnLearneffectivewaystodealwithdefectsfoundin

differentphasesofAgiletesting

P a g e 2 4

session block


Wednesday17 october

701 Lee Henson, ChiefAgileEnthusiast,AgileDad

Technical Debt: a Treasure to Discover and DestroySometreasuresareworththeplunderastheyyieldvastamountsofrichesandjewels.Othertreasuresareoftenbetterleftuntouched.Thissessionisaboutatreasurethatnoorganizationwantstoseeorfacebuttherewardsforacknowledginganddestroyingthetreasureisvastandbountiful.Aswecontinuetoseecompaniesgrowandexpand,organizationsarebuildingVERYstrongfeaturesetsatopacrumblingarchitecturalfoundation.Learnwhatthesevendeadlysinsoftechnicaldebtare,andthestepsyoucantaketoeliminatethem!Seefirsthandwhattheveryobstaclesarethatwearetryingtoavoidyetfallingrightintotheirpath.Learnwhatthetester’sroleisinhelpingtomakecertainweneverpitfallintothisenvironmentagain.Leavearmedwiththestepswecantaketoadjusttheriggingandmakecertainweneversaildownthepathofendlessdebtagain.

702 Wayne Ariola, VPofStrategy,Parasoft

Dependencies Gone Wild: Testing Composite applicationsThemovetoSOAandcompositeapplicationshasundeniablydeliveredtremendousbenefits.However,theassociateddistributionandreusecreatesvariouschallengesfromthequalityperspective.Withmanydependenciesrelyingonacentralizedendpointtocompletetheirbusinessprocesses,itbecomesessentialthatthiscomponentalwaysworkasexpected.Additionally,thefragmentationofsystemorendpointownership(orcontrol)shiftshowindividuals,thirdparties,anddependentapplicationsmustaccessandevolvetheirsystems.Moreover,ensuringthequalityofthesystemundertestiscomplicatedbythefollowingfactors:

nEnd-to-endtestsneedtopassthroughmultipledependentsystems,whicharecommonlyunavailable,evolving,ordifficult-to-accessfortesting

3 : 0 0 p m – 4 : 1 5 p m

7

Jamie Burns startedhercareerinsoftwaretesting,hasbeeninthesamedisciplineforover19yearsinsoftwaretestingandqualityassurance,andhas10+yearsintestautomation.

Matthew Heusserisaconsultingsoftwaretesterandsoftwareprocessnaturalistwhohasspenthisentireadultlifedeveloping,testing,ormanagingsoftwareprojects.

Lee Henson’s12yearsofexperiencespanabroadarrayofsoftwareproductionrolesandresponsibilities.Heiscurrentlyoneofjustover100CertifiedScrumTrainers(CST)worldwide.

Andreas Grabnerhas10yearsofexperienceasanarchitectanddeveloperintheJavaand.NETspace.Inhiscurrentrole,AndiworksasaTechnologyStrategistfordynaTraceSoftwareintheMethodsandTechnologyteam.

Wayne AriolaisVicePresidentofStrategyandCorporateDevelopmentatParasoft,aleadingproviderofintegratedsoftwaredevelopmentmanagement,qualitylifecyclemanagement,anddev/testenvironmentmanagementsolutions.

P a g e 2 5


nAccessingsuchsystemsofteninvolvestransactionandbandwidthfees

nTeamsneedtotestandtunethesystemundertestagainstarealisticandbroadrangeofperformanceandbehaviorconditions

703 Andreas Grabner, TechnologyStrategist,Compuware dynaTrace

Top 3 Performance land Mines and How to address ThemAsatester,youdonothavetheluxuryorthetimetotestrepeatedlytotrytofixslow,poorly-performingapplicationsduringloadtests.Youneedtogettothecauseofperformancequicklyandfixissuesfastandefficiently.Therearetoolsthatcanhelpinidentifyingapplicationissues,butmanyarenoteffectivefortestinginanenvironmentwheretheboundariesbetweenpreproductionandproductionareincreasinglyblurred.

Thissessionwilldiscussthetop3applicationissuesthatimpactperformanceandofferloadtestingbestpracticetipsforfindingandfixingperformanceproblems.Attendeeswilllearnhowto:

nRapidlydeterminetherootcauseofproblemsdowntothecomponent,SQLstatement,orMethodlevel

nReducetestingiterationsandcycletimenValidatearchitectureformaximumscalability

704 Jamie Burns,ITTeamLead,Denver, Colorado

building automation from the bottom Up, not the Top DownMostsoftwareautomationprojectsfail.Why?Becausetesters,managers,companiesthinkautomationtoolsaremagicalandthatautomationiseasytoimplement,justrecordandplayback–right?Wrong!Toomanytimes,ITprojectsbuyintothe‘easilyautomate’softwarefromthetoolsvendoronlytofindtheyhaveshelvedthetool6monthsdowntheroad.Buildinganautomatedtestsystemtakesjustasmuchthought,designandplanningasbuildingthesoftwareapplicationundertestitself.

Beforeeventhinkingaboutanautomationtool,youmusthavethesupportinginfrastructureinplacefortestautomation.Notonlydoesthemanualtestcasehavetoberepeatable,butthewholeprocessneedstoberepeatable.Oneofthebiggestcausesofautomation

failureistryingtoautomatechaos.Youwon’tbesuccessfulatautomationifyouhaven’ttakenthenecessarystepstocreatearepeatabletestingprocess.

Session Takeaways:

nWhatarethegoalsoftesting?nTestEnvironment–isitundercontrol,

oroutofcontrol?nTestData,doyouknowwhatyouhave,

orisitconstantlychanging?nHowhaveyoubuiltyourtestcases?Arethey

independentoraretheydependent?nGetbacktobasics,developatestautomation

plananddriveautomationfromthegroundup

705 Matt Heusser, PrincipalConsultant,Excelon Development

There Can be only one: a Testing Competition – Part 1Thisdoublesessionintegratestheprevioustalksandappliesthem,simulatingrealsoftwaretesting.Afteraquickexercisetocreateteamsof2-6testers(orbringyourown),youwillbeplungedintotherealworldofsoftwaretesting:Funchallenges,deliveredundertimepressureandconditionsofuncertainty.Teamswillbejudgedoncoverage,bugsfound,thequalityofthecommunicationtheyhavewith“management”and“therestofthetechnicalstaff”,newapproachesandstrategy/leadership.Stickaroundafterthecompetition,becauseprizeswillbeawardedonthemainstageThursdaymorning.

Bringyourlaptop,yourmobiledevice,yourmind,andyourbesttestideastothishigh-pacedracefortestexcellence.Seeyouontheplayingfield.

session block

P a g e 2 6


Wednesday17 october

801 Todd Schultz, ManagingSeniorQualityAssuranceEngineer,Ubermind / Deloitte

Maintaining Quality in a Period of explosive Growth – a Case studyA12yearoldsoftwaredevelopmentfirmbegancreatingiOSapplicationswithabout20employees.Lessthan2yearslatertheyhad150employeesandweremakingawardwinningiOSandAndroidapplications.Inearly2012theywerepurchasedbyoneofthebig4accountingagenciestobethemobileextensionoftheirworld-widetechnologyconsultingbusiness.

Maturingprocessinatimeofexplosivegrowthisanimmensechallenge.SincebeforetheylaunchedtheirfirstiOSapplicationtheexecutiveleadershipsoughttohirethebestandthebrightesttechnologistsandturnedthemloosetotraversetheterrainofthisfastadvancingmobileemergingmarket.Now,asapartofa188,000personcorporation,theycontinuetochallengethestatusquoandpushtheagileprocessboundaries,andcontinuemakingleadingedgemobileapplications.

ThissessionisacasestudyofoneQualityAssuranceDepartmentmanagingexplosivegrowthandbecomingtheheadlightsofanagilewhole-team.

Session Takeaways:

nSoftwaredevelopmentmethodscanmaturecontinuallyinacompanyofanysize

nCurrentqualityassurancemethodsareover30yearsoldandbadlyinneedofsomepolish

nGreatbenefitcanberealizedfromfairlysimpleprocessmodificationandrefocus

nQualityassuranceisoftenthelastdisciplinetofullyembraceagilemethods

802 Carl Shaulis, QAEngineeringManager,HomeAway.com

Testing in the World of Kanban – The evolutionInthissession,CarlShaulispresentsajourneyofateamwhoadoptedKanbanandwentfrom6weekrelease

84 : 3 0 p m – 5 : 4 5 p m

Uday Thonangihasover10yearsofexperiencetestingapplicationsbuiltforclientserver,AS400andmobileandover2yearsexperiencetesting,settingupprocesses,buildingtestenvironmentsandevaluatingtoolsformobileapplications.

Carl Shaulishasbeentestingsoftwarefor10+yearsandhasover15yearsofmanagementexperience.Carltakesananalyticalapproachtotestingandhasthefortitudetoembracechange.

Overthepast15yearsTodd Schultzhastestedmanytypesofsoftware,inmanyindustries.Toddispassionateaboutprofessionaldevelopment;mentoringQualityAssuranceEngineerswhoseeQAasacareer,andnotjustajob.

Anna Royzmanisthetestleadinacross-functionalproductdevelopmentteamthatcreatesanddeliversgame-changingsoftwareinthefinancialindustry,where“quality”isasimportantasthe“timetomarket.”



P a g e 2 7

cyclesdowntoalmostdaily.ThissessionwillthenshiftintosecondgearillustratinghowtheteamhasevolvedthepracticeandhowKanbanmigratedtootherteams.

Session Takeaways:

nWhatisKanban?nHowdotestersplayaroleinKanban?nWhyaremoreteamsadoptingKanban?nHowtoelevateKanbantodeliverValue

803 Anna Royzman, QALead,Liquidnet Holdings, Inc.

Refocusing Testing strategy Within the Context of Product MaturitySameasthe“completepreplanningahead”isnottheAgilewayofdeliveringsoftware,thetestingstrategywithintheagileprojectneedstofine-tunetothevariousstagesofproductdevelopmentandmaturity.Whiletheteamandproductleadswanttobeconfidentaboutsoftwarequality,testingtasksandactivitiesneedtobeleanenoughtoavoidunnecessarytime/maintenancehurdlesorbottlenecks.Wewillreviewtestingmethodsandstyleswhichfitbestatdifferentstagesofproductmaturity(hint:thedefinitionof“quality”mayadjustforeachstage).Sessionhighlights:

nStrategicwaystouseautomation,andwhenmanualexploratorytestingisabetterchoice

nTestingtheusabilityandbusinessassumptionsnLeveragingexploratorytestingasateamactivity

(whenandhow)nGettingreadyforlivepilotsandsalesdemos

oftherealproductnTestingcoveragerefinementfromthe

customerfeedbacknRisk-basedtestingnTestautomation:onetooldoesn’t‘fitall’nDesigningproduction“safetynet”suiteof

automatedtests

Session Takeaways:

nRecognizingwhat“quality”meansforvariousgroupsofusersandstakeholders(Sales,Business,Product,Operations,EndUsers)

nChoosingtherighttestingstrategyandsolutionsbasedonprojectneedsandstakeholders’goals

nDiscoveringqualityrisksatdifferentstagesofproductmaturity,andfine-tuningtestingstrategyaccordingly(throughsimulationexercises)

nFormingintelligentdecisionsontesttacticsandmethodsapplicablewithincontext-specificsituations

804 Uday Thongai, SoftwareTestEngineerLead,Progressive Insurance

Mobile Testing: Tools, Techniques & Target DevicesThenatureofthemobileindustryisinconstantfluxwithnewdevices,browserandoperatingsystemversionsbeingreleasedconstantly.Mobiletestershavetokeepdevice,browserandOScombinationsinmindwithmultipleIDEsandtestingtoolstocomeupwithriskassessmentandtestapproaches.Usageofbuilt-inSDKutilities,vendortoolsandcommandlinegoodiesareexploredinthissession.Testingtooloptionsforbothnativeandmobilewebapplicationswithideasonwhatselectioncriteriashouldbeusedareshowcasedwithrecommendations.Therequiredskilllevelofmobileapplicationtestersisslightlyhigher.Forinstance,availabletestingtoolsexpectaccesstoapplicationsourcecodewithbasicknowledgeofJava/ObjectiveCfornativeappstesting;understandingofecosystems(Eclipse/AndroidSDK,Xcode/iOSSDKetc);andknowledgeofbrowsersanddifferentrenderingengineswiththeireffectonhowpagesarerenderedisessential.Thissessionwillprovideaframeworktomanageallthesedimensionsofmobiletesting.

805 Matt Heusser, PrincipalConsultant,Excelon Development

There Can be only one: a Testing Competition – Part 2Thisdoublesessionintegratestheprevioustalksandappliesthem,simulatingrealsoftwaretesting.Afteraquickexercisetocreateteamsof2-6testers(orbringyourown),youwillbeplungedintotherealworldofsoftwaretesting:Funchallenges,deliveredundertimepressureandconditionsofuncertainty.Teamswillbejudgedoncoverage,bugsfound,thequalityofthecommunicationtheyhavewith“management”and“therestofthetechnicalstaff”,newapproachesandstrategy/leadership.Stickaroundafterthecompetition,becauseprizeswillbeawardedonthemainstageThursdaymorning.

Bringyourlaptop,yourmobiledevice,yourmind,andyourbesttestideastothishigh-pacedracefortestexcellence.Seeyouontheplayingfield.

P a g e 2 8

session block


Thursday18 october

901 Rakesh Ranjan,ManagerandSoftwareTestArchitect,IBM Corporation

7 Habits of Highly effective TestersAsthetitleofthetalkimplies,thespeakerwilldescribe/proposesevenhabitsofbeinghighlyeffectiveinaTester’sroleandwillpresenttechniquesforadoptingthosehabits.Atestermustmakeaparadigmshiftinhisorherjobandadoptaprofessionalattitudetowardstestingandtestengineeringprocessesingeneral.Thesession’sfocalpointisonsomeprovenapproachesforobtainingpersonalandinterpersonaleffectivenessthatarenecessarytobecomeahighlyeffectivetester.

Session Takeaways:

nLearnwhatiscausingtheparadigmshiftintestengineering

nIdentifybadassumptionsandblindspotsnDevelopcoverage,confidenceandcommonsensein

youreverydayjobnUsemathematicsandstatisticstomeasureresults

andeffectivenessnUnderstandthepsychologyoftesting

902 Matt Heusser,PrincipalConsultant,Excelon Development

advances in software Testing – a Panel DiscussionIfthepaceofdevelopmentandtechnologyaretwotothreetimesasfast,whatnewadvancesarehappeninginsoftwaretesting?Themoderatorwillpolltopicsfromtheaudience,thenusetheK-CardMethodtoevaluatetheattentionoftheroom,expandingontopicstheroomwouldliketodiscussandmovingonasenergyfades.

FromCloudComputingtoMobile,LeanSoftwareTestingtoExploratoryTestAutomation,Crowdsourcedtesting,privacyandsecurity,thisadvancedsessionissuretoprovideinsightsintotoday’schallengesinsoftwaretesting–andhowtosolvethem.Inadditiontotalkingpoints,eachexpertwillprovideapapersummaryforallattendees,includingpointersandlinks.

Mark Tomlinsonisasoftwaretesterandtestengineer.Hisfirsttestprojectin1992soughttopreventtrainsfromrunningintoeachother–andMarkhasmetaphoricallybeenpreventing“trainwrecks”forhiscustomersforthepast20years.

Sreekanth Singaraju hasmorethan12yearsofseniortechnologyleadershipexperienceandleadsAlliance’sQA&Testingorganizationindevelopingcuttingedgesolutions.

Rakesh RanjanmanagesahighperformanceTestEngineeringandQAteamforIBM’sflagshipdatabaseproductDB2andhasover16yearsofsoftwaredesign,developmentandtestexperience.


Jean Ann HarrisonhasbeenintheSoftwareTestingandQualityAssurancefieldforover12yearsincluding4yearsworkingwithinaRegulatoryEnvironment.Hernicheissystemintegrationtesting,specificallyonmobilemedicaldevices.

91 0 : 1 5 a m – 1 1 : 3 0 a m

P a g e 2 9


Session Takeaways:

nAsummaryofcutting-edgeissuesinsoftwaretesting,alongwithcutting-edgesolutions

nAhandfulofideastotryonMonday,somewithlittleornocost

nAbalanceddiscussionofhowthoseideashaveworkedforavarietyofexperts

nReferencesforwheretogoformore

903 Mark Tomlinson,PerformanceGuru,West Evergreen Consulting, LLC

Performance Testing Metrics and MeasuresThissessionwillcovertheexpansiveunderstandingofperformancetestingmetricsandhowtheycanbeusedtodrivequalityinitiativesupstreamanddownstreamintheapplicationlifecycle.Toooftentodayweseethatperformancemeasurements(CPU,DISK,MEMORY,NETWORK)areleftoutofearlytestingautomationandpass/failcriteria,whenitwouldbeabsolutelymorecost-effectiveifwecouldfindandfixthosebottlenecksearlier.Testerswhoarenewtoperformancetestingsuccesscriteriawilllearnnewwaystocorrelateandanalyzeperformancemeasurementsandextrapolatetheresultsinareliableandrepeatableway.Testerswhoareinterestedintakingtheirbug-findingskillstoawholenewlevelwillbedelightedtoexpandintoperformance-relatedtestinginvestigation,explorationandriskanalysis.

904 Sreekanth Singaraju,VP,QAandTestingServices,Alliance Global Services

How and Where to Invest Your Testing automation budgetTestautomationpromisessubstantialbenefitstoanorganizationincludingacceleratedtestcycles,increasedcoverage,accuracyinreportingandenhancedproductivity.Thereality,however,isthatinmanycases,automationprojectsfailbeforetheydeliverprojectedROIortheysubstantiallyunder-performontheobjectives.Thissessionwillcoverfiveprovenstrategiesforasuccessfultestingautomationstrategyandhowtobestallocateyourtestautomationbudget.

Session Takeaways:

nApracticalguidetodevelopingasuccessfulautomationstrategyincludingwheretospendyourbudgetdollarsandallocateresources

nCasestudiesoutliningstrategiestochoosingthefollowing:End-to-Endscenarios,AutomationFrameworks,ImplementationApproachesandTestData

nDefinitionsofmetricsandhowtocapturethemtovalidatethatyourstrategiesareworking

905 Jean Ann Harrison, ProjectManager,ProjectRealms, Inc.

Memory, Power and bandwidth – oh My! Mobile Testing beyond the GUIManytesterstodayareaskedtotestmobileapplications.Theassumptionistotestthemobileapplicationinthesamemanneroftestingawebapplicationoraclient/serverapplication.However,ifthesoftwaretesteristestingmobileapplications,thenthesoftwaretestermustnowbecomeawareofhardwareandfirmwareconditionswhichwerenotnormallyapartofprevioustestcasedevelopment.Chargingthedevicewhilethesoftwareapplicationisbeingdownloaded,installing,inusewheretheGUIisengagedareallnecessarytestsforthemobileapplicationtester.Addanothervariabletochargingthedevicetoconsidertheheatgeneratedfromchargingthebattery,anotherleveloftestscanincludenetworkcommunication,databasesearches,andmemorymanagement.Understandingthecombinationofsoftware/firmware/hardwareallcontainedwithinonecomplexsystemisnowapartofanysoftwaretesterofmobileapplications.

Testerswillworkinteamstoformulateheuristicoraclesbyintroducingvarioushardwareconditionstotheirmobiledevicesandwitnessingdifferentsoftwarebehaviors.Wewilluseexercisestodeveloptestcasesusingexploratorytestingtofurtherinspireheuristicoracles.Theresultwillgenerateaseriesofregressiontestideastoapplyforanymobileapplicationtestingproject.

session block

P a g e 3 0


Joseph Oursdrawson15years’experienceprovidingexecutive-levelleadershipwhilemanaginghighprofileinitiativeswithademonstratedabilitytoleadpeopletowardssuccessfuldelivery.

Philip LewisanAdjunctProfessoratAlaskaPacificUniversityandtheProjectManagementCollegeteachinggraduatecoursesinsoftwareengineering,ITprojectmanagement,andITGovernance.

Richard Kriheli’scareerspansfifteenyearsofqualityassuranceanddesignonaccountssuchasWalmart,L’Oreal,Nokia,Vogue,BestBuy&others.HecurrentlyheadstestingeffortsforNikeatR/GA.

Dan BartowisVPofProductManagementatSOASTA,theleaderinperformancetestingfromthecloud.PriortojoiningSOASTAhewasSr.EngineeringManageratIntuit.

1 1 : 4 5 a m – 1 : 0 0 p m

10Scott BarberisCo-FounderoftheWorkshoponPerformanceandReliability,andco-authorofPerformanceTestingGuidanceforWebApplications,BeautifulTesting,andReducingtheCostofTesting.

Thursday18 october

1001 Joseph Ours,DirectorofSoftwareQAandTestingServices,Cohesion

Redefining the Purpose of software TestingThroughoutthehistoryofsoftwaretesting,theprofessionhasevolvedfromexpectationsofjustmeetingrequirementstoensuringfitnessofuse.Alongtheway,testershavebeensaddledwiththeburdensomeexpectationsofensuringoverallqualityineachoftheseways.Inthispresentationwewilldiscussthehistoryofsoftwaretestinginordertounderstandwheretheindustryneedstogo.Wewilltalkaboutthecommonchallengesourstakeholdershaveinunderstandingourcraft,aswellassomeofthecommonnegativeperceptionsofvalue.Wewilladdressthesewithanewlydefinedpurposeofsoftwaretesting,wheretheemphasisisplacedonprovidinginformation,notjustrawdata,tostakeholders;informationofvalue.Thistransitiontoprovidinginformationwilltransformtestingintoaservicemindedgroupwhosevalueistransparentandultimatelyempoweredbytheirstakeholdersinsteadofjusttoleratedbythem.

Session Takeaways:

nTheevolutionofsoftwaretestingnAnewdefinitionforthepurposeofsoftwaretestingnHowtodelivervaluetostakeholdersinordertobe

empoweredbythemnAbetterdefinedtestingrolethatalignswith

businessvalue

1002 Philip Lew, CEO,XBOSoft

evaluating and Improving UsabilityToday’sweb-basedapplications(WebApps)containingcomplexbusinesslogicandsometimescriticaltooperatingthebusiness,nowmusthaveanincreasedfocusonusabilityaswellasthenewerandbroaderterm,userexperience.Now,mobileappsarefollowingtheirleadandaregainingmoreandmoresophisticatedfunctionalityevenwithlimitedscreenrealestate.Thishasledtobothusabilityanduserexperiencebecomingparamountasthereisnoup-frontinvestmentforcingausertostay.EventhoughusabilityhassomeformalISOmodeldefinitions,


P a g e 3 1

therearenomodelsorformaldefinitionsforuserexperience,noritsrelationtousability.Forusability,ISOprovidesgeneralguidelinesbutlacksimplementationspecifics.UX,ontheotherhand,doesnothaveanyformalstandarddefinition,althoughsomemodelshavebeendevelopedregardingitselements.Modelsandresearchhavebeenusedmostlyforthepurposeofunderstanding,ratherthanevaluatingandimproving.Inthistalk,wedrawrelationshipsbetweenusabilityanduserexperienceanddiscussmeasurementandevaluationmethodsthatcanbeusedasthefirststeptowardimprovement.

Session Takeaways:

nUnderstandusabilityanddevelopausabilitymodelnUnderstandwhyitisimportantandhowitimpacts

useracceptancenMethodologyforcontinuoususabilityimprovementnPracticalmeasurementsnLearnhowoneorganizationconductedusability

testingviaacasestudy

1003 Dan Bartow, VicePresident,ProductManagement,SOASTA

Real World Performance Testing in ProductionOnlineapplicationperformanceiscritical–noonewouldchallengethisstatement.Yetthe“dirtylittlesecret”inthewebworldisthattheamountofperformancetestingdoneonapplicationsisappallinglylow.Whenperformancetestingisdoneit’susuallyconductedinatestlab.Evenwiththoroughtestinginalabenvironment,whenapplicationsaredeployedtoproductiontheyveryfrequentlytoppleunderthepressureofreal-wordusers.Theresultsfromthisinvestmentinlabtestingarenotdeliveringtheanswersthatleadershipneedsaboutwebapplicationperformance.

Testinginproductionisanessentialcomponentofworld-classperformancemethodologies.However,thisapproachisnotwithoutitsownsetofchallenges;thethreemostcommonofwhicharesecurity,testdatainproduction,andpotentiallivecustomerimpact.Inthissessionyou’lllearnkeyelementsfromthemethodologythatcompaniesareusingtoenableproductiontestingandsubsequentlygainthehighestconfidencepossibleintheirproductionapplicationperformanceandreliability.CometothissessionandlearnhowbusinessesfromtheNewYorkStockExchangethroughNetflixhavesolvedtheseproblemstoenableongoingproductiontesting.

1004 Richard Kriheli,AssociateDirectorofQualityAssurance,R/GA

scaling Gracefully and Testing ResponsivelyThewebisn’tjustdesktopanymore.Thewebiseverywhere,creatingafluidconundrumfortheQAprofessional.Asthetestingmatrixgrowsandgrowsintoamultiplatformexpanse,wemustbereadyfornotjustthesizeofascreen,butalsouserbrowsinghabits.Inthissession,we’llexploretheproblemspresentedbyresponsivedesign,examinetheflexiblegridandforecastsystematicsolutions.

Session Takeaways:

nWalkawaywithanenhancedunderstandingofthenuancesofanincreasinglyfluidweblandscape

nGetanoverviewofresponsivewebdesignandarecommendedapproachtotestbeyondthedesktop

nWitnessthevariouspermutationsoftheflexiblegridappliedtoarangeofplatforms

1005 Scott Barber,ChiefTechnologist,PerfTestPlus

Quick, easy & Useful Performance Testing: no Tools RequiredWhenmostpeoplethinkofperformancetesting,theythinkaboutthehardpartsandabouttheexpensiveandcomplicatedtoolsthatarerequiredtosimulatetheactivityofthousandsofend-usersallatthesametime,whilecollectingtensorhundredsofthousandsofmeasurements.Inreality,manyperformanceissuescanbedetectedanddiagnosedwithexactlythetoolsandknowledgeyoualreadyhaveatyourdisposalusinginformationobtainedfromquick,easyandcheapperformancetests.Infact,muchoftheperformancerelatedinformationthatstakeholdersneedtomakegooddecisionsanddevelopmentteamsneedtodramaticallyimprovesystemperformanceiseasilyobtainablebytheperformance-testinglayman.

Scottwillintroduceyoutoseveraltechniquesthattheperformancetestinglaypersoncanusetospeedupandsimplifythecollectionofvaluableperformance-relatedinformation;manyofwhichyoucanuseduringthetutorialtotestyourcurrentwebsiteifit’saccessiblefromtheclassroom.

Session Takeaways:

nWhatperformancetestingcanbedonequickly&easilynTheresourcesnecessarytodoitnTheexperienceofhavingdoneit

PRSR

TST

DU.

S.P

OSTA

GE

PAID

PERM

IT#

6563

SLC

UT8

4115

RegisteR N O W !DiscountsEarlyBirdDiscount:RegisteronorbeforeSeptember7toreceive$400.00offanyfullconferencepackage

Team Discounts

Number of Attendees

Rate Before Early Bird

(9/7)

Rate After Early Bird

(9/7)

1-2 $1,295 $1,695

3-5 $1,195 $1,395

6-9 $1,095 $1,295

10-14 $995 $1,195

15+ $895 $1,095

*Price above is for access to the Main Conference Package. Please add $400 to your registration if you are registering for the Main Conference Package PLUS 1-Day.

**Team discounts are not combinable with any other discounts/offers. Teams must be from the same company and should be submitted into the online registration system on the same day.

regiSTer @www.STPCon.com

or call 877.257.9531

50 Conference breakout sessions in 8 Comprehensive Tracks

1115

Elk

ton

Driv

e,S

uite

301

nC

olor

ado

Sprin

gs,C

O80

907

leadership Perspectives for Testers

strategic business alignment

Test strategy, Process and Design

Performance Testing

Test automation

agile Testing

Mobile application Testing

Hands-on Practicals

Documents

STPCon Fall 2012