Case Study: Royal Bank of Canada’s Managing of Test Data Life Cycle with CA Agile Requirements Designer and CA Test Data Manager

World®’16

CaseStudy:RoyalBankofCanada’sManagingofTestDataLifeCycleWithCAAgileRequirementsDesignerandCATestDataManagerElhamBassiri- Director,QualityEngineering- RoyalBankofCanada

DO5X33S

DEVOPS

2 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

©2016CA.Allrightsreserved.Alltrademarksreferencedhereinbelongtotheirrespectivecompanies.

Thecontentprovidedinthis CAWorld2016presentationisintendedforinformationalpurposesonlyanddoesnotformanytypeofwarranty. The informationprovidedbyaCApartnerand/orCAcustomerhasnotbeenreviewedforaccuracybyCA.

ForInformationalPurposesOnlyTermsofthisPresentation


Abstract

RoyalBankofCanada’s(RBC)datawarehousegroupisfocusedondeliveringsolutionsontime,withreducedcostandminimizedrisk.Fordevelopmentandtestingpurposes,migratingfullcopiesofproductiondataandmaintainingthemistime-consuming,costlyandpronetorisk.Thein-housesolutionsinthisregardweremostlymanualandrequiresignificantongoingmaintenance.RBCapplicationsarelargeandcomplex.Asaresult,findingandextractingconsistent,realisticsubsetsbyhandischallenging.Provisioningpoorqualitydataresultsinpoorqualitytesting.Manydatasub-settingtechniquesinvolvemultiplesteps,whichincludechangingthedatatoproprietaryformatsinordertomaskit,whichalsoincreasesthepotentialriskofbreaches.Thispresentationwilloutlinetheneedforasub-setting/maskingsolution,howitcanbeimplementedinsuchalargeorganizationlikeRBC,andpossibleexpectedresults.RBCwillpresenttheiruseofCAAgileRequirementsDesigneralongsideCATestDataManager,andhowtestdatalifecycleautomationisapossibility.UsingCAAgileRequirementsDesigner,BRCisabletomodelcurrenttestingrequirementsandgenerateoptimizedtestcases,andbyusingCATestDataManagerSolutiontheyareabletosubsetandmasklargevolumesofproductiondata,complexdatastructuresfollowingstrictregulationsthatareinplace.

ElhamBassiriRBC,EnterpriseInformationManagementDirector,QualityEngineering


Agenda

RBCQUALITYENGINEERINGSERVICES

TESTDATAMANAGEMENTPAINPOINTS

CURRENTBENEFITSANDFUTUREPLANTS

TESTDATAMANAGEMENTOBJECTIVES

PROPOSEDSOLUTION

TOOLSELECTION

1

2

3

4

5

6


QualityEngineeringServicesWhatThisTeamDoes

EIM Services

Optimized TestingRelease Management

*Test Data Management and

QA Environment

Other:Provide QE approach for transformational changes

Automation and

Continuous Integration

*FocusofthispresentationisonourTDMchallengesandsolutionthatisalsoaninputtoallQEservices


TestDataManagement– PainPoints

§ Wehadtoomanytestenvironmentsandtheywerenotinsync

§ TestenvironmentsdidnotsufficientlyrepresentproductionandleadtoQAandcredibilityissuesandrework

§ Timetodeliveronchanges/Projectsandcosttoimplementwasincreasedduetotestdatachallenges

§ InadditiontestDataadhocrequestsfromover50BusinessUnitswasbecomingunmanageable

TestDataManagementWasOneofOurBiggestChallengesforTesting,ExplorationandAnalysis


TestDataManagement– ObjectivesWhatWasOurObjective:

§ EIMtoprovideaTestandDevelopmentenvironmenttosupportinternalandbusinessbaseddevelopmentlifecycle

§ EstablishaTest/Devplatformmaintenanceapproach

§ Theenvironmenttocontainscheduledrefreshedrepresentationofproductiondata

§ Deployautomateddataconsistencyacrossenvironmentsandreduceoveralldevelopmentandtestingtime


ProposedSolutionOurProposedSolutionWas:

Prod-A

Prod-B

FullSetBaseline+NewData

Test-X

FullSetBaseline

IST

FullSetBaseline

Test/Dev-B

FullSetBaseline

Test/Dev-A

FlatFiles

1

2

3

1 2 3

§ AutomatedprocessestoextractdatafromproductionintoTest-X

§ Dataisextractedbasedonasamplingcriteria(yettobedetermined).

§ Theseprocesseswillbescheduledinlinewithcurrentproductioncycles(weekly,monthly,etc.

§ Test-Xtomaintainproductionleveldatawithlimitedhistory.

§ Platformtoserveandprovideaccessfor:⎻ Poweruseranalytics⎻ Supportworkgroups⎻ Userdrivendatadiscoveryand

dataprofiling⎻ Providea”near-production”

platformtoconductperformancetestingandfinalpre-productiontesting

§ Productionreflectionofdata”masked”indatabaseonTest-X,thenextractedtofiles.

§ Thebaselinesetofdataloadedtoallthreetest/devplatforms.

§ Versioncontrolledbaselinesmaintainedateachplatformforaccesswhilecreatingadditionalobjectsorchangesineachlogicalprojectdatabases.


ToolSelectionWeNeededaTooltoHelpUsWiththeProposedSolution

§ Providedatasubsetting andmaskingtobuildagoldencopyofproductionliketestdata

§ Maintainthereferentialintegrityofthedata

§ Generatetestdatathatdoesn’texistinthegoldencopy


OurSolutionLeveragingCATDMGoldenCopyofDataIsCreatedUnderBaselineDatabase

CATDM


TestDataGenerationSyntheticDataFitforPurpose

Inthefollowingcaseswherewehavedatarequeststhatdoesn’texistinourbaseline:

§ Specifictestdatarequirements§ Testdatafornegativetestscenarios§ Datavolume§ Newfieldsorcolumnrequirements

UseCATestDataManagerTool:§ Itfollowsthesamefieldsand

structureastheactualdataextractedfromproductionserver

§ Provideshighvolumeofdatafaster


TestCaseOptimization

InAdditionweuseCAAgileRequirementsDesignersolutionwhichhelpsus:

§ Identifygapsintherequirements§ Generateasetofoptimizedtestcasesautomatically§ Helpswithagilechangesandsupportagilesprints§ IntegrationwithourALMrepository§ Futureplantsincludeusingautomationcodegeneration

andQAriskassessment

CAHasAlsoHelpedUsWithOptimizingOurTestCases


OurFutureGoals

Achieveahands-free,100%testdataautomationusingtestdataondemand

ExpandtheTestDataManagementServicestootherdepartmentsacrossotherdepartmentsinIT

ConnectARDtestcasesgeneratedtoourtestexecutionautomatedtool

Generatesyntheticdatacustomfitfortestcases


Questions?


RecommendedSessions

SESSION# TITLE DATE/TIME

DO5T02PLeadershipPanel:DevOpsLeadersDiscusstheJourneytoContinuousDelivery

11/17/2016at01:45pm

DO5T03PLeadershipPanel:ContinuousDeliveryintheFinancialServicesIndustry

11/16/2016at04:30pm

DO5T14SAnalystKeynote:ContinuousDelivery:MakingDevOpsAwesome

11/17/2016at10:30am


MustSeeDemos

ModernizeAppDelivery

IntegratedCDTheater5- DOV501P

DeliverTestDataFaster

TestDataManagerTheater5- DOV511P

DeliverBetterApps

ServiceVirtualizationTheater5- DOV507P

OrchestrateYourRelease

ReleaseAutomationTheater5- DOV513P


Stayconnectedatcommunities.ca.com

Thankyou.


DevOps– ContinuousDelivery

FormoreinformationonDevOps– ContinuousDelivery,pleasevisit:http://cainc.to/PiTFpu

Technology

Case Study: Royal Bank of Canada’s Managing of Test Data Life Cycle with CA Agile Requirements Designer and CA Test Data Manager