Hands-On Lab: Speed Problem Resolution with CA Application Performance Management Assisted Triage

World®’16

Hands-OnLab:SpeedProblemWithCAApplicationPerformanceManagementAssistedTriage

AndreasReiss,Sr.PrincipalEngineeringServicesArchitect,CATechnologies

DO4X150L

DEVOPS– AGILEOPERATIONS

2 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

©2016CA.Allrightsreserved.Alltrademarksreferencedhereinbelongtotheirrespectivecompanies.

Thecontentprovidedinthis CAWorld2016presentationisintendedforinformationalpurposesonlyanddoesnotformanytypeofwarranty. The informationprovidedbyaCApartnerand/orCAcustomerhasnotbeenreviewedforaccuracybyCA.

ForInformationalPurposesOnlyTermsofthisPresentation


Abstract

Inthisguidedlabsession,youwilltakeawalkintheshoesofPete,aLevel1supportanalystandlearnhowtoquicklytriageapplicationperformanceissuesusingnewpatentpendinginnovationsinCAApplicationPerformanceManagement(CAAPM)10.SeehowthenewAssistedTriagefeatureinCAAPM10.4canpredictivelysuggestfixestocommonperformanceproblems.Alsolearnhowtopivotperspectivestoobtainrole- andtask-basedviewsintocomplexappinfrastructures.

AndreasReissCATechnologiesSr.PrincipalEngineeringServicesArchitect


Agenda

WELCOMETONOWHEREBANK

ANORMALDAYINPRODUCTION

ASSISTEDTRIAGEEXPLAINED

REWIND

CLOSINGINONTHEPROBLEM

1

2

3

4

5


WelcometoNowhereBank


TriageandDiagnoseApps

§ LocateBanking-Control.cmdatfolderxyzandstartit

§ Startinsequence– Messagingserver– Engine– Mediator– Portal

§ Logintoweb view– http://localhost:8080

GettingNowhereBankStarted

1 2 3 4



§ Starttraffic

§ Validatetransactiontracesininvestigator


1



§ Three-tierapplication

§ HTTPcommunicationbetweenportalandmediator

§ Mediatorandenginecommunicatewithrequest/replyqueues

IntroductiontoNowhereBank

NowhereBankServer

Portal

Mediator

Engine

HTTPCommunication

RequestQueues

ReplyQueuesQueueServer


ANormalDayinProduction…


SpeedProblemResolutionWithAssistedTriage

§ Systemlooksnotsuperbusy

§ CPUlooksnormal

§ Suddenlyportalresponsetimesjumpthroughtheroof

§ Butonlyforsometransactions?

ANormalDayinProduction


SpeedProblemResolutionWithAssistedTriageANormalDayinProduction‒10MinutesLater

NoworriesJohn,wegotit!

Weareallsorted.Theproblemandallevidencesarealreadyinthe

ticket.

At8:52ourexternalwebservice intheengine showedhighresponsetimes.

That’swhenwesawfirsthighresponsetimesontransactions.5minlaterthebookingqueuewasfull.2minlaterrequestsstalledinthemediator.

Pete,what isgoingon?IheardaboutserioustroubleonNowhereBank?

Calleverybody.Let’sgoonabridge

calltofindtheproblem.

????

1

2

3



§ Triggerthescenario– “DBFailing”



AssistedTriageExplained


SpeedProblemResolutionWithAssistedTriageAssistedTriageSteps

ProblemTriggers

ProblemStory Analysts

TransactionPath

AssistedTriage


SpeedProblemResolutionWithAssistedTriageAssistedTriage

xyz xyz xyz xyz

18:25– DifferentialAnalysistrigger

18:22-timeouts

18:20-stalls

Evidence Types ErrorComponent ComponentRelationships ProblemSequences

ComponentRelationships

Suspect(s)


10MinutesEarlier…



§ OpenTeamCenter

§ Gothemapview

§ Investigatethecallpathofthetransaction

ValidatetheTransaction Path

TransactionPath


SpeedProblemResolutionWithAssistedTriageProblemTriggers

AssistedTriage

evidence

DifferentialAnalysis

ErrorEvents

AlertBreach

StallEvents

ProblemTriggers


xyz xyz


§ Twocomponentswithproblemsidentified

§ Noexperienceaffected

Experiencevs.Problemvs.Anomaly

Experience

xyz

xyz

xyz xyz

xyzThesystemdetectedoneanomalywithtwoaffectedcomponents



§ Onceanexperienceshowserrors,it’sidentifiedasproblem

Experiencevs.Problemvs.Anomaly

xyz xyz

Experience

xyz

xyz

xyz xyz

xyzThesystemdetectedoneproblemwiththree affectedcomponents



§ GototheHomepageandobservetheexperiences§ Movetothenotebooktoisolatetheproblem

ProblemTriggersProblemTriggers

Linktonotebookperexperience


SpeedProblemResolutionWithAssistedTriageNotebook– Isolatingdata

Timelinewithindicators

Transactionhealth

information

Isolatedtransactioncomponents

Problemsandanomaliessection


ClosinginontheProblem



§ Selectevidencestoinvestigatecomponentsontheselectionpath

InvestigatingProblemComponentsProblemStory

DBFailureEvidence



§ Usethemetricsoverviewtovalidateproblembehavior

InvestigatingProblemComponentsProblemStory

Transactionerrors



§ Thenotebookasacombinedsolutiontoprovideallinformationrelatedtoaproblem

Understand

Businesstransaction/experiencerelatedtoaproblem

Timestampoffirstandlastappearanceofevidences

Alldetailedevidencesrelatedtoaproblem

Suspect

ProblemStory


SpeedProblemResolutionWithAssistedTriageCommunicate‒Share

• SharableLinktotheisolatedproblemdescription(notebook)

• Alldetailsandevidencesatoneplace


Thankyou.

Stayconnectedatcommunities.ca.com


DevOps– AgileOps

FormoreinformationonDevOps– AgileOps,pleasevisit:http://cainc.to/wYXSg6

Technology

Hands-On Lab: Speed Problem Resolution with CA Application Performance Management Assisted Triage