52
World ® ’1 6 Exploiting Operational Intelligence Within Database Management Tools Ron Colmone, Sr Consulting Architect Arun Vijayaraghavan, Sr Principal Product Manager CA Technologies MAINFRAME AND WORKLOAD AUTOMATION MFX76E

Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

Embed Size (px)

Citation preview

Page 1: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

World®’16

ExploitingOperationalIntelligenceWithinDatabaseManagementToolsRonColmone,Sr ConsultingArchitectArunVijayaraghavan,Sr PrincipalProductManagerCATechnologies

MAINFRAMEANDWORKLOADAUTOMATION

MFX76E

Page 2: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

2 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

Abstract

Attendthissessiontogetaclose-uplookatcurrentlyembeddedoperationalintelligenceindatabasemanagementutilities.Discoverhowtoexploittheseavailablecapabilitiesaswellasthepossibilitiesforyoutobuildyouown!Youwilllearnhowadvancedautomationrequiresuniqueoperationalintelligencethatcanfurtherevaluatewhichadditionaltaskscanbeautomatedandtowhatdegree.Additionally,learnhowtosimplifyyourdaytodaydecisionmakingtominimizethetimerequiredtoeffectivelymanageandrunanefficientdatabasesystem.Theeffectsofallthis?HowabouthelpingtolowerDB2operatingcostsandimproveuserproductivity,includingmanualeffortandspecifically“specializedorexpert”manualrequirements.

RonColmone

ArunVijayaraghavan

Sr.ConsultingArchitectCATechnologies

Sr.PrincipalProductManagerCATechnologies

Page 3: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

3 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

Agenda

USINGDATABASEANALYZERFORAUTOMATINGOBJECTMAINTENANCE

IDENTIFYINGSQLTOANALYZEFORIMPROVINGAPPLICATIONPERFORMANCE

IMPROVINGQUERYPERFORMANCEWITHPLANANALYZER

IDAAACCELERATIONWITHRC/QUERYANDSYSVIEW FORDB2

FUTUREOFOPERATIONALINTELLIGENCEINDB2

1

2

3

4

5

Page 4: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

4 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

CADatabaseManagementPortfolioVisionManagingGrowthandComplexitytoAddressEvolvingDataManagementNeeds

Planned Available

IMS DB2

CAAdministrationSuite

CAPerformanceSuite

CAUtilitiesSuite

CARecoverySuite

ExperiencedDBA

WebAppServer

MobileDeveloper

BigDataAnalyst

RESTAPI

NextGenDBA

CAAnalyticsfor

DB2

NextGenDBA

ExternalApps

Page 5: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

5 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

DatabaseAnalyzerProvidesOperationalIntelligenceforDB2ObjectMaintenance

Page 6: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

6 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

DatabaseAnalyzer– PastandPresent

STATISTICSEVOLUTIONINDB2

QUICKOVERVIEWOFDATABASEANALYZERPROCESSING

TRADITIONALSTATISTICSCOLLECTIONANDANALYSIS

OBJECTMAINTENANCEUSINGDB2REALTIMESTATISTICS(RTS)

PRIORITIZEDOBJECTMAINTENANCE

1

2

3

4

5

Page 7: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

7 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

Statisticsevolution– let’sstepbackandremember

§ RUNSTATSSinceDay-1– Collectedstatisticsfortheoptimizer– CollectedstatisticsfortheDBAtodeterminewhenREORGneeded

§ ExtentsaloteasiertotriggerthanCLR,LEAFDIST,FAROFF,NEAROFFetc.

§ Someissues/problemswiththisapproach– DB2cataloggotupdatedwithpotentially“bad”statistics– BIND’sandREBIND’sshouldbepostponeduntilstatisticsfixedby

REORGandanotherRUNSTATS

Page 8: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

8 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

Statisticsevolution– let’sstepbackandremember

§ REPORTYESandUPDATENONE– Greatimprovementtoverifyobjectshealthcondition– NoneedtoworryaboutBIND,REBIND,dynamicSQLdueto“bad”

statistics– HadtochangeapplicationstointerpretRUNSTATSSYSOUTasopposed

tousingSQLagainsttheDB2catalogdeterminingREORGetc.

§ Objectskeptgrowinginnumberandsize– RUNSTATSexpensive– Samplingintroducedlateinthegame– Inlinestatscanbeusedwhenloading/reorganizingobject- Limited

Page 9: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

9 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

Statisticsevolution– let’sstepbackandremember

§ RTSintroducedinDB2V7– fromDB29mandatory– Newchallengesintroduced(morelater)

§ Manywaystotriggerthereorgofanobject?– Performancemetrics– whenapplicationperformancestarttodegrade– Fixedschedule– Weekly,Monthly,etc.basedonobjectsize/type– Partitionedobjects- EntireTableSpaceoraPartitionatatime?

§ RTSiscommonlyusedtodayforObjectMaintenance

§ ToolslikeDatabaseAnalyzerorDB2’sDSNACCOXSP

Page 10: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

10 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

RTSDrivenREORGsandSpaceAdministration

§ Somelimitationstothinkaboutbasedonrequirements– Istheobject(orpartition)over- orunderallocated?– DoyouwanttoalterQTYbasedoncurrentconditions/metrics?– CanyousaveanINDEX-LEVELbydoingareorg

(oneRTScolumnmighthelp)– Doyouneedtoprovideaccuratespacetrending/forecasting– DoyouhaverequirementstogenerateyourownSQLbasedconditions

todrivetheprocess– DoyouhaveaneedforIF-ELSElogicdrivingtheprocessesor

dynamicallydecidehowtheutilityshouldbegenerated– Slidingscalealgorithmresolvesmanyspaceallocationconcerns

Page 11: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

11 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

DatabaseAnalyzerProcessOverview

DatabaseAnalyzerExtractandActionProcessing

DB2UtilityJOBs

DatabaseStatisticsExtract

ActionsConditions

Page 12: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

12 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

DatabaseAnalyzer– Traditional(OldStyle)Space/Reorg

§ VerycommontobuildanExtractProcedureononeormoreDatabases(couldprocessentiresubsystem)

§ ActionProcedurescanbecreatedorselectedfromlistofbestpracticeDB2maintenanceoptions(Reorg,RUNSTATS,ImageCopy,etc.)

§ ProblemwithTraditionalDatabaseAnalyzerAutomation– Toomanyobjectstoprocess,onlysubsetmayneedattention– CPUintensivecollectingallthestatsneededtodoReorgorAlter– RTShasbeenavailableforsometimeandcanprovidenecessarystats

Page 13: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

13 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

DatabaseAnalyzer– PreferredMethodisRTOS

§ RealTimeObjectSelection(RTOS)usesDB2RTS– NewwithR19- ObjectSelectionProfile(OSP)linkedtoExtractprocedure

tofilterobjectstobeprocessed(DatabaseandTablespacemasks)– CangenerateactionJCLforselectedUtilityprocessingbasedonRTS

conditions(Bestpracticearevaluesavailable)– OrcangenerateDatabaseAnalyzerStatisticsonthesubsetofobjectsand

continuetotakeadvantageoftheextensive“traditional”actionconditions– NewwithR19– PrioritizedObjectMaintenance(POM)profilescanbe

linkedtoExtractProcedurestoenabletheActionJCLgeneratedtobeprioritizedbasedonPrioritizedObjectConditions(POC)

Page 14: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

14 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

OperationIntelligencewithDetectorSQLCollection

Page 15: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

15 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

Detector– SQLCollectionforAcceleratedPerformance

§ AnalyticsAcceleratorUsageScenarios– Rapidlyacceleratebusinesscriticalqueries

§ OftenchallengingtotunequeriesthatalsosupportOLTPworkload– Improveaccesstohistoricaldata– Newbusinessintelligenceusecases

§ UseCADetectortohelpidentifylongrunningqueries– SortQueriesbyHighIN-DB2time– IdentifyDB2Tablesassociatedwiththeselongrunningqueries

§ IfrunningSubsystemAnalyzer,OptionTinDetectorwillshowtablesassociatedwithQuery

Page 16: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

16 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

PlanAnalyzertoDeterminePotentialAcceleratedPerformanceImprovements

Page 17: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

17 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

PlanAnalyzer- ACCELProfileSupport- ProfileServices

§ CreateanduseACCELprofilesusingtheDB2ProfileServicesfacility.ThefacilityusestheseDB2tables:– SYSIBM.DSN_PROFILE_TABLE– SYSIBM.DSN_PROFILE_HISTORY– SYSIBM.DSN_PROFILE_ATTRIBUTES– SYSIBM.DSN_PROFILE_ATTRIBUTES_HISTORY

§ ACCELprofilecostingisonlyappliedwhenDSNZPARMQUERY_ACCELERATIONisoneoftheseoptions:– ENABLE– ENABLEWITHFALLBACK

Page 18: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

18 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

PlanAnalyzer:IBMDB2AnalyticsAcceleratorsupport

ThresholdvaluesdetailstobeusedwhenAcceleratoraccessisconsidered

19.0 ---------- PPA DB2 Profile Services Create --------- 2016/04/05 03:32COMMAND ===>

PROFILEID ===> 5000 FUNCTION ===> ACCEL ENABLED ===> Y REMARKS ===> AIG DEMO >----------------------------------------------------------------- RASST02

ACCELERATOR THRESHOLDS: TABLE CARDINALITY ===> 2000000 N/A | -1 | 1 thru 2,147,483,647 RESULT SIZE ===> 1 N/A | -1 | 1 thru 2,147,483,647 TOTAL COST ===> +.0E+00 N/A | -1 | 0 thru +7.2E+75

Page 19: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

19 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

PlanAnalyzer:IBMDB2AnalyticsAcceleratorsupport

STARTPROFoncommandlinewillactivatenewDB2Profile

19.0 -------------- PPA DB2 Command Display ------------- 2016/04/05 03:36COMMAND ===> SCROLL ===> PAGE

LINE 1 OF 24DSNT741I !DB2G DSNT1SDV START PROFILE IS COMPLETED. DSN9022I !DB2G DSNT1STR 'START PROFILE' NORMAL COMPLETION

Profile Services Status Report

Profile ID: 5000 Function: ACCEL Status TS: 2016-04-05-03.36.11.397468 Status : ACCEPTED BY DB2G

Attribute : ACCEL_RESULTSIZE_THRESHOLD Value : 1 Status : ACCEPTED

Attribute : ACCEL_TABLE_THRESHOLD Value : 2,000,000 Status : ACCEPTED

Attribute : ACCEL_TOTALCOST_THRESHOLD Value : 0 Status : ACCEPTED

Profile ID: 8661 Function: ACCEL Status TS: 2016-04-05-03.36.11.397468 Status : REJECTED BY DB2G - DUPLICATED SCOPE SPECIFIED

ID=8661wasalreadyactive.

TogglecommandonProfileServicespanelcanbeusedtoenable/disable

Page 20: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

20 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

PlanAnalyzer:IBMDB2AnalyticsAcceleratorsupport

§ PossiblevaluesforQUERYACCELERATIONareobtainedfromSYSACCELERATEDPACKAGESandassignedtothespecialregister– (ENABLEWITHFAILBACK)BehaveslikeENABLE,butifanerroroccursonthefirstOPENof

theacceleratedstaticqueryDB2preventsthequeryfromfailing.Instead,DB2performsatemporarystatement-levelincrementalbindofthequery,andthequeryexecutesinDB2.

– (ELIGIBLE)Indicatesthatstaticqueriesareboundforacceleration,butareacceleratedonlywhentheymeetallaccelerationcriteriawiththeexceptionofcostandheuristicscriteria.QueriesthatdonotmeetthiscriteriaareboundforexecutioninDB2.

– (ALL)Indicatesthatallstaticqueriesareboundforacceleration,androutedtotheDB2Accelerator.IfDB2determinesaquerycannotbeacceleratedandthequeryreferencesauserbasetableorview,thebindorrebindpackagefailswithanerror.

SupportfornewBIND/REBINDcardsforpackages

Page 21: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

21 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

CAPlanAnalyzer:IBMDB2AnalyticsAcceleratorsupport

§ EXPLAINwithQUERYACCELERATION– Generatetheaccesspathinformationforpackagesthatwerebound

withthisoption,withoutissuingaREBIND.– FUTUREexplainwillSETthespecialregisterCURRENTQUERY

ACCELERATIONbeforethedynamicexplaintoreflectthevalueboundinthecatalogforthepackage.

– IfDSNZPARMACCELMODEL=YES,FutureExplainoverridesthevaluethatisspecifiedintheQUERYACCELERATIONbindoptiontoNONE.Thisactionallowstheaccesspathtogeneratesuccessfully.(nextslidewillillustrate)

Page 22: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

22 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

CAPlanAnalyzer:IBMDB2AnalyticsAcceleratorsupport

ACCESStypeillustratesthequerycanbeexecutedontheIBMDB2Analytics

Accelerator

ViewDSN_QUERYINFO_TABLEwhenusingExplainProfile– PLAN_TABLEOption===>ALL

Page 23: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

23 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

AccelerateandMonitorIDAATableswithRC/Query,BatchProcessorandSysview forDB2

Page 24: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

24 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

CADatabaseAdministrationforDB2forz/OS

§ CARC/Query &BatchProcessor(canusewithautomation)– Noneedtonavigatebetweenmultiplesolutions– ManageDB2AnalyticsAcceleratorwithinyourCADB2solutions

§ Display/Start/StopAccelerator§ Add/RemovetablestoDB2AnalyticsAccelerator§ Loadtabletotheaccelerator§ Enable/Disabletableacceleration/replication§ AlterAcceleratedtableDist.&OrgKeys§ ArchiveAcceleratedtable§ ForceRemoveTablefromDB2AnalyticsAccelerator§ Restorethearchivedmovedpartitionsdata

NewwithR19

Page 25: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

25 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

ManageDB2AnalyticsAcceleratorUseCARC/QueryforIDAAadministration

Use“?”linecommandtoseeavailablecommands.

IDAATablelevelfunctionsareavailabletoDefine,Alter,Remove,Load,etc.

Page 26: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

26 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

ManageDB2AnalyticsAccelerator

§ LoadDB2TableintoIDAA– RC/QALOADCommand

– CanloadrangeofpartitionsorentireTable

– UsesIDAALoaderutility

– MostcommandssuchasALOADareavailableusingBatchProcessorScripts

UseCARC/QueryforIDAAadministration

Page 27: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

27 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

SYSVIEWforDB2– IDAASubsystemStatistics

§ Newacceleratorrelatedfieldswereaddedtorecords:– Databasestatistics(IFCIDs2and1002)– DB2systemparameters(IFCIDs106and1006)

§ Updatedreports:– SYSACCEL/SYSACDTL:AcceleratorList/Detail– HSACCLST/SYSCCDTL:AcceleratorServerList/Detail(history)– HSUACLST/HSUACDTL:AcceleratorServerList/DetailSummary(history)– BTSTATR1:StatisticsDataTrace(batch)– BTSTASM2:SummaryofDB2databaseaddressspacestatistics(batch)– SYSSTATS/SYSTATA,GRPSTATS/GRPSTATA:SystemOverview

Page 28: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

28 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

DB2AnalyticsAccelerator

§ Subsystemstatistics:AcceleratorDetails– SYSACDTL:

AcceleratorDetails– HSACCDTL/

HSUACDTL:AcceleratorServerDetails/Summary

CASYSVIEW®PerformanceManagementforDB2

Page 29: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

29 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

DataDrivenDBPerformanceManagementMainframeOperationalIntelligence

Page 30: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

30 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

EXPERTSYSTEMS&MACHINELEARNING§ AnalysisofHistorical,Near

Real-timeplusLivedata§ DataMining,MachineLearning

&Autonomics§ SelfDrivingCars

DATAMINING&DECISIONSUPPORT§ AnalysisofHistorical&NearReal-timeData§ DataMining,Aggregations&Decision

Support§ NavigationToolswithTrafficUpdates

BI&STATISTICALANALYSIS§ AnalysisofHistoricalData§ BIReporting,Slicing/Dicing§ BasicNavigationTools

EvolutionofOperationalIntelligenceActionableanalyticswithsignificantadvancestowardszerotouchoperations

ANALYTICS1.0BUSINESSINTELLIGENCE

ANALYTICS3.0DATA-DRIVENAPPLICATIONS

ANALYTICS2.0BIGDATA

TechnologyTrend

Page 31: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

31 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

55%ofapps

dependonmainframe

70%world’scorporate

dataisonamainframe

70%oftransactionsflowthroughmainframe

64%Increaseinmainframeworkloads

ANOMALYDETECTION

BUSINESSSERVICEMANAGEMENT

EXPERTSYSTEMS

SECURITYBREACH

DETECTION

IndustryOpportunityDataAnalyticsandtheMainframeOpportunity

Page 32: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

32 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

MainframeOperationalIntelligenceLeveragetechnologytrendtosolveanimportantMainframeproblem

ANOMALYDETECTION

REPORTINGMODERNIZATION

BUSINESSSERVICEPERSPECTIVES

EXPERTSYSTEMS

• Reacttothresholdevents

• Selfserviceviews• ModernU/X

• Predictanomalies• Proactiveresponse

• Topologydiscovery• Businessserviceperspectives

• Predictbusinessservicedisruption

• Rootcausehypothesis• Resolution guidance• Automateresponse

DataAnalyticsBI/StatisticalModeling

USERS

Generalist

MAINFRAM

EOPERA

TIONS

Experts

Specialists

Automation

ENTERP

RISE

SUPP

ORT

MTTR&FirefightingOptimizedPerformance&Efficiency

AutomationDataDrivenOperations

Page 33: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

33 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

IntelligentMainframeOperations- LiftingtheBurden

DATA-DRIVENAPPLICATIONS

ANALYTICALTOOLS&SKILLS

IN-HOUSEDATASCIENCE

IN-HOUSEDOMAINEXPERTISE

+

+

YOURBURDEN MainframeTeamCenter

LettheDATAdotheWORKforyou

DoMOREwithLESS!

Fueledby:§ advancedanalytic

algorithms§ machinelearning

Page 34: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

34 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

MainframeOperationalIntelligenceKeycapabilitiesbeingdevelopedtomanagethelifecycleofyourdataassets

AnalyticsProcessing Multi-ChannelDelivery

Multi-ChannelDataCapture

DistributedDB2,Oracle,MySQL,

Cassandra...

MainframeVSAM,DB2,IMSDB,IDMS,DATACOM,

SMF,Syslogs,Vtape,CICS

Itsyourdata,leverageittodotheworkforyou!

DataLifecycleManagement

• ReportDistribution• AnomalyAlerts• Ad-HocAnalysisTools• APIbaseddataaccess• Automationframeworks

ExpertSystemsAutonomics

Transport&Integration ScalableData

Storage

DataScienceandAnomalyDetection

BusinessIntelligence

ITOperationsIntelligence

APIManagement

MasterDataManagement

Page 35: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

35 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

DataDrivenDBPerformanceManagementProblem,OpportunityandProposedSolution

Page 36: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

36 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

INCREASINGCOMPLEXITY REACTIVETOPROACTIVE EARLYWARNING

CompaniesaredevelopingcomplexSQL applicationsonDB2.Performanceoftendegradesovertimewithoutanyonenoticing(thecreepingtrend).

AnintelligentsystemthatcanrecognizeandprioritizesignificantchangesinSQLperformancebeforeitstartstoimpactresourceoverheadsand servicelevelagreements

ADBAoftendoesnotrecognizedegradationuntilcustomerscomplain orservicelevelagreementshavebeenmissed.

TheSituationEverincreasingapplicationvolumesandcomplexity

Page 37: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

37 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

§ Howdoyoudeterminewhenperformancestartedtodegrade?§ HowlongdoesittaketoidentifytheproblematicSQLstatements?§ Doyouknowhowthestatementsexecutedbeforetheperformance

degraded?§ Doyouhavealogofapplicationperformanceproblemsand

resolutions?– Canyoucomparethislogwithcurrentproblems?

§ ManycustomersoffloadCADetectordatastoreintoDB2tables– Queryheaviestplans/packages&manuallycompareto“baselines”– Noefficientmethodtore-evaluatebaselineswhen“theworldchanges”

– Howtomonitor“standarddeviation”and“creepingtrend”iscomplexandcumbersome

TheChallengeHowdoyouresolveperformanceproblems?

Page 38: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

38 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

Capture CADetectorcollectsSQL

intervalperformancemetricsforanalysis.Createsan historicalviewofapplicationperformance,whichwillbestoredinthecloud.

Baselin

e BaselinesarecreatedthatcontainastatisticalanalysisofapplicationSQLperformanceforachosen,representative,period-in-time.Baselinerepositorycanbeupdatedwhenbaselinesaredeterminedtonolongerberepresentative.

Analyze Analyzesapplication

performancedeviationsfromnormalexecutionbehavior(i.e.,deviationsfrombaselines)andlogsinaneventsrepository. N

otify

DuringtheAnalyzestep,notificationsofperformancedeviationscanbesenttokeypersonnelviaemail.

Review

InadditiontooutputfromCapture,Baseline,andAnalyzetheapplicationwillallowyoutoreviewapplicationperformancehistorythroughawebbrowserinterface.Deeperanalyticsandvisualizationareavailablethroughthebrowserdashboard.

Mainframe

TheSolutionMainframeTeamCenter–OperationalIntelligence

Page 39: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

39 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

USECASE:Sherman,Debbie,andFredhavedeepexperienceandskillsintheirrespectiveareas.Theyhatebeingcalledafterasystemproblemhasoccurredandbeingaskedtoprovethattheirareawasatfaultorinnocent.Theywouldlikeasystemthattellsthemwhentheirareaisbehavingabnormally,sothattheycanaddressitbeforeitcomestotheattentionoftheSystemsPerformanceEngineer.

• Operations,SystemsProgrammer,• NetworkEngineer,ApplicationDBA

PERSONA:

PROBLEM§ “Avoid,detectandpredictissuesthatmightbeaproblem”§ “Thresholdsarehardtomaintainandgeneratelargeamountoffalsepositives”§ “Abilitytoseemultipleviewsofdata”§ “Abilitytocreateviewsofinformationfaster”§ “ThecurrentU/Xpreventseasycollaborationandaccesstoanalytics”

AnomalyDetection– ProblemAvoidance/Prediction

Page 40: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

40 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

AnomalyDetection– ProblemAvoidance/PredictionSOLUTION§ Detectanomalies&predictissuesreal-time,alertbasedonpredefinedrules

§ Leveragehistoricaldataandmachinelearningfordynamicthresholds

§ SimplifiedU/X– browseraccess&designedforcollaboration

BOTTOMLINE§ HighAvailability

§ Problemavoidance§ ReducedMTTR

§ ReduceSMEdependenceforissuedetection

Page 41: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

41 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

AnomalyDetection– DeepDive

§ UtilizeHistoricaldata§ DefinebandsofLikelyandunlikelyvalues

§ Maprealtimemetricstreamsagainstsystemdefinednormal

§ Multi-pointalertsgeneratedusingindustry-standardWestern-Electricrules

§ Makestaticthresholdsoptional!

Letdatadotheworkforyou

Unlikely

MostLikely

Metric

Time

TypicalVolatility

Anomaly

Tasksready

tobedispatched

LessLikely

Page 42: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

42 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

USE CASE:As someone owning IT operations and responsible for technology progress, my MF systems should exploitplatforms like Linux (X86 & Z) to offload data processing and non essential management capabilities. Lack of thiscapability limits the ability to extend the strengths of the mainframe with next generation technology that issupported on Linux.

• BusinessOwner• TechnologyOwner

PERSONA:

PROBLEM§ “Helpmedeployyouranalyticssolutioninhoursnotdays”§ “Nosignificantincreaseonmyteamsworkload,wearenotlinux experts”§ “WeplantoexpandourzecosystemtoincludeLinuxandrequiretoolstoleverageourstrategy”§ “Ensuringtechnologyprogresswithoutlosingthereliability/securityofMFishighvaluegoal”§ ”Ensureanalyticssolutiondonotincreasemyoperationscostssignificantly”

SimplifiedDeployment– MinimizeCostandRisk

Page 43: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

43 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

SimplifiedDeployment– MinimizeCostandRisk

Web-basedUI

RestAPI

z/OS

PerformanceManagement

DatabaseManagement

RestAPIs

StorageManagement

SoftwareVirtual

Appliance

BENEFITS§ LowCostcomputing§ Non-Invasive§ RetainsSecurity§ SetupinMinutes

ANALYTICSSTREAM

EXISTINGPRODUCTS

Browser

SOLUTION§ Virtualappliance§ ContainerizedPlug-n-play§ SimpleConfig GUI

MetricBaseline

AnomalyDetection

Correlations

Aggregation

HistoricalData

Page 44: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

44 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

BusinessServicePerspectives&TopologyViewsSOLUTION§ Monitorservicelevelmetrics

§ Analyzemetricswithabilitytodrilldownacrossentiretopology

§ Trackandprioritizeeventsaffectingservices,consolidatealerts

§ Correlatemetricsviamachinelearning

§ QuickrootcauseanalysisandreducedMTTR

BOTTOMLINE§ ReducedMTTR

§ ReduceSMEdependenceforissuetriage/investigation

§ Improvedenduserexperience

Page 45: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

45 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

ExpertSystems– IntelligentMainframe

SME

•SOLUTION§ AssistedtriagethathelpsfasterRCA,reduced

MTTRandfacilitatesbetterdecisions§ Utilizecorrelationdatasciencetofindclusters

ofalertsandrelationships

§ Leveragemachinelearning&yourdatatothesystemtriageandisolatetheproblem

§ Systemlearnsfromexperts,helpsonboardjuniorstafffaster

BENEFITS§ ReducedMTTR

§ Higherproductivityofjuniorstaff§ TransferofTribalknowledgetoanexpertsystem

§ Lowercostsofoperations,noincreaseinrisks

1

2

3

41 3

2

4

Page 46: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

46 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

LEVERAGEDATAITSYOURASSET

MOVEFROMREACTIVETOPROACTIVE

DETECTANOMALIESAVOIDPROBLEMS

WrapUpandKeyTakeawayMainframeOperationalIntelligence&DB2Tools

Expertuserswithdecadesofexperience

Highlycustomizable,flexibletoolkits

Basicsoftwareintelligence

InexperiencedusersnewtoMainframe

Toolsthatguideuserstodecisions

Predictivesoftware

intelligence

WeInviteyoutoparticipateinDesign@CAandTechPreview!

Page 47: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

@CAWORLD#CAWORLD ©2016CA.AllRIGHTSRESERVED.47 @CAWORLD#CAWORLD

MainframeandWorkloadAutomation

FormoreinformationonMainframeandWorkloadAutomation,pleasevisit:http://cainc.to/9GQ2JI

Page 48: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

48 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

RecommendedSessions

SESSION# TITLE DATE/TIME

MFX79E ProtectingandTappingIntoyourDataGoldmine:leveragingwhatresidesinyourmainframe 11/15/2016at9:00am

MFX80EIntelligentMainframeManagement- DataDrivenDatabase PerformanceManagement 11/15/2016at10:00am

MFX81EHowtoGettheMostoutofYourDB2,DB2Management,andAnalyticsInvestment 11/15/2016at11:00am

MFX88S StrategyandVisionforCADB2DatabaseManagement 11/17/2016at12:45pm

MFX90S DrivingDownCostsforDB2Management 11/17/2016at1:45pm

MFX91S BirdsofaFeather/StumptheTechieforCADB2Tools! 11/17/2016at3:00pm

Page 49: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

49 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

MustSeeDemos

DemoNameServicesYTheater#location

DemoNameSolutionYTheater#location

DemoNameProductXTheater#location

DemoNameProductXTheater#location

Page 50: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

50 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

Questions?

Page 51: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

51 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

Thankyou.

Stayconnectedatcommunities.ca.com

Page 52: Exploiting Operational Intelligence within Database ... · Exploiting Operational Intelligence Within Database Management Tools ... (POM) profiles can be ... – Improve access to

52 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

©2016CA.Allrightsreserved.Alltrademarksreferencedhereinbelongtotheirrespectivecompanies.

Thecontentprovidedinthis CAWorld2016presentationisintendedforinformationalpurposesonlyanddoesnotformanytypeofwarranty. The informationprovidedbyaCApartnerand/orCAcustomerhasnotbeenreviewedforaccuracybyCA.

ForInformationalPurposesOnlyTermsofthisPresentation