Db2 Recovery Expert for z/OS · 2020-04-03 · Version 3 Release 2 IBM Db2 Recovery Expert for z/OS User's Guide IBM SC19-2548-04

Version 3 Release 2

IBM Db2 Recovery Expert for z/OSUser's Guide

IBM

SC19-2548-04

Note:

Before using this information and the product it supports, read the "Notices" topic at the end of thisinformation.

Subsequent editions of this PDF will not be delivered in IBM Publications Center. Always download thelatest edition from the Db2 Tools Product Documentation page.

March, 2020 edition

This edition applies to Version 3 Release 2 of IBM Db2 Recovery Expert for z/OS (product number 5697-H74) and to allsubsequent releases and modifications until otherwise indicated in new editions.© Copyright International Business Machines Corporation 1996, 2020.US Government Users Restricted Rights – Use, duplication or disclosure restricted by GSA ADP Schedule Contract withIBM Corp.

http://www-304.ibm.com/support/docview.wss?uid=swg27020910

Contents

About this information........................................................................................ xiii

Chapter 1. Db2 Recovery Expert overview.............................................................. 1What's new in Db2 Recovery Expert............................................................................................................1What does Db2 Recovery Expert do?.......................................................................................................... 6Backup and recovery solutions....................................................................................................................7Db2 Recovery Expert features and benefits................................................................................................7Important components of Db2 Recovery Expert...................................................................................... 10Db2 Recovery Expert product definitions................................................................................................. 11Determining which interface to use.......................................................................................................... 13Db2 Recovery Expert scenarios.................................................................................................................14Db2 Recovery Expert validation................................................................................................................ 15User ID authorities required for installation............................................................................................. 16Hardware and software requirements...................................................................................................... 17

Db2 Recovery Expert server, agent, and ISPF interface requirements..............................................17Web interface requirements................................................................................................................ 19Product constraints ............................................................................................................................. 19

Service updates and support information.................................................................................................20Product documentation and updates........................................................................................................20Accessibility features.................................................................................................................................21

Chapter 2. Planning for a system-level backup..................................................... 23System backup usage considerations.......................................................................................................23Backup frequency and space utilization................................................................................................... 24Analyzing data set isolation.......................................................................................................................25Planning for the creation of a Db2 subsystem backup............................................................................. 27Performing a Db2system, application, or object recovery....................................................................... 29Planning a tape-based Db2 disaster restart methodology.......................................................................30Db2 Recovery Expert and storage system integration............................................................................. 31Copy blade selection considerations........................................................................................................ 32

IBM FlashCopy blade........................................................................................................................... 33EMC TimeFinder copy blade................................................................................................................ 33HDS ShadowImage copy blade............................................................................................................35IBM DFSMSdss copy blade.................................................................................................................. 36

Db2 32 KB table space requirements....................................................................................................... 36

Chapter 3. Preparing to customize Db2 Recovery Expert ...................................... 37Set up your environment prior to customization...................................................................................... 39

Adding ARY$TSOC to SYS1.PARMLIB................................................................................................. 40Create RBA Capture utility PDS library................................................................................................ 40Undiscovered Db2 parameters............................................................................................................ 41Specifying Db2 load libraries in the correct order...............................................................................41Installing the web interface................................................................................................................. 42Clearing web browser cache after upgrading or applying maintenance............................................ 42Configuring the PARMLIB member...................................................................................................... 42Configuring access profiles for Db2 Recovery Expert......................................................................... 58Setting up the Db2 Recovery Expert server to use VIPA.....................................................................59Setting up a Db2 subsystem with multiple data sharing members....................................................59

Worksheets: Gathering required data set names..................................................................................... 59APF authorizing load libraries....................................................................................................................62

iii

Worksheets: Gathering parameter values for Db2 Recovery Expert....................................................... 62

Chapter 4. Customizing Db2 Recovery Expert..................................................... 109Roadmap: Customizing Db2 Recovery Expert for the first time.............................................................109Roadmap: Customizing a new version of Db2 Recovery Expert from a previous customization..........110Roadmap: Recustomizing Db2 Recovery Expert.................................................................................... 111Specifying the metadata library for the product to customize...............................................................112Discovering Db2 Recovery Expert information automatically................................................................113Creating and associating Db2 entries..................................................................................................... 115Defining parameters................................................................................................................................ 117

Defining Db2 Recovery Expert parameters....................................................................................... 117Db2 migration.....................................................................................................................................119Defining LPAR parameters................................................................................................................. 120Defining Db2 parameters...................................................................................................................122

Generating customization jobs................................................................................................................124Submitting customization jobs................................................................................................................125Browsing parameters.............................................................................................................................. 127Copying Db2 entries................................................................................................................................ 127Removing Db2 entries............................................................................................................................. 128Deleting Db2 entries................................................................................................................................129Displaying customization jobs.................................................................................................................129Maintaining customization jobs...............................................................................................................130Using Tools Customizer in a multiple-LPAR environment......................................................................130

Chapter 5. Administering client, server, and agent communications....................133Server, client, and agent communications............................................................................................. 133Maintaining the Db2 Recovery Expert server..........................................................................................133

Server environment............................................................................................................................134Server security................................................................................................................................... 134Server output......................................................................................................................................135Stopping the server............................................................................................................................ 135Administrative commands (server)................................................................................................... 135

Maintaining the Db2 Recovery Expert agent...........................................................................................137Agent environment.............................................................................................................................137Agent security.................................................................................................................................... 137Agent output.......................................................................................................................................138Stopping the agent............................................................................................................................. 139Administrative commands (agent).................................................................................................... 139

RACF keyring and token support.............................................................................................................139Authenticating the current ISPF user..................................................................................................... 140

Using RACF passtickets to authenticate ISPF users.........................................................................140Using passwords to authenticate ISPF users....................................................................................141

Chapter 6. The Subsystem Setup facility............................................................ 143About configuring a subsystem for the system backup and restore utilities........................................ 143Configuration summary for the Subsystem Setup facility......................................................................144Subsystem analysis and the Subsystem Setup Information screen......................................................144

Reviewing subsystem setup information.......................................................................................... 145Separating the MVS user catalogs...........................................................................................................146

Existing MVS user catalogs................................................................................................................ 146New MVS user catalogs......................................................................................................................147Creating a new user catalog...............................................................................................................147Viewing the aliases for a user catalog............................................................................................... 150Adding a new catalog alias................................................................................................................ 150Displaying the data sets currently cataloged by the MVS catalog....................................................151Updating the new MVS user catalog..................................................................................................153

Reviewing the storage copy pools for Db2 system backups..................................................................153

iv

Viewing a volume list for a copy pool................................................................................................ 154Viewing the data sets allocated on a volume....................................................................................155

Renaming and moving the boot strap data sets..................................................................................... 157Moving boot strap data sets...............................................................................................................157Renaming boot strap data sets..........................................................................................................158

Renaming or moving active log data sets............................................................................................... 159Moving active logs.............................................................................................................................. 159Renaming active log data sets........................................................................................................... 160

Managing aliases in the MVS user catalogs............................................................................................ 161Viewing the data sets for an alias...................................................................................................... 161Renaming aliases............................................................................................................................... 162Merging catalog entries......................................................................................................................163

Optimizing volumes used by the Db2 subsystem...................................................................................164Viewing the data sets allocated on a volume....................................................................................165Moving data sets on a volume........................................................................................................... 166

Chapter 7. Using the Db2 Recovery Expert for z/OS ISPF interface...................... 169ISPF interface overview...........................................................................................................................169Logging in to a database using the ISPF interface..................................................................................169Restriction for products running POSIX clients with TCP/IP connections.............................................170Header fields............................................................................................................................................171Getting help............................................................................................................................................. 172Column display functionality...................................................................................................................173

Accessing the CSETUP primary option menu....................................................................................173Fixing a column.................................................................................................................................. 175Repositioning columns.......................................................................................................................178Resizing columns............................................................................................................................... 180Sorting................................................................................................................................................ 182Fastpath SORT command.................................................................................................................. 184Resetting CSET customizations......................................................................................................... 186Removing CSET customizations........................................................................................................ 187Column scrolling.................................................................................................................................188Column numbering.............................................................................................................................189Ruler display.......................................................................................................................................190Expanding columns............................................................................................................................191CSET restrictions................................................................................................................................192

Chapter 8. Configuring Db2 Recovery Expert session settings and defaults .........195Specifying System Backup Profile defaults............................................................................................ 195Registering Db2 subsystems...................................................................................................................196Reducing recovery time by using multiple LPARs.................................................................................. 198Specifying Server information................................................................................................................. 198Specifying IMS CLIST Information..........................................................................................................198Resetting ISPF client password.............................................................................................................. 199Defining Combined system level backup groups....................................................................................199Removing Records from the Db2 Recovery Expert Schema Level Repository (SLR)............................ 200

Chapter 9. Creating system backup profiles........................................................201Profile setup.............................................................................................................................................201Accessing the backup profile list............................................................................................................ 203Creating IBM FlashCopy and EMC TimeFinder/Clone backup profiles..................................................206

Discovering source volumes using SMS storage groups...................................................................210Bypassing vary processing during system backup and restore........................................................211Using auto mapping for target volumes............................................................................................ 212Using manual mapping for target volumes....................................................................................... 213

Creating an EMC BCV backup profile...................................................................................................... 217Specifying source volumes for an EMC BCV backup profile............................................................. 221

v

Specifying target volumes for an EMC BCV backup profile...............................................................222Creating a backup profile using the Db2 backup method...................................................................... 225

Specifying alternate copy pool options............................................................................................. 229Creating a DFSMSdss backup profile...................................................................................................... 230

Discovering source volumes using SMS storage groups...................................................................234Using auto mapping for target volumes............................................................................................ 235Using manual mapping for target volumes....................................................................................... 236

About offload options.............................................................................................................................. 240Setting offload options for IBM FlashCopy, EMC SNAP, EMC BCV, and DFSMSdss backups.......... 241Setting offload options for Db2 backups...........................................................................................244Setting data set options..................................................................................................................... 247About data encryption....................................................................................................................... 251

Specifying PARMLIB override options.....................................................................................................253Message Area messages......................................................................................................................... 256Profile management................................................................................................................................ 258

Updating a profile...............................................................................................................................259Viewing a profile.................................................................................................................................260Renaming a profile............................................................................................................................. 260Deleting a profile................................................................................................................................ 261

Chapter 10. Creating a system backup............................................................... 263Building and submitting backup jobs......................................................................................................263Sample build JCL for the profile setup process......................................................................................265Sample build JCL for a backup................................................................................................................266About incremental system backups....................................................................................................... 269Improving performance with faster alias processing.............................................................................269Starting and stopping incremental system backups.............................................................................. 271Adding keywords to a system backup job.............................................................................................. 271Adding keywords to the system backup offload job step...................................................................... 273Reviewing output from an IBM FlashCopy backup.................................................................................273

Reviewing output from an IBM FlashCopy backup with auto mapping to target stogroups........... 273Reviewing output from an IBM FlashCopy backup with auto mapping to target units....................276

Reviewing output from an EMC BCV backup.......................................................................................... 278Reviewing output from an EMC SNAP backup........................................................................................280

Reviewing output from an EMC SNAP backup with manual mapping.............................................. 280Reviewing output from an EMC SNAP backup with auto mapping...................................................283

Reviewing output from a Db2 backup.....................................................................................................286Reviewing output from a DFSMSdss backup.......................................................................................... 289

Reviewing output from a DFSMSdss backup with auto mapping..................................................... 289Reviewing output from a DFSMSdss backup with manual mapping................................................ 291

Reviewing the Restricted Objects report................................................................................................ 292Reviewing output from offloading a backup........................................................................................... 293

Chapter 11. Recovering database objects........................................................... 297Application Recovery: Using application profiles................................................................................... 297Backing up objects using system backups............................................................................................. 297Displaying profiles and specifications.....................................................................................................298Creating application profiles and recovery jobs..................................................................................... 302

Creating application profiles..............................................................................................................302Selecting object types for profiles and specifications...................................................................... 303Filtering the subsystem objects.........................................................................................................304Selecting the object........................................................................................................................... 305Viewing an application profile............................................................................................................306Updating an application profile..........................................................................................................308Performing quiet time analysis for an object.................................................................................... 310

Creating ad-hoc recovery specifications.................................................................................................311Ad-hoc Operations: Transaction specifications................................................................................ 311

vi

Selecting the transactions for recovery.............................................................................................314Sample transaction recovery job JCL and results.............................................................................315Saving a transaction specification..................................................................................................... 317Ad-hoc Operations: Log based specifications...................................................................................317

Generating recovery DDL for an object................................................................................................... 323Generating object recovery plans .......................................................................................................... 325

Specifying recovery options...............................................................................................................326Performing redirected recovery.........................................................................................................333Specifying statistics options.............................................................................................................. 340Specifying Log Read and Log Apply recovery options.......................................................................340Selecting a recovery point..................................................................................................................342Selecting an object definition level for a recovery point...................................................................343Selecting a history event for a recovery point................................................................................... 344Selecting a quiet time recovery point................................................................................................347Recovery plan generation.................................................................................................................. 347Selecting a recovery plan...................................................................................................................350Recovery plan validation....................................................................................................................351Submitting the recovery plan job.......................................................................................................352

Building application profiles in batch .....................................................................................................354Specifying recovery options for application profile batch job.......................................................... 356Sample build application profile batch job........................................................................................360

Building log based specifications in batch .............................................................................................360Sample build log based specification batch job................................................................................362

Building recovery plan batch jobs by editing JCL samples.................................................................... 363Sample Build Recovery Plan in Batch job .........................................................................................365

Building recovery plan batch jobs in ISPF.............................................................................................. 366Build Jobs Options panel................................................................................................................... 367

Chapter 12. Recovering Db2 and IMS applications.............................................. 369Connecting Db2 Recovery Expert and IMS Recovery Expert................................................................. 369Setting up and managing the coordinated recovery process.................................................................370Creating coordinated recovery profiles...................................................................................................373Associating a Db2 and an IMS profile to the coordinated recovery profile........................................... 374Updating the coordinated recovery profile............................................................................................. 375Viewing a coordinated recovery profile.................................................................................................. 376Renaming an coordinated recovery profile.............................................................................................377Deleting a coordinated recovery profile..................................................................................................377Performing quiet time analysis for a coordinated recovery................................................................... 378

Building the quiet time analysis job...................................................................................................379Building the coordinated recovery job.................................................................................................... 380

Selecting the recovery point.............................................................................................................. 380Generating the Db2 object recovery plans........................................................................................381Selecting the Db2 object recovery plan.............................................................................................382Submitting the recovery plan job.......................................................................................................383Building the coordinated recovery job for IMS objects.....................................................................384

Chapter 13. Recovering objects using application groups.................................... 387Displaying application groups................................................................................................................. 387Creating application groups.................................................................................................................... 389Updating application groups................................................................................................................... 390Viewing application groups..................................................................................................................... 392Deleting an application group................................................................................................................. 393Renaming application groups..................................................................................................................393Generating application group recovery plans ........................................................................................ 394Selecting a recovery plan for the application group............................................................................... 395Submitting the recovery plan job............................................................................................................ 397

vii

Chapter 14. Performing a Combined System Level Backup..................................399Planning for a Combined SLB.................................................................................................................. 399

Configuring Combined SLB................................................................................................................ 400Creating shared repositories............................................................................................................. 401

Creating Combined SLB groups...............................................................................................................402Creating system backup profiles for Combined SLB groups.................................................................. 404Using System Restore and Offload with Combined SLB.........................................................................407Using application profiles with Combined SLB....................................................................................... 409Creating disaster recovery profiles for Combined SLB groups...............................................................409Performing Db2 system analysis and configuration............................................................................... 411Using coordinated application profiles with Combined SLB.................................................................. 411

Chapter 15. Restoring a subsystem.................................................................... 413Before you restore the subsystem..........................................................................................................413Viewing a list of backups......................................................................................................................... 414

Viewing the summary report from the backup..................................................................................417Offloading a backup........................................................................................................................... 417Deleting backups................................................................................................................................418Viewing an object list from a backup.................................................................................................418Using the health check function........................................................................................................ 421

Restoring a subsystem: Data only...........................................................................................................426Building restore jobs (data only)........................................................................................................427Sample restore jobs........................................................................................................................... 432

Restoring a subsystem: Data and logs....................................................................................................437Building the restore job - data and logs............................................................................................ 437

Adding keywords to a system restore job...............................................................................................439Selecting a recovery RBA based on a timestamp................................................................................... 441

Selecting a recovery RBA using the RBA Capture utility...................................................................442Using the timestamp to LRSN conversion window........................................................................... 444

Restarting a failed restore job ................................................................................................................ 445Reviewing restore reports....................................................................................................................... 446

Conditional restart job report (data only restores)........................................................................... 446Restore job report.............................................................................................................................. 447Log restore report (data only restores)............................................................................................. 449RECOVER and REBUILD job output................................................................................................... 449

Chapter 16. Creating image copies from system level backups............................453Selecting or creating the application profile...........................................................................................453Setting image copy options..................................................................................................................... 455Specifying data set naming conventions................................................................................................ 457

Using the substring function..............................................................................................................459Resulting DSN using current symbolic string.................................................................................... 460Viewing a sample string..................................................................................................................... 460

Creating an image copy from the last created system-level backup.....................................................461Restarting an image copy from a system level backup job.................................................................... 462Adding keywords to the image copy job................................................................................................. 462

Chapter 17. Creating image copies offline...........................................................465Using Change Accumulation to improve data availability...................................................................... 465

Prerequisites for using Change Accumulation.................................................................................. 465Sample JCL for Change Accumulation.............................................................................................. 465

Chapter 18. Recovering a Db2 database subsystem using the Db2 RecoveryExpert disaster recovery feature.................................................................... 467Planning a disaster recovery strategy.....................................................................................................467

viii

Recovery steps at the local site overview...............................................................................................468Setting up for your chosen recovery strategy......................................................................................... 469

Offloading the system level backup to tape......................................................................................469Setting up for Db2 image copy recoveries.........................................................................................472

Creating disaster recovery profiles......................................................................................................... 473Specifying the restore multijob options............................................................................................ 478

Renaming the disaster recovery profile.................................................................................................. 479Creating a secondary disaster recovery profile...................................................................................... 479Creating application recovery jobs..........................................................................................................480Building disaster recovery jobs............................................................................................................... 480

Sample JCL generated from a system level backup primary profile................................................ 482Sample JCL generated from an image copy primary profile.............................................................483

Building the secondary profile................................................................................................................ 484Recovering at the remote site from system level backups.................................................................... 484

Contents of the system level backup disaster recovery PDS........................................................... 492Recovering at the remote site using Db2 image copies......................................................................... 494

Contents of a Db2 image copy disaster recovery PDS...................................................................... 501Recovering both Db2 and IMS subsystems............................................................................................ 504

Setting up the IMS and Db2 disaster recovery profiles.................................................................... 504Creating the recovery job at the local site.........................................................................................504Running the job at the disaster recovery site ...................................................................................505Running timestamp determination process in simulate mode........................................................ 506

Chapter 19. The RBA Capture utility................................................................... 507Viewing the utility output........................................................................................................................ 507Modify commands................................................................................................................................... 509Managing the repository..........................................................................................................................509

Chapter 20. Using the Db2 Recovery Expert web interface.................................. 511Opening the web interface, setting preferences, and starting advisors................................................ 511Managing message information.............................................................................................................. 512Specifying General preferences............................................................................................................. 513Specifying the Warnings preferences .................................................................................................... 513Specifying the Limits preferences .......................................................................................................... 514Specifying the Job Card preferences ..................................................................................................... 514Specifying the Quiet Time Tables preferences ...................................................................................... 514Specifying the Logging preferences ....................................................................................................... 515

Chapter 21. Performing common advisor tasks................................................... 517Logging in to a database..........................................................................................................................517Saving advisor settings for future use.....................................................................................................517

Saving a specification.........................................................................................................................517Using the Specification Advisor......................................................................................................... 518Copying a specification...................................................................................................................... 519Renaming a specification...................................................................................................................519

Viewing the properties of a selected object........................................................................................... 520Point in time conversion job.................................................................................................................... 521Exporting job JCL or results.....................................................................................................................521No recovery plans generated.................................................................................................................. 521

Chapter 22. Recovering a Db2 object ................................................................. 525Using the Recovery Advisor.....................................................................................................................525Opening the Recovery Advisor................................................................................................................ 526Selecting a Db2 system location ............................................................................................................ 526Selecting objects for recovery.................................................................................................................528Specifying recovery plan options............................................................................................................ 529

Specifying recovery plan options for the RECOVER utility................................................................531

ix

Specifying the recovery plan options for the COPY utility................................................................ 531Specifying recovery plan generation options for running parallel jobs ........................................... 532Specifying recovery plan generation DDL options............................................................................ 533Specifying Log Read and Log Apply recovery options.......................................................................534Specifying statistics options.............................................................................................................. 535Specifying Redirected Recovery options...........................................................................................536

Specifying a point in time........................................................................................................................ 537Selecting an object level, history event, or quiet time recovery point............................................. 538

Recovery plans.........................................................................................................................................540Generating recovery plans for XML and LOB columns........................................................................... 541Viewing recovery method information....................................................................................................542Calculating recovery plan cost................................................................................................................ 543

Viewing and editing relative cost parameters...................................................................................543Generating and running recovery plans.................................................................................................. 544Viewing the recovery job JCL.................................................................................................................. 545RECOVER Utility Warning window........................................................................................................ 545Reviewing the recovery process results................................................................................................. 546Recovering Db2 objects specified by pattern......................................................................................... 546Recovering Db2 objects specified by Db2 Automation Tool profile.......................................................547Restarting a failed job..............................................................................................................................548

Chapter 23. Recovering dropped objects using Db2 log....................................... 549Using the Log Based Recovery Advisor...................................................................................................549Opening the Log Based Recovery Advisor.............................................................................................. 549Selecting the Db2 subsystem..................................................................................................................550Selecting a time range to search for dropped objects............................................................................551

Selecting or deleting a previously scanned log range.......................................................................552Selecting dropped objects for recovery.................................................................................................. 552Specifying recovery plan options............................................................................................................ 554

Specifying recovery plan options for the RECOVER utility................................................................556Specifying the recovery plan options for the COPY utility................................................................ 556Specifying recovery plan generation options for running parallel jobs ........................................... 557Specifying recovery plan generation DDL options............................................................................ 557Specifying Log Read and Log Apply recovery options.......................................................................559Specifying statistics options.............................................................................................................. 560Specifying Redirected Recovery options...........................................................................................560

Selecting a recovery point....................................................................................................................... 562Selecting a definition level or history event recovery point ............................................................. 563

Generating dropped object recovery plans............................................................................................ 564Reviewing the dropped object recovery plan JCL.................................................................................. 565Selecting the dropped object recovery job for review............................................................................565Reviewing a dropped object recovery job results...................................................................................565

Chapter 24. Using the Transaction Recovery Advisor.......................................... 567Opening the Transaction Recovery Advisor............................................................................................567Selecting the Db2 subsystem location....................................................................................................567Selecting the transaction recovery range............................................................................................... 569Selecting one or more transactions for recovery....................................................................................570Reviewing the Undo SQL .........................................................................................................................570Submitting the transaction recovery job.................................................................................................570Reviewing the transaction recovery job results......................................................................................571

Chapter 25. Searching the Db2 log to find object inactivity..................................573Using the Log Analysis Advisor................................................................................................................573Opening the Log Analysis Advisor........................................................................................................... 573Selecting the Db2 subsystem location....................................................................................................574Selecting the log analysis range..............................................................................................................575

x

Selecting objects for analysis..................................................................................................................576Submitting JCL for a log analysis............................................................................................................ 577Reviewing log analysis job results.......................................................................................................... 578Reviewing a log analysis job results........................................................................................................578

Chapter 26. Restoring a Db2 subsystem .............................................................579Preparing to restore a Db2 subsystem ...................................................................................................579Using the System Restore Advisor.......................................................................................................... 579Opening the System Restore Advisor..................................................................................................... 580Selecting the Db2 subsystem..................................................................................................................581Selecting a recovery point....................................................................................................................... 582Selecting the type of restore to perform.................................................................................................583

Selecting a RBA or LRSN recovery point ...........................................................................................584Selecting a RBA recovery point..........................................................................................................584Converting a timestamp to a LRSN recovery point........................................................................... 586

Submitting JCL for a data only system restore ...................................................................................... 586Submitting JCL for a data and logs system restore................................................................................ 587Selecting the system restore job for review........................................................................................... 587Reviewing system restore job results..................................................................................................... 588Restarting a failed restore job................................................................................................................. 588

System restore JCL (review results) window.................................................................................... 589Restart System Restore window....................................................................................................... 589

Chapter 27. Tools Customizer reference............................................................. 591Tools Customizer terminology and data sets......................................................................................... 591

Tools Customizer terminology...........................................................................................................591Data sets that Tools Customizer uses during customization............................................................593

Appendix A. Db2 Recovery Expert Product Control File (PCF).............................. 597

Appendix B. Recovery utilities............................................................................607Removing entries from the schema level repository (SLR).................................................................... 607Removing entries from the schema level repository (SLR) after a system clone.................................. 607Limiting logs scanned during Log Based Data Recovery........................................................................ 608DSN1COPY SYSXLAT generate utility..................................................................................................... 608Using the Db2 Recovery Expert Cloning Tool interface module............................................................ 609Removing entries from the Quiet Time Analysis tables .........................................................................609Reorganizing system backup VSAM repository files...............................................................................611Reporting available SLB backups at the disaster recovery site............................................................. 613Reporting the incremental status of a list of SLB profiles...................................................................... 614

Appendix C. Automatic discovery for server agent communication...................... 617

Appendix D. Db2 Recovery Expert files and file sizes.......................................... 619B37 ABEND errors................................................................................................................................... 619Correcting B37 ABEND errors in the JCL................................................................................................ 621Correcting B37 errors using a sample job...............................................................................................622Files used in Log Analysis processing..................................................................................................... 623

Appendix E. Troubleshooting............................................................................. 625How to look up message explanations................................................................................................... 625Determining maintenance levels of Db2 Recovery Expert.....................................................................626Installing Db2 Recovery Expert V3.2 on a new Db2 subsystem............................................................ 626

Reinstalling Db2 Recovery Expert V3.2.............................................................................................626Installing Db2 Recovery Expert V3.2 for the first time..................................................................... 627Verifying Db2 Recovery Expert V3.2 installation...............................................................................628

xi

RACF Permission requirements.........................................................................................................629

Appendix F. Messages and Codes....................................................................... 631Tools Customizer messages....................................................................................................................631Db2 Recovery Expert for z/OS messages and codes..............................................................................702

Notices............................................................................................................1003Notices...................................................................................................................................................1005

Index.............................................................................................................. 1009

xii

About this information

Db2 Recovery Expert for z/OS® is a feature-rich product that assists you with system-level as well asobject level backups, and system-level, application, and object-level recoveries.

The topics in this user's guide are designed to help database administrators, system programmers,application programmers, and system operators perform the following tasks:

• Plan for the installation of Db2 Recovery Expert.• Install Db2 Recovery Expert.• Configure your Db2 Recovery Expert environment.• Operate Db2 Recovery Expert.• Diagnose and recover from Db2 Recovery Expert problems.

Always check the Knowledge Center for the most current version of this information:

https://www.ibm.com/support/knowledgecenter/SSAUTW_3.2.0/topics/kc_welcome.html

© Copyright IBM Corp. 1996, 2020 xiii

https://www.ibm.com/support/knowledgecenter/SSAUTW_3.2.0/topics/kc_welcome.html

xiv Db2 Recovery Expert for z/OS

Chapter 1. Db2 Recovery Expert overviewIBM® Db2 Recovery Expert for z/OS (also referred to as Db2 Recovery Expert) is a storage-aware backupand recovery solution that integrates storage processor fast-replication facilities with Db2® backup andrecovery operations to allow instantaneous backups, reduce recovery time, and simplify disaster recoveryprocedures while using less CPU, I/O, and storage resources.

What's new in Db2 Recovery Expert

April, 2020

The following updates were made to Db2 Recovery Expert for z/OS:

A new Disaster Recovery option, MODE(QUIESCE), has been added to the Update Disaster RecoveryProfile panel. As a DBA, you may want the option to create a Quiesce point before active logs arearchived, to capture a point of consistency in the current active log before an archive is taken.

Related topic: Creating disaster recovery profiles

Related APAR: PH20428

Improved data availability by creating image copies offline with features previously available in Db2Change Accumulation Tool, now incorporated into Db2 Recovery Expert. This saves recovery time,because you have more recent image copies derived from Change Accumulation. You can use offlineresources to create image copies, so that the actual database, tablespace, or other database objects areunaffected and can be used online or in batch at the time of the image copy.

You can use the Change Accumulation features in Db2 Recovery Expert to create image copies of a givendatabase, tablespace, or set of tablespaces. Db2 Recovery Expert reads the most recent image copy andadds any incremental image copies and Db2 log data.

Related topic: Using Change Accumulation


Db2 Recovery Expert now allows you to create a new output DD for Hierarchical Storage Management(HSM) messages. You can see all the HSM messages together, so that I can diagnose system level backupissues more quickly.

Having a separate HSMOUT, collecting them all in one place, instead of having to look for them among allthe other messages that go into the ARYOUT DD, makes it easier to identify and solve backup problems.

Related topic: “Reviewing output from a Db2 backup” on page 286.


March, 2020


A new parameter, ALIAS_PROCESS_METHOD, lets you use a faster alias processing algorithm, if onlysingle-level aliases are used on the subsystem.


The REINIT_SPACE_EFFICIENT parmlib parameter now causes the reinitialization of space efficientvolumes after offload only; before this update, reinitialization would occur after backup.


© Copyright IBM Corp. 1996, 2020 1

The Include RI related objects option, in object recovery plans, has a new value: Relationsonly. When you choose this option, Db2 Recovery Expert will create the relations but not include therelated objects themselves in the recovery.


New and changed messages:

• “ARYJ083I” on page 828• “ARYJ084I” on page 829• “ARYJ085I” on page 829• “ARYJ086I” on page 829• “ARYJ087I” on page 829• “ARYJ088I” on page 829• “ARYJ089I” on page 829• “ARYJ090I” on page 829• “ARYJ091I” on page 829• “ARYJ092I” on page 829• “ARYJ093I” on page 829• “ARYJ094I” on page 830• “ARYJ095I” on page 830• “ARYJ096I” on page 830• “ARYJ135W” on page 832• “ARYS884I” on page 954• “ARYS885I” on page 954• “ARYS886W” on page 954• “ARYS887E” on page 954• “ARYS888I” on page 954


January, 2020


• New DETAILS keyword for recovery plan JCL. When DETAILS is used, a recovery plan job will providedetails on database objects that are recoverable, unrecoverable, and not eligible for recovery.


New and changed messages:

• “ARYB205E” on page 813• “ARYB213E” on page 814• “ARYB215E” on page 814• “ARYB216E” on page 814• “ARYB235E” on page 814• “ARYB243I” on page 814• “ARYB244I” on page 814• “ARYB245I” on page 814• “ARYB254I” on page 815• “ARYB255I” on page 815

2 Db2 Recovery Expert for z/OS

• “ARYB282I” on page 815• “ARYB283I” on page 815• “ARYB284W” on page 815• “ARYB285E” on page 816• “ARYB286I” on page 816• “ARYB287I” on page 816• “ARYB288W” on page 816• “ARYB289I” on page 816


November, 2019

Update:

• New standalone utility to showing the incremental status of system level backup profiles. See Reportingthe incremental status of a list of SLB profiles for more information.

• New OFFLOAD-TO-VOLSERS control card. See Adding keywords to the system backup offload job stepfor more information.

• New processing option, TOCOPY for SHRLEVEL CHANGE copies. See Selecting a history event for arecovery point for more information.

• New message ARYS854E• New message ARYS878W• New message ARYS881W


September, 2019

Update:

• Recovery Plan and JCL Generation in batch now available via ISPF• LBDR Recovery now available in batch• SQL grantees for GRANT statements may be specified in Tools Customizer• Improved informational messages about recoverable and unrecoverable objects, replacing the

ARYZ018E message• Server can register in a system to allow other products to discover it and obtain the connection

information• Infrastructure changes in agent and server components


August, 2019

Update: Several fixes related to system operations, and some new error and information messages.


June, 2019

Update: Enhancements have been added to system level backup (SLB) and offload.

Description: If PARMLIB option WAIT_FOR_BACKGROUND_COPY is set to Y, FASTREPLICATIONSTATE isalso checked, and error messages are produced if RECOVERABLE status is not achieved. Additionalmonitoring of the offload process may be enabled with a new PARMLIB option WAIT_FOR_OFFLOAD: if it

Chapter 1. Db2 Recovery Expert overview 3

https://www-01.ibm.com/support/docview.wss?uid=swg1PH16834https://www-01.ibm.com/support/docview.wss?uid=swg1PH17194http://www-01.ibm.com/support/docview.wss?uid=swg1PH14687

is set to Y, DUMPSTATE of the copypool is repeatedly checked, and the offload step finishes successfullyonly if ALLCOMPLETE is achieved.

Related APAR: PH13181.

Update: The ISPF client is more task-oriented and more consistent with the Web client.

Description: All LBDR and transaction recovery operations are available from the new "Ad-hocOperations" added to the main menu. It is no longer necessary to create a profile to perform LBDR orTransaction recovery.


Update: The internal format of application profiles is changed, and migration of existing profiles isrequired.

Description: After applying the PTF, users need to enable Migration option in TCz and run the generatedJCL for each subsystem in which the environment for Recovery Expert exists, in order to migrate theprofiles, using template ARYPRMIG. To undo migration, users need to manually modify generated jobsand change job parameters: PARM='SSID,MIGRATE' should become PARM='SSID,REVERT'. Aftermodification, submit the edited jobs.


Update: Fast Replication copies are deprecated and removed from the ISPF client.


Update: Allow Redirected Recovery of Dropped Objects. See Performing redirected recovery.

Description: Redirected Recovery is allowed for LBDR profiles. With this enhancement, RedirectedRecovery of dropped, or altered objects, is allowed if source and target SSIDs are equal and log apply isnot disabled.


Update: ARY optional indexes are not required and should not be created. See Preparing to customizeDb2 Recovery Expert and Customizing Db2 Recovery Expert.

Description: ARY provides a template job which creates optional catalog indexes. These indexes are notrequired anymore as Db2 creates corresponding indexes automatically. See Worksheets: Gatheringparameter values for Db2 Recovery Expert.

Related APAR: None.

Update: New options for copy-scope parameter. See Specifying recovery options for application profilebatch job

Description: Available options are now N (do not create image copies after recovery), T (copy tablespacesonly), and I (copy tablespaces and indexes).

Related APAR: None.

Update: User Guide has been updated with additional detail about the syntax for the application profile inthe ARYIN DD statement. Procedures and functions have different syntax from the other object types. Inaddition, the TP object type has been added. See Building standard application profiles in batch.


Update: Db2 Recovery Expert now uses work files instead of 64-bit memory, so it is not limited to 500archive logs. See Specifying recovery options.

Related APAR: PI88704.

Update: Runtime statistics for dropped objects may be restored during the LBDR recovery. See Specifyingrecovery options.

Related APAR: PI88704


https://www-01.ibm.com/support/entdocview.wss?uid=swg1PH13181https://www-01.ibm.com/support/entdocview.wss?uid=swg1PH12477https://www-01.ibm.com/support/entdocview.wss?uid=swg1PH12477https://www-01.ibm.com/support/entdocview.wss?uid=swg1PH12480http://www-01.ibm.com/support/docview.wss?uid=swg1PH11064http://www-01.ibm.com/support/docview.wss?uid=swg1PH11064http://www-01.ibm.com/support/docview.wss?uid=swg1PI88704http://www-01.ibm.com/support/docview.wss?uid=swg1PI88704

Update: User Guide has been updated to explain that Remember Password does not work withmultifactor authentication. See Using passwords to authenticate ISPF users.

Related APAR: None.

November, 2018

• Accelerated tables will be automatically reloaded into IDAA after a recovery action.• MQT are now supported for Redirected Recovery.• Added an option to allow the use of member ids in profile names, configurable from the TCz panels.• Restriction removed from Redirected Recovery.• Updated messages.

October, 2018

• Added recovery utility for reorganizing VSAM repository files (ARYRORG1 and ARYRORG2).• Added recovery utility for listing available SLB backups at disaster recovery site (ARY#RPTD).• Added a new option to detect unrecoverable resources during plan generation.• Added restrictions to Redirected Recovery.• Updated messages.

August 24, 2018

• Added ability to monitor recovery jobs and recovered objects.• Added new requirements for Redirected Recovery and Advanced Recovery.• Added support for new batch utility plans.• Clarified a misleading HFS installation path requirement.

August 3, 2018

• Added topics that describes Db2 migration and product migration through TCz.• Added administrative commands available on the Db2 Recovery Expert agent.• Added Override PARMLIB option and a topic discussing the Override PARMLIB Options panel.• Assorted updates to Redirected Recovery.• Updated parameters list.• Updated messages.

July 2018


• Added a topic that describes performing redirected recovery at an overview level.• Updated messages.

June 2018

• Added a topic that describes how to login to a database from the ISPF interface using either a password(up to 8 characters) or a password phrase (up to 128 characters).

• Added a Multicast options that allows users to disable multicasting on the server.• Added and updated server and agent messages.


May 2018

• Added a recovery option that enables users to add SYSAFF to a recovery job card. Including SYSAFF onthe job card ensures that the job runs on the same system (LPAR) as the target Db2 system to which theobjects will be recovered.

• Added the Notify if Data Capture Changes enabled redirected recovery option. This option specifieswhether a warning message is issued if Data Capture Changes is enabled on the table that is beingrecovered.

• Added Trigger objects to the list of object types that can be selected for redirected recovery.• Added an option to log based recovery that enables users to selected all dropped objects for recovery

with one click. When selected, all dropped objects of every type are included in the profile for recovery.• Added a redirected recovery option that allows users to choose whether the generated job JCL includes

detailed comments describing the function of each step.• Added a recovery option that allows users to choose whether to generate recovery plans for all objects

in a profile even if some objects in profile.• Added support for Log Read and Log Apply recovery and redirected recovery options that can be used

for redirected recovery and fast recover plans.• Added the Use Db2 System Catalog only recovery option specifies that any information about

recovered objects stored in RBR repositories should be ignored.• Added support to allow workfiles to be used for Undo/Redo SQL plans instead of the 64 bit storage. This

helps to overcome a restriction on the amount of scanned log activity.• Added support for single character wildcards and arbitrary string wildcards options that can be used todefine redirected recovery source and target names.

• Added support for XML redirected recovery options.

The web browser section of the documentation was updated to include a topic on the benefits of clearingyour web browser's cache after applying maintenance and before opening the Db2 Recovery Expert webbrowser interface.

What does Db2 Recovery Expert do?Db2 Recovery Expert helps you avoid accidental data loss or corruption by providing the fastest, leastcostly method of backup and recovery.

Db2 Recovery Expert provides a fast and easy-to-use implementation of a Db2 system backup andrecovery methodology. It reduces backup windows by leveraging storage-based fast-replication such thatbackups of multi-terabyte databases can be performed in seconds or less. It simplifies backup andrecovery methodologies by allowing full-system, application, and object-level recoveries to be performedfrom a common system backup.

Consistent backups can be created using "full" or "data-only" system level backup options. It providesDb2 system backup and recovery support even for complex applications, where all of the application'sdata must be backed up, restored, and recovered as a unit. System backups can be taken while the Db2system remains active. In addition, when creating system level backups, Db2 Recovery Expert invokesstorage-based fast-replication facilities through appropriate storage processor APIs, reducing host CPUand I/O resource utilization and enabling legacy data copy methods to be used while the Db2 system isdown.

Db2 Recovery Expert has integrated, intelligent recovery and disaster recovery managers that analyzerecovery assets and establish optimal recovery procedures to minimize recovery time and recovery pointobjectives. Recovery jobs are tailored specifically to available backup and hardware resources.

• The Intelligent Recovery Manager supplies the ability to perform local recoveries efficiently using allavailable recovery resources. Restore operations that invoke fast-replication facilities throughappropriate storage processor APIs and parallel recovery can significantly reduce recovery time andcomplexity.


• The Intelligent Disaster Recovery Manager uses local site procedures to prepare for offsite disasterrecovery or disaster restart in advance. The information that is acquired allows Intelligent DisasterRecovery Manager to intelligently perform remote site restoration operations and appropriate recoveryor restart procedures.

Backup and recovery solutionsIBM solutions help IT organizations maximize their investment in Db2 databases while staying on top ofsome of today's toughest IT challenges. Backup and recovery solutions can protect your data and lessenthe negative impact that data loss can have on your business.

Backup and recovery is one of the most complicated areas of database management. Having the rightresources to do a recovery is critical, and unfortunately in many cases, is not addressed until after data isalready lost.

Database backup and recovery solutions include recovering from a dropped object to bouncing back froma major disaster, and everything in between. Recoveries that are done manually can be error prone, timeconsuming, and resource intensive.

Some of the questions you might face as a database administrator who is responsible for backup andrecovery tasks include:

• Can a transaction be reversed or does the entire database have to be recovered?• How can you determine which objects have been impacted?• Do you have the necessary resources to recover to a point in time?• Are you prepared for a disaster?• Can you recover your subsystem?• How much data are you willing to lose?

Db2 Tools for z/OS products support and exploit the most current versions of Db2, optimizing theperformance and management of Db2.

Db2 Recovery Expert for z/OS, one of several important Db2 Tools for z/OS, is a storage-aware backupand recovery solution that integrates storage processor fast-replication facilities with Db2 backup andrecovery operations to allow instantaneous backups, reducing recovery time, and simplifying disasterrecovery procedures while using less CPU, I/O, and storage resources. This product provides anintelligent analysis of altered, incorrect, or missing database assets, including table spaces, tables,indexes, and data. It automates the process of rebuilding these assets to a specified point in time, oftenwithout taking the database or the business operations offline.

Other Db2 Tools for z/OS that can assist with database backup and recovery include:

• Db2 Log Analysis Tool for z/OS• Db2 Change Accumulation Tool for z/OS• Db2 Archive Log Accelerator for z/OS• Db2 Automation Tool• IBM Application Recovery Tool for IMS and Db2

Db2 Recovery Expert features and benefitsDb2 Recovery Expert offers several unique and significant features that you can use to significantlyimprove your Db2 backup and recovery methodology.

Db2 Recovery Expert features include:Db2 system backup and recovery

Db2 Recovery Expert provides the ability to backup an entire Db2 system (full image or data only) or apartial Db2 system at the volume level through the use of system backup profiles.


These profiles designate the Db2 system, the user options and the resources that will be used toperform the backup. When executed, Db2 Recovery Expert will validate that all Db2 data is included inthe backup by performing dynamic discovery of all the data sets and their associated volumes. Thiswill ensure that the entire Db2 system is backed up.

The system backup can be taken while the Db2 system is active by using fast-replication storagedevices, or while the Db2 system is down using DFSMSdss or FDR to copy each Db2 volume. Db2Recovery Expert also provides the ability to "offload" or copy the system backup to tape.

A system backup can be used at the local site to restore an entire Db2 system, or at the remote site torestore the Db2 system for disaster recovery purposes. In addition, Db2 Recovery Expert can restoreindividual Db2 objects from a system backup.

Db2 system backup configuration and managementDb2 Recovery Expert includes a System Setup feature that can be used to discover a Db2 system andrecommend layout and configuration changes so that the Db2 system can be set up appropriately toaccommodate a system backup and recovery methodology.

Backup validationDb2 Recovery Expert provides extensive backup validation to ensure that the system backup containsall Db2 files and catalog structures required for a successful recovery.

Tape offload supportDb2 Recovery Expert provides tape offload support to automate copying a system backup or partialsystem backup from disk to tape. Backups created on disk can be copied to tape using DFSMSdss orFDR so the backup disk volume pool can be reused. Db2 Recovery Expert allows you to encrypt thedata when offloading to tape or disk. Data encryption can be specified for either DFSMSdss or FDRoffloads.

Db2 Recovery Expert provides a report of backups and offloaded tapes for offsite support. Asubsequent Db2 system restore operation will restore the backup from disk or tape depending onsystem backup availability and recovery scope. Db2 Recovery Expert will use the most appropriatebackup for application-level recovery and will restore the databases from disk, tape, or a previousimage copy depending on which backup provides the most expedient recovery process.

Object level recoveryDb2 Recovery Expert object level recovery enables users to recover individual Db2 objects or groupsof related objects from a system backup or from image copies.

Users create application profiles that contain the information that is used to recover a Db2subsystem's objects to a desired point in time. When recovery is necessary, Db2 Recovery Expertanalyzes all the available backup resources to generate the most appropriate recovery JCL to recoverall the objects in the profile. Db2 Recovery Expert can also invoke additional recovery utilities afterrestoring the databases to bring them to a more current point-in-time.

In addition, object-level recovery leverages storage-based data set fast-replication facilities. The useof storage-based data set fast-replication allows object recovery to be performed in parallel to thedatabase restore process, thus significantly reducing the overall recovery time. Object or databaserecoveries that traditionally have taken many hours can be performed in minutes or seconds usingDb2 Recovery Expert.

Tape-based disaster restartDb2 Recovery Expert provides disaster recovery support by transforming traditional Db2 disasterrecovery procedures into a tape-based disaster restart methodology.

System backups can be tagged for offsite transport to a disaster recovery site during the o

Documents

Db2 Recovery Expert for z/OS · 2020-04-03 · Version 3 Release 2 IBM Db2 Recovery Expert for z/OS User's Guide IBM SC19-2548-04