Zero Data Loss Solutions

Embed Size (px)

Citation preview

  • 8/6/2019 Zero Data Loss Solutions

    1/44

    1

    EMC SRDF: Zero Data Loss Solutions

    for Extended Distance Replication

    Technical NoteP/N 300-006-714

    REV A04

    June 2, 2010

    This technical note contains information on these topics:

    Executive summary ................................................................................... 2 Introduction and overview....................................................................... 3 EMC foundation products and features ................................................. 4 Revised SRDF relationships for cascaded SRDF....................................8 Supported SRDF modes and general restrictions................................ 10 Initial best practices for cascaded SRDF ............................................... 12 Changes to open systems Solutions Enabler interface........................ 13 SRDF/EDP specific Solutions Enabler interface changes................... 20 Changes to the SRDF Host Component z/OS interface..................... 27 Mainframe Enabler 7.0 (SRDF Host Component 7.0) changes .......... 38 Cascaded SRDF/Star support for open systems and z/OS............... 40 Summary and conclusion ....................................................................... 42

  • 8/6/2019 Zero Data Loss Solutions

    2/44

    2

    Executive summary

    EMC SRDF: Zero Data Loss Solutions for Extended Distance Replication Technical Note

    Executive summary

    The EMC Symmetrix Remote Data Facility (SRDF) family of remotemirroring software offers various levels of Symmetrix-based businesscontinuance and disaster recovery solutions. The SRDF products offerthe capability to maintain multiple, host-independent, mirrored copies ofdata. The Symmetrix systems can be in the same room, in different

    buildings within the same campus, or hundreds to thousands ofkilometers apart.

    SRDF remotely mirrors production or primary (source) site data to asecondary (target) site transparently to users, applications, databases,and host processors. The local SRDF device, known as the primary (R1)device, is configured in a partner relationship with a remote secondary

    (R2) device, forming an SRDF pair.Enginuity level 5773 is the latest Enginuity release supporting theSymmetrix Direct Matrix Architecture DMX-3 and DMX-4 storagearrays, and contains features that provide increased storage utilizationand optimization, enhanced replication capabilities, and greaterinteroperability and security, as well as multiple ease-of-useimprovements.

    One such feature of Enginuity level 5773 providing remote mirroringcapabilities is cascaded SRDF, which supports a three-site disasterrecovery configuration. The core benefit behind a cascadedconfiguration is its inherent capability to continue replicating withminimal user intervention from the secondary site to a tertiary site with

    SRDF/A in the event that the primary site goes down. This enables afaster recovery at the tertiary site, provided that is where the customer islooking to restart their operation.

    By maintaining copies of data in different physical locations, SRDFenables you to perform the following operations with minimal impact onnormal business processing:

    Disaster restart Disaster restart testing Recovery from planned outages Remote backup

    Data center migration Data replication and data mobility

  • 8/6/2019 Zero Data Loss Solutions

    3/44

    3

    Introduction and overview

    EMC SRDF: Zero Data Loss Solutions for Extended Distance Replication Technical Note

    Introduction and overview

    Prior to Enginuity 5773, an SRDF device could be a primary device (R1device) or a secondary device (R2 device); however it could not be in thedual role simultaneously. Cascaded SRDF is a new three-site disasterrecovery configuration where data from a primary site is synchronouslyreplicated to a secondary site, and then asynchronously replicated to atertiary site.

    Cascaded SRDF introduces a new SRDF R21 device. The R21 deviceassumes dual roles of primary (R1) and secondary (R2) device typessimultaneously. Data received by this device as a secondary canautomatically be transferred by this device as a primary (according to theavailable modes).

    A basic cascaded SRDF configuration consists of a primary site (site A)replicating to a secondary site (site B) and then replicating the same datato a tertiary site (site C).

    In the figure above, the secondary site B device is labeled R21. Thisdevice is the R2 mirror of the primary site A device, and the R1 mirror ofthe tertiary site C device. Primary site A and secondary site B have anSRDF pair state; secondary site B and tertiary site C have an SRDF pairstate. These two pair states are separate from each other, but each must

    be considered when performing a control operation on the other pair.

    The key benefits of cascaded SRDF:

    Sites can be geographically dispersed. Cascaded SRDF can span multiple SRDF groups and Symmetrix

    arrays.

    Faster recovery times at the tertiary site, which is enabled by thecapability to continue replicating from the secondary site to the

    tertiary site if the primary site becomes unusable. Facilitate and assist customers in achieving less than a 2-hour

    recovery time objective.

    Zero data loss achievable up to the point of the primary site

  • 8/6/2019 Zero Data Loss Solutions

    4/44

    4

    EMC foundation products and features

    EMC SRDF: Zero Data Loss Solutions for Extended Distance Replication Technical Note

    failure, fault or disaster event at the secondary B or tertiary Csites.

    Is tightly integrated with the TimeFinder

    product family. Management capability provided with the current Storage

    Management Portfolio of products (using SMC and EMCControlCenter). Does not require the purchase of additionalnew management software products.

    Available with Enginuity 5874, SRDF/Extended Distance Protection(EDP) is a new two-site disaster restart solution that enables customersto achieve no data loss at an out-of-region site at a lower cost. Usingcascaded SRDF as the building block for this solution, combined with theuse of the new diskless R21 data device at an intermediate (pass-through) site Symmetrix system, provides data pass-through to the out-of-region site using SRDF/A.

    In addition, SRDF/EDP supports SRDF/Star for continuous remote datareplication protection between the production site and the out-of-regionsite in the event that the intermediate (pass-through) site goes offline dueto a disaster event.

    The key benefits of SRDF/EDP to the customer:

    New long-distance replication solution with the ability toachieve zero RPO at the tertiary site.

    Lower cost alternative in which to achieve no data loss for out-of-region disaster restart.

    SRDF/Star differential relationship support between theextended distance site and the production site for failover

    operations with reverse SRDF/Asynchronous protection.

    Audience

    This technical note is intended for anyone who needs to understandcascaded SRDF or SRDF/EDP, functionality, best practices, and currentrestrictions. It is specifically targeted at EMC field technical staff andEMC customers who are either running cascaded SRDF or areconsidering cascaded SRDF as a viable long-distance replicationsolution.

    EMC foundation products and features

    Symmetrix Remote Data Facility

    Symmetrix Remote Data Facility (SRDF) is a business continuity solutionthat provides a host-independent, mirrored data storage solution for

  • 8/6/2019 Zero Data Loss Solutions

    5/44

    5

    EMC foundation products and features

    EMC SRDF: Zero Data Loss Solutions for Extended Distance Replication Technical Note

    duplicating primary site data to one or more physically separatedsecondary Symmetrix systems. In basic terms, SRDF is a configurationof multiple Symmetrix systems whose purpose is to maintain multiplecopies of logical volume data in more than one location.

    SRDF replicates primary (source, R1) site data to a secondary (target, R2)site transparently to users, applications, databases, and host processors.The primary SRDF device is configured in a partner relationship with asecondary (R2) device, forming an SRDF pair. While the R2 device ismirrored with the R1 device, the R2 device is write-disabled to theremote host. After the R2 device synchronizes with its R1 device, the R2device can be split from the R1 device at any time, making the R2 devicefully accessible again to its host. After the split, the target (R2) devicecontains valid data and is available for performing business continuitytasks through its original device address.

    SRDF requires the configuration of specific source Symmetrix volumes(R1s) to be mirrored to target Symmetrix volumes (R2s). If the primarysite is no longer able to continue processing when SRDF is operating insynchronous mode, data at the secondary site is current up to the lastI/O transaction. When primary systems are down, SRDF enables fastfailover to the secondary copy of the data so that critical information

    becomes available in minutes. Business operations and relatedapplications may resume full functionality with minimal interruption.

    SRDF/Extended Distance Protection

    SRDF/Extended Distance Protection (EDP) is a new two-site disasterrestart solution that enables customers the ability to achieve no data loss

    at an out-of-region site at a lower cost. Using cascaded SRDF as thebuilding block for this solution, combined with the use of the newdiskless R21 data device at an intermediate (pass-through) siteSymmetrix system, provides data pass-through to the out-of-region siteusing SRDF/A.

    In addition, SRDF/EDP supports SRDF/Star for continuous remote datareplication protection between the production site and the out-of-regionsite in the event that the intermediate (pass-through) site goes offline dueto a disaster event.

    As with cascaded SRDF, an SRDF/EDP configuration consists of aprimary site (site A) replicating synchronously to a secondary site (site B)with SRDF/S, and then replicating the same data asynchronously to a

    tertiary site (site C) with SRDF/A.

    A regular R21 has its own local mirrors so there are three full copies ofdata, one at each of the three sites. In contrast, the diskless R21 devicehas no local disk space allocated to store the user data, therefore it

  • 8/6/2019 Zero Data Loss Solutions

    6/44

    6

    EMC foundation products and features

    EMC SRDF: Zero Data Loss Solutions for Extended Distance Replication Technical Note

    reduces the cost of having disk storage in secondary Symmetrix.

    The purpose of a diskless R21 device is to cascade data to the R2 device.

    When using a diskless R21 device, the changed tracks received on the R2mirror are saved in cache until these tracks are sent to the R2 device.Once the data is sent to the R2 device and the receipt is acknowledged,the cache slot is freed and the data no longer exists on the R21Symmetrix.

    SRDF/EDP is for customers who are looking for a two-site DR solutionwith the ability to achieve a zero recovery point objective (RPO) in theevent of a primary site failure. To date, customers looking to establish atwo-site disaster recovery configuration with a zero RPO were bound bydistance limitations due to latency and application performance(Synchronous Type Replication). Also, if the business called for anextended distance replication solution (Asynchronous Type Replication)

    they would have to compromise with some level of data loss(secs/mins).

    In order to achieve the best of both worlds, some customers had to optfor three-site configurations such as concurrent SRDF or cascaded SRDFwith SRDF/Star for the ability for extended distance replication and zeroRPOs at the tertiary site, even though they really did not need threecopies of their data. SRDF/EDP supports an RPO between the zero RPOof SRDF/S and seconds to minutes of SRDF/A, offering customers amore cost-effective, optimal solution to a three-site DR configuration.

    SRDF/A Reserve Capacity enhancements

    SRDF/A Reserve Capacity enhances SRDF/A's ability to maintain an

    operational state when encountering network resource constraints thatwould have previously suspended SRDF/A operations. With SRDF/AReserve Capacity functions enabled, additional resource allocation can

    be applied to address temporary workload peaks, periods of networkcongestion, or even transient network outages. The use of SRDF/AReserve Capacity is fully supported with cascaded SRDF.

    SRDF/A Transmit Idle is a Reserve Capacity enhancement to EMCsSRDF/A feature that provides SRDF/A with the capability ofdynamically and transparently extending the Capture, Transmit, andReceive phases of the SRDF/A cycle while masking the effects of an allSRDF links lost event. Without the SRDF/A Transmit Idleenhancement, an all SRDF links lost event would normally result in

    the abnormal termination of SRDF/A. The SRDF/A Transmit Idleenhancement has been specifically designed to prevent this event fromoccurring.

  • 8/6/2019 Zero Data Loss Solutions

    7/44

  • 8/6/2019 Zero Data Loss Solutions

    8/44

    8

    Revised SRDF relationships for cascaded SRDF

    EMC SRDF: Zero Data Loss Solutions for Extended Distance Replication Technical Note

    in a host database file.

    Note:Solutions Enabler references pertaining to the open systemscascaded SRDF interface are included in this document for introductory

    purposes only and are not intended to replace product specificdocumentation. For additional details on the cascaded SRDF opensystems interface, refer to the EMC Solutions Enabler Symmetrix SRDFFamily CLI Product Guide (available on Powerlink).

    SRDF Host Component for z/OS

    SRDF Host Component is a z/OS subsystem for controlling SRDFprocesses and monitoring SRDF status by using commands executedfrom a host. SRDF Host Component for z/OS along with ResourcePakBase for z/OS (API services module) is delivered when ordering a

    member of the SRDF product family.User interfaces to the SRDF Host Component are provided with bothTSO (ISPF) and batch commands. An optional interface is provided forEMC TimeFinder commands as well as SRDF commands to centralizecommands for both replication products.

    You can issue SRDF Host Component commands to both local andremote Symmetrix systems. Commands destined for remote Symmetrixsystems are transmitted using local Symmetrix systems to remoteSymmetrix systems using their SRDF links.

    Note: SRDF Host Component references pertaining to the z/OS cascadedSRDF interface are included in this document for introductory purposes

    only and are not intended to replace product specific documentation. Foradditional details on the cascaded SRDF interface for z/OS, refer to theEMC SRDF Host Component for z/OS Version 5.6 Product Guide (available onPowerlink).

    Revised SRDF relationships for cascaded SRDF

    The introduction of a cascaded SRDF relationship means that thecommonly used mechanism of viewing an SRDF device as either a R1device or a R2 device needs to change since the R21 device serves bothpurposes. Changing the way we view an SRDF device to be context-, ormirror-based, rather than device type-based will allow the customer tomore easily understand the changes that have been made to SolutionsEnabler and SRDF Host Component.

  • 8/6/2019 Zero Data Loss Solutions

    9/44

    9

    Revised SRDF relationships for cascaded SRDF

    EMC SRDF: Zero Data Loss Solutions for Extended Distance Replication Technical Note

    Throughout Solutions Enabler and SRDF Host Component interfaces, anR21 device may be viewed based on the relationship that is beingqueried or controlled. For example, when working with the R1->R21relationship, the R21 device will be acting and will be managed as if itwere an R2. When working with the R21-> R2 relationship, the R21 will

    be acting and will be managed as if it were an R1 device.

    When querying or controlling an R1 device that is participating in acascaded SRDF relationship, the termsfirst hop and second hop will beused to R1 -> R21 and R21 -> R2 relationship, respectively. This is alsotrue when controlling a R2 device that is participating in a cascadedSRDF relationship, but the first hop will represent the R2 -> R21relationship and the second hop will represent the R21 -> R1relationship.

    When performing controls against one SRDF pair relationship, the state

    of the other SRDF pair relationship will determine whether the operationwill be allowed. Controls are allowed from hosts connected to either theSymmetrix containing the R1 device, the Symmetrix containing the R21device, or the Symmetrix containing the R2 device.

    The open systems example below shows that the location of the hop-2devices is dependent on the location of the controlling host. In thisexample, the controlling host is located at workload site A, therefore acontrol operation using a -hop2 specific reference will act on thedevices in the Symmetrix at tertiary site C.

    Conversely, when the controlling host is located at site C, as shown onthe next example, a control operation using a -hop2 specific referencewill act on the devices in the Symmetrix at primary site A.

    While similar, references in SRDF Host Component for z/OS utilize a

  • 8/6/2019 Zero Data Loss Solutions

    10/44

    10

    Supported SRDF modes and general restrictions

    EMC SRDF: Zero Data Loss Solutions for Extended Distance Replication Technical Note

    slightly modified remote command reference.

    As in the previous examples, the controlling host is located at primarysite A, therefore a control operation using a LCL(GK,RDFGRP1)reference will act on the local devices at primary site A , aRMT(GK,RDFGRP1) reference will act on the devices at secondary site B ,and a RMT(GK,RDFGRP1.RDFGRP2) reference will act on the devices inthe Symmetrix at tertiary site C.

    Supported SRDF modes and general restrictions

    Valid SRDF modes

    SRDF currently supports the following modes of operation in a cascadedenvironment:

    Synchronous mode (SRDF/S) Provides real-time mirroring ofdata between the primary Symmetrix system(s) and one or moresecondary Symmetrix systems. Data is written simultaneously to thecache of both systems in real time before the application I/O iscompleted, thus ensuring the highest possible data availability. Datamust be successfully stored in both the primary and secondarySymmetrix systems before a positive acknowledgment is sent to theprimary host. This mode is used mainly for metropolitan areanetwork distances less than 200 km.

    Asynchronous mode (SRDF/A) Maintains a dependent-writeconsistent copy of data at all times across any distance with little orno measurable host application impact. Applications needing toreplicate data across long distances historically have had limitedoptions. SRDF/A delivers high-performance, extended distancereplication and reduced telecommunication costs while leveraging

    existing management capabilities with no host performance impact. Adaptive Copy mode Transfers data from source devices to target

    devices regardless of order or consistency, and without hostperformance impact. This is especially useful when transferring

  • 8/6/2019 Zero Data Loss Solutions

    11/44

    11

    Supported SRDF modes and general restrictions

    EMC SRDF: Zero Data Loss Solutions for Extended Distance Replication Technical Note

    large amounts of data during data center migrations, consolidations,and in data mobility environments.

    Similar to other advanced SRDF relationships, the modes supported foreach hop of a cascaded SRDF configuration are based upon the currentstate of the device in question and the SRDF links.

    A basic cascaded SRDF configuration consists of a primary site (site A)replicating synchronously to a secondary site (site B) with SRDF/S, andthen replicating the same data asynchronously to a tertiary site (site C)with SRDF/A.

    Notice that in the previous figure, the link from workload site A tosecondary site B is in SRDF/S or synchronous mode and the link fromsecondary site B to tertiary site C is in SRDF/A or asynchronous mode.

    While the configuration above represents a typical or best practiceimplementation of cascaded SRDF, other SRDF mode combinations arealso valid as shown in the following diagram and associated table.

    HOP-1: Site A to Site B(R1 - R21)

    HOP-2: Site B to Site C(R21 - R2)

    Synchronous 1 Asynchronous 2

    Adaptive Copy disk Asynchronous

    Adaptive Copy WP Asynchronous

    Synchronous Adaptive Copy disk

    Asynchronous Adaptive Copy diskAdaptive Copy WP Adaptive Copy disk

    Adaptive Copy disk Adaptive Copy disk1

    Recommended Hop-1 SRDF mode of operation2

    Recommended Hop-2 SRDF mode of operation

  • 8/6/2019 Zero Data Loss Solutions

    12/44

    12

    Initial best practices for cascaded SRDF

    EMC SRDF: Zero Data Loss Solutions for Extended Distance Replication Technical Note

    Caution! Use of Adaptive Copy mode on the first leg will cause loss of

    consistency for SRDF/A operating on the second leg.

    General limitations and restrictions (non-interface specific)

    The following is a current list of general cascaded SRDF limitations andconstraints:

    The secondary site B (where the R21 device resides) requiresEnginuity 5773, Solutions Enabler 6.5, or SRDF Host Component5.6. The primary/workload A and tertiary C sites systems canrun on 5671, 5772, or 5773.

    Primary site A and tertiary site C Symmetrix will requireEnginuity 5x71 or later to support SRDF/A Multi-SessionConsistency (MSC).

    An R21 device cannot be paired with another R21 device. R21 devices cannot be BCV devices. R21 devices are only supported on GigE and Fiber RAs. PPRC devices cannot be R21 devices. R21 thin devices are not supported. The first hop will support all SRDF modes of operation, with the

    exception of SRDF/A if it is currently utilized on the second hop.

    The second hop will support either SRDF/A or Adaptive CopyDisk Mode, with the exception of SRDF/A if it is currentlyutilized on the first hop.

    Solutions Enabler or SRDF Host Component will continue todiscover Symmetrix that are at most two hops away.

    There is no support for controlling or creating a single SRDFrelationship containing both concurrent and cascadedcomponents.

    Initial best practices for cascaded SRDF

    As a new Enginuity feature, cascaded SRDF best practices are in theprocess of being developed based on our continued experiences with theproduct in the lab and well as with customers in the field. The list ofcascaded SRDF best practices presented below is in no way definitiveand will continue to develop based on these experiences:

  • 8/6/2019 Zero Data Loss Solutions

    13/44

    13

    Changes to open systems Solutions Enabler interface

    EMC SRDF: Zero Data Loss Solutions for Extended Distance Replication Technical Note

    A basic cascaded SRDF configuration is recommended and shouldconsist of a primary site (site A) replicating synchronously to asecondary site (site B) with SRDF/S, and then replicating the samedata asynchronously to a tertiary site (site C) with SRDF/A.

    The first hop of a cascaded SRDF configuration should haveConsistency Group (ConGroup) enabled in SRDF/S mode.

    SRDF/A MSC should be enabled on the secondary leg with a hostcontrolling cycle switching from primary, secondary or tertiary sites.

    R21 will have local mirrors using Mirrored, RAID 5, or RAID 6, or itcan be unprotected. However, unprotected R21 devices are notrecommended due to possible impact on replication due to drivefailures.

    Separate SRDF directors configured to support the incoming andoutgoing SRDF groups for the R21 device are highly recommended.

    A R21 device cannot have one static and one dynamic SRDF mirror. The use of SRDF/A Reserve Capacity is fully supported and

    recommended with cascaded SRDF.

    For the second hop, the R21 device cannot be in a consistency groupbecause SRDF synchronous mode is not supported on the secondhop.

    A gold copy BCV device at the tertiary site C is highlyrecommended should re-synchronization become necessaryfollowing a network or link outage.

    Changes to open systems Solutions Enabler interface

    The following sections pertaining to the open systems cascaded SRDFinterface are included for introductory purposes only and are notintended to replace EMC product specific documentation.

    For additional details on the cascaded SRDF open systems interface,refer to the EMC Solutions Enabler Symmetrix SRDF Family CLI ProductGuide (available on Powerlink).

    Initial packaging and licensing

    The initial release of cascaded SRDF has been packaged with the 5773Enginuity release and Solution Enabler 6.5. It requires a license at each

    site in a cascaded SRDF configuration. Other applicable SRDF familylicenses for the cascaded SRDF implementation also will apply.

  • 8/6/2019 Zero Data Loss Solutions

    14/44

    14

    Changes to open systems Solutions Enabler interface

    EMC SRDF: Zero Data Loss Solutions for Extended Distance Replication Technical Note

    Establishing a cascaded SRDF configuration

    Configuring cascaded replication is a two-step process, which can beperformed in any order:

    1. Create the initial R1 -> R2 pair between primary site A andsecondary site B, or first hop

    (or) between secondary site B and tertiary site C (second hop),alternatively.

    2. Set up the R1 -> R2 pair between secondary site B and tertiary site C,or second hop

    (or) between primary site A and secondary site B (first hop,alternatively.

    These steps are accomplished using the symconfigure command withthe add mirror option. The following examples show how to add amirror from each site. Please refer to the EMC Solutions EnablerSymmetrix Array Controls CLI Product Guide for information about usingthe symconfigure command.

    In the following examples, the device pairs in the cascaded replicationare:

    01A:140 (R1 workload site A and R21 secondary site B) 140:4F (R21 secondary site B and R2 tertiary site C)

    From workload site A, the add mirror command would be as follows:

    add rdf mirror to dev 01A ra_group=67, mirror_type =

    RDF1, remote_dev = 140, invalidate=R1, start_copy =

    YES, rdf_mode = sync;

    From tertiary site C, the add mirror command would be as follows:

    add rdf mirror to dev 4F ra_group=67, mirror_type =

    RDF2, remote_dev = 140, invalidate=R1, start_copy =

    YES, rdf_mode = acp_disk;

  • 8/6/2019 Zero Data Loss Solutions

    15/44

    15

    Changes to open systems Solutions Enabler interface

    EMC SRDF: Zero Data Loss Solutions for Extended Distance Replication Technical Note

    Note: For SRDF/EDP configurations, use rdf_mode = acp_wp.

    Note: Both add mirror commands cannot be in the same command file.

    Adding SRDF hop-2 devices

    Cascaded SRDF introduces the ability to perform controls on SRDFdevices that are two hops, or SRDF links, away.

    The following new device types have been added to device groups andcomposite groups:

    Hop-2 BCV (logical device name 2BCVnnn) Hop-2 VDEV (logical device name 2VDEVnnn) Hop-2 TGT (logical device name 2TGTnnn)

    For device groups, all -hop2 devices must be associated using the samehop-1 and hop-2 SRDF groups. The SRDF group used to associate hop-2devices must be the same one used to associate RBCVs, RTGTs, and

  • 8/6/2019 Zero Data Loss Solutions

    16/44

    16

    Changes to open systems Solutions Enabler interface

    EMC SRDF: Zero Data Loss Solutions for Extended Distance Replication Technical Note

    RVDEVs.

    Device groups

    To add hop-2 VDEV and TGT devices to a device group use thesymldcommand syntax, as follows:

    symld -g DgName [-sid SymmID] [ [-rdf |-hop2] [-rdfg GrpNum] [-remote_rdfg RemoteGrpNum]]add dev SymDevName [LdevName]

    Use the symbcv command syntax to add hop-2 BCVs to a device group,as follows:

    symbcv -g DgName [-sid SymmID] [[-rdf] [-bcv]] |[-rrdf] | [-hop2] [[-rdfg GrpNum] [-remote_rdfgRemoteGrpNum]] associate dev SymDevName [LdevName]

    The symld and symbcv commands with the -hop2 parameter can beused for the following operations:

    Add/remove Addall rmall (symld) Move/moveall Copy/copyall Dg2cg

    Composite groups

    To add hop-2 VDEV and TGT devices to a composite group, use the

    symcg command syntax, as follows:symcg -cg CgName sid SymmID [[-rdf | -hop2] [-vdev |-tgt]] [[-rdfg GrpNum] [-remote_rdfg RemoteGrpNum]]add dev SymDevName [LdevName]

    Use the symbcv command to add hop-2 BCVs to a composite group, asfollows:

    symbcv -cg CgName [-sid SymmID] [[-rdf | -hop2] [-vdev | -tgt]] [[-rdfg GrpNum] [-remote_rdfgRemoteGrpNum]] associate dev SymDevName [LdevName]

    The symdg and the symbcv commands with the -hop2 parameter canbe used for the following operations:

    Associate/disassociate Associateall/rmall Move/moveall

  • 8/6/2019 Zero Data Loss Solutions

    17/44

    17

    Changes to open systems Solutions Enabler interface

    EMC SRDF: Zero Data Loss Solutions for Extended Distance Replication Technical Note

    Copy/copyallRDF21 type groups

    Device groups and composite groups can be created to contain R21devices as standards. These groups can be identified with a new SRDFgroup type: RDF21. The following syntax examples show creating anRDF21 device group and composite group:

    symdg -type RDF21 create test_group_dg

    symcg -type RDF21 create test_group_cg

    The following restrictions apply to RDF21 groups:

    Composite groups cannot be PowerPath groups Device groups must use the same SRDF groups The SRDF mirror types for an SRDF group must match

    For example, the following figure shows an RDF21 group that will not beallowed because the device groups must use the same SRDF groups.

    The next figure shows an allowed RDF21 group using the same SRDFgroups.

  • 8/6/2019 Zero Data Loss Solutions

    18/44

    18

    Changes to open systems Solutions Enabler interface

    EMC SRDF: Zero Data Loss Solutions for Extended Distance Replication Technical Note

    Pair states queries of a cascaded relationship

    To display information about the second hop SRDF pair of a cascaded

    SRDF relationship, use the -hop2option with the symrdf querycommand. The following output is an example of a symrdf queryconr1 -hop2 command. The bolded output is further describedimmediately after the display.

    Some items to note in the preceding query:

  • 8/6/2019 Zero Data Loss Solutions

    19/44

    19

    Changes to open systems Solutions Enabler interface

    EMC SRDF: Zero Data Loss Solutions for Extended Distance Replication Technical Note

    Number of RDF (RA) Groups Represents the number of R1 -> R21 SRDF groups in the composite group.

    Symmetrix ID Represents the Symmetrix ID of the R1 device. Hop-2 Symmetrix ID Represents the Symmetrix ID of the R21

    device.

    Hop-2 Remote Symmetrix ID Represents the Symmetrix IDof the R2 device.

    RDF (RA) Group Number Represents the SRDF group of theR1 device.

    Hop-2 RDF (RA) Group Number Represents the SRDF groupof the R21 device.

    Total Sums the invalid tracks (and MB) across all displayedR21 -> R2 SRDF groups (sums all hop-2 invalid tracks).

    Note: With an R1 -> R21 -> R2 configuration, issuing a query -hop2 froman RDF1 CG indicates that the query should show the relationship of theR21->R2 device pairs. Thus the query will display the R21 device fromthe R1 mirror point of view.

    To see both hops of the RDF1 or RDF2 CG that contains devices in acascaded SRDF relationship, use the symrdf -cg query commandwith the -hop2 and the detail options.

    Note: The -detail option is not supported for a device group.

    Restrictions and limitations for open systemsThe following restrictions and limitations apply to R21 devices:

    To set up a dynamic R21 device, the device must be bothdyn_rdf1 and dyn_rdf2 capable. The following command willset this value:

    set dev xxx:[xxx] attribute = dyn_rdf;

    When adding the first device to an SRDF group with -rdf_modeasync, all subsequent devices that are added to the SRDF groupmust also be added with -rdf_mode async.

    When a mode is not specified, it defaults to Synchronous mode. When adding the first device to an SRDF group with -rdf_mode

    sync|semi|acp_wp|acp_disk, subsequent devices cannot beadded with -rdf_mode async.

    If the SRDF device is a part of a consistency group, the device

  • 8/6/2019 Zero Data Loss Solutions

    20/44

    20

    SRDF/EDP specific Solutions Enabler interface changes

    EMC SRDF: Zero Data Loss Solutions for Extended Distance Replication Technical Note

    cannot have a mirror added to it to form an R21 device.

    Mirrors cannot be added to VDEVS , SAVE devices, DATAdevices, thin devices, and WORM-enabled devices.

    When adding a mirror to a device, making the device an R21device, the following two conditions must be met:

    1. The R21 device should be able to see its current SRDFpartner, in other words, the links cannot be partitioned.

    2. The remote partner of the R21 cannot already be an R21device.

    If adding a dynamic SRDF mirror for an R21 device, the secondhop can only be in async or acp_disk mode (ac_wp forSRDF/EDP configurations).

    Specific restrictions for Static SRDF configurations:

    Static SRDF configurations can only be configured in sync,ac_wp, or ac_disk mode.

    The static SRDF R21 -> R2 link has to be ac_disk mode (ac_wpfor SRDF/EDP configurations).

    The start_copy option should be set to NO and invalidate set toNONE, if adding a remote mirror to a device leads to aconcurrent SRDF configuration.

    Note: Currently symconfigure contains a restriction that if invalidate isset to R1 or R2, then start_copy should be set to yes.

    SRDF/EDP specific Solutions Enabler interface changes

    The new SRDF/EDP functionality is based on a cascaded SRDFconfiguration, where a Symmetrix VMAX at a secondary site uses anew DLDEV (diskless R21) device to capture only the differential datathat would be owed to the tertiary site in the event of a primary sitefailure. The data in the diskless R21 device helps these configurations toachieve a zero RPO. The new DLDEV device type does not consumestorage space and is not a restartable copy of the user data. Therefore inthis configuration, users only have two full copies of the data beingprotected, one at the primary and the other at the tertiary site.

    EMC Solutions Enabler has been enhanced to support diskless devices.Support has been added to SYMCLI to allow the user to create disklessdevices, report on diskless devices, create SRDF relationships with

  • 8/6/2019 Zero Data Loss Solutions

    21/44

    21

    SRDF/EDP specific Solutions Enabler interface changes

    EMC SRDF: Zero Data Loss Solutions for Extended Distance Replication Technical Note

    diskless devices, and control the diskless devices and diskless SRDFrelationships. The Solutions Enabler SRDF Consistency support has also

    been enhanced to support SRDF consistency groups and Starenvironments comprised of diskless cascaded SRDF devices.

    The following changes have been made to the SYMCLI to supportSRDF/EDP:

    The add and remove SRDF mirror command has been extended tosupport add both static and dynamic SRDF mirrors to diskless devices.The procedure for setting up a diskless R21 device is generally nodifferent from configuring a legacy R21 device.

    The symdev list command will be enhanced to support a newdldev parameter that can be used to display all configured disklessdevices.

    symdev [-sid SymmID] [-offline][-v] [-resv] [-wwn] [-all]list [-SA ][-P #][-scsi][-fibre]-RANGE :]

    [-R1] [-R2] [-R21] [-dldev]

    Note: The dldev flag can be specified in conjunction with the R1, -R2, -R21, or dynamic flags and will return the requested disklessSRDF or SRDF capable devices.

    symdev list -sid 64 -dldev0005 Not Visible ???:? NA:NA RDF1+DLDEV N/Grp'd RW1031

    The following changes have been made to the output of the symdevshow command to support diskless devices:

    The Device Configuration field shows the device as beingdiskless.

    The Device SA Status always shows as N/A because disklessdevices cannot be mapped to a host.

    The Mirror Set Type and Mirror Set DA Status only showinformation about SRDF mirrors.

    The Back End Disk Director Information section only showsinformation about SRDF mirrors.

    The Back End Disk Director Information section shows a newMirror Number field for each displayed hyper.

    Each RDF Information section displays a new Diskless RDFRelationship field to indicate if the device is a diskless SRDF

  • 8/6/2019 Zero Data Loss Solutions

    22/44

    22

    SRDF/EDP specific Solutions Enabler interface changes

    EMC SRDF: Zero Data Loss Solutions for Extended Distance Replication Technical Note

    device or in a SRDF relationship with a diskless SRDF device.

    symdev show 01A -sid 56 (for a R21 diskless device)Device Configuration : RDF21+DLDEV(Non-Exclusive Access)Device Status : Ready (RW)Device SA Status : N/A (N/A)Mirror Set Type : [R2 Remote,R1 Remote,N/A,N/A]Mirror Set DA Status : [RW,RW,N/A,N/A]Mirror Set Inv. Tracks : [0,0,0,0]

    Back End Disk Director Information{Hyper Type : R2 RemoteHyper Status : Ready (RW)Disk [Director, Interface, TID] : [N/A,N/A,N/A]Disk Director Volume Number : N/AHyper Number : N/A

    Mirror Number : 1

    Hyper Type : R1 RemoteHyper Status : Ready (RW)Disk [Director, Interface, TID] : [N/A,N/A,N/A]Disk Director Volume Number : N/AHyper Number : N/A

    Mirror Number : 2

    }RDF Information{Device Symmetrix Name : 01ARDF Type : R2RDF (RA) Group Num : 8 (07)Remote Device Symmetrix Name : 0120Remote Symmetrix ID : 000190000000R2 Device Is Larger Than The R1 Device : False

    Paired with Diskless Device : FalseConcurrent RDF Relationship : FalseCascaded RDF Relationship : TrueRDF Information{Device Symmetrix Name : 01ARDF Type : R1RDF (RA) Group Num : 11 (0A)Remote Device Symmetrix Name : 0234Remote Symmetrix ID : 000190002615R2 Device Is Larger Than The R1 Device : FalsePaired with Diskless Device : False

    Paired with a Concurrent RDF Device : FalsePaired with a Cascaded RDF Device : False

    Note: The Paired with Diskless Device fields show as False because

    this device is not paired with a diskless device but rather is the disklessdevice. The Paired with Diskless Device field is an indicator about thedevice type for the SRDF remote pair for this device.

    symdev show 01A -sid 56(for a non-SRDF diskless device)

  • 8/6/2019 Zero Data Loss Solutions

    23/44

    23

    SRDF/EDP specific Solutions Enabler interface changes

    EMC SRDF: Zero Data Loss Solutions for Extended Distance Replication Technical Note

    Device Configuration : DLDEV(Non-Exclusive Access)

    Device Status : Ready (RW)Device SA Status : N/A (N/A)Mirror Set Type : [NA,N/A,N/A,N/A]Mirror Set DA Status : [N/A,N/A,N/A,N/A]Mirror Set Inv. Tracks : [0,0,0,0]

    Back End Disk Director Information{Hyper Type : N/AHyper Status : N/A (N/A)Disk [Director, Interface, TID] : [N/A, N/A, N/A]Disk Director Volume Number : N/AHyper Number : N/A

    Mirror Number : N/A

    Disk Capacity : N/ADisk Group Number : N/A}

    XML output has been changed to include the new displayed values and

    to display the new mirror number and Paired with a Diskless RDFDevice fields.

    symdev show ae -sid 109(for an R1 diskless device)RDF1+DLDEV

    2

    False

    The SRDF feature has been enhanced to support diskless SRDF devices.Since a diskless SRDF device does not have any local mirrors,appropriate controls have been restricted. Configuring a diskless R1, R2,R11, or R22 device is not recommended unless it is an intermediate stageof creating a diskless R21 device.

    The following change will be made to the symrdf list command:

    Filtering has been enhanced to support listing diskless SRDF devices. Anew diskless_rdf flag will be added and can be used to list all devices

    that are diskless SRDF devices or have an SRDF relationship with adiskless SRDF device.

    -diskless_rdf can be used in conjunction with R1, -R2, -R21, or dynamic flags and will return the requested diskless SRDF or SRDF

  • 8/6/2019 Zero Data Loss Solutions

    24/44

    24

    SRDF/EDP specific Solutions Enabler interface changes

    EMC SRDF: Zero Data Loss Solutions for Extended Distance Replication Technical Note

    capable devices.

    The new symrdf list syntax is as follows:

    symrdf [-sid SymmID] [-i Interval] [-c Count] [-offline] [-v] [-diskless_rdf]

    SRDF control operations can be issued against CGs, DGs, and files thatcontain both diskless and legacy cascaded device types. The processingfor SRDF pairs containing diskless devices is no different from theprocessing for SRDF pairs containing legacy cascaded devices; however,some new restrictions apply when you are controlling a cascaded SRDFrelationship that is comprised of diskless devices. These are:

    Set mode ASYNC issued against a device in a SRDF group thatconsists of mixed diskless legacy cascaded devices is notallowed.

    With an R1R21R2 configuration where the R21 is diskless,only the following combinations of SRDF modes are allowedwith all other combinations restricted:

    R1 R21 R21 R2Synchronous Asynchronous

    Adaptive Copy DISK Asynchronous

    Adaptive Copy WP Asynchronous

    Synchronous Adaptive Copy WP

    Adaptive Copy DISK Adaptive Copy WP

    Adaptive Copy WP Adaptive Copy WP

    The createpair, deletepair, swap_personality,movepair, and failover establish actions can be used to create

    and manage diskless SRDF device relationships. Please see the Currentlimitations and restrictions sections for additional information.

  • 8/6/2019 Zero Data Loss Solutions

    25/44

    25

    SRDF/EDP specific Solutions Enabler interface changes

    EMC SRDF: Zero Data Loss Solutions for Extended Distance Replication Technical Note

    The following types of MSC and SRDF-ECA Consistency enabling willbe allowed with SRDF/EDP:

    R1 R21 R21 R2SRDF-ECA -none-

    SRDF-ECA MSC

    -none- MSC

    The symconfigure CLI has been modified to support creation,configuration, convert, and delete of diskless device and SRDF disklessdevice.

    DLDEV RDF1+DLDEV RDF2+DLDEV RDF21+DLDEV

    To create a diskless device the user can use the existing create/configuredev command with one of the following config values.

    DLDEV RDF1+DLDEV RDF2+DLDEV

    Other applicable Solutions Enabler SYMCLI considerations forSRDF/EDP:

    Symreplicate will be changed to return an error if a disklessSRDF is found in the configuration.

    SymRecover has been enhanced to support diskless SRDFconfigurations at the R21 site.

    For control site operations, when the R21 is diskless,the cascaded_monitor_both_hops flag is required. Monitoringonly a single hop of a diskless relationship is not supported.

    When restarting, the R21R2 leg will be recovered beforerecovering the R1R21 leg. This is required to adhere to theEnginuity limitation that the R1R21 relationship cannot be RWon the link when the R21R2 relationship is NR on the link.

    When recovering the R21R2 relationship, therestart_sync_type will always be adaptive copy write pending(ADCOPY_WP) if the R21 is a diskless device.

    Users cannot directly create RDF21 devices. They will have touse the ADD RDF MIRROR symconfigure command or the

  • 8/6/2019 Zero Data Loss Solutions

    26/44

    26

    SRDF/EDP specific Solutions Enabler interface changes

    EMC SRDF: Zero Data Loss Solutions for Extended Distance Replication Technical Note

    SYMRDF CREATEPAIR TYPE=DLDEV command to create R21diskless devices.

    When creating diskless SRDF devices both the local and remotedevices cannot be R21 devices.

    The disk group number and the mvs_ssid attributes are notapplicable when creating diskless devices.

    The create pair action will be blocked if it results in aR1R21R2 relationship where the R1 and the R2 are disklessdevices.

    Diskless SRDF is supported in conjunction with the SRDF/ADelta Set Extension feature.

    Requirements and dependencies

    SRDF/EDP and associated diskless devices are supported only on theSymmetrix VMAX hardware platforms with Enginuity 5874 and later.However, only the Symmetrix that contains the diskless R21 device isrequired to be Enginuity 5874. The primary and the tertiary site systemsare required to be in a Enginuity code level 5773 or 5874. Customers arereminded that if a failover action will result in the primary or tertiary site

    being configured as a new secondary site (where diskless R21s areconfigured), then Enginuity 5874 will be required to run on those sites aswell. Please see the Current limitations and restrictions sections foradditional information.

    Current limitations and restrictions

    The following is a current list of SRDF/EDP limitations and constraints: A diskless device cannot be mapped to the host. Therefore, no

    host will be able to directly access a diskless device for I/O (reador write).

    Diskless SRDF devices are only supported on GIGE and FiberRAs

    A diskless device cannot use hot sparing or dynamic sparing. All Symmetrix replication technologies other than SRDF

    (TimeFinder, Snap, Clone, and ORS) will be blocked fromworking in conjunction with diskless devices as either the sourceor the target of the operation.

    A diskless SRDF device cannot be paired with a thin SRDFdevice. A diskless SRDF device cannot be used in a R2 larger than R1

    configuration.

  • 8/6/2019 Zero Data Loss Solutions

    27/44

    27

    Changes to the SRDF Host Component z/OS interface

    EMC SRDF: Zero Data Loss Solutions for Extended Distance Replication Technical Note

    The software implementation of DLDEVs will run only on theVMAX hardware platform with the Enginuity 5874 code leveland later.

    Only the secondary site (where the DLDEV resides) will berequired to be at the Enginuity 5874 code level to support adiskless R21 device.

    The primary and the tertiary site systems are required to be in aEnginuity code level 5773 or 5874.

    Primary or tertiary site systems with Enginuity code level 5773will require an e-pack in order to connect to a SRDF/EDPsystem.

    Since local replication cannot be performedon a diskless device,Gold copies will not be allowed at a diskless R21 site.

    Diskless devices may not be added to the TGT, RTGT, or 2-HopTGT device list.

    When creating a metadevice using diskless devices all themembers of the meta must be diskless. You cannot mix disklessand legacy cascaded devices in a single meta.

    Either the local or the remote device can be diskless, however,both the local and the remote SRDF device cannot be diskless.

    Cannot add a mix of diskless and traditional cascaded SRDFdevices in an SRDF group with devices in Async mode.

    Changes to the SRDF Host Component z/OS interface

    The following sections pertaining to the z/OS cascaded SRDF interfaceare included for introductory purposes only and are not intended toreplace EMC product specific documentation.

    For additional details on the cascaded SRDF interface for z/OS, refer tothe EMC SRDF Host Component for z/OS Version 5.6 Product Guide(available on Powerlink).

    Initial packaging and licensing

    Cascaded SRDF will be packaged with the 5773 Enginuity release andSRDF Host Component version 5.6. It will require a license at all sites ina cascaded SRDF configuration. Other applicable SRDF family licenses

    for the cascaded SRDF implementation also will apply.

    SRDF Host Component change summary

    Throughout SRDF Host Component version 5.6 and later versions, an

  • 8/6/2019 Zero Data Loss Solutions

    28/44

    28

    Changes to the SRDF Host Component z/OS interface

    EMC SRDF: Zero Data Loss Solutions for Extended Distance Replication Technical Note

    R21 device may be viewed based on the relationship that is beingqueried or controlled. For example, when working with the R1->R21(read as R1 to R21) relationship, the R21 device will be acting, and will bemanaged, as if it were an R2. When working with the R21->R2relationship, the R21 will be acting, and will be managed, as if it were anR1 device.

    Configuring a cascaded SRDF configuration is a two-step process: (1)Establish R1->R2 pairs between primary site A and secondary site B (orsecondary site B and tertiary site C) and (2) establish R1->R21 pairs

    between primary site A and secondary site B (or R21->R2 betweensecondary site B and tertiary site C).

    Cascaded SRDF changes the way we view an SRDF volume to becontext-, or mirror-based, rather than device-based. SRDF HostComponent now supports configuring both cascaded and concurrent

    SRDF environments using the standard SRDF Host Component SCcommand syntax. The following example assumes that the synchronousSRDF relationship to the secondary DMX has already been established:

    SC VOL,RMT(GK,localRDFGRP#,bunkerRDFGRP#),

    CREATEPAIR(ADCOPY-DISK),start-bunkersymdv-end-bunkersymdev#,B-site-start-symdev#

    There have been relatively few SRDF Host Component changes requiredto implement cascaded SRDF; the SRDF commands needed to domultiple hops have been available in the command syntax and wereused for SRDF/SAR in legacy releases. The only real change incommand syntax added for cascaded SRDF support was related todescribing the SRDF/A MSC session, since it is now controlled remotely.The syntax has been changed as follows:

    MSC_INCLUDE_SESSION=ccuu,(localrdfgrp,remoterdfgrp)

    All other changes within Enginuity allow concurrent SRDF for a R2device and all associated operations that this entails.

  • 8/6/2019 Zero Data Loss Solutions

    29/44

    29

    Changes to the SRDF Host Component z/OS interface

    EMC SRDF: Zero Data Loss Solutions for Extended Distance Replication Technical Note

    Establishing a cascaded SRDF configuration

    Once the required SRDF groups have been established, setting upcascaded replication is a two-step process, which can be performed inany order:

    1. Create the initial R1 -> R2 pair between primary site A andsecondary site B, or first hop

    (or) between secondary site B and tertiary site C (second hop),alternatively.

    2. Set up the R1 -> R2 pair between secondary site B and tertiary site C,or second hop

    (or) between primary site A and secondary site B (first hop,alternatively.

    In the following examples we will create the required SRDF groups, anddevice pairing, and perform various queries to determine the state of theenvironment.

  • 8/6/2019 Zero Data Loss Solutions

    30/44

    30

    Changes to the SRDF Host Component z/OS interface

    EMC SRDF: Zero Data Loss Solutions for Extended Distance Replication Technical Note

    The first step required to configure a legacy cascaded SRDF environmentis to create an SRDF group from primary site A to secondary site B forthe first hop.

    The next step is to create an SRDF group between secondary site B andtertiary site C for the second hop.

  • 8/6/2019 Zero Data Loss Solutions

    31/44

    31

    Changes to the SRDF Host Component z/OS interface

    EMC SRDF: Zero Data Loss Solutions for Extended Distance Replication Technical Note

    Once the first and second hop SRDF groups have been created,performing an SQ LINK command will result in the following:

  • 8/6/2019 Zero Data Loss Solutions

    32/44

    32

    Changes to the SRDF Host Component z/OS interface

    EMC SRDF: Zero Data Loss Solutions for Extended Distance Replication Technical Note

    Once the SRDF groups have been created and verified, our next step is toidentify volumes to be paired between primary site A and secondary siteB for the first hop:

    Once the volumes to be paired have been identified, the next step is tocreate device pairs between primary site A and secondary site B for thefirst hop.

  • 8/6/2019 Zero Data Loss Solutions

    33/44

    33

    Changes to the SRDF Host Component z/OS interface

    EMC SRDF: Zero Data Loss Solutions for Extended Distance Replication Technical Note

    Once the first hop has been completed, our next step is to identifyvolumes to be paired between secondary site B and tertiary site C for thesecond hop:

    Once the second hop volumes have been chosen, the next step is to createdevice pairs between secondary site B and tertiary site C for the first hop.However, performing a typical CREATEPAIR will result in an error.

    Important!CREATEPAIR will default to synchronous mode, which isnot a valid mode for the second hop of a cascaded SRDF relationship:

  • 8/6/2019 Zero Data Loss Solutions

    34/44

    34

    Changes to the SRDF Host Component z/OS interface

    EMC SRDF: Zero Data Loss Solutions for Extended Distance Replication Technical Note

    With this restriction in mind, the next step would then be to createdevice pairs between secondary site B and tertiary site C for the secondhop, specifying Adaptive Copy disk as the mode of operation.

  • 8/6/2019 Zero Data Loss Solutions

    35/44

    35

    Changes to the SRDF Host Component z/OS interface

    EMC SRDF: Zero Data Loss Solutions for Extended Distance Replication Technical Note

    Performing a concurrent SRDF SQ VOL for comparison purposes resultsin the following output:

    There have also been changes to RMT in the SQ VOL command toaddress access to the second hop:

  • 8/6/2019 Zero Data Loss Solutions

    36/44

    36

    Changes to the SRDF Host Component z/OS interface

    EMC SRDF: Zero Data Loss Solutions for Extended Distance Replication Technical Note

    The SRDF/A hop may now be activated and the second hop queried tovalidate the expected mode of operation results (note the Cimmediately after the SRDF group number indicates that the group isparticipating in a cascaded relationship):

  • 8/6/2019 Zero Data Loss Solutions

    37/44

    37

    Changes to the SRDF Host Component z/OS interface

    EMC SRDF: Zero Data Loss Solutions for Extended Distance Replication Technical Note

    Similarly, the output of the SQ VOL command also has been changed toindicate a cascaded SRDF relationship (CAS in the status field indicates acascaded SRDF relationship):

    Restrictions and limitations for z/OS

    The following restrictions and limitations apply to R21 devices:

    R21 devices are supported only at 5773 code. A and C Symmetrix systems can be at older code levels.

    Note: Failover operations that result in R21 devices beingconfigured in the original A or C sites will require Enginuity5773 to be running on the Symmetrix systems at those sites.

    R21 is only supported on GigE and Fibre RA (no ESCON). R21 can only be paired with R1 and R2 devices. You cannot chain R1->R21->R21->R2. R21 cannot be a BCV device. R21 cannot be a PPRC or XRC device. R21 device cannot have one static and one dynamic SRDF

    mirror.

    The R21 devices must be both static or both dynamic.

  • 8/6/2019 Zero Data Loss Solutions

    38/44

    38

    Mainframe Enabler 7.0 (SRDF Host Component 7.0) changes

    EMC SRDF: Zero Data Loss Solutions for Extended Distance Replication Technical Note

    Mainframe Enabler 7.0 (SRDF Host Component 7.0) changes

    With Mainframe Enabler 7.0 (SRDF Host Component 7.0), configuring acascaded SRDF or SRDF/EDP configuration is now a one-step process:Establish R1, R21 to R2 triples between primary, secondary, and tertiarysites. This is accomplished by utilizing the new composite commandsavailable in SRDF Host Component 7.0. The following commands have

    been added:

    CASCRE Creates a cascaded configuration

    CASSUSP1 Suspends pairs in a cascaded configuration Issued fromR1 only

    CASRSUM1 Resumes pairs in a cascaded configuration Issued fromR1 only

    CASDEL

    2

    Terminates all relationships in a cascaded configurationCASSWAP2 Performs SRDF personality swap on both device pairs

    1Must be used for diskless R21

    2 Requires devices to be suspended first

    The syntax for these new composite commands is as follows:

    #SC VOL,LCL(cuu,rdfgroup#1,rdfgroup#2),CASCRE(flag-list),r1dv-r1dv,r21dv,r2dv

    #SC VOL,LCL(cuu,rdfgroup#1),CASSWAP(flag-list),r1dv-r1dv

    #SC VOL,LCL(cuu,rdfgroup#1),CASDEL(flag-list),r1dv-r1dv

    #SC VOL,LCL(cuu,rdfgroup#1),CASSUSP,r1dv-r1dv

    #SC VOL,LCL(cuu,rdfgroup#1),CASRSUM,r1dv-r1dv

    For example, Host Component 7.0 now supports configuring SRDF/EDPenvironments by using the new parameters for the SRDF HostComponent SC command syntax. The following shows the syntax forcreating the SRDF/EDP volume triplets needed to establish theSRDF/EDP environment.

    SC VOL,LCL(cuu,rdfgroup#1,rdfgroup#2), CASCRE(flag-list)r1dv-r1dv,r21dv,r2dv

    Other considerations for use of the new composite commands:

    Cannot be issued from secondary site B. Default states for cascaded SRDF are sync (AB) and AD Copy

    Disk (BC).

    Default states for SRDF/EDP are sync (AB) and AD CopyWrite Pending (BC).

    Specifying ADCOPY_DISK or ADCOPY flags on CASCRE willaffect the AB leg.

  • 8/6/2019 Zero Data Loss Solutions

    39/44

    39

    Mainframe Enabler 7.0 (SRDF Host Component 7.0) changes

    EMC SRDF: Zero Data Loss Solutions for Extended Distance Replication Technical Note

    These modes are implicit for a BC link. Message Terminology: Environment 1 = AB, Environment 2

    = BCThere have been relatively few host component changes required toimplement SRDF/EDP. The SRDF commands have been updated withnew parameters to create, delete, resume, suspend and swap. All otherchanges are done within Enginuity to allow concurrent SRDF for a R2device and all associated operations that this entails.

    Requirements and dependencies

    SRDF/EDP and associated diskless devices are supported only on theSymmetrix VMAX hardware platforms with Enginuity 5874 and later.However, only the Symmetrix that contains the diskless R21 device isrequired to be Enginuity 5874. The primary and the tertiary site systems

    are required to be in a Enginuity code level 5773 or 5874. Customers arereminded that if a failover action will result in the primary or tertiary site

    being configured as a new secondary site (where diskless R21s areconfigured), then Enginuity 5874 will be required to run on those sites aswell. Please see the Current limitations and restrictions sections foradditional information.

    Current limitations and restrictions

    The following is a current list of SRDF/EDP limitations and constraints:

    The secondary site (where the R21 device resides) requiresEnginuity 5874 and SRDF Host Component 5.7.

    The primary and tertiary sites systems can run on 5773, or 5874. Symmetrix Sites A and C will require Enginuity 5x73 or later to

    support SRDF/A MSC.

    R21 devices cannot be BCV devices. R21 devices are supported only on GIGE and Fiber RAs. PPRC devices cannot be R21 devices. XRC devices cannot be R21 devices. R21 thin devices are not supported. The first hop will support all SRDF modes of operation, with the

    exception of SRDF/A if it is currently utilized on the second hop.

    The second hop will support either SRDF/A or Adaptive CopyWrite Pending Mode, with the exception of SRDF/A if it iscurrently utilized on the first hop. The second hop will notsupport SRDF/S.

  • 8/6/2019 Zero Data Loss Solutions

    40/44

    40

    Cascaded SRDF/Star support for open systems and z/OS

    EMC SRDF: Zero Data Loss Solutions for Extended Distance Replication Technical Note

    There is no mix of dynamic and static SRDF relationships forSRDF/EDP devices.

    There is no mix of SRDF/EDP R21 devices and legacy cascadedR21 devices ResourcePak Base and Host Component will continue to

    discover Symmetrix arrays that are at most an additional twohops away.

    Cascaded SRDF/Star support for open systems and z/OS

    The following sections pertaining to the cascaded SRDF/Star areincluded for introductory purposes only and are not intended to replaceEMC product specific documentation.

    For additional details on the cascaded SRDF open systems SRDF/Starinterface, refer to the EMC Solutions Enabler Symmetrix SRDF Family CLIProduct Guide.

    For additional details on the cascaded SRDF z/OS SRDF/Star interface,refer to the EMC SRDF Host Component for z/OS Product Guide (availableon Powerlink).

    Cascaded SRDF/Star introduction

    SRDF/Star is a data protection and failure recovery solution that coversthree geographically dispersed data centers in a triangular topology.SRDF/Star configures its three sites to protect business data against aprimary/workload site failure or a regional disaster, using concurrent

    SRDF capability to mirror the same production data synchronously toone remote site and asynchronously to another remote site:

    The primary site of the SRDF/Star topology is the data centerwhere the production workload is running.

    The secondary site is the sync target site usually located in thesame region as the primary site. The production data is mirroredto this site using synchronous replication.

    The async target site is a secondary site in a distant location. Theproduction data is mirrored to this site using asynchronousreplication.

    In the event of a primary site failure, there would be no data loss becauseof the synchronous replication to the sync target site. In the event of aregional disruption that made both the workload site and the sync targetsite unusable, SRDF/Star's concurrent SRDF setup ensures that there

  • 8/6/2019 Zero Data Loss Solutions

    41/44

    41

    Cascaded SRDF/Star support for open systems and z/OS

    EMC SRDF: Zero Data Loss Solutions for Extended Distance Replication Technical Note

    would be only a minimal data loss because of the asynchronousreplication to the more distant async target site.

    A major benefit of using SRDF/Star for failure recovery is that you canquickly establish communication and protection between the two remotesites, either of which can become the new primary site. SRDF/Starallows you to incrementally establish an asynchronous session betweenthe two remote sites, thus avoiding a full and time-consumingresynchronization to re-enable disaster recovery protection betweenthem. Incremental resynchronization (replicating only the datadifferences between the synchronous and asynchronous secondary sites)dramatically reduces the time required to establish remote mirroring andprotection for a new primary site following a failure of the originalprimary site.

    Another SRDF/Star benefit is that it allows the coordination of

    consistency groups to the secondary sites, meaning that devices within aconsistency group act in unison to preserve dependent-write consistencyof a database that may be distributed across multiple SRDF systems.SRDF/Star also allows you to determine which secondary site (sync orasync) has the most current data in the event of a rolling disaster thataffects the workload site. With a rolling disaster, there is no guaranteethat the sync secondary site will be more current than the asyncsecondary site. The capability to display where the most current data islocated helps determine which site's data should be used for failurerecovery.

    A cascaded SRDF/Star configuration has an SRDF/S (Synchronous)relationship between the primary site and the regionally located target

    site, and an SRDF/A (Asynchronous) relationship between the primarysite and the extended distance target site.

    The following figure illustrates, at a high level, a cascaded SRDF/Starconfiguration under normal operation with the primary site located atsite A.

  • 8/6/2019 Zero Data Loss Solutions

    42/44

    42

    CSummary and conclusionC

    EMC SRDF: Zero Data Loss Solutions for Extended Distance Replication Technical Note

    Summary and conclusion

    The Symmetrix Remote Data Facility (SRDF) family of replicationsoftware offers various levels of Symmetrix-based business continuanceand disaster recovery solutions. The SRDF products offer the capabilityto maintain multiple, host-independent, mirrored copies of data. TheSymmetrix systems can be in the same room, in different buildingswithin the same campus, or hundreds to thousands of kilometers apart.

    SRDF replicates production or primary (source) site data to a secondary(target) site transparently to users, applications, databases, and hostprocessors. The primary (R1) device is configured in a remotelymirrored relationship with a secondary (R2) device, forming an SRDFpair.

    Enginuity level 5773 is the latest Enginuity release supporting theSymmetrix Direct Matrix Architecture DMX-3 and DMX-4 storagearrays, and contains new features that provide increased storageutilization and optimization, enhanced replication capabilities, andgreater interoperability and security, as well as multiple ease-of-useimprovements.

    One such feature providing new replication capabilities is cascadedSRDF, which supports a three-site disaster recovery configuration. Thecore benefit behind a cascaded configuration is its inherent capabilityto continue replicating with minimal user intervention from thesecondary site B to a tertiary site C with SRDF/A in the event that theprimary site A becomes unusable. This enables a faster recovery at the

    tertiary site C, provided that is where the customer is looking to restarttheir operation.

    Prior to Enginuity 5773, an SRDF device could be a primary device (R1device) or a secondary device (R2 device); however it could not be in thedual role simultaneously. Cascaded SRDF is a new three-site disasterrecovery configuration where data from a primary site is synchronouslyreplicated to a secondary site B, and then asynchronously replicated to atertiary site C.

    Cascaded SRDF introduces a new SRDF R21 device. The R21 device willassume dual roles of primary (R1) and secondary (R2) device typessimultaneously. Data received by this device as a secondary canautomatically be transferred by this device as a primary (according to the

    possible modes).

    The introduction of a cascaded SRDF relationship means that thecommonly used mechanism of viewing an SRDF device as either a R1

  • 8/6/2019 Zero Data Loss Solutions

    43/44

    43

    CSummary and conclusionC

    EMC SRDF: Zero Data Loss Solutions for Extended Distance Replication Technical Note

    device or a R2 device needs to change since the R21 device serves bothpurposes. Changing the way we view an SRDF device to be context-

    based rather than device type-based will allow the customer to moreeasily understand the changes that have been made to Solutions Enabler.

    Throughout Solutions Enabler and SRDF Host Component interfaces, anR21 device may be viewed based on the relationship that is beingqueried or controlled. For example, when working with the R1->R21relationship, the R21 device will be acting and will be managed as if itwere a R2. When working with the R21-> R2 relationship, the R21 will

    be acting and will be managed as if it were an R1 device.

    When performing controls against one SRDF pair relationship, the stateof the other SRDF pair relationship will determine whether the operationwill be allowed. Controls are allowed from hosts connected to either theSymmetrix containing the R1 device, the Symmetrix containing the R21

    device, or the Symmetrix containing the R2 device.

    Similar to other advanced SRDF relationships, the modes supported foreach hop of a cascaded SRDF configuration are based upon the currentstate of the device in question and SRDF links. A basic cascaded SRDFconfiguration consists of a primary or workload site (site A) replicatingsynchronously to a secondary site (site B) with SRDF/S, and thenreplicating the same data asynchronously to a tertiary site (site C) withSRDF/A. While this configuration represents a typical or best practiceimplementation of cascaded SRDF, other SRDF mode combinations arealso valid. For example, cascaded SRDF is also supported in opensystems and z/OS SRDF/Star environments.

    SRDF/Extended Distance Protection (SRDF/EDP) is a new long distancedisaster recovery solution that is supported with Enginuity 5874.SRDF/EDP is intended to be used in a cascaded SRDF environment thatrequires a no-data-loss failover capability at the tertiary site. SRDF/EDPis based on a new type of device, a diskless device, which does notconsume any local storage. As the device has no local disk spaceallocated to store the user data, it reduces the cost of dedicating diskstorage for the purpose of remote data replication in a secondary siteSymmetrix.

  • 8/6/2019 Zero Data Loss Solutions

    44/44

    44

    CSummary and conclusionC

    EMC SRDF: Zero Data Loss Solutions for Extended Distance Replication Technical Note

    Copyright 2008, 2009, 2010 EMC Corporation. All Rights Reserved.

    EMC believes the information in this publication is accurate as of its publication date. Theinformation is subject to change without notice.

    THE INFORMATION IN THIS PUBLICATION IS PROVIDED "AS IS." EMCCORPORATION MAKES NO REPRESENTATIONS OR WARRANTIES OF ANY KINDWITH RESPECT TO THE INFORMATION IN THIS PUBLICATION, AND SPECIFICALLYDISCLAIMS IMPLIED WARRANTIES OF MERCHANTABILITY OR FITNESS FOR APARTICULAR PURPOSE.

    Use, copying, and distribution of any EMC software described in this publication requiresan applicable software license.

    For the most up-to-date listing of EMC product names, see EMC Corporation Trademarkson EMC.com.

    For the most up-to-date regulatory document for your product line, go to the TechnicalDocumentation and Advisories section on EMC Powerlink.

    All other trademarks used herein are the property of their respective owners.