Upload
voquynh
View
219
Download
1
Embed Size (px)
Citation preview
PowerHA for IBM i Solutions Portfolio
Allyn Walsh
Consulting IT Specialist
•Power Systems Strategic Initiatives
1
© Copyright IBM Corporation 2016.
Session objectives
• High Availability – General introduction
• PowerHA System Mirror for IBM i concepts
• High level comparison to Logical Replication
• 7.1 PowerHA SystemMirror for I
• 7.2 Enhancements
• PowerHA foundations
• Clusters
• IASP
• PowerHA Technologies
• Switchable IASP – single copy
• Data replication – two or more copies
• FlashCopy
• Mixing technologies
• Summary
2
© Copyright IBM Corporation 2016.
PowerHA SystemMirror
Power Systems High Availability Solution For mission critical application availability through planned and unplanned outage events
Shared Storage Clustering Technology designed for automation and minimal IT operations.
Multi-Site Clustering for enterprise class availability
Embedded for integrated simplicity and reliability
3
© Copyright IBM Corporation 2016.
PowerHA SystemMirror
� Complete IBM Power Systems integrated end to end solutions for HA DR
• Focus: 24 x 7 Application availability through planned or unplanned outage events
• Deeply integrated extension of IBM i (implemented in LIC and the OS)
� Clustering technology
• Provides the applications with a complete resiliency infrastructure
• Monitors and manages primary and secondary resources for HA and DR operations
� Storage based data resiliency
• Data resiliency is an extension of the host system storage management architecture
• Storage volumes are either switchable or mirrored between nodes in the cluster
• Hardware based replication services for Multi-Site Operations
• Host Based Replication (Geographic mirroring for IBM i, or GLVM for AIX)
• Storage Base Replication (Metro Mirror or Global Mirror)
� Overall solution characteristic
• Automation, minimal IT operations involvement
• Data between primary and secondary nodes always in sync always ready for a failover event
4
© Copyright IBM Corporation 2016.
PowerHA Business Value & Objectives
• Provide IBM i Clients With Confidence & Certainly of Outcome
• PowerHA eliminates the classic logical replication dilemmas:
• Have we identified all of the objects that need to be replicated ?
• Are all of those objects in sync ? Should we or should we not failover ?
• ROI Acquisition and Cost of Ownership
• PowerHA is priced per processor core / CBU reduces total number of licenses required
• FlashCopy (save window elimination)
• Minimize operational expense through automation
• Enable best of breed performance and HA/DR metrics
• Provide HA/DR and application performance
• Exploit and integrate modern storage technology
• Eliminate single points of failure
• Enable RPO of 0 and best case RTO
• Native Embedded Technology for HA/DR Solutions
• PowerHA technology is an integrated extension of SLIC and IBM i
5
© Copyright IBM Corporation 2016.
IBM i HA/DR Customer Profile
• Internal Disk
• Logical replication
• Role-swap = seldom if ever
• Backup window = ranges up to a few hours
• TCO = staffing, SWMA, upgrade charges,
• Staffing = dedicated specialist
• Outage management = complex
• Support = vendor
• IBM Storage or (Internal Disk with Geomirroring)
• Switchable LUNs, Metro or Global Mirroring with IBM SAN
• Role-swap = daily, weekly, monthly, quarterly
• Backup window = minutes (Flash Copy)
• TCO = minimal staffing, SWMA
• Staffing = minutes/week
• Outage management = simple
• Support = IBM
Legacy solution PowerHA
6
© Copyright IBM Corporation 2016.
PowerHA for IBM i – HA solutions for the 21st Century
PowerHA storage based HA/DR solutions are based on shared storage configurations
PowerHA Solution
� Clustering technology implemented in SLIC eliminates complexity uncertainty
� Designed for automated role swap and failover operations
� Concurrent maintenance for OS upgrades, PTF applies, hardware maintenance
� Flashcopy eliminates backup by enabling save operations concurrent to production
� Operational simplicity staffing is a fraction of what is required with software replication
� IBM service and support
Logical replication solutions
� Complexity and time required to manage software replication
� Fear of failover associated with software replication tools
� Upgrade and maintenance $$$ of software
� Tape Backup takes too long
� Staffing required to manage software replication
� Service and Support
6
7
© Copyright IBM Corporation 2016.
Who are our PowerHA for IBM i customers ?
• Over 1000 are clients with fewer than four processor cores.
• These customers typically are using PowerHA with geomirroring and internal disk
• About 20% of these are using ihosting i with geomirroring for a full system replication solution. Although the ihosting I with geomirring is classified as a disaster recovery solution, some clients prefer it because its relatively easy to set up and doesn’t require a cluster configuration where the database is separated out into an IASP.
• The customers using PowerHA with geomirroring are represented in every industry; municipalities, retail, distribution, banking, manufacturing
• The other half of the PowerHA on IBM i customers are using IBM storage servers.
• The DS8K implementations are LUG class customers who nearly always have at least two sites involved in the cluster and increasingly, three sites.
• The rest of the customers are using Storwize servers ranging from the V3700 on up to the SVC or the V9000. The V7000 has been the most popular in recent years.
• The motivation behind storage servers ranges from scalability, robustness, flash copy and the capability to support various combinations for HA and DR in a PowerHA cluster.
PowerHA for IBM I is installed in accounts ranging from small to very large enterprises. Virtually all of them (over 95% ) moved off of logical replication solutions.
8
© Copyright IBM Corporation 2016.
Scotsburn Ice Cream Company is a leading processor of branded and private label ice cream, novelties and frozen desserts throughout Canada.
Scotsburn Ice Cream Company rapidly modernizes web presence using IBM i, DB2, and PHP
The Need
Replace & modernize the company’s web presence using their existing IBM iinfrastructure.
The Solution
• 2 Power S814 Systems• IBM i 7.1• DB2 for IBM i• IBM HTTP Server• PowerHA for high availability• Zend Server V8• All content stored in DB2/IFS
The Results
• New web site created & deployed in six weeks
• Custom, user-driven content management solution.
“We hired an experienced developer, gave
him a crash course in IBM i and managing
DB2 schemas. We were able to deploy our
new web interface in six weeks. It shows
how easy it is to get a developer up,
running, and productive with IBM i.”
- Steve Pitcher, Enterprise Systems Manager,
Scotsburn Ice Cream Company
Wholesale Distribution
9
© Copyright IBM Corporation 2016.
Holy Name Medical Center provides responsive access to the growing demands of the healthcare system
The Need
� Create a customized comprehensive responsive clinical information system that meets the needs of the HNMC physicians and clinicians.
Solution
� IBM POWER 750 Server � IBM i 7.1� IBM PowerHA� Rational Developer for i, RPG CGI� HNMC WebHIS, MicroHIS (mobile users)
Holy Name Medical Center is a comprehensive, 361 bed acute care facility providing high-quality healthcare across a continuum of services
The Benefits
� Interface that is intuitive, supports mobile access, requires minimal training, high satisfaction by users
� Supports billing, document imaging, physician notes, pharmacy, QR Codes, patient dashboard & current location in clinic
� Able to respond proactively to new requests and functions, using onsite developers
� Provides the scalable, secure, available, recoverable infrastructure HNMC needs.
Healthcare
“We can do everything with IBM i. We haven’t
had to add any other systems to the solution."
Mike Skvarenina, CIO, Holy Name Medical Center
10
© Copyright IBM Corporation 2016.
Mueller, Inc. deploys a disaster recovery solution that meets their data availability requirements & let’s them sleep at night
The Need
� Update outdated recovery time and data loss requirements in response to rapid expansion to three manufacturing sites and 32 sales branches
Solution
� Power S824, 387GB SSD disk drives, Power 740
� IBM i 7.2, PowerHA’s Geographic Mirroring asynchronous replication for backup and recovery
� Oracle’s JDEdwards EnterpriseOne, OneWorld, Kronos
Mueller, Inc. is a leading manufacturer of pre-engineered metal buildings and roofing products
The Benefits
� Outage exposure reduced from days to less than an hour
� Potential for data loss reduced to minutes from 24 hours
� Solution is automated & self-managing
� Provides data replication in near real-time
� Production applications can be switched from the primary to secondary system in about 10 minutes
Manufacturing
““Our recovery time in the event of an outage has been reduced from days to less than an hour, and our potential for data loss went from a minimum of 24 hours to only a few minutes. Plus, the solution is automated and self-managing. We couldn’t be happier.”
— Evanet Gallant, Corporate IT ManagerITSG - Mueller Case Study
11
© Copyright IBM Corporation 2016.
Large Bank …some actual stats
• A recent real world example email from one of the lab services guys at a large South American bank.
• Environment: 28 cores, 560GB memory, 5.4TB SYSBAS, 38TB IASP, OS 7.1 TR9
Planned switch time (not including application shut down/start up): 14 minutes, 53 seconds
• Switch makeup:
• Vary off IASP: 6 minutes 58 seconds
• longest step: Writing changes to disk: 5 minutes 51 seconds
• Switch related processes; 3 minutes 5 seconds
• longest step: 2 minute delay to allow disks to report in before multipath reset (may be able to optimize)
• Vary on IASP: 4 minutes 50 seconds
longest step: DB xref merge: 1 minute 20 seconds (may be able to optimize)
• next longest: authority recovery: 1 minute 9 seconds (too many profiles and AUTL)
12
© Copyright IBM Corporation 2016.
PowerHA Price
PowerHA System Mirror for AIX and IBM i New price table effective March 1st 2016
TierEdition
small price/core medium price/core large price/core
standard - data center $2600 $3650 $4700
Enterprise – multi site $3400 $5250 $6800
PowerHA System Mirror for AIX and IBM i
TierEdition
small price/core medium price/core large price/core
standard - data center $2500 $3500 $4500
Enterprise – multi site $3250 $5000 $6500
License only the IBM i and PowerHA for cores needed on the target system, when using CBU. This could be as little as 1 core when using hardware based replication
13
© Copyright IBM Corporation 2016.
Small client price example with PowerHA and CBU
• Production server S814 has three cores,CBU server, S814 only needs one core.
• Since Metro or Global mirror consumes no server CBU overhead or Geomirror only a fraction of the CPW you only need one core on the CBU (unlike logical replication which can consume up to 30% or more of available CPW and those cores must be licensed )
• Production site and DR site are 400 miles apart therefore we will need async replication. Geomirroing async mode or Global Mirror costs $3250 per core.
NOTE:
Many customers in this environment typically use internal disk and therefore can not do Switchable LUNs, so we put
Geomirroring sync mode into the standard edition. In all other cases, storage replication requires the Enterprise Edition.
• The $3250 x 4 (3 from Production and 1 for CBU) = $13,000 Plus 1 IBM i license on the CBU
• The T’s & C’s of the CBU offering allow you to run with up to 4 cores of IBM i (and related STG products) to match the Production server when the workload is moved to the CBU and NOT on the Prod Server.
• $13,000 for an HA/DR solution that requires very little baby sitting
Large tier is gone
with Power 8
14
© Copyright IBM Corporation 2016.
Internal vs External Storage - considerations
• What needs to be considered to determine which type of disk storage is "right" for your IBM i environment?
• Size of data in the enterprise – isolate or consolidate?
• I/O performance
• Availability and Backup requirements
• Frequency of deploying new partitions or workloads
• Appetite for flexibility vs. complexity
• Cost
• Possible advantages of external storage
• Flashcopy to offload backups
• Elimination of hardware maintenance downtime with Live Partition Mobility
• Other virtualization technologies such as Active Memory Sharing, Suspend/Resume
• Recent announcements simplifying external storage deployment
• Storwize models – economical but still full function
• Flash Storage – V9000 or V840, or Flash systems behind a SVC or Storwize
• Native attach options
15
© Copyright IBM Corporation 2016.
For PowerHA - Who’s Doing the Replication?
IBM i
• Technologies: Synchronous and Asynchronous Geographic Mirroring
• Storage agnostic, although predominantly used with internal storage
• Source and target could be different storage types
• Ie. one side could be SAN and the other side Internal disk.
• Would allow exploiting SAN capabilities (ie. FlashCopy)
• System failure affects production workload and data replication
External Storage Server
• Technologies: Metro Mirror, Global Mirror, LUN switching, FlashCopy
• PowerHA supports specific external storage devices
• DS8K, San Volume Controller (SVC), Storwize storage servers, V840 and V9000
• Data replication independent of IBM i
• Replication overhead offloaded to external storage device
• Additional external storage functionality available, such as FlashCopy
16
© Copyright IBM Corporation 2016.
PowerHA SystemMirror IASP Replication Technologies
1 site
Shared Storage
External Storage
PROD HA
Network
External Storage
Metro Mirror
External StoragePROD HA
LUN level switching
External Storage
PROD HA/DR
Network
External Storage
Global Mirror
External Storage Replication
External Storage
PROD DR
Network
External Storage
LUN switch + Global Mirror
HA
PROD DR
Network
External Storage
Metro Global Mirror
HA
PROD HA
Network
Synchronous Geographic Mirroring
PROD HA/DR
Network
Asynchronous Geographic Mirroring
2 site Replication
2 site Replication
2 site HA + DR
IBM i replication
3 site Replication(DS8K only)
17
© Copyright IBM Corporation 2016. �17
Geographic Mirroring
• Synch
• Any storage
• Direct attached
• SAN attached
• VIOS or IBM i Hosted storage
IBM i 7.1 / 7.2 PowerHA SystemMirror for i
MetroMirror
• Synch
• DS8000
• SVC
• V7000
• V3700
• V5000
• V840/v9000
FlashCopy
• DS8000
• SVC
• V7000
• V5000
• V3700
• V840
SwitchedIASPs
• Internal or external storage
• IOA
End-to-EndSolution
NPIV and LUN Level Switching was added for SVC, Storwize and Native attach (No VIOS required in 1H 2013 – V840 and V9000 7.1 TR8 IBM i 7.2 TR2
GlobalMirror
• Asynch
• DS8000
• SVC
• V7000
• V5000
• V3700
• V840/V9000
Geographic Mirroring
• Asynch
• Any storage
• Direct, VIOS, IBM i Hosted storage
LUN Level Switching
• DS8000
• SVC
• V7000
• V5000
• V3700
• V840/V9000
Extended options for an IBM delivered, end-to-end solution for HA, DR and backups
IBM i Cluster Resource Services
DSCLI DS Command Line Interface
HA Switchable Resources - IBM i option 41 included
PowerHA SystemMirror for i(5770-HAS) – 7.1 /7.2
LabServices
ICSM
18
© Copyright IBM Corporation 2016.
IBM i Native Attach Storage and Resiliency
Internal SAS/SSD (1)
DS5000 DS8000SVC V7000, V5000 V3700 V840 V9000
Non-IBM SAN (ie EMC) (2)
POWER/7/8 POWER/7/8 POWER7/8 POWER7 or 8 POWER7/8
PowerHA SystemMirror 7.1 or 7.2
FlashCopy No No Yes Yes (3) No (Timefinder) (2)
Metro Mirror No No Yes Yes (3) No (SRDF) (2)
Global Mirror No No Yes Yes (3) No (SRDF) (2)
Switched IASP Yes Yes Yes Yes No
LUN Level Switching No No Yes (7.1) Yes No
Geographic Mirroring Yes Yes Yes Yes Yes
PowerHA SystemMirror 6.1 or 7.1 plus IASP Copy Services Manager (ICSM - formerly Advanced Copy Services (ACS))
FlashCopy No Yes Yes Yes No (Timefinder) (2)
Metro Mirror No Yes Yes Yes (3) No (SRDF) (2)
Global Mirror No Yes Yes Yes (3) No (SRDF) (2)
LUN Level Switching No No Yes (6.1) Yes (3) No
Metro/Global Mirror No No Yes No No
External Storage Full System Copy
FlashCopy No Yes Yes Yes (3) Yes (Timefinder)
Global Mirror No Yes Yes Yes (3) Yes (SRDF)
Metro Mirror No Yes Yes Yes (3) Yes (SRDF)
(1) SSD requires POWER6 or later. (2) EMC (DMX, VMAX) are not supported by PowerHA except with Geographic Mirror(3) Fabric Attach (SAN Switch) requires IBM i 7.1 TR6 + PTF’s, or Direct attach (no SAN switch – 4GB adapter only)V840 and V9000 (Flash) requires IBM i 7.1 TR8 or later (Note: 16GBs one both SVC and Storwize requires IBM i 7.1 TR10 or IBM i 7.2 TR2)Note. Native attach means the partition contains a SCSI, SAS or Fiber Channel card used to connect to the storage
For PowerHA -Storage is a key part of your HA/DR solution decision
19
© Copyright IBM Corporation 2016.
IBM i - VIOS Storage and Resiliency
PowerHA Supported
configuration options
DS5000 DS8000 XIV SVC / V7000 V5000 V3700 V840 V9000
POWER6/7/8
BladeCenter
POWER6/7/8
BladeCenter
POWER6/7/8
BladeCenter
POWER6/7/8
BladeCenter
PowerHA SystemMirror 7.1 or 7.2
FlashCopy No Yes No Yes 2
Metro Mirror No Yes No Yes 4
Global Mirror No Yes No Yes 4
Switched IASP No No No No
LUN Level Switch No Yes No Yes 3
Geo’mirroring Yes Yes Yes Yes 2
PowerHA SystemMirror 6.1, 7.1 or 7.2 plus IASP Copy Services Manager (ICSM – formerly Advanced Copy Services (ACS))
FlashCopy Yes 1 Yes No Yes
Metro Mirror Yes 1 Yes No No
Global Mirror Yes 1 Yes No No
LUN Level Switch No Yes No No
External Storage Full System Copy
FlashCopy Yes Yes Yes Yes
Metro Mirror Yes Yes Yes Yes
Global Mirror Yes Yes Yes Yes
1 Requires NPIV capable fiber channel adapter / DS5000 NPIV support requires IBM i 7.1 TR22 SVC, V7000 requires IBM i 7.1 TR3 or later (vSCSI). 3 Requires NPIV capable fiber channel and IBM i 7.1 TR6 or later 4 V5000, V3700 support added with IBM i 7.1 TR6 and V840 / V9000 with TR8 or later
20
© Copyright IBM Corporation 2016.
A PowerHA Technology for Every Storage Type
Internal
SAS/SSD DS8000
SVC
V840,V9000
Storwize
XIV DS5000
Other
Storage
Geographic Mirroring
Metro Mirror
Global Mirror
Metro Global Mirror
LUN switching
FlashCopy
HyperSwap ?
Recommend viewing IBM i POWER External Storage Support Matrix Summary – TechDoc - PRS4563 http://www-03.ibm.com/support/techdocs/atsmastr.nsf/WebIndex/PRS4563 andQuick reference - Storage options for PowerHA SystemMirror for IBM i – TechDoc - TD106243 http://www-304.ibm.com/jct03001c/support/techdocs/atsmastr.nsf/WebIndex/TD106243
21
© Copyright IBM Corporation 2016.
PowerHA and LPM Feature Comparison
PowerHA LPM
Live Partition Mobility between physical frames (IBM i 7.1 TR4) * �
Server Workload Management** �
Energy Management** �
Hardware Maintenance � �
Software Maintenance �
Automated failover upon System Failure (OS or HW) �
Automated failover upon HW failure �
Automated failover upon App failure �
*~ 2 seconds of total interruption time** Require free system resources on target system
22
© Copyright IBM Corporation 2016.
What Active Partition Mobility Isn’t
• It is not a replacement for PowerHA.
• It is not automatic.
• LPARs cannot be migrated from failed CECs (Remote/Restart)
• Failed OS’s cannot be dynamically migrated.
• It is not a Disaster Recovery Solution.
• For the same reasons as above.
• Mobility across long distances not supported.
• Additional SAN and LAN considerations to treat.
• It is not an OS update solutions
• LPM can help with server firmware updates by evacuating a server but doesn’t help with OS upgrades
23
© Copyright IBM Corporation 2016.
�23
Unix Linux Windows
Boot & OS
'C'
PGMs
'D''E'
'F'
DB
'G''H'
'I'
'J''K'
'L'
Object B Object C Object DObject A
Storage Management
IBM i
I/O
TIMI
Integrated or SAN
Storage Management Styles – IBM i Compared To...
System ASP
Page
Your IBM i solution is probably already delivering an enterprise class performance solution. Your future storage design should take this into account: for tier-1 storage, design for I/Os not capacity.
24
© Copyright IBM Corporation 2016.
PowerHA Basic Concepts
• PowerHA SystemMirror creates and manages a cluster topology
• Sysbase volume group is the OS and system based objects
• IASP volume group hosts the DB, IFS application data
• Admin Domain manages the SYSBAS data
Admin domain
Application data
(IASP)
IASP -IndependentAuxiliary Storage Pool
SYSBAS
SYSBAS
25
© Copyright IBM Corporation 2016. 25
Independent Auxiliary Storage Pool
� An IASP is:� A set of disk units which contain a collection of user objects and the necessary system data
(e.g. storage management directories, object ownership, and authorization information)
� Independent of ASP1 (SYSBASE) – This enables the IASP to be taken offline or brought online independent of system activity or other ASPs
� Provides an independent ‘Name Space’ for job and DB isolation
� Can reside on internal or external disk – or a combination of both
� Also known as – Independent Disk Pool
� Availability of the IASP is controlled through varying on / off the associated device description and “attaching” jobs / threads to the IASP
� Included in the base operating system
� IASPs can contain:� User defined file systems
� User libraries – some object types not supported
26
© Copyright IBM Corporation 2016.
iASP Benefits (vs full system replication)
� Faster switching, no IPL
� No replicating OS, microcode, temp space
� Target system is online – just switch the data
� Better recovery – just data recovery steps
� Reduced bandwidth requirement
� Integrated with clustering
� BRMS networking integration
� Improved flexibility and masking planned outages
� Much simpler, automated switch process
� Consolidate workloads using separate iASPs
� Less impact for planned outages (PTF and OS upgrades)
27
© Copyright IBM Corporation 2016.
What about Full System Replication
• Common Use: Need protection against (some) planned and unplanned outages for DR
• Less configuration (no IASPs) can be view as easier to implement
• FlashCopy may be an option
Caveats
• There is no active backup server – Target server is offline
• Does not help with reducing software maintenance outage
• Replicating OS and temporary storage (requires more bandwidth)
• Failover is a full system IPL, not just data recovery steps (IASP vary on)
• Requires External storage
28
© Copyright IBM Corporation 2016.
� Administration Domain (included in PowerHA)
– Changes on one node are propagated to others
• User profiles, System Values, Security, Key configuration data
PowerHA - Environment Resiliency Options
Synchronize non-IASP (SYSBAS)
objects across systems in the cluster
Additional Monitored Resources (6.1)• Subsystem Descriptions (*SBSD)
• Network Server Descriptions (*NWSD) of types *WINDOWSNT, *IXSVR, and *ISCSI.
• NWS Configurations (*NWSCFG)
• NWSH Device Descriptions (*NWSHDEV)
• NWS Storage Spaces (*NWSSTG)
• Tape Device Descriptions (*TAPDEV)
• Optical Device Descriptions (*OPTDEV)
• Ethernet Line Descriptions (*ETHLIN)
• Token-ring Line Descriptions (*TRNLIN)
Additional Monitored Resources (7.1)• Authorization lists (*AUTL)
• Printer Device Descriptions (*PRTDEV)
Monitored Resources (5.4)• User profiles (*USRPRF)
• Class (*CLS)
• Job description (*JOBD)
• ASP device description (*ASPDEV)
• System values (*SYSVAL)
• Network attributes (*NETA)
• Environment variables (*ENVVAR)
• TCP/IP Attributes (*TCPA)
LPAR-1 LPAR-1
IASP IASP
HA (target)PROD (source)
SYSBAS SYSBAS
30
© Copyright IBM Corporation 2016. 30
Clustering – at the heart of IBM i and PowerHA
� Cluster:
� provides the communication infrastructure between systems and/or partitions
� Facilitates the execution of cluster events
� Simplified management, single point of control
� Device Domain
� The device domain defines the cluster nodes which may share IASPs
� Each IASP is assigned an unique address space within the device domain
� Can’t allow two IASPs with the same address space to exist on the same IBM i node
OS and other
system data
OS and other
system datacluster
Production
*SYSBAS
Device domain
Application
data
IASP IASP
HA
*SYSBAS
31
© Copyright IBM Corporation 2016. 31
Cluster Resource Group
� Cluster Resource Group (CRG) � Defines which IBM i nodes are potential hosts for the IASP
� The recovery domain (list of nodes) is ordered (This determines replication direction)
� A switchable (takeover) IP address can also be defined and PowerHA will activate it on whichever node is currently primary
Cluster resource group
Production
*SYSBAS
HA
*SYSBAS
Primary 1st Backup
IASP IASP
32
© Copyright IBM Corporation 2016. 32
Copy Description and ASP Session
� Copy D
� The copy description describes one copy of the IASP
� Gives PowerHA all the information needed to access and control the IASP
� Session:
� Describes the relationship between copy descriptions
� Will determine the type of replication from a system storage perspective
� PowerHA uses the session to control the replication
Copy description
HA
*SYSBAS
Copy description
sessionIASP IASP
Production
*SYSBAS
33
© Copyright IBM Corporation 2016. 33
Administrative Domain
� Administrative Domain
- List of cluster nodes to synchronize *SYSBAS objects
- Independent of the data in the IASP
� Monitored Resource Entries (MRE’s)
- Objects in the Admin Domain being synchronized
- Specific attributes of objects being synchronized
HA
*SYSBAS
IASP IASP
Production
*SYSBAS
cluster
Admin Domain
34
© Copyright IBM Corporation 2016.
Geographic Mirroring – IBM
Synchronous or Asynchronous - long distances and DR
• Two IBM i partitions (different “sites”)
• One IASP, two copies (two sets of disks/LUNs)
• Typically for internal storage but could have SAN at one side or the other
• Replication handled at IBM i SLIC storage management level
Internal Disks *
Internal Disks *GeoMirror
IBM i
IBM iPROD Target
Mirror Copy IASP
Production Copy IASP
High Availability (HA) and Disaster Recovery (DR) solutionReplication handled at SLIC Storage Management level, as opposed to O/S and remote journalingManaged via PowerHATrue asynchronous transmission option at IBM i 7.1Requires sufficient bandwidth between sites to maintain consistent copies and avoid auto-suspend issuesRecommended to have equal quantity, capacity and type of disks at both sites to maintain consistencyReplication ports use random ephemeral (1024+) TCP ports, not specific ports
35
© Copyright IBM Corporation 2016.
• Synchronous Geographic Mirroring – Local HA
PROD (source) HA (target)
LPAR-1 LPAR-1
IASP IASP
SYSBAS SYSBAS
X X
= Main Storage
= Completed Write
• Synchronous write to target copy means the change must completed on target memory before it can complete on source
– Write at target can be synchronous or asynchronous (shown here as asynchronous)
• Very good RPO – changes are confirmed on target copy before source
• Requires local LAN like network performance: little latency, plenty of capacity
• Requires proper CPU, memory, disk planning for both source and targets to ensure performance expectations are met
X X
Your Network
IBM i Geographic Mirroring
IBM i 6.1 and up
I/O Adapter Cache I/O Adapter Cache
36
© Copyright IBM Corporation 2016.
Your Network
• Asynchronous Geographic Mirroring - long distances and DR
IBM i Geographic Mirroring IBM i 7.1 and up
PROD (source) HA (target)
LPAR-1 LPAR-1SYSBAS SYSBAS
X X
• Asynchronous write to target copy means network latency will not impact end user and job performance nearly as much as synchronous
– If the network delays writes to target copy, source storage pages wait at source
– Source memory pages will be paged out to disk, just as any other job in system
• Consumes additional source server CPU and memory compared to Synchronous Geographic Mirroring
• Available with PowerHA 7.1 and Enterprise Edition
MemoryPage Copy
= Main Storage
= Completed Write
IASP IASP
X X
I/O Adapter Cache I/O Adapter Cache
37
© Copyright IBM Corporation 2016.
HA (target)
SYSBAS
PROD (source)
SYSBAS
IBM i Geographic Mirroring
LPAR-1 LPAR-1
IASP IASP
X X
Your Network
• Limited use for on-line backups
– Detach with Tracking
• Replication from source is suspended, changes are tracked
– Requires partial resynchronization once backups are completed
• No HA or DR failovers are possible until that re-sync has completed
– Will this meet your business requirements?
– By itself, can be a viable on-line backup solution, if full time HA/DR is not required. Otherwise, consider the latest version of Save-While-Active
• On-line backups at target site
No data replication during backups
Partial resynchNo HA or DR until resync completes
Detach with tracking
38
© Copyright IBM Corporation 2016. 38
LUN Level Switching – IBM External StorageExternal Storage using Switched IASPs technology for local HA
IASP
DS8000SVC/Storwize
PROD (source)
LPAR-1
HA (target)
LPAR-2
LUN Level Switching provides local High Availability
– IASP is switched via fiber connections between partitions
• Great for masking planned outages like release or application upgrades
– Or - IASP is switched via fiber connections between servers
• Great for masking planned and unplanned outages
– Local HA solution which can be used in conjunction with:
• Metro Mirror
• Global Mirror
• FlashCopy
DS8000 with IBM i 7.1 (or IBM i 6.1 with ACS supports LUN Level Switching) IBM i 7.1 TR6 adds NPIV support or direct attach for SVC, Storwize (V7000, V5000 & V3700)IBM i 7.1 TR8 or 7.2 TR2 adds supports for V840 and V9000 Flash
39
© Copyright IBM Corporation 2016.
LUN-Level Switching
• Local High Availability (HA) solution
• Automated failover through PowerHA, at v 7.1
• Managed via PowerHA (DS8K,SVC,Storwize)
• Limited amount of disk required
• Single copy of data
• Not a Disaster Recovery (DR) Solution
• Supported on DS8000, SVC, V7000, V5000, V3700 and V840/V9000
40
© Copyright IBM Corporation 2016. 40
Copy Services
� Copy Services is a real-time remote copy technique that mirrors a primary set of logical volumes (that are being updated by applications) onto a secondary set of logical volumes.
� The secondary volumes can either be in the same or a different IBM System Storage Unit than the primary set of volumes.
� Copy Services is a hardware solution, thus it is application independent. The copy function occurs at the storage subsystem level, the application does not know of its existence.
Copy
Services
System Storage
� PowerHA
� Integrates the storage system copy services functions with IBM i clustering technology to provide an integrated solution
– Copy Services technology does the replication of the IASP
– Cluster technology monitors the health of the IBM i nodes as well as the health of the copy services replication
– PowerHA controls the direction of the replication within the storage server
41
© Copyright IBM Corporation 2016.
PowerHA - Metro Mirror
PowerHA integrates storage-based replication with IBM i clustering technology
–Synchronous replication ensures new production data is written to target first
–Excellent RPO and very good RTO
–An IASP based solution
–DS8000, SVC/Storwize/V840 and V9000
• Direct attach, VIOS using VSCSI or NPIV
–SVC, Storwize, V9000 and V840
• Requires 7.1 or later
ExternalStorage
HA
ExternalStorage
Local or campus Site
MetroMirror
Production
*SYSBAS
IASP
*SYSBAS
IASP
42
© Copyright IBM Corporation 2016. 42
Metro mirror
� Synchronous mirroring:
� Metro Mirror receives a host update to the source volume, it completes the corresponding update to the target volume.
� Guarantees data consistency by ensuring that a write operation that completes is received by the host application after the update has been committed to the target storage unit and acknowledged by both the source and target storage units.
� Metro Mirror supports a maximum distance of 300 km
� Delays in response times are proportional to the distance between the volumes. 100% of the source data is available at the recovery when the copy operation ends.
� Requires
� PowerHA SystemMirror Enterprise Edition (57xx-HAS Option 1)
� A Cluster with at least two nodes in a Device Domain
� A Device - Cluster Resource Group (CRG) with the two nodes in the Recovery Domain
� An IASP using SAN-based storage that are the preferred source volumes
� Identical number and size of SAN-based storage volumes that are the preferred target (preferably in a different storage unit than the preferred source volumes)
� Copy Descriptions for the source and target volumes
� An ASP Session managing the metro mirror relationship
43
© Copyright IBM Corporation 2016.
PowerHA Express Edition - Full System HyperSwap
� First release (7.2) provides support for DS8000 HyperSwap in full system replication environments (SVC and Storwize with firmware 7.5 in testing)
• HyperSwap by itself is a hardware availability solution
• ‘Zero’ downtime switch for storage planned and unplanned outages
• Single partition solution, although can be combined LPM
• Not a disaster recovery solution
• No protection against software planned or unplanned outages
• Once configured, HyperSwap switch will occur automatically in the case of a DS8K failure, or can be triggered manually before a planned outage
Prod
MetroMirror
SYSBAS SYSBAS
Prod
MetroMirror
SYSBAS SYSBAS
LPM 2nd
server
44
© Copyright IBM Corporation 2016.
PowerHA Enterprise (IBM i 7.2 & 7.3) - HyperSwap GA – April 2016
• IASP replication plus HyperSwap• HyperSwap for ‘zero’ downtime storage planned and unplanned outages• Live partition mobility for ‘zero’ downtime planned firmware, POWER outages• Challenge – two way replication (2 copies of Sysbase per PowerHA node) • PowerHA vary off/on of IASP for OS planned outage, disaster recovery
MetroMirror
Prod
*SYSBAS
IASP
DS8-A
IASP
DS8-B
*SYSBASHA
*SYSBAS *SYSBAS
MetroMirror
MetroMirror
Current Production environment
Storage outage
45
© Copyright IBM Corporation 2016.
Global Mirror – Asynchronous - Continuous Copy (SVC Storwize)
• Asynchronous copy; Writes sent sequentially in order
• Requires sufficient bandwidth; Size for peak I/O workload
• Better suited for fiber replication, not IP replication
• Nearly unlimited distance; Maximum 80ms round-trip
PROD BCKP
Production Copy
Mirror Copy
Global Mirror
IBM i IBM i
SVC Storwize SVC Storwize
46
© Copyright IBM Corporation 2016.
Global Mirror + Change Volumes (SVC Storwize)
• Change volumes hold point-in-time copy that are changed during cycling mode – FlashCopy is performed
• Change volumes required at both source and target site (typically thin-provisioned)
• Requires 4 “sets” of disks/LUNs (two source, two target)
PROD BCKP
Production Copy
Mirror Copy
Global Mirror
IBM i IBM i
SVC Storwize SVC Storwize
Change Volume (FlashCopy)
Change Volume (FlashCopy)
47
© Copyright IBM Corporation 2016.
Global Mirror + Change Volumes (SVC Storwize)
• Benefits
• High Availability (HA) and Disaster Recovery (DR) solution
• Replication handled at storage level, as opposed to IBM I
• Managed via PowerHA for SVC Storwize
• Does not require bandwidth to meet peaks
• Unlimited distance, up to 80ms round trip latency
• Recommended when performance is poor with metro mirror or global mirror continuous copy on SVC Storwize
• Additional disk capacity required for change volumes (auxiliary volumes)
48
© Copyright IBM Corporation 2016. 48
PowerHA DS8000 Global Mirror
Prod LPAR1
Local Site DS8000
IASP
DR Site
DR
DS8000
IASP StandardFlashcopy
ConsistencyGroup
Symmetrical – Enables reverse replication: required for role swap capability
StandardFlashcopy
ConsistencyGroup
Global Mirror
Global Mirror
– Asynchronous replication allows for long distances
– DS8000 (Direct attach or VIOS using NPIV)
�Add copy descriptions for the volumes present in the global mirror environment
� Preferred source
� Preferred target
� Target consistency group flash volumes
� Source consistency group flash volumes for symmetric global mirror
– SVC and Storwize offers two async replications technologies (standard or Change Volume)
49
© Copyright IBM Corporation 2016.
Metro-Global Mirror
• Three IBM i partitions (three “sites”)
• One IASP, three full copies, plus one additional set of disks/LUNs for Consistency Group (CG) FlashCopy
• Requires DS8000 external storage and TPC-R
IBM i IBM i IBM i
DS8800 DS8800 DS8800
MetroMirror Global Copy
PROD BCKPHA BCKPDR
Production Copy IASP
MMir Target GMir Source
PPRC Target Copy
CG Copy
50
© Copyright IBM Corporation 2016. 50
Flashcopy options
• IBM i can leverage FlashCopy to:
� Create a copy of an IASP for backup
� Create a full system copy for backup
• Recommendation is:
• Vary off the IASP or power down the system before taking the Flash
• Known as a “cold Flash” is the best way to guarantee complete data integrity
• IBM i 6.1 added support for the “Quiesce” of IASP
• Known as a “warm Flash”
• suspends transactions & operations to ensure that as much in-flight data as possible is written to disk
• Places transactions at database boundaries if possible
� Best when used with applications running commitment control
• Requires a ‘recovery vary-on’ of the IASP.
• 7.1 and later supports Quiesce with VIOS storage pools
51
© Copyright IBM Corporation 2016.
FlashCopy Multiple IASPs to Single Target
• Support added at PowerHA 7.2 for multiple source to 1 target
• Provides ability to create point-in-time “copies” of DIFFERENT production sets of data
• Eliminates scheduled outage time for production backups
• Multiple backups can be staggered back-to-back
• Limited amount of disk required – saves on disk space, sharing same target LUNs
• Can be managed through PowerHA or ICSM
• Single target partition has only one “copy” at a time
• Multiple partitions involved
52
© Copyright IBM Corporation 2016.
IBM I 7.2 with PowerHA - IASP assignment
Enables use of one partition to save multiple production environments
Allows attachment of an IASP to a partition not in the cluster device domain
Only one IASP can be attached to the partition at a time
Eliminate dedicated flash partitions per cluster
Universal FlashCopy target node
Save LPAR
*SYSBAS
Tape Backup
FlashCopy targets
IASP Production cluster 1
IASP Production cluster 2
IASP Production cluster 3
53
© Copyright IBM Corporation 2016. �53
PowerHA SystemMirror – combining Technologies
Example: LUN Level Switching on DS8000 or SVC/Storwize, plus remote replication for a second copy of the data at DR location. LPM is possible with VIOS, can evacuate a node for server maintenance/hardware changes etc,
DR (target)
LPAR-4
DS8000SVC/Storwize
IASP
IASP
Metro or Global Mirror
Or GeoMirror
Remote HA or DR – On-line backups
PROD (source)
IASP
DS8000SVC/Storwize
FlashCopy
BU - LPAR-2
On-line backups
PRODLPAR-1
VIOS LPAR1
LUN Level Switching – Local HA (for planned or unplanned) or LPM for work load balancing or planned server maintenance.
Local HALPAR-3 VIOS LPAR3
VIOS LPAR2
FlashCopy
BU - LPAR-5
Local HA &
Server A
Server B
Server C
PRODLPAR-1
LPM LUN level Switching
54
© Copyright IBM Corporation 2016.
Summary
- Single-site solutions can provide some High Availability (HA) and may save $$, but cannot provide Disaster Recovery (DR)
- Consider internal vs external storage (and what type of external storage), depending on which solution you choose
- Consider connectivity options (Direct-attached, SAN-attached, VIOS, vSCSI, N-PIV) and number of host connections, when deciding which solutions can or cannot be implemented
- Consider the amount of disk needed for multiple copies (Mirror Copy LUNs, FlashCopy LUNs, Consistency Group LUNs, Change Volume LUNs)
- Consider BANDWIDTH requirements between sites to ensure efficient delivery of packets on mirroring solutions
55
© Copyright IBM Corporation 2016.
Publications and Links (1 of 2)
• PowerHA Wiki
• www.ibm.com/developerworks/ibmi/ha/
• IBM PowerHA SystemMirror for i - Performance Information
• http://ibmurl.hursley.ibm.com/35XN
• PowerHA solutions
• www.ibm.com/systems/power/software/availability
Redbooks at www.redbooks.ibm.com
• PowerHA SystemMirror for IBM i Cookbook - SG24-7994-00 (Feb 2012)
• Implementing PowerHA for IBM i - SG24-7405-00 (Nov 2008)
• IBM i 6.1 Independent ASPs: A Guide to Quick Implementation of Independent ASPs -SG24-7811
• Implementing SAP Applications on the IBM System i with IBM i5/OS - SG24-7166
Publications
• Implementing high availability
• http://publib.boulder.ibm.com/infocenter/iseries/v7r1m0/topic/rzaig/rzaig.pdf
• Resiliency on Power Systems
• www-03.ibm.com/systems/p/hardware/whitepapers/power6_availability.html
• IBM i Virtualization and Open Storage Read-me First
• http://www-03.ibm.com/systems/resources/systems_i_Virtualization_Open_Storage.pdf
56
© Copyright IBM Corporation 2016.
Publications and Links (2 of 2)
PowerHA System Mirror for IBM i – Data Sheet
• http://public.dhe.ibm.com/common/ssi/ecm/en/pod03024usen/POD03024USEN.PDF
Impact and Cost of Downtime Tools
• IBM: http://www-935.ibm.com/services/us/bcrs/self-assessment/
• GIAC BIA overview: www.giac.org/resources/whitepaper/planning/122.php
Advanced Copy Services for PowerHA
• http://www-03.ibm.com/systems/resources/systems_services_labservices_stgls_advcpysvc_powerha_10.pdf
• http://www.ibm.com/systems/services/labservices
• Email: [email protected]
Business impact analysis (service)
• www-935.ibm.com/services/us/index.wss/offering/bcrs/a1000260
IBM Risk Assessment Tool
– www-935.ibm.com/services/us/gts/managing_risk/self_assessment/index.html