32
IBM Global Technology Services October 2009 Storage migrations made simple Overcoming the challenges of technology refresh

Storage migrations made simple

Embed Size (px)

DESCRIPTION

Minimizing the impact of data migrations on business operations is a criticalpart of the data center manager’s job. Studies have shown that technologyrefresh is the primary driver of data migration. Storage hardware and serverreplacement, as well as the expiration of storage equipment leases, means thatstorage managers have to move data on a regular basis. Moving data for tech-nology refresh can be problematic, however, due to application availabilityrequirements, incompatibilities between source and target systems, and timeand budget constraints. While technology refresh projects are typically sched-uled to be performed during off-hours, today’s around-the-clock environmentmeans that applications need to stay online, even during off-hours.

Citation preview

  • 1. IBM Global Technology ServicesOctober 2009 Storage migrations made simple Overcoming the challenges of technology refresh

2. Storage migrations made simplePage 2Executive summaryContentsMinimizing the impact of data migrations on business operations is a criticalpart of the data center managers job. Studies have shown that technology2 Executive summaryrefresh is the primary driver of data migration. Storage hardware and server4 Introduction to datamigration replacement, as well as the expiration of storage equipment leases, means that6 Data migration software storage managers have to move data on a regular basis. Moving data for tech- 10 Technology refreshnology refresh can be problematic, however, due to application availabilityexamplesrequirements, incompatibilities between source and target systems, and time 30 Summaryand budget constraints. While technology refresh projects are typically sched-uled to be performed during off-hours, todays around-the-clock environmentmeans that applications need to stay online, even during off-hours.New software allows nondisruptive migration, meaning that applicationsremain online during migration, without signicant performance delays. Andreliable methodologies that help assess, plan, move and validate data migra-tions can enable customization, speed the process and help provide dataintegritysimplifying the technology refresh process. 3. Storage migrations made simplePage 3The following table presents ve key factors that show how data migration Highlights software can simplify technology refresh and how IBM Softek TransparentData Migration Facility (IBM TDMF) technology can meet these needs.Technology refresh is the primarydriver of data migration.Key factors DescriptionSoftek TDMF capabilityPerformance Performance measurements TDMF software includes amust take into consideration throttling or pacing capabilityhow quickly data is copied that can speed up or slowfrom the source to targetdown data movementand balanced against net-depending on systemwork bandwidth and systemdemands in order to easilyoverhead.balance migration.Roll-back capabilityIf something goes wrong, Roll back can easily bethe migration can be termi-accomplished with TDMFnated and restarted, orsoftware, although it can beapplication processing can problematic with some othercontinue on the source datatechnologies, such as vol-or device. ume managers.Increase in volume size Many migrations involve an TDMF software can accom-increase in volume size from modate an increase in vol-the source to the target.ume size.Heterogeneous sourceWhile host-based productsTDMF software is hardwareand target hardware support unlike storage independent.devices, most array-basedproducts require that thesource and target comefrom the same vendor.Application downtimeApplications have differentTDMF software allows forlevels of business criticality nondisruptive data migrationand therefore have varying so applications can staydegrees of acceptableonline and continue todowntime.process data throughout the migration process. 4. Storage migrations made simplePage 4Introduction to data migration HighlightsWhat drives data migration? Technology refresh, dened as replacing an arraywith a new one, is the major reason for moving data and most commonlyoccurs when: The lease on a piece of storage equipment ends. Data is being moved from old to new storage. The storage system is being upgraded. The organization has decided to standardize on a particular technology.Typically, most data centers lease their storage hardware under three-yearagreements. Once the agreement ends, the hardware needs to be replaced andthe data stored on it moved to new equipment. Data migration must be com-pleted before the lease expires to avoid additional monthly lease costs. Incases in which storage hardware is purchased rather than leased, older arraysthat are fully depreciated can be expensive to maintain. Once again, purchaseand implementation of new equipment requires migrating data from theolder arrays.IT organizations justify purchase or lease of new equipment by the fact that itis less expensive to maintain, performs better and supports advanced features.IT organizations justify new equip- New arrays can support larger capacities to accommodate the growth of appli-ment because it can accommodate cations; have faster processing chips to deliver better performance; or havegrowth, process more quickly to new features such as snapshot copies. Finally, newer arrays are justied todeliver better performance andminimize the risk of hardware malfunction, as older arrays are perceived asminimize the risk of hardware being less reliable.malfunction. 5. Storage migrations made simplePage 5In many cases, technology refresh means not only replacing storage arrays, but Highlights also upgrading associated servers to better meet service level agreements orbecause the servers, like the arrays, have reached the end of their lease. Inaddition, storage and server capacity are acquired annually or more often toFor most industries, estimates of accommodate data and application growth. Estimates of data growth vary, butdata growth typically range fromthey typically range from 25 to 50 percent annually for most industries.25 to 50 percent annually.So every year, a typical organization acquires storage technology to replacearrays on which lease or maintenance agreements are expiring, as well asadditional capacity to accommodate anticipated growth. Thus, the IT organi-zation must move data between servers and storage for technology refresh ona very regular basis. The storage mantra is: You have data, therefore you willmove it. Total on Floor (TB)New (TB) Replaced (TB)Purchased (TB)Example annual migration requirements 6. Storage migrations made simplePage 6 IT organizations face many challenges associated with technology refresh Highlightsparticularly deciding how to deal with data growth and determining how, when and where to move data. Some of the key issues associated with tech-It is an ongoing challenge to decide nology refresh include:how to deal with data growth and Lease overlap costs or duplicate maintenance costs, when old and newto determine how, when and where equipment are on the data center oor at the same timeto move data. Migration of data between arrays from different vendors, as there may be signicant incompatibilities Risk of data loss or corruption that may occur if the migration is not done properly Prolonged application downtime, or even an inability to restart applications This paper focuses on how organizations can meet these challenges by lever- aging data migration software. Data migration software Depending on the criticality of applications, the quantity of data to be moved and allowable downtime, there are a variety of tools that organizations can use to migrate data, each with its own considerations and limitations.Organizations can meet these chal- Offline migration methodslenges by leveraging various types Offline migration methods require that applications be taken offline duringof data migration software.data movement, and therefore they are suitable only when signicant down- time can be tolerated. While the amount of downtime required typically depends on the quantity of data being transferred, this offline migration mechanism is not recommended for heavily used applications or those that must be accessible outside of normal business hours. Offline migration typi- cally requires manual manipulation of data or les, which can increase the risk of human error and may not scale to distributed or remote scenarios. 7. Storage migrations made simplePage 7Restore from backup tapes Highlights This method involves making a backup copy of data, then taking the associ-ated arrays or servers offline to ensure that no new data is added. Then theOffline migration methods include data is restored from the backup tapes to the new arrays or servers. Oncerestore from backup tapes and FTP the restore process is complete, the systems are brought online. Whiletransfer. this is a low-cost solution, especially as nearly all organizations already usebackup software, it requires signicant administrative attention and applica-tion downtime.FTP transferThis method involves manually copying les from the source systems to thetarget systems via File Transfer Protocol (FTP). Because it requires le-by-lemovement, this method is not recommended when the data contains largenumbers of individual les. FTP transfer does not provide control over thenetwork bandwidth used for migration, which can affect other applicationsand users in the network environment, nor does it enable verication of thecomplete transfer of data.Online migration methodsOnline migration methods generally allow data movement while applicationsare up and running. Depending on the method chosen, however, these meth-Online migration methods includeods can be limited to a single vendor environment. Other methods may con-array-based replication, volume sume signicant processor overhead, potentially resulting in applicationmanagement or replication and slowdown or other disruptions.host-based mirroring.Array-based replicationWhile this method allows for high service level guarantees, it requires movingbetween similar storage devices, increasing costs and limiting the data centerto a single vendor. 8. Storage migrations made simplePage 8 Volume management or replication HighlightsVolume management is used primarily to control disk resources by mapping the logical view of storage space with the actual physical disks. While it can be used to move small amounts of data, it can be slow. This solution requires a heterogeneous storage environment over an IP network and may require the costly installation of additional software. Host-based mirroring Host-based mirroring or replication solutions generally focus on le-by-le data movement to create a secondary data copy for disaster recovery purposes. When used for data migration, this approach may put an additional burden on application servers and may require high-cost management, especially in het- erogeneous environments. Online nondisruptive migrationSoftek data migration products There are a few products available in the marketplace today that were designed to provide nondisruptive data migrationmeaning that data move-Softek TDMF software helps makement occurs without causing application outages or slowdowns. Softek datait easier to upgrade to new storage, migration software is the proven standard for online, heterogeneous dataimprove application performancemovement, meeting the challenges of application availability and technicaland manage information availabilitycompatibility between source and target storage. Softek TDMF software movesthrough the information lifecycle. data while maintaining application availability, making it easier to upgrade to new storage, improve application performance and manage information avail- ability through the information lifecycle. So whether the organization needs to upgrade to new storage hardware (from any vendor to any vendor) or needs a more effective way to migrate data based on cost and performance, TDMF software can provide the solution. Together with Softek z/OS Data Mobility Facility (zDMF) software for moving mainframe data at the dataset level, Softek TDMF technology provides the solution to meet a wide range of tech- nology refresh and other data migration needs. 9. Storage migrations made simplePage 9An examination of real-world scenarios can demonstrate how Softek data Highlights migration products are used to simplify technology refresh:A discussion of real-world imple- A manufacturing company running a mission-critical Oracle customermentations can illustrate how order and tracking system on Solaris conducting local UNIX array-to-Softek technology simplies tech- array migrationnology refresh. A large bank running a credit and debit transaction application onIBM z/OS conducting local mainframe array-to-array migration A major savings and loan institution running an IBM DB2,IBM CICS and Virtual Storage Access Method (VSAM) application withhigh-availability requirements conducting mainframe migration with vol-ume consolidation A Fortune 500 nancial services rm running a mission-critical DB2data warehouse conducting multiserver UNIX array-to-array migrationwith consolidation A Fortune 1000 bank running a Sybase nancial application conducting aglobal migration to new storage over distance An insurance company with a mission-critical claims processingapplication on Oracle conducting a global migration to new servers andnew storage A Fortune 500 bank running a key enterprise compliance managementapplication conducting a local Microsoft Windows array-to-array migration 10. Storage migrations made simplePage 10 Technology refresh examples Highlights The detailed descriptions of the scenarios that follow show how Softek capabilities can meet technology refresh needs and streamline technology refresh projects.Softek software capabilities can Local UNIX array-to-array migrationmeet technology refresh needsIn this example, a manufacturing company running a mission-critical Oracleand streamline technology refreshcustomer order and tracking system on Solaris needed to move three terabytesprojects.(TB) of legacy data from an old storage array to a new storage array. The challenges that the company faced were as follows:In the rst example, Softek soft- Limited downtime Downtime was limited to four hours on the weekend.ware helped a manufacturing com- Large volume of data Application storage spanned 10 300 GB volumes.pany move 3TB of legacy data from Increase in volume size The planned capacity growth required anan old storage array to a new one, increase in volume size during migration.without signicant downtime. The company considered the pros and cons of several different migration options, including: Restore from backup tapes This option would have required more than four hours to copy the data, exceeding application downtime restrictions. Sun Solstice Volume Manager This would not support the increase in volume size. Array-based replication This option would have been expensive to install, and the company did not plan to use it following the migration. In addition, rmware upgrades required on the legacy arrays to support the current array-based replication version would have added downtime and complexity to the project. Semantic Veritas Volume Replicator (VVR) This option would have required installing the prerequisite Veritas Volume Manager. 11. Storage migrations made simplePage 11Softek TDMF technology was chosen because the asynchronous, host-basedHighlightsmigration was cost-effective, able to work with disparate platforms, did notrequire changes to the source environment and could accommodate theincreased volume size in the target environment. The benets of the TDMFsolution were that the Oracle applications storage volumes were augmented,enabling continued expansion of capacity. In addition, the migration was com-pleted without signicant downtime to this mission-critical application. Mostimportant, the storage technology upgrade was transparent to the applicationsend users.Most important, the storage tech- Softek solution: Local UNIX array-to-array migration with Softek TDMF solutionnology upgrade was transparent1. Softek TDMF technology was installed on the host prior to the weeklyto users.scheduled downtime and congured to map the source and target devices. A script was written to unmount and remount the source devices during the weekend outage. The script was run just after the weekly backups and took less than 30 seconds to run, so the scheduled down- time was not affected.2. The TDMF solution started the copy operation once applications are back online. Copy ran slowly in background so as not to signicantly affect the operation of the application.3. All volumes were synchronized within 48 hours.4. Switchover was performed without service outage. Old volumes were left in place while performance of new volumes was validated.5. Old volumes were removed from conguration.6. TDMF software was left on the system and used to move two volumes nondisruptively within the new storage array to resolve performance problems caused by pathing issues in the new hardware. 12. Storage migrations made simplePage 12 Solaris Server running Oracle Highlights applicationLegacy 15 minutes downtime15 minutes downtimeOlder arrays installedNew Arrays installed 48 hours Local UNIX array-to-array migration Local mainframe array-to-array migration In this scenario, a large Canadian bank running a credit and debit transaction application on the IBM z/OS platform was moving from legacy storage to newer storage arrays.A nancial institution cannot afford The challenges the bank faced included the following:downtime when moving from No application downtime allowedThe application was a key revenuelegacy storage to newer storage driver, requiring around-the-clock access. The projected 18 hours of down-arrays. time to install and congure new arrays and complete migration would violate corporate IT policy and cost thousands of dollars in lost revenue. Large number of volumesFour hundred volumes had to be moved from the old to new storage array. Budget constraintsThe migration budget did not include the anticipated need for outside consulting resources with migration expertise. 13. Storage migrations made simplePage 13In this case, Softek TDMF technology was the only option considered, Highlights because no other solution could accomplish the migration withoutrequiring downtime.In the case of a large bank migrat- Using the Softek TDMF solution, the banks migration project wasing to new storage arrays, Softek completed on schedule and required no outside resources so the budgetTDMF was the only option consid-was not affected. And because no application performance impact or outagesered because no other solutionwere experienced, the bank could continue to generate revenue duringcould perform the migration with- the migration.out requiring downtime.Softek solution: Local mainframe array-to-array migration1. Softek TDMF software was installed nondisruptively on the host.2. Storage administrators, without formal training, used examples in the Softek manual to perform TDMF initialization, activation and copy tasks.3. In the rst week, administrators migrated 50 percent of volumes to target storage arrays with no performance degradation. Migration took place during peak periods of activity because Softek TDMF software has a dynamic throttling capability that speeds up or slows down migration as application requirements change.4. Refreshes were performed periodically so that updates made to source volume during the copy phase were made to target volume, ensuring synchronization between source and target.5. Administrators migrated the nal 50 percent of volumes over the second week, with still no application impact.6. When nal synchronization had taken place, Softek TDMF software completed the swap operation to redirect the mainframe I/O to target volumes, which became primary volumes. Switchover was performed without service outage. 14. Storage migrations made simplePage 147.Backout option was available in case a failure occurs during any phase. If Highlights needed, original source volume contained all the write operations per-formed during the migration.8.Old volumes were removed from conguration. Credit and debit transaction applicationThis chart depicts the banks localIBM mainframemainframe array-to-array migration.Old storage arrayNew storage arrayLocal mainframe array-to-array migration 15. Storage migrations made simplePage 15 Local mainframe migration with volume consolidation HighlightsA major savings and loan institution had an older locally attached storage array under strain that it was replacing with a new locally attached storage array. The institution was running DB2 and CICS VSAM applications with very high availability requirements. The key migration challenges were as follows:A savings and loan company faced Converting data between volume sizesThe project required movingmigration challenges such as per-MOD 3 arrays onto MOD 3s, and MOD 3 arrays onto MOD 9s at bothsonnel constraints and strict avail- volume and dataset levels.ability requirements. Limited downtimeThe only permitted system downtime was Sunday mornings. Personnel constraintsThere were limited personnel available to perform the migration. Complex projectDue to the complexity of the migration and the personnel constraints, the estimated duration of the project was at least two weeks. The savings and loan company evaluated several migration options: Manual methodsThis option was considered too labor intensive, espe- cially with the overworked and understaffed customer resource base. Avoiding bandwidth impacts also would be difficult. Array-based replicationThis option could not be used as the project involved migrating MOD 3s to MOD 9s. 16. Storage migrations made simplePage 16 A combination of Softek TDMF and zDMF software was chosen because ofHighlights the products ability to migrate data nondisruptively, handle the resizing of MODs, and move specic data at the dataset level. With the combination of TDMF and zDMF, the project was completed ahead of schedule (60 hoursAfter evaluating several migration estimated, 55 hours actual), with data migration constituting 38 hours of themethods, a savings and loan com- total time. This was considerably shorter than anticipated, and the migrationpany chose Softek TDMF and zDMFwas performed while the mainframe was in production, with no impact tosoftware due to their ability to end users.migrate data nondisruptively, resize Softek solution: Local mainframe migration with volume consolidationMODs and move specic data at 1. TDMF and zDMF software was nondisruptively installed on IBM Z800the dataset level.mainframe and veried by the implementation team. 2. The team mapped source and target volume migration for TDMF migra-tion. As part of the process, TDMF software was used to migrate a singlesource MOD 3 to a MOD 9, thereby establishing the target MOD 9 intothe existing storage management subsystem (SMS) environment andeliminating any SMS setup requirements for the new MOD 9 volumes. 3. The team mapped the remaining MOD 3 to MOD 9 migration, whichwas accomplished using Softek zDMF software. The mapping docu-mented the target-volume SMS storage groups and storage class. Thisalso identied any volumes that were not under SMS control. 4. Softek TDMF migration was initiated. Over the course of 10 hours(including verication), the implementation team migrated200 MOD 3 to 200 MOD 3 and 240 MOD 3 to 240 MOD 9. Thisentire migration was completed transparently during production hours. 5. The implementation team set up Softek zDMF migration by buildingsource and target dataset migration groups (460 source volumes going to240 target volumes at the dataset level). 17. Storage migrations made simplePage 17 6.Softek zDMF migration was executed over a 28-hour period (submission Highlightsof group migrations, monitoring progress and verication results) and no application impact was reported during this period. 7.Scheduled off-hours bounce of all database applications took place after migration, and the total duration of the outage for all applications was less than one hour.DB2 and CICS VSAM applications IBM Z800This chart depicts the array-to-240 MOD3 to 240 MOD9array migration with consolidationenabled by the Softek software.240 MOD3 to 240 MOD9460 source volumes to 240 targetvolumes at dataset levelOlder arrays New arrays Local array-to-array migration with consolidation 18. Storage migrations made simplePage 18Multiserver UNIX array-to-array migration with consolidation Highlights A Fortune 500 nancial services rm had a mission-critical DB2 datawarehouse (24 terabyte (TB) DB2, 10TB supporting les) on sevenIBM AIX 5.1 server platforms with the storage allocated to nine differentstorage arrays, some more than ve years old.The rm faced these key migration challenges: Storage growthStorage capacity grew from 4TB to 30TB in three years,A nancial services rm struggled with storage added in a demand-driven, rather than a planned, fashion.with excessive storage growth and Locating storageStorage administrators were unable to preciselyother related challenges. locate storage. Complex environmentThe system could be upgraded or changedonly with difficulty, resulting in numerous end-user complaints aboutsystem performance. Relocating dataA new storage array was purchased to improve perform-ance by migrating and reconguring volumes. Source and target incompatibilitiesThe rm was unable to performmigration due to the complexity of the environment; this created incom-patibilities between the source and target storage arrays, so the new arraysat unused for two months on the data center oor.The rm evaluated several different migration options: Offline backup and restore from tapeThis option was rejected due totime constraints. Operating system synchronization toolsThis option was rejected due tothe inability to control migration start and end times. Array-based replicationThis was not an option because of the incompati-bilities between source and target storage. AIX server-native Logical Volume Manager mirroringThis wasrejected because Volume Manager was too slow and was not conguredfor mirroring. 19. Storage migrations made simplePage 19Softek TDMF UNIX (IP) software was chosen based on its ability to migrate Highlights between disparate platforms and its exibility in working with various logicaldenitions. The benet of the TDMF solution is that the data migration couldA Fortune 500 nancial services be performed in a challenging environment well within scheduled windows.rm chose Softek TDMF UNIX (IP) The rm was nally able to take advantage of its new hardware, whichsoftware for its migration based on enabled it to run queries four times more quickly with the new array, improveits ability to migrate between dis- data layout and greatly simplify administration. Most important, end-userparate platforms and its exibility complaints about performance were eliminated almost entirely. In addition,in working with various logical the rm was no longer paying lease charges for unused or outdated hardware.denitions. The Softek implementation methodology helped avoid manual errors andused onsite resources efficiently.Softek solution: Multiserver UNIX array-to-array migration with consolidation1. In the premigration stage, Softek worked with the storage vendor to per- form comprehensive testing and proof of concept to prove the viability ofThe Softek implementationthe migration strategy. The rm elected to perform migration over sched-methodology helped avoid manualuled weekend downtime, with an estimated 24 hours for total migration.errors and used onsite resources2. In the migration stage, the migration team was given the system atefficiently. 8 p.m. on Saturday night; it installed Softek TDMF software on seven AIX hosts in less than 15 minutes.3. The migration process was initiated with migration conguration in loop- back. The actual migration started at 12 a.m. and ended at 4 a.m., mov- ing 22 TB of data in four hours.4. As part of the migration process, the implementation team resized physi- cal partitions on volume groups, improved the layout of the volumes on the new array, and resized the IBM journaled le system (JFS) logs. 20. Storage migrations made simplePage 20 5.The system was handed back at 3 p.m. on Sunday, well ahead of sched- ule, for preliminary testing. The DB2 data warehouse started correctly and the verication script launched. 6.The rm performed extensive testing, and at the end of the scheduled application stoppage, the system went into full production. 7.At the next scheduled downtime, the old source arrays were taken out of service and sent back to the leaseholder.DB2 data warehouseAIX 5.1 servers 4 hours22TB New array Old arrays Multiserver migration with consolidation 21. Storage migrations made simplePage 21 Global migration to new storage over distance HighlightsA Fortune 1000 bank running a Sybase nancial application was relocating four servers from a New Jersey operations center to a New York City opera-A bank needed help relocating four tions center, changing out the legacy storage arrays to newer arrays.servers to another state. The banks key migration challenges were as follows: Increased storage demands and internal consolidationThese factors drove the technology refresh. Expiration of storage leaseThe New Jersey storage needed to be returned to the leaseholder. Hardware movePhysical servers had to be moved via courier. Data move over distanceData had to be moved from the New Jersey stor- age area network (SAN) to the New York City SAN. Limited downtimeThe only allowable outage was from Friday night to Saturday morning. The bank reviewed several migration options: Offline migrationRestore from tape after physically moving the servers was possible but would have required complete shutdown of application servers over a 48-hour period. Availability requirements made this option impossible. FTP transferThe lack of bandwidth control, inability to verify the com- plete transfer of data and the requirement for le-by-le movement prompted the rejection of this option. VERITAS Volume ReplicatorThis option required the installation of VERITAS Volume Manager on the source and target machines. Hardware-based mirroringThis option was not possible because the source and target arrays were dissimilar. 22. Storage migrations made simplePage 22Softeks TDMF UNIX (IP) software was chosen for its ability to work with Highlights multiple operating systems and perform fast, controllable transfers.A Fortune 1000 bank chose SoftekThe migration allowed the bank to realize economies of scale and increaseTDMF UNIX (IP) software for its administrative control. In addition, the increased storage capacity allowed themigration based on its ability to bank to more fully utilize the Sybase application in support of key operations.work with multiple operating sys-Softek solution: Global migration to new storage over distancetems and perform fast transfers.1. In the target environment, all new storage was dened, with the bank opting to use swing server to perform the migration. Data for the New Jersey servers was allocated to the swing server, which served as a proxy during the migration.2. At 5 p.m. on Friday, the applications were taken offline and Softek TDMF was installed on the New Jersey servers.3. Migration was set up from the four servers to one target and was initi- ated. The complete, full refresh took two hours and involved moving 2.2 TB over the banks wide area network (WAN). Upon completion, the Softek TDMF solution maintained synchronization between source and target environment.4. The migration was completed and verication testing was performed on data.5. The New Jersey servers were shut down, physically moved to New York City and installed at the banks site.6. In the target environment, the storage was rezoned from the swing server to the relocated servers. 23. Storage migrations made simplePage 237.The servers were brought up and tested, and applications were brought Highlights up and tested. At 6 a.m. Saturday, the application was put backinto production.8.At the next scheduled outage, the New Jersey storage array was takenoffline and removed for return to leaseholder. Sybase applicationsNew JerseyNew YorkTarget environmentThe Softek solution enabled aSwing Serverrapid, security-rich migration fromthe source to the target.Old array New arrayGlobal migration to new storage over distance 24. Storage migrations made simplePage 24Global migration to new servers and new storageHighlightsAn insurance company was running a mission-critical claims processing appli-cation on Oracle. It was upgrading from legacy servers running Solaris 8 andAn insurance company neededVeritas Filesystem/Solstice Disksuite to new servers running Solaris 9 andhelp to maintain availability whileVeritas Volume Manager. Six TB (allocated 2TB per server) on an older diskmigrating a mission-critical claimsarray were being replaced by a new array.processing application.The insurance company faced these key migration challenges: Limited downtimeOnly four hours downtime per week were permitted forany application. Hardware move constraintsOnly one server could be moved at a time toavoid risk to the application infrastructure. Compatibility of new storage with legacy serversThere were insufficientconnections available to directly attach new storage to legacy servers, andit was risky to install new device drivers on legacy servers.The migration options that were considered included the following: Offline migrationThis would have resulted in multiple downtimeinstances, each exceeding 12 hours. Array-based replicationThis option could not be used due to dissimilarlegacy and target storage, and because disk subsystems were incompatible. Veritas Volume ReplicatorThis option would have required the installa-tion of Veritas Volume Manager on source servers. Fabric-based appliance replicationThis was rejected because of the riskof reconguring the SAN. EMC Recovery PointThis was rejected due to the requirement that mir-rors be set up and created on the host system. Such an arrangement wasunacceptable given the changes involved and the associated disruption. 25. Storage migrations made simplePage 25 Softek TDMF UNIX (IP) software was chosen as the least risky optionHighlights because no system reboots were required. The migration was performed with- out requiring a reboot of any critical service, continuous application availabil-An insurance company chose ity was maintained during data migration, and the migration was performedSoftek TDMF UNIX (IP) software without end users experiencing any loss or signicant degradation in service.because it was the least riskyoption, requiring no reboots.Softek solution: Global migration to new servers and new storage 1. In the initial phase, congurations were pre-created and user-customizable scripts were written to unmount, replace the vfstab leand remount le systems. 2. Softek TDMF software was installed just prior to weekly shutdown withno disruption. Each server is congured in turn, with a total elapsed timeof 15 minutes for TDMF installation and conguration. 3. A full refresh from source server A to target server A was conducted overthe course of a week. Big asynchronous buffer (BAB) absorbed peaks inNot only did the migration notwrite activity on legacy servers to minimize CPU usage and prevent highrequire a reboot of any critical serv-I/O load.ice, but it also provided continuous 4. New versions of Oracle and other software preinstalled on target server Aapplication availability and no were tested. Testing involved receiving multiple application-consistentloss or degradation of service forversions of production disks on a daily basis. To avoid having to refreshend users.from the production disks every time, checkpoint and a chaining cong-uration were used. 5. At the completion of the testing, journal wrote to target volumes toensure minimal data transfer on resynchronization. 26. Storage migrations made simplePage 266. During the next weekends outage, applications on target server A wereHighlights brought up and pointed to the new storage volumes. Source server A was taken out of service.7. The process was repeated for source servers B and C over the next two weeks.8. During the next scheduled outage, the older storage array was taken out of service.Oracle applications Source Target environmentenvironmentSource Source Server C Server BCheckpointThis chart shows how the insur-SourceTarget Server AServer Aance companys global migrationwas executed. Journal checkpoint area Old arrayNew arraysGlobal migration to new servers and storage 27. Storage migrations made simplePage 27 Local Windows array-to-array migration A Fortune 500 bank had 5.8TB of data on two servers for a key enterprise compliance management application based on Microsoft SQL. The bank wanted to move from an older locally attached storage array to a new locally attached storage array. The key migration challenges were as follows: Adding new storageThe goal was to free up existing storage and imple- ment new faster, cheaper storage. Limited downtimeThe application had a limited downtime window from 12 a.m. to 6 a.m. Saturday morning and from 12 a.m. to 2 a.m. Tuesday morningbut it was estimated that the full migration would take a week. Reconguration of a large number of volumesThere were 30 volumes to be moved, creating potential conguration issues. The bank considered these options: Restore from tape backupsThis was not possible due to application avail- ability requirements. EMC Open MigratorThis was initially selected but failed during an early migration test. File-level migration and replicationThis was considered but found to be too expensive and difficult to congure for users lacking expert-level implementation experience. 28. Storage migrations made simplePage 28Softek TDMF Windows (IP) software was chosen because of its ease of use,Highlightsprice and ability to maintain continuous application availability duringdata migration.A Fortune 500 bank chose SoftekTDMF Windows (IP) software for itsSoftek solution: Local Windows array-to-array migrationease of use, price and ability to 1. During scheduled Saturday downtime, Softek TDMF software wasmaintain continuous applicationinstalled on the production server. Target volumes were connected to theavailability during data migration.volume and disk manager, and the system was rebooted to allocate the BAB buffer (RAM) and register target volume at volume and disk man- ager. Installation took 10 minutes per server. Application was restarted at the end of scheduled downtime.2. Migration groups were congured on source and target by the implemen- tation team. The team, with offsite Softek support, created mount points to resolve issues related to insufficient drive letters caused by the num- ber of volumes to be migrated.3. Softek TDMF full refresh was initiated in loopback conguration. Full refresh took approximately 24 hours and was performed online without any application impact.4. With Softek TDMF operation in normal mode, the team validated the data migrated to the new storage array by using the TDMF softwares checkpoint function. 29. Storage migrations made simplePage 29 5.During Tuesday downtime, the application was stopped and source vol-Highlights umes were removed. The target volumes were renamed, and the applica- tion was placed back into production using new arrays. 6.Old arrays were decommissioned.The local Windows array-to-arraymigration was a success.Production server 24 hours 24 hoursCheckpointOld arrays New arrays Local Windows array-to-array migration 30. Storage migrations made simplePage 30 Summary For the IT manager, technology refresh is regular, continuous and problem- atic, unless data migration software is used to simplify and streamline the process. The scenarios presented in this paper demonstrate how IBM Softek data migration software can be leveraged to streamline technology refresh projects. Above and beyond what most other products offer, Softek data migration soft- ware provides nondisruptive, exible and purpose-built solutions to address the complex challenges of technology refresh. With Softek solutions, applications remain online and continue to process data throughout the migration process. Softek TDMF software is hardware inde- pendent, accommodates increases in volume size, adjusts to system demands and has roll-back capability. 31. Notes 32. For more information Copyright IBM Corporation 2009 IBM Global ServicesFor more information about IBM Softek solutions for technology refresh, visit: Route 100ibm.com/services/datamobilitySomers, NY 10589 U.S.A. Produced in the United States of America October 2009 All Rights Reserved IBM, the IBM logo, ibm.com, AIX, CICS, DB2, Softek, TDMF and z/OS are trademarks or registered trademarks of International Business Machines Corporation and other companies in the United States, other countries, or both. If these and other IBM trademarked terms are marked on their rst occurrence in this information with a trademark symbol ( or ), these symbols indicate U.S. registered or common law trademarks owned by IBM at the time this information was published. Such trademarks may also be registered or common law trademarks in other countries. A current list of IBM trademarks is available on the Web at Copyright and trademark information at ibm.com/legal/copytrade.shtml Microsoft and Windows are trademarks of Microsoft Corporation in the United States, other countries, or both. UNIX is a registered trademark of The Open Group in the United States and other countries. Other product, company or service names may be trademarks or service marks of others. References in this publication to IBM products or services do not imply that IBM intends to make them available in all countries in which IBM operates. SDW03012-USEN-00