Upload
dokhuong
View
224
Download
1
Embed Size (px)
Citation preview
Experiences with VIOS support for IBM i
Pete Stephen,
Power Systems / AIX Architect
Sirius Computer Solutions
© 2015 Sirius Computer Solutions© 2015 Sirius Computer Solutions
Agenda� VIO overview – Virtualization Trends.
� PowerVM and how do I use it with IBM i. Supported functions and IBM i versions
� VIOS Changes with 2.2.3.51
� HMC V8.R8.2 Changes
� Virtualized Network overview (SEA)
� Virtualized Storage and Fiber overview
– NPIV
� Considerations for Configuring VIO for IBM i
© 2015 Sirius Computer Solutions2
– Dynamic LPAR and RMC connections
– Setting up the Storage – vSCSI or/and NPIV
– LUNs vs. Disk Arms in the IBM i world
– 60 LUN per adapter limit. New PMR, but we still cover how to work around this.
– Identifying the Load Source Disk
– Storage Pools for Disk and DVD
– Tape Library Attachment Options
� Monitoring the VIO and the SEA and the storage
– Using VIO Adviosr to size the VIO (the part command)
– NMON to monitor and NMON Analyzer to view
– Using the HMCScanner to document the configuration
VIO Overview – Virtualization Trends
� CPU / Memory Technology support and accelerate virtualization
trends
� The problem is to minimizing complexity while maximizing
utilization through virtualization
� IBM has been and continues to be a virtualization technology
© 2015 Sirius Computer Solutions3
� IBM has been and continues to be a virtualization technology
leader
� IBM i has used virtualization. But now it is taking advantage of
Virtual I/O
� PowerVM is evolving to support these trends on multiple OS
platforms.
� As an AIX and VIO guy, I need to support PowerVM as it evolves
IBM i and PowerVM
� IBM i – The i stands for Integrated (not virtualized)
� IBM i has always treated its disk in a unique way.
� IBM i does benefit from virtualization – DPARs – LPM.
© 2015 Sirius Computer Solutions4
� So how does VIO best support IBM i ???
IBM i and PowerVM
Supported Versions
Feature Version/Release
Support for 8GB FC
adapter and NPIVIBM i level 6.1 with 6.1.1 machine code
Live Partition Mobility IBM i level 7.1 TR4 PTF group – SF99707 level 4
PowerVM Enterprise with VIOS 2.2.1.4
Various SAN Storage Check the IBM i Storage Support Matrix
© 2015 Sirius Computer Solutions5
Various SAN Storage
Systems supportCheck the IBM i Storage Support Matrix
IBM i POWER External Storage Support Matrix Summary
© 2015 Sirius Computer Solutions6
Definition of IBM i attach methodsDirect attach – switch or fabric device is not required between the adapter and the storage device
Fabric attach – switch or fabric device is required between the adapter and the storage device
VIOS VSCSI – A virtual I/O server (VIOS or IBM i) provides a virtual SCSI adapter and virtual SCSI storage devices to a client operating system (IBM i, AIX, or Linux for VIOS; IBM i, AIX, Linux, or Windows for IBM i)
VIOS NPIV – N_Port ID Virtualization (NPIV) – aka virtual fibre channel – A virtual I/O server (VIOS) provides a virtual fibre channel
adapter to the client operating system (IBM i, AIX, or Linux)
http://www-03.ibm.com/support/techdocs/atsmastr.nsf/WebIndex/PRS4563
VIOS Release Strategy
� VIOS Release Strategy Changes with 2.2.3.50In June 2015, VIOS introduces the minipack as a new service stream delivery vehicle as well as a
change to the VIOS fix level numbering scheme. The VIOS "fix level" (the 4th number) has changed
to a double digit. VIOS 2.2.3.5 is changed to VIOS 2.2.3.50. Please refer to the VIOS Maintenance
Strategy here for more details regarding the change to the VIOS release numbering scheme..
http://www-01.ibm.com/support/docview.wss?uid=hpc1vios_home
© 2015 Sirius Computer Solutions7
http://www-01.ibm.com/support/docview.wss?uid=hpc1vios_home
VIOS level is NIM Master level must be equal to or higher than
Update Release 2.2.3.50 AIX 6100-09-05 or AIX 7100-03-05
• To take full advantage of all the function available in the VIOS, it may be necessary to be atthe latest system firmware level. Upgrade the Firmware before you update the VIOS
• The latest level of HMC V8R8.2 SP1 (MH01521) will support VIO functionality
Considerations for Configuring VIO for IBM i
� Dynamic LPAR operations and RMC connections
� Shared Ethernet Adapter Configuration
� Setting up the Storage – vSCSI or/and NPIV - IASP or not
� LUNs vs. Disk Arms in the IBM i world
� The 60 LUN per adapter limit. New PMR, but we still cover how to work
around this.
© 2015 Sirius Computer Solutions8
around this.
� Identifying the Load Source Disk
� Storage Pools for Disk and DVD
� Tape Library Attachment Options
IBM i and Dynamic LPAR operations and RMC connections
� IBM i does not use the rsct demons to enable DLPAR operations.
� IBM i uses the HMC Service Processor connection to enablre DLPAR.
# lssrc -a | grep rsct
© 2015 Sirius Computer Solutions9
# lssrc -a | grep rsctctrmc rsct 5374166 activeIBM.HostRM rsct_rm 14156014 activeIBM.ServiceRM rsct_rm 5439716 activeIBM.MgmtDomainRM rsct_rm 9240692 activeIBM.DRM rsct_rm 17301604 active
VIO Implementation with SEA
SEA Configurationhttp://www-01.ibm.com/support/docview.wss?uid=isg3T7000527
• Common to AIX LPARs. Unusual and complex for IBM i LPARs• Do we need to support multiple VLANs or just one?• 10GB adapters or 1 GB?• EtherChannel the ports?
S824 Server
© 2015 Sirius Computer Solutions
S824 Server
Jumbo Frames has a large impact on network performance
I Recommend building out the SEA (physical and logical devices) with Jumbo Frames.Then use mtu_bypass=yes or mtu_bypass=no to enable on a per LPAR basis
© 2015 Sirius Computer Solutions
VIO Implementation with SR-IOV
•Expected to be popular with IBM I LPARs
© 2015 Sirius Computer Solutions
VIO Virtualized Storage vSCSI or NPIV for IBM i
© 2015 Sirius Computer Solutions13
VIO NPIV Implementation for IBM i
Each IBM i LPAR has 4 vFC adapters supporting up to 64 LUNs. (IBM i OS limit per FC)( Best to stay below 64 )
Each VIO Server is connected to both Fabrics
alp206
Can support up to 128 LUNs
Virtual
Adapters
virtual adapter device
Controller Slot number
Last 4 digits of WWPN
VIO
fsc0
C43
0030
fsc2
C45
0034
fsc1
C44
0032
fsc3
C46
0036
vfchost0
C43
vfchost1
C45
vfchost2
C47
vfchost3
C49
vfchost4
C51
vfchost5
C53
vfchost0
C44
vfchost1
C46
vfchost2
C48
vfchost3
C50
vfchost4
C52
vfchost5
C54
fsc4
C47
0038
fsc6
C49
0042
fsc5
C48
0040
fsc7
C50
0044
alp210
Can Support up to 64 LUNs
fsc0
C51
0A60
fsc2
C53
0A64
fsc1
C52
0A62
fsc3
C54
0A68
SAN Disk
80GBSAN Disk
80GB
SAN Disk
100GB
SAN Disks
100GBSAN Disk
100GB
SAN Disks
100GBSAN Disk
100GB
SAN Disks
100GB
© 2015 Sirius Computer Solutions
connected to both FabricsFabric A -> T1 portsFabric B -> T2 ports
vfcmap –vadapter vfchostX –fcp fcsX
Command to map Virtual to Physical Fiber Channel
14
VIOS01
U2C4E.001.DBJF263-P2-C2
SWITCH 9506-00
Fabric A
Physical Dual Port
FC Adapters
09 11 1615
Physical adapter device
Last 4 digits of WWPN
T1
fcs0
99D4
T2
fcs1
99D5
U2C4E.001.DBJF263-P2-C5
T1
fcs2
A1FC
T2
fcs3
A1FD
10 141312
SWITCH 9506-00
Fabric B
09 11 161510 141312
VIOS02
U2C4E.001.DBJF262-P2-C2
T1
fcs0
A260
T2
fcs1
A261
U2C4E.001.DBJF262-P2-C5
T1
fcs2
A160
T2
fcs3
A161
Physical port number
Serversvfcmaps
SAN Disk
Load Source Disks Data Disks (size as needed)
SAN Disk
100GB
SAN Disk
100GB
SAN Disk
100GBSAN Disk
80GB
SAN Disk
80GB
SAN Disk
100GB
SAN Disk
100GB
V7000 LUNs and Disk Arms for iOS
LUN compared to Disk arm
� The V7000 LUN connected to IBM i reports in IBM i as a disk unit.
IBM i storage management employs the management and
performance functions as if the LUN was a disk arm.
� The number of LUNs drives the requirement for more FC
adapters on the IBM i due to the addressing restrictions of IBM i
if you are using native attachment. Remember that each path to
© 2015 Sirius Computer Solutions
if you are using native attachment. Remember that each path to
a LUN will count towards the maximum addressable LUNs on
each IBM i IOA.
�
IBM i OS limits the number of “Disks” per “Fiber HBA” to 60
� Note the Limit of Disks per Adapter on iOS!!!.
– http://www-01.ibm.com/support/docview.wss?uid=tss1td106091
� All the Data LUNs should be
the same size.
� If the total storage / size of
alp206
Can support up to 128 LUNs
fsc0
C43
0030
fsc2
C45
0034
fsc1
C44
0032
fsc3
C46
0036
fsc4
C47
0038
fsc6
C49
0042
fsc5
C48
0040
fsc7
C50
0044
alp210
Can Support up to 64 LUNs
fsc0
C51
0A60
fsc2
C53
0A64
fsc1
C52
0A62
fsc3
C54
0A68
SAN Disk
80GBSAN Disk
80GB
SAN Disk
100GB
SAN Disks
100GBSAN Disk
100GB
SAN Disks
100GBSAN Disk
100GB
SAN Disks
100GB
Match the
Client and
Server Slot
© 2015 Sirius Computer Solutions16
� If the total storage / size of
the LUNs exceeds 60 you
MUST map to multiple
“virtual hosts”.
VIOS01
U2C4E.001.DBJF263-P2-C2
SWITCH 9506-00
Fabric A
Physical Dual Port
FC Adapters
09 11 1615
“Virtual Host
Mapping #1
T1
fcs0
99D4
T2
fcs1
99D5
U2C4E.001.DBJF263-P2-C5
T1
fcs2
A1FC
T2
fcs3
A1FD
10 141312
SWITCH 9506-00
Fabric B
09 11 161510 141312
VIOS02
U2C4E.001.DBJF262-P2-C2
T1
fcs0
A260
T2
fcs1
A261
U2C4E.001.DBJF262-P2-C5
T1
fcs2
A160
T2
fcs3
A161
VIO
Servers
SAN Disk
Load Source Disks Data Disks (size as needed)
SAN Disk
100GB
SAN Disk
100GB
SAN Disk
100GBSAN Disk
80GB
SAN Disk
80GB
SAN Disk
100GB
SAN Disk
100GB
vfchost0
C43
vfchost1
C45
vfchost2
C47
vfchost3
C49
vfchost4
C51
vfchost5
C53
vfchost0
C44
vfchost1
C46
vfchost2
C48
vfchost3
C50
vfchost4
C52
vfchost5
C54
“Virtual Host
Mapping #2
Server Slot
Numbers
Identify which LUN is which disk unit in IBM i to find the Load Source
� All connection options: Native, VIOS_NPIV, and VIOS Virtual SCSI support Boot from
SAN. LoadSource resides on a V7000 LUN which is connected the same way as the
other LUNs; there aren't any special requirements for LoadSource connection.
� In IBM i Dedicated Service Tools (DST) or System Service Tools (SST) look for the
Serial number of a disk unit. In the picture Disk units in native or NPIV connection we
see Serial numbers Y11C490001DC, Y11C490001DA, etc.
� The last 6 characters of the Serial number are the last 6 characters of the LUN IDs in
V7000. Example: Y11C490001DA.
© 2015 Sirius Computer Solutions17
Virtual Storage Management of the DVD Drive
� DVDs are important to IBM i
maintenance.
� If the DVD is not on its own
adapter (traditional IBM i
configuration) then create a
Virtual Storage Pool for the DVD
device.
© 2015 Sirius Computer Solutions
device.
18
Virtual Storage Management of the Tape Library
� One Drive or a Library?
� BMRS or Native backup
� NPIV attached or dedicated adapter?
© 2015 Sirius Computer Solutions19
Cool Tools – VIOS Advisor and HMC Scanner� Analyze and document your IBM i virtualized environment
� HMC Scanner
https://www.ibm.com/developerworks/community/wikis/home/wiki/Power Systems/page/HMC Scanner
� VIOS Advisor (the part command)
http://www-01.ibm.com/support/knowledgecenter/8231-E1C/p7hcg/part.htm?lang=en
© 2015 Sirius Computer Solutions20
References and Links
� The VIO cheat sheethttp://www.ibm.com/developerworks/aix/library/au-viocheatsheet/index.html
� IBM PowerVM Virtualization Introduction and Configurationhttp://www.redbooks.ibm.com/abstracts/sg247940.html
� IBM PowerVM Best Practiceshttp://www.redbooks.ibm.com/abstracts/sg248062.html?Open
� Virtual I/O Server and Integrated Virtualization Manager commandshttp://www-01.ibm.com/support/knowledgecenter/8231-E1C/p7hcg/iphcgkickoff_alphabetical.htm?lang=en
� Get to know the VIOS CLIhttps://www.ibm.com/developerworks/aix/library/au-vioscli/
© 2015 Sirius Computer Solutions21
� Virtualization best practices - Wikihttps://www.ibm.com/developerworks/community/wikis/home?lang=en#!/wiki/Power%20Systems/page/Virtualization%20best%20practices
� HMC Commands Syntaxhttp://www-01.ibm.com/support/knowledgecenter/8231-E1C/p7edm/p7edm_kickoff.htm?lang=en
� Hints and Tips for implementing Storwize V7000 in an IBM i environmenthttp://www-03.ibm.com/support/techdocs/atsmastr.nsf/WebIndex/WP102305
� What are the maximum storage devices IBM i LPAR?http://www-01.ibm.com/support/docview.wss?uid=tss1td106091
� IBM i Virtualization and Open Storagehttp://www-03.ibm.com/systems/resources/systems_i_Virtualization_Open_Storage.pdf
Thank You
© 2015 Sirius Computer SolutionsThis document is for IBM and IBM Business Partner use only. It is not intended for client distribution or use with clients
22