Virtual I/O Server - gomitec.com Presentations/James Nash VIO Scripts and... · –AIX and Linux Combines capabilities of 5 or 6 tools into one Save data into comma delimited files

© 2011 IBM Corporation

Virtual I/O Server Scripts and Tools To help simplify your environment

James Nash

Advanced Technical Skills

[email protected]

MITEC 2011 W 210 C-6


MITEC 2011 W 210 C-6

Trademarks

22

The following are trademarks of the International Business Machines Corporation in the United States, other countries, or both.

The following are trademarks or registered trademarks of other companies.

* All other products may be trademarks or registered trademarks of their respective companies.

Notes:

Performance is in Internal Throughput Rate (ITR) ratio based on measurements and projections using standard IBM benchmarks in a controlled environment. The actual throughput that any user will experience will vary depending upon considerations such as the amount of multiprogramming in the user's job stream, the I/O configuration, the storage configuration, and the workload processed. Therefore, no assurance can be given that an individual user will achieve throughput improvements equivalent to the performance ratios stated here.

IBM hardware products are manufactured from new parts, or new and serviceable used parts. Regardless, our warranty terms apply.

All customer examples cited or described in this presentation are presented as illustrations of the manner in which some customers have used IBM products and the results they may have achieved. Actual environmental costs and performance characteristics will vary depending on individual customer configurations and conditions.

This publication was produced in the United States. IBM may not offer the products, services or features discussed in this document in other countries, and the information may be subject to change without notice. Consult your local IBM business contact for information on the product or services available in your area.

All statements regarding IBM's future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only.

Information about non-IBM products is obtained from the manufacturers of those products or their published announcements. IBM has not tested those products and cannot confirm the performance, compatibility, or any other claims related to non-IBM products. Questions on the capabilities of non-IBM products should be addressed to the suppliers of those products.

Prices subject to change without notice. Contact your IBM representative or Business Partner for the most current pricing in your geography.

Adobe, the Adobe logo, PostScript, and the PostScript logo are either registered trademarks or trademarks of Adobe Systems Incorporated in the United States, and/or other countries.

Cell Broadband Engine is a trademark of Sony Computer Entertainment, Inc. in the United States, other countries, or both and is used under license therefrom.

Java and all Java-based trademarks are trademarks of Sun Microsystems, Inc. in the United States, other countries, or both.

Microsoft, Windows, Windows NT, and the Windows logo are trademarks of Microsoft Corporation in the United States, other countries, or both.

Intel, Intel logo, Intel Inside, Intel Inside logo, Intel Centrino, Intel Centrino logo, Celeron, Intel Xeon, Intel SpeedStep, Itanium, and Pentium are trademarks or registered trademarks of Intel

Corporation or its subsidiaries in the United States and other countries.

UNIX is a registered trademark of The Open Group in the United States and other countries.

Linux is a registered trademark of Linus Torvalds in the United States, other countries, or both.

ITIL is a registered trademark, and a registered community trademark of the Office of Government Commerce, and is registered in the U.S. Patent and Trademark Office.

IT Infrastructure Library is a registered trademark of the Central Computer and Telecommunications Agency, which is now part of the Office of Government Commerce.

For a complete list of IBM Trademarks, see www.ibm.com/legal/copytrade.shtml:

*, AS/400®, e business(logo)®, DBE, ESCO, eServer, FICON, IBM®, IBM (logo)®, iSeries®, MVS, OS/390®, pSeries®, RS/6000®, S/30, VM/ESA®, VSE/ESA, WebSphere®, xSeries®, z/OS®, zSeries®, z/VM®, System i, System i5, System p, System p5, System x, System z, System z9®, BladeCenter®

Not all common law marks used by IBM are listed on this page. Failure of a mark to appear does not mean that IBM does not use the mark nor does it mean that the product is not

actively marketed or is not significant within its relevant market.

Those trademarks followed by ® are registered trademarks of IBM in the United States; all others are trademarks or common law marks of IBM in the United States.


MITEC 2011 W 210 C-6

3


MITEC 2011 W 210 C-6

Agenda

4

Make your Life a Little Easier

• New Functions and Features

• K-I-S-S

Problem Areas

• Virtualization

• Documentation

• Monitoring

A handful of Tools already available

• Top 10 List

• Sample scripts


MITEC 2011 W 210 C-6

Enhancements added with v2.1.2 (Oct 2009)

Live Partition Mobility (LPM)– Preservation of Virtual Target Device names or ability to change names

– IPSEC Encryption of MSP to MSP traffic

– Network Interface selection for MSP to MSP communications

– Ability to create non-symmetric VIO server configurations

– Support for shared persistent reservations (PR_shared)

N_Port Id Virtualization (NPIV)– Dynamic remapping of vFC adapter to a physical port

– Concurrent microcode updates for NPIV adapters/ports

– Support for additional Blade Fibre Channel adapters

• FC 8240

• FC 8242

• FC8271

New commands chkdev, postprocesssvc, and viosbr

Official support for Solid State Drives in a virtual environment

Latest version of SDDPCM5


MITEC 2011 W 210 C-6

Enhancements added with v2.1.3 (April 2010)

NPIV Support for FCoE

VIO Support for AIX Runtime Expert (ARTEX

commands)– artexget Creates a new profile

– artexset Applies a profile to a system

– artexdiff Compares a profile against exiting settings

– artexlist Finds profiles in a given path

– artexmerge Combines multiple profiles into a single profile

New –nomedialib flag added to backupios

6


MITEC 2011 W 210 C-6

Enhancements added with v2.2 (August 2010)

Role Based Access Control (RBAC)

Enhanced Virtual Networking– SNMP

– QoS

– Dynamic VLAN

– User-defined MAC address

Partition Suspend/Resume

Linked Clones 4Q10

Thin Provisioning 4Q107


MITEC 2011 W 210 C-6

K-I-S-S

Virtualization– Best Practice

Documentation– Web pages, System Plans, Self-

maintaining

Upgrades– Support vs Stability

Disaster Recovery

Monitoring

8


MITEC 2011 W 210 C-6

OMG It’s A Subjective Top Ten List!

“We are all born originals – why is it so many of us die

copies?”

- Edward Young

Embrace the freedom and beauty of System

Design and System Architecture allow yourself to

be unique.

The opinions in this presentation represent the personal views of the author.

Some tools may not be a good fit for every environment. You are

encouraged to generate your own opinions on these utilities and determine

their worth.

9


MITEC 2011 W 210 C-6

nSuite

10


MITEC 2011 W 210 C-6

nSuite

Single binary built for each operating

system– AIX and Linux

Combines capabilities of 5 or 6 tools into

one

Save data into comma delimited files– Output into Excel Spreadsheets

– Add to rrd databases

– Generate webpages

Now built into the VIO server

11


MITEC 2011 W 210 C-6

Managed System Utilization Data

12


MITEC 2011 W 210 C-6

Managed System Utilization Data

13


MITEC 2011 W 210 C-6

lpar2rrd

14


MITEC 2011 W 210 C-6

lpar2rrd

Historical and near “real-time”

utilization information

Detailed shared processor partition

CPU utilization

Web-based, menu driven front-end

Ability to utilize nmon data with

nmon2rrd

It’s Free

15


MITEC 2011 W 210 C-6

Script It

16


MITEC 2011 W 210 C-6

Script It

17

Running non-VIO commands as padmin

$ oem_setup_env

# ln –fs /usr/bin/pg /usr/ios/utils/pg

# exit

$ lsmap –all | pg

ssh the command as padmin

On remote host

# vi test.ksh

lsdev –dev hdisk0

# ssh –l padmin test.ksh


MITEC 2011 W 210 C-6

Script It

18

Make use of ioscli

$ oem_setup_env

# vi test.ksh

/usr/ios/cli/ioscli chdev -dev hdisk0 -attr pv=yes

/usr/ios/cli/ioscli chdev -dev hdisk0 \

-attr reserve_policy=no_reserve

/usr/ios/cli/ioscli mkvdev -vdev hdisk0 \

-vadapter vhost0 -dev blue32_rootvg

# ./test.ksh


MITEC 2011 W 210 C-6

dshvio

http://ibmsystemsmag.blogs.com/aixchange/2008/05/another-great-a.html

19

• Script run from an AIX host

• Commands are ssh’d to a set of VIO servers

# dshvio -?

Valid parameters are:

-r for a root command

-n for a list of VIO servers

-n vios1

-n vios1,vios2

http://ibmsystemsmag.blogs.com/aixchange/2008/05/another-great-a.htmlhttp://ibmsystemsmag.blogs.com/aixchange/2008/05/another-great-a.htmlhttp://ibmsystemsmag.blogs.com/aixchange/2008/05/another-great-a.htmlhttp://ibmsystemsmag.blogs.com/aixchange/2008/05/another-great-a.htmlhttp://ibmsystemsmag.blogs.com/aixchange/2008/05/another-great-a.html


MITEC 2011 W 210 C-6

Put it all together

On your non-VIO system– Exchange ssh keys with a set of VIO servers

– Build a script on your non-VIO system

• Make use of the ioscli command– scp scripts to VIO servers

– Use dshvio to execute scripts on set of VIO

servers

Other things you might do?

20


MITEC 2011 W 210 C-6

Rapid LPAR Deployment Tool (RLDT)

21


MITEC 2011 W 210 C-6

Rapid LPAR Deployment Tool (RLDT)

22

Create and deploy partitions on HMC or IVM managed

system

Replicated disk image

Move from no partition to login prompt in under 10

minutes

Works best for partitions with similar rootvg

requirements

Requirements

– Ability to ssh commands to HMC/IVM and VIO

– Donor virtual disk

Restrictions

– Does not work well with PowerHA

– Does not configure network parameters on partition


MITEC 2011 W 210 C-6

End-to-end Virtual Device Mappings

23


MITEC 2011 W 210 C-6


24


MITEC 2011 W 210 C-6


25


MITEC 2011 W 210 C-6


26


MITEC 2011 W 210 C-6


27


MITEC 2011 W 210 C-6


28


MITEC 2011 W 210 C-6

New command - viosbr

29

$ viosbr

Too few parameters.

Usage: viosbr -backup -file FileName [-frequency

daily|weekly|monthly [-numfiles fileCount]]

viosbr -nobackup

viosbr -view -file FileName [-type devType] [-detail]

viosbr -view -file FileName -mapping

viosbr -view -list [UserDir]

viosbr -restore -file FileName [-validate] [-type devType]

[-inter]

viosbr -restore -file FileName [-type devType] [-force]

$ viosbr -backup -file nash-backup


MITEC 2011 W 210 C-6


30

$ viosbr -view -file /home/padmin/cfgbackups/nash-backup.tar.gz

Controllers:

============

Name Phys Loc

---- --------

iscsi0

sissas0 U5802.001.00H1395-P1-C1-T1

sissas1 U5802.001.00H1395-P1-C2-T1

sissas2 U78C0.001.DBJ0426-P2-T3

sissas3 U78C0.001.DBJ0426-P2-C9-T1

pager0 U9117.MMB.100414P-V1-C32769-L0-L0

pager1 U9117.MMB.100414P-V1-C32773-L0-L0

vasi0 U9117.MMB.100414P-V1-C32769


MITEC 2011 W 210 C-6


31

Physical Volumes:

=================

Name Phys Loc

---- --------

hdisk20 U78C0.001.DBJ0426-P2-C2-T1-W201800A0B81132D0-

L12000000000000


L1B000000000000

hdisk22 U78C0.001.DBJ0426-P2-C9-D1

hdisk23 U78C0.001.DBJ0426-P2-C9-D4

hdisk0 U5802.001.00H1395-P3-D1

hdisk1 U5802.001.00H1395-P3-D2

hdisk2 U78C0.001.DBJ0426-P2-C2-T1-W201800A0B81132D0-L0


L1000000000000


MITEC 2011 W 210 C-6


32

Ethernet Interfaces:

====================

en0

en1

en2

en3

en4

Shared Ethernet Adapters:

=========================

Name Physical Adapter Default Adapter Virtual Adapters

---- ---------------- --------------- ----------------

ent4 ent0 ent1 ent1


MITEC 2011 W 210 C-6


33

Virtual Server Adapters:

========================

SVSA Phys Loc VTD

---- -------- ---

vhost0 U9117.MMB.100414P-V1-C5 rg103_gambs




vhost4 U9117.MMB.100414P-V1-C2 mob29_target

vhost5 U9117.MMB.100414P-V1-C4 vtscsi1

vtscsi0


MITEC 2011 W 210 C-6


34

Virtual Server Adapters:

========================

SVSA Phys Loc VTD

---- -------- ---





vhost4 U9117.MMB.100414P-V1-C2 mob29_target

vhost5 U9117.MMB.100414P-V1-C4 vtscsi1

vtscsi0

This is NOT even the detailed view


MITEC 2011 W 210 C-6


35

$ viosbr -view -file /home/padmin/cfgbackups/nash-backup.tar.gz \

-detail

..............hdisk21 U78C0.001.DBJ0426-P2-C2-T1-W201800A0B81132D0-L1B000000000000

Attribute Name Attribute Value

-------------- ---------------

device_mode 10

queue_depth 32

message_no 105

hcheck_interval 60

hcheck_cmd inquiry

unique_id 3E213600A0B80001132D00000F2F94B7E72800F1815 FAStT03IBMfcp

scsi_id 0x611400

lun_id 0x1b000000000000

ww_name 0x201800a0b81132d0

node_name 0x200800a0b81132d0

ses_attach yes

pvid 00c23c9f212cf8880000000000000000

reserve_policy no_reserve


MITEC 2011 W 210 C-6


36

$ viosbr -view -file /home/padmin/cfgbackups/nash-backup.tar.gz \

–mapping

..............

Name Physloc ClntID ClntName ClntOS

------------- -------------------------------- ------ ------------- -------

vfchost0 U9117.MMB.100414P-V1-C16 29 mob29_lpm AIX

ClntOS AIX

Status LOGGED_IN

FC name fcs0

Ports logged in 3

Flags a

VFC client name fcs0

FC loc code U78C0.001.DBJ0426-P2-C2-T1

VFC client DRC U9117.MMA.1023C9F-V29-C3-T1


MITEC 2011 W 210 C-6

/usr/bin/which seastat

37


MITEC 2011 W 210 C-6

/usr/sbin/which seastat

38


MITEC 2011 W 210 C-6

NPIV – Hints/Tips

39

VIO Server

POWER Hypervisor (PHYP)

Client

LPAR

Client

LPAR

Client

LPAR

Physical 8Gb

NPIV Adapter

Virtual FC

Server Adapter

Virtual FC

Client Adapter


MITEC 2011 W 210 C-6

NPIV – Hints/Tips

40

hscroot@hmc:~> lssyscfg –r prof –m FieldSystem1 \

–F lpar_name,virtual_fc_adapters

fs5,"""20/client/1/fs6vio2/20/c050760061590000,c050760061590001/0"",

“"21/client/2/fs6vio3/21/c050760061590002,c050760061590003/0""“

fs6,"""22/client/1/fs6vio2/22/c050760061590004,c050760061590005/0"",

""23/client/2/fs6vio3/23/c050760061590006,c050760061590007/0""“

fsios71,none

fsios61,none

fs6vio3,"21/server/7/fs5/21//0,23/server/6/fs6/23//0“

fs6vio2,"20/server/7/fs5/20//0,22/server/6/fs6/22//0"


MITEC 2011 W 210 C-6

NPIV – Hints/Tips

41

# lscfg -vpl fcs0

fcs0 U8203.E4A.06EB1C4-V8-C26-T1 Virtual Fibre Channel Client Adapter

Network Address.............C05076006159000CROS Level and ID............

Device Specific.(Z0)........








Device Specific.(Z8)........C05076006159000CDevice Specific.(Z9)........

Hardware Location Code......U8203.E4A.06EB1C4-V8-C26-T1

PLATFORM SPECIFIC

Name: vfc-client

Node: vfc-client@3000001a

Device Type: fcp

Physical Location: U8203.E4A.06EB1C4-V8-C26-T1

# fcstat fcs0FIBRE CHANNEL STATISTICS REPORT: fcs0

Device Type: FC Adapter (adapter/vdevice/IBM,vfc-client)

Serial Number: UNKNOWN

Option ROM Version: UNKNOWN

Firmware Version: UNKNOWN

World Wide Node Name: 0xC05076006159000D

World Wide Port Name: 0xC05076006159000D

FC-4 TYPES:

Supported: 0x0000010000000000000000000000000000000000000000000000000000000000

Active: 0x0000010000000000000000000000000000000000000000000000000000000000

Class of Service: 3

Port Speed (supported): UNKNOWN

Port Speed (running): 2 GBIT

Port FC ID: 0x6D071D

Port Type: Fabric


MITEC 2011 W 210 C-6

42

NPIV – Hints/Tips


MITEC 2011 W 210 C-6

Manual Step?

43


MITEC 2011 W 210 C-6

IBM Systems Director VMControl

44


MITEC 2011 W 210 C-6

IBM Systems Director VMControl

45

Hierarchical views with live data in columns

Discover and Manage Virtual Resources

Display inventory and topology

Create and Manage Virtual Servers

Enhanced Monitor of virtual resource health

Activate thresholds

Relocate virtual resources

Building block for system pooling


MITEC 2011 W 210 C-6

A few more tools

46


MITEC 2011 W 210 C-6

Supporting Documentation

nSuite http://www.ibm.com/developerworks/wikis/display/wikiptype/nmon

lpar2rrd http://www.ibm.com/developerworks/aix/library/au-lpar2rrd/

Running scripts on VIO

dshvio http://ibmsystemsmag.blogs.com/aixchange/2008/05/another-great-a.html

Rapid LPAR Deployment Tool (RLDT) e-mail [email protected]

Virtual Device Mappings

seastathttp://publib.boulder.ibm.com/infocenter/powersys/v3r1m5//topic/iphcg/seastat.ht

m

NPIV Tips

47

http://www.ibm.com/developerworks/wikis/display/wikiptype/nmonhttp://www.ibm.com/developerworks/aix/library/au-lpar2rrd/http://www.ibm.com/developerworks/aix/library/au-lpar2rrd/http://www.ibm.com/developerworks/aix/library/au-lpar2rrd/http://ibmsystemsmag.blogs.com/aixchange/2008/05/another-great-a.htmlhttp://ibmsystemsmag.blogs.com/aixchange/2008/05/another-great-a.htmlhttp://ibmsystemsmag.blogs.com/aixchange/2008/05/another-great-a.htmlhttp://ibmsystemsmag.blogs.com/aixchange/2008/05/another-great-a.htmlhttp://ibmsystemsmag.blogs.com/aixchange/2008/05/another-great-a.htmlhttp://publib.boulder.ibm.com/infocenter/powersys/v3r1m5/topic/iphcg/seastat.htmhttp://publib.boulder.ibm.com/infocenter/powersys/v3r1m5/topic/iphcg/seastat.htm


MITEC 2011 W 210 C-6

Additional Resources

http://www.ibm.com/developerworks/wikis/display/WikiPtype/seastat

http://publib.boulder.ibm.com/infocenter/powersys/v3r1m5/topic/iphcg/seastat.htm

http://www.ibm.com/developerworks/wikis/display/wikiptype/nmon

http://www.ibm.com/developerworks/wikis/display/WikiPtype/Performance+Other+Tools

http://www.ibm.com/developerworks/wikis/display/virtualization/VIO

http://www.ibm.com/developerworks/wikis/display/virtualization/Virtualization+Best+Practice

http://www.ibm.com/developerworks/wikis/display/WikiPtype/Movies

http://ibmsystemsmag.blogs.com/aixchange/2008/05/another-great-a.html

http://www.ibm.com/developerworks/wikis/display/virtualization/lpar2rrd+tool

http://www.ibm.com/developerworks/aix/library/au-viocheatsheet/index.html?ca=drs-

ftp://public.dhe.ibm.com/common/ssi/ecm/en/pow03033usen/POW03033USEN.PDF

http://www.ibmsystemsmag.com/aix/octobernovember09/webexclusive/27497p4.aspx

http://www.ibm.com/collaboration/wiki/display/WikiPtype/VIOS_Monitoring

http://publib.boulder.ibm.com/infocenter/director/v6r1x/index.jsp?topic=/director.status_6.1/f

qm0_t_monitoring_health_and_status.html

48

http://www.ibm.com/developerworks/wikis/display/WikiPtype/seastathttp://publib.boulder.ibm.com/infocenter/powersys/v3r1m5/topic/iphcg/seastat.htmhttp://www.ibm.com/developerworks/wikis/display/wikiptype/nmonhttp://www.ibm.com/developerworks/wikis/display/WikiPtype/Performance+Other+Toolshttp://www.ibm.com/developerworks/wikis/display/virtualization/VIOhttp://www.ibm.com/developerworks/wikis/display/virtualization/Virtualization+Best+Practicehttp://www.ibm.com/developerworks/wikis/display/WikiPtype/Movieshttp://ibmsystemsmag.blogs.com/aixchange/2008/05/another-great-a.htmlhttp://ibmsystemsmag.blogs.com/aixchange/2008/05/another-great-a.htmlhttp://ibmsystemsmag.blogs.com/aixchange/2008/05/another-great-a.htmlhttp://ibmsystemsmag.blogs.com/aixchange/2008/05/another-great-a.htmlhttp://ibmsystemsmag.blogs.com/aixchange/2008/05/another-great-a.htmlhttp://www.ibm.com/developerworks/wikis/display/virtualization/lpar2rrd+toolhttp://www.ibm.com/developerworks/aix/library/au-viocheatsheet/index.html?ca=drs-http://www.ibm.com/developerworks/aix/library/au-viocheatsheet/index.html?ca=drs-http://www.ibm.com/developerworks/aix/library/au-viocheatsheet/index.html?ca=drs-http://www.ibm.com/developerworks/aix/library/au-viocheatsheet/index.html?ca=drs-ftp://public.dhe.ibm.com/common/ssi/ecm/en/pow03033usen/POW03033USEN.PDFhttp://www.ibmsystemsmag.com/aix/octobernovember09/webexclusive/27497p4.aspxhttp://www.ibm.com/collaboration/wiki/display/WikiPtype/VIOS_Monitoringhttp://publib.boulder.ibm.com/infocenter/director/v6r1x/index.jsp?topic=/director.status_6.1/fqm0_t_monitoring_health_and_status.htmlhttp://publib.boulder.ibm.com/infocenter/director/v6r1x/index.jsp?topic=/director.status_6.1/fqm0_t_monitoring_health_and_status.html


MITEC 2011 W 210 C-6

Credits

The “real” Nigel

Griffiths

Dean Roswell

Chris Eisenmann

Jeffrey Nowicki

Rob McNelly

Mr. Steve Pittman

49

Pavel Hampl

Craig Beible

Vess Natchev

Andy Archelger

Stephen Diwell

Christian Pruett


Questions?

James Nash

[email protected]

MITEC 2011 W 210 C-6

Documents

Virtual I/O Server - gomitec.com Presentations/James Nash VIO Scripts and... · –AIX and Linux Combines capabilities of 5 or 6 tools into one Save data into comma delimited files