Installation and Configuration of LVM 1.0 Standard …manuals.ts.fujitsu.com/file/11884/FF11A00_LVM_Installation_Guide.pdf · Installation and Configuration of LVM 2.1 Standard Edition

FlexFrame® Orchestrator

Version 1.1A

Installation and Configuration of LVM 2.1 Standard Edition

Edition February 2015 Document Version 1.2

Installation and Configuration of LVM 2.1 Standard Edition

Fujitsu Limited

© Copyright Fujitsu Technology Solutions 2015

FlexFrame® and PRIMERGY™ are trademarks or registered trademarks of Fujitsu

Limited in Japan and other countries.

SAP® and NetWeaver™ are trademarks or registered trademarks of SAP AG in Germany

and in several other countries

Linux® is a registered trademark of Linus Torvalds

SUSE® Linux is a registered trademark of Novell, Inc., in the United States and other

countries

Oracle™ and Java™ are trademarks of ORACLE Corporation and/or its affiliates

Intel® and PXE

® are registered trademarks of Intel Corporation in the United States and

other countries

MaxDB® is a registered trademark of MySQL AB, Sweden

MySQL® is a registered trademark of MySQL AB, Sweden

NetApp® and the Network Appliance

® logo are registered trademarks and Network

Appliance™ and Data ONTAP™ are trademarks of NetApp, Inc. in the U.S. and other countries.

EMC®, CLARiiON

®, Symmetrix

® and Celerra™ are trademarks or registered trademarks

of EMC Corporation in the United States and other countries

VMware®, ESX

®, ESXi, VMware vCenter, VMware vSphere are registered trademarks or

trademarks of VMware, Inc. in the United States and/or other jurisdictions.

Ethernet® is a registered trademark of XEROX, Inc., Digital Equipment Corporation and

Intel Corporation

Windows® and Word

® are registered trademarks of Microsoft Corporation

All other hardware and software names used are trademarks of their respective companies.

All rights, including rights of translation, reproduction by printing, copying or similar methods, in part or in whole, are reserved.

Offenders will be liable for damages.

All rights, including rights created by patent grant or registration of a utility model or design, are reserved.

Delivery subject to availability. Right of technical modification reserved.

Contents

2

Contents

1 Introduction ...................................................................................................... 1 1.1 Requirements .................................................................................................... 1 1.2 Notational Conventions ..................................................................................... 1 1.3 Document History .............................................................................................. 1 1.4 Related Documents ........................................................................................... 1

2 General Preparations ...................................................................................... 3 Required Software for LVM Installation ............................................................. 3 2.1

Known Issues .................................................................................................... 3 2.2

Documentation .................................................................................................. 3 2.3

3 Installation and Configuration ........................................................................ 5 Preparation ........................................................................................................ 8 3.1

NetWeaver Installation ...................................................................................... 8 3.2

LVM Installation ................................................................................................. 9 3.3

Post Installation Activities ................................................................................ 22 3.4

3.4.1 Performance Setup .......................................................................................... 22 3.4.1 LVM Initial Setup ............................................................................................. 23 3.4.2 Installation and Configuration of SAPHostAgent ............................................. 29

Configuration of LVM ....................................................................................... 34 3.5

3.5.1 Add Network .................................................................................................... 36 3.5.2 Virtualization Manager Configuration ............................................................... 40 3.5.3 Add Pools ........................................................................................................ 45 3.5.4 Discover Hosts and Systems ........................................................................... 47 3.5.5 Configure Hosts ............................................................................................... 53 3.5.6 Configure Systems and Instances ................................................................... 61

Start/Stop/Relocate Systems and Instances .................................................... 71 3.6

Same SID in Different Pools ............................................................................ 73 3.7

4 Troubleshooting ............................................................................................ 76 Resource Unlock ............................................................................................. 76 4.1

SAPHostAgent Invalid Credentials .................................................................. 79 4.2

Invalid Response code 504 ............................................................................. 80 4.3

5 Abbreviations ................................................................................................. 81

6 Glossary ......................................................................................................... 84

Installation and Configuration of LVM 2.1 Standard Edition 1

1 Introduction

1.1 Requirements

This document addresses administrators on FlexFrame environments. We assume that

the reader of this document has technical background knowledge in the areas of

operating systems Linux®, IP networking and SAP

® basis.

1.2 Notational Conventions

The following conventions are used in this manual:

Additional information that should be observed.

Warning that must be observed.

fixed font Names of paths, files, commands, and system output.

<fixed font> Names of variables.

fixed font User inputs in command examples (if applicable using <> with

variables).

1.3 Document History

Document Version Changes Date

1.0 First Edition 2014-03-12 1.1 Only minor adaptions to FlexFrame

Orchestrator version 1.1A

2014-11-19

1.2 Upgrade to LVM 2.1 2015-03-25

1.4 Related Documents

FlexFrame® – Administration and Operation

FlexFrame® – HW Characteristics Quickguides

FlexFrame® – Installation Guide for SAP Solutions

FlexFrame® – Installation of a FlexFrame Environment

Contents

2

FlexFrame® – Management Tool

FlexFrame® – FlexFrame Agents Installation and Administration

FlexFrame® – FlexFrame Messenger Installation and Administration

FlexFrame® – FlexFrame LogAgent Installation and Administration

FlexFrame® – Network Design and Configuration Guide

FlexFrame® – Security Guide

FlexFrame® – Technical White Paper

FlexFrame® – Upgrading FlexFrame Orchestrator 1.0A to 1.1A

ServerView Documentation

SUSE Linux Enterprise Server Documentation


2 General Preparations

Required Software for LVM Installation 2.1

● SAP recommended the following NW Releases (note 1973341)

SAP NetWeaver Release 7.30 Support Package 08



● SAP LVM 2.1 final Support Package http://support.sap.com/swdc

● The final SAPHostAgent from http://support.sap.com/swdc

Known Issues 2.2

Documentation 2.3

The following documents provide detailed information on SAP LVM:

● This Installation Guide (Fujitsu)

The actual SAP documentation is available on http://help.sap.com/lvment21,

http://www.sdn.sap.com/irj/sdn/lvm , http://service.sap.com/instlvm

● SAP LVM notes: 2052212 ,1973341, 2039994

● Concerning NetWeaver Installations in FlexFrame® environments the "FlexFrame

Installation Guide for SAP Solutions" (Fujitsu) provides all relevant informations.

Before installing SAP NetWeaver on FlexFrame, please refer to the original

SAP installation guide. Get the final SAP Notes from:

http://support.sap.com

Screenshots in this document could be different from the current Service

Packs of LVM

http://support.sap.com/swdc

http://support.sap.com/swdc

http://help.sap.com/lvment21

http://www.sdn.sap.com/irj/sdn/lvm

http://service.sap.com/instlvm

http://support.sap.com/

General Preparations Documentation

4

Sample system for this document:

This document refers to the following examples:

LVM = SID for NW (LVM) installation

bx920-1 = Host for LVM installation

j01lvm = Virtual host name of LVM system

pcom = Pool for LVM

cn1 = Control Node 1

bx920-x = App Nodes

L7S = Managed System


3 Installation and Configuration

First of all you have to decide in which way you want to integrate the LVM in a FlexFrame

environment:

a) Install a LVM in every pool (go on with chapter Preparation).

b) Install a LVM only once for all pools, connect other pools via network

routing and setup hostnames

Setup hostnames of SAP systems and hosts from your pools e.g. p1 and p2 to LVM host

of pool pcom:

bx920-3:/ # getent hosts

10.53.22.116 bx920-16

10.53.24.116 bx920-16-se

10.53.23.116 bx920-16-st

10.53.22.118 bx920-18

10.53.24.118 bx920-18-se

10.53.23.118 bx920-18-st

10.53.22.109 bx920-9

10.53.24.109 bx920-9-se

10.53.23.109 bx920-9-st

10.53.22.5 app02l7s app02l7s.Fujitsu.rot.com p2-app02l7s

10.53.24.6 app02l7s-se app02l7s-se.Fujitsu.rot.com p2-app02l7s-se

10.53.24.3 dbl7s-se dbl7s-se.Fujitsu.rot.com p2-dbl7s-se

10.53.22.3 pail7s pail7s.Fujitsu.rot.com p2-pail7s

10.53.24.4 pail7s-se pail7s-se.Fujitsu.rot.com p2-pail7s-se

10.53.22.4 ascsl7s ascsl7s.Fujitsu.rot.com p2-ascsl7s

10.53.24.5 ascsl7s-se ascsl7s-se.Fujitsu.rot.com p2-ascsl7s-se

Insert all hosts from other pools in /etc/hosts of pool pcom

cn1:/ # cd /FlexFrame/volFF/os/Linux/pool_img/com/etc

cn1:/FlexFrame/volFF/os/Linux/pool_img/com/etc # vi hosts

10.53.32.101 bx920-1

10.53.32.102 bx920-2

10.53.22.116 bx920-16

10.53.22.118 bx920-18

10.53.22.109 bx920-9

Installation and Configuration Documentation

6








-- INSERT --

Don’t forget to update the /etc/hosts for pool (LVM), if you create new hosts

or SAP systems in your pools.

Take care that your vCenter (if existent) is reachable from LVM host.

c) Install a LVM only once for all pools, connect other pools via HTTP proxy

You configure global HTTP proxy settings for SAP Landscape Virtualization Management

in the SAP NetWeaver Administrator >SOA> SOAMiddleware Global Settings: HTTP

Proxy.

This can be done after NetWeaver installation.

Documentation Installation and Configuration


Enter your proxy settings e.g. proxy squid on cn1 and press Save.

Insert all virtual hostnames in the /etc/hosts of the proxy host e.g. cn1

bx920-3:~ # getent hosts

.

.








cn1:~ # vi /etc/hosts

.

.








Restart proxy e.g. squid

cn1:~ # rcsquid restart

Shutting down WWW-proxy squid - wait a minute or two... .............done

Starting WWW-proxy squid done

Don’t forget to update the /etc/hosts on proxy host, if you create new SAP

systems and instances in your pools.

Take care that your vCenter or ESX host (if existent) is reachable from LVM

host

Installation and Configuration Preparation

8

For a correct LVM-validation it’s also necessary to setup all hostnames to /etc/hosts file of the LVM host e.g. see bullet point b).

Preparation 3.1

Create a LVM directory in every pool:

bx920-1:~ # mkdir /FlexFrame/scripts/log/LVM

Create for every LVM managed SAP SID a file e.g. L7S

bx920-1:~ # touch /FlexFrame/scripts/log/LVM/L7S

Don’t forget to update the LVM directory, if you create new SAP systems

and instances in your pool.

NetWeaver Installation 3.2

Please install a “Java only” system of the following NetWeaver Releases with the min.

SP, see also current SAP note 1973341 :




Please make sure that the FlexFrame Application Agents are stopped

on the hosts that you are installing SAP Software on.

Please check the “FlexFrame Installation Guide for SAP Solutions” for

additional hints installing SAP NetWeaver in FlexFrame.

LVM Installation Installation and Configuration


LVM Installation 3.3

After finishing the NetWeaver and SP installation successfully, proceed with the LVM installation.

Unpack the final SUM.sar file on the LVM host:

bx920-1:~ # ssh -X lvmadm@bx920-1

Authorized uses only. All activity may be monitored and reported.

Password:

j01lvm:lvmadm 51> cd /usr/sap/LVM/install/

j01lvm:lvmadm 58> /usr/sap/hostctrl/exe/SAPCAR -xvf SUM10SP12_7-20006543.SAR

.

.

j01lvm:lvmadm 61> cd SUM

j01lvm:lvmadm 63> ./STARTUP

.

.

Feb 6, 2014 12:40:00 PM [Info]: Services started.

Feb 6, 2014 12:40:00 PM [Info]: Starting HTTP server listening on port 4239 ...

Feb 6, 2014 12:40:00 PM [Info]: HTTP server started.

Feb 6, 2014 12:40:00 PM [Info]: SL Controller started.

Installation and Configuration LVM Installation

10

Connect with a browser to LVM host Port 4239.



Login to SUM.


12

Press Next.



Enter password for lvmadm.


14

Select your manual prepared directory with the final LVMxx.SCA files.



Press Next.


16

Press Next.



Fill in password and press Continue.


18

Press Continue.



Follow the instructions above and press Continue.


20

Press Continue.



Check and press Continue.

Follow the upcoming steps to Finalization.

After finishing deployment please restart SAP NW AS Java.

Installation and Configuration Post Installation Activities

22

Post Installation Activities 3.4

3.4.1 Performance Setup

For getting a better performance and increasing the load for LVM,

please check and adjust the parameters of SAP note 1973341:

chapter 2.1: SAP NW AS Java Engine.

Don’t forget to restart the Java Instance in order for the changes to

take effect.

Post Installation Activities Installation and Configuration


3.4.1 LVM Initial Setup

Login to SAP NetWeaver Administrator. Select Configuration => Scenarios and start

Configuration Wizard


24

Select Initial Setup for LVM and press button Start.

Select Custom and press button Next.



Type password and press button Next.

Type password for sapadm user.

Press button Next.


26

Make sure to use sapadm password from FFO LDAP.

Use Default settings or change e.g. Security Settings. Press button Next.

For more information http://help.sap.com/lvment21/

http://help.sap.com/lvment21/



Press Next or select your choice.


28

Enter the User Name and the Password in the respective fields.

From the Group drop down list select the required group name, to associate it with the created user.

Press button Next.



3.4.2 Installation and Configuration of SAPHostAgent

3.4.2.1 Install SAPHostAgent

You can find the newest SAPHostAgent.SAR file in the SAP Software Distribution Center of the SAP Service Marketplace (https://support.sap.com/swdc).

Download the final version.

For a pool wide installation refer to FF11A00_SAP_Installation_Guide chapter 9.2.2

Before you copy SAPHostAgent to other application nodes, please

perform first next chapter.

It’s reasonable to start SAPHostAgent after system reboot, make sure that

sapinit is executed.

3.4.2.2 Setup User Exit and Host Profile

LVM User Exit works as an interface to the FlexFrame Agents.

Set the profile parameter

'service/EnableRemoteDeployment = true'.

PLEASE NOTE: This feature allows remote clients to deploy, for example,

new Host Agent operations or to patch existing operations. If you think that

this is a security risk in your environment you can also keep that feature

disabled and deploy the configuration files manually.

See also SAP note :927637

Add following lines to the host_profile:

bx920-1: /usr/sap/hostctrl/exe # vi host_profile

...

service/hook/sap_control = /usr/sap/hostctrl/exe/sap_control.sh %p %h %s %n

service/hook/db_control = /usr/sap/hostctrl/exe/db_control.sh %p %h %s %t

service/EnableRemoteDeployment = true

https://support.sap.com/swdc


30

Create sap_control.sh:

bx920-1: /usr/sap/hostctrl/exe # vi sap_control.sh

#!/bin/bash

# User Exit Script for LVM in FF (instances)

echo "Running User Exit Script"

echo "/ ---- " $0 $* " ---- /"

FF="/FlexFrame/scripts/ff_service.sh -s $3 -a $1"

case $1 in

"p"*)

case $2 in

*"ci"*)

if [ -d /usr/sap/$3/SMD* ] ; then

$FF -t smd -i $4

else

$FF -t ci

fi

exit_code=$?

;;

*"hdb"*)


$FF -t smd -i $4

else

$FF -t hdb -i $4 -N 001

fi

exit_code=$?

;;

*"pai"*)


$FF -t smd -i $4

else

$FF -t pai

fi

exit_code=$?

;;

*"jc"*)




$FF -t smd -i $4

else

$FF -t jc

fi

exit_code=$?

;;

*"ascs"*)

$FF -t ascs

exit_code=$?

;;

*"scs"*)

$FF -t scs

exit_code=$?

;;

*"app"*)


$FF -t smd -i $4

else

$FF -t app -i $4

fi

exit_code=$?

;;

*"j"$4*)


$FF -t smd -i $4

else

$FF -t j -i $4

fi

exit_code=$?

;;

*"ers"*)

$FF -t ers -i $4

exit_code=$?

;;

*"bobj"*)

$FF -t bobj

exit_code=$?

;;

*"cms"*)

$FF -t cms


32

exit_code=$?

;;

*"mdss"*)

$FF -t mdss -i $4

exit_code=$?

;;

*"mds"*)

$FF -t mds -i $4

exit_code=$?

;;

*"mdis"*)

$FF -t mdis -i $4

exit_code=$?

;;

*"trx"*)

$FF -t trx -i $4

exit_code=$?

;;

esac

echo "/ $1 position executed /"

if [ $exit_code -ge 1 -a $exit_code -le 4 ];then

exit 0

else

exit $exit_code

fi

;;

esac

exit 0

Create db_control.sh:

bx920-1:/usr/sap/hostctrl/exe # vi db_control.sh

#!/bin/bash

#User Exit Script for LVM in FF (databases)

echo "Running User Exit Script"

echo "/ ---- " $0 $* " ---- /"

FF="/FlexFrame/scripts/ff_service.sh -s $3 -a $1"



case $1 in

"p"*)

case $2 in

*"lc"*)


$FF -t smd -i $4

else

$FF -t db

fi

exit_code=$?

;;

*"db"*)


$FF -t smd -i $4

else

$FF -t db

fi

exit_code=$?

;;

esac

echo "/ $1 position executed /"

if [ $exit_code -ge 1 -a $exit_code -le 4 ]; then

exit 0

else

exit $exit_code

fi

;;

esac

exit 0

bx920-1:/usr/sap/hostctrl/exe # chmod 750 sap_control.sh db_control.sh

bx920-1:/usr/sap/hostctrl/exe # chown root:root sap_control.sh db_control.sh

Start/Restart SAP Host Agent on every host in every pool.

bx920-1:/usr/sap/hostctrl/exe # ./hostexecstart –restart

Installation and Configuration Configuration of LVM

34

Configuration of LVM 3.5

This chapter describes how configure LVM.

See also: http://help.sap.com/lvment21/

Use the following URL: http://<LVM_host>:<port>/lvm

e.g. http://j01lvm:50100/lvm

First, logon to LVM:

http://help.sap.com/lvment21/

Configuration of LVM Installation and Configuration


Setup LVM

Click on Setup icon.


36

Switch to Settings => Engine => Press Expert mode and Edit button.

Marking ‘Enable user exit scripts’ is mandatory for using the FlexFrame

Agents.

Please use the right password for sapadm from FFO LDAP.

After setting up above press button Save.

3.5.1 Add Network

Navigate to Infrastructure icon:

Select Network Components and press Add button.



Enter the required data e.g. Client LAN pool pcom. Press Next.

Press button Next.


38

Then click on Save button.

Repeat these steps to insert all Client and Server networks of all pools.




40

3.5.2 Virtualization Manager Configuration

If you don’t have a Virtualization Manager ( e.g. ESX, vCenter ), skip this chapter.

Navigate to tab Virtualization Managers:

Press button Add.



Select VMware and press button Next.


42

Fill in your connection information to your e.g. ESX host (or Vcenter) and press Test Connection button to check your connection to ESX host.

Press button Next.



Press button Save.


44

In the Virtualization Overview (Operations => Virtualization) ESX Servers and VM’s are now visible.



3.5.3 Add Pools

Navigate to Configuration icon and select tab Pools.

Click on Add Pool and enter your pool(s).

Then click on button Save.


46



3.5.4 Discover Hosts and Systems

Select tab Hosts:

Press button Discover.


48

There are several methods to discover hosts and systems into LVM.

Select e.g. Detect Using Host and Instance Agent.

Fill in your Host Names separated by comma.

Press button Detect.

Please make sure that the SAP Host Agent and Instances are started on

every host.

For using ERS instances in LVM, you have to provide the virtual

hostnames with IP-addresses.



After detection press button Next.


50

Select corresponding pool and press button Auto Assign.

Check that the correct System is selected.

Press button Next.



Assign the host to the corresponding pool. Press button Next.


52

If the overview is correct, press button Save.

Under tabs Hosts and Systems the detected hosts and system is now available for configuration.



3.5.5 Configure Hosts

Select the first one and press button Edit.


54

Activate Managed, Operational and select the required Pool, if not preselected.

Test the connection to server by pressing button Test Connection.

Click on button Next.



For resource control you can provide SAPS for your host.

To configure network (if not preselected):

Press Retrieve & Add Interfaces from Host Agent. Remove all interfaces except the relevant LAN’s

The example above shows VLANs. For VMs these are eth1, eth2. Please check which one is Client LAN or Server LAN

Press button Next.


56

With Mass Configuration you can select hosts with equal conditions (e.g. equal blades) and configure them in one step by pressing the button Save & Apply Mass Configuration.



Here you can select different host options. Go on with button Apply.


58



If you have configured all hosts you could check them by clicking on tab Hosts (Operations => Hosts).


60

Select a host and press button Monitoring Data to refresh the information.



3.5.6 Configure Systems and Instances

Switch to Configuration => Systems

Select the row with the database of the new system and press Edit button.


62

Here you can add Additional Information and Test DB Connection.

Also it’s possible to manage a Solution Manager Diagnostic Agent for DB.

It’s not necessary for the new SMD host based Agents.

Go on with button Next.



Select AC-Enabled.

Add virtual host name for Client LAN and select corresponding networks.

Press Retrieve from Host Agent to select the operating system.

You can also fill in Requirements for SAPS, Memory or a Preferred Host.

Press button Next.


64

Select Automounter in the Mount Points configuration (if not preselected).

Press button Next.



Press button Save or use Save & Mass Configuration, if you have similar system configurations.


66

Select the row for the central instance and press button Edit.



Here you can add Additional Information and Test Connection to the instance agent.

Also it’s possible to manage a Solution Manager Diagnostic Agent for instances.

It’s not necessary for the new SMD host based Agents.

If you have the same SID for a SAP System in different pools, it is

necessary to have a Universal Unique ID for those systems see SAP Note

1438774 and chapter Same SID in Different Pools of this document.

Go on with button Next.


68

Select AC-Enabled.

Add virtual host name for Server LAN and select corresponding networks.

Press Retrieve from Host Agent to select the operating system.

You can also fill in Requirements for SAPS, Memory or a Preferred Host.

Press button Next.



Select Automounter (if not preselected) and press button Next.


70

Press button Save or use button Save & Apply Mass Configuration, if you have similar system configurations.

Go on configuring the rest of the instances and other systems, like the examples above.

Start/Stop/Relocate Systems and Instances Installation and Configuration


Start/Stop/Relocate Systems and Instances 3.6

Switch to Operations => Systems tab.

Here you are able to start/stop and relocate the configured systems and instances. Therefor select the service row you like to operate on.

You can select the whole system for Mass Operations or …

Installation and Configuration Start/Stop/Relocate Systems and Instances

72

… an instance or DB for detail operations.

There is more help available under the link Help!

Same SID in Different Pools Installation and Configuration


Same SID in Different Pools 3.7

Stop all instances of SID (L7S) e.g.

First L7S system is running in pool p1 (Nothing changed)

Second L7S system is running in pool p2.

LVM is running in pool com.

Modify hostname in pool specific /etc/hosts of pool com and p2.

cn1:/FlexFrame/volFF/os/Linux/pool_img/com/etc # vi hosts

.

10.51.12.52 j00lvm j00lvm.myCompany.com

10.51.14.52 j00lvm-se j00lvm-se.myCompany.com

10.51.22.25 p2-app01l7s p2-app01l7s.myCompany.com

10.51.24.25 p2-app01l7s-se p2-app01l7s-se.myCompany.com



10.51.22.23 p2-cil7s p2-cil7s.myCompany.com

10.51.24.23 p2-cil7s-se p2-cil7s-se.myCompany.com

10.51.24.24 p2-dbl7s-se p2-dbl7s-se.myCompany.com

cn1:/FlexFrame/volFF/os/Linux/pool_img/p2/etc # vi hosts

10.51.24.5 cn2-p2-se





10.51.22.23 p2-cil7s p2-cil7s.myCompany.com

10.51.24.23 p2-cil7s-se p2-cil7s-se.myCompany.com

10.51.24.24 p2-dbl7s-se p2-dbl7s-se.myCompany.com

10.51.22.1 bx920-11

Create uuid:

bx920-12:~ # uuidgen

e3147c55-239c-4566-82d6-4b1fa299cadb

Change DEFAULT profile of system L7S in pool p2:

Installation and Configuration Same SID in Different Pools

74

dbl7s-se:l7sadm 53> vi DEFAULT.PFL

SAPSYSTEMNAME = L7S

SAPGLOBALHOST = p2-cil7s

login/system_client = 001

SAPDBHOST = p2-dbl7s-se

j2ee/dbtype = sap

j2ee/dbname = L7S

j2ee/dbhost = p2-dbl7s-se

j2ee/dbadminurl = http://p2-dbl7s-se:9999/webdbm?Server=dbl7s-se&Database=L7S&User=control

rdisp/bufrefmode = sendon,exeauto

DIR_PUT = /usr/sap/$(SAPSYSTEMNAME)/put

#-----------------------------------------------------------------------

# SAP Message Server for ABAP

#-----------------------------------------------------------------------

rdisp/mshost = p2-cil7s

rdisp/msserv = sapmsL7S

rdisp/msserv_internal = 3900

#-----------------------------------------------------------------------

# SAP Message Server for ABAP

#-----------------------------------------------------------------------

system/uuid = e3147c55-239c-4566-82d6-4b1fa299cadb

Change instance and start profiles of system L7S in pool p2.

dbl7s-se:l7sadm 54> mv L7S_DVEBMGS00_cil7s L7S_DVEBMGS00_p2-cil7s

dbl7s-se:l7sadm 55> vi L7S_DVEBMGS00_p2-cil7s

SAPSYSTEMNAME = L7S

SAPSYSTEM = 00

INSTANCE_NAME = DVEBMGS00

DIR_CT_RUN = $(DIR_EXE_ROOT)/run

DIR_EXECUTABLE = $(DIR_INSTANCE)/exe

SAPLOCALHOST = p2-cil7s

exe/saposcol = $(DIR_CT_RUN)/saposcol

dbl7s-se:l7sadm 56> mv START_DVEBMGS00_cil7s START_DVEBMGS00_p2-cil7s

dbl7s-se:l7sadm 55> vi START_DVEBMGS00_p2-cil7s

SAPSYSTEMNAME = L7S

SAPSYSTEM = 00

INSTANCE_NAME = DVEBMGS00

Same SID in Different Pools Installation and Configuration


DIR_CT_RUN = $(DIR_EXE_ROOT)/run

DIR_EXECUTABLE = $(DIR_INSTANCE)/exe

SAPLOCALHOST = p2-cil7s

DIR_PROFILE = /sapmnt/L7S/profile

_PF = $(DIR_PROFILE)/L7S_DVEBMGS00_p2-cil7s

SETENV_00 = LD_LIBRARY_PATH=$(DIR_LIBRARY):%(LD_LIBRARY_PATH)

Repeat above step for all instances and start profiles of system L7S in

pool p2.

Check and change if there are some SID specific entries in the sapservices file of pool p2:

bx920-12:/usr/sap/sapservices # vi sapservices

LD_LIBRARY_PATH=/usr/sap/L7S/DVEBMGS00/exe:$LD_LIBRARY_PATH; export LD_LIBRARY_PATH; /usr/sap/L7S/DVEBMGS00/exe/sapstartsrv pf=/usr/sap/L7S/SYS/profile/START_DVEBMGS00_p2-cil7s -D -u l7sadm

LD_LIBRARY_PATH=/usr/sap/L7S/D01/exe:$LD_LIBRARY_PATH; export LD_LIBRARY_PATH; /usr/sap/L7S/D01/exe/sapstartsrv pf=/usr/sap/L7S/SYS/profile/START_D01_p2-app01l7s -D -u l7sadm

……

Start all instances interfaces of L7S in pool p2 e.g.:

bx920-12: ff_service.sh -s L7S -a istart -t db

INFO: Version of ff_service.sh:

INFO: SAP version found: SAP-7.0

INFO: server_lan interface vlan24:1 10.51.24.24 is (already) up

INFO: Exit code: 0 (no error)

Start all instances of L7S in pool p2 e.g.:

dbl7s-se:l7sadm 53> startsap DVEBMGS00 p2-cil7s

Checking ADA db Database

------------------------------

Database is not available via R3trans

Running /usr/sap/L7S/SYS/exe/run/startdb

Now you can go on with chapter Configure systems and instances.

Troubleshooting Resource Unlock

76

4 Troubleshooting

Resource Unlock 4.1

If error messages like Resource could not be locked are displayed or some

resources are not available,

Resource Unlock Troubleshooting


go to NWA -> Problem Management -> Locks and release locks.

Often it’s also helpful to restart the routing-service.

Press Refresh button for routing service or start and stop application.

Troubleshooting Resource Unlock

78

SAPHostAgent Invalid Credentials Troubleshooting


SAPHostAgent Invalid Credentials 4.2

Check if password for sapadm in LVM Setup => Engine is the same like in LDAP!

Troubleshooting Invalid Response code 504

80

Invalid Response code 504 4.3

Invalid Response code 504: Please check if virtual hostnames are in /etc/hosts on the

host where your proxy is located. Sometimes it’s necessary to restart the proxy.

Check also that the instances are still up.


5 Abbreviations

ABAP Advanced Business Application Programming

ACC Adaptive Computing Controller

ACI Adaptive Computing Infrastructure

ACPI Advanced Configuration and Power Interface

APM Advanced Power Management

APO Advanced Planner & Optimizer

CIFS Common Internet File System

DHCP Dynamic Host Configuration Protocol

ERP Enterprise Resource Planning

ESF Enhanced System Facility

EULA End User License Agreement

FA FlexFrame (Autonomous) Agent

FC Fiber Channel

FF FlexFrame

FF4S FlexFrame for SAP

FFO FlexFrame Orchestrator

FSC FlexFrame Software Container, name part used for Images and CDs/DVDs

FTP File Transfer Protocol

IP Internet Protocol

LAN Local Area Network

LDAP Lightweight Directory Access Protocol

LUN Logical Unit Number

LVM Landscape Virtualization Management

MAC Media Access Control

MINRA Minimal Read Ahead

NAS Network Attached Storage

NDMP Network Data Management Protocol

Abbreviations

82

NIC Network Interface Card

NVRAM Non-Volatile Random Access Memory

OBP Open Boot Prom

OLTP On-Line Transaction Processing

ONTAP Open Network Technology for Appliance Products

OSS Open Source Software

POST Power-On Self Test

PXE Preboot Execution Environment

PY PRIMERGY

RAID Redundant Array of Independent (or Inexpensive) Disks

RARB Reverse Address Resolution Protocol

RDBMS Relational Database Management System

RHEL Red Hat Enterprise Linux

RSB Remote Service Board

SCS System Console Software

SAP BW SAP Business Warehouse

SAPGUI SAP Graphical User Interface

SAPOSS SAP Online System Service

SID System Identifier

SLD System Landscape Directory

SLES SuSE Linux Enterprise Server

SMB Server Message Block

SMC System Management Console

SPOC Single Point Of Control

TELNET Telecommunications Network

TFTP Trivial File Transfer Protocol

UDP User Datagram Protocol

UPS Uninterruptible Power Supply

VLAN Virtual Local Area Network

Abbreviations


VTOC Virtual Table Of Contents

WAN Wide Area Network

WAS Web Application Server

WAFL Write Anywhere File Layout

XSCF Extended System Control Facility


6 Glossary

Advanced Business Application Programming (ABAP)

Proprietary programming language of SAP.

Advanced Power Management (APM)

A standard for power saving and management in computers.

Application Agent

A software program for monitoring and managing applications.

Application Node (AN)

A host for applications (e.g. SAP instances db, ci, agate, wgate, app etc.). This

definition includes Application Servers as well as Database Servers.

Automounter

The automounter is an NFS utility that automatically mounts directories on an NFS

client as they are needed, and unmounts them when they are no longer needed.

Autonomous Agent

Central system management and high availability software component of FlexFrame.

Blade

A special form factor for computer nodes.

BRBACKUP

SAP backup and restore tools.

Client LAN

Virtual network segment within FlexFrame, used for client-server traffic.

Common Internet File System (CIFS)

A protocol for the sharing of file systems (same as SMB).

Computing Node

From the SAP ACI perspective: A host that is used for applications.

Control Agent

A software program for monitoring and managing nodes within FlexFrame.

Control LAN

Virtual network segment within FlexFrame, used for system management traffic.

Control Node (CN)

A physical computer system, controlling and monitoring the entire FlexFrame

landscape and running shared services in the rack (dhcp, tftp, ldap etc.).

Control Station

An Application Node running SAP LVM.

Glossary


Dynamic Host Configuration Protocol (DHCP)

DHCP is a protocol for assigning dynamic IP addresses to devices on a network.

Dynamic Host Configuration Protocol (DHCP) server

A DHCP server provides configuration parameters specific to the DHCP client host,

required by the host to participate on the Internet.

Enterprise Resource Planning (ERP)

Enterprise Resource Planning systems are management information systems that

integrate and automate many of the business practices associated with the

operations or production aspects of a company.

Ethernet

A Local Area Network which supports data transfer rates of 10 Megabits per second.

Fiber Channel

Fibre Channel is a serial computer bus intended for connecting high-speed storage

devices to computers.

Filer

Network attached storage for file systems.

FlexFrame®

The name FlexFrame® is a generic term for both „FlexFrame® for SAP®“ and

„FlexFrame® Orchestrator“.

FlexFrame® Orchestrator

This is the advancement of the Fujitsu solution FlexFrame for SAP and means a new

approach to offer enhanced functionality and features step by step and become more

and more independent from certain hardware and software components.

FlexFrame® for SAP

®

FlexFrame® for SAP

® is a Fujitsu solution and means a radically new architecture for

SAP environments. It exploits the latest business-critical computing technology to

deliver major cost savings for SAP customers. FlexFrame for SAP is a joint project in

which the main partners are SAP, Network Appliance, Intel and Fujitsu.

Gigabit Ethernet

A Local Area Network which supports data transfer rates of 1 Gigabit (1,024

Megabits) per second.

Host name

Name of a physical server as seen from outside the network. One physical server

may have multiple host names.

Image

In the FlexFrame documentation, “Image” is used as a synonym for “Hard Disk

Image”.

Glossary

86

Internet Protocol (IP) Address

A unique number used by computers to refer to each other when sending information

through networks using the Internet Protocol.

Landscape Virtualization Management (LVM)

SAP system for monitoring and controlling SAP landscapes.

Lightweight Directory Access Protocol (LDAP)

Protocol for Accessing on-line directory services.

Local Area Network (LAN)

A computer network that spans a relatively small area. Most LANs are confined to a

single building or group of buildings. However, one LAN can be connected to other

LANs over any distance via telephone lines and radio waves. A system of LANs

connected in this way is called a Wide Area Network (WAN).

Local host name

The name of the node (physical computer); it can be displayed and set using the

command /bin/hostname.

Logical Unit Number (LUN)

An address for a single (SCSI) disk drive.

MaxDB™

A relational database system from mySQL (formerly ADABAS and SAPDB).

Media Access Control (MAC) address

An identifier for network devices, usually unique. The MAC address is stored

physically on the device.

Netboot

A boot procedure for computers where the operating system is provided via a

network instead of local disks.

NetWeaver

SAP NetWeaver is the technical foundation of the SAP Business Suite solutions.

Network Appliance Filer

See “Filer”.

Network Attached Storage (NAS)

A data storage device that is connected via a network to one or multiple computers.

Network File System (NFS)

A network protocol for network-based storage access.

Network Interface Card (NIC)

A hardware device that allows computer communication via networks.

Node

A physical computer system controlled by an OS.

Glossary


Node name

The name of a physical node as returned by the command uname –n. Each node

name within a FlexFrame environment must be unique.

Non-Volatile Random Access Memory (NVRAM)

A type of memory that retains its contents when the power is turned off.

On-Line Transaction Processing (OLTP)

Transaction processing via computer networks.

OpenLDAP

An Open Source LDAP Service Implementation.

Open Network Technology for Appliance Products

The operating system of Network Appliance Filers.

Open Source Software (OSS)

Software that is distributed free of charge under an open source license, such as the

GNU General Public License.

Oracle RAC

A cluster database by Oracle Corporation.

Physical host

Name of a physical computer system (node).

Power-On Self Test (POST)

Part of a computer's boot process; automatic testing of diverse hardware

components.

Preboot Execution Environment

An environment that allows a computer to boot from a network resource without

having a local operating system installed.

PRIMERGY

Fujitsu's i386-based server product line.

Red Hat Enterprise Linux

Linux distribution by Red Hat, Inc., targeting business customers.

Reverse Address Resolution Protocol (RARP)

A protocol allowing resolution of an IP address corresponding to a MAC address.

SAP Service

In FlexFrame: SAP Services and DB Service.

SAP service script

An administration script for starting and stopping an SAP application on a virtual host.

SAP Solution Manager

Service portal for the implementation, operation and optimization of an SAP solution.

Glossary

88

SAPLogon

Front-end software for SAPGUI.

SAPRouter

Router for SAP services like SAPGUI or SAPTELNET.

Server

A physical host (hardware), same as node.

Service

A software program providing functions to clients.

Service type

The type of an application or service (db, ci, app, agate, wgate etc.).

Single Point of Control

In FlexFrame: One user interface to control a whole FlexFrame environment.

Storage LAN

A virtual LAN segment within a FlexFrame environment, carrying the traffic to the

Filer.

SuSE Linux Enterprise Server

A Linux distribution by Novell, specializing in server installations.

Trivial File Transfer Protocol

A simple form of the File Transfer Protocol (FTP). TFTP uses the User Datagram

Protocol (UDP) and provides no security features. It is often used by servers to boot

diskless workstations, X-terminals, and routers.

TFTP server

A simple FTP implementation.

Virtual Host

Before an application starts, the virtual host name is assigned to the physical host where

the application is to run. From the application's perspective, it always runs on the

same virtual host, even if the application is moved to another physical host.

The following rule forms the host names of virtual services:

<service_type>[<ID>]<SID>[<-LAN type]

where <service_type> can be one of:

ci - central instance (ABAP)

db - database instance

app - application instance (ABAP)

ascs - ABAP SAP central services instance

scs - JAVA SAP central services instance

jc - JAVA central instance

j - JAVA application instance

<ID> is a number from 00 to 96 (except: 2, 25, 43, 72, 89) for the service types app

and j only. It is empty for other service types.

Glossary


<SID> is the system ID of an SAP system.

<LAN type>

-se Server LAN

empty string Client LAN

This host name formation rule for virtual services is mandatory in version 3.2 of the

FlexFrame solution. Some components rely on this rule.

Within a FlexFrame environment, each node name must be unique. However, each

node may have multiple host names that are derived from the node name by a

defined naming rule.

In SAP environments host names are currently limited to 13 alphanumeric

characters including the hyphen (“-“). The first character must be a letter. In the SAP

environment host names are case-sensitive. (See SAP Note No. 611361)

Virtual Local Area Network

A VLAN is a logically segmented network mapped over physical hardware according

to the IEEE 802.1q standard.

Virtualization

Virtualization means the separation of hardware and processes. In a virtualized

environment (FlexFrame), a process can be moved between hardware nodes while

staying transparent to the user and application.