23
Ninth EELA Tutorial for Users and Managers www.eu-eela.org E-infrastructure shared between Europe and Latin America BDII Server Installation Yubiryn Ramírez G. ULA – Venezuela. Ninth EELA Tutorial Users and System Administrators. Bogotá, 09.03.2007.

BDII Server Installation

Embed Size (px)

DESCRIPTION

BDII Server Installation. Yubiryn Ramírez G. ULA – Venezuela. Ninth EELA Tutorial Users and System Administrators. Bogotá, 09.03.2007. This presentation is based on LCG and gLite manuals and previous EELA tutorials. Outline. Information System Overview How to install a BDII Server - PowerPoint PPT Presentation

Citation preview

Ninth EELA Tutorial for Users and Managers

www.eu-eela.org

E-infrastructure shared between Europe and Latin America

BDII Server Installation

Yubiryn Ramírez G.

ULA – Venezuela.

Ninth EELA Tutorial Users and System Administrators.

Bogotá, 09.03.2007.

Bogotá, Ninth EELA Tutorial, 09.03.2007 2

E-infrastructure shared between Europe and Latin America

• This presentation is based on LCG and gLite manuals and previous EELA tutorials

Bogotá, Ninth EELA Tutorial, 09.03.2007 3

E-infrastructure shared between Europe and Latin America

Outline

• Information System Overview

• How to install a BDII Server

• BDII customization and references

Bogotá, Ninth EELA Tutorial, 09.03.2007 4

E-infrastructure shared between Europe and Latin America

Information System Overview

• The Information System (IS) provides information about grid´s resources and their actual status.

Bogotá, Ninth EELA Tutorial, 09.03.2007 5

E-infrastructure shared between Europe and Latin America

Information System Levels

• Resource level: Grid Resource Information Server (GRIS)– One GRIS on top of each CE, SE, RB, MyProxy (no WNs).– Sensors and scripts get status of concrete resources statically (e.g.

GlueCEUniqueID) or dynamically (e.g. GlueCEStateWaitingJobs)

• Site level: Grid Index Information Server (GIIS) – Compiles all the information of the different GRISs in a site.– LCG-2 recommends using a BDII instead of a GIIS

Improves robustness and stability. Called the site BDII.

• Top level: Berkeley DB Information Index (BDII) – Keeps all Grid information about the VOs (generally only one). – Stores information from local BDIIs or GIISs in its database. – Only queries sites that are included in a configuration file.

Bogotá, Ninth EELA Tutorial, 09.03.2007 6

E-infrastructure shared between Europe and Latin America

BDII

• Users and other Grid services (such as the RB) can

query BDIIs to get information about the Grid status.

• Each BDII collects information from the site GIISes (or local BDII) defined in a configuration file, which is accessed through a web interfaces.

• Every two minutes a cron-job runs a script and collects information (pull model) from all the GIISes (local BDII) listed in the configuration file.

Bogotá, Ninth EELA Tutorial, 09.03.2007 7

E-infrastructure shared between Europe and Latin America

BDII

Each site can run

a BDII. It collects the information coming from the BDIIs/GIISs

At each site, a site GIIS collects the information

given by the GRISs

Local GRISs run on CE, SE, RB, MyProxy at each site and report dynamic and static information

Abbreviations:

BDII: Berkeley DataBase Information Index

GIIS: Grid Index Information Server

GRIS: Grid Resource Information Server

From LCG2.3.0 site GIIS has been replaced by“site” BDII

Bogotá, Ninth EELA Tutorial, 09.03.2007 8

E-infrastructure shared between Europe and Latin America

BDII

RB Local GRIS

SELocal GRIS

CE Local GRIS

BDII-A BDII-B

SELocal GRIS

SELocal GRIS

CE Local GRIS

SELocal GRIS

BDII-C

Site 1 Site 2 Site 3

Site BDII Site BDII Site BDII

Bogotá, Ninth EELA Tutorial, 09.03.2007 9

E-infrastructure shared between Europe and Latin America

Installing BDII Server

Bogotá, Ninth EELA Tutorial, 09.03.2007 10

E-infrastructure shared between Europe and Latin America

Pre-requisites

• Start from the base machine you installed in the INTRODUCTORY tutorial

• Verify that these packages are installed and properly configured:– Java SDK– Ntp daemon– CA_Gilda rpm– edg_VO_Gilda rpm– glite-yaim-3.0.0-11– gilda_ig-yaim-3.0.0-37

• Also check that your host certificates are present in /etc/grid-security and have proper permissions:

-rw-r--r-- 1 root root 1127 Jun 14 12:27 hostcert.pem-r-------- 1 root root 887 Jun 14 12:28 hostkey.pem

Bogotá, Ninth EELA Tutorial, 09.03.2007 11

E-infrastructure shared between Europe and Latin America

Glite and Gilda Metapackages

Matapackage Node type Description

Glite-BDII BDII A top level BDII

GILDA_ig_BDII GILDA_ig_BDII Gilda BDII

GILDA_ig_RB_BDII GILDA_ig_RB_BDII Gilda RB + BDII

• Usual combinación: RB and BDII

• CE and BDII: doesn´t work

Bogotá, Ninth EELA Tutorial, 09.03.2007 12

E-infrastructure shared between Europe and Latin America

site-info.def

• BDII_FCR: URL of the Freedom of Choice for Resources. (Web interface that provides a facility for VOs to modify resources list available for them on a BDII level, based on their own decision or Sites Functional Test (SFT) results)

• BDII_HOST: BDII Hostname.

• BDII_HTTP_URL: List of the GIIS (or site BDII) from which the BDII server fetches the information

• BDII_REGIONS: List of nodes publishing information on the BDII. BDII_REGIONS="CE SE RB LFC VOBOX PX FTS MON“BDII_CE_URL="ldap://$CE_HOST:2135/mds-vo-name=local,o=grid"BDII_SE_URL="ldap://$CLASSIC_HOST:2135/mds-vo-name=local,o=grid"……BDII_FTS_URL="ldap://$FTS_HOST:2170/mds-vo-name=resource,o=grid"BDII_MON_URL="ldap://$MON_HOST:2135/mds-vo-name=local,o=grid"

Bogotá, Ninth EELA Tutorial, 09.03.2007 13

E-infrastructure shared between Europe and Latin America

site-info.def

Copy http://mnto04.uniandes.edu.co/Base/gilda_ig-site-info.def into /root/my-site-info.def

and edit these fields:

BDII_HOST=eventogridXX.uniandes.edu.co

Bogotá, Ninth EELA Tutorial, 09.03.2007 14

E-infrastructure shared between Europe and Latin America

Installation and Configuration

• Install the BDII server:

/opt/glite/bin/gilda_ig_install_node /root/my-site-info.def GILDA_ig_BDII

• Configure the BDII server:

/opt/glite/bin/gilda_ig_configure_node /root/my-site-info.def GILDA_ig_BDII

Bogotá, Ninth EELA Tutorial, 09.03.2007 15

E-infrastructure shared between Europe and Latin America

Firewall configuration

Be sure that your firewall is open for bdii listening port 2170:

In /etc/sysconfig/iptables add:

-A RH-Firewall-1-INPUT -m state --state NEW -m tcp

-p tcp --dport 2170 -j ACCEPT

service iptables restart

Bogotá, Ninth EELA Tutorial, 09.03.2007 16

E-infrastructure shared between Europe and Latin America

BDII Server Testing & Customization

Bogotá, Ninth EELA Tutorial, 09.03.2007 17

E-infrastructure shared between Europe and Latin America

BDII testing

• Issue an ldapsearch to check if BDII is correctly publishing sites informations:ldapsearch -x -h <hostname> -p 2170 -b 'mds-vo-name=local,o=grid‘

• Log into a LCG User Interface machine and use lcg-infosites:export LCG_GFAL_INFOSYS=<hostname>:2170

lcg-infosites --vo gilda ce

Bogotá, Ninth EELA Tutorial, 09.03.2007 18

E-infrastructure shared between Europe and Latin America

BDII customization

• BDII configuration file can be found in

/opt/bdii/etc/bdii.conf

Bogotá, Ninth EELA Tutorial, 09.03.2007 19

E-infrastructure shared between Europe and Latin America

BDII customization

BDII_PORT_READ=2170BDII_PORTS_WRITE="2171 2172 2173"BDII_USER=edguserBDII_BIND=mds-vo-name=local,o=gridBDII_PASSWD=26082BDII_SEARCH_FILTER='(|(objectClass=GlueSchemaVersion)(objectClass=GlueTop))'BDII_SEARCH_TIMEOUT=30BDII_BREATHE_TIME=60 every 2 minute BDII cache is refreshedBDII_AUTO_UPDATE=yes the list of GIIS is dynamic (no=static) BDII_AUTO_MODIFY=noBDII_DIR=/opt/bdii/BDII_UPDATE_URL=http://grid018.ct.infn.it/fileadmin/bdii/glite-bdii-update.confBDII_UPDATE_LDIF=http://SLAPD=/usr/sbin/slapdSLAPADD=/usr/sbin/slapadd

Bogotá, Ninth EELA Tutorial, 09.03.2007 20

E-infrastructure shared between Europe and Latin America

BDII customization

BDII log files in

/opt/bdii/var/bdii.log

Bogotá, Ninth EELA Tutorial, 09.03.2007 21

E-infrastructure shared between Europe and Latin America

BDII customization (II)

• Example:

– Change BDII_UPDATE_URL to:http://grid-deployment.web.cern.ch/grid-deployment/gis/lcg2-bdii/dteam/lcg2-all-sites.conf

– Restart the service with: /etc/init.d/bdii restart

– Give a look to the new information published by the service

Bogotá, Ninth EELA Tutorial, 09.03.2007 22

E-infrastructure shared between Europe and Latin America

BDII customization (III)

The file /opt/bdii/etc/bdii-update.conf contains the list of GIIS:...INFN-CATANIA ldap://grid010.ct.infn.it:2170/mds-vo-name=infn-catania,o=grid # 2.6.0

INFN-CNAF ldap://grid011f.cnaf.infn.it:2170/mds-vo-name=infn-cnaf,o=grid # 2.6.0

INFN-PADOVA ldap://gilda-ce-01.pd.infn.it:2170/mds-vo-name=infn-padova,o=grid # 2.6.0

IISAS-BRATISLAVA ldap://dgt01.ui.savba.sk:2170/mds-vo-name=iisas-gilda,o=grid # 2.6.0

ULA-MERIDA ldap://grid006.cecalc.ula.ve:2170/mds-vo-name=ula-merida,o=grid

Bogotá, Ninth EELA Tutorial, 09.03.2007 23

E-infrastructure shared between Europe and Latin America

References

• LCG-2 User Guidehttps://edms.cern.ch/file/454439//LCG-2-UserGuide.html

• gLite 3.0 User Guidehttps://edms.cern.ch/file/722398/1.1/gLite-3-UserGuide.pdf

• gLite 3.0 Generic Installation and Configuration Guide http://grid-deployment.web.cern.ch/grid-deployment/documentation/

LCG2-Manual-Install/

• BDII Documentation:https://twiki.cern.ch/twiki//bin/view/EGEE/BDII

https://twiki.cern.ch/twiki/bin/view/LCG/BdiiNotes