27/04/05 Sabah Salih

Sabah SalihParticle Physics Group

The School of Physics and Astronomy

The University of Manchester

http://www.hep.man.ac.uk/u/sabah

27/04/05 Sabah Salih

Manchester HEP • Desktop/ Laptop 30 Desktop running RH 7.3 20 Laptop Windows XP & RH OS X• Home server AFS using openafs 3 DB servers

Kerberos 4 we will move to kerberos 5 by sept.• Web server AFS• Mail Server NFS• Backup• We used Kickstart for the installation• Security• 5 Farms

27/04/05 Sabah Salih

Storage Space 26 TB

14 TB Apple Xraid Servers 5 TB Babar 3ware 5 TB D0 3ware 1 TB Users 3ware

27/04/05 Sabah Salih

Software

• D0 Software mounted via NFS to the farm• Atlas Software mounted via NFS to the

farm • CERN Software via AFS

27/04/05 Sabah Salih

Network

Network

Wireless11M

Farms

1GB

Servers Users Machens

100M

Default denyDefault allowDefault Deny

27/04/05 Sabah Salih

Machines room1G available to every machine thatneed 1G connection.

27/04/05 Sabah Salih

Farm2

30 dual-processor PC’s 2GH AMDUsed for D0 and Atlas.2 GB Memory

PBS batch system is used to direct jobs to the

worker nodes, with a maximum of 2 jobs per dual-processor worker node.

There is a SAM station attached to this farm.

and we running JIM which is much easy and

user friendly than LCG.

27/04/05 Sabah Salih

Farm 3 Apple G5 No need for Linux

This is new 7 X-server with 14 TB Disks We are using it to run simulation work have started testing Atlas and D0 simulation and analysis

Farm 416 Single processor Used for Grid Testbed

27/04/05 Sabah Salih

Future

1000 Nodes to come with 200 TB via Dcache Will be installed with LCG software. Tender has gone Through and we are selecting vendors

Farm 5

Tier 2 Farm

26 xpc Shuttle

13 P4 machines 3GHz

13 AMD 64 bit machines 3.2 GHz

Dcache testing is in progress.

27/04/05 Sabah Salih

FarmsFarm1 consists of 40 dual-processor worker nodes

with 800 MHz PIII processors and 1 GB of memory.

Two gatekeeper machines, bfa and bfb, provide front-end

access and NFS servers for the farm. The PBS batch system is

used to direct jobs to the worker nodes, with a maximum of 2

jobs per dual-processor worker node.

Gatekeepers and worker nodes are installed using the AFS

Cluster's kickstart procedure, and are very similar to the

Redhat Linux 7.3 desktop machines. Although full access to

AFS is available, temporary

Farms

27/04/05 Sabah Salih

Problems1- UI installation required /usr/local to be local

2- Mail ServerWe are trying to use SL and CyrusSending:Email Client ---> Postfix authentication and SMTP ---postfix ----> Internet

Receiving: POSTFIX

Internet ----> Fetchmail ----> Procmail----> CYRUS-IMAP-SERVER ---->EMAIL CLIENT

27/04/05 Sabah Salih

Sabah Salih Hep sysman meeting

CYRUS Installation

In file included from /usr/include/openssl/ssl.h:179, from prot.h:56, from prot.c:72:/usr/include/openssl/kssl.h:72:18: krb5.h: No such file or directoryIn file included from /usr/include/openssl/ssl.h:179, from prot.h:56, from prot.c:72:/usr/include/openssl/kssl.h:134: syntax error before "krb5_enctype"/usr/include/openssl/kssl.h:136: syntax error before '*' token/usr/include/openssl/kssl.h:137: syntax error before '}' token/usr/include/openssl/kssl.h:149: syntax error before "kssl_ctx_setstring"/usr/include/openssl/kssl.h:149: syntax error before '*' token/usr/include/openssl/kssl.h:150: syntax error before '*' token/usr/include/openssl/kssl.h:151: syntax error before '*' token/usr/include/openssl/kssl.h:151: syntax error before '*' token/usr/include/openssl/kssl.h:152: syntax error before '*' token

27/04/05 Sabah Salih

/usr/include/openssl/kssl.h:153: syntax error before "kssl_ctx_setprinc"/usr/include/openssl/kssl.h:153: syntax error before '*' token/usr/include/openssl/kssl.h:155: syntax error before "kssl_cget_tkt"/usr/include/openssl/kssl.h:155: syntax error before '*' token/usr/include/openssl/kssl.h:157: syntax error before "kssl_sget_tkt"/usr/include/openssl/kssl.h:157: syntax error before '*' token/usr/include/openssl/kssl.h:159: syntax error before "kssl_ctx_setkey"/usr/include/openssl/kssl.h:159: syntax error before '*' token/usr/include/openssl/kssl.h:161: syntax error before "context"/usr/include/openssl/kssl.h:162: syntax error before "kssl_build_principal_2"/usr/include/openssl/kssl.h:162: syntax error before "context"/usr/include/openssl/kssl.h:165: syntax error before "kssl_validate_times"/usr/include/openssl/kssl.h:165: syntax error before "atime"/usr/include/openssl/kssl.h:167: syntax error before "kssl_check_authent"/usr/include/openssl/kssl.h:167: syntax error before '*' token/usr/include/openssl/kssl.h:169: syntax error before "enctype"In file included from prot.h:56, from prot.c:72:

27/04/05 Sabah Salih

/usr/include/openssl/ssl.h:909: syntax error before "KSSL_CTX"/usr/include/openssl/ssl.h:931: syntax error before '}' tokenmake[1]: *** [prot.o] Error 1make[1]: Leaving directory `/tmp/cyrus-imapd-2.2.12/lib'make: *** [all] Error 1[root@pc94 cyrus-imapd-2.2.12]#

[root@pc94 root]# export LOCALDEFS="-DOPENSSL_NO_KRB5"

27/04/05 Sabah Salih

Future Plan,Physics Building refurbished withnew very small machines room.

Firewall to move to MCC Ciscothis will enable users to have 1Gconnection.

Use Dcache with users desktop