26
hursday 12/10/2006 [email protected] The In and Out of The Manchester Particle Physics Computing Sabah Salih

Thursday 12/10/[email protected] The In and Out of The Manchester Particle Physics Computing Sabah Salih

Embed Size (px)

Citation preview

Page 1: Thursday 12/10/2006Sabah.Salih@manchester.ac.uk The In and Out of The Manchester Particle Physics Computing Sabah Salih

Thursday 12/10/2006 [email protected]

The In and Out of The Manchester Particle Physics

Computing

Sabah Salih

Page 2: Thursday 12/10/2006Sabah.Salih@manchester.ac.uk The In and Out of The Manchester Particle Physics Computing Sabah Salih

Thursday 12/10/2006 [email protected]

HardwareNetworkSoftwareBackupEmailCollaborative tools “eg VC ,Skype” next week

Page 3: Thursday 12/10/2006Sabah.Salih@manchester.ac.uk The In and Out of The Manchester Particle Physics Computing Sabah Salih

Thursday 12/10/2006 [email protected]

Hardware

1- Users Desktop2- Home Servers3- Disks Servers4- Farms5- Printers

Page 4: Thursday 12/10/2006Sabah.Salih@manchester.ac.uk The In and Out of The Manchester Particle Physics Computing Sabah Salih

Thursday 12/10/2006 [email protected]

Users Desktop

We run Scientific Linux 304

1-USBcd /mnt/auto/usb

2- DVDuse k3bk3b

Page 5: Thursday 12/10/2006Sabah.Salih@manchester.ac.uk The In and Out of The Manchester Particle Physics Computing Sabah Salih

[email protected] 12/10/2006

3- /var/tmpa- Download pdf, ps,….

c- music?Please copy your music to a dvd. examplepop, Indy, Rock,….copy each 4GB to a DVD or two.

c- /etc/cron.daily/tmpwatch/usr/sbin/tmpwatch 240 /tmp/usr/sbin/tmpwatch 720 /var/tmp

Page 6: Thursday 12/10/2006Sabah.Salih@manchester.ac.uk The In and Out of The Manchester Particle Physics Computing Sabah Salih

Thursday 12/10/2006 [email protected]

Home Servers

We have 3 home Severs. They run AFS

Please make sure you have a valid tokenYour token last only for 24 hours

klog

Please readhttp://www.hep.man.ac.uk/local/afshelp/afs-hep.html

Page 7: Thursday 12/10/2006Sabah.Salih@manchester.ac.uk The In and Out of The Manchester Particle Physics Computing Sabah Salih

[email protected] 12/10/2006

We have to areas:

1- Users area:/afs/hep.man.ac.uk/u2- 4 GB for each users

2- Experiment area/afs/hep.man.ac.uk/g10 to 60 GB for each experiments

Page 8: Thursday 12/10/2006Sabah.Salih@manchester.ac.uk The In and Out of The Manchester Particle Physics Computing Sabah Salih

Thursday 12/10/2006 [email protected]

Disks Servers

hepdata01 is the existing hepdata01 hepdata02 is the existing hepdata02 hepdata03 is the existing babardisk1 hepdata04 is the existing babardisk2 hepdata05 is the existing babardisk3 hepdata06 is the existing work (used by babar) hepdata07 is the existing data, data1 and data2 (used by D0) hepdata08 is the existing home (used by D0) hepdata09 is the existing home1 (used by D0 and full) hepdata10 is the existing home2 (used by D0 and full)

Page 9: Thursday 12/10/2006Sabah.Salih@manchester.ac.uk The In and Out of The Manchester Particle Physics Computing Sabah Salih

[email protected] 12/10/2006

Name Current Size Future Size hepdata01 .65 TB 1.6 TB hepdata02 1.6 TB 1.6 TB hepdata03 1.3 TB 1.3 TB hepdata04 1.3 TB 1.3 TB hepdata05 1.3 TB 1.3 TB hepdata06 1.6 TB 1.6 TB hepdata07 1.6 TB 1.6 TB hepdata08 .65 TB 1.6 TB hepdata09 .65 TB 1.6 TB hepdata10 .65 TB 1.6 TB

Disks Servers

Page 10: Thursday 12/10/2006Sabah.Salih@manchester.ac.uk The In and Out of The Manchester Particle Physics Computing Sabah Salih

[email protected] 12/10/2006

The above upgrade will give us 3 TB extraAt the moment if you need disk spaceplease use /hepdata02

From any linux8 or df?? Machines

cd /nfs/hepdata01

Disks Servers

Page 11: Thursday 12/10/2006Sabah.Salih@manchester.ac.uk The In and Out of The Manchester Particle Physics Computing Sabah Salih

Farms

[email protected] 12/10/2006

1- D Zero Farm 30 Dual 2 GHz AMD with 2GB of Memory ineach node Each node installed like any linux8 machineto access the nodes ssh df00 - df29

2- Babar Farmhalf dead due to power problem.

3- Apple Farm 6 Dual G5 with 4 GB of memory in each node

Please make sure you an upto date copy of your code in AFS

Page 12: Thursday 12/10/2006Sabah.Salih@manchester.ac.uk The In and Out of The Manchester Particle Physics Computing Sabah Salih

[email protected] 12/10/2006

Network

MCC

194.36.3.Firewall

194.36.2.Printers, Users Desktops, And laptops, linux

No Printer accessNo Mail accessFast machinesFarms node,Linux8, Disks servers

Page 13: Thursday 12/10/2006Sabah.Salih@manchester.ac.uk The In and Out of The Manchester Particle Physics Computing Sabah Salih

[email protected] 12/10/2006

Software

Common software like “ROOT” , mathematica,….Are installed in each desktop, node,….

Use the following to find the path if you need it

which root/opt/root/bin/rootwhich mathematica/usr/site/mathematica/5.0/Executables/mathematica

Page 14: Thursday 12/10/2006Sabah.Salih@manchester.ac.uk The In and Out of The Manchester Particle Physics Computing Sabah Salih

[email protected] 12/10/2006

Software

Each experiment have a software are in partition“G”/afs/hep.man.ac.uk/g

[root@afs5 root]# ls /afs/hep.man.ac.uk/g accelerators babar calice grid kickstart atlas bfactory dzero hepbackup nemo sw[root@afs5 root]#

[root@afs5 root]# ls /afs/hep.man.ac.uk/g/swcern oldroot packages root usr.local.73 usr.local.SL3[root@afs5 root]#

Page 15: Thursday 12/10/2006Sabah.Salih@manchester.ac.uk The In and Out of The Manchester Particle Physics Computing Sabah Salih

[email protected] 12/10/2006

Mounted area in each desktop

/usr/site[sabah@pc93 newsabah]$ ls /usr/site/manchesterSL3 mathematica matlabR14[sabah@pc93 newsabah]$

[sabah@pc93 newsabah]$ ls /usr/site/manchesterSL32006 bin etc mysqlv5 usr.local.SL3[sabah@pc93 newsabah]$

Software

Page 16: Thursday 12/10/2006Sabah.Salih@manchester.ac.uk The In and Out of The Manchester Particle Physics Computing Sabah Salih

[email protected] 12/10/2006

Backup

MonthlyAnd daily[root@afs5 root]# ls /backup/2006 current lost+found[root@afs5 root]# [root@afs5 root]# ls /backup/2006/10[root@afs5 root]# [root@afs5 root]# ls /backup/2006/1003 04 05 06 07 08[root@afs5 root]#

Page 17: Thursday 12/10/2006Sabah.Salih@manchester.ac.uk The In and Out of The Manchester Particle Physics Computing Sabah Salih

[email protected] 12/10/2006

1[root@afs5 root]# ls /backup/2006/10/08/04\:45\:00/u/anthony chrisg joe nasim pallis rmj sabah swildbjorn farah kyrieleis nbarlow philip robert sbray yazidchiayawming irina mark owen pjtelford rosa shiv yslin[root@afs5 root]#

Backup

Page 18: Thursday 12/10/2006Sabah.Salih@manchester.ac.uk The In and Out of The Manchester Particle Physics Computing Sabah Salih

[email protected] 12/10/2006

More important Please make a date stamp of anyFile before you modefy

ExampleFor a file

cp -p pointer-2.cpp pointer-2.cpp.111006

For a dircp -rp Please Please never use “mv”

Backup

Page 19: Thursday 12/10/2006Sabah.Salih@manchester.ac.uk The In and Out of The Manchester Particle Physics Computing Sabah Salih

[email protected] 12/10/2006

EmailPlease make do the following:

1- Send a text message only with your email.2- Do not send an attachment unless you have to

a- If you sharing a document with other member of the group then create a dir and set the ACL to be access by you and that person

fs setacl -dir /afs/hep.man.ac.uk/u/sabah/babar -acl nbarlow write

Page 20: Thursday 12/10/2006Sabah.Salih@manchester.ac.uk The In and Out of The Manchester Particle Physics Computing Sabah Salih

[email protected] 12/10/2006

b- If you sharing the information with external person then put the information in a web page and setup a username and passwd

http://www.cse.unsw.edu.au/faq/questions/www-htaccess.html#sslexamplecd /afs/hep.man.ac.uk/u/sabah/WWW/newsabah/vi .htaccessAdd the following

Email

Page 21: Thursday 12/10/2006Sabah.Salih@manchester.ac.uk The In and Out of The Manchester Particle Physics Computing Sabah Salih

AuthUserFile /afs/hep.man.ac.uk/u/sabah/WWW/newsabah/.htpasswdAuthGroupFile /dev/nullAuthName ByPasswordAuthType Basic<IfModule mod_ssl.c>SSLRequireSSL</IfModule><IfModule !mod_ssl.c># no non-ssl accessorder allow,deny</IfModule>

<Limit GET>require user myfriend

</Limit>

Email

Thursday 12/10/2006 [email protected]

Page 22: Thursday 12/10/2006Sabah.Salih@manchester.ac.uk The In and Out of The Manchester Particle Physics Computing Sabah Salih

[email protected] 12/10/2006

/usr/bin/htpasswd -c .htpasswd myfriendNew password: Re-type new password: Adding password for user myfriend

wget -nH -nd -r -l2 -np -P/var/tmp/newsabah --no-check-certificate --http-user=myfriend --http-passwd=mooandmoo https://www.hep.man.ac.uk/u/sabah/newsabah/

cd /afs/hep.man.ac.uk/u/sabah/bin/chmod 700 wget-passwd.sh./wget-passwd.sh

Email

Page 23: Thursday 12/10/2006Sabah.Salih@manchester.ac.uk The In and Out of The Manchester Particle Physics Computing Sabah Salih

[email protected] 12/10/2006

Library accessTo access the Library Please use the following proxy “Thanks to Jeff” :

http://www.hep.man.ac.uk/config.pac

Library

Page 24: Thursday 12/10/2006Sabah.Salih@manchester.ac.uk The In and Out of The Manchester Particle Physics Computing Sabah Salih

[email protected] 12/10/2006

$grep [sabah@pc93 sabah]$ cd afsserver/txt/[sabah@pc93 txt]$ grep kas * |grep adminafs1-history-110306.txt:kas setpassword hepbackup -admin admin

$tar When you copy dir please use tar

tar -zcvf /var/tmp/newsabah.tar.gz newsabah

[sabah@pc103 WWW]$ uname -npc103.hep.man.ac.uk

Useful note

.bash_history file

Page 25: Thursday 12/10/2006Sabah.Salih@manchester.ac.uk The In and Out of The Manchester Particle Physics Computing Sabah Salih

[email protected] 12/10/2006

Environment variables and .bashrc

Please do not put you experiment environmental Setup in .bashrcIf you do so thing will break.some of the software will run and some will not.

Page 26: Thursday 12/10/2006Sabah.Salih@manchester.ac.uk The In and Out of The Manchester Particle Physics Computing Sabah Salih

[email protected] 12/10/2006

Thank you So Much