View
215
Download
0
Category
Tags:
Preview:
Citation preview
Sejong STATUS
Chang Yeong CHOI
CERN, ALICE
LHC Computing Grid Tier-2 Workshop in Asia, 1th December 2006
Chang Yeong CHOI(CERN, ALICE)
LHC Computing Grid Tier-2 Workshop in Asia, 1th December 2006
OUTLINE
Sejong Farm Working with ALICE Network status Sejong Report in PDC06 Issues in PDC06 Plan during 2007 Summary
Chang Yeong CHOI(CERN, ALICE)
LHC Computing Grid Tier-2 Workshop in Asia, 1th December 2006
Sejong FARM
Chang Yeong CHOI(CERN, ALICE)
LHC Computing Grid Tier-2 Workshop in Asia, 1th December 2006
Sejong Farm (1)
Since 2004 Tier 2 for ALICE One Front-End server for ALICE CE,SE. One storage server with 1.25 TB 32 CPUs as Worker Node
Support ALICE jobs: 23 CPUs Support local jobs: 9 CPUs
Network switches : 1Gbps : For Front-End server 100Mbps: For Worker Nodes
Chang Yeong CHOI(CERN, ALICE)
LHC Computing Grid Tier-2 Workshop in Asia, 1th December 2006
100Mbps switch
Sejong Farm (2)
Storage:1.25TBRAID 5
Front-End serverCPU: intel 2.8Ghz
Memory: 2GB
Swap: 4GB
Network: 1Gbps
Services: PBS server, Ganglia (gmetad)
NFS mount directory: /home1Gbps
switch
NFS mount directory: /scratch
wknode1
wknode32
CPU: intel 2.8Ghz
Memory: 2GB
Swap: 4GB
Network: 100Mbps
Services: PBS client,
Ganglia (gmond)
wknode1
wknode32
CPU: intel 2.8Ghz
Memory: 2GB
Swap: 4GB
Network: 100Mbps
Services: PBS client,
Ganglia (gmond)
AliEn
Chang Yeong CHOI(CERN, ALICE)
LHC Computing Grid Tier-2 Workshop in Asia, 1th December 2006
Sejong
WORKING WITH ALICE
Chang Yeong CHOI(CERN, ALICE)
LHC Computing Grid Tier-2 Workshop in Asia, 1th December 2006
VO-BOX for only ALICE
All services on the same machine Cluster Monitor Computing Element (CE) : Batch system->PBS Storage Element (SE): Mass Storage System-> File Package Manager (PackMan) Monitoring system (MonaLisa) The File Transfer Daemon (FTD)
WORKING WITH ALICE -
Chang Yeong CHOI(CERN, ALICE)
LHC Computing Grid Tier-2 Workshop in Asia, 1th December 2006
Certificate request For ALICE VO [machine]:/home/aliprod> alien host-cert-request
Country Name (2 letter code) [ch]:
Organization Name (eg, company) [AliEn]:
Organizational Unit Name (eg, section) []:ALICE
Common Name (eg, YOUR name) []:
alicece.sejong.ac.kr/SE
WORKING WITH ALICE -
Chang Yeong CHOI(CERN, ALICE)
LHC Computing Grid Tier-2 Workshop in Asia, 1th December 2006
Sejong info in LDAP
WORKING WITH ALICE -
Chang Yeong CHOI(CERN, ALICE)
LHC Computing Grid Tier-2 Workshop in Asia, 1th December 2006
NETWORK STATUS
Chang Yeong CHOI(CERN, ALICE)
LHC Computing Grid Tier-2 Workshop in Asia, 1th December 2006
Network connection Between CERN and Sejong (1)
GLORIAD (GLObal RIng Network for Advanced Applications Development) with 10/40Gbps Optical lambda networking
KREONet2 (Korea Research Environment Open NETwork)
CERN KISTI SEJONG
GLORIAD
10Gbps
KREONet2
1Gbs
NETWORK STATUS -
Chang Yeong CHOI(CERN, ALICE)
LHC Computing Grid Tier-2 Workshop in Asia, 1th December 2006
Network connection Between CERN and Sejong (2)
KISTI, Korea KISTI, Korea (Daejeon)(Daejeon)
CNIC, ChinaHong Kong
Beijing
Russia (Novosibirsk)
Amsterdam
MoscowUS Seattle
CANARIE, Canada
ChicagoEU
NYC
10G(KR-US)
10G(KR-HK)
Calgary Toronto
* TGN (Tyco Global Network ) : Korea to US
* FNAL (FLAG North Asia Loop) : Korea to HK
2.5G
10G
HKLight
CSTNET
Korea
OC192
OC192
OC192KR GLIF
Exchange Point
Hong Kong, CN 2*10GE
KREONET
Seattle, US
GLIF node(CANARIE,
PW)
KR/CANARIE nodes(L1, L2)
PacificWave
OC192
10GE
OC192
Korea
StarLight
Sejong
1Gbps
cern
Picture from KISTI
NETWORK STATUS -
Chang Yeong CHOI(CERN, ALICE)
LHC Computing Grid Tier-2 Workshop in Asia, 1th December 2006
SCP TEST with KT network
Before 2006.6
100KB/s
IPERF and SCP TEST with KISTI network since 2006.6:
The network bandwidth was 1Gbps between KISTI and Sejong, but local network switches were 10/100Mbps
6MB/s
2.5MB/s
Scp : Outgoing bandwidth
With 1 Gbps switch
Network bandwidth between CERN
and Sejong
NETWORK STATUS -
Chang Yeong CHOI(CERN, ALICE)
LHC Computing Grid Tier-2 Workshop in Asia, 1th December 2006
Sejong REPORT IN PDC06
Sejong
Chang Yeong CHOI(CERN, ALICE)
LHC Computing Grid Tier-2 Workshop in Asia, 1th December 2006
Productions in PDC06
Running service : VO-BOX Production started in July 2006 Max jobs: 23 Produced 1.8GB of data (raw.root: 800MB,
root_archive.zip: 60MB) The raw.root and the root_archive.zip were sent to
CERN by xrootd Other data removed from the work directory.
Sejong REPORT IN PDC06 -
Chang Yeong CHOI(CERN, ALICE)
LHC Computing Grid Tier-2 Workshop in Asia, 1th December 2006
Resources statistics of ALICE Resources contribution (normalized Si2K units): 50% from T1s, 50% from T2s
The role of the T2 remains very high!
Sejong REPORT IN PDC06 -
Chang Yeong CHOI(CERN, ALICE)
LHC Computing Grid Tier-2 Workshop in Asia, 1th December 2006
Report on Sejong activity
Sejong support only ALICE
Sejong REPORT IN PDC06 -
Chang Yeong CHOI(CERN, ALICE)
LHC Computing Grid Tier-2 Workshop in Asia, 1th December 2006
VO Box and AliEn services status of Sejong with MonaLisa
Sejong REPORT IN PDC06 -
Chang Yeong CHOI(CERN, ALICE)
LHC Computing Grid Tier-2 Workshop in Asia, 1th December 2006
Done jobs
Sejong REPORT IN PDC06 -
Chang Yeong CHOI(CERN, ALICE)
LHC Computing Grid Tier-2 Workshop in Asia, 1th December 2006
Outgoing Traffic
Sejong REPORT IN PDC06 -
Chang Yeong CHOI(CERN, ALICE)
LHC Computing Grid Tier-2 Workshop in Asia, 1th December 2006
Network speed for one job Network speed was 76.8KB/s for one job
We hoped the speed was 100KB/s at least That is why we put 23 for max jobs:
Network bandwidth is 2.5MB/s on average
Sejong REPORT IN PDC06 -
Chang Yeong CHOI(CERN, ALICE)
LHC Computing Grid Tier-2 Workshop in Asia, 1th December 2006
Sejong(CE) status with Ganglia
During 6 months
With KISTI network
Sejong REPORT IN PDC06 -
Chang Yeong CHOI(CERN, ALICE)
LHC Computing Grid Tier-2 Workshop in Asia, 1th December 2006
Sejong (worker nodes) status with Ganglia
Jobs status on PBS
Sejong REPORT IN PDC06 -
Chang Yeong CHOI(CERN, ALICE)
LHC Computing Grid Tier-2 Workshop in Asia, 1th December 2006
ISSUES IN PDC06
Most serious problem was related to network
Chang Yeong CHOI(CERN, ALICE)
LHC Computing Grid Tier-2 Workshop in Asia, 1th December 2006
PackMan issue
PackMan could not get packages from AliEn because it timed out. Solution:
SOAP.pm : row 418print"Putting A Longer Timeout \n"; $self->{$service} = SOAP::Lite->uri($serviceName)->proxy($host,timeout=>400)->on_fault($my_faultSub);
ISSUES IN PDC06 -
Chang Yeong CHOI(CERN, ALICE)
LHC Computing Grid Tier-2 Workshop in Asia, 1th December 2006
Depend on Network:Compare with Kolkatta (1)
7 jobs for saving For one job:
Kolkatta = 0.28MB/s
Sejong = 0.077MB/s
About 3.6 times difference
ISSUES IN PDC06 -
Chang Yeong CHOI(CERN, ALICE)
LHC Computing Grid Tier-2 Workshop in Asia, 1th December 2006
Depend on Network:Compare with Kolkatta (2)
Running and Saving job During one day
ISSUES IN PDC06 -
Chang Yeong CHOI(CERN, ALICE)
LHC Computing Grid Tier-2 Workshop in Asia, 1th December 2006
Done jobs during one day
2350
Depend on Network:Compare with Kolkatta (3)
ISSUES IN PDC06 -
Chang Yeong CHOI(CERN, ALICE)
LHC Computing Grid Tier-2 Workshop in Asia, 1th December 2006
Depend on Network:Compare with Kolkatta (4)
ISSUES IN PDC06 -
Chang Yeong CHOI(CERN, ALICE)
LHC Computing Grid Tier-2 Workshop in Asia, 1th December 2006
Plan during 2007
We are trying to organize ALICE Tier 2 center in collaboration with KISTI situated at KISTI
The scale will be
CPU (kSI2K) 300 or 100
DISK (TBytes) 50 or 30
10G SWITCH 1
File Server 2
Chang Yeong CHOI(CERN, ALICE)
LHC Computing Grid Tier-2 Workshop in Asia, 1th December 2006
Summary The Sejong network bandwidth has an increase of about
2.5MB/s on the average with KISTI network since 2006.6 Now the Sejong site gets 23 jobs from the AliEn on the
grid : one job produce 1.8 GB of data. The raw.root (800MB) and the root_archive.zip (60MB)
which are one of the produced data from only one finished job move to CERN storages (Castor) with about 76KB/s network bandwidth.
Although every network system is 1Gbps, the network bandwidth between CERN and Sejong is still about 2.5MB/s on the average.
A stable and high performance network is very important to work on the Grid.
Recommended