Sejong STATUS Chang Yeong CHOI CERN, ALICE LHC Computing Grid Tier-2 Workshop in Asia, 1 th December 2006

Sejong STATUS

Chang Yeong CHOI

CERN, ALICE

LHC Computing Grid Tier-2 Workshop in Asia, 1th December 2006

Chang Yeong CHOI(CERN, ALICE)


OUTLINE

Sejong Farm Working with ALICE Network status Sejong Report in PDC06 Issues in PDC06 Plan during 2007 Summary



Sejong FARM



Sejong Farm (1)

Since 2004 Tier 2 for ALICE One Front-End server for ALICE CE,SE. One storage server with 1.25 TB 32 CPUs as Worker Node

Support ALICE jobs: 23 CPUs Support local jobs: 9 CPUs

Network switches : 1Gbps : For Front-End server 100Mbps: For Worker Nodes



100Mbps switch

Sejong Farm (2)

Storage:1.25TBRAID 5

Front-End serverCPU: intel 2.8Ghz

Memory: 2GB

Swap: 4GB

Network: 1Gbps

Services: PBS server, Ganglia (gmetad)

NFS mount directory: /home1Gbps

switch

NFS mount directory: /scratch

wknode1

wknode32

CPU: intel 2.8Ghz

Memory: 2GB

Swap: 4GB

Network: 100Mbps

Services: PBS client,

Ganglia (gmond)

wknode1

wknode32

CPU: intel 2.8Ghz

Memory: 2GB

Swap: 4GB

Network: 100Mbps

Services: PBS client,

Ganglia (gmond)

AliEn



Sejong

WORKING WITH ALICE



VO-BOX for only ALICE

All services on the same machine Cluster Monitor Computing Element (CE) : Batch system->PBS Storage Element (SE): Mass Storage System-> File Package Manager (PackMan) Monitoring system (MonaLisa) The File Transfer Daemon (FTD)

WORKING WITH ALICE -



Certificate request For ALICE VO [machine]:/home/aliprod> alien host-cert-request

Country Name (2 letter code) [ch]:

Organization Name (eg, company) [AliEn]:

Organizational Unit Name (eg, section) []:ALICE

Common Name (eg, YOUR name) []:

alicece.sejong.ac.kr/SE




Sejong info in LDAP




NETWORK STATUS



Network connection Between CERN and Sejong (1)

GLORIAD (GLObal RIng Network for Advanced Applications Development) with 10/40Gbps Optical lambda networking

KREONet2 (Korea Research Environment Open NETwork)

CERN KISTI SEJONG

GLORIAD

10Gbps

KREONet2

1Gbs

NETWORK STATUS -



Network connection Between CERN and Sejong (2)

KISTI, Korea KISTI, Korea (Daejeon)(Daejeon)

CNIC, ChinaHong Kong

Beijing

Russia (Novosibirsk)

Amsterdam

MoscowUS Seattle

CANARIE, Canada

ChicagoEU

NYC

10G(KR-US)

10G(KR-HK)

Calgary Toronto

* TGN (Tyco Global Network ) : Korea to US

* FNAL (FLAG North Asia Loop) : Korea to HK

2.5G

10G

HKLight

CSTNET

Korea

OC192

OC192

OC192KR GLIF

Exchange Point

Hong Kong, CN 2*10GE

KREONET

Seattle, US

GLIF node(CANARIE,

PW)

KR/CANARIE nodes(L1, L2)

PacificWave

OC192

10GE

OC192

Korea

StarLight

Sejong

1Gbps

cern

Picture from KISTI

NETWORK STATUS -



SCP TEST with KT network

Before 2006.6

100KB/s

IPERF and SCP TEST with KISTI network since 2006.6:

The network bandwidth was 1Gbps between KISTI and Sejong, but local network switches were 10/100Mbps

6MB/s

2.5MB/s

Scp : Outgoing bandwidth

With 1 Gbps switch

Network bandwidth between CERN

and Sejong

NETWORK STATUS -



Sejong REPORT IN PDC06

Sejong



Productions in PDC06

Running service : VO-BOX Production started in July 2006 Max jobs: 23 Produced 1.8GB of data (raw.root: 800MB,

root_archive.zip: 60MB) The raw.root and the root_archive.zip were sent to

CERN by xrootd Other data removed from the work directory.

Sejong REPORT IN PDC06 -



Resources statistics of ALICE Resources contribution (normalized Si2K units): 50% from T1s, 50% from T2s

The role of the T2 remains very high!




Report on Sejong activity

Sejong support only ALICE




VO Box and AliEn services status of Sejong with MonaLisa




Done jobs




Outgoing Traffic




Network speed for one job Network speed was 76.8KB/s for one job

We hoped the speed was 100KB/s at least That is why we put 23 for max jobs:

Network bandwidth is 2.5MB/s on average




Sejong(CE) status with Ganglia

During 6 months

With KISTI network




Sejong (worker nodes) status with Ganglia

Jobs status on PBS




ISSUES IN PDC06

Most serious problem was related to network



PackMan issue

PackMan could not get packages from AliEn because it timed out. Solution:

SOAP.pm : row 418print"Putting A Longer Timeout \n"; $self->{$service} = SOAP::Lite->uri($serviceName)->proxy($host,timeout=>400)->on_fault($my_faultSub);

ISSUES IN PDC06 -



Depend on Network:Compare with Kolkatta (1)

7 jobs for saving For one job:

Kolkatta = 0.28MB/s

Sejong = 0.077MB/s

About 3.6 times difference

ISSUES IN PDC06 -




Running and Saving job During one day

ISSUES IN PDC06 -



Done jobs during one day

2350


ISSUES IN PDC06 -




ISSUES IN PDC06 -



Plan during 2007

We are trying to organize ALICE Tier 2 center in collaboration with KISTI situated at KISTI

The scale will be

CPU (kSI2K) 300 or 100

DISK (TBytes) 50 or 30

10G SWITCH 1

File Server 2



Summary The Sejong network bandwidth has an increase of about

2.5MB/s on the average with KISTI network since 2006.6 Now the Sejong site gets 23 jobs from the AliEn on the

grid : one job produce 1.8 GB of data. The raw.root (800MB) and the root_archive.zip (60MB)

which are one of the produced data from only one finished job move to CERN storages (Castor) with about 76KB/s network bandwidth.

Although every network system is 1Gbps, the network bandwidth between CERN and Sejong is still about 2.5MB/s on the average.

A stable and high performance network is very important to work on the Grid.

Documents

Sejong STATUS Chang Yeong CHOI CERN, ALICE LHC Computing Grid Tier-2 Workshop in Asia, 1 th December 2006