Upload
ava-houston
View
215
Download
1
Tags:
Embed Size (px)
Citation preview
The DataTAG Project 25 March, Brussels FP6 Information Day
http://www.datatag.orghttp://www.datatag.org
Peter Clarke, University College London
DataTAG - EU FP6 Information Day - Brussels 25 March 2003
(2)
DataTAG MissionDataTAG Mission
EU EU US Grid network research US Grid network research High Performance Transport protocols
Inter-domain QoS
Advance bandwidth reservation
EU EU US Grid Interoperability US Grid Interoperability
Sister project to DataGRIDSister project to DataGRID
TTransransAAtlantictlantic G Gridrid
DataTAG - EU FP6 Information Day - Brussels 25 March 2003
(3)
Collaborations Collaborations
Collaboration with NetworksCollaboration with Networks DANTE and National Research Networks (NRN) GARR (IT), MB-NG (UK), Surfnet (NL), VTHD (FR) Internet2/Abilene, Starlight, TeraGrid, ESnet,
Canarie
Collaboration with projects in EuropeCollaboration with projects in Europe DataGrid/CrossGrid Gridstart National Grid projects (e.g. IT) LHC Computing Grid (LCG)
Collaboration with projects in the USCollaboration with projects in the US Globus iVDGL GriPhyN PPDG
DataTAG - EU FP6 Information Day - Brussels 25 March 2003
(4)
EU collaboratorsEU collaborators Brunel UniversityBrunel University
CERNCERN
CLRCCLRC
DANTEDANTE
INRIA INRIA
NIKHEFNIKHEF
PPARCPPARC
UvAUvA
University of University of ManchesterManchester
UCLUCL
DataTAG - EU FP6 Information Day - Brussels 25 March 2003
(5)
US collaboratorsUS collaborators
ANLANL
CaltechCaltech
FermilabFermilab
University of University of ChicagoChicago
FSUFSU
IndianaIndiana
WisconsinWisconsin
GlobusGlobus
Northwestern Northwestern UniversityUniversity
UICUIC
University of MichiganUniversity of Michigan
SLACSLAC
StarlightStarlight
DataTAG - EU FP6 Information Day - Brussels 25 March 2003
(6)
Cooperating Networks
Funding agencies
DataTAG - EU FP6 Information Day - Brussels 25 March 2003
(7)
NLNLSURFnet
CERN
UKUKSuperJANET4
AbileneAbilene
ESNETESNET
MRENMREN
ITITGARR-B
GEANT
NewYork
STAR-TAP
STAR-LIGHT
Network Research Testbed
FRFRINRIA ATRIUM/
VTHD
ATRIUM/VTHD
3*2.5G3*2.5G
2.5G --> 2.5G --> 10G10G
10G10G
DataTAG - EU FP6 Information Day - Brussels 25 March 2003
(8)
Phase I (iGRID2002)Phase I (iGRID2002)
DataTAG - EU FP6 Information Day - Brussels 25 March 2003
9
On February 27-28, a Terabyte of data was transferred by S. Ravot of Caltech between the Level3 PoP in Sunnyvale near SLAC and CERN through the TeraGrid router at StarLight from memory to memory as a single TCP/IP stream with 9KB Jumbo frames at a rate of 2.38 Gbps for 3700 seconds. This beat the former record by a factor of approximately 2.5, and used the US-CERN link at 96% efficiency. This is equivalent to:
Transferring a full CD in 2.3 seconds (i.e. 1565 CDs/hour)Transferring 200 full length DVD movies in one hour (i.e. 1 DVD in 18 seconds)
Intel 10GigE Data Transfer TrialIntel 10GigE Data Transfer Trial
European CommissionEuropean Commission
DataTAG - EU FP6 Information Day - Brussels 25 March 2003
(10)
ObjectivesObjectives Enable Middleware interoperabilityEnable Middleware interoperability between between
European and US Grid domains European and US Grid domains DemonstrateDemonstrate Large Hadron Collider (LHC) Large Hadron Collider (LHC)
AApplications running on heterogeneous Gridpplications running on heterogeneous Grid
EU EU US Grid Interoperability US Grid Interoperability
IssuesIssues
Resource DiscoveryResource Discovery
Authentication & AuthorisationAuthentication & Authorisation
Job schedulingJob scheduling
Data Management Data Management
DataTAG - EU FP6 Information Day - Brussels 25 March 2003
(11)
Results Results
Common Resource Information Common Resource Information PublicationPublication
DataGrid Resource Broker and DataGrid Resource Broker and common Information system common Information system integrationintegration
Implementation in standard Globus release
To be included in next DataGrid Release Already included in US VDT release and
CERN LCG-0 release Input to GGF and CIM
DataTAG - EU FP6 Information Day - Brussels 25 March 2003
(12)
Results Results
Common Virtual Organization Common Virtual Organization Authorization system (VOMS)Authorization system (VOMS)
jointly developed by DataTAG/DataGRID
Mapping between PKI-based Grid Mapping between PKI-based Grid security and Kerberos-based security and Kerberos-based mechanism at the local site.mechanism at the local site.
New Grid monitoring system New Grid monitoring system
DataTAG - EU FP6 Information Day - Brussels 25 March 2003
(13)
Dissemination Dissemination
Web siteWeb site
PresentationsPresentations GGF, DataGrid, Internet2, AcrossGrid, Nordunet,
INFN-Grid, Gridstart, HNF Europe, IST2002, SC2002, etc
DemosDemos iGRID2002, IST2002, SC2002
High Performance TCP workshopHigh Performance TCP workshop
0
5000
10000
15000
20000
25000
30000
35000
40000
Feb-02 Apr-02 May-02 Jul-02 Sep-02 Oct-02 Dec-02 Jan-03 Mar-03
MonthH
its
40000/month40000/month
DataTAG - EU FP6 Information Day - Brussels 25 March 2003
(14)
ConclusionsConclusions
Successfull first yearSuccessfull first year
Comprehensive Transatlantic testbed builtComprehensive Transatlantic testbed built
Many advances in very high rate data transport Many advances in very high rate data transport
Demonstration of applications running across Demonstration of applications running across
heterogeneous Grid domainsheterogeneous Grid domains