Embed Size (px)
DESCRIPTION
EMI INFSO-RI The EMI Facts –From 22 Partners to EMI-Data –The EMI-Data shopping cart. –The EMI(-Data) release plan. The EMI-Data Mission –Standardization WebDAV NFS 4.1 / pNFS SSL for SRM –Interoperability ARGUS Client library consolidation GLUE 2.0 UNICORE Apr 21, 2011 EMI Data,.... EGI UF2011, Vilnius 3 Outline Mission (Cont) –Catalogue Synchronization Conclusion
Citation preview
EMI I
NFS
O-R
I-261
611
EMI I
NFS
O-R
I-261
611
EMI Data, the unified European Data Management Middleware
Patrick Fuhrmann (DESY)EMI Data Area lead
Data
EMI I
NFS
O-R
I-261
611
EMI I
NFS
O-R
I-261
611
Apr 21, 2011 EMI Data, .... EGI UF2011, Vilnius 2
Credits• Alejandro Alvarez• Alex Sim• Claudio Cacciari• Christian Bernardt• Christian Loeschen• Dirk Duellmann• Elisabetta Ronchieri• Fabrizio Furano• Giuseppe Fiameni• Giacinto Donvito• Giuseppe Lo Presti• Jon Kerr Nilsen• Jan Schaefer• Jean-Philippe Baud
• Karsten Schwank• Michele Carpene• Michele Dibenedetto• Michail Salichos• Mischa Salle• Oscar Koeroo• Oliver Keeble• Paul Millar• Ralph Mueller-Pfefferkorn• Ricardo Rocha• Riccardo Zappi• Tigran Mkrtchyan• Zsolt Molnar• Zsombor Nagy
Our wiki : https://twiki.cern.ch/twiki/bin/view/EMI/EmiJra1T3Data
EMI I
NFS
O-R
I-261
611
EMI I
NFS
O-R
I-261
611
EMI Data, .... EGI UF2011, Vilnius 3
• The EMI Facts– From 22 Partners to EMI-Data– The EMI-Data shopping cart.– The EMI(-Data) release plan.
• The EMI-Data Mission– Standardization
• WebDAV• NFS 4.1 / pNFS• SSL for SRM
– Interoperability• ARGUS• Client library consolidation• GLUE 2.0• UNICORE
Apr 21, 2011
Outline• Mission (Cont)
– Catalogue Synchronization
• Conclusion
EMI I
NFS
O-R
I-261
611
EMI I
NFS
O-R
I-261
611
EMI Overview - EGI TF, Amsterdam 416/09/2010
Apr 21, 2011 EMI Data, .... EGI UF2011, Vilnius 4
EMI Factsheet
EMI Factsheet
Budget : about 24 Million Euros
Funding : about 50% by EU-FP7, rest by partners
Covers : JRA, SA and NA
Partners : 22
Middlewares: Arc, gLite, UNICORE and dCache
EMI I
NFS
O-R
I-261
611
EMI I
NFS
O-R
I-261
611
Why
According to our Project Director, Alberto Di Meglio :
Apr 21, 2011 5EMI Data, .... EGI UF2011, Vilnius
The European Middleware Initiative (EMI)project represents a close collaboration of the major European middleware providers - ARC, gLite, UNICORE and dCache - to establish a sustainable model to support, harmonise and evolve distributed computing middleware for deployment in EGI, PRACE and other distributed e-Infrastructures
EMI I
NFS
O-R
I-261
611
EMI I
NFS
O-R
I-261
611
Apr 21, 2011 EMI Data, .... EGI UF2011, Vilnius 6
EMI in context
EMI
EGI, PRACE, WLCG,OSG
Requirements ReleasesSLAs &Support
Collaborations
DCI collaborations
6
ESFRI,VRCs
StratusLab VENUS-C EDGI IGESIENA
StandardsIndustry
Collaborations
Stolenfrom
Alberto Di Meglio
EMI I
NFS
O-R
I-261
611
EMI I
NFS
O-R
I-261
611
Apr 21, 2011 EMI Data, .... EGI UF2011, Vilnius 7
“User” Feedback processEGI, Heavy User: HEP,
Astronomy and Astro Physics, Life and Earth Science
TechnicalCoordination
Board
ProjectTechnical
Board
EMITechnicalDirector
Requirements(prioritized)
ProjectExecutive
Board
Suggestion
EMI
Decision
ReleasesWLCG, OSG, ?
!! YOU !!
EMI I
NFS
O-R
I-261
611
EMI I
NFS
O-R
I-261
611
EMI Data, .... EGI UF2011, Vilnius 8Apr 21, 2011
EMI Data in context
Data
dCache, StoRM, DPM, FTS, LFC, GFAL, arc-libs, UNICORE-SMS,etc
Computing Security InfraStructur
Information system, accounting, bookkeeping
ARGUS, VOMS,UNICORE-Gate,gridSite, etc
A-REX, UAS-Compute, WMS, CREAM, MPI, etc
EMI I
NFS
O-R
I-261
611
EMI I
NFS
O-R
I-261
611
Apr 21, 2011 EMI Data, .... EGI UF2011, Vilnius 9
What does EMI-Data provide ?
The EMI-Data shopping basketCART
EMI I
NFS
O-R
I-261
611
EMI I
NFS
O-R
I-261
611
Apr 21, 2011 EMI Data, .... EGI UF2011, Vilnius 10
The EMI shopping cart
Professional Storage Solutions
DPM
dCache
Fits all sizes (IKEA approach)
Reliable File Transport Service File Location
and meta data Service (LFC)
Generic Meta Data Service (AMGA)
DOG
Happy
Dancing
Data Access and
control library(s)
EMI I
NFS
O-R
I-261
611
EMI I
NFS
O-R
I-261
611
Apr 21, 2011 EMI Data, .... EGI UF2011, Vilnius 11
Release Plan
Start EMI 0 EMI 1 EMI 2 EMI 3
Support & Maintenance
Support & Maintenance
Support & Maintenance
Supp. & Maint.Major releases
Stolenfrom
Alberto Di Meglio
01/05/2010 31/10/2010 30/04/2011 30/04/2012 28/02/2013
Kebnekaise, Lappland, Sw, 2100mGiebnegáisi
EMI I
NFS
O-R
I-261
611
EMI I
NFS
O-R
I-261
611
Apr 21, 2011 EMI Data, .... EGI UF2011, Vilnius 12
The Mission
EMI I
NFS
O-R
I-261
611
EMI I
NFS
O-R
I-261
611
Apr 21, 2011 EMI Data, .... EGI UF2011, Vilnius 13
The Mission• Fixing of issues based on the experience of operating the infrastructures
for some years.• Improving or creating interoperability between components and
middle-wares.• Reducing components by merging functionality or removing duplication.• Applying standards where available• Standardizing EMI-Data mechanisms with “standardization bodies” e.g.
OGF• EGI : Attracting resp. enabling new communities.
• Becoming competitive and attractive– Standards– Professional Support– Strict quality monitoring
EMI I
NFS
O-R
I-261
611
EMI I
NFS
O-R
I-261
611
Apr 21, 2011 EMI Data, .... EGI UF2011, Vilnius 14
Mission overview
EMI Data
CatalogueSynchronization
SRMSecurity
GLUE 2.0
ARGUSIntegration
DATA clientLibrary
consolidation
StandardsNFS 4.1
Security
StandardizationOGFIETF
Standardshttp(s)
WebDavSRM Spec
SimplificationStorageAccounting
UNICOREIntegration
Interoperability
EMI I
NFS
O-R
I-261
611
EMI I
NFS
O-R
I-261
611
Apr 21, 2011 EMI Data, .... EGI UF2011, Vilnius 15
Standardization
Applying industry standards
• Posix file system : NFS 4.1 / pNFS
• WebDAV
• SSL security for SRM
EMI I
NFS
O-R
I-261
611
EMI I
NFS
O-R
I-261
611
Apr 21, 2011 EMI Data, .... EGI UF2011, Vilnius 16
Standardization : WebDAV
• Very useful for new (non-LHC) communities.• ITEF Standard• Allows “File system like” access with
• Mac OS• Linux• Windows
WebDAV
dCacheStoRMDPM
EMI-1 EMI-2 EMI-3
EMI I
NFS
O-R
I-261
611
EMI I
NFS
O-R
I-261
611
Apr 21, 2011 EMI Data, .... EGI UF2011, Vilnius 17
Standardization : NFS 4.1 / pNFSWhy pNFSSimplicity
Regular mount-point and real POSIX I/O Can be used by unmodified applications (e.g. Mathematica..) Data client provided by the OS vendor Smart caching (block caching) development done by OS vendors
Performance pNFS : parallel NFS (first version of NFS which support multiple
data servers)
Clever protocols , e.g. Compound Requests
dCacheStoRMDPM
EMI-1 EMI-2 EMI-3
GPFS
EMI I
NFS
O-R
I-261
611
EMI I
NFS
O-R
I-261
611
Apr 21, 2011 EMI Data, .... EGI UF2011, Vilnius 18
Standardization : NFS 4.1 / pNFS
NetAppTest DESY Production (OnTap 8.1)NetApp
Blue Arc
dCache Next Golden Release (1.9.12)
DPM
2011Q1 Q2 Q3 Q4Q4
2010
StoRM GPFS native GPFS pNFS
pNFS in official 2.6.38 kernel
Linux distributions (RH6.2…)pNFS
EnabledKernel
Industry
Beta read-only
DESY Linux pNFS kernel for SL5
There might be issues with 38
Availability for production use
Beta Read/Write
EMI I
NFS
O-R
I-261
611
EMI I
NFS
O-R
I-261
611
Apr 21, 2011 EMI Data, .... EGI UF2011, Vilnius 19
Standardization : NFS 4.1 / pNFS
Mar 16, 2011 Göttingen, NFS 4.1/pNFS, Patrick Fuhrmann 19Patrick Fuhrmann, dCache.org 19
The DESY Grid LabOperated byYves KempDmitri Ozerov
TheDESYGridLab
Has been enlarged and will start testing end of March’11
Cern NFS 4.1 evaluation setupContactAndrea Sciaba and Ricardo Rocha
DESY Grid Lab available for more than 9 months to evaluate protocols and systems. Publications at CHEP and HEPIX
Presentation on NFS 4.1 Details
In the afternoon.
EMI I
NFS
O-R
I-261
611
EMI I
NFS
O-R
I-261
611
Apr 21, 2011 EMI Data, .... EGI UF2011, Vilnius 20
Standards : SRM over SSLReplacing SRM over httpg (GSI) by https
• GSI (httpg) is not a standard (SSLv3 is)
• Coupling delegation with transport negotiation is inflexible.
• It’s not widely used outside of Grid.
• Libraries are coming from a single vendor : GLOBUS
• E.g. no hardware acceleration.
• Delegation has to be solved. (see “spin off” standards)
• Prototype (server and client) w/o delegation available in
EMI-1 for dCache.
Stolen from activity leader : Paul Millar
Presentation on SRM/SSL Details
After these messages
EMI I
NFS
O-R
I-261
611
EMI I
NFS
O-R
I-261
611
Apr 21, 2011 EMI Data, .... EGI UF2011, Vilnius 21
Spin off standards
EMI involvement in OSG (wg)
• Storage accounting record Working Group
• ID Delegation (EMI wide)
EMI I
NFS
O-R
I-261
611
EMI I
NFS
O-R
I-261
611
Apr 21, 2011 EMI Data, .... EGI UF2011, Vilnius 22
Storage Accounting Record (StAR)
• If there is no standard for storage accounting yet, do anyone actually need it?
• Developing a storage infrastructure– We need to know how much storage space is used, by which
group/user, on which storage media– To know where to put the money when increasing the storage space– To know who to ask for the money to increase the storage space
• Basis for billing– Storage is expensive – Some non-academic resource owners may not like to give it away for
free
• Jon prepared a draft definition of a StAR• -> OGF existing working group (Jon becoming Co-Chair)
Stolen from activity leader : Jon Kerr Nielsen
Presentation on StAR
Wednesday afternoon
EMI I
NFS
O-R
I-261
611
EMI I
NFS
O-R
I-261
611
Apr 21, 2011 EMI Data, .... EGI UF2011, Vilnius 23
Delegation using SSLv3
• SRM needs delegation to perform operations on behave of
the initiator. (e.g. 3rd party copy , bring online, ..)
• GSI (httpg) allows delegation w/o additional services.
• For SSLv3 delegation is not defined.
• There are several options
• -> OSG working group (Forming a research group : Paul)
Delegation
EMI I
NFS
O-R
I-261
611
EMI I
NFS
O-R
I-261
611
Apr 21, 2011 EMI Data, .... EGI UF2011, Vilnius 24
Interoperability
• Integration of ARGUS (Blacklisting)
• Data Client Library Consolidation
• GLUE 2.0 migration
• UNICORE client integration
Interoperability between EMI components
EMI I
NFS
O-R
I-261
611
EMI I
NFS
O-R
I-261
611
Apr 21, 2011 EMI Data, .... EGI UF2011, Vilnius 25
InteroperabilityARGUS integration
ARGUS : Authorization system Allows local and centralized configuration (and both) SE’s, LFC and FTS starting with ARGUS blacklisting
Client Library consolidation (ARC, gLite) Goal : Merge ARC and gLite client library functionality
SRM Client Catalogue access …
Activity started in Feb at CERN with F2F. No casualties were reported.
EMI I
NFS
O-R
I-261
611
EMI I
NFS
O-R
I-261
611
Apr 21, 2011 EMI Data, .... EGI UF2011, Vilnius 26
Interoperability
Migration from GLUE 1.3 to GLUE 2.0 Already agreed before EMI Starting with GLUE 1.3 information published with GLUE 2.0 Followed by clients (between EMI-1 and EMI-2) Running both systems in parallel for awhile.
AllEMI-1 EMI-2 EMI-3
GLUE 2 butGLUE 1.3 content
Presentation on GLUE 2 in DM
Wednesday afternoon
EMI I
NFS
O-R
I-261
611
EMI I
NFS
O-R
I-261
611
Apr 21, 2011 EMI Data, .... EGI UF2011, Vilnius 27
Interoperability
UNICORE access to EMI-Data components
SRM client interface
LFC Client interface
AMGA client
UNICORE
Unicore
EMI-1 EMI-2 EMI-3
EMI I
NFS
O-R
I-261
611
EMI I
NFS
O-R
I-261
611
Apr 21, 2011 EMI Data, .... EGI UF2011, Vilnius 28
Fixing an intended design flaw
• Catalogues and SE name-spaces get out of sync over the time. (They interact by non atomic operations)
• Mechanisms to get them synchronized exists but involve SE resp. catalogue dump and are painful and certainly don’t scale.
• The plan is to use message passing to synchronizes them in ‘real time’
• First step (EMI-1) allow to ‘register’ lost files manually.• DPM and LFC interaction already done. Now working on
experiment catalogues (ATLAS DDN).• StoRM and dCache a bit behind.
The (in)famous catalogue synchronization
EMI I
NFS
O-R
I-261
611
EMI I
NFS
O-R
I-261
611
Apr 21, 2011 EMI Data, .... EGI UF2011, Vilnius 29
Fixing an intended design flawStolen from activity leader : Fabrizio Furano
Presentation on Catalogue Synchronzation
Late this afternoon
EMI I
NFS
O-R
I-261
611
EMI I
NFS
O-R
I-261
611
AMGA Demo dCache and StoRM Tutorials
EMI user client usage in ARC,
UNICORE, gLite and dCache
Apr 21, 2011 EMI Data, .... EGI UF2011, Vilnius 30
Find EMI Data in VilniusMonday Tuesday Wednesday
14:00
16:00
You are here
The ARC data Client
gLite Transfer Service
gLite Data ManagementIntegration and Testing
EMI, dCache and standards
SRM over SSL
NFS 4.1 / pNFS
Catalogue Synchronization
GLUE 2.0 in EMI
Storage Accounting Record
The Doctor is
IN
EMI : meet the experts
EMI I
NFS
O-R
I-261
611
EMI I
NFS
O-R
I-261
611
EMI Data, .... EGI UF2011, Vilnius 31
• EMI Data is a good opportunity to get our storage management middleware into a maintainable shape.
• Standardization is the way to get broader acceptance by other communities, which is especially important for EGI.
• EMI-Data will become THE competitor in Storage Management in Europe.
• Everybody can join or may provide suggestions through WLCG or EGI.eu.
Apr 21, 2011
Conclusions
EMI I
NFS
O-R
I-261
611
EMI I
NFS
O-R
I-261
611
Further reading
https://twiki.cern.ch/twiki/bin/view/EMI/EmiJra1T3Data
Apr 21, 2011 32EMI Data, .... EGI UF2011, Vilnius
EMI is partially funded by the European Commission under Grant Agreement INFSO-RI-261611
