JTE - HPC File Systems: From Cluster To GridOctober 3-4, 2007, IRISA, Rennes

ACM SIGOPSFrance

HPC File Systems: From Cluster To Grid

Gather major actors in file systems and data management fields Get a ‘snapshot’ of the different works currently led

Academic / Industrial

Make a point of storing data at cluster and grid levelsIs storage research at cluster level over ? How should we approach/deal with storage at grid levels ?

Exchange ideas, suggestions / remarks

Look ahead !

Overview of the event

4 sessions: 11 talks + open discussions

File systems at cluster level (chair: Christine Morin) 2 talks

Data management/FS at grid level (1/2, chair: Pierre Sens) 4 talks

Data management/FS at grid level (2/2, chair: Yves Denneulin) 3 talks

Future directions for HPC File systems (chair: Adrien Lebre) 2 talks + open discussions

Otherwise: Restaurant “L’ouvrée”, 18 place des Lices (http://www.louvree.com/plan.asp)

Last talk will finish around 6:45 pmEnjoy the city center, Rennes is beautiful

Few informations …

At IRISA

All talks will be in the room (‘Michel Métivier’ room), 2 Coffee breaks just on the left (‘Valorisation’ room) WIFI access: guest-irisa (DHCP connection)

In Rennes

Dinner meeting point 8:45 pm in front of the Britany parliament

If it rains: take an umbrella, you are in Rennes, it will not last ;)

HPC File Systems: From Cluster To Grid

Any questions ?

HPC File Systems: From Cluster To Grid

Session 1: HPC File Systems at Cluster Level High Performance Lustre Storage Architecture at CEA/DIF

Stéphane Theill - CEA - France

Towards An Integrated Cluster File System Adrien Lebre - INRIA - France

HPC File Systems: From Cluster To Grid

Session 2: Data Management/FS At Grid Level (1/2)

LHC Data Management On A Global GridFabio Hernandez - CC IN2P3 - France

The VISAGE Project - Storage Virtualization at Grid Level François Thiebolt, Salam Traboulsi - IRIT - France

The GEDEON Project - Data, Meta-Data and DatabasesYves Denneulin - LIG - France

XtreemFS, An Object-Based File System For Large Scale Federated IT Infrastructure

Jan Stender - ZIB - Germany

HPC File Systems: From Cluster To Grid

Session 3: Data Management/FS At Grid Level (2/2) GFARM, A Global File System

Osamu Tatebe - Univ. Of Tsukuba - Japan

JuxMem: A Data Sharing Service For The GridLoic Cudennec - INRIA - France

Pastis: A P2P File System For Persistant Large-Scale StoragePierre Sens - Univ of PARIS VI - France

HPC File Systems: From Cluster To Grid

Session 4: Future Directions For HPC File Systems

Storage Virtualization From Clusters To Grid Marc Descamps, Yoann Lechevalier, Mathieu Avila Seanodes - France

Panasas Parallel File System and pNFSSven Neirynch - Panasas EMEA division

Open discussions : storage at cluster level (guidelines)

Who need/require HPC File Systems ? (Web server/ Multimedia / HPC : simulation,... / Bank )

Usual data-sets ? Size (GB, PB, larger ) ? Access : local/remote - distributed/parallel ?

State of current solutions for each domain (strength / weakness) Are there particular research investigations to realize?

Use of the current hierarchical structure of a FS ? Manage database and FS in a common or in a distinct way ? Historical model of HPC clusters : compute vs storage nodes ? ...

HPC File Systems: From Cluster To Grid

HPC File Systems: From Cluster To Grid

Open discussions: storage at grid level (guidelines)

Storage at Grid level (multi-sites, cluster of cluster):

A real demand for sharing data between several sites ? If Yes, in what cases ? What are the current solutions ? What are the current answers from Industrial ?

Grid File Systems and Virtual Machines ?Recovering mechanisms in time (sizeof DATASETS)Parallel recovering mechanisms …