eInfrastructures in Italy (and their EU and International integration) Roma – 9 December 2003

Mirco Mazzucato Infn -Padova 1

last update: 22/04/23 14:05

eInfrastructures in Italy (and their EU and

International integration)

Roma – 9 December 2003Mirco Mazzucato

[email protected]

Mirco Mazzucato INFN-Padova-3

last update 22/04/23 14:05

Grids: origin and foundation Italy started to develop the Grid technology and

related eInfrastructures at the end of ’90s (INFN Condor, Grid project, ISUFI Lecce). Main motivations:

Modern fundamental Science, HEP in particular, but also Life sciences, Earth Observation, Economics, … have been evolving fast during the ’90s from local well consolidated laboratory practices towards: global collaboration (eScience), involving real time working

relations between distributed teams with top level expertise Intensive usage, in the daily work, of IT resources including

access and sharing of distributed data Effective use of modelling practices for the steering of the

research and innovation processes ,,,boosted by the decreasing costs of commodity IT

resources: desktop, disks, networks.. and Open Source


last update 22/04/23 14:05

The “Data” Issue The modern scientific world and society are characterized

by the large development of digital instruments which produces a large amount of distributed raw data

High Energy Physics detectors (LHC): 10 PByte/year in 2007 Earth Observation satellites: Envisat 500 TByte/year now Mammography screening of the population in Italy:

200TB/year Genomic and proteinomic databases quickly growing to PByte WEB, Digital Libraries,Virtual Reality, CADS: now at TB Distributed sensors……..: Millions, quickly growing

The economical and social progress of modern digital societies depend strongly on their capacity and efficiency in transforming these Raw Data into precious piece of knowledge:

Laws of nature, new drug discoveries, innovative technologies, early cancer diagnosis, early alarm for a new catastrophic event ….


last update 22/04/23 14:05

The “modelling” issue Progress in modern Sciences but also the Innovation

processes in modern Industries, Business and Governments relies on the cycle: Theoretical modelling of the problem Simulation/Calculations of different options and input

parameters Selection of best solution Virtual and practical realization of prototypes Comparison, iteration or mass production

In all domains the extensive professional exploitation of the past accumulated knowledge through the systematic usage of modelling practices should steer the innovation process To be confronted with current practices of systematic

laboratory tests of all different hypothesis and parameters This points towards the pervasive introduction and

systematic usage of IT resources (CPU, Archives, networks..) in the daily work of all people involved in the production of new knowledge and beyond in all society


last update 22/04/23 14:05

eInfrastructures:the new general enabling

factor The conbination of Internet with the new WEB and Grid Services on top of the modern fastly developing physical layer of networks, CPU farms, storage space.., can provide the general infrastructure (eInfrastructure) which enable all the above tasks:

Collaborative work in distributed VO large volume data sharing intensive usage of distributed CPU and Storage resources General access to knowledge in the society

The Grid middleware can provide those additional common services that applications in all domains from Science to Industry and Business can use to access exactly those IT resource that they need at the most effective cost

As the TCP/IP protocol and the WEB daemons have provided in the past uniforn access to information to Science, Industry and all other domains

eInfrastructures becomes in this way one of the key enabling factors for the social and economical progress of modern knowledge based society


last update 22/04/23 14:05

The INFN Grid project and the national eInfrastructure

1. Condor on WAN (started 1996, operational in 1998) Integrate ~ 20 sites CPU resources into a national pool

2. National testbed to evaluate Globus services in 1999 3. INFN-GRID, INFN special project, (February 2000-…)

National Grid infrastructure driven by INFN experiments 4. DATAGRID , EU Project, 3 years duration (2001-2003)

European integration and new M/W services for HEP, Biology, EO5. DataTAG, EU project, 2 years duration (2002-2003)

Optical networking and Interoperability with US Grid, GLUE, HICB, JTB..

6. Grid.IT, National project 3 years (2003-2005) MIUR special funds Towards a national production eInfrastructure

7. eBusiness, eIndustry, eGovernment, EScience and, Technology --> (BIGEST) Italian Grid Initiative

Coordination of all national eInfrastructure activities8. FP6: Italian grid infrastructure in EGEE.....

The new production EU eInfrastructure for all Sciences and beyond


last update 22/04/23 14:05

MIUR/HPCC

Center of Excellence forHigh Perfomance Computing

University of Calabria Director: Prof. Lucio Grandinetti

The SPACI Consortium:a flexible, robust, secure and scalable IT infrastructure

Southern Partnership for Advanced Computational Infrastructure

ISUFI/CACT

Center for Advanced ComputingTechnologies

University of Lecce Director: Prof. Giovanni Aloisio

DMA/ICAR

Dept. of Mathematics and ApplicationsUniversity of Naples “Federico II” & ICAR

(Section of Naples)Director: Prof. Almerico Murli

3 MEuro startup funds by MIUR

1.4 Tflops

SPACI infrastructure part SPACI infrastructure part of the EGEE production Gridof the EGEE production Grid


last update 22/04/23 14:05

To put the computing resources of the partecipating institutions into a grid

To integrate the research activity of the three main sites and to estabilish a real collaboration in Italy between the Italian Public and Industrial Research

To exchange experiences both in High Technology and Scientific Research among the researchers & students of the three main sites and other Universities & Research Centers in Europe and the USA

SPACI – The Mission


last update 22/04/23 14:05

CitrixMetafra

me

CitrixNfuse

ICA

WEB(ICA)

power3.frascati.enea.it

boquad.frascati.enea.it

dafne.casaccia.enea.it

infocal.trisia.enea.it

GEANT

DataGrid at

ESA\ESRIN

grid0007 ENEA GRID

GigaBit-Link

CNRTor Vergata

ENEA infrastructurewill be part of EGEE


last update 22/04/23 14:05

PISA

NAPOLI

COSENZA

PERUGIA

PADOVA

GENOVA

LECCE

MILANO

PALERMO

ROMA

TORINO

MATERA

PAVIA

BARI

BOLOGNA

The Grid.it National Project CNR & University

HPC, Parallel Programming, Grid computing, Scientific libraries, Data base and knowledge discovery, Earth Observation, Computational chemistry, Image processing, …R&D on next generation tools

ASIApplications of Earth ObservationCAGLIARI

INFN & UniversityGrid infratsructure(INFN-Grid, DataGrid, DataTag) , e-science applications: Astrophysics,

Bioinformatics, Geophysics, …National eInfrastructure

Funding: €8.1 M 3-Year Project

Start-up: November 2002

UR INFN : €1.58M

CNITR&D on optical networking


last update 22/04/23 14:05

The national Grid.it eInfrastructure

In Grid.it INFN is responsible for the R&D and creation of a national Grid Infrastructure and for studying and prototyping a national Grid Operation Service (GOS)

The generalization of the infrastructure support to other Sciences from INFN is a model successfully established in the past with the research network (INFNET -> GARR)

The GOS support several Italian Sciences applications and the operation of the Italian infrastructure also in the context of the new European Infrastructure project EGEE

The Italian eScience Grid.it infrastructure currently support: Astrophysics Biology Computational Chemistry Geophysics Earth Observation

but other sciences are joining thanks to new MIUR funds (e.g. new S-PACI and other PON projects)


last update 22/04/23 14:05

The Grid.it support site Web site: http://grid-it.cnaf.infn.it


last update 22/04/23 14:05

The Italian Grid for Business, Industry, Government,

EScience&Technology (IG-BIGEST) It is a national initiative aiming at coordinating all

Italian efforts in Grids development or exploitation and at promoting the participation to EU FP6 and international grid projects

IG-BIGEST main objectives are To support the creation of a general Italian and EU grid

infrastructure for eScience integrating available EU national infrastructures and open to industry early test

-> EGEE project To promote R&D on open Grid issues

->New FP6 proposals To support the development of specific grid environments

on top of basic services enabling usage of Grid by major applications in e-Science, eIndustry and eGovernment

->New FP6 and national application projects


last update 22/04/23 14:05

Current achievements for the Italian and EU

eInfrastructure The national Grid infrastructure is now a reality costantly developed by a series of coordinated national projects

Garr (NREN) for the underline broadband Research Networking INFN Grid, S-PACI, ENEA-Grid FIRB Grid.it for Grids and eInfrastructure

Integration at EU and international level is efficiently carried through a series of EU projects DataGrid, DataTAG, EGEE , international HEP LCG...

Grid infrastructures are now seen by many governments as a Science and society development enabling factor and large funds are made available in Europe, US (Cyber-infrastructure), Japan and other countries so technological development will continue fast

EGEE will make the Grid M/W adhering to standard spec. (OGSI-OGSA) robust and reliable and will provide a production eInfrastructure in Europe on top of the Geant nework

EGEE will provide also: Support to the development of some research eInfrastrcture user

communities Coordination of national and regional technical operational structures


last update 22/04/23 14:05

eInfrastuctures: the challenges

The general European structure at managerial and policy - administrative level to support the eInfrastructure developments in Europe is still very weak

Projects like EGEE have definite technical goals, are focused and ends

Cannot provide effective long term foundation for an EU eInfrastructure

Cannot provide longterm EU wide roadmaps integrated with national programs

Cannot guarantee long term support of M/W This is even more true at international level

GGF can provide long term international standards but is not following the urgent policy agreements needed to integrate EU eInfrastructures, with US Cyber-Infratruscture, Japan and world wide Grids

Policies for resource sharing within comunities having common objectives (VO), security issues, accounting, business and cost models etc need now to be actively generally addressed in Europe and internationally


last update 22/04/23 14:05

The new event “eInfrastructures (Internet and Grids) –

The new foundation for knowledge-based Societies” It offers an opportunity to start to discuss a framework of

administrative- and policy-level mechanisms and rules to break down barriers related to deployment and use of eInfrastructures in Europe and world-wide

Some of the issues that need to be addressed include: The harmonization of national, EU and International

eInfrastructures dvelopment programs The general long term support and coordinated world-wide

evolution of the basic eInfrastructure services in order to guarantee continuous world-wide interoperability and usage

Existing GLUE schema, Intergrid Coordination Board, JointTechnical Board, are International Bodies which may provide input and feedback to eIRG

Security EU structures and shared EU and International sec. policies

Authorization, Accounting, Cost sharing and Business models for EU wide and international resource access and sharing

Bringing in all Research user communities Bringing in general Industry, Business and Society applications


last update 22/04/23 14:05

Conclusions EU eInfrastructures are a key element for the establishment of the European Research Area and for boosting in Europe the Scientific Research and Industrial/Commercial outreach, allowing the building up of critical mass in all domains With the constitution of eIRG Europe can address the issue of putting in place a solid structural foundation at adminstrative and policy level for the eInfrastructure development and involve all Research comunities, Industries and the Society eInfrastructures can enalarge access to knowledge creating a new market of IT resources and applications as the WEB did in the past The EU eInfrastructure Reflection Group has been formed with delegates of Ministries of all EU countries following the recommendations of the previous workshop organized by the Greek Presidency. It can provide harmonization of the adopted policies and input to the EU governments and EU commission for the development of the EU eInfrastructure together with international coordination The White Paper that has been circulated as a first draft to stimulate discussions is now in the hands of this group It will evolve according to the input and suggestions provided during the today workshop. The eIRG will meet tomorrow to plan the next steps

Documents

eInfrastructures in Italy (and their EU and International integration) Roma – 9 December 2003