14
EUROGRID – An Integrated User– Friendly Grid System Hans–Christian Hoppe, Karl Solchenbach A Member of the ExperTeam Group Pallas GmbH Hermülheimer Straße 10 D–50321 Brühl, Germany [email protected] http://www.pallas.c om Health–Grid Workshop, Brussels, September 2002

EUROGRID – An Integrated User–Friendly Grid System Hans–Christian Hoppe, Karl Solchenbach A Member of the ExperTeam Group Pallas GmbH Hermülheimer Straße

Embed Size (px)

Citation preview

Page 1: EUROGRID – An Integrated User–Friendly Grid System Hans–Christian Hoppe, Karl Solchenbach A Member of the ExperTeam Group Pallas GmbH Hermülheimer Straße

EUROGRID – An Integrated User–Friendly Grid System

Hans–Christian Hoppe, Karl Solchenbach

A Member of the ExperTeam Group

Pallas GmbHHermülheimer Straße 10D–50321 Brühl, Germany

[email protected]://www.pallas.com

Health–Grid Workshop, Brussels, September 2002

Page 2: EUROGRID – An Integrated User–Friendly Grid System Hans–Christian Hoppe, Karl Solchenbach A Member of the ExperTeam Group Pallas GmbH Hermülheimer Straße

© Pallas GmbH

Outline

EUROGRID approach and history

EUROGRID functionality and services

EUROGRID architecture and implementation

Availability and outlook

Page 3: EUROGRID – An Integrated User–Friendly Grid System Hans–Christian Hoppe, Karl Solchenbach A Member of the ExperTeam Group Pallas GmbH Hermülheimer Straße

© Pallas GmbH

EUROGRID Approach

Provide a uniform work environment for end–users– access and authentication mechanisms (client, certificates, …)– details of execution environments (commands, data access, …)– user–level workflow and resource model (task graph, …)

Preserve autonomy of participating sites

Emphasize security– site security– data and workflow integrity

Support end–users in specific science/engineering domains

Focus on transactional usage modes– offline execution of large workflows– interactive monitoring and steering– NOT traditional interactive (shell commands)

Page 4: EUROGRID – An Integrated User–Friendly Grid System Hans–Christian Hoppe, Karl Solchenbach A Member of the ExperTeam Group Pallas GmbH Hermülheimer Straße

© Pallas GmbH

EUROGRID History

Started as a seamless access platform for German HPC centers

– project UNICORE (1997–1999)– project UNICORE Plus (2000–2002) uniform interface to supercomputers phased into operation in 2003

Embracing the Grid philosophy, enhancing functionality– project EUROGRID (IST–1999–20247) dynamic resource identification and brokering plugins provide user–friendly interfaces

Introducing compatibility to Globus– project GRIP (IST–2001–32257) combine EUROGRID and Globus resources pave the way towards OGSA

Page 5: EUROGRID – An Integrated User–Friendly Grid System Hans–Christian Hoppe, Karl Solchenbach A Member of the ExperTeam Group Pallas GmbH Hermülheimer Straße

© Pallas GmbH

EUROGRID Functionality and Services

Access grids securely

Construct workflows

Submit to computing resources

Page 6: EUROGRID – An Integrated User–Friendly Grid System Hans–Christian Hoppe, Karl Solchenbach A Member of the ExperTeam Group Pallas GmbH Hermülheimer Straße

© Pallas GmbH

EUROGRID Functionality and Services

Monitor progress, retrieve results

Control&steer execution

Page 7: EUROGRID – An Integrated User–Friendly Grid System Hans–Christian Hoppe, Karl Solchenbach A Member of the ExperTeam Group Pallas GmbH Hermülheimer Straße

© Pallas GmbH

EUROGRID Functionality and Services

Application–specific interfaces

Page 8: EUROGRID – An Integrated User–Friendly Grid System Hans–Christian Hoppe, Karl Solchenbach A Member of the ExperTeam Group Pallas GmbH Hermülheimer Straße

© Pallas GmbH

EUROGRID Architecture and Implementation

Interactive client for end–users

– uses SSL for all communication

– signs all requests with user’s private key

Gateway as single point of site entry

– acts as SSL server– rejects connections lacking a

valid user certificate

Keystore

Workflow Construction Workflow Monitoring

EUROGRID Client

Gridsites

Keystore management Application Plugins

EUROGRID Gateway

Firewall

Unsafe Internet(SSL)

Page 9: EUROGRID – An Integrated User–Friendly Grid System Hans–Christian Hoppe, Karl Solchenbach A Member of the ExperTeam Group Pallas GmbH Hermülheimer Straße

© Pallas GmbH

EUROGRID Architecture and Implementation

NJS controls workflow execution

– maps to local userid (UUDB)– incarnates tasks into

command sequences (IDB)– provides information about

available resources (RDB)

Interfaces to execution systems

– drives shells, queueing systems, load balancers (TSI)

EUROGRID Gateway

TSI

Executionplatform

NJS

Safe Intranet (TCP or SSL)

Firewall

UUDB

Firewall

IDB

Other Grid sites

RDB

Page 10: EUROGRID – An Integrated User–Friendly Grid System Hans–Christian Hoppe, Karl Solchenbach A Member of the ExperTeam Group Pallas GmbH Hermülheimer Straße

© Pallas GmbH

EUROGRID Architecture and Implementation

Emphasizes extensibility– user interfaces &

functionality (plugins)– user information (UUDB)– new abstract tasks (IDB)– support additional execution

systems (TSI)

Page 11: EUROGRID – An Integrated User–Friendly Grid System Hans–Christian Hoppe, Karl Solchenbach A Member of the ExperTeam Group Pallas GmbH Hermülheimer Straße

© Pallas GmbH

EUROGRID Technology

Client and server components implemented in Java–2

Authentication uses X.509 certificates– software can work with any PKI scheme– even Globus temporary certificates can work …

Coexistence with firewalls– gateway as single point of entry– can run outside firewall, in DMZ or inside firewall– user authentication at that point: rogue users can’t go further

Secure data transmission using SSL– additional data encryption considered in EUROGRID

Use of XML for– storing workflows– databases

Page 12: EUROGRID – An Integrated User–Friendly Grid System Hans–Christian Hoppe, Karl Solchenbach A Member of the ExperTeam Group Pallas GmbH Hermülheimer Straße

© Pallas GmbH

Ongoing Projects

EUROGRID = Grid system for seamless access tocomputing and data services

Project Objectives Duration Funded by

UNICORE Plus

SW development, deployment at HPC centers

01/2000 –12/2002

German govt. (BMBF)

EUROGRID European HPC centers, scientific applications, industrial involvement

11/2000 – 10/2003

IST–1999–20247

GRIP Interoperability of EUROGRID and Globus

01/2002 – 12/2003

IST–2001–32257

Page 13: EUROGRID – An Integrated User–Friendly Grid System Hans–Christian Hoppe, Karl Solchenbach A Member of the ExperTeam Group Pallas GmbH Hermülheimer Straße

© Pallas GmbH

Availability and Outlook

Current version: EUROGRID 1.0 (UNICORE 4.0)– open source release of full sources– available from UNICORE Forum web pages (www.unicore.org)– Upcoming project results to be made available likewise …

Active participation in the GGF– security model– workflow model and plugin interface– Grid operation (PKI issues, …)

Moving towards supporting OGSA– UNICORE demonstrator by David Snelling …

Deployment in FP5 projects (physics, medicine, …)– domain– and application–specific extensions

Interest in participating in FP 6 projects– deployment and extensions– integration into OGSA framework

Productization of the EUROGRID components

Page 14: EUROGRID – An Integrated User–Friendly Grid System Hans–Christian Hoppe, Karl Solchenbach A Member of the ExperTeam Group Pallas GmbH Hermülheimer Straße

© Pallas GmbH

Further Information

Contact [email protected]

WWW pageshttp://www.fz–juelich.de/unicore UNICORE Plus projecthttp://www.unicore.org UNICORE Forumhttp://www.eurogrid.org EUROGRID projecthttp://www.grid–interoperability.org GRIP project

UNICORE test GRIDhttp://www.fz-juelich.de/unicore-test

Source code releasehttp://www.unicore.org/downloads.htm UNICORE Forum