Grid-enabling the Australian Synchrotron

24 February 2005

Project Program

• Phase 1 (to end January 2005)

– Specification of grid requirements

– Consultations with scientists

– Preparation of discussion paper

• Phase 2 (to end February 2005)

– Circulation of discussion paper

– Consolidation of comments and research

– Preparation of draft project proposal

• Phase 3 (to end March 2005)

– Circulate draft project proposal (by 11 March 2005)

– Consult with key stakeholders

– Conduct forum with key scientists and stakeholders

– Prepare final project report (by 25 March 2005)

Key Issues

• Data security

• Data management

• Data linking

• Data manipulation and visualisation

• Security, authentication, audit trails

• Telepresence

• Remote operations

• Production class facilities

• Virtual organisation management

Responses to Discussion Paper

• Generally supportive of discussion paper context

• Reinforced data security as key issue

• Reinforced the need to link related data (experiment, beamline, etc)

• Noted not many examples worldwide, although similar to Diamond

• Network security and reliability issues are important

• Remote access and telepresence are key facilitating needs

Project Scope

• National Data Structure

– primary, backup, archive

• Regional nodes as ‘virtual instruments’

• Secure Data Network

• Data Grid

• Semantic Grid

National Data Architecture

Virtual Laboratory

Virtual Laboratory

InstitutionalStorage

SecondaryStorage

SecondaryStorage

InstitutionalStorage

Backup Storage

Primary Storage

Primary Storage

ArchiveStorage

Backup Storage

ArchiveStorage

National Data Architecture

Virtual Laboratory

Virtual Laboratory

InstitutionalStorage

SecondaryStorage

SecondaryStorage

InstitutionalStorage

Backup Storage

Primary Storage

Primary Storage

ArchiveStorage

Backup Storage

ArchiveStorage

National Data Architecture

Virtual Laboratory

Virtual Laboratory

InstitutionalStorage

SecondaryStorage

SecondaryStorage

InstitutionalStorage

Backup Storage

Primary Storage

Primary Storage

ArchiveStorage

Backup Storage

ArchiveStorage

Data and Semantic Grid Development

• Coordinated research and development programme

• Integration with international activities

• Involvement of formal and informal networks of scientists

• Phased approach:

– Phase1: Quick runs using available technologies with key metadata to facilitate later stages

– Phase 2: Provide support tools and services for data management

– Phase 3: Develop technologies/techniques for semantic grid.

Project Costs

• Data Centre - Capital: $5M, Operating: $2M/a

• Regional ‘virtual’ nodes: (each) Capital: $0.5M, Operating $0.3m/a

• Data Grid and Semantic Grid Research and Development: $3M

• Network and other costs: $1M

– excludes building costs

Project Timelines

0 0.5 1 1.5 2 2.5 3

Semantic Grid Research

Data Centre

Virtual Lab Design

Data Stds

Establishment

Year

Operational Structure

• Formal project management structure and processes

• Formalise operational management of data