11-Feb-2004 IoP Half Day Meeting: Getting Ready For the Grid Peter Clarke SC2003 Video

11-Feb-2004IoP Half Day Meeting: Getting Ready For the Grid Peter Clarke

SC2003 Video


An Introduction to Grids

Teragrid

Peter Clarke / [email protected] Meeting / Portland Place / 11-Feb-04


• Scientific Requirements for Grids

• What is a Grid ?

• A word on Interoperation & Standardisation

• Where can you find a Grid

• Concluding thoughts


Take a tunnel …….

Particle Physics

Fill with magnets and expensive

Detectors..

Smash protons together and catch the debris

…

Discover the origin of mass


~1-10 Gbps

Tier 1

Tier2 Center

Online System

CERN 700k SI95

~1 PB Disk; Tape Robot

FNAL: 200k SI95; 600

TB

IN2P3 Center

INFN Center

RAL Center

InstituteInstituteInstituteInstitute ~0.25TIPS

Workstations

~100-400 MBytes/se

c

0.1–1 GbpsPhysics data cache

~PByte/sec

~1-10 Gbps

Tier2 Center

Tier2 Center

Tier2 Center

~1-10 Gbps

Tier 0 +1

Tier 3

Tier 4

Tier2 Center

Experiment


Crab Nebula

Optical

RadioInfra-red

X-ray

Jet in M87

HST optical

Gemini mid-IR

VLA radio

Chandra X-ray

Astronomy

Federation of astronomical surveys On demand discovery of information relevant to a study



Current system very Minimal technologically

Mammography

Digitise

Other information

Remote Radiographers

More opinions


These applications generate Grid like distributed computing requirements:

• Massive & Dynamic resources for compute and store – leading to registration and discovery requirements

• Federation of heterogeneous systems

• Federation of many disparate data and meta data

•Access for many widespread “loosely connected” users with a “standard” credential

• Replication management

• Secure virtual systems (“VPGs”)

• On demand access to vast compute power

• Inter resource accounting

• Agreements……………..


So … What is a GRID

… many things to many people….

• Federation of Clusters

• Virtualisation of computing

• Heterogeneity

• Discovery

• Standards

• …


Power:

110V AC

60Hz

Computing: ?

?

At the highest level it is computing coming out of a wall socket….


User/Application

Storage ResourceCompute resource

User registration Information/Databases


User/Application

Information/Databases

Look at analogue in WWW

Middleware: Web Server

Middleware: Web Client

Standards for access (HTTP on port 80)

Middleware: Web Server


User/Application

User registrationResource availability Directories

Access & Publication Access & Publication

Client Discovery & Access

Subscription & Publication

Third party services

Resource Brokering

~~~~~~~~~

~~~~~

Credential Management

Credential issue


@#%&*!

E = mc2

Grid Middleware

“Putting the bottleneck back in the

Scientist’s mind”

… or as stolen form S.Lloyd…


Leads to need for GRID middleware to mediate all this :

Application

AuthenticationResource

InformationResource

AllocationData

accessMetadata

cataloguing

GRID middleware

AuthorisationNetwork

protocols& servicesCPU schedulers

Mass storageaccess

Resource specific services


NetworkNetwork

Today: Virtual Private Network (VPN): Virtualises Network connection

between sitesMakes enterprise think it owns a

dedicated secure connection

Virtualisation


The GridThe Grid

Tomorrow: Virtual Private Grid (VPG): Virtualises Computing, Storage and Network connection between sitesMakes enterprise think it owns a

dedicated secure computer system


The GridThe Grid

Next Year: Virtual Private Services ???:

Everything built from robust, interacting secure services provided

by trusted GridCos

Service

Service

Service

Service

Service

Service


A word on interoperability and Standards

• Grids will not work by adapting each grid to talk to another. Or adopting the same bespoke software.

• Grids will work by defining and agreeing standards in analogy with the internet

• This is the Goal of the Global Grid Forum – it’s a long and hard job


Where can you go and use a Grid


SomeGrid Testbeds

The UK e-Science Grid

UK Particle PhysicsTestbed (GridPP)

The European DataGrid Testbed


SomeGrid Production Services

The JISC Clusters

UK Particle PhysicsTestbed (GridPP-2)

UK E-Science Grid – 2


EGEE will bind national infrastructures - focussing all activities towards establishing a production quality Grid for Europe

EGEE

A production Europe Grid forAn EU Flagship Project Starting Now


Concluding Remarks

Grids are an evolution which was waiting to happen

Grids are about seamless discovery and use of heterogeneous resources around the globe

Grids are about standards for interoperation, just as the internet only works because of standards

Grids are about “virtualising” Computing just as a “VPN” virtualised a leased line

Grids are set to evolve to a Web-Services framework – where everything is just a set of self describing,

discoverable, interoperating services

Documents

11-Feb-2004 IoP Half Day Meeting: Getting Ready For the Grid Peter Clarke SC2003 Video