19
Gridbus Toolkit for Belle Analysis Data Grid and Utility Computing Rajkumar Buyya Grid Computing and Distributed Systems (GRIDS) Lab. Dept. of Computer Science and Software Engineering The University of Melbourne Melbourne, Australia www.gridbus.org WW Grid

Gridbus Toolkit for Belle Analysis Data Grid and Utility Computing Rajkumar Buyya Grid Computing and Distributed Systems (GRIDS) Lab. Dept. of Computer

Embed Size (px)

Citation preview

Gridbus Toolkit for Belle Analysis Data Grid and Utility

Computing

Rajkumar BuyyaGrid Computing and Distributed Systems (GRIDS) Lab. Dept. of Computer Science and Software EngineeringThe University of MelbourneMelbourne, Australia

www.gridbus.org

WW Grid

2

The Gridbus Project @ Melbourne:Enable Leasing of IT Services on Demand

WWG

World Wide Grid!On Demand Utility

Computing

Gridbus

Distributed Data

3

Gridbus Technologies

Gridscape Interactive Grid Testbed Portal Generator

G-monitor Grid Application Execution Management Portal

Data Grid Broker QoS based Scheduling of Distributed Data Oriented Apps

(- uses Nimrod-G dispatcher) Grid Market Directory

A Registry for GSPs and their Services – VO/VE Grid Bank

A Grid Accounting Services Many Research Tools – GridSim, VPM, Libra, etc. Apps: Brain Activity Analysis, Docking, Gemail, NLE?, of

course Belle!

4

Belle Data Grid: Infrastructure Setup

GMonitor

@ PRAGMA-4(Monash Univ.)

Grid MarketDirectoryGridscapeG-monitor

Melbourne U

PCs @GRIDS/EPPLab

Gridbus+Nimrod-G

Melbourne

GRIDS Lab: IBM eServer PC – pletnev

EPP Lab: PC

Sydney

IBM eServer@ Physics

InternetBelle Grid

Belle Visualisation

Belle DataCatalogue

Canberra

IBM eServer@ ANU

(Sun WS @ GRIDS Lab)

Adelaide

IBM eServer@ CS

* All Grid nodes have BASF code and Globus/Linux; Some have Tomcat..

5

A Typical IBM Node Setup Events – e.g., Melbourne Node

IBM eServer Package Arrival May 27 @ 11.55am

Opening, Assembly, Basic setup By May 27 evening Red Hat Linux installed Applied for belle.cs.mu.oz.au MAC address registration for Internet access!

Upgraded Linux to RedHat 8? – May 29 Registration belle.cs.mu.oz done May 30 Deployed Globus (30/5), Node certificate (31/5) BASF code, Gridbus, Nimrod installed & up Reverse DNS problem solved – June 1 IBM Engineer (Benjamin from Singapore) arrives –&

worked with Gridbus team – June 2-4 IBM Singapore (Michael M) – June 4 at 6.30pm – 9.30pm

6

Result: Grid Baby in 9 daysProud Parents (Melb. Node)

Let us Play with 4 Babies (@ S , C, M, A) and Friends and

Discover what the Universe is made of

Belle Data Grid Demonstration

8

Playground

GMonitor

@ PRAGMA-4(Monash Univ.)

Grid MarketDirectoryGridscapeG-monitor

Melbourne U

PCs @GRIDS/EPPLab

Gridbus+Nimrod-G

Melbourne

GRIDS Lab: IBM eServer PC – pletnev

EPP Lab: PC

Sydney

IBM eServer@ Physics

InternetBelle Grid

Belle Visualisation

Belle DataCatalogue

Canberra

IBM eServer@ ANU

(Sun WS @ GRIDS Lab)

Adelaide

IBM eServer@ CS

* All Grid nodes have BASF code and Globus/Linux; Some haveTomcat..

9

Belle Data Grid Portal

10

G-Monitor: Setup Experiment

11

Grid Resources

12

Jobs Status

13

Jobs Status

14

Experiment Status

15

Live Graphs: # ready, exec, failed, done

16

Jobs Status Statistics

17

Jobs: % Completed

18

Completion Progress Status

IBM PR/Vision Machine Focus:from 2001 onwards

Grid/ On Demand/ Data-Intensive/ Autonomic/Utility

Computing

- Gridbus an example Technology that demonstrates how one can realise this vision!