19
Gridbus Toolkit for Belle Analysis Data Grid and Utility Computing Rajkumar Buyya Grid Computing and Distributed Systems (GRIDS) Lab. Dept. of Computer Science and Software Engineering The University of Melbourne Melbourne, Australia www.gridbus.org WW Grid

Gridbus Toolkit for Belle Analysis Data Grid and Utility Computing

Embed Size (px)

DESCRIPTION

WW Grid. Gridbus Toolkit for Belle Analysis Data Grid and Utility Computing. Gri d Computing and D istributed S ystems (GRIDS) Lab. Dept. of Computer Science and Software Engineering The University of Melbourne Melbourne, Australia www.gridbus.org. Rajkumar Buyya. - PowerPoint PPT Presentation

Citation preview

Page 1: Gridbus Toolkit for Belle Analysis Data Grid and Utility Computing

Gridbus Toolkit for Belle Analysis Data Grid and Utility

Computing

Rajkumar BuyyaGrid Computing and Distributed Systems (GRIDS) Lab. Dept. of Computer Science and Software EngineeringThe University of MelbourneMelbourne, Australia

www.gridbus.org

WW Grid

Page 2: Gridbus Toolkit for Belle Analysis Data Grid and Utility Computing

2

The Gridbus Project @ Melbourne:Enable Leasing of IT Services on Demand

WWG

World Wide Grid!On Demand Utility

Computing

Gridbus

Distributed Data

Page 3: Gridbus Toolkit for Belle Analysis Data Grid and Utility Computing

3

Gridbus Technologies

Gridscape Interactive Grid Testbed Portal Generator

G-monitor Grid Application Execution Management Portal

Data Grid Broker QoS based Scheduling of Distributed Data Oriented Apps

(- uses Nimrod-G dispatcher) Grid Market Directory

A Registry for GSPs and their Services – VO/VE Grid Bank

A Grid Accounting Services Many Research Tools – GridSim, VPM, Libra, etc. Apps: Brain Activity Analysis, Docking, Gemail, NLE?, of

course Belle!

Page 4: Gridbus Toolkit for Belle Analysis Data Grid and Utility Computing

4

Belle Data Grid: Infrastructure Setup

GMonitor

@ PRAGMA-4(Monash Univ.)

Grid MarketDirectoryGridscapeG-monitor

Melbourne U

PCs @GRIDS/EPPLab

Gridbus+Nimrod-G

Melbourne

GRIDS Lab: IBM eServer PC – pletnev

EPP Lab: PC

Sydney

IBM eServer@ Physics

InternetBelle Grid

Belle Visualisation

Belle DataCatalogue

Canberra

IBM eServer@ ANU

(Sun WS @ GRIDS Lab)

Adelaide

IBM eServer@ CS

* All Grid nodes have BASF code and Globus/Linux; Some have Tomcat..

Page 5: Gridbus Toolkit for Belle Analysis Data Grid and Utility Computing

5

A Typical IBM Node Setup Events – e.g., Melbourne Node

IBM eServer Package Arrival May 27 @ 11.55am

Opening, Assembly, Basic setup By May 27 evening Red Hat Linux installed Applied for belle.cs.mu.oz.au MAC address registration for Internet access!

Upgraded Linux to RedHat 8? – May 29 Registration belle.cs.mu.oz done May 30 Deployed Globus (30/5), Node certificate (31/5) BASF code, Gridbus, Nimrod installed & up Reverse DNS problem solved – June 1 IBM Engineer (Benjamin from Singapore) arrives –&

worked with Gridbus team – June 2-4 IBM Singapore (Michael M) – June 4 at 6.30pm – 9.30pm

Page 6: Gridbus Toolkit for Belle Analysis Data Grid and Utility Computing

6

Result: Grid Baby in 9 daysProud Parents (Melb. Node)

Page 7: Gridbus Toolkit for Belle Analysis Data Grid and Utility Computing

Let us Play with 4 Babies (@ S , C, M, A) and Friends and

Discover what the Universe is made of

Belle Data Grid Demonstration

Page 8: Gridbus Toolkit for Belle Analysis Data Grid and Utility Computing

8

Playground

GMonitor

@ PRAGMA-4(Monash Univ.)

Grid MarketDirectoryGridscapeG-monitor

Melbourne U

PCs @GRIDS/EPPLab

Gridbus+Nimrod-G

Melbourne

GRIDS Lab: IBM eServer PC – pletnev

EPP Lab: PC

Sydney

IBM eServer@ Physics

InternetBelle Grid

Belle Visualisation

Belle DataCatalogue

Canberra

IBM eServer@ ANU

(Sun WS @ GRIDS Lab)

Adelaide

IBM eServer@ CS

* All Grid nodes have BASF code and Globus/Linux; Some haveTomcat..

Page 9: Gridbus Toolkit for Belle Analysis Data Grid and Utility Computing

9

Belle Data Grid Portal

Page 10: Gridbus Toolkit for Belle Analysis Data Grid and Utility Computing

10

G-Monitor: Setup Experiment

Page 11: Gridbus Toolkit for Belle Analysis Data Grid and Utility Computing

11

Grid Resources

Page 12: Gridbus Toolkit for Belle Analysis Data Grid and Utility Computing

12

Jobs Status

Page 13: Gridbus Toolkit for Belle Analysis Data Grid and Utility Computing

13

Jobs Status

Page 14: Gridbus Toolkit for Belle Analysis Data Grid and Utility Computing

14

Experiment Status

Page 15: Gridbus Toolkit for Belle Analysis Data Grid and Utility Computing

15

Live Graphs: # ready, exec, failed, done

Page 16: Gridbus Toolkit for Belle Analysis Data Grid and Utility Computing

16

Jobs Status Statistics

Page 17: Gridbus Toolkit for Belle Analysis Data Grid and Utility Computing

17

Jobs: % Completed

Page 18: Gridbus Toolkit for Belle Analysis Data Grid and Utility Computing

18

Completion Progress Status

Page 19: Gridbus Toolkit for Belle Analysis Data Grid and Utility Computing

IBM PR/Vision Machine Focus:from 2001 onwards

Grid/ On Demand/ Data-Intensive/ Autonomic/Utility

Computing

- Gridbus an example Technology that demonstrates how one can realise this vision!