GRID COMPUTINGGRID COMPUTINGA new trend of super computingA new trend of super computing

John Martin R John Martin R

What is Grid What is Grid Computing ?Computing ?

Grid computingGrid computing is a form of distributed is a form of distributed computing whereby a "super and computing whereby a "super and virtual computer" is composed of a virtual computer" is composed of a cluster of networked, loosely-coupled cluster of networked, loosely-coupled computers, acting in concert to computers, acting in concert to perform very large tasks.perform very large tasks.

Grid computingGrid computing is intended to provide is intended to provide computational power.computational power.

Computational GridComputational Grid

A A Computational GridComputational Grid as “a hardware and as “a hardware and software infrastructure that provides software infrastructure that provides dependable, consistent, pervasive, and dependable, consistent, pervasive, and inexpensive access to computational inexpensive access to computational capabilities”.capabilities”.GridGrid is a terminology used with respect to is a terminology used with respect to unification of resources, they may not only unification of resources, they may not only be the clusters, they might be standalone be the clusters, they might be standalone machines scattered across the globe. machines scattered across the globe. Grid Grid can encompass desktop PCs, but can encompass desktop PCs, but more often than not its focus is on more more often than not its focus is on more powerful workstations, servers, and even powerful workstations, servers, and even mainframes and supercomputers working mainframes and supercomputers working on problems involving huge datasets. on problems involving huge datasets.

Computational GridComputational Grid

Objectives of Grid Objectives of Grid ComputingComputing

To obtain the computational power without the huge costs of super-computing, and that CPU cycles would otherwise be wasted are put to good use.To share CPU time and also other things such as data files.

What makes up a Grid ?What makes up a Grid ?

Grid Computing can also be Grid Computing can also be defined as the seamless provision defined as the seamless provision of access to possibly of access to possibly remoteremote, , possibly possibly heterogeneousheterogeneous, possibly , possibly untrustinguntrusting, possibly , possibly dynamicdynamic computing resources.computing resources.

Possibly Remote Computing Resources: Means that local resources, which are on the same LAN, and remote resources, which are geographically distant, can be accessed in exactly the same way on the Grid.

Possibly Heterogeneous Computing Resources: Some computers on the Grid can run different Operating Systems on different types of machines. Accessing them via the Grid should be possible without making any special allowances for this.

Possibly Untrusting Computing Resources: Means that the owner of a Computing resource on the Grid might not know or trust other users but should still be confident that they cannot access any non-shared data on their computer. The Grid should handle this security checking without any specific instruction from the user or from the sharer.

Possibly Dynamic Computing Resources: One of the major selling points of Grid Computing is that it makes use of otherwise wasted CPU cycles. The problem with this is that the availability of computers to the Grid changes rapidly as computers become busy and then idle as their owner's usage varies. The Grid system should ensure that this dynamism is hidden from users so that they do not have to program explicitly to take account of this.

Gc provides seamless Gc provides seamless access to:access to:

Dc vs GcDc vs Gc

Distributed computingDistributed computing is a science is a science which solves a large problem by which solves a large problem by giving small parts of the problem to giving small parts of the problem to many computers to solve and then many computers to solve and then combining the solutions for the parts combining the solutions for the parts into a solution for the problem.into a solution for the problem.

Distributed computingDistributed computing is a subset of is a subset of grid computing.grid computing.

Why do we need …?Why do we need …?The rate of increase in network bandwidth The rate of increase in network bandwidth is increasing at a rate faster than that of is increasing at a rate faster than that of processor speed which means that the way processor speed which means that the way to make best use of computing power is to to make best use of computing power is to network many computers together in an network many computers together in an efficient fashion.efficient fashion.Every traditional science Every traditional science (Physics, Chemistry, (Physics, Chemistry,

Mathematics, Biology, Astronomy, and many others)Mathematics, Biology, Astronomy, and many others) is relying is relying more and more on computers and more and more on computers and computational power. Grid Computing is computational power. Grid Computing is therefore seen as the computing technology therefore seen as the computing technology enabling the advancement of all sciences.enabling the advancement of all sciences.

How it works ?How it works ?

The Grid relies on advanced software, called The Grid relies on advanced software, called middleware, which ensures middleware, which ensures seamless seamless communicationcommunication between different computers between different computers and different parts of the world.and different parts of the world.

The Grid The Grid search engine findssearch engine finds the the data/resources the scientist needs, but also data/resources the scientist needs, but also the data processing techniques and the the data processing techniques and the computing power to carry them out.computing power to carry them out.

It then It then distributedistribute the computing taskthe computing task to to wherever in the world there is spare wherever in the world there is spare capacity, and send the result to the scientist.capacity, and send the result to the scientist.

An interesting prediction is that grid An interesting prediction is that grid technology will be slowly absorbed into technology will be slowly absorbed into enterprise fabrics. enterprise fabrics.

Grid 1.0Grid 1.0 – concerned with – concerned with the the virtualization, aggregation and sharing of virtualization, aggregation and sharing of compute resources.compute resources.

Grid 2.0Grid 2.0 – focused on – focused on the virtualization, the virtualization, aggregation and sharing of all compute, aggregation and sharing of all compute, storage, network and data resources. storage, network and data resources.

Grids – Where to ?Grids – Where to ?

The key term is “The key term is “virtualizationvirtualization” (encapsulation behind ” (encapsulation behind a common interface of diverse implementationsa common interface of diverse implementations) ) is is being driven by the need to various enterprises to being driven by the need to various enterprises to create a create a virtual resource marketvirtual resource market to allocate resources to allocate resources based on business demandbased on business demand..Virtualization introduces a layer of abstractionVirtualization introduces a layer of abstraction:: instead of having to snoop out what resources are instead of having to snoop out what resources are available and try to adapt a problem to use them, a available and try to adapt a problem to use them, a user can describe a resource environment (virtual user can describe a resource environment (virtual workspace) and expect it to be deployed on the grid. workspace) and expect it to be deployed on the grid. The mapping between the physical resources and the The mapping between the physical resources and the virtual workspace will be handled using virtual virtual workspace will be handled using virtual machines, virtual appliances, distributed storage machines, virtual appliances, distributed storage facilities and network overlays (“virtual grids”). facilities and network overlays (“virtual grids”). Virtualization covers both, Virtualization covers both, datadata (flat files, databases (flat files, databases etc.) and etc.) and computing resources. computing resources.

VirtualizationVirtualization

Grid as Grid as workflow virtualizationworkflow virtualization - the Grid computing - the Grid computing services are used to execute and manage processes services are used to execute and manage processes across multiple compute platforms.across multiple compute platforms.Data Grid as Data Grid as data virtualizationdata virtualization - the management of - the management of shared collections independently of the remote storage shared collections independently of the remote storage systems where the data is stored.systems where the data is stored.Name space virtualizationName space virtualization - logical names for - logical names for resources, users, files, and metadata that are resources, users, files, and metadata that are independent of the name spaces used on the remote independent of the name spaces used on the remote resource. resource. Trust virtualizationTrust virtualization - the ability to manage - the ability to manage authentication and authorization independently of the authentication and authorization independently of the remote resource.remote resource.Constraint virtualizationConstraint virtualization - the ability to manage access - the ability to manage access controls independently of the remote resource.controls independently of the remote resource.Network virtualizationNetwork virtualization - the ability to manage - the ability to manage transport in the presence of network devices. transport in the presence of network devices.

VirtualizationVirtualization

Grid 2.0 EmergingGrid 2.0 Emerging

Grid 1.0Grid 1.0Compute Intensive Compute Intensive Cycle AggregationCycle Aggregation

Software ServicesSoftware Services

Virtualization Virtualization Consolidation of Consolidation of

ResourcesResources

Grid 2.0*Grid 2.0* Virtualized Compute, Virtualized Compute,

Storage, Network, DataStorage, Network, Data

Service OrientedService Oriented

Distributed, Parallel, Distributed, Parallel, stateless and stateless and transactional appstransactional apps

The promise is that in The promise is that in Grid 2.0Grid 2.0 the resources the resources will be easier to define, test, install, will be easier to define, test, install, transport and adjust on demand.transport and adjust on demand.

Tools and StandardsTools and Standards1. Globus:1. Globus:

The Globus Toolkit designed by the Globus Alliance contains a set of software tools - Services, APIs and protocols - to facilitate constructions of Grids. It is the most widely used toolkit for building of Grids. It includes tools for, among other things, security, resource management and communication.The Globus Alliance also researches various issues related to Grid Computing, especially issues relating to the infrastructure of Grids.

2. Condor and Condor -G:2. Condor and Condor -G:Condor is a software tool for distributing computationally intensive jobs over Grids. It works by using spare CPU cycles on other computers. From the Condor product Condor-G has been created. Condor-G is an enhanced version of Condor which can be used to make Grids also.It uses Globus tools to provide security, resource discovery, and resource access.

Commercial Grid Commercial Grid ProductsProducts

http://www.parabon.com

http://www.ud.com

Computing and CommunicationComputing and Communication Evolution: 1960-2010!Evolution: 1960-2010!

* Sputnik

1960 1970 1975 1980 1985 1990 1995 2000

* ARPANET

* Email* Ethernet

* TCP/IP

* Internet Era* WWW Era

* Mosaic

* XML

* PC Clusters* Crays * MPPs

* Mainframes

* HTML

* W3C

* P2P

* Grids* XEROX PARC wormC

OM

PU

TIN

GC

om

mu

nic

ati

on

* Web Services

* Minicomputers

* PCs

* Clusters

* PDAs* Workstations

* HTC

2010

* e-Science

* Computing as Utility

* e-Business

* SocialNet

ControlCentralised Decentralised

Supercomputing Power For Supercomputing Power For Everyone ?Everyone ?

In the past, supercomputing power has been In the past, supercomputing power has been available only to very few people - certain people in available only to very few people - certain people in research institutions and some businesses. research institutions and some businesses. If theIf the Grid is ever created, though, supercomputing Grid is ever created, though, supercomputing power will be available to anyone who wishes to power will be available to anyone who wishes to access it.access it.This means that, amongst other things, anyone can This means that, amongst other things, anyone can do huge password searches or can try and crack do huge password searches or can try and crack public/private keys. public/private keys. With the creation of theWith the creation of the Grid, these issues will have Grid, these issues will have to be addressed either by somehow restricting to be addressed either by somehow restricting users from being able to do such searches or by users from being able to do such searches or by using even larger keys and passwords. using even larger keys and passwords. There are no doubt many other social issues that There are no doubt many other social issues that will arise when everyone can have access to will arise when everyone can have access to supercomputing power, and they will have to be supercomputing power, and they will have to be addressed as well.addressed as well.

Organizational politics act very much like a barrier to Organizational politics act very much like a barrier to implementing Grid computing.implementing Grid computing.““Server-hugging” – organizations have a sense of Server-hugging” – organizations have a sense of ownership over the resources bought or allocated for ownership over the resources bought or allocated for their use.their use.Perceived loss of control or access over resources.Perceived loss of control or access over resources.Lack of data security among departments.Lack of data security among departments.Fear of external data leaks.Fear of external data leaks.Reduced priority of projects - sometimes users believe Reduced priority of projects - sometimes users believe that they need dedicated IT resources to complete their that they need dedicated IT resources to complete their work accurately and efficiently.work accurately and efficiently.Risks associated with enterprise-wide deployment - how Risks associated with enterprise-wide deployment - how do different geographies and cultures come together to do different geographies and cultures come together to agree on global priorities, configurations, standards, agree on global priorities, configurations, standards, and policies.and policies.In fact, how do you encourage people to let others run In fact, how do you encourage people to let others run code on their machines ?code on their machines ?

What’s holding us ?What’s holding us ?

Once a technology matures, it does Once a technology matures, it does not necessarily take long time for it to not necessarily take long time for it to become widespread. become widespread.

This same idea could be applied to This same idea could be applied to Grid Computing - if some of the Grid Computing - if some of the fundamental issues holding it back fundamental issues holding it back are addressed then computing power are addressed then computing power could truly become as widespread and could truly become as widespread and easily accessible as electricity is now.easily accessible as electricity is now.

Gc as successful technology Gc as successful technology !!

Thank you !Thank you !

Clarifications ?Clarifications ?