23
The Grid What is it? what is it for?

The Grid What is it? what is it for?. Your university or experiment logo here Web: information sharing Invented at CERN by Tim Berners-Lee No. of Internet

Embed Size (px)

Citation preview

Page 1: The Grid What is it? what is it for?. Your university or experiment logo here Web: information sharing Invented at CERN by Tim Berners-Lee No. of Internet

The Grid

What is it?what is it for?

Page 2: The Grid What is it? what is it for?. Your university or experiment logo here Web: information sharing Invented at CERN by Tim Berners-Lee No. of Internet

Your university or experiment logo here Web: information

sharing• Invented at CERN by Tim Berners-Lee

No. of

Inte

rnet

host

s (m

illio

ns)

Year

• Agreed protocols: HTTP, HTML, URLs

• Anyone can access information and post their own

• Quickly crossed over into public use Tim

Berners-Lee

Page 3: The Grid What is it? what is it for?. Your university or experiment logo here Web: information sharing Invented at CERN by Tim Berners-Lee No. of Internet

Your university or experiment logo here

SETI@home• Search for Extra-Terrestrial Intelligence

• Uses home PCs to analyse radio telescope data in bits

• Distributed computing project, not a grid

Users - 5,414,992

Results received - 1,862,972,261

Years of CPU Time – 2,286,333

Extraterrestrials found – 0

• Other @home projects• ClimatePrediction.net • United Devices Cancer

Research Project

Page 4: The Grid What is it? what is it for?. Your university or experiment logo here Web: information sharing Invented at CERN by Tim Berners-Lee No. of Internet

Your university or experiment logo here

File-sharing

• No centralised database of files• Legal problems with sharing

copyrighted material• Security problems

• Peer to peer

Centralised network

Peer-to-peer network

Page 5: The Grid What is it? what is it for?. Your university or experiment logo here Web: information sharing Invented at CERN by Tim Berners-Lee No. of Internet

Your university or experiment logo here Flashmob

Computing

• Over 700 PCs connected• Best run – 150 PCs, 77 GFlops

• Good for interdependent parallel problems

• Cheap, ad hoc, relies on volunteers

• Not permanent

• Idea of graduate students at University of San Francisco

• Connect PCs via a LAN, all working on the same problem = instant supercomputer

FlashMob 1 San Francisco, 7 April

2004

Page 6: The Grid What is it? what is it for?. Your university or experiment logo here Web: information sharing Invented at CERN by Tim Berners-Lee No. of Internet

Your university or experiment logo here

Grid: Resource Sharing• Share more than information

• Data, computing power, applications

MIDDLEWARE

CPUCluster

User Interface Machine

CPUCluster

Resource Broker

DiskServer

Your Program

Disks, CPU etc

PROGRAMS

OPERATING SYSTEM

Word/Excel

Email/Web

Your Program

Games

• Middleware handles everything

Single computer

The Grid

Page 7: The Grid What is it? what is it for?. Your university or experiment logo here Web: information sharing Invented at CERN by Tim Berners-Lee No. of Internet

Your university or experiment logo here

Electricity GridAnalogy with the Electricity Power

Grid

'Standard Interface'

Power Stations

Distribution Infrastructure

Page 8: The Grid What is it? what is it for?. Your university or experiment logo here Web: information sharing Invented at CERN by Tim Berners-Lee No. of Internet

Your university or experiment logo here

Computing Grid

Computing and Data Centres

Fibre Optics of the Internet

Page 9: The Grid What is it? what is it for?. Your university or experiment logo here Web: information sharing Invented at CERN by Tim Berners-Lee No. of Internet

Your university or experiment logo here

How does it work?

Page 10: The Grid What is it? what is it for?. Your university or experiment logo here Web: information sharing Invented at CERN by Tim Berners-Lee No. of Internet

Your university or experiment logo here What can you do with a

Grid?• Astronomy

• Healthcare

• Bioinformatics

• Digital curation

To create digital Libraries and

Museums

Scanning

Remote consultanc

y

Optical

X ray

Digitize almost anything

Page 11: The Grid What is it? what is it for?. Your university or experiment logo here Web: information sharing Invented at CERN by Tim Berners-Lee No. of Internet

Your university or experiment logo here

Particle Physics

Page 12: The Grid What is it? what is it for?. Your university or experiment logo here Web: information sharing Invented at CERN by Tim Berners-Lee No. of Internet

Your university or experiment logo here

The CERN LHC

4 Large Experiments

The world’s most powerful particle accelerator - 2007

Page 13: The Grid What is it? what is it for?. Your university or experiment logo here Web: information sharing Invented at CERN by Tim Berners-Lee No. of Internet

Your university or experiment logo here

ATLAS and CMS

• General purpose• Origin of mass• Supersymmetry• 2,000 scientists from 34

countries

ATLAS• General purpose

detector• 1,800 scientists from

over 150 institutions

CMS

Page 14: The Grid What is it? what is it for?. Your university or experiment logo here Web: information sharing Invented at CERN by Tim Berners-Lee No. of Internet

Your university or experiment logo here

LHCb and ALICE

• Studying the differences between matter and anti-matter

• LHCb will detect over 100 million b and b-bar mesons each year

LHCb

These experiments will produce

Petabytes of data

1 PByte = 1,000,000 GByte

• Heavy ion collisions, to create quark-gluon plasmas

• 50,000 particles in each collision

ALICEConcorde(15 Km)

Mt. Blanc(4.8 Km)

One year’s data from LHC

would fill a stack of CDs 20km high

Page 15: The Grid What is it? what is it for?. Your university or experiment logo here Web: information sharing Invented at CERN by Tim Berners-Lee No. of Internet

Your university or experiment logo here

• What is the origin of mass? • Is it the Higgs Particle?

Looking for the Higgs

Massless Particle – Travels at the speed of light

Low Mass Particle – Travels slower

High Mass Particle – Travels slower still

• Not yet proven experimentally • Bigger and better particle accelerator - LHC

Page 16: The Grid What is it? what is it for?. Your university or experiment logo here Web: information sharing Invented at CERN by Tim Berners-Lee No. of Internet

Your university or experiment logo hereWhy do particle physicists need

the Grid?• Large amounts of data

• International collaborations

Example from LHC: starting from this event…

…we are looking for this “signature”Selectivity: 1 in 1013

Like looking for 1 person in a thousand world populations

Or for a needle in 20 million haystacks!

• ~100,000,000 electronic channels

• 800,000,000 proton-proton interactions per second

• 0.0002 Higgs per second

• 10 PBytes of data a year

• (10 Million GBytes = 14 Million CDs)

Page 17: The Grid What is it? what is it for?. Your university or experiment logo here Web: information sharing Invented at CERN by Tim Berners-Lee No. of Internet

Your university or experiment logo here

GridPP• 19 UK Universities, CCLRC

(RAL & Daresbury) and CERN• Funded by PPARC (Particle

Physics and Astronomy Research Council)

• Currently used by running US experiments BaBar (b mesons), D0 and CDF (proton-antiproton collisions)

20 Sites

3 Countries (England, Scotland,

Wales)

2,740 CPUs

67 Tbytes storage• Our Grid works!

Page 18: The Grid What is it? what is it for?. Your university or experiment logo here Web: information sharing Invented at CERN by Tim Berners-Lee No. of Internet

Your university or experiment logo here

LCG

• GridPP is part of LCG – currently the largest Grid in the world

138 Sites

34 Countries

13,784 CPUs

4402 Tbytes storage

Page 19: The Grid What is it? what is it for?. Your university or experiment logo here Web: information sharing Invented at CERN by Tim Berners-Lee No. of Internet

Your university or experiment logo here

Tier 0Where data comes from

Tier 1National centres

Tier 2Regional groups

Tier 3Institutes

Tier 4Workstations

Offline farm

Online system

CERN computer centre

RAL,UK

ScotGrid NorthGridSouthGrid London

ItalyUSA

Glasgow Edinburgh Durham

Tier Structure

FranceGermany

Detector

Page 20: The Grid What is it? what is it for?. Your university or experiment logo here Web: information sharing Invented at CERN by Tim Berners-Lee No. of Internet

Your university or experiment logo here UK Tier-1/A Centre

• High quality data services• National and International

Role• UK focus for International Grid

development

•1000 Dual CPU

•200 TB Disk•220 TB Tape (Capacity 1PB)

Grid Operations Centre

Page 21: The Grid What is it? what is it for?. Your university or experiment logo here Web: information sharing Invented at CERN by Tim Berners-Lee No. of Internet

Your university or experiment logo here UK Tier-2 Centres

ScotGridDurham, Edinburgh, Glasgow NorthGridDaresbury, Lancaster, Liverpool,Manchester, Sheffield

SouthGridBirmingham, Bristol, Cambridge,Oxford, RAL PPD, Warwick

LondonBrunel, Imperial, QMUL, RHUL, UCL

Mostly funded by HEFCE

Page 22: The Grid What is it? what is it for?. Your university or experiment logo here Web: information sharing Invented at CERN by Tim Berners-Lee No. of Internet

Your university or experiment logo here

Other Grids

• UK National Grid Service– UK’s core production

computational and data Grid

• EGEE (Europe)– Enabling Grids for E-

sciencE

• Nordugrid (Europe)– Grid Research and

Development collaboration

• Open Science Grid (USA)– Science applications from

HEP to biochemistry

Page 23: The Grid What is it? what is it for?. Your university or experiment logo here Web: information sharing Invented at CERN by Tim Berners-Lee No. of Internet

Your university or experiment logo here

The Future• Grow the LHC Grid• Spread beyond science

– Healthcare, commercial uses, government, games

• Will it become part of everyday life?