Embed Size (px)
DESCRIPTION
COSCUP 2012 講題簡報
Citation preview
大強子計算網格與大強子計算網格與 OSSOSS告訴您「機關」雲如何做運算告訴您「機關」雲如何做運算
Yuan CHAO ( 趙元 )(National Taiwan University, Taipei, Taiwan)
COSCUP2012/08/18-19
我是誰？
我是誰？Yuan CHAO (John)
YChao...
研究員高能物理
閒暇不務正業沒事就玩玩 OSS...
研究員高能物理
閒暇不務正業使用 OSS 做研究 ...
全球 LHC 計算網格Worldwide LHC
Computing Grid (WLCG)
什麼是 LHC ?
什麼是 LHC ?大型強子對撞型加速器
Large Hadron Colliderin 10 minutes
http://cdsweb.cern.ch/record/1129502http://www.youtube.com/watch?v=sldST8jP9jQhttp://copyright.web.cern.ch/
Large Hadron Colliderin 10 minutes
in 1.5 min.
http://cdsweb.cern.ch/record/1129502http://www.youtube.com/watch?v=sldST8jP9jQhttp://copyright.web.cern.ch/
LHCLHC
WWWWWW 的出生地的出生地 !!!!!!
SERN
LHCLHC
CERN Ski ClubCERN Ski Club
Why LHC ?大型強子對撞機做什麼用
... 給我五分鐘講物理
14
大霹靂大霹靂 The Origin of the UniverseThe Origin of the Universe
15
大霹靂大霹靂 The Origin of the UniverseThe Origin of the Universe
16
高能物理天文學高能物理天文學 HEP & Astro.HEP & Astro.
17
標準模型標準模型 Standard ModelStandard Model
~10-18 m宇宙的尺度 http://htwins.net/scale2/~10-1 m
膠子 光子 W/Z 子 重力子
強作用力 電磁力 弱作用力 重力
夸克
輕子
奈米 =10-9 m
18
標準模型標準模型 Standard ModelStandard Model
http://atlas.kek.jp/sub/photos/Physics/PhotoPhysicsSM.html
強子
輕子
媒介子
無法單獨存在
The "God-dammed" particle!
構成
19
四大問題四大問題 The QuestionsThe Questions
LHC was built for the following LHC was built for the following purposes:purposes:
質量的來源質量的來源To find the origin of mass... To find the origin of mass... the the Higgs Higgs boson.boson.暗物質與暗能量暗物質與暗能量Looking for the unification.. Looking for the unification.. Super-symmetrySuper-symmetry as well as as well as other candidates of other candidates of Dark MaterDark Mater & & Dark energyDark energy反物質的消失反物質的消失Investigate the mystery of Investigate the mystery of anti-matteranti-matter disappearance disappearance宇宙初期狀態宇宙初期狀態Physics at the early stage of the Physics at the early stage of the universe: universe: Heavy Ion CollisionsHeavy Ion Collisions and and Quark-Gluon PlasmaQuark-Gluon Plasma
Courtesy of Center for European Nuclear Research (CERN), Geneva, Switzerland.
如何研究？
如何研究？重新做出來！
如何研究？重新做出來！
E=mcE=mc ²²Pair-productionPair-production
有圖有真相NPNT
http://en.wikipedia.org/wiki/File:Top_antitop_quark_event.svg
https://cdsweb.cern.ch/record/1459470?ln=en
26
超導環場探測器超導環場探測器 Atlas DetectorAtlas Detector
A Toroidal LHC ApparatusA Toroidal LHC Apparatus→ → A general purposed detectorA general purposed detector
27
緊湊渺子線圈緊湊渺子線圈 CMS DetectorCMS Detector
Compact Muon SolenoidCompact Muon Solenoid→ → Also a general purposed detectorAlso a general purposed detector
3.8
28
緊湊渺子線圈緊湊渺子線圈 CMS DetectorCMS Detector
Compact Muon SolenoidCompact Muon SolenoidA general purposed detectorA general purposed detector
3.8
29
Detecting ParticlesDetecting Particles
Detect & identify particles through layersDetect & identify particles through layers
Giant digital camera!
超級數位相機
~ 150 million sensors
~ 150 million sensorsresolution to ~ 10 μm
~ 1 MByte / event
~ 1 MByte / event x 40 MHz collision
~ 1 MByte / event x 40 MHz collisionTrigger Rate → ~ 300 KHz
~ 1 MByte / event x 40 MHz collisionCapable Trigger Rate → ~ 300 KHz
Level-1 Filter → ~ 300 Hz
~ 1 MByte / event x 40 MHz collisionCapable Trigger Rate → ~ 300 KHz
Level-1 Filter → ~ 300 Hz→ ~ 300 MByte / s RAW data
~ 1 MByte / event x 40 MHz collisionCapable Trigger Rate → ~ 300 KHz
Level-1 reduction → ~ 300 Hz→ ~ 300 MByte / s RAW data x 2.x
→ ~ 10 – 15 PByte / year
~ 1 MByte / event x 40 MHz collisionCapable Trigger Rate → ~ 300 KHz
Level-1 reduction → ~ 300 Hz→ ~ 300 MByte / s RAW data x 2.x
→ ~ 10 – 15 PByte / year
~ 1 MByte / event x 40 MHz collisionCapable Trigger Rate → ~ 300 KHz
Level-1 reduction → ~ 300 Hz→ ~ 300 MByte / s RAW data x 2.x
→ ~ 10 – 15 PByte / year
每年壹萬伍千顆 1TB 硬碟 Needs 15K 1TB HDD per year
40
The Large Hadron ColliderThe Large Hadron Collider
Four major experiments at LHCFour major experiments at LHCAtlas, Alice, Atlas, Alice, CMSCMS, LHCb, LHCb
LHC first beam in Sep. 2008LHC first beam in Sep. 2008A technical trouble occurred A technical trouble occurred 10 days after the start10 days after the start
Physics restarted in Nov. 2009Physics restarted in Nov. 2009Energy starts at Energy starts at 0.9 TeV0.9 TeVPushed up to Pushed up to 2.36 TeV2.36 TeV in Dec. in Dec.
New energy record in 2010New energy record in 2010Collision at Collision at 7 TeV7 TeV on Mar. 30 on Mar. 30
Delivered data Delivered data ~36/pb ~36/pb in 2010in 2010Reached Reached ~5.7/fb~5.7/fb in 2011 in 2011Accumulated Accumulated ~6/fb~6/fb at at 8 TeV8 TeV in Jun. 2012 in Jun. 2012
Grid Computing網格運算
"A computational grid is a hardware and software infrastructure that provides dependable, consistent,
pervasive, and inexpensive access to high-end computational capabilities."
... by Carl Kesselman and Ian Foster in 1998
取用軟硬體計算資源的基礎建設
"The sharing that we are concerned with is not primarily file exchange but rather direct access to computers, software, data and other resources, as is required by a range of collaborative problem-
solving and resource-brokering strategies emerging in industry, science, and engineering. This sharing is, necessarily, highly
controlled, with resource providers and consumers defining clearly and carefully just what is shared, who is allowed to share, and the conditions under which sharing occurs. A set of individuals and/or
institutions defined by such sharing rules form what we call a virtual organization"
... "The Anatomy of the Grid" in 2000
共享運算資源的虛擬研究機構
44
網格運算網格運算 A Grid ChecklistA Grid Checklist
Coordinates resources that are Coordinates resources that are notnot subject subject to to centralizedcentralized control control
非中央集權式控管非中央集權式控管
45
網格運算網格運算 A Grid ChecklistA Grid Checklist
Coordinates resources that are Coordinates resources that are notnot subject subject to to centralizedcentralized control control
非中央集權式控管非中央集權式控管
Using standard, Using standard, openopen, general-purpose , general-purpose protocolsprotocols and interfaces and interfaces
開放標準開放標準
46
網格運算網格運算 A Grid ChecklistA Grid Checklist
Coordinates resources that are Coordinates resources that are notnot subject subject to to centralizedcentralized control control
非中央集權式控管非中央集權式控管
Using standard, Using standard, openopen, general-purpose , general-purpose protocolsprotocols and interfaces and interfaces
開放標準開放標準
To deliver To deliver nontrivial qualitiesnontrivial qualities of services of services
高品質服務高品質服務
47
全球全球 LHCLHC 計算網格計算網格 WLCGWLCG
Worldwide LHC Computing GridWorldwide LHC Computing GridLaunched in 2002, released design report in 2005, op in 2008Launched in 2002, released design report in 2005, op in 2008Distributed computing infrastructure for LHC experimentsDistributed computing infrastructure for LHC experiments提供給大強子對撞機實驗的網格運算服務提供給大強子對撞機實驗的網格運算服務
Linking 3 computing grids Linking 3 computing grids 整合三大網格整合三大網格EGI: EGI: EEuropean uropean GGrid rid IInitiativenitiative (Enabling Grid for E-SciencE)(Enabling Grid for E-SciencE)OSG: OSG: OOpen pen SScience cience GGrid (US)rid (US)NDGF: NDGF: NNordic ordic DData ata GGrid rid FFacilityacility
Providing service: Providing service: 服務現況服務現況Linking more than 300 computer centersLinking more than 300 computer centersProviding > 340,000 coresProviding > 340,000 coresMoving ~10GB/s for each experimentMoving ~10GB/s for each experimentArchiving 15PB data per yearArchiving 15PB data per year
48
網格架構 網格架構 WLCG ArchitectureWLCG Architecture
In total In total 11 T111 T1 centers connected directly to CERN centers connected directly to CERNNearly Nearly 150 T2150 T2 sites associated to one of the T1s sites associated to one of the T1s
49
大強子光纖網路大強子光纖網路 LHCOPNLHCOPN
ASGC is the ASGC is the currentcurrent only one Tier-1only one Tier-1 center in Asia center in Asia ((南韓即將投入南韓即將投入 ))
https://netstat.cern.ch/monitoring/network-statistics/visual/lhcopn.kml
50
Analysis Work FlowAnalysis Work FlowMoving jobs instead of
moving data
WLCG as a wholeis an OSS project!
開放原始碼的網格運算
52
Scientific LinuxScientific Linux
Fermi Linux (1998)Fermi Linux (1998)Based on Red Hat 5 – 9 with security hardening & tweaksBased on Red Hat 5 – 9 with security hardening & tweaks
End of End of free RedHatfree RedHatNeeds at least 3 years supportNeeds at least 3 years supportFreely distributableFreely distributableEasy transition from RedHatEasy transition from RedHat
→ → Fermi Linux from Fermi Linux from RHELRHEL source sourceVersions: Versions: 版本沿革版本沿革
S. L. 3.0.1 created by FermiLab S. L. 3.0.1 created by FermiLab 試水溫 試水溫 in in May 2004May 2004S. L. 3.0.2 first collaboration working with S. L. 3.0.2 first collaboration working with CERNCERN……Latest version: 6.2 & 5.8Latest version: 6.2 & 5.8
https://www.scientificlinux.org/
Carbon
53
Globus ToolkitGlobus Toolkit
Open source toolkits for building computing gridsOpen source toolkits for building computing gridsVersion 1.0 in 1998Version 1.0 in 1998
Role of Globus Toolkit Role of Globus Toolkit 網格工具箱網格工具箱A collections of solutions to distributed app.A collections of solutions to distributed app.Heterogeneity Heterogeneity 整合異質環境整合異質環境Standards Standards 開放標準與協定開放標準與協定http://www.globus.org/toolkit/
54
網格中介軟體網格中介軟體 Grid Middle-wareGrid Middle-ware
EEuropean uropean MMiddleware iddleware IInitiative (EMI)nitiative (EMI)Components: Components: 組成架構組成架構
Authentication: X. 509 certificatesAuthentication: X. 509 certificatesUI: GUI or CLI for user job submissionUI: GUI or CLI for user job submissionComputing ElementComputing ElementStorage ElementStorage ElementFile & Data ManagementFile & Data ManagementWorkload Management SystemWorkload Management System
http://gridtalk-project.blogspot.tw/2012/03/emi-and-opensource.html
http://emisoft.web.cern.ch/emisoft/index.html
統合傳統計算資源
55
作業流程作業流程 Job Work FlowJob Work Flow
EMI Hot Topic, JSC, FZJ
56
ROOT & RooFitROOT & RooFit
RROOT OOT OObject-bject-OOriented riented TToolkitoolkitData Analysis toolData Analysis tool
Written in C++ (millions of lines)Written in C++ (millions of lines)Open sourceOpen sourceIntegrated C++ interpreterIntegrated C++ interpreterFile formatsFile formatsI/O handling, graphics, plotting,I/O handling, graphics, plotting,math, histogram binning, eventmath, histogram binning, eventdisplay, geometric navigationdisplay, geometric navigationPowerful fitting (RooFit) andPowerful fitting (RooFit) andstatistical (RooStats) packagesstatistical (RooStats) packagesIn use by most of HEP experimentsIn use by most of HEP experimentsStandard tool for producing physicsStandard tool for producing physicsresults at LHCresults at LHCNew tools for model creation andNew tools for model creation andcombinationscombinations
http://root.cern.ch/drupal/
Out-reaching關注 LHC
http://www.lhcportal.com/
http://cms.web.cern.ch/
http://atlas.ch/
LHSee
https://play.google.com/store/apps/details?id=com.lhsee
Open Access研究成果開放取用
取之於民、與民享之
LHCLHC
我們終於發現可能是希格斯粒子我們終於發現可能是希格斯粒子 ......http://cms.web.cern.ch/news/july-4th-seminar-new-cms-higgs-search-results
LHCLHC
我們終於發現可能是希格斯的粒子我們終於發現可能是希格斯的粒子 ...... 沒有發現微觀黑洞存在沒有發現微觀黑洞存在 ......
http://cdsweb.cern.ch/record/1428128?ln=en
以上
Remerci deVotre
Attention
謝謝
