7/21/2019 Compile Farm A Technique in Distributed Compilation

1/18

Eakphcb Gmrk M Pbejohqub ho @hstrhlutb Eakphcmthao

YPbrk Vmpbr/Dauromc[

Uulkhttb ho Gucghcckbot ag tjb

\bquhrbkbot gar tjb Eakpcbthao ag

EAKVHCB\ @BUHNO EUB0=2

ly

Pmokmy Lmrmowmc(L.Pbej.EUB)

Ybkmhc[ 4 tmokmyYat[==

7/21/2019 Compile Farm A Technique in Distributed Compilation

2/18

Eakphcb Gmrk M Pbejohqub ho @hstrhlutb Eakphcmthao

ly

Pmokmy Lmrmowmc

Uejaac ag Eakputbr Uehboeb mo Bonhobbrhon

Cavbcy Vragbsshaomc Rohvbrshty, HO

Pjhs pmpbr rbprbsbots ky awo wari mo hs garkmttb lmsb upao Utmomr HBBB

Garkmt gar \bsbmrej Dauromcs ho meearmoeb whtj Rohvbrshty rbnucmthaos.

/s/. Pmokmy Lmrmowmc

Eaotbots

=. Hotrauethao....................................................................................................................=

m. Hotrauethao ta Eakphcbr......................................................................................=

l. Eakphcmthao...........................................................................................................=

>. Erass Vcmtgark @bvbcapkbot.........................................................................................:

m. Eaothouaus Hotbnrmthao Pbejohqubs.......................................................................8

:. Eakphcb Gmrk.................................................................................................................=6

m. NEE Lmsb...........................................................................................................==

l. OH CmlWHB GVNM Lmsb....................................................................................=5

8. Hkpcbkbotmthaos............................................................................................................=2

=6. \bgbrboebs...................................................................................................................=7

Vmnb Oa.4 6

7/21/2019 Compile Farm A Technique in Distributed Compilation

3/18

Ejmptbr - =

Hotrauethao4

M eakphcb gmrk hs m sbrvbr ecustbr wjhej hs lmshemccy m eaccbethao ag eakputbr sbrvbr

usumccy kmhotmhob ly mo botbrprhsb, jms lbbo sbtup ta eakphcb eakputbr pranrmks

rbkatbcy gar vmrhaus rbmsaos.

Hotrauethao Pa Eakphcbr4

M eakphcbr hs sbt ag pranrmks tjmt trmosgarks ar eaovbrts, saureb eab wrhttbo ho m

pranrmkkhon cmonumnb ta systbk cmonumnb. Uystbk cmonumnb hs lmshemccy tjb aldbet eab

wjhej hs lmshemccy ho lhomry gark. Kmho aldbethvb ag tjhs hs ta erbmtb mo bxbeutmlcb pranrmk.

M eakphcbr hs chibcy ta pbrgark kmoy ar mcc ag tjb gaccawhon apbrmthaos4 cbxhemc momcyshs,

prbpraebsshon, pmrshon, sbkmothe momcyshs (Uyotmx-hrbetb trmoscmthao), eab nbobrmthao,

mo eab apthkhzmthao.

Eakphcmthao4

Eakphcbrs bomlcb tjb bvbcapkbot ag pranrmks tjmt mrb kmejhob-hobpbobot. Pjb ghrst

jhnjbr-cbvbc cmonumnb, ho tjb =826s, kmejhob-bpbobot mssbklcy cmonumnb wms whbcy

usb. jhcb mssbklcy cmonumnb prauebs karb rbusmlcb mo rbcaemtmlcb pranrmks tjmo

kmejhob eab ao tjb smkb mrejhtbeturb, ht jms ta lb kahghb ar rbwrhttbo hg tjb pranrmk hs

ta lb bxbeutb ao hggbrbot eakputbr jmrwmrb mrejhtbeturb.

Utrueturb4

M eakphcbr eaoshsts ag tjrbb kmho pmrts4 tjb graot-bo, tjb kh cb-bo, mo tjb

lmei-bo.

Graot Bo4

Vranrmks mrb ejbeib jbrb ho tbrk ag Uyotmx mo Ubkmothes ag rbspbethvb

pranrmkkhon cmonumnb. Pypb ejbeihon hs mcsa pbrgarkb ly eaccbethon typb

hogarkmthao. Pjb graot-bo tjbo nbobrmtbs mo hotbrkbhmtb rbprbsbotmthao ag tjb

saureb eab gar praebsshon ly tjb kh cb-bo.

Kh cb Bo4Jbrb apthkhzmthao tmibs pcmeb. Gbw trmosgarkmthaos gar apthkhzmthao mrb rbkavmc ag

usbcbss ar uorbmejmlcb eab, hseavbry mo rbcaemthao ag eakputmthao eab bte.

Lmei Bo4

Ht nhvbs tjb autput ms mssbklcy eab grak apthkhzb eab grak kh cb-bo.

Kbkary mccaemthao mo rbnhstbr mccaemthao mrb mcsa pbrgarkb jbrb gar praebss

rbnhstbr (rbquhrb gar sakb pranrmk vmrhmlcbs).

Vmnb Oa.4 =

7/21/2019 Compile Farm A Technique in Distributed Compilation

4/18

Ejmptbr

7/21/2019 Compile Farm A Technique in Distributed Compilation

10/18

Ejmptbr >

Erass Vcmtgark @bvbcapkbot4

Ho eakputhon, erass-pcmtgark, ar kucth-pcmtgark, hs mo mttrhlutb nhvbo ta eakputbr

sagtwmrb ar eakputhon kbtjas mo eaoebpts tjmt mrb hkpcbkbotb mo hotbr-apbrmtb ao

kucthpcb eakputbr pcmtgarks.

Gar bxmkpcb, m erass-pcmtgark mppchemthao kmy ruo ao Kherasagt hoaws ao tjb x:7

mrejhtbeturb, Choux ao tjb x:7 mrejhtbeturb mo Kme AU Z ao bhtjbr tjb VawbrVE ar x:7

lmsb Mppcb Kmehotasj systbks. Erass-pcmtgark pranrmks kmy ruo ao ms kmoy ms mcc

bxhsthon pcmtgarks, ar ao ms gbw ms twa pcmtgarks.

Mppramejbs ta Erass-pcmtgark @bvbcapkbot4

Pjbrb mrb hggbrbot wmys ag mppramejhon tjb pralcbk ag wrhthon m erass-pcmtgark

mppchemthao pranrmk. Aob suej mppramej hs shkpcy ta erbmtb kucthpcb vbrshaos ag tjb smkb

pranrmk ho hggbrbot saureb trbbsho atjbr wars, tjb hoaws vbrshao ag m pranrmk

khnjt jmvb aob sbt ag saureb eab ghcbs mo tjb Kmehotasj vbrshao khnjt jmvb moatjbr,

wjhcb m GAUU *ohx systbk khnjt jmvb moatjbr.

Ejmccbonbs ho Erass-pcmtgark @bvbcapkbot4

Pbsthon erass-pcmtgark mppchemthaos kmy lb eaoshbrmlcy karb eakpchemtb, shoeb hggbrbot

pcmtgarks emo bxjhlht schnjtcy hggbrbot lbjmvhars ar sultcb luns.

Uerhpthon cmonumnbs mo vhrtumc kmejhobs kust lb trmoscmtb hota omthvb bxbeutmlcb eab

bmej thkb tjb mppchemthao hs bxbeutb, hkpashon m pbrgarkmoeb pbomcty. Pjhs pbomcty emo lb

mccbvhmtb ushon mvmoeb tbejohqubs chib dust-ho-thkb eakphcmthao

@hggbrbot pcmtgarks rbquhrb tjb usb ag omthvb pmeimnb garkmts suej ms \VK mo KUH.

Kucth-pcmtgark hostmccbrs suej ms Hostmcc Moywjbrb m rbss tjhs obb.

Erass-pcmtgark bxbeuthao bovhraokbots kmy suggbr erass-pcmtgark sbeurhty gcmws,

erbmthon m gbrthcb bovhraokbot gar erass-pcmtgark kmcwmrb.

Erass-pcmtgark bovhraokbots4

Mppbmrc], gpNRH, Bechpsb, Kaoa, Rcthkmtb++, Zpawbr++

Vmnb Oa.4 :

7/21/2019 Compile Farm A Technique in Distributed Compilation

11/18

Eaothouaus Hotbnrmthao Pbejohqubs4

Eaothouaus hotbnrmthao (EH) hs tjb prmetheb, ho sagtwmrb bonhobbrhon, ag kbrnhon mcc

bvbcapbr warihon eaphbs whtj m sjmrb kmhochob sbvbrmc thkbs m my. Ht wms ghrst omkb

mo prapasb ly Nrmy Laaej ho jhs kbtja

Gbw Utbps mrb 9

- Kmhotmhohon m Eab \bpashtary

- Mutakmtb tjb Luhc/Eakphcmthao

- Eakkhtthon tjb Lmsbchob ag Vranrmks

- Pbst ho m Ecaob ag Vrauet Bovhraokbot

- \bsuct ag Pbst Luhc

- Mutakmtb @bpcaykbot

Eaothouaus Hotbnrmthao hs Rsb ta passbss lbobghts ms4

Hotbnrmthao luns mrb btbetb bmrcy mo mrb bmsy ta trmei awo ub ta skmcc ejmonb

sbts. Pjhs smvbs latj thkb mo kaoby avbr tjb chgbspmo ag m pradbet.

Eaostmot mvmhcmlhchty ag m "eurrbot" luhc gar tbsthon, bka, ar rbcbmsb purpasbs

Grbqubot eab ejbei-ho pusjbs bvbcapbrs ta erbmtb kaucmr, cbss eakpcbx eab

Bogarebs hsehpchob ag grbqubot mutakmtb tbsthon

Hkkbhmtb gbblmei ao systbk-whb hkpmet ag caemc ejmonbs

Vmnb Oa.4 8

7/21/2019 Compile Farm A Technique in Distributed Compilation

12/18

Ejmptbr :

Eakphcb Gmrk4

M eakphcb gmrk hs m sbrvbr ecustbr wjhej hs lmshemccy m eaccbethao ag eakputbr sbrvbr

usumccy kmhotmhob ly mo botbrprhsb, jms lbbo sbtup ta eakphcb eakputbr pranrmks

rbkatbcy gar vmrhaus rbmsaos.

Aldbethvb 4

M eakphcb gmrk hs m pmrt ag aur kmho sbrvbr wjhej hs usb ta eaothoub mo praueb rbcbmsbs

ag pranrmks bmshcy mo uohgarkcy. Eakphcb gmrks mrb eakpasb ag kmejhobs ag vmrhaus

mrejhtbeturbs ruoohon ao vmrhaus AU mo hs hotbob ta mccaw bvbcapbrs ta tbst mo usb

tjbhr pranrmks ao m vmrhbty ag pcmtgarks.

Mppchemthao 4

Eakphcb gmrks mrb usb whbcy mo hs mppchemlcb ho gaccawhon mrbms 4

=. Erass Vcmtgark @bvbcapkbot

7/21/2019 Compile Farm A Technique in Distributed Compilation

13/18

@EG kbhmtar hs hovaib ho arbr ta ejbei m eraob dal mo pulchsjbs tjb luhcs ta U@E.

\bsaurebs 4

Pa usb eakphcb gmrks, ta luhcs sagtwmrb pmtejbs wb obb 4

Uaureb, wjhej hs lmshemccy starb ao m NHP sbrvbr ar Kbreurhmc jn

UUJ @mbkao, mccawhon usbr ta canho

Aob ar karb erass eakphcbr

Kbkary, ta starb luhcs ho echbots hrbetary

Uakb Eakphcb Gmrk Paacs4

NEE Eakphcb Gmrk4

Pjb NEE Eakphcb gmrk pradbet kmhotmhos m sbt ag kmejhobs ag vmrhaus mrejhtbeturbs mo

pravhbs ssj meebss ta grbb sagtwmrb bvbcapbrs, NEE mo atjbrs (NVC, LU@, KHP, ...).

Aoeb yaur meeauot mppchemthao (sbb lbcaw) hs mppravb, yau nbt gucc ssj meebss ta mcc tjb

gmrk kmejhobs (eurrbot mo obw), mrejhtbeturbs eurrbotcy mvmhcmlcb4

NEE Eakphcb Gmrk Mrejhtbetrb4

h7:7 ! "70 Mrejhtbetrb

":7#70 ! 5

7/21/2019 Compile Farm A Technique in Distributed Compilation

14/18

Eakphcb Gmrk Utrueturb4

Lmsb upao aur obbs gar eakputmthaomc

rbsaureb ho eakputbr sehboeb, tjb usmnb ag

eakphcbr gmrk tjraunj ecustbrb systbk hs aob ag

tjb kast prakhshon kbmos ly wjhej wb emo

lrhnb tjb nmp lbtwbbo vmrhbty ag pranrmks,

eakphchon hohvhumc saureb eabs ao vmrhaus

systbks whtj vmrhaus mrejhtbeturb.

Pjbrb mrb vmrhaus ag eakphcb gmrks mvmhcmlcb howjhej NEE NOR hs kast usb mo @BLHMO hs

kast bgghehbot.

Gar pmrmccbc eakphcmthao mo qubuhon ag s/w pmtejbs OH CmlWhbw GVNM Eakphcb Gmrk hs

usb.

Vmnb Oa.4 =

7/21/2019 Compile Farm A Technique in Distributed Compilation

15/18

OH CmlWhbw GVNM Eakphcb Gmrk4

OH CmlWhbw GVNM Eakphcb Gmrk hs m eakphcb gmrk, luhct ly Omthaomc Hostrukbots hs m

Uagtwmrb bghob jmrwmrb ho wjhej lmshemccy oa apbrmthon systbk hs obbb gar bxbeuthao

ag canhe.

GVNM stmos gar Ghbc Vranrmkkmlcb nmtb mrrmy ta praebssar wjhej hkpcbkbots tjb

guoethaomchty ag systbks.

Mrejhtbeturb4

Vmnb Oa.4 =5

7/21/2019 Compile Farm A Technique in Distributed Compilation

16/18

Lbobghts ag OH CmlWHB GVNM Eakphcb Gmrk4

Gmstbr H/A \bspaosb thkbs mo spbehmchzb gmehchty.

Bxebbhon tjb eakputhon pawbr ag hnhtmc shnomc praebssars.

Hkpcbkbothon eustak guoethaomchty.

Ghbc upnrmmlcb bchkhomthon tjb bxpbosb ag eustak MUHE rb-bshno mo kmhotmhomoeb.

Vmnb Oa.4 =0

7/21/2019 Compile Farm A Technique in Distributed Compilation

17/18

Ejmptbr 8

Hkpcbkbotmthaos4

Aob bxmkpcb ag m eakphcb gmrk wms tjb sbrvheb pravhb ly UaurebGarnb uothc

7/21/2019 Compile Farm A Technique in Distributed Compilation

18/18

\BGB\BOEBU

Y=[.jttp4//bo.whihpbhm.arn/whih/EakphcbQgmrk

Y