Bài toán Workflow Scheduling trong môi trường điện toán đám mây

Embed Size (px)

DESCRIPTION

Bài toán Workflow Scheduling trong môi trường điện toán đám mây

Citation preview

  • BI TON WORKFLOW SCHEDULINGTRONG MI TRNG IN TON M MYHc vin: Kiu Tun DngGing vin hng dn: TS. Phm Ngc HngKHOA CNG NGH THNG TINCHUYN NGNH CNG NGH PHN MM

  • 1. Gii thiu- (IDC) T nm 2015: s c khong 15 t thit b kt ni n internet. D bo mt truyn ti d liu:+Smartphone: 1.300 MB/thng+Table: 2.311 MB/thng+Laptop: 6.522 MB/thngV dung lng lu tr tng 670% t 2009 2014in ton m my khng n thun l mt cng ngh mi, m l s thay i c tnh cch mng v bn cht ca cng ngh thng tin v k thut... - (IDC) D bo gi tr th trng in ton m my t 43 t la M vo nm 2012 v khng nh trong vng 3 nm ti dch v in ton m my c th t ti mc tng trng gp hng nm l 27%.

  • DATACENTER1. Gii thiu CloudHng triu khch hng trn ton th gii s dng cc dch v ca nh cung cp dch v in ton m my.

  • 1. Gii thiu Lp lch ng dng trong mi trng in ton m my: cng ty cung cp dch v in ton m my phn b ngun ti nguyn (phn cng, phn mm) cho hng triu khch hng trn ton th gii p ng theo nhu cu.

  • 1. Gii thiu Nhu cu ca vic lp lch:Ti thiu thi gian thc thiTi thiu chi ph thc thi (tin phi tr)m bo cht lng dch vTi thiu c thi gian v chi ph thc thi Mt s gii thut lp lch ph binGii thut Gen di truynGii thut By kinGii thut M phng luyn kimGii thut Ti u by n

  • 2. Pht biu bi ton lp lch ng dng workflowBi ton: Tm phng n M phn b cc Task Ti cho cc ti nguyn PCj sao cho gi tr Cost ln nht trong s cc PC l nh nht.f.in

  • 2. Pht biu bi ton lp lch ng dng workflow...

  • 3. Gii php la chn: PSOGii thut ti u by n PSOL mt k thut tm kim ti u ton cc t thch nghi c gii thiu ln u tin bi Kennedy v Eberhart vo nm 1995L mt thut ton c xy dng tm kim mt li gii ti u ha trn mt khng gian tm kim.By n (qun th) l mt tp cc c th (tp cc li gii bi ton), qun th s tm kim c th cho gii php ti u nht.So vi gii thut di truyn GA, PSO khng c s kt hp trc tip gia cc c th trong qun th m n da trn cc hnh vi x hi ca cc c th t iu chnh hng bay => lm tng tnh t nhin ca c th v nhanh chng t ti trng thi ti u ton cc vi mt gii php hp l.

  • 3. Gii php la chn: PSOvik+1 = w.vik + c1 . rand1 . (pbesti xik) + c2 . rand2 . (gbest xik)xik+1 = xik + vik+1xikXik+1vik+1vikGbestviGbestviPbestPbesti

  • 3. Gii php la chn: PSO

  • 4. Vn dng thut ton PSOXy dng gii thut PSO x l bi ton lp lch workflowM ha c th: kch thc c th bng s Task, gi tr mi chiu v tr bng k hiu cc PC

  • 4. Vn dng thut ton PSO Khi to qun th: khi to n c th vi mi chiu v tr cc c th nhn cc gi tr ngu nhin t 1, , j vi j = s PCHm nh ngha thch nghiHm vn tc v

  • 4. Thut ton xut Size Particle = number of task ready

  • 5. Thut ton xut Gii thut 2: Gii thut PSO_Heuristic

  • 5. Thut ton xut M hnh gi ca Amazon EC2M hnh gi ca Google App Engine

  • 6. Kt qu thc nghimThc nghim tin hnh ci t gii thut PSO_heuristic trn m hnh xut bng vic s dng cng c CloudSim v gi JSwarm-PSO.CloudSimL cng c m hnh ha v m phng dch v v h tng in ton m my c pht trin ti CLOUDS Lab, i hc Melbourne do nhm ca Gio s Buyya pht trin.a ch download: http://www.cloudbus.org/cloudsim/ JSwarm-PSOL gi th vin c vit bng java m phng gii thut Ti u by n ca tc gi Pablo Cingolani, i hc McGill Canada.a ch download: http://jswarm-pso.sourceforge.net/ i tng kim chng: gii thut Random v RoundRobin.

  • 6. Kt qu thc nghim Cu hnh thc nghim:5 Task v 3 HostS c th: 25; S th h: 30; S ln lp: 30Trng s qun tnh w = 0.85, h s gia tc C1 = 1.5 v C2 = 0.5, chi ph truyn: 0.1----------------------------------------Host1: (1000, 1,0.1); (nng lc x l CPU l 1000MI, chi ph thc thi 0.1 vt/1000MI)Host2: (1000, 1,0.2);Host3: (1000, 1,0.3);----------------------------------------Task1: (25000, 10000)); ( di cn x l l 25000MI, output size = 10000byte)Task2: (25000, 10000));Task3: (25000, 10000));Task4: (25000, 10000));Task5: (25000, 60000));----------------------------------------

  • 6. Kt qu thc nghim Cu hnh thc nghim:f.in25000MI, 10000byte25000MI, 10000byte25000MI, 60000byte1000MI1000MI1000MI

  • 6. Kt qu thc nghim Nhn xt: chi ph thc thi workflow trn gii thut lp lch da PSO tit kim chi ph (gim mt na chi ph) so vi cc gii thut Random v RoundRobin

  • 7. Kt lunLun vn xut gii thut lp lch heuristic da trn phng php ti u by n nhm ti thiu tng chi ph thc thi ca ng dng lung cng vic trong mi trng in ton m my.Kim chng thut ton xut trn cng c m phng CloudSim v JSwarm-PSO.Mt s kt qu t c:ang thc hin ti cp trng HSPHN giai on 2012-2013: Bi ton lp lch workflow trong mi trng in ton m my. 01 Bi bo c ng k yu Hi tho khoa hc cn b tr trng HSPHN ln th V nm 2012.

  • 8. Hng nghin cu

    Hng nghin cu tip theo:Ti thiu tng chi ph thc thi v thi gian thc thi, Cn bng ti trn ti nguyn c s dng khi gp rng buc deadline ca ng dngm bo cht lng dch v Tin hnh so snh gii thut xut vi gii thut Gen di truyn.

  • Gii php la chn: PSO M t thut ton chi tit nh sau:B1.Khi to qun th vi vic khi to vector v tr xi v vector vn tc vi cho c th th i, i = 1,.., n B2.Khi to cc thng tin ban u v v tr tt nht ca cc c th v c qun thpbesti = xi gbest = min (f(xi)), i = 1,..n B3.Bc lp vi iu kin lp xc nhfor 1
  • Vn dng thut ton PSOGii thut 1: Gii thut PSO

    B1.Xy dng kch thc c th bng kch thc cc cng vic sn sng (task ready)

    B2.Khi to v tr cc c th ngu nhin t cc PC = 1, , j v vn tc vi ngu nhin.

    B3.Vi mi c th, tnh gi tr hm mc tiu theo cng thc.

    B4.Nu gi tr hm mc tiu tt hn Pbest tt nht trc , thit lp li gi tr Pbest bng gi tr mi.

  • Vn dng thut ton PSOB5.Sau bc 3 v 4 cho tt c cc c th, chn c th c gi tr tt nht coi l gbest.

    B6.i vi tt c cc c th, tnh ton vn tc s dng cng thc: vik+1 = w.vik + c1.rand1.(pbesti xik) + c2.rand2.(gbest xik) v cp nht li v tr cc c th s dng cng thc: xik+1 = xik + vik+1

    B7.Nu cc iu kin dng v s ln lp ti a cha p ng, lp li bc 3.

  • Thut ton xut Gii thut 2: Gii thut PSO_HeuristicB1. Tnh ton chi ph tnh ton trung bnh ca tt c cc cng vic trn tt c cc ti nguyn tnh ton. B2. Tnh ton chi ph (thng tin/kch thc d liu) trung bnh gia cc ti nguyn.B3. Thit lp trng s cc node: weight wkj = (chi ph tnh ton trung bnh)B4. Thit lp trng s cnh ek1,k2 bng kch thc file chuyn giao gia cc task.B5. Tnh ton PSO({ti}) vi cc tasks

  • Thut ton xut Gii thut 2: Gii thut PSO_HeuristicB6. RepeatB7. For mi task trng thi Ready doB8. Gn mi {ti} {pj} theo gii thut PSOB9. End ForB11. Thc hin mapping: gn kt cc cng vic ti nguyn.B12. Ch x l cng vic (s ph thuc d liu u vo v u ra gia cc cng vic).B13. Cp nht li cc cng vic trng thi ReadyB14. Cp nht li chi ph giao tip gia cc ti nguyn theo trng thi mng hin ti.B15. Tnh ton PSO({ti}).B16. Ultil khng cn cng vic no phi thc thi.

  • Cc dch v in ton m myGoogle Apps: Google Mail, Google Docs, Google CalendarBox.net: qun l ti liu v lu tr.DropBox: chia s tp tin vi ngi dng khc hoc qua my tnh ngng hot ng.iCloud: dch v trn nn in ton m my dnh cho iOSOnLive: tr chi video, game trn in ton m my

  • Cc dch v in ton m myGoogle Apps: Google Mail, Google Docs, Google CalendarBox.net: qun l ti liu v lu tr.DropBox: chia s tp tin vi ngi dng khc hoc qua my tnh ngng hot ng.iCloud: dch v trn nn in ton m my dnh cho iOSOnLive: tr chi video, game trn in ton m my

  • Cng ngh o ha o ho l cng ngh tin tin nht trong mt lot cc cuc cch mng cng ngh nhm tng mc o ha h thng cho php tng hiu sut lm vic ca my tnh ln mt cp cha tng c. o ha h thng my ch tc l ta tin hnh phn chia mt server thnh nhiu server o hoc kt hp nhiu my ch vt l thnh mt my ch logic, i vi ngi s dng h nhn bit v s dng cc server o ging nh mt my vt l c lp c cc ti nguyn cn thit (b vi x l, b nh, kt ni mng, ), trong khi cc server o khng h c nhng ti nguyn c lp nh vy, n ch s dng ti nguyn c gn t my ch vt l. y, bn cht th nht l cc server o s dng ti nguyn ca my ch vt l, bn cht th hai l cc server o c th hot ng nh mt server vt l c lp.