Concept of Monitoring and Evaluation and

Its Application in Nepal

Krishna Prasad DhakalProgram Director

National Planning Commission Secretariat

Public Sector Management

MANAGEMENT

What is Monitoring and Evaluation?The term “monitoring and evaluation” tends

to get run together as if it is only one thing.

In fact, these are two distinct sets of organizational activities.

M and E are related (both are ultimately about measurement) but not identical.

Divorce of M&E

Divorce between Monitoring and

Evaluation is needed to

understand and use it in

appropriate way.

What is Monitoring?Monitoring is a continuous process of

collecting and analyzing information to compare how well a project, program or policy is performing against expected results.

It is aimed at improving the efficiency and effectiveness of a project or organization.

It is based on targets set andactivities planned during the planning phases of work.

What is Monitoring?

It helps to keep the work on track, and can let management know when things are going wrong.

it is an invaluable tool for good management, and it provides a useful base for evaluation.

What is Monitoring?

It enables you to determine- whether the resources you have

available are sufficient and are being well used,

whether the capacity you have is sufficient and appropriate, and

whether you are doing what you planned to do?

What is Monitoring?

gLlt, of]hgf, sfo{qmd÷cfof]hgfdf nufgL tyf ;fwgsf] k|jfx ;d"lrt (ª\un] ePsf] %÷%}g / lqmofsnfkx?sf] sfof{Gjog sfo{tflnsf cg';f/ eO{ nlIft k|ltkmn k|fKt ePsf] %÷%}g egL ljleGg txsf] Joj:yfkg jf Joj:yfkgn] tf]s]sf] JolQm, lgsfoaf^ lg/Gt/ / cfjlws ?kdf lgu/fgL /fVg] sfo{ cg'udg xf] .

-cg'udg tyf d"NofÍg sfo{ljlw, 2069 sf] d:of}baf^_

s] x]%{ cg'udgn]

-s_ cfof]hgfsf] ;|f]t, ;fwgx?sf] k|flKt / k|of]u :jLs[t ah]^ / ;dotflnsfcg';f/ ePsf] 5, 5}g <

-v_ cfof]hgfsf ck]lIft k|ltkmnx? ;dod} / nfut k|efjsf/L ?kdf xfl;n ePsf] 5, 5}g <

-u_ cfof]hgfsf] sfof{Gjog Ifdtf s], s:tf] 5< -cg'udg tyf d"NofÍg sfo{ljlw, 2069 sf] d:of}baf^_

cg' + udg of] sfo{s|d cjlwe/ lg/Gt/ ul/g] k|ls|of xf] .

o;nfO{ cfof]hgfsf] Pp6f cfGtl/s sfo{sf] ¿kdf klg lnO{G5 .

cg'udg ;fdfGotof sfof{Gjogsf] cj:yfdf b]lvPsf sdL, sdhf]/Lx¿nfO{ ;'wf/ ug]{ ;+:yfut k|ls|of xf] .

cg'udg sfo{ cfof]hgfsf] k|ls|of, nufgL / k|ltkmn;Fu k|ToIf ¿kdf ;DalGwt x'G5 .

cg'udg Joj:yfkgsf] k|0ffnLsf] Pp6f c+u xf] .

glthfd"ns cg'udgsf ljlwx¿ ! nIo / k|ultsf] t'ngf ljlw nIocg';f/ sfo{ eP gePsf] tyf sfo{qmdsf] ;du| l:ylt -ef}lts k|ult, ljQLo k|ult / JotLt ;do_ ljj/0f sfo{qmd,cfof]hgfaf6 x/]s rf}dfl;s cjlwdf ul/g] k|ltj]bgaf6 ul/g] cg'udg .;"rs nIo k|

ultnIo k|

ult ljrsf] cGt/

sf/0f

;d:of ;dfwfgsf k|of;x?

  

         

        

   

nIo / k|ultsf] t'ngf

glthfd"ns cg'udgsf ljlwx¿

@= :ynut cg'udg ljlw sfo{qmd, cfof]hgfdf ePsf ljleGg lqmofsnfkx? cfof]hgf:ynd} uP/ cjnf]sg u/L ul/g] cg'udg . o;df ;DalGwt sfo{qmd,cfof]hgfsf] lgDg b:tfj]h ;d]t k|of]u ug{' kb{5 .

!= nlhsn k|m]djs{@= aflif{s ljsf; sfo{qmd#= rf}dfl;s k|ult k|ltj]bg$= ;"rsx¿%= jflif{s ljsf; sfo{qmd -efu !_ ^= lhNnf:t/Lo jflif{s ljsf; sfo{qmd -efu @_

#= t];|f] kIf cg'udg ljlw s'g} vf; bIftf tyf sfo{s'zntfsf] dfWodaf6 cg'udg u/fpg k/]df :jtGq lgsfo tyf JolQmx?af6 u/fOg] ljlw .

What is Evaluation?Evaluation is an assessment, based on detailed

data collection and careful analysis, of the results of a policy or program.

Evaluation is research, but not just any research.

It is the comparison of actual project impacts against the agreed strategic plans.

It looks at what you set out to do, at what you have accomplished, and how you accomplished it.

What is Evaluation?

It can be formative (taking place during the life of a project or organization, with the intention of improving the strategy or way of functioning of the project or organization).

It can also be summative (drawing learning from a completed project or an organization that is no longer functioning).

Someone once described this as the difference between a check-up and an postmortem.

Process evaluation A study of the implementation of a program or policy focusing on inputs, activities, and outputs and often used to assess the performance of implementers.

Program evaluation A study, using research methods to collect and analyze data, of the outcomes of a program—that is, whether and how well a program is working and why.

What is Evaluation?

sfof{Gjog ul/Psf gLlt, sfo{qmd÷cfof]hgf xfnsf] ;dodf s]slt ;fGble{s, nfebfoL / k|efjsf/L /x]sf 5g\ tyf s]s:tf pknlJw Pjd\ k|efjx? xfl;n ePsf 5g\ eGg] s'/fsf] cfGtl/s / afXo d"NofÍgstf{af6 p2]Zok"0f{ / Jojl:yt tl/sfn] n]vfhf]vf ug]{ sfo{ d"NofÍg xf]

-cg'udg tyf d"NofÍg sfo{ljlw, 2069 sf] d:of}baf^_

lrq != sfof{Gjog ;dofjlwdf cg'udg tyf d"NofÍg

kmfObfx?sf] k|j fx k"j {

d"NofÍg

cfwf/ ; j ]{If0f

dWofj lw d"NofÍg

clGtd d"NofÍg

k|efj d"NofÍg

lg/Gt/ cg'udg

lgdf{0f r /0f

lbuf]kgfsf] cg'udg

; ~r fng r /0f 5gf}6 r /0f

lg/Gt/ k[i7kf]if0f

-;fef/– >L tLy{/fh 9sfn, ;x;lrj, /fof]cf;_

cg'udg tyf d"NofÍgsf k|

sf/

p2]Zo

lg/Gt/ cg'udg

sfo{qmd |cfof]hgf lgdf{0f r/0fdf nufgL, lqmofsnfk, k|lqmof / k|ltkmn ;"rsx?sf] cfwf/df sfo{;Dkfbg eP gePsf] lgwf{/0f ug{ .

lbuf]kgf cg'udg

sfo{qmd, cfof]hgfsf] lgdf{0f r/0f ;DkGg kZrft pQm sfo{qmd, cfof]hgfsf] lgwf{l/t cfo";Dd lg/Gt/ ;~rfngsf] nflu cfjZos kg]{ ;|f]t;fwg tyf dd{t;Def/ lglZrt ug{ . 

sfo{qmd÷cfof]hgfdf ul/g] cg'udg tyf d"NofÍgsf p@]Zo

k"j{ d"NofÍg (Ex-ante)

sfo{qmd, cfof]hgfsf] cfjZostf tyf ;'lglZrttf lgwf{/0f ug{

sfo{qmd, cfof]hgfsf] k"0f{ ljj/0f :ki6 ug{ / ;"rsx? lgwf{/0f ug{

rfn" d"NofÍg (Ongoing)

sfo{qmd, cfof]hgfsf] k|ult cfFsng ug{ k"j{ lgwf{l/t sfo{of]hgfdf kl/dfh{g

ug{ jf ;~rfng 9fFrfdf cfjZos kl/jt{g ug{

clGtd d"NofÍg (Terminal)

sfo{qmd, cfof]hgfsf] sfo{Ifdtf, k|efjsfl/tf / bLuf]kgfnfO{ Wofgdf /fv]/ ;dLIff ug{

sfo{qmd, cfof]hgf ;DkGg ePkl5 yk sfo{ (follow-up) cfjZos /x]sf] jf g/x]sf] lgSof}{n ug{

k|efj d"NofÍg (Ex-post)

sfo{qmd, cfof]hgfsf] k|efj / bLuf]kgfnfO{ Wofgdf /fv]/ ;dLIff ug{

eljiodf sfo{qmd, cfof]hgfsf] th"{df / sfof{Gjog ubf{ ;'wf/ ug{sf nflu l;sfO / ;'emfjx? k|fKt ug{

-cg'udg tyf d"NofÍg sfo{ljlw, 2069 sf] d:of}baf^_

d"NofÍgsf kfFr cfwf/x¿d"NofÍgsf cfwf/x?

kl/efiff

;fGble{stf (Relevance)

nlIft ju{sf cfjZostf / k|fyldstf tyf /fli6«o, If]qut ljsf; nIox? jf gLltx? ;fy} bft[ lgsfosf ;xfotf gLlt;Fusf] ;fGble{stf .

k|efjsfl/tf (Effectiveness)

nIox? s'g, s], slt k|fKt eP jf k|fKt x'g] ;Defjgfsf 5g\ eGg] klxrfg ug]{

sfo{bIftf (Efficiency)

nufgLsf] cg'kftdf k|ltkmn k|fKt eP jf gePsf] dfkg ub{5 .

k|efj,c;/ (Impact) k|ToIf jf ck|ToIf, lgwf{l/t jf clgWff{l/t, ;sf/fTds jf gsf/fTds kl/jt{gnfO{ dfkg ug]{

bLuf]kgf (Sustainability)

;DkGg ePkZrft k|fKt kmfObf / k|ltkmnx?n] lg/Gt/tf kfpF5g\ jf kfpFb}gg\ .

d"NofÍg ljlwx¿

!= kl/df0ffTds ljlw (Quantitative Method)

nfO{sfo{qmd, cfof]hgfn] kf/]sf] jf kfg]{ k|efj jf c;/nfO{ ;+Vof jf k|ltztdf k|:t't u/L ck]lIft glthf;Fu t'ngf u/L d"NofÍg ug]{ ljlw kl/df0fTds ljlw xf] .

kl/df0ffTds tYofÍ k|fKt ug]{ tl/sfx¿

k|ZgfjnL / ;j]{If0f ljlw ljBdfg 8f6fa];x?— EMIS, HMIS, FMIS etc

d"NofÍg ljlwx¿tYofÍ ljZn]if0f nfut–nfe tyf nfut–sfo{bIftf sfo{qmd, cfof]hgf ;~rfng x'g'cl3 / ;~rfng eO;s]kl5sf] cj:yf t'ngf (Pre/Post Test)

sfo{qmd, cfof]hgf …;~rfng ePsf] If]qÚ (with) / …;~rfng gePsf]Ú (without) p:t} k|s[ltsf If]qaLrsf] t'ngfTds ljZn]if0f

d"NofÍg ljlw@= u'0ffTds ljlw (Qualitative Method)

kl/df0fTds ?kdf dfkg ug{ g;lsg] ;]jfu|fxLx?sf] afgLJojxf/, wf/0ff, ;fj{hlgs ;]jfk|ltsf] ;Gt'li6h:tf ljljw kIfx?nfO{ dfkg ug{ o;sf] k|of]u ul/G5 .

Uf'0ffTds tYofÍ k|fKt ug]{ tl/sfx? k|ToIf cjnf]sg ljlw nlIft ;d"x ljlw cGtjf{tf{ ljlw gd"gf ljlw SWOT Analysis ljlw b:tfj]h cWoog

d"NofÍg ljlw#= ldl>t ljlw (Mixed Method) -kl/df0ffTds / u'0ffTds ljlwsf] ld>0f_ kl/df0ffTds ljlw / u'0ffTds ljlwsf cf}hf/ (tools) / lgrf]8 (fact findings) nfO{ ;Tofkg (triangulate) ug]{ p2]Zon] ldl>t ljlw (Mixed method) ckgfOG5 .

o; ljlwn] kl/df0ffTds ljlw / u'0ffTds ljlwx?sf] ;sf/fTds kIf / ;Ldf (Limitations) nfO{ Wofg lbO{ k|fKt lgrf]8x?sf] j}wtf / ljZj;gLotf (Validity and Reliability) kl/If0f u/L lg0f{o ug{ ;xof]u u5{ .

Facilitating Vs Conducting Evaluation

Facilitating Selection of policy, programs projects for

evaluation Preparing TOR Bidding Process Getting reports in various stages such as

inception report, field report, draft report and final report.

Providing feedback and suggestions Implementing and Using Evaluation

report for establishing accountability and lesson learning.

Conducting

Ways of Evaluation?

Self-evaluation It is a way of self-reflective, learning and

improving practice.

Participatory evaluationThis is an internal evaluation involving

stakeholders such as project staff and beneficiariesInteractive evaluation

This involves a very active interaction between an outside evaluator or evaluation team and the organization or project being evaluated.

What is Evaluation?

Rapid Participatory AppraisalThis is a qualitative way of doing

evaluations by an interdisciplinary team over a short time especially applied in rural areas. It involves the use of secondary data review, direct observation, semi-structured interviews, key informants, group interviews,

games, diagrams, maps and calendars.

External evaluation This is an evaluation done by a carefully chosen

outsider or outsider team.

cg'udg d"NofÍgsfo{qmd cjlwe/ lg/Gt/ ul/g] k|lqmof xf],h;nfO cfof]hgfsf] Pp^f cfGtl/s sfo{sf] ?kdf klg lnO{G% .

sfo{qmdsf] ;'¿df k"j{ d"NofÍg -Ex-ante_, dWofjlws (Mid-term), clGtd jf ;DkGg d"NofÍg -Terminal_ / sfo{qmd kl%sf] d"NofÍg (Ex-post) ul/G%.

cg'udg sfo{ cfof]hgf sfof{Gjog / ;~rfngsf] cj:yfdf dfq ul/G% .

d"NofÍg sfo{ cfof]hgfsf] sfof{Gjogsf]cj:yfdf / cfof]hgf sfof{Gjogsf] ;dflKt kl%sf cj:yfx¿df klg ul/G% .

sfof{Gjogsf] cj:yfdf b]lvPsf sdL,sdhf]/Lx¿nfO{ ;'wf/ ug]{ ;+:yfut k|lqmof xf] .

sfof{Gjogsf] r/)fdf cfjZos ;'wf/ ug]{ tyf sfof{Gjogsf qmddf ePsf sdL, sdhf]/Laf^ kf& l;sL eljZosf To:t} of]hgf, sfo{qmd / lg)f{ox¿df Joj:yfkgn] ;'wf/ ug]{ ;fwg xf] .

cg'udg d"NofÍgcg'udg sfo{ cfof]hgfsf] k|lqmof, nufgL / k|ltkmn;+u k|ToIf ¿kdf ;DalGwt x'G% .

d"NofÍg sfo{ cfof]hgfsf] k"j{ lgwf{/t nIo / pknlAwsf] l:ylt tyf o;n] ;/f]sf/jfnfnfO{ kf/]sf] c;/ / k|efjsf] cWoog;F+u ;DalGwt % .

cg'udg Joj:yfkg k|)ffnLsf] Pp^f cª\u xf] .

d"NofÍg sfof{Gjog ul/Psf sfo{af^ kf& l;Sg] sfo{d"vL Joj:yfksLo cf}hf/ xf] .

;fwf/)ftof, cg'udg sfo{ sfof{Gjog ug]{ lgsfox¿af^ g} ul/G% .

;fwf/)ftof, d"NofÍg sfo{ sfof{Gjog ug]{ lgsfoeGbf aflx/sf / :jtGq ;+:yfx¿af^ u/fOG% .

Uses and Importance of M&E

Evaluate/

learn/ decide

Plan

Implement

Reflect/learn/

decide/adjust

MonitorImplem

ent

Uses and Importance of M&EHelp you identify problems and their

causes;

Suggest possible solutions to problems;

Raise questions about assumptions and strategy;

Push you to reflect on where you are going and how you are getting there;

Uses and Importance of M&E Provide you with information and insight;

Encourage you to act on the information and insight;

Increase the likelihood that you will make a positive development difference.

But It is important to recognize that monitoring and evaluation are not magic wands that can be waved to make problems disappear, or to cure them, or to miraculously make changes without a lot of hard work being put in by the project or organization.

cg'udgsf] dxTjljsf; sfo{qmd÷cfof]hgfx?df nufgL

ul/Psf] ;|f]t;fwgsf] kf/bzL{, lhDd]jf/Lk"0f{ / k|efjsf/L k|of]u ;'lglZrt ug{,

lqmofsnfkx¿nfO{ lgwf{l/t nIok|flKttkm{{ lgb]{lzt ug{, /

sfof{Gjogdf s'g} ;d:of / afwfJojwfgx¿ b]lvPdf tTsfn ;dfwfg ug{ .

d"NofÍgsf] dxTjcfof]hgfsf] p2]]Zo tyf nIo xfl;n

ug{ k"j{lgwf{l/t lqmofsnfk, ;|f]t ;fwg / If]q (scope) df kl/jt{g cfjZos 5, 5}g eGg] hfgsf/Lsf pknAw u/fpF5 .

;DkGg cfof]hgfsf] ;fGble{stf, bIftf, k|efjsfl/tf, k|efj / lbuf]kgfsf af/]df oyfy{ hfgsf/L pknAw u/fO{ rfn" cj:yfdf cfjZos ;'wf/ ug{ / eljiodf gLlt, of]hgf sfo{qmd÷cfof]hgfx¿sf] th"{dfdf ljutsf cg'ejaf6 kf7 l;sL uNtLx¿ bf]xl/g glbg ;xof]u k'¥ofpF5 .

glthfd"ns cg'udg k|ltj]bg tyf glthfsf] k|of]u

-;fef/– >L tLy{/fh 9sfn, ;x;lrj,

/fof]cf;_

M&E institutionalization effortsPlan Focus of M&E

First to Fourth

Practices of progress review in NDC, NPC esp. input and processesNo systematic M&E system and processes

Fifth Weightage system (Physical progress tied up with actual performance than budget spent)

Eighth New M&E System (NDAC, MDAC, M&E units, Formats, indicators)

Since Tenth Plan

Towards Results based M&E (MfDR)- (PMAS, DPMAS, Streamlined Hh surveys); RBME: indicator-based monitoring

Monitoring responsibility Agency Responsible

NPCS, M&E Division Monitoring of monitoringDesigning guidelines, formatsMonitoring outcomes; sustainability monitoringEvaluationSecretariat services to NDACFacilitate build M&E capacities

NPCS, Sectoral Divisions

Prog./Project monitoring and progress updates

OPMCM. M&E section

Monitoring services deliveryMonitoring projects of national pride

MOF, M&E Division Monitoring projects’ key milestones and disbursement status

Line ministries Implementation monitoring, completion evalu....

-;fef/– >L tLy{/fh 9sfn, ;x;lrj, /fof]cf;_

cg'udg tyf d"NofÍgsf tx tyf ;+:yfut ;+/rgftx s] sf] s;n] < slxn]

<s;/L <

/fli6«o

gLlt k|wfgdGqL tyf dlGqkl/ifbsf] sfof{no, /fli6«o of]hgf cfof]u,;DjlGwt dGqfno

gLlt sfof{Gjog r/0f

:jtGq lgsfoaf6 d"NofÍg

cfjlws of]hgf

/fli6«o of]hgf cfof]u

of]hgf cjlwe/

lg/Gt/ cg'udg,:jtGq lgsfoaf6 d"NofÍg

klxnf] k|fyldstf k|fKt cfof]hgf

k|wfgdGqL tyf dlGqkl/ifbsf] sfof{no, /fli6«o of]hgf cfof]u,dGqfno

cfjZostf cg';f/

;+o'Qm cg'udg

If]qLo

sfo{qmd, cfof]hgf

ljefu, If]qLo sfof{no

cfjZostfcg';f/

lg/Gt/ cg'udg, t];|f] kIf cg'udg,

sfo{qmd, cfof]hgf

sfo{qmd,cfof]hgf

lhNnf ljsf; ;ldlt,;Da4 lhNnftxsf lgsfox?

cfjZostfcg';f/

lg/Gt/ cg'udg, t];|f] kIf cg'udg,

ljleGg txdf ug'{kg]{ cg'udg tyf d"NofÍg

-;fef/– >L tLy{/fh 9sfn, ;x;lrj, /fof]cf;_

ljleGg txdf cg'udg tyf d"NofÍg Aoj:yfM/fli6«o tx

◦dxfn]vf k/LIfssf] sfof{no ◦k|wfgdGqL tyf dlGqkl/ifb\sf] sfof{no

◦/fli6«o of]hgf cfof]u◦cy{ dGqfno ◦/fli6«o ;ts{tf s]Gb| ◦dxfn]vf lgoGqssf] sfof{no

;+:yfut Joj:yf /fli6«o ljsf; ;d:of ;dfwfg ;ldltdGqfno:t/Lo ljsf; ;d:of ;dfwfg ;ldltcg'udg tyf d"NofÍg dxfzfvf÷zfvf

lhNnf:t/Lo ljsf; sfo{qmd÷cfof]hgfx?sf] cg'udg tyf d"NofÍg Joj:yf

;'kl/j]If0f tyf cg'udg ;ldlt :yfgLo :jfoQ zf;g P]g, @)%% tyf :yfgLo :jfoQ zf;g lgodfjnL, @)%^

adf]lhdsf] Joj:yf .