42
Evaluation of National Veterinary Services Evaluation of National Veterinary Services using using the OIE PVS Tool the OIE PVS Tool Workshop for OIE new Delegates of Europe ENSV, Lyons, France 4 – 5 November 2008 Gastón Funes Head, Regional Activities Department

Evaluation of National Veterinary Services Evaluation of ... · Evaluation of National Veterinary Services Evaluation of National Veterinary Services ... In the case of new ... Costa

  • Upload
    lexuyen

  • View
    221

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Evaluation of National Veterinary Services Evaluation of ... · Evaluation of National Veterinary Services Evaluation of National Veterinary Services ... In the case of new ... Costa

Evaluation of National Veterinary Services Evaluation of National Veterinary Services usingusing

the OIE PVS Toolthe OIE PVS ToolWorkshop for OIE new Delegates of Europe

ENSV, Lyons, France4 – 5 November 2008

Gastón FunesHead, Regional Activities Department

Page 2: Evaluation of National Veterinary Services Evaluation of ... · Evaluation of National Veterinary Services Evaluation of National Veterinary Services ... In the case of new ... Costa

Topics of the presentation:

BackgroundBasis in OIE standardObjectives ProceduresEvaluation processGap analysisFollow-up

OIE-PVS Evaluation

Page 3: Evaluation of National Veterinary Services Evaluation of ... · Evaluation of National Veterinary Services Evaluation of National Veterinary Services ... In the case of new ... Costa

SOME KEY FACTS• Established in 1924: 172 Members• Intergovernmental organisation – predates the UN• Permanent Regional Representations: Bamako (Mali), Buenos Aires

(Argentina), Tokyo (Japan), Sofia (Bulgaria) and Beirut (Lebanon)• Sub-regional Offices: Bangkok (Thailand), Gaborone (Botswana),

Panama, Brussels (Belgium)• Regional Commissions: Africa, America, Asia-Pacific, Europe and Middle

East

29

50

13

2852

Page 4: Evaluation of National Veterinary Services Evaluation of ... · Evaluation of National Veterinary Services Evaluation of National Veterinary Services ... In the case of new ... Costa

OIE MANDATE

Historical: ‘To prevent animal diseases from spreading around the world’

The 4th Strategic Plan 2006/2010 extends the OIE’s global mandate to:

‘‘The improvement of animal health all around the world’

Page 5: Evaluation of National Veterinary Services Evaluation of ... · Evaluation of National Veterinary Services Evaluation of National Veterinary Services ... In the case of new ... Costa

ANIMAL HEALTH INFORMATION

OIE OBJECTIVES

to ensure transparency in the global animal disease and zoonosis situation

to collect, analyse and disseminatescientific veterinary information

Page 6: Evaluation of National Veterinary Services Evaluation of ... · Evaluation of National Veterinary Services Evaluation of National Veterinary Services ... In the case of new ... Costa

INTERNATIONAL STANDARDS

OIE OBJECTIVES

to promulgate health standards for the safety of international trade in animals and animal products (within its WTO mandate) and animal disease surveillance

to contribute to food safety and food security

and to promote animal welfare, through a science-based approach

Page 7: Evaluation of National Veterinary Services Evaluation of ... · Evaluation of National Veterinary Services Evaluation of National Veterinary Services ... In the case of new ... Costa

ACTIVITIES OF VETERINARY SERVICES

OIE OBJECTIVES

to provide expertise and encourage international solidarity in the control of animal diseases

to improve the legal framework and resourcesof national Veterinary Services

PVS concept linked with these objectives

Page 8: Evaluation of National Veterinary Services Evaluation of ... · Evaluation of National Veterinary Services Evaluation of National Veterinary Services ... In the case of new ... Costa

Adopted by consensus of OIE Members

Official references of the World Trade Organisation SPS Agreement

Terrestrial Animal Health Codemammals, birds and beesAvailable athttp://www.oie.int/eng/normes/mcode/en_sommaire.htm

Section 3: Quality of Veterinary Services Chapter 3.1. - Veterinary ServicesChapter 3.2. - Evaluation of VS

OIE INTERNATIONAL STANDARDS

Page 9: Evaluation of National Veterinary Services Evaluation of ... · Evaluation of National Veterinary Services Evaluation of National Veterinary Services ... In the case of new ... Costa

Evaluation of the Evaluation of the Performance ofPerformance of

VeterinaryVeterinary ServicesServices

Page 10: Evaluation of National Veterinary Services Evaluation of ... · Evaluation of National Veterinary Services Evaluation of National Veterinary Services ... In the case of new ... Costa

What is the OIE-PVS Tool?An assessment tool on level of compliance with OIE international standards on Quality and Evaluation of Veterinary Services

Chapter 3.1.: Veterinary Services

Chapter 3.2.: Evaluation of VS

Page 11: Evaluation of National Veterinary Services Evaluation of ... · Evaluation of National Veterinary Services Evaluation of National Veterinary Services ... In the case of new ... Costa

Self evaluation performed by internal and/or OIE expertsfor the purpose of assessing the performance of VS…process reviewed on a regular basis to monitor improvements

Use of the OIE-PVS Tool

Page 12: Evaluation of National Veterinary Services Evaluation of ... · Evaluation of National Veterinary Services Evaluation of National Veterinary Services ... In the case of new ... Costa

An evaluation relevant to bilateral negotiations between trading countries:… performed at the request of either country…best done by mutual agreement

Use of the OIE-PVS Tool

Page 13: Evaluation of National Veterinary Services Evaluation of ... · Evaluation of National Veterinary Services Evaluation of National Veterinary Services ... In the case of new ... Costa

An independent objective evaluation that provides a strong legitimization of a request for national and/or international financing

Major donors have accepted the use of the OIE PVS Tool and the criteria in the Code in the evaluation of performance and priorities of VS, as a prerequisite and a key guide in helping countries make requests for investment

Use of the OIE-PVS Tool

Page 14: Evaluation of National Veterinary Services Evaluation of ... · Evaluation of National Veterinary Services Evaluation of National Veterinary Services ... In the case of new ... Costa

“First diagnostic” of conformity of VS with OIE standards on Quality, which allows:

Gap identification (legitimacy of the request and leverage effect):

..national use for self improvement;

..external use for financial support;

..use for credibility in international trade.

Output of OIE-PVS Evaluation:

Page 15: Evaluation of National Veterinary Services Evaluation of ... · Evaluation of National Veterinary Services Evaluation of National Veterinary Services ... In the case of new ... Costa

Legal Basis (OIE Code)

from Article 3.2.1.

The purpose of evaluation may be– to assist a national authority in the decision-

making process regarding priorities for its own VS (self-evaluation)…

– to assist the process of risk analysis in international trade … to which official sanitary and/or zoosanitary controls apply.

Page 16: Evaluation of National Veterinary Services Evaluation of ... · Evaluation of National Veterinary Services Evaluation of National Veterinary Services ... In the case of new ... Costa

Legal Basis (OIE Code)from Article 3.1.3.

“Members should recognise the right of another Member to undertake, or request it to undertake, an evaluation of its VS where the initiating Member is an actual or prospective importer or exporter of commodities, and where the evaluation is to be a component of a risk analysis process which is to be used to determine sanitary measures to be applied to trade.”

Page 17: Evaluation of National Veterinary Services Evaluation of ... · Evaluation of National Veterinary Services Evaluation of National Veterinary Services ... In the case of new ... Costa

OIE Code: Reference to OIE PVS-Tool:

from Article 3.1.5.• Evaluation facilitated by OIE experts under the auspices

of the OIE• …procedures for the evaluation of VS upon request by

Members,• International Committee endorses a list of approved

experts…,• Experts facilitate the evaluation of VS of Members based

on the provisions in Chapter 3.2., using the OIE Tool forthe Evaluation of Performance of Veterinary Services (OIE PVS Tool).

Page 18: Evaluation of National Veterinary Services Evaluation of ... · Evaluation of National Veterinary Services Evaluation of National Veterinary Services ... In the case of new ... Costa

OIE Tool for the Evaluation of

Performance of Veterinary Services

OIE-PVS Tool

http://www.oie.int/eng/oie/organisation/EN_OIE%20PVS%20Tool_2008.pdf

Page 19: Evaluation of National Veterinary Services Evaluation of ... · Evaluation of National Veterinary Services Evaluation of National Veterinary Services ... In the case of new ... Costa

PVS 4 fundamental components

Criticalcompetencies

(6 - 12)

5 levels of advancement

OIE PVS TOOL

Page 20: Evaluation of National Veterinary Services Evaluation of ... · Evaluation of National Veterinary Services Evaluation of National Veterinary Services ... In the case of new ... Costa

4 FUNDAMENTAL COMPONENTS

Human, physical and financial resources

Technical authority and capability

Interaction with stakeholders

Access to markets

OIE PVS TOOL

Page 21: Evaluation of National Veterinary Services Evaluation of ... · Evaluation of National Veterinary Services Evaluation of National Veterinary Services ... In the case of new ... Costa

I) Human, physical and financial resources

Professional and technical staffingCompetencies of veterinarians and veterinary para-professionalsPhysical resourcesFunding……

6 - 12 critical competencies in eachfundamental component

OIE PVS TOOL

Page 22: Evaluation of National Veterinary Services Evaluation of ... · Evaluation of National Veterinary Services Evaluation of National Veterinary Services ... In the case of new ... Costa

5 levels of advancement (qualitative) for each critical competency

Level 1no compliance

Level 5full compliance with OIE

standards

A higher level assumes compliance with all preceding levels

OIE PVS TOOL

Page 23: Evaluation of National Veterinary Services Evaluation of ... · Evaluation of National Veterinary Services Evaluation of National Veterinary Services ... In the case of new ... Costa

Critical competency II-1Veterinary Laboratory DiagnosisDefinition:‘The authority and capability of the VS to identify and record pathogenic agents, including those relevant for public health, that can adversely affect animals and animal products’.

OIE PVS TOOL

Page 24: Evaluation of National Veterinary Services Evaluation of ... · Evaluation of National Veterinary Services Evaluation of National Veterinary Services ... In the case of new ... Costa

II. 1 Veterinary Laboratory Diagnosis

Level1.

Disease diagnosis is

almost always conducted by clinical means

only,with

laboratory diagnostic capability

being generally

unavailable.

2.For major

zoonoses and diseases of

national economic

importance, the VS have access

to and use a laboratory to

obtain a correct diagnosis.

3.For other zoonoses

and diseases present in

the country, the VS have access to and use a

laboratory to obtain a correct

diagnosis.

4.For diseases of

zoonotic or economic

importance not present in the country, but

known to exist in the region and/ or that could enter the country, the

VS have access to and use a

laboratory to obtain a correct

diagnosis.

5.In the case of new

and emerging diseases in the region or world,

the VS have access to and use

a network of national or

international reference

laboratories (e.g. an OIE Reference

Laboratory) to obtain a correct

diagnosis.

Page 25: Evaluation of National Veterinary Services Evaluation of ... · Evaluation of National Veterinary Services Evaluation of National Veterinary Services ... In the case of new ... Costa

External independent evaluationUpon request of the country– according to its context

To assess– Compliance with OIE Standards– Strengths / Weaknesses– Gaps / areas for improvement

Not an audit

OIE PVS APPROACH

Page 26: Evaluation of National Veterinary Services Evaluation of ... · Evaluation of National Veterinary Services Evaluation of National Veterinary Services ... In the case of new ... Costa

Experts trained and certified by the OIEAssessment based on facts & evidence, not impressionsDonors have accepted the use of the OIE PVS Tool in the evaluation of the performance of VSA prerequisite and a guide in helping countries request national and/or international financial support needed to make improvements

OIE PVS APPROACH

Page 27: Evaluation of National Veterinary Services Evaluation of ... · Evaluation of National Veterinary Services Evaluation of National Veterinary Services ... In the case of new ... Costa

Official request from the OIE DelegatePropose names of experts and datesEVALUATION (documents and mission)Draft ReportPeer reviewCountry agreement/comments on the

draft reportFinal report confidential until this stage

…for release only if agreed

STEPS IN THE OIE-PVS EVALUATION

Page 28: Evaluation of National Veterinary Services Evaluation of ... · Evaluation of National Veterinary Services Evaluation of National Veterinary Services ... In the case of new ... Costa

Team Leader + Expert(s)…+ Observer(s) …+ Facilitator(s)

~ 150 OIE certified PVS experts trained so far(May 06; July 06; Feb. 07 and in Feb. 08) (adopted by OIE Members and recognised by donors)

Four operating languages: EN, FR, SP & RUGeographical balanceMissions financed through the OIE World Fund

OIE-PVS Evaluation Team

Page 29: Evaluation of National Veterinary Services Evaluation of ... · Evaluation of National Veterinary Services Evaluation of National Veterinary Services ... In the case of new ... Costa

OIE Forum for discussions and analysis:OIE-PVS internal Task ForceOIE Ad Hoc Group on Evaluation of VSOIE specific workshops (feed back experts)

Useful elements:OIE-PVS Tool Indicators for each CCOIE-PVS Manual of the Assessor:

Vol 1: Guidelines for conducting an evaluationVol 2: Guidelines for writing an evaluation report

OIE-PVS Evaluation

Page 30: Evaluation of National Veterinary Services Evaluation of ... · Evaluation of National Veterinary Services Evaluation of National Veterinary Services ... In the case of new ... Costa

REGION Official requestsfrom countries

Missionscompleted

Gap analysisrequests

AFRICA 36 32 6

AMERICAS 16 10 1

ASIA/ PACIFIC 13 10 1

EUROPE 11 9 2

MIDDLE EAST 12 6 1

TOTAL* 88 67 11

AFRICA (36): Algeria, Benin, Burkina Faso, Burundi, Cameroon, Chad, Côte D’Ivoire, Congo (DR), Djibouti, Egypt, Eritrea, Gabon, Ghana, Guinea, Guinea-Bissau, Kenya, Lesotho, Madagascar, Malawi, Mali, Mauritania, Mauritius, Morocco, Mozambique, Namibia, Niger, Nigeria, Senegal, Swaziland, Sudan, Tanzania, Togo, Tunisia, Uganda, Rwanda, Zambia. AMERICAS (16): Barbados, Belize, Bolivia, Brazil, Colombia, Costa Rica, Dominican Republic, Guyana, Honduras, Jamaica, Mexico, Panama, Paraguay, Peru, Salvador, Uruguay.ASIA/PACIFIC (13): Bangladesh, Bhutan, Brunei, Cambodia, Fiji, Indonesia, Korea (PDR), Lao, Mongolia, Nepal, Philippines, Sri Lanka, Vietnam.EUROPE (11): Albania, Armenia, Azerbaijan, Bulgaria, Kazakhstan, Kyrgyzstan, Romania, Tajikistan, Turkey, Ukraine, Uzbekistan. MIDDLE EAST (12): Afghanistan, Bahrein, Jordan, Lebanon, Kuwait, Qatar, Saudi Arabia, Palestinian National Authority, , Oman, Syria, UAE, Yemen,

Most of pending missions are planned until the end of the year 2008.

PVS Evaluation Missions – (As at 31 October 2008)

Page 31: Evaluation of National Veterinary Services Evaluation of ... · Evaluation of National Veterinary Services Evaluation of National Veterinary Services ... In the case of new ... Costa

PVS Evaluation Missions in Europe(As at 31 October 2008)

Country Missions carried out Report Released

Albania yes

Armenia yes yes

Azerbaijan yes

Bulgaria In planning

Kazakhstan Yes

Kyrgyzstan* Yes yes

Romania Yes

Tajikistan In planning

Turkey* Yes yes

Ukraine yes

Uzbekistan

* Gap AnalysisRequest

Yes

Page 32: Evaluation of National Veterinary Services Evaluation of ... · Evaluation of National Veterinary Services Evaluation of National Veterinary Services ... In the case of new ... Costa

Delays or no answers from MC after OIE proposal;

Problems on communication/coordination betweenTL and the country for the previous organisation of the mission;

Provision of information and documents from the country to TL (designation of contact person);

Sooner answer (comments/agreement) from the evaluated country on the PVS report;

Authorisation from evaluated countries to release the report;

Improving PVS process: Lessons LearntImproving PVS process: Lessons Learnt

Page 33: Evaluation of National Veterinary Services Evaluation of ... · Evaluation of National Veterinary Services Evaluation of National Veterinary Services ... In the case of new ... Costa

Role of OIE Reg. and Sub-Reg. Representations:

Helpers / facilitators / nexus, between:

-Team Leaders and countries,

to help TL in getting information in advance,

-Countries and OIE HQs,

to get answers from MC,to get agreement/comments from countries, on the report,

Improving PVS process: Lessons LearntImproving PVS process: Lessons Learnt

Page 34: Evaluation of National Veterinary Services Evaluation of ... · Evaluation of National Veterinary Services Evaluation of National Veterinary Services ... In the case of new ... Costa

GAP ANALYSIS

“Gap Analysis of PVS Outcomes: Evaluation of Needs and Priorities”

Page 35: Evaluation of National Veterinary Services Evaluation of ... · Evaluation of National Veterinary Services Evaluation of National Veterinary Services ... In the case of new ... Costa

Using OIE-PVS Evaluation results…OIE-PVS Evaluation = “1st Diagnostic” (qualitative):

Compliance with OIE StandardsStrengths / WeaknessesGaps / areas for improvement

Next step of the process, “Treatment”: Gap Analysis: Evaluation of Needs and Priorities(quantitative assessment of corresponding needs)

Preparation of strengthening investment programmes

Page 36: Evaluation of National Veterinary Services Evaluation of ... · Evaluation of National Veterinary Services Evaluation of National Veterinary Services ... In the case of new ... Costa

Gap Analysis of PVS Outcomes: Evaluation of Needs and Priorities

PVS Gap Analysis: baseline for the investment programs

Investment programmes: prepared in collaboration with OIE partners (FAO) and donors

Need of additional expertise: economists, project managers, etc.

Deep involvement of countries concerned: priority setting process (national factors and conditions)

Focus on specific FC or CCShifting from level “x” to “x +1” or to “x +

2”….

Page 37: Evaluation of National Veterinary Services Evaluation of ... · Evaluation of National Veterinary Services Evaluation of National Veterinary Services ... In the case of new ... Costa

Gap Analysis of PVS Outcomes: Evaluation of Needs and Priorities

To identify specific activities, tasks and resources required to address “gaps” (from PVS evaluation)

To determine priorities (country involvement)

Estimation of costs (collaboration from partners and donors)

Preparation of investment programmes (involvement of country and commitment from donors)

Page 38: Evaluation of National Veterinary Services Evaluation of ... · Evaluation of National Veterinary Services Evaluation of National Veterinary Services ... In the case of new ... Costa

Gap Analysis MissionsUpon request of countriesTeam composed by OIE-PVS Experts + partners +

donors + local teamDesk review of PVS report + o identify specific

activities, tasks and resources required to address “gaps” (from PVS evaluation)

Gap Analysis template (based on PVS structure)

GA Manual (to be developed with partners/donors)

Training on GA ofr PVS experts and others

Page 39: Evaluation of National Veterinary Services Evaluation of ... · Evaluation of National Veterinary Services Evaluation of National Veterinary Services ... In the case of new ... Costa

OIE Complementary Assistance to GA

Sanitary Legislation Model: Specific missions

Laboratory twinning proposals

OIE Vaccine Bank support (AI)

Regional training programmes for OIE Delegatesand focal points

PVS follow up missions

Page 40: Evaluation of National Veterinary Services Evaluation of ... · Evaluation of National Veterinary Services Evaluation of National Veterinary Services ... In the case of new ... Costa

OIE-PVS Follow Up missions

Continuous missions (each 1-2 years)Upon request of countriesOIE-PVS ExpertsMonitoring and improvement processAssessment of progressive evolution of

steps takenFinal objective: compliance with OIE

standards

PVS Evaluation« 1st Diagnostic »

GA and implementation of Projects« Treatment »

PVS Follow Up missionsEvaluation of« Evolution »

Page 41: Evaluation of National Veterinary Services Evaluation of ... · Evaluation of National Veterinary Services Evaluation of National Veterinary Services ... In the case of new ... Costa

« Without Good Governanceof Veterinary Services

OIE Objectives can not be achieved »

Page 42: Evaluation of National Veterinary Services Evaluation of ... · Evaluation of National Veterinary Services Evaluation of National Veterinary Services ... In the case of new ... Costa

World Organisation for Animal World Organisation for Animal HealthHealth12 rue de Prony

75017 Paris, FranceTel: 33 (0)1 44 15 18 88 Fax: 33 (0)1 42 67 09 87

Email: [email protected]://www.oie.int

Thank you for your attention