Evaluation of National Veterinary Services Evaluation of ... · Evaluation of National Veterinary...

Evaluation of National Veterinary Services Evaluation of National Veterinary Services usingusing

the OIE PVS Toolthe OIE PVS ToolWorkshop for OIE new Delegates of Europe

ENSV, Lyons, France4 – 5 November 2008

Gastón FunesHead, Regional Activities Department

Topics of the presentation:

BackgroundBasis in OIE standardObjectives ProceduresEvaluation processGap analysisFollow-up

OIE-PVS Evaluation

SOME KEY FACTS• Established in 1924: 172 Members• Intergovernmental organisation – predates the UN• Permanent Regional Representations: Bamako (Mali), Buenos Aires

(Argentina), Tokyo (Japan), Sofia (Bulgaria) and Beirut (Lebanon)• Sub-regional Offices: Bangkok (Thailand), Gaborone (Botswana),

Panama, Brussels (Belgium)• Regional Commissions: Africa, America, Asia-Pacific, Europe and Middle

East

29

50

13

2852

OIE MANDATE

Historical: ‘To prevent animal diseases from spreading around the world’

The 4th Strategic Plan 2006/2010 extends the OIE’s global mandate to:

‘‘The improvement of animal health all around the world’

ANIMAL HEALTH INFORMATION

OIE OBJECTIVES

to ensure transparency in the global animal disease and zoonosis situation

to collect, analyse and disseminatescientific veterinary information

INTERNATIONAL STANDARDS

OIE OBJECTIVES

to promulgate health standards for the safety of international trade in animals and animal products (within its WTO mandate) and animal disease surveillance

to contribute to food safety and food security

and to promote animal welfare, through a science-based approach

ACTIVITIES OF VETERINARY SERVICES

OIE OBJECTIVES

to provide expertise and encourage international solidarity in the control of animal diseases

to improve the legal framework and resourcesof national Veterinary Services

PVS concept linked with these objectives

Adopted by consensus of OIE Members

Official references of the World Trade Organisation SPS Agreement

Terrestrial Animal Health Codemammals, birds and beesAvailable athttp://www.oie.int/eng/normes/mcode/en_sommaire.htm

Section 3: Quality of Veterinary Services Chapter 3.1. - Veterinary ServicesChapter 3.2. - Evaluation of VS

OIE INTERNATIONAL STANDARDS

Evaluation of the Evaluation of the Performance ofPerformance of

VeterinaryVeterinary ServicesServices

What is the OIE-PVS Tool?An assessment tool on level of compliance with OIE international standards on Quality and Evaluation of Veterinary Services

Chapter 3.1.: Veterinary Services

Chapter 3.2.: Evaluation of VS

Self evaluation performed by internal and/or OIE expertsfor the purpose of assessing the performance of VS…process reviewed on a regular basis to monitor improvements

Use of the OIE-PVS Tool

An evaluation relevant to bilateral negotiations between trading countries:… performed at the request of either country…best done by mutual agreement

Use of the OIE-PVS Tool

An independent objective evaluation that provides a strong legitimization of a request for national and/or international financing

Major donors have accepted the use of the OIE PVS Tool and the criteria in the Code in the evaluation of performance and priorities of VS, as a prerequisite and a key guide in helping countries make requests for investment

Use of the OIE-PVS Tool

“First diagnostic” of conformity of VS with OIE standards on Quality, which allows:

Gap identification (legitimacy of the request and leverage effect):

..national use for self improvement;

..external use for financial support;

..use for credibility in international trade.

Output of OIE-PVS Evaluation:

Legal Basis (OIE Code)

from Article 3.2.1.

The purpose of evaluation may be– to assist a national authority in the decision-

making process regarding priorities for its own VS (self-evaluation)…

– to assist the process of risk analysis in international trade … to which official sanitary and/or zoosanitary controls apply.

Legal Basis (OIE Code)from Article 3.1.3.

“Members should recognise the right of another Member to undertake, or request it to undertake, an evaluation of its VS where the initiating Member is an actual or prospective importer or exporter of commodities, and where the evaluation is to be a component of a risk analysis process which is to be used to determine sanitary measures to be applied to trade.”

OIE Code: Reference to OIE PVS-Tool:

from Article 3.1.5.• Evaluation facilitated by OIE experts under the auspices

of the OIE• …procedures for the evaluation of VS upon request by

Members,• International Committee endorses a list of approved

experts…,• Experts facilitate the evaluation of VS of Members based

on the provisions in Chapter 3.2., using the OIE Tool forthe Evaluation of Performance of Veterinary Services (OIE PVS Tool).

OIE Tool for the Evaluation of

Performance of Veterinary Services

OIE-PVS Tool

http://www.oie.int/eng/oie/organisation/EN_OIE%20PVS%20Tool_2008.pdf

PVS 4 fundamental components

Criticalcompetencies

(6 - 12)

5 levels of advancement

OIE PVS TOOL

4 FUNDAMENTAL COMPONENTS

Human, physical and financial resources

Technical authority and capability

Interaction with stakeholders

Access to markets

OIE PVS TOOL

I) Human, physical and financial resources

Professional and technical staffingCompetencies of veterinarians and veterinary para-professionalsPhysical resourcesFunding……

6 - 12 critical competencies in eachfundamental component

OIE PVS TOOL

5 levels of advancement (qualitative) for each critical competency

Level 1no compliance

Level 5full compliance with OIE

standards

A higher level assumes compliance with all preceding levels

OIE PVS TOOL

Critical competency II-1Veterinary Laboratory DiagnosisDefinition:‘The authority and capability of the VS to identify and record pathogenic agents, including those relevant for public health, that can adversely affect animals and animal products’.

OIE PVS TOOL

II. 1 Veterinary Laboratory Diagnosis

Level1.

Disease diagnosis is

almost always conducted by clinical means

only,with

laboratory diagnostic capability

being generally

unavailable.

2.For major

zoonoses and diseases of

national economic

importance, the VS have access

to and use a laboratory to

obtain a correct diagnosis.

3.For other zoonoses

and diseases present in

the country, the VS have access to and use a

laboratory to obtain a correct

diagnosis.

4.For diseases of

zoonotic or economic

importance not present in the country, but

known to exist in the region and/ or that could enter the country, the

VS have access to and use a

laboratory to obtain a correct

diagnosis.

5.In the case of new

and emerging diseases in the region or world,

the VS have access to and use

a network of national or

international reference

laboratories (e.g. an OIE Reference

Laboratory) to obtain a correct

diagnosis.

External independent evaluationUpon request of the country– according to its context

To assess– Compliance with OIE Standards– Strengths / Weaknesses– Gaps / areas for improvement

Not an audit

OIE PVS APPROACH

Experts trained and certified by the OIEAssessment based on facts & evidence, not impressionsDonors have accepted the use of the OIE PVS Tool in the evaluation of the performance of VSA prerequisite and a guide in helping countries request national and/or international financial support needed to make improvements

OIE PVS APPROACH

Official request from the OIE DelegatePropose names of experts and datesEVALUATION (documents and mission)Draft ReportPeer reviewCountry agreement/comments on the

draft reportFinal report confidential until this stage

…for release only if agreed

STEPS IN THE OIE-PVS EVALUATION

Team Leader + Expert(s)…+ Observer(s) …+ Facilitator(s)

~ 150 OIE certified PVS experts trained so far(May 06; July 06; Feb. 07 and in Feb. 08) (adopted by OIE Members and recognised by donors)

Four operating languages: EN, FR, SP & RUGeographical balanceMissions financed through the OIE World Fund

OIE-PVS Evaluation Team

OIE Forum for discussions and analysis:OIE-PVS internal Task ForceOIE Ad Hoc Group on Evaluation of VSOIE specific workshops (feed back experts)

Useful elements:OIE-PVS Tool Indicators for each CCOIE-PVS Manual of the Assessor:

Vol 1: Guidelines for conducting an evaluationVol 2: Guidelines for writing an evaluation report

OIE-PVS Evaluation

REGION Official requestsfrom countries

Missionscompleted

Gap analysisrequests

AFRICA 36 32 6

AMERICAS 16 10 1

ASIA/ PACIFIC 13 10 1

EUROPE 11 9 2

MIDDLE EAST 12 6 1

TOTAL* 88 67 11

AFRICA (36): Algeria, Benin, Burkina Faso, Burundi, Cameroon, Chad, Côte D’Ivoire, Congo (DR), Djibouti, Egypt, Eritrea, Gabon, Ghana, Guinea, Guinea-Bissau, Kenya, Lesotho, Madagascar, Malawi, Mali, Mauritania, Mauritius, Morocco, Mozambique, Namibia, Niger, Nigeria, Senegal, Swaziland, Sudan, Tanzania, Togo, Tunisia, Uganda, Rwanda, Zambia. AMERICAS (16): Barbados, Belize, Bolivia, Brazil, Colombia, Costa Rica, Dominican Republic, Guyana, Honduras, Jamaica, Mexico, Panama, Paraguay, Peru, Salvador, Uruguay.ASIA/PACIFIC (13): Bangladesh, Bhutan, Brunei, Cambodia, Fiji, Indonesia, Korea (PDR), Lao, Mongolia, Nepal, Philippines, Sri Lanka, Vietnam.EUROPE (11): Albania, Armenia, Azerbaijan, Bulgaria, Kazakhstan, Kyrgyzstan, Romania, Tajikistan, Turkey, Ukraine, Uzbekistan. MIDDLE EAST (12): Afghanistan, Bahrein, Jordan, Lebanon, Kuwait, Qatar, Saudi Arabia, Palestinian National Authority, , Oman, Syria, UAE, Yemen,

Most of pending missions are planned until the end of the year 2008.

PVS Evaluation Missions – (As at 31 October 2008)

PVS Evaluation Missions in Europe(As at 31 October 2008)

Country Missions carried out Report Released

Albania yes

Armenia yes yes

Azerbaijan yes

Bulgaria In planning

Kazakhstan Yes

Kyrgyzstan* Yes yes

Romania Yes

Tajikistan In planning

Turkey* Yes yes

Ukraine yes

Uzbekistan

* Gap AnalysisRequest

Yes

Delays or no answers from MC after OIE proposal;

Problems on communication/coordination betweenTL and the country for the previous organisation of the mission;

Provision of information and documents from the country to TL (designation of contact person);

Sooner answer (comments/agreement) from the evaluated country on the PVS report;

Authorisation from evaluated countries to release the report;

Improving PVS process: Lessons LearntImproving PVS process: Lessons Learnt

Role of OIE Reg. and Sub-Reg. Representations:

Helpers / facilitators / nexus, between:

-Team Leaders and countries,

to help TL in getting information in advance,

-Countries and OIE HQs,

to get answers from MC,to get agreement/comments from countries, on the report,

Improving PVS process: Lessons LearntImproving PVS process: Lessons Learnt

GAP ANALYSIS

“Gap Analysis of PVS Outcomes: Evaluation of Needs and Priorities”

Using OIE-PVS Evaluation results…OIE-PVS Evaluation = “1st Diagnostic” (qualitative):

Compliance with OIE StandardsStrengths / WeaknessesGaps / areas for improvement

Next step of the process, “Treatment”: Gap Analysis: Evaluation of Needs and Priorities(quantitative assessment of corresponding needs)

Preparation of strengthening investment programmes

Gap Analysis of PVS Outcomes: Evaluation of Needs and Priorities

PVS Gap Analysis: baseline for the investment programs

Investment programmes: prepared in collaboration with OIE partners (FAO) and donors

Need of additional expertise: economists, project managers, etc.

Deep involvement of countries concerned: priority setting process (national factors and conditions)

Focus on specific FC or CCShifting from level “x” to “x +1” or to “x +

2”….

Gap Analysis of PVS Outcomes: Evaluation of Needs and Priorities

To identify specific activities, tasks and resources required to address “gaps” (from PVS evaluation)

To determine priorities (country involvement)

Estimation of costs (collaboration from partners and donors)

Preparation of investment programmes (involvement of country and commitment from donors)

Gap Analysis MissionsUpon request of countriesTeam composed by OIE-PVS Experts + partners +

donors + local teamDesk review of PVS report + o identify specific

activities, tasks and resources required to address “gaps” (from PVS evaluation)

Gap Analysis template (based on PVS structure)

GA Manual (to be developed with partners/donors)

Training on GA ofr PVS experts and others

OIE Complementary Assistance to GA

Sanitary Legislation Model: Specific missions

Laboratory twinning proposals

OIE Vaccine Bank support (AI)

Regional training programmes for OIE Delegatesand focal points

PVS follow up missions

OIE-PVS Follow Up missions

Continuous missions (each 1-2 years)Upon request of countriesOIE-PVS ExpertsMonitoring and improvement processAssessment of progressive evolution of

steps takenFinal objective: compliance with OIE

standards

PVS Evaluation« 1st Diagnostic »

GA and implementation of Projects« Treatment »

PVS Follow Up missionsEvaluation of« Evolution »

« Without Good Governanceof Veterinary Services

OIE Objectives can not be achieved »

World Organisation for Animal World Organisation for Animal HealthHealth12 rue de Prony

75017 Paris, FranceTel: 33 (0)1 44 15 18 88 Fax: 33 (0)1 42 67 09 87

Email: oie@oie.inthttp://www.oie.int

Thank you for your attention