General evaluation of the process and results

of the preparation of the Innovative master program "Biodiversity and nature protection"

Kseniya Kamenskaya,Project manager of NGO Stellit

• ObjectiveTo evaluate the effectiveness of the

project on preparation and accomplishment of the ECODIV program

• Subject of research Activity aimed at preparation and implementation of the program at

St.Petersburg University

• Target group Partner organizations’ personnel and

students participating in the preparation and implementation of the

program at St.Petersburg University

Methodology of evaluation

Within this project internal efficiency was evaluated.

The evaluation was based on self-reports of the project participants, i.e.:

• Problems/difficulties and the ways of resolving them

• Participational satisfaction of the participants

• Opinions, expectations, attitudes, etc.

Evaluation phases: first wave

Target group Russian participants - participants of the 1st year of project realization (31 professors and 6 students who have had an internship at Western higher institutions).

International participants – university teachers from EU countries (12 people).

Subject Difficulties and problems arising during the project realization.Efficiency of collaboration with international (Russian/European) partners.

Method Questionnaire survey

Evaluation phases : second wave

Target group Russian University teachers (7 persons).Students of other Russian higher education institutions who once studied at St.Petersburg University, (2 persons).Students/personnel of St.Petersburg University who studied at foreign higher education institutions in 2007 (7 persons).

Subject Activity aimed at preparation and implementation of the program at St.Petersburg University and its subsequent introduction at other universities in the region.

Method Questionnaire survey

Evaluation phases: third wave

Target group

Russian participants – St.Petersburg University teachers and partner organizations’ personnel (21 persons)

Subject General evaluation of the project efficiency by the project participants, satisfaction, attitudes towards the prospects for Russian integration into the European system of higher education

Method Semi-structured interview

Tasks completed by the participants in the projectPrimary tasks1. development of training courses,

teaching aids, programs, etc. 2. administration, coordination of the work

of other specialists 3. organizing activities as such,

participation in the program conceptualization, specific tasks and goals

Secondary tasks:technical issues, events organization,

cooperation with Russian and international partners, etc.

Task completeness self-evaluation

• 5-max – 1-min

10; 47%

8; 38%

2; 10%1; 5%

5

4

3

Could notanswer

Dissatisfaction with Dissatisfaction with completeness of some of the completeness of some of the

taskstasks• Quantitative • For instance: according to the

participants, insufficient preparation of some of the courses, teaching aids, etc., insufficient involvement of potential employers, incomplete equipment, etc.

• Qualitative The methodological Commission could

not be convinced that there is a need for new regulations in accordance with European educational standards

Evaluation by the participants of the reasons why some of the task have

not been completed

External organizational reasons • Existent norms and regulations of the Russian

educational system that come into conflict with European standards

• Intricate internal organizational structure of the University, incl. the finance system

• Insufficient time allocated for the project within the teaching load of the personnel

No unified view upon the project among participants

• It was unclear for the participants how the program would work in the future

• No previous experience of such work• Different work approaches employed by the participants• Uncertainty of final product evaluation criteria

Evaluation of Russian part of the project management

7; 33%

8; 38%

4; 19%

1; 5% 1; 5%

5

4

3

2

Could notanswer

• 5-max – 1-min

Evaluation of Russian part of the project management

Strong points:• Active attitude, initiative• Organized exchange of opinion between

participants• Keeping the terms, efficient response

Weak points• Considerable changes of the project

during implementation• Insufficient awareness of the

participants on the local level• Unclear tasks and requirements

Evaluation of foreign part of the project management

2; 11%

10; 56%4; 22%

2; 11%

5 4 3 Could not answer

• 5-max – 1-min

Evaluation of foreign part of the project management

Strong points:• Active attitude, persistence• Soft management• Strong commitment to the success of

the project

Weak points• Insufficient awareness of the

organizational structure of the university

• Insufficient awareness of the Russian teaching methodology and the Russian model of higher education

Participation in the project as Participation in the project as a factor of professional a factor of professional

growthgrowth20 out of 21 participants of the project

reported gaining new professional experience, in particular:

• General view upon the principles and system of Western European educational programs

• Specific knowledge of the European system of education (teaching load calculation, finance) and field experience in developing teaching courses in accordance with European requirements

• Increased knowledge of allied sciences

Participation in the project as Participation in the project as a factor of professional a factor of professional

growthgrowth

11; 52%

7; 33%

1; 5%

2; 10%

5 4 3 Could not answer

Importance of the experience gained for future professional career

Fields of application of the experience gained:

1. teaching2. methodology

development

Evaluation of the prospects of integrating Russian education into

the European system

Advantages of the European approach• Better teaching aids• Better technique• Practically-oriented education• Students’ mobility

Advantages of the Russian approach• Education oriented to fundamental

science• Multifunctional specialist training• More class hours

Evaluation of the prospects of integrating Russian education into

the European system

The vast majority of the participants view such possible integration in a positive light

However, • they think that the current advantages

of the Russian approach to higher education have to be retained

• such integration could be possible only after a considerable organizational change on the Russian part and will take a lot of time

Project evaluation: resume

The efficiency of the project evaluated can be considered as high

Project successes:

• Successful overcome of internal organizational difficulties during the project

• Sufficiently high evaluation of the project management on both sides: Russian and foreign

• Positive attitude of all participants towards the project

• Professional growth and increased expertise of the participants

• Establishing contacts between participants who work at different departments

• Engaging young specialists in the project

Thank you!