20
Chief Executive Unit ESF-ALLEA WORKPLAN For the Review of the Research Institutes of the Bulgarian Academy of Sciences Annex 2 to the BAS-ESF-ALLEA Memorandum of Understanding Revision 20 January 2009 Changed on: 10 February 09, 19 February 09, 27 February 09, 2 March 09, 16 March 09, 18 March 09, 19 March 09 ESF Contact: Farzam RANJBARAN

ESF-ALLEA WORKPLANgeometrie.uibk.ac.at/obsolete/institutsangehoerige/Husty...Chief Executive Unit ESF-ALLEA WORKPLAN For the Review of the Research Institutes of the Bulgarian Academy

  • Upload
    others

  • View
    3

  • Download
    0

Embed Size (px)

Citation preview

Page 1: ESF-ALLEA WORKPLANgeometrie.uibk.ac.at/obsolete/institutsangehoerige/Husty...Chief Executive Unit ESF-ALLEA WORKPLAN For the Review of the Research Institutes of the Bulgarian Academy

Chief Executive Unit

ESF-ALLEA WORKPLAN

For the Review of the Research Institutes of the Bulgarian

Academy of Sciences

Annex 2 to the BAS-ESF-ALLEA Memorandum of Understanding

Revision 20 January 2009

Changed on: 10 February 09, 19 February 09, 27 February 09, 2 March 09, 16 March 09, 18 March 09, 19 March 09

ESF Contact: Farzam RANJBARAN

Page 2: ESF-ALLEA WORKPLANgeometrie.uibk.ac.at/obsolete/institutsangehoerige/Husty...Chief Executive Unit ESF-ALLEA WORKPLAN For the Review of the Research Institutes of the Bulgarian Academy

Page 2 of 20

Chief Executive Unit

Table of Contents

0. SUMMARY OF CHANGES IN THIS REVISION .......................................................................... 3

A. SCOPE ................................................................................................................................................. 4

B. REFERENCE AND APPLICABLE DOCUMENTS........................................................................ 4

C. INTRODUCTION .............................................................................................................................. 4

D. TERMS OF REFERENCE ................................................................................................................. 5

E. PROJECT PLANNING AND IMPLEMENTATION ..................................................................... 6

F. A BRIEF HISTORY AND ORGANISATIONAL STRUCTURE OF THE BAS ......................... 9

G. EVALUATION PROTOCOL .......................................................................................................... 14

H. TEMPLATE FOR THE SELF EVALUATION REPORTS ......................................................... 15

Page 3: ESF-ALLEA WORKPLANgeometrie.uibk.ac.at/obsolete/institutsangehoerige/Husty...Chief Executive Unit ESF-ALLEA WORKPLAN For the Review of the Research Institutes of the Bulgarian Academy

Page 3 of 20

Chief Executive Unit

0. Summary of Changes in this Revision

Changed on 10 February 2009:

Page 4 Paragraph 1: number of panel members (excluding the Chair) for PE-2 (Biological

Sciences) is changed to 8 (from 5) and for PE-3 (Earth Sciences) is changed to 5 (from 8).

Changed on 19 February 2009:

Page 5, Figure 3: the Date of the first meeting of the RMC and the Panels was changed from

being during 1-6 June to be during 8-13 June.

Page 7, Figure 6: The date of the first meeting of the RMC and the Panels was changed from 1-6

June to be during 8-13 June.

Changed on 27 February 2009:

Page 9: Based on a request from BAS, under division 1: Mathematical Sciences, the research unit

4- National Laboratory of Computer Virology, shall be excluded from the evaluation and

therefore the list of research units is modified accordingly.

Page 11: Based on a request from BAS, under Division IV. BIOLOGICAL SCIENCES, the research

unit 2- Institute of Physiology is substituted by 2- Institute of Neurobiology

Page 11: Based on a request from BAS, under Division V. EARTH SCIENCES, the research unit: 10-

Central Laboratory for Solar- Terrestrial Influences is substitute by 10- Institute for Solar-

Terrestrial Influences

Changed on 2 March 2009:

Page 4, last line of paragraph 1: sentence was changed to: “It is envisaged that in addition to

their Chairs, there will be …”

Page 12: Fifth paragraph was modified to: “There are a total number of 69 Research Units “

Changed on 16 March 2009:

Page 6 to 8: Figures (3-7) changed to account for about four weeks delay in the timeline.

Changed on 18 March 2009:

Page 4: [Ref 6] was added.

Page 14: New Section G. “Evaluation Protocol” was added

Changed on 18 March 2009:

Page 15: New Section H. “Template for Self-Evaluation Report Protocol” was added

Page 4: ESF-ALLEA WORKPLANgeometrie.uibk.ac.at/obsolete/institutsangehoerige/Husty...Chief Executive Unit ESF-ALLEA WORKPLAN For the Review of the Research Institutes of the Bulgarian Academy

Page 4 of 20

Chief Executive Unit

A. SCOPE

At the request of the Bulgarian Academy of Sciences (BAS), the European Science Foundation (ESF)

together with the European Federation of National Academies of Sciences and Humanities (ALLEA) will

conduct a comprehensive evaluation of the Bulgarian Academy’s Research Units (RU) under eight

Research Divisions. This document complements the Memorandum of Understanding (MoU) signed

between BAS, ALLEA and ESF. It serves as the project plan that defines and guides the activities of the

three parties involved towards a successful completion of the review.

B. REFERENCE AND APPLICABLE DOCUMENTS

[Ref. 1] Formal request from BAS to ESF and ALLEA for conducting the Review

[Ref. 2] Minutes of the first meeting of the representatives of ESF, ALLEA and BAS

[Ref. 3] Memorandum of Understanding (MoU) signed by the three organisations

[Ref. 4] BAS-ESF contract

[Ref. 5] Bulgarian Academy of Science – A Profile

[Ref. 6] Standard Evaluation Protocol, 2003 – 2009, For Public Research Organisations.

Vereniging van Universiteiten (VSNU), Nederlandse Organisatie voor Wetenschappelijk

Onderzoek (NWO), Koninklijke Nederlandse Akademie van Wetenschappen (KNAW).

January 2003, ISBN 90-5588 278x, link e.g., www.knaw.nl/publicaties/pdf/90000091.pdf

C. INTRODUCTION

On 13 October 2008, an official request [Ref. 1] signed by the BAS President, Professor Nikola Sabotinov,

was sent to the ESF Chief Executive, Professor Marja Makarow, and to the ALLEA President, Professor

Juri Engelbrecht, inviting the ESF and ALLEA to take on the task of conducting the evaluation of the BAS-

RUs. Following this request, a meeting was held at the BAS offices on 21 November 2008 in Sofia with

participants from ESF and ALLEA to discuss the details of the exercise. Minutes of this meeting are

provided in [Ref. 2]. The participants of this meeting form the ESF-ALLEA-BAS ad hoc Technical

Committee (members of the ad hoc committee are introduced in [Ref. 2]). In this meeting a broad-

level agreement was reached on the format of the review and participation of the different

organisations. Following the first meeting in Sofia, a Memorandum of Understanding was prepared and

signed by the three parties on 20 January 2009. This workplan complements the MoU by providing the

details of the activities, their timeline, and the division of responsibilities between the parties involved

for their accomplishment.

Page 5: ESF-ALLEA WORKPLANgeometrie.uibk.ac.at/obsolete/institutsangehoerige/Husty...Chief Executive Unit ESF-ALLEA WORKPLAN For the Review of the Research Institutes of the Bulgarian Academy

Page 5 of 20

Chief Executive Unit

D. TERMS OF REFERENCE

The description of the main requirements and characteristics of the review to be carried out are

provided within the Memorandum of Understanding [Ref. 3]. The overall evaluation will be governed by

a surveying Review Monitoring Committee (RMC) consisting of 7 researchers and experienced science

policy executives. Four different Panels of Experts (PE) with 5-11 members in each will be assigned to

the eight Research Divisions of the BAS as shown in Figure 1. The PEs will conduct the scientific

evaluation of the Research Units in their respective Divisions and will provide reports to the RMC. Four

members of the RMC are members of, and will chair, the 4 Panels of Experts defined above. Final

deliverable of a PE to the RMC is an expert evaluation report covering both the individual Research Units

and the Research Division as a whole. It is envisaged that in addition to their Chairs, there will be 11

members in PE-1, 8 members in PE-2, 5 members in PE-3 and 9 members in PE-4.

The RMC is responsible for compiling the final analysis, conclusions and one evaluation report based on

the expert reports of the PEs and their own discussions and analysis. This will include an assessment of

the research divisions and the overall performance of the BAS as a research performing organization.

The ESF-ALLEA-BAS Technical Management Committee (TMC) (otherwise known as the ad hoc technical

committee) will be responsible for the overall planning and management of the process including

elaborating the details and solving practical problems at every stage of the implementation. The TMC

represents the three organisations involved and its recommendations shall be considered as those of

the three organisations it represents. The list of members of the TMC may be found in [Ref. 2]

NB: The Identity of the members of the Panels of Expert shall be kept strictly confidential until the

beginning of the site visits when the PE members are in Sofia. The only exceptions to this are a very

limited number of BAS management who would have access to this information. The identity of the

RMC Chair and co-chairs will not be kept confidential.

Figure 1: Overall Setup of the Evaluation

Review Monitoring Committee (RMC)

PE-1

• Mathematical Sciences

• Physical Sciences

• Chemical Sciences

• Engineering Sciences

PE-2

• Biological sciences

PE-3

• Earth Sciences

PE-4

• Social Sciences

• Humanities

Page 6: ESF-ALLEA WORKPLANgeometrie.uibk.ac.at/obsolete/institutsangehoerige/Husty...Chief Executive Unit ESF-ALLEA WORKPLAN For the Review of the Research Institutes of the Bulgarian Academy

Page 6 of 20

Chief Executive Unit

E. PROJECT PLANNING AND IMPLEMENTATION

In this Section, the details of the planning, timelines, resource allocations and task distributions are

provided. Figure 2 below, illustrates the original timeline suggested by BAS. Figure 3 shows the updated

timeline for the major milestones and their expected completion as suggested by the ESF. Figures 4 to 7

show in more details all the individual activities and achievements that are necessary for the completion

of the five major milestones of Figure 3.

*also known as the ad hoc technical committee

Figure 2: Original Schedule suggested by BAS (NOT USED - SEE TIMELINE IN FIGURE 3 BELOW)

Figure 3: High-level workflow suggested by the ESF (major milestones and deadlines)

1st mtg in sofia Technical Management Committee

TMC (*)

• 21 Nov 08

SER submission deadline to BAS

• 30 Jan 09

SER sent to ESF-ALLEA

• 20 Feb 09

TMC review of SER

• 10 days

SER Final submission

• 02 Mar 09

ESF-ALLEA distribute

SER to Panels

• 2-6 Mar 09

PE 1st Meeting

Strasbourg

• Mid April 09

PE 2nd meeting and

Site Visits

• 20-30 Jun 09

PE Reports sent to RMC

• 30 Sep 09

RMC final report

• 31 Oct 09

4-7 May 09

Launch of

Evaluation

PEs site visits

& meetings

First meeting of

RMC and Panels

Final release

of SERs

15 Jan 09

RMC final meeting

and Report

11-12 Jun 09 7-13 Jul 09

1 Oct-30 Nov

09

Page 7: ESF-ALLEA WORKPLANgeometrie.uibk.ac.at/obsolete/institutsangehoerige/Husty...Chief Executive Unit ESF-ALLEA WORKPLAN For the Review of the Research Institutes of the Bulgarian Academy

Page 7 of 20

Chief Executive Unit

Figure 4: Preparatory activities leading to the Launch of Evaluation

Figure 5: Work leading to Final release of SERs to RMC and PEs

Finalise MoU

• ESF-BAS-ALLEA

• Start: 20 Oct 08

• End: 10 Jan 09

Finalise workplan

•ESF-BAS-ALLEA

•Start: 01 Dec 08

•End: 10 Jan 09

Finalise costing and financial agreements

•ESF

•Start: 08 Dec 08

•End: 12 Jan 09

Launch of Evaluation

• BAS-ESF-ALLEA

• On 15 Jan 09

RMC and PE Nominations and Selection

•ESF-ALLEA

• Start: 15 Jan 09

• End: 30 Jan 09

Endorsement by TMC

• ESF-ALLEA-BAS

• Start: 04 Feb 09

• End: 08 Feb 09

SERs Supplied to ESF-ALLEA

• ESF

• Start: 5 Feb 09

• End: 10 Feb 09

Invitations to members of RMC and PE

• ESF-ALLEA

• Start: 9 Mar 09

• End: 18 Mar 09

First opportunity for revision of SERs

• ESF-ALLEA

• By 23 Mar 09

Feedback from ESF-ALLEA to BAS on SER

• ESF-ALLEA

• By 25 Mar 09

RMC and PEs constituted

• BAS-ESF-ALLEA

• Start: 26 Mar 09

• End: 27 Mar 09

Endorsement of changes by

BAS

• ESF-ALLEA

• Start: 27 Mar 09

• End: 4 Apr 09

RMC endorsement

of process

•RMC-ESF-ALLEA

• Start: 6 Apr 09

• End: 11 Apr 09

RMC/PEs review of SERs

• RMC-PEs

• Start: 6 Apr 09

• End: 25 Apr 09

Delivery of supplemental information as

requested by RMC

• BAS

•Start: 26 Apr 09

•End: 30 May 09

Distribution of the final

version of SERs

• ESF-ALLEA

• Start: 4 May 09

• End: 5 May 09

Page 8: ESF-ALLEA WORKPLANgeometrie.uibk.ac.at/obsolete/institutsangehoerige/Husty...Chief Executive Unit ESF-ALLEA WORKPLAN For the Review of the Research Institutes of the Bulgarian Academy

Page 8 of 20

Chief Executive Unit

Figure 6: Work leading to RMC-PE First Meeting, PE Site Visits and PE Reports to RMC

Figure 7: Work leading to RMC final meeting and preparation/delivery of the final report

RMC/PE review of SERs

• ESF-ALLEA-RMC

• Start: 11 May 09

• End: 10 June 09

Feedback from PEs to RMC

• ESF-ALLEA-BAS

• Start: 9 June 09

• End: 10 June 09

RMC-PE First Meetings -

Brussels

• ESF-ALLEA-RMC-PE

• Start: 11 Jun 09

• End: 12 Jun 09

Compile discussions summary &

feedback

• ESF-ALLEA

• Start: 13 Jun09

• End: 20 Jun09

Preparation for PEs site visits

• BAS-ESF-ALLEA

• Start: 15 Apr 09

• End: 7 Jul 09

PEs Site Visits and Meetings

• ESF-ALLEA-PEs

• Start: 7 Jul 09

• End: 13 Jul 09

PEs conclusions and Reports

• ESF-ALLEA-PE

• Start: 13 Jul 09

• End: 30 Jul 09

PEs Reports sent to RMC

• ESF-ALLEA-PE

• Start: 05 Sep 09

• End: 10 Sep 09

Preparation of RMC Final Meeting

• ESF-ALLEA-RMC

• Start: 15 Feb 09

• End: 30 Sep 09

RMC final Meeting,

& Draft Report

• ALLEA-RMC-ESF

• Start: 1 Oct 09

• End: 5 Oct 09

Final Report prepared

• ALLEA-RMC-ESF

• Start: 5 Oct 09

•End: 20 Oct 09

Presentation & final delivery

of Report

• ALLEA-RMC-ESF

• Start: 20 Oct 09

• End: 30 Nov 09

Page 9: ESF-ALLEA WORKPLANgeometrie.uibk.ac.at/obsolete/institutsangehoerige/Husty...Chief Executive Unit ESF-ALLEA WORKPLAN For the Review of the Research Institutes of the Bulgarian Academy

Page 9 of 20

Chief Executive Unit

F. A BRIEF HISTORY AND ORGANISATIONAL STRUCTURE OF THE BAS

This Section contains excerpts from Reference Document 5: Bulgarian Academy of Science – A Profile

[Ref. 5].

Bulgarian Learned Society (BLS) was established at the end of September 1869 by a small group of

enlightened and patriotically minded Bulgarians in the town of Braila, Romania.

In March 1911, the BLS was transformed to Bulgarian Academy of Sciences (BAS).

1940 to 1947: The renaming of BAS to “Bulgarian Academy of Sciences and Arts”.

The democratization of the society in Bulgaria during and after 1989 had an important impact on the

status of BAS. New BAS Law adopted in 1991 by the Grand Bulgarian Parliament.

The Law established new principles of management, introduced election for all posts comprising the

General Assembly and the Executive Council.

The General provisions in the Law for BAS were further developed in the new Statutes of the BAS,

accepted by The Academy’s General Assembly in July 1992.

Reforms during the 90’s: acting on an initiative of its own the Academy accomplished a very difficult, but

urgently needed reform. Its most important goals were:

- to increase the efficiency of its activities,

- to preserve its first class scientists and

- to strengthen its authority in conformity with the new social and economic requirements.

When formulating the philosophy of the reform, the best was made to reflect most completely the new

needs of the Bulgarian society, the further development of the national scientific schools, the world's

modern practices for the promotion of scientific research, the requirements for the scientific

qualification of the staff, the existing facilities and capital resources of the research units and the

existing possibilities for funding scientific research in Bulgaria.

The result of the reform and the assessment of the research units and individual scientists was that by

1997 the number of the Academy’s research units was reduced by 28%, the total number of the

employees decreased by 6100 individuals, or by more than 42%.

Present: Presently the Bulgarian Academy of Sciences is a national, autonomous non-governmental

organization, combining the functions of a Learned Society and a National Centre for Scientific Research.

It comprises 52 research institutes, 16 research laboratories and centres, a National Museum of Natural

History, a National Archaeological Museum and a National Ethnographic Museum.

Page 10: ESF-ALLEA WORKPLANgeometrie.uibk.ac.at/obsolete/institutsangehoerige/Husty...Chief Executive Unit ESF-ALLEA WORKPLAN For the Review of the Research Institutes of the Bulgarian Academy

Page 10 of 20

Chief Executive Unit

The scientists and scholars holding tenure at these units are less than 3,600, amounting to 16% of all

Bulgarian scientists, but producing more than 60% of the significant scientific output of the country.

The Academy’s Executive Board, its individual members, as well as scientists and scholars from the

research institutes of the Academy are active members of standing advisory bodies , e.g. to the Office of

the President, to the Council of Ministers, to specialized councils of experts convened by ministries or

other governmental or municipal authorities.

The Academy is governed by a General Assembly, a President and an Executive Council.

The General Assembly (GA) is the supreme governing body of BAS. It is composed of senior scientists,

representing the research units of the Academy and elected by secret ballot by the researchers in the

research units. It elaborates, adopts, modifies and amends the Statutes, allocates the budget and is

responsible for the properties and the investments of the Academy. The General Assembly is

responsible for setting up and closing down the research units of the Academy.

The President of the Academy is charged with the responsibility of organizing and supervising the

implementation of all academic activities. The president chairs the Executive Council and the Assembly

of the Academicians.

The Executive Council (EC) is composed of 25 members, elected by the GA. The Executive Council elects

the directors of the scientific units of the Academy. The EC is responsible for the implementation of the

decision of the GA and is also responsible for the assessment of the research units. Directors of research

units are not eligible for membership in the EC. Officers of state and governmental institutions,

universities and other organizations are eligible for the enlarged format of the EC as members entitled

to a deliberative vote. Decisions concerning their membership are taken by the General Assembly. The

chairperson of the General Assembly is ex officio member of the enlarged format of the EC.

The research units of BAS are legal entities performing basic and applied research, postgraduate and

postdoctoral training. Eligible for directors of the research units are senior scholars from any scientific

organization in the country. The directors are elected by the EC for four years.

There are a total number of 69 Research units under 8 Divisions within the Bulgarian Academy of

Sciences. There are:

I. MATHEMATICAL SCIENCES

1- Institute of Mathematics and Informatics

2- Institute of Mechanics

3- Institute for Parallel Information Processing

II. PHYSICAL SCIENCES

1- Institute for Nuclear Research and Nuclear Energy

2- Institute of Solid State Physics

Page 11: ESF-ALLEA WORKPLANgeometrie.uibk.ac.at/obsolete/institutsangehoerige/Husty...Chief Executive Unit ESF-ALLEA WORKPLAN For the Review of the Research Institutes of the Bulgarian Academy

Page 11 of 20

Chief Executive Unit

3- Institute of Electronics

4- Institute of Astronomy with National Astronomical Observatory - Rozhen

5- Central Laboratory of Solar Energy and New Energy Sources

6- Central Laboratory for Applied Physics - Plovdiv

7- Central Laboratory of Optical Storage and Processing of Information

III. CHEMICAL SCIENCES

1- Institute of General and Inorganic Chemistry

2- Institute of Organic Chemistry with a Center of Phyto-Chemistry

3- Institute of Physical Chemistry

4- Institute of Catalysis

5- Institute of Electrochemistry and Energy Systems

6- Institute of Chemical Engineering

7- Institute of Polymers

8- Central Laboratory of Photoprocesses

IV. BIOLOGICAL SCIENCES

1- Institute of Molecular Biology

2- Institute of Neurobiology

3- Institute of Biophysics

4- Institute of Plant Physiology

5- Institute of Genetics

6- Institute of Microbiology

7- Institute of Experimental Morphology and Anthropology with Museum

8- Institute of Experimental Pathology and Parasitology

9- Institute of Biology and Immunology of Reproduction

10- Institute of Botany

11- Institute of Zoology

12- Forest Research Institute

13- Central Laboratory of General Ecology

14- Central Laboratory of Biomedical Engineering

15- National Museum of Natural History

V. EARTH SCIENCES

1- National Institute of Meteorology and Hydrology

2- Geological Institute

3- Geophysical Institute

4- Institute of Oceanology

5- Space Research Institute

6- Institute of Water Problems

7- Geographical Institute

8- Central Laboratory for Geodesy

Page 12: ESF-ALLEA WORKPLANgeometrie.uibk.ac.at/obsolete/institutsangehoerige/Husty...Chief Executive Unit ESF-ALLEA WORKPLAN For the Review of the Research Institutes of the Bulgarian Academy

Page 12 of 20

Chief Executive Unit

9- Central Laboratory of Mineralogy and Crystallography

10- Institute of Solar - Terrestrial Influences

11- Central Laboratory for Seismic Mechanics and Earthquake Engineering

VI. ENGINEERING SCIENCES

1- Institute of Metal Science

2- Bulgarian Ship Hydrodynamics Centre

3- Institute of Computer and Communication Systems

4- Institute of Information Technologies

5- Institute of Control and System Research

6- Central Laboratory of Mechatronics and Instrumentation

7- Central Laboratory of Physico-Chemical Mechanics

VII. HUMANITIES

1- Institute of Bulgarian Language

2- Institute of Literature

3- Institute of History

4- Institute of Thracology

5- Institute of Archeology with Museum

6- Institute of Balkan Studies

7- Ethnographic Institute with Museum

8- Institute of Art Studies

9- Institute of Folklore Studies

10- Cyrillo Methodian Research Center

11- Centre for Architectural Studies

VIII. SOCIAL SCIENCES

1- Institute of Sociology

2- Institute of Economics

3- Institute of Philosophical Studies

4- Institute of Psychology

5- Institute of Legal Studies

6- Centre for Population Studies

7- Centre for Science Studies and History of Science

IX. Specialized and Supporting Units of the BAS

1- Central Administration

2- Central Library

3- Scientific Archives

4- Academic Publishing House "Prof. Marin Drinov"

Page 13: ESF-ALLEA WORKPLANgeometrie.uibk.ac.at/obsolete/institutsangehoerige/Husty...Chief Executive Unit ESF-ALLEA WORKPLAN For the Review of the Research Institutes of the Bulgarian Academy

Page 13 of 20

Chief Executive Unit

5- Botanical Gardens

6- Scientific Information Centre “Bulgarian Encyclopaedia”

7- Center for National Security Research

8- Laboratory of Telematics

9- PhD Training & Career Development Centre

10- Centre for Innovations

Main Strategic Objective of BAS is “to ensure and maintain the highest possible level of science,

interdisciplinarity, international competitiveness and high national self-confidence in agreement with

the needs of the socio-economic and spiritual development of the Bulgarian society and with the

European and world trends of the organization of scientific research.”

In order to achieve this objective it is necessary to:

• Improve the funding of science in Bulgaria both in terms of GDP and national budget share and

the efficiency of funding;

• To support the development of the Bulgarian society;

• To strengthen the national identity, historical, cultural and spiritual values originated by

Bulgarian people on its land;

• To integrate intensively into the European programmes and structures;

• To increase the attractiveness of the scientific career;

• To develop opportunities for scientific communication;

• To improve and modernize the obsolete material basis and equipment;

• To maintain the high level of qualification of Bulgarian scientists;

• To decrease the brain-drain without affecting the mobility of scientists.

Page 14: ESF-ALLEA WORKPLANgeometrie.uibk.ac.at/obsolete/institutsangehoerige/Husty...Chief Executive Unit ESF-ALLEA WORKPLAN For the Review of the Research Institutes of the Bulgarian Academy

Page 14 of 20

Chief Executive Unit

G. EVALUATION PROTOCOL

The evaluation criteria used for this assessment is derived from the protocol adopted by the Dutch

Universities (VSNU), the Netherlands Organisation for Scientific Research (NWO) and the Royal

Netherlands Academy of Arts and Sciences (KNAW) – see [Ref. 6] for more detail on the protocol. The

four assessment criteria outlined below will be used to evaluate the research units based on the

information provided in the Self-Evaluation Reports (SERs) accessible to the members of the Panels as

well as the site visits and the panel’s reviews and deliberations:

Quality (international recognition and innovative potential)

Productivity (scientific output)

Relevance (scientific and socio-economic impact)

Prospects (vitality and feasibility, management and leadership),

At the request of the BAS leadership a scoring system similar to what is shown below will be used:

“A*” for Work that is at the forefront internationally, and which most likely will have an

important and substantial impact in the field. Institute is considered an international leader.

“A” Work that is internationally competitive and is expected to make a significant contribution.

Institute is considered an international player, national leader.

“B” for Work that is competitive at the national level and will probably make a valuable

contribution in the international field. Institute is considered internationally visible and a

national player.

“C” for Work that is solid but not exciting, will add to our understanding and is in principle

worthy of support. It is considered of less priority than work in the higher categories. Institute is

nationally visible.

“D” for Work that is neither solid nor exciting, flawed in the scientific and or technical approach,

repetitions of other work, etc. Work not worthy of pursuing.

Page 15: ESF-ALLEA WORKPLANgeometrie.uibk.ac.at/obsolete/institutsangehoerige/Husty...Chief Executive Unit ESF-ALLEA WORKPLAN For the Review of the Research Institutes of the Bulgarian Academy

Page 15 of 20

Chief Executive Unit

H. TEMPLATE FOR THE SELF EVALUATION REPORTS

Bulgarian Academy of Sciences has invited their research units to submit Self Evaluation Reports (SERs)

based on a template provided in the following pages. The matrix below can be used to identify various

Sections and Annexes of the SERs and their Links to the Evaluation Criteria used for the assessment.

Links of the SER’s sections and annexes to the evaluation criteria

SER sections (S) &

Annexes (A)

Evaluation Criteria

Quality Productivity Relevance Prospects

S I.2 Strong Links Strong Links

S I.3 Strong Links Strong Links

S I.4 Strong Links

S I.5 Strong Links Strong Links

S I.6 Strong Links Links Strong Links

S I.7 Strong Links

S I.8 Strong Links Links Links Strong Links

S I.9 Strong Links

S I.10 Links Strong Links Links

S II.1 Links Links Strong Links

S II.2 Strong Links

S II.3 Links Links Links Strong Links

S II.4 Strong Links Strong Links

S II.5 Strong Links Strong Links

S II.6 Strong Links

A 1 Strong Links Links Links

A 2.(1,2,3) Strong Links

A.2.4 Strong Links Links

A.2.5 Links

A.3 Strong Links Strong Links Strong Links

A.4 Strong Links Strong Links Strong Links Strong Links

A.5 Strong Links Strong Links

A.6 Strong Links

A.7 Links

A.8 Links Links Links Links

A.9 (1,2,3,4) Strong Links

A.9(2,3) Strong Links

A.10 Strong Links Strong Links

A.11 (1,2,3,4,5) Strong Links

A.11.3 Links

A.11 (3,5,6) Strong Links

A.12.1 Strong Links

A.12.2 Strong Links

Page 16: ESF-ALLEA WORKPLANgeometrie.uibk.ac.at/obsolete/institutsangehoerige/Husty...Chief Executive Unit ESF-ALLEA WORKPLAN For the Review of the Research Institutes of the Bulgarian Academy

Self-Evaluation Reports: actual situation based on the period 2004-2008 and prospective development

Section I. Actual situation based on last five years achievements

1. Name of the research unit and date of establishment. Organization chart of the Unit. 2. Areas of activities and/or mission description. 3. Relation of the research areas and topics of the unit with the research policies and programs

approved by the General Assembly of BAS, and with national and/or EU research priorities. 4. Leadership – description based on the Organization chart with the names and titles of all

leaders elected or appointed (directors, deputy directors, scientific secretaries, heads of structural units1 according to the Organization chart, chairperson of the scientific council, etc);

5. Researchers and other personnel. Analysis of personnel and personnel development in the

period 2004-2008. Separate information about the young researchers2. 6. Formal and informal bilateral and multilateral co-operation and relations with other research

establishments: 6.1 within the Academy (examples of complementary and interdisciplinary approaches) , 6.2 at national level (complementary and interdisciplinary approaches; involvement of

university and industrial partners) 6.3 in Europe and world wide ( internationalization of the research; participation in the

construction of European research area; regional collaborations in Central and Eastern Europe). Development in the period 2004-2008; Assessment of the importance of such cooperation;

7. Organization of the research process at the unit: team work, individual research activities,

seminars, quality control, supervision of junior researchers, institutional planning and reporting, description of the internal procedures of evaluation etc.

8. Participation of the unit in different educational activities. Analysis for the period 2004-2008.

Critical assessment of these activities. PhD training should be considered separately and should include critical analysis of the conditions and quality of this training.

9. Services of particular national importance connected to3 :

1 Here and further these are the sub-units of the RU: sections, laboratories, research groups, etc.

2 In the category of the young researchers are those under 35

3 If relevant for the respective RU.

.

Page 17: ESF-ALLEA WORKPLANgeometrie.uibk.ac.at/obsolete/institutsangehoerige/Husty...Chief Executive Unit ESF-ALLEA WORKPLAN For the Review of the Research Institutes of the Bulgarian Academy

A) operation of national, state and governmental institutions and supporting their functioning;

B) different regional initiatives and infrastructures in the country.

10. Overall academic achievements or reputation of the research unit illustrated by all data for the period 2004-2008 with special stress on:

A) up to five most important scientific achievements; B) up to five most important applied results and/or realizations; C) total number of citations appeared in the period 2004-2008. Critical assessment of all data.

Section II. Strategy and policies for future development 1. Envisaged development of research subjects and plans in short and long term including the

perspectives for the future strengthening of interdisciplinary co-operations within Academy, at national level and internationally (in Europe and worldwide).

2. Actual personnel policy as basis for personal development policy including both plans for

improving PhD training schemes and PhD personnel recruitment. 3. Financial situation. Sources of finance: budget subsidy, additional sources- public, private,

international; cash flow and acquired or donated material assets (indirect, in kind and other type of individual support as for ex. through the international bilateral cooperation should not be considered); strategy and policy for attracting more funding.

4. Critical assessment of the current structure of the research unit with the view of its future

development. 5. Innovation potential of the research unit – patents, advanced technologies, prototypes,

applications, perspectives for strengthening the relations with industry and/or other sectors important for the economic development of the country4. Critical assessment and future plans.

6. Short view of the perspectives of the unit emphasizing its position within the research

structure and the strategic views of BAS. Suggestions of what has to be done to meet the expectations of the society for the future role of the Academy.

The statements of the self-evaluation report should be supported by evidence that is

contained in the annual reports of the research units. This evidence has to be presented in accordance with the 12 annexes to this report or added in the tables related to annexes 1, 6, 7, 8, and 11.

4 If relevant for the respective RU

Page 18: ESF-ALLEA WORKPLANgeometrie.uibk.ac.at/obsolete/institutsangehoerige/Husty...Chief Executive Unit ESF-ALLEA WORKPLAN For the Review of the Research Institutes of the Bulgarian Academy

ANNEXES TO THE SELF-EVALUATION REPORT

COMPRISING THE PERIOD 2004-2008

Annex1: Table of the research projects for the period 2004-2008. Annex 2: List of the publications of the research scientists split up as follows:

2.1. Papers published in science journals 2.1.1 Abroad 2.1.2. In Bulgaria 2.2. Papers published in full text in congresses and symposia proceedings, as well as in thematic/subject collections 2.2.1.Abroad 2.2.2.In Bulgaria 2.3. Scientific books published 2.3.1.Abroad 2.3.2. In Bulgaria 2.4. Text-books and other training aids 2.5. Popular science and other papers for general public 2.5.1. books and brochures 2.5.2. articles

The list of publications has to be split up by types of publication as enumerated above, and the numbering in each paragraph has to start from 1.

The description of each paper published has to comprise: names of the authors, title of the journal, proceedings or collections, volume, issue, pages from-to, year. All data concerning papers published in Bulgarian have to be translated into English, marking “in Bulgarian” between brackets.

The description of each book published has to comprise: authors, title, publishing house, city, year, total number of pages, illustrations and figures. All data concerning books published in Bulgarian have to be translated into English, marking “in Bulgarian” between brackets.

Annex 3: List of scientific products ready to be implemented in industry. Annex 4:Table of the scientific products, inventions and patents produced over the period 2004-2008, presented within the following columns: heading, registration number of the patent, etc., user, mode of participation of the scientific unit in the implementation, mode of realization (e.g. marketing, implementation, etc.), effect of the realization, transfer of technologies under contracts with industry. Annex 5: Patent-license activities, including individual patents of scientists of the Unit registered over the period 2004-2008. The results have to be presented in tables:

Page 19: ESF-ALLEA WORKPLANgeometrie.uibk.ac.at/obsolete/institutsangehoerige/Husty...Chief Executive Unit ESF-ALLEA WORKPLAN For the Review of the Research Institutes of the Bulgarian Academy

5.1 Support of protection documents: Columns: authors, headings, participation of external organizations and private persons participating in the support; income from license realization broken down by years. 5.2. Applications for protection documents under way: Columns: authors; names; countries; 5.3. Protected patents and licenses, introduced in our country and abroad during the period; Columns: authors; names; countries; revenues from licensing realization so far by year.

Annex 6: Information about the regular personnel of the unit by 31 December 2008 according to the attached form. Annex 7: Information about the distribution of the regular personnel of the unit in age groups according to the attached form. Annex 8: Information about the PhD students in the unit by year for the period 2004-2008 and the state by 31 December 2008 according to the attached form. Annex 9: Tables presenting the participation of scientists from the unit in teaching and training: 9.1. In institutions of higher education:

9.1.1. Lectures and specialized classes: Columns: subject or topic; lecturer, degrees and titles; institution of higher education; total number of academic hours for the academic years. This information should be presented by year for the period 2004-2008 and as a whole for the period. 9.1.2. Practices and seminars: Columns: subject or topic; lecturer, degrees and titles; institution of higher education; total number of academic hours for the academic years. This information should be given by year for the period 2004-2008 and as a whole for the period; 9.1.3. students preparing their bachelor or master theses - numbers by institutions of higher education. This information should be given by year for the period 2004-2008 and as a whole for the period.

9.2. Post-graduate training and specialization courses: Columns: subject or topic; supervisor (lecturer), degrees and titles; place of delivering; total number of academic hours for each year. This information should be given by year for the period 2004-2008 and as a total for the period; 9.3. Schools organized by the unit: topic, total number of participants, including those from abroad, total number of lecturers, including those from abroad. This information should be given by year for the period 2004-2008 and as a total for the period. 9.4. List of contracts and agreements with institutions of higher education and scientific organizations in the country. This information should be given as a whole for the period.

Page 20: ESF-ALLEA WORKPLANgeometrie.uibk.ac.at/obsolete/institutsangehoerige/Husty...Chief Executive Unit ESF-ALLEA WORKPLAN For the Review of the Research Institutes of the Bulgarian Academy

Annex 10: Information about the expert activity of the scientists and the specialists with higher education from the unit:

10.1. List of councils, commissions and other expert bodies of external for BAS institutions (governmental and non-governmental), foundations, organizations, publishing houses and others, where scientists and specialists from the unit are participating. This information should be given as a total for the period.

Annex 11: Information about the international activity of the unit according to a questionnaire applied. This information should be given as a total for the period. Annex 12: List of scientists from the unit, participating in editorial boards. This information should be given as a total for the period:

12.1. of journals in Bulgarian (the journal has to be indicated) 12.2. of journals abroad (the journal has to be indicated)

ATTENTION: Each section, table or annex to the Report should start with a heading containing the name of the respective research unit. In all tables, the numbers, resources etc. should be summed up by year and as a total for the period 2004-2008.