Institute for Information Institute for Information Problems of the Russian Problems of the Russian

academy of Sciences and academy of Sciences and its linguistic researchits linguistic research

Olga KozhunovaOlga KozhunovaCML-2008, Becici, 6-13 CML-2008, Becici, 6-13

SeptemberSeptember

The The Institute for Informatics Institute for Informatics Problems of the Russian Problems of the Russian Academy of Sciences (IPI RAN)Academy of Sciences (IPI RAN) was founded in 1983 with a goal was founded in 1983 with a goal of conducting fundamental and of conducting fundamental and applied research in the area of applied research in the area of hardware and software for mass hardware and software for mass application and in the area of application and in the area of relevant computer systemsrelevant computer systems

The Institute is a member of the The Institute is a member of the Department of Information Department of Information technologies and Computing technologies and Computing Systems of the Russian Systems of the Russian Academy of SciencesAcademy of Sciences. IPI RAN . IPI RAN has 22 departments and has 22 departments and laboratorieslaboratories

Our Our Department of Information Department of Information Technologies for Data Structuring Technologies for Data Structuring and Retrievaland Retrieval supports several supports several linguistic projects, namely:linguistic projects, namely:

• ““Intertext: a multilingual knowledge Intertext: a multilingual knowledge base for machine translation” base for machine translation”

• ““Semantic dictionary for Monitoring Semantic dictionary for Monitoring system of the Russian Academy of system of the Russian Academy of Sciences: evaluating for institutional Sciences: evaluating for institutional R&D activities”R&D activities”

In 2007 an experiment on assessment In 2007 an experiment on assessment researchers’ performance in the researchers’ performance in the Russian Academy of Sciences was Russian Academy of Sciences was carried outcarried out

In order to fulfil the evaluation task of In order to fulfil the evaluation task of the experiment for my Institute a the experiment for my Institute a Monitoring system has been Monitoring system has been designed and implementeddesigned and implemented

One of the components of the One of the components of the Monitoring system is Semantic Monitoring system is Semantic dictionarydictionary

It’s necessity is motivated by problems It’s necessity is motivated by problems arisen at the period of monitoring arisen at the period of monitoring and evaluation of the researchers’ and evaluation of the researchers’ performance heldperformance held

The problems dealt with absence of The problems dealt with absence of unambiguous terms’ definitions and of unambiguous terms’ definitions and of common understanding of their common understanding of their meanings by experts of the Monitoring meanings by experts of the Monitoring systemsystem

This strongly defined the structure of the This strongly defined the structure of the dictionary: it contains links to dictionary: it contains links to normative, informative, algorithmic, normative, informative, algorithmic, and other components of the and other components of the Monitoring system Monitoring system

Dictionary’s architecture is based on Dictionary’s architecture is based on classification scheme, in which classification scheme, in which indicators of researcher’s indicators of researcher’s performance been integratedperformance been integrated

When designing Semantic dictionary, When designing Semantic dictionary, several aspects were taken into several aspects were taken into account:account:

• Normative documents rarely contain Normative documents rarely contain indicators’ definitionsindicators’ definitions

• Sometimes indicators are differently Sometimes indicators are differently understood by expertsunderstood by experts

• There are indicators depending on There are indicators depending on several parameters (for example, several parameters (for example, values of citation indexes depend on values of citation indexes depend on the set of scientific papers analyzedthe set of scientific papers analyzed) )

• Numeric values of indicators may Numeric values of indicators may depend on the amount of elements depend on the amount of elements in normative files and their contentsin normative files and their contents

For example, values of citation indexes For example, values of citation indexes depend on the list of journals useddepend on the list of journals used

• Aspects mentioned were taken into Aspects mentioned were taken into account when elaborating the account when elaborating the procedure of indicators’ meanings procedure of indicators’ meanings clarificationclarification

• The procedure was brought out in The procedure was brought out in two stages: integration of an two stages: integration of an indicator into classification scheme indicator into classification scheme and its definition and clarificationand its definition and clarification

Examples of indicators:Examples of indicators:

• Invited reports on International Invited reports on International conferencesconferences

• PatentsPatents• Russian citation indexRussian citation index……………………………………………………..

Thank You for Your Thank You for Your attention!attention!