Embed Size (px)
Citation preview
www.gu.se
Håkan Carlsson
Gothenburg University Library
Bibliometrics – A Tool in the Evaluation of Science
www.gu.se
Table of Contents
• Introduction and definition• Different applications of bibliometrics• Bibliometric indicators• Financial allocaton models based on bibliometrics• Conclusions
www.gu.se
What is bibliometrics?
Definition:
“"Bibliometrics can be defined as the quantification of bibliographic
information for use in analysis “– Garfield
Statistical bibliography
www.gu.se
• Authors
• Affiliation
• Source (journal)
• Title, Abstract, Keywords
• Year
Metadata
www.gu.se
• Authors
• Affiliation
• Source (journal)
• Title, Abstract, Keywords
• Year
• References
Metadata
www.gu.se
Major areas of bibliometric research
• Fundamental statistical relationships• Citation analysis• Publication indicators for evaluation purposes
www.gu.se
Statistical Metods
Pioneer: Derek de Solla Price
1963: Little Science, Big Science
”We can say that 80 to 90 percent of all the
scientists that have ever lived are alive now”
www.gu.se
www.gu.se
Power-law
www.gu.se
Lotka’s Law
Antal författare med ett visst antal publikationer
0
2000
4000
6000
8000
10000
12000
14000
16000
0 20 40 60 80 100
Antal publikationer
An
tal
förf
atta
re
Serie1
www.gu.se
www.gu.se
Rosvall M, CT, Maps of Information Flow Reveal Community Structure In Complex Networks
www.gu.se
Why Publish?
www.gu.se
Research evaluation indicators
• Production (number of publications, number of collaborators, …)• Demand, Impact, Quality (number of citations, number of publications
in quality channels, …)• Excellence (compared to the field, ratio top5% cited publications)• Collaboration (network properties estimated by co-authorships)• Internationalization (number of publications in international
journals, number of international collaborators)• Interdisciplinarity (number of publications in channels in other
fields or with co-authors from other fields) • …
Changes over time or in comparison with the field or specific others
www.gu.se
Producation-Based Indicators
• Straight-forward and fast• Time, organisational and document-type limitations• Fractionalisation
www.gu.se
1985 1990 1995 2000 20050
500
1000
1500
2000
Ant
al p
ublik
atio
ner
Karolinska inst.
Chalmers
Göteborgs univ.
Linköpings univ.
Luleå tekn. univ.
Lunds univ.
Kungl. tekn. högsk.Stockholms univ.
SLUUmeå univ.
Uppsala univ.
Övriga
Publications (fractionalized, source: Web of Science/VR)
www.gu.se
0,0
200,0
400,0
600,0
800,0
1000,0
1200,0
Busin
ess,
Econo
mics
and
Law
Facult
y of
Arts
IT F
acult
y
Fine A
pplie
d an
d Per
form
ing A
rts
Facult
y of
Science
Sahlgr
ensk
a Aca
demy
Facult
y of
Social S
cience
s
Facult
y of
Educa
tion
2004
2005
2006
2007
2008
2009
Fractionalized publications Gothenburg University (research articles, chapters, books) GUP Februray 2010
www.gu.se
How do we publish?
www.gu.se
Citation-based indicators
• Paying homage to pioneers.• Giving credit for related work (homage to peers).• Identifying methodology, equipment, etc.• Providing background reading.• Correcting one's own work.• Correcting the work of others.• Criticizing previous work.• Substantiating claims.• Alerting to forthcoming work.• Providing leads to poorly disseminated, poorly indexed, or uncited work.• Identifying original publications in which an idea or concept was discussed.• Identifying original publications or other work describing an eponymic concept
or term.• Disclaiming work or ideas of others (negative claims).• Disputing priority claims of others (negative homage).
Why cite?
www.gu.se
Average citation per publication type and year (Source: Web of Science/VR/2008)
www.gu.se
Citation rate of different fields (source: VR)
www.gu.se
Citation window
0 5 10 15 20 250
5
10
15
20
Ant
al c
iterin
gar
(% a
v su
mm
a)
År efter publicering
EngineeringEnvironmental studiesPsychology, biologicalSociology
www.gu.se
Field normalized citation (”crown indicator”)
CPP (cites per publication) _____________
FCS (Field Citation Score)
world average for a specific field,
year and article type
’
www.gu.se
Endocrinology Letter 2003
CPP (cites per publication) 10_____________ ________
FCS (Field Citation Score) 10
world average for a specific field,
year and article type
CPP/FCS 1
Field normalized citation (”crown indicator”)
www.gu.se
Endocrinology Letter 2003 Oncology Review 2004
CPP (cites per publication) 10 20_____________ ________ ________
FCS (Field Citation Score) 10 40
world average for a specific field,
year and article type
CPP/FCS 1 0,5
Field normalized citation (”crown indicator”)
www.gu.se
Field normalized citation score, 1986-2006
Source: Swedish production of highly cited scientific publikactions (VR, 2010)
www.gu.se
Allocation Systems for University Funding
www.gu.se
• Publications in the database Web of Science (WoS) are aggregated for each university
• Number of publications and number of citations to the publications are normalized and multiplied together to form the publication indicator
”The Swedish Model”
www.gu.se
Coverage GUP in WoS, Scopus and Scholar
www.gu.se
”The Norweigan Model”
Publications (books, articles, book chapters) are registered in a national database by the researcher
A quality indicator is added where extra credit is given to publications in certain publication channels (i.e. journal or publisher determines the extra credit)
Publication type Level 1 Level 2
Article 1 3
Book chapter 0,7 1
Book 5 8
www.gu.se
Local Developments
• The university has decided to allocate part of its funding to the faculties based on publications in GUP and external funds.
• Faculties have made similar decisions:- Humanities- Social sciences- Medicine- Science- Business school
• New inquiry may give new system
www.gu.se
What can we learn?
• What have you learned from this session that you would bring back and tell a colleague?
• How would you think strategically about your own publications?
• Journal choice (target audience, indexing, Web of Science)• Visibility (access, promotion, personal webpage)
www.gu.se
