Upload
others
View
6
Download
0
Embed Size (px)
Citation preview
Research evaluation and academic publishing
Marina Carbonell Biblioteca d’Humanitats Juny 2014
Credits • Some slides are extracted and contents are the
following educational materials:
Bibliotecnia. UPC La publicació i avaluació de la recerca.
[Presentacions]. [Consulta 29.05.14] Disponible a:
http://www.slideshare.net/
Alexandre López-Borrull, UOC (Jul 21, 2011). Articles i
Revistes Científiques a Internet. [Presentacions]. [Consulta
29.05.14] Disponible a: http://www.slideshare.net/
Contreras, Núria. Eines de suport a l'acreditació i
avaluació de la recerca [Presentacions]. [Consulta 29.05.14] Disponible a: http://ddd.uab.cat/
3
What does it involves?
• Authors and their new ideas.
• Dissemination and impact of these ideas.
• Value of the publications in which these ideas are published.
Research evaluation
4
• Of an article: number of citations in academic journals
• Of an author: h-index
• Of a journal:
• Observance of quality criteria, ex. Latindex / DICE
• Appearance in databases, ex. Arts and Humanities Citation Index, Bibliographie Linguistique, and derived calculations, ex. ICDS (MIAR)
• Calculations based on the number of citations, ex. JCR impact factor, SJR (SCIMAGO), etc.
Impact factors
5
Impact factors of an article
• Web of Science:
• Searching that article using the Cited Reference Search option on http://www.accesowok.fecyt.es/
• SCOPUS: Searching that article on http://www.scopus.com
•Citeseer http://citeseerx.ist.psu.edu/
•Citebase Search: use with prudence http://www.citebase.org/
•Google Scholar http://scholar.google.es/
6
Appearence on social networks
• The influence of an article can be appraised through its impact on popular social networks (Twitter, Facebook, LinkedIn, etc.) as well as academic ones (Mendeley, ResearchGate, Academia.edu, etc.). In this case some Altmetric tools can be used.
• Altmetric indicators can be obtained using applications for web browsers, mobile devices or bibliographic databases.
Impact factors of an article
7
Impact factors of an author
h-index
•It’s based on the author’s most cited papers and the number of citations of each of these papers. It’s the only index that focuses on the author and not on his/her articles.
How is it calculated?
•It can be calculated by listing the articles according to the amount of citations in descending order. Each article is assigned a correlative number. The point in which the assigned number is the same or greater than the number of citations is called the h-index.
Where to look it up?
•Web of Knowledge www.accesowok.fecyt.es/login/ (UAB network)
By searching the author on Web of science and selecting Create citation report.
•Scopus www.scopus.com/ (UAB network)
By searching the author on Author search and selecting View citation overview (Only from 1996 on.)
8
1.- Enter Web of Science: http://www.accesowok.fecyt.es/login/
2.- Search the articles by an author. The h-index can be applied to any list of articles. For instance, academic papers by Prof. Antonio Armario:
h-index on WoK (I)
9
3.- Click on this icon:
h-index on WoK (II)
10
4.- Look up the h-index on the citation report.
h-index on WoK (III)
11
5.- In this example the h-index is 28. Following the list of articles in descending
order of citations we find a orange line. This indicates that the article appearing in the 28th position has 28 citations or more.
h-index on WoK (IV)
12
The quality of academic journals is usually appraised through their impact according to the following criteria:
• Impact factor (or impact index) • Immediacy index • Quartile • SJR (SCImago Journal Rank) • SNIP (Source Normalized Impact per Paper)
Impact factors of a journal
13
What is it?
• It indicates the impact of a journal on academic literature through the number of citations its articles have.
How is it calculated?
• Number of citations within one year for the articles published in a journal the previous 2 years divided by the total number of articles published in that journal these previous 2 years.
Example:
Number of citations in 2012 for articles published in 2010 and 2011
Impact factor 2012 = __________________________________________________
Number of articles published in 2010 and 2011
What is it for?
- To compare journals on a specific field.
- To set up rankings and reflect the relative relevance of any title.
- To make decisions, as it is used to appraise the quality of a journal and has great influence.
Impact factor
14
Where to look it up?
•Journal Citation Reports (JCR) – Social sciences edition
www.accesowok.fecyt.es/login (UAB network)
•IN-RECS (Índice de impacto-Revistas españolas de ciencias sociales) ec3.ugr.es/in-recs
•RESH (Revistas Españolas de Ciencias Sociales y Humanidades) epuc.cchs.csic.es/resh
Impact factor
15
What is it?
It is an indicator to evaluate the relative relevance of a journal amongst the whole set of journals within an academic field.
How is it calculated? If a list of journals in descending order according to their impact factor is divided in four equal parts, each part is called a quartile. The journals with a higher impact factor are in the upper section (quartile 1) while the ones with a lower factor are at the bottom section (quartile 4). Quartiles 2 and 3 are in the middle. For instance, in a list containing 100 titles, quartile 1 contains the 25 titles with a higher impact factor, which are therefore most appreciated by researchers.
Where to look it up? Journal Citation Reports (JCR)
IN-RECS i IN-RECH
Quartile
16
What is it?
It indicates the speed an article is cited and the frequency of citations of a journal within one year time. A high immediacy factor means that journal publishes leading articles.
How is it calculated?
It is calculated dividing the number of citations of the whole set of articles of a journal published within one year by the total number of articles published within that year.
Where to look it up?
Journal Citation Reports (JCR)
Immediacy index
17
To search the impact index of the following journal: Language in Society
1.- Enter Web of Science: http://www.accesowok.fecyt.es/jcr
2.- Select JOURNAL CITATION REPORTS (JCR)
Impact factor of a journal on JCR (I)
18
4.- Select edition and year and “Search for a specific journal”.
5.- Although any field can be used, ISSN is recommended.
Impact factor of a journal on JCR (II)
19
6. - Click on the title to access all the related information.
7.- The immediacy index is provided as well.
8.- Click on the link and then on “Journal ranking”.
Impact factor of a journal on JCR (III)
20
9.- Quartile is provided here.
Impact factor of a journal on JCR (IV)
21
SJR (SCImago Journal Rank)
What is it?
• It reflects the prestige of a source, according to the idea that “not all citations are equal”. With SJR research field, quality and reputation of a journal have a direct impact on the value of a citation. That means that a citation in a source with a high SJR index has more value than a citation in a source with a low SJR.
How is it calculated? • It is calculated using the PageRank algorithm (created by Google).
Where to look it up? • Scopus : www.scopus.com (UAB network). See Analytics.
22
SNIP (Source-Normalized Impact per Paper)
What is it? • It indicates the contextual impact of each citation in
relation to the entire amount of citations in a specific field.
How is it calculated? • The impact of a citation is assigned a higher value in
those fields with lesser frequency of citations and viceversa.
Where to look it up? • Scopus www.scopus.com (UAB network). See
Analytics.
23
1.- Enter Scopus: http://www.scopus.com
2.- Click on Analyze Journals
3.- Search Translation review
SCOPUS (I)
24
4.- Scimago Journal Rank (SJR) and related qualitative data are provided here.
SCOPUS (II)
25
SCOPUS (III)
26
Entities that evaluate and certify research
• CNEAI (Comisión Nacional Evaluadora de la Actividad Investigadora)
• ANECA (Agencia Nacional de Evaluación de la Calidad y Acreditación)
• AQU (Agència per a la Qualitat del Sistema Universitari de Catalunya)
27
Índexs i Bases de dades que valoren la investigació
http://www.bib.uab.cat/human/acreditacions/planes/publiques/index.php
28
29
30
31
RETI/REAO In these pages you will find a list of academic journals in this area of knowledge with the quality indicators of the different resources evaluated by the accrediting bodies: AQU, ANECA and CNEAI. We have added more information, including links to various bibliographic catalogs, the requirements for the publication of articles
according to the publisher and the permissions for self-archiving. http://www.bib.uab.cat/human/acreditacions/planes/publiques/revistes/eti.php?area=eti&menuidioma=eng
32
33
34
35
36
• Scientific publication must be original and contribute something new to a scientific discipline.
• Scientific publication provides recognition. It is the only way to obtain the approval of the scientific community and the admission as a scientist. It is also the only way to ensure that science reaches the next generations of scientists.
• The fact that scientific publications are reviewed and following a peer-review process determines the articles presented, which pretend to discourage reviewers by providing a detailed section on methodology and sources of information.
Scientific publication
37
Current research
Get teams working on the same issues
Suggestion for a later article
Limited diffusion
Create a network of affinities
Completed research
Wide circulation among the academic community
Publish original research for the 1st time
The most recognized of scientific papers
Traditional publishing models
Presentation at a congress
Article in a journal
38
1. Choose a topic relevant, original and interesting today.
2. Search for partners (if possible, international).
3. Make a work well written, well organized, well presented...
4. Make a good bibliographic review (international, current...).
5. Select the appropiate journal.
6. Follow the instructions to authors of the journal.
7. Ask the opinion of colleagues.
8. Publish it also in institutional and academic repositories.
9. Spread the work with Web 2.0 tools.
10. Manage your digital identity correctly.
What to consider when publishing:
39
• Title (informative) • Signatories (appointment and contact details) • Summary • Keywords • Introduction • Methodology • [Body] • Results and conclusions • Bibliographic references
Structure of a scientific article
40
• Scientific journals are not all equal...
• ... And when choosing a scientific journal take into account...
– Prestige Dissemination and impact International scope Presence in databases Distribution Thematic scope
Speed of publication Membership in an association Review process Works property, OA (journal, deposit)
Choose the journal
Swan, A. What authors want: the ALPSP research study on the motivations and concerns of contributors
to learned journals. Learned publishing 1999; 12(3): 170-172
41
Process of an article
eprint preprint
postprint reprint
42
As part of research the author of the article:
• Writes the article
• Searches for a journal in which to publish
• Is submitted to the review process
• In case of acceptance
– Reviews the text and makes the appropiate changes in content and/extension
– Adjusts the text to the editorial standards
• Delivers the document in due time
• Makes a celebration !!
Process of publication
43
• Beware of the title, the summary and the first pages. They are crucial because the publishers have to choose the reviewers.
“First impressions are strong impressions; hence, the title should be well studied and give; insofar as permitted by the limits, a clear and concise indication of things to come.” T. Clifford Allbutt
• Take a look at the members of the editorial board.
• Respect scrupulously the instructions for authors
• Check the style of your thecnical and scientific text
Advises
44
It is essential to cite sources but also: • It should be done well and in a standardized way (ISO
690, APA, Chicago, MLA...)
Why? • For readers to be able to find the referenced sources
• Because the ref. are cited and used in the indexes (network of relationships among articles)
Bibliographic references
45
Peer review system
Reception of the article
Preliminary selection
Peer Review
Collects reviews
The author modifies the article
Article refused
Article accepted
Publication of the article
Janette K. Klingner, David Scanlon and Michael Pressley. How to Publish in Scholarly Journals Educational Researcher November 2005 34: 14-20
Submitting the results of an investigation
46
• Once the editorial board admits a work which meets the general conditions of the magazine:
• Internal review (experiences, resources evaluation works, etc.)
• External review (of the articles) by a Scientific Committee or Advisory Counsel
• External review:
• Peer-review system (review by experts or arbitration):
– Open review (the evaluators’ names are known)
– Double-blind system (both the evaluators and the author are kept anonymous)
How do magazines evaluate the articles
47
The results of the external review can be:
• It’s unconditionally accepted
• It’s accepted but with the condition of some changes or improvements
• It’s refused but the author is encouraged to review it soundly
• It’s unconditionally refused
How do magazines evaluate the articles
48
It’s not an irrevocable decision
DO INSIST
What if your article is refused?
49
• Open access magazines
• Institutional repositories
• Blogs
• Podcasts
• Wikis ...
New models of publication
50
Access to scientific
information without barriers
51
What is open access? Access to scientific information without barriers
Open Access (OA) to scientific information consists of deposit research production
in the net freely and free of charge as an alternative to the model of paying for
access to information generated by the own institutions.
52
• Copyright
• Thinking that open access magazines don’t
have an impact factor
• Also thinking that they don’t have a review
process (‘peer review’)
• Fear of plagiarism
• Not knowing about the existence of the diposit
and the procedure
• Losing time
The brakes
53
• More visibility for authors and for institutions.
• Guarantees the preservation and conservation.
• Favors the impact of research results.
• Stable computing environment
• Platform to host unpublished documents
• Fix URL
• Standardized and interchangeable description
• Full text search
• Grouping of own scientific production in full text
• Benefits for the scientific community
• Customized statistics
The advantages
54
Intellectual production of the researcher: copyrights
• You must manage correctly the copyrights of your works. Controling them will facilitate their open publication and its diffusion by different means, therefore increasing the visibility and impact of the results of your research.
• From the very moment of the creation of a scientific article, law guarantees your rights as an author and you are the owner of these rights. As such, you have control over the possible uses of your work.
55
Copyrights
Author
Connected
Moral rights: Being recognized as the author
Exploitation: • Copy • Distribution • Public communication • Transformation • Remuneration for private copy
A. Rights
Intellectual property
56
Relationship publisher-author or viceversa
• Publishers of scientific magazines will require you to post your article that you cede your exploitation rights by means of a written contract. This cession can be exclusive.
• If you cede your rights exclusively, you will have to ask permission from the publisher to make any change on your article.
57
So, if you want to reuse your article, you must:
• Know the contracts and aggreements about rights established by the publishers.
• These aggreements are not standardized and you won’t find them easily in the publishers or magazines’ web pages. It’s more usual to find them with the guidelines for the author, that you may find in the publisher page under the following epigraphs : author’s side, author’s rights, publicaen, etc.
58
How to know the publisher’s policy:
Sherpa-Romeo: Publisher copyright policies, specially
abroad and self-archiving. (International Journal of Advertising, Sage Publications)
Dulcinea: Publisher policies about patrimonial rights and self-
archiving permissions of Spanish science and law magazines. (Comunicación y sociedad, Creatividad y sociedad)
Héloïse: Publishers policies about self-archiving of magazines,
specially French (Documentaliste-Sciences de l’information)
59
Publishing in open access • Thanks to initiatives as open access, many publishers
now let the authors to post copies of their articles in their personal web pages. Or to deposit them in digital archives known as deposits or repositories, where people has an open access to them through Internet
• The two main types of deposit are: – institutional deposits, which get all the scientific production
from a university or research center : DDD (UAB) – thematic deposits, which give access to works of authors from
different institutions, specializing in one or more disciplines
60
• When an author deposits an article or any other work in one of those archives, that’s called self-archiving
• Based on the conditions established by the publishers, the author can self-archive different versions of his/her article, the preprint which still has not been reviewed, or the postprint, the article after the peer-review. In this last case, you can use both the author’s version or the publisher’s version on pdf
Self-archiving
61
• If you, as an author, don’t aggree with the conditions established by the publisher in the aggreement he/she asks you to sign, you can negotiate with him/her by means of an addendum describing the rights you want to retain, ask your publisher to accept a modification in the aggreement about the policy of self-archiving.
Examples: • Scholar Copyright Addendum Engine: scholars.sciencecommons.org
• Science Commons (CC)
• Model amendment to publishing agreement (Open access in FP7)
Addendum
62
Open access magazines
• Some publishers, and there’s more of them every day, give open access to their magazines through the Internet and use to let the authors keep all their rights. They are known as open access magazines. Some of them permit the reuse of the articles with minimum restrictions, for instance, the articles can be translated without asking permission.
63
Paying to publish in open access...
• Some publishing companies offer to publish articles in open access if the authors pay a certain amount. The UAB offers aid for open access publishing in this type of magazines. You could consult the Cercador d'ajuts, beques i convocatòries. : Cercador d'ajuts, beques i convocatòries: http://www.uab.cat/servlet/Satellite/beques-i-ajuts-1276168992788.html
64
Copyright Copyleft
We can make some reserved actions under some conditions.
“All rights reserved”
We can’t use the work without permission.
“Some rights reserved”
65
Creative Commons licenses
After choosing one of these licenses (http://creativecommons.org/choose) a code will be generated that you must insert in your digital publication
67
DOAJ • Certain publications publish openly their contents. You
could consult DOAJ (Directory of Open Access Journals) to know these publications: http://www.doaj.org
•Consult E-revistas or Redalyc to know journals in context Hispanic. We recommend you the REDI service of the UAB.
68
• Some publishing companies that publish wholly or partly in open access: http://www.scielo.org
• Dialnet http://dialnet.unirioja.es
• Openj-gate http://www.openj-gate.com/Footer/About.aspx
• Hindawi http://www.hindawi.com
• Medknow http://www.medknow.com
• Highwire Press http://highwire.stanford.edu/cgi/search?quick=true
• Bentham http://www.bentham.org/open/index.htm
• J-stage http://www.jstage.jst.go.jp/browse
In open access journals
69
ddd.uab.cat
What and where can we publish?
70
Source: http://repositories.webometrics.info of CSIC. July 2012. Total: 1522 repositories.
Spain’s 1st, Europe’s 4th and world’s 10th
71
Increase its impact!
• Check that the article has been correctly indexed in the relevant databases.
• Follow the authors that have quoted you.
• Deposit the e-print in the UAB’s institutional deposit (DDD).
• Promote your work with the tools 2.0
What to do once the article has been
published?
72
Moltes gràcies!
Contacte:
Ana Lopo
Gestora de Suport a la Docència i la Recerca
Correu-e: [email protected]
Biblioteca d’Humanitats (UAB)