34
Workshop How to get peer reviewed Facultat de Biblioteconomia i Documentació, Universitat de Barcelona Barcelona, 20 June 2011 Remedios Melero

How to get peer reviewed

Embed Size (px)

DESCRIPTION

Presentació realitzada per Remedios Melero en el marc del Seminari sobre la revisió per experts (peer review) que va tenir lloc a la Facultat de Biblioteconomia i Documentació de la UB el 20 de juny de 2011, dins el marc del programa de doctorat “Informació i Documentació en la Societat del Coneixement”. Aquest seminari va ser organitzat conjuntament amb l'EASE (European Association of Science Editors).

Citation preview

Page 1: How to get peer reviewed

Workshop

How to get peer reviewed

Facultat de Biblioteconomia i Documentació, Universitat de Barcelona

Barcelona, 20 June 2011

Remedios Melero

Page 2: How to get peer reviewed

Peer review is both a set of mechanisms for evaluating and assuring the quality of research before and after it is funded or published.

It involves subjecting research proposals and draft presentations, papers and other publications to critical evaluation by independent experts (peers).

The reviewers are usually appointed by the funding body or the editors of a journal or other formal channel for communication to which the work has been submitted.

Page 3: How to get peer reviewed

A peer review guide for researchers.

www.rin.ac.uk/peer-review-guide

Page 4: How to get peer reviewed

Scheme from NECOBELAC PORTAL

It is up to the journal editor to decide which system would best ensure scientific integrity (editorial policy) and cooperation. Once a policy is chosen, it should be made clear in the instructions to authors and reviewers.

Page 5: How to get peer reviewed

Comments and data about the effects of open peer review

Page 6: How to get peer reviewed

http://www.bmj.com/content/341/bmj.c5729.full

Conclusion Telling peer reviewers that their signed reviews might be available in the public domain on the BMJ’s website had no important effect on review quality. Although the possibility of posting reviews online was associated with a high refusal rate among potential peer reviewers and an increase in the amount of time taken to write a review, we believe that the ethical arguments in favour of open peer review more than outweigh these

disadvantages.

Page 7: How to get peer reviewed

Scheme from NECOBELAC PORTAL

Page 8: How to get peer reviewed

Peer review does not mean

I like it

Or

I do not like it

Peer review does not mean

I accept it

Or

I do not accept it

Page 9: How to get peer reviewed

Reviewer’s tasks

• Evaluate the content (rigor and originality) of work

• Advise the editor in making decisions about the publication of the work

• Detection of malpractices/missconduct

Page 10: How to get peer reviewed

• The journal needs your scientific expertise, not your editorial assistance

• Some editorial comments are appropriate

• Focus on the science

• The reviewer should consider the appropriateness of the paper for the journal

• The reviewer must also consider whether the paper meets the standards of the journal

What reviewers should focus on:

Extracted from: Ethics of Peer Review: Guide for Manuscript Reviewers Overview by Sara Rockwell (avilable at http://radonc.yale.edu/research/ethics.aspx )

Page 11: How to get peer reviewed

The reviewer is generally ask consider and comment on a variety of issues, including

• The importance and novelty of the work

• The appropriateness of the materials, methods and experimental model systems

• The rigor of the experimental design (including the inclusion of appropriate controls)

• The quality of the data

• The appropriateness of the statistical analyses

• The rigor of the interpretation of the data

• The value of the discussion of the data

• The validity of the conclusions drawn in the paper

Page 12: How to get peer reviewed

The reviewer may also be asked to comment on

• The length of the paper• The writing quality • The clarity, accuracy, and completeness of the figures and tables• The accuracy and adequacy of the introduction which frames the area of the research, of the discussions of prior and related work, and of the citations to the literature

Page 13: How to get peer reviewed

How to select a reviewer…..Adviceable to have criteria for the selection of reviewers

It is recommended that journals monitor the performance of theirreviewers periodically

A checklist for reviewer evaluation will help in choosing more effective and helpful reviewers in the future. Some items that can be included in reviewers’ evaluation are:

• timeliness;• ease of communication;• depth of the review;• clear and instructive comments;• positive attitude;• lack of bias;• willingness to cooperate

Page 14: How to get peer reviewed

Training of reviewers (if possible) may help to increase the quality of the reviewing

The journal should have a review form (guidelines for reviewers) to be sent to the reviewer.

Support to reviewers

Page 15: How to get peer reviewed

The role of editors…briefly

Page 16: How to get peer reviewed

A day in the life of...

a scientific journal editor

Andrew Sugden. Editor of Science

What Andrew asks when considering whether a paper is suitable for Science…

o Does it show something that’s not been shown before? (original)

o Is it surprising; does it show an unexpected result?

o Is it an answer to a long-standing question? Is it significant to other researchers?

o Has everything been done correctly (is it valid)?

o Does it encourage new questions in research?

( Peer review educational resource

http://www.senseaboutscience.net/ )

Page 17: How to get peer reviewed

What happens when the reviewer has looked at it? What do you do then?

I have to consider the reviewers’ comments and make a recommendation about whether the papers should be published in our journal.

Often reviewers don’t agree about a paper, so I need to check that they are being fair and are not too harsh or too kind. If a paper covers more than one area of science, reviewers with different expertise will look at different sections of it. A paper might have both ecology and immunology aspects, for example. Sometimes these reviewers don’t agree. The person reviewing the ecology part of the paper might think it’s excellent but the person reviewing the immunology part might think it’s weak. My job is to check that the reviewers have provided the information to back up their judgements and that they have explained their views. …..

Before I make my final decisions I tell several colleagues about what I plan to do. So now I’m asking another colleague for their point of view on two papers I’d like to accept. ….

Page 18: How to get peer reviewed

Peer review innovation….( see more cases at http://www.alpsp.org/ngen_public/default.asp?id=370 )…………….

Page 19: How to get peer reviewed

http://www.atmospheric-chemistry-and-physics.net/review/index.html

Atmospheric Chemistry and Physics (ACP)

Page 20: How to get peer reviewed
Page 21: How to get peer reviewed

http://jime.open.ac.uk/jime/index

Page 22: How to get peer reviewed

http://www.nature.com/emboj/index.html

Page 23: How to get peer reviewed

Other ways to evaluate scientific papers………….

Page 24: How to get peer reviewed

http://f1000.com

Page 25: How to get peer reviewed

http://www.peerevaluation.org/

Share and get feedback…..

Page 26: How to get peer reviewed

Does peer review detect missconduct?

Page 27: How to get peer reviewed

One of the key aims of peer review is to filter out bad research, including:

• Fabrication of data• Falsification of data• Plagiarism• Failure to disclose conflict of interests and other forms of scientific misconduct

However the peer review process and reviewers themselves are fallible

and

Peer review cannot provide a guarantee against the publication of bad research. In fact there is evidence of the number of retracted papers is rising (Times Higher Education, 2009).

All major publishers have established procedures for handling such cases, and bodies such as the Committee on Publication Ethics (COPE) and the European Association of Science Editors (EASE) provide training and guidance on good practice.

Page 28: How to get peer reviewed

http://www.timeshighereducation.co.uk/story.asp?sectioncode=26&storycode=407838

James Parry, acting head of the UK Research Integrity Office (UKRIO), said it was impossible to know for certain the reasons for the increase."It might reflect a real increase in misconduct or, more likely, an increase in detection compared with 20 years ago," he said.

It shows that over nearly 20 years the number of articles produced has doubled, but the number of retractions - still a small fraction of the literature - has increased 20 times. This is equal to a tenfold increase,

factoring in the growth of articles.

Times Higher Education, 2009

Page 29: How to get peer reviewed

Ethics and editors/reviewers/journal staff

Competing interests (also called conflict of interest)

ConfidentialityManuscripts, or parts thereof, or comments of reviewers, must be protected from any personal use byeditors, reviewers or journal staff.

Page 30: How to get peer reviewed

As with authors, it is important for the journal to have clear guidelines to avoid conflicts when articles are reviewed

• Ask reviewers to disclose to the editor any potential competing interests with the paper under review

• Ask reviewers to respect and maintain the confidentiality of the contents of the manuscript, and not to disclose it to anyone without the consent of the editor

• Ask reviewers not to make use of, or quote from, the manuscripts they are reviewing before they are published

• Ask reviewers to obtain written consent of the editor if, for any reason, they want to refer the manuscript to another colleague

• Ask reviewers not to contact the author regarding the manuscript without consulting the editor

• Send manuscripts to at least one foreign or external reviewer when working for a journal that serves a small scientific community, in order to avoid competing interests

Key points to avoid conflict of interests

Page 31: How to get peer reviewed

An alternative to answer some questions about publications ethics…

Page 32: How to get peer reviewed

http://www.publicationethics.org/

Page 33: How to get peer reviewed

The flowcharts are designed to help editors follow COPE’s Code of Conduct and implement its advice when faced with cases of suspected misconduct.

Page 34: How to get peer reviewed

Thanks!

[email protected]

Http:www.ease.org.uk