39
Medicine Grand Rounds Weill Cornell Medical College New York May 25, 2016 Ivan Oransky, MD Co-Founder, Retraction Watch Vice President, Global Editorial Director, MedPage Today Distinguished Writer In Residence, NYU (Journalism) Clinical Assistant Professor of Medicine, NYU @ivanoransky Scientific Fraud, Retractions, and the Future of Scientific Publishing

Scientific Fraud, Retractions, and the Future of Scientific Publishing

Embed Size (px)

Citation preview

Page 1: Scientific Fraud, Retractions, and the Future of Scientific Publishing

Medicine Grand RoundsWeill Cornell Medical College

New YorkMay 25, 2016

Ivan Oransky, MDCo-Founder, Retraction Watch

Vice President, Global Editorial Director, MedPage TodayDistinguished Writer In Residence, NYU (Journalism)

Clinical Assistant Professor of Medicine, NYU@ivanoransky

Scientific Fraud, Retractions,and the Future of Scientific Publishing

Page 2: Scientific Fraud, Retractions, and the Future of Scientific Publishing

Conflict of Interest Disclosure

• I'm an employee of MedPage Today, which provides health care news to health care professionals, and a shareholder in its parent company, Everyday Health, which does the same for consumers.

• I've received grant funding for the work discussed here from the MacArthur Foundation, Arnold Foundation, and Helmsley Trust.

Page 3: Scientific Fraud, Retractions, and the Future of Scientific Publishing

Is This Publishing Today?

Page 4: Scientific Fraud, Retractions, and the Future of Scientific Publishing

Robots No Longer Considered Harmful

I.P. Freely, Oliver Clothesoff, Jacques Strap, Hugh Jazz, Amanda Huginkiss

Is This Publishing Today?

Page 5: Scientific Fraud, Retractions, and the Future of Scientific Publishing

Publish Or Perish

Page 6: Scientific Fraud, Retractions, and the Future of Scientific Publishing

Fake Peer Review Watch

The number of papers retracted for rigged peer review since 2012 is:

?

Page 7: Scientific Fraud, Retractions, and the Future of Scientific Publishing

Fake Peer Review Watch

The number of papers retracted for rigged peer review since 2012 is:

>300

Page 8: Scientific Fraud, Retractions, and the Future of Scientific Publishing

Retractions on the Rise

http://pmretract.heroku.com/byyear

Page 9: Scientific Fraud, Retractions, and the Future of Scientific Publishing

Common Reasons for Retractions• Duplication (“self-plagiarism”)• Plagiarism• Image Manipulation• Faked Data• Fake Peer Reviews• Publisher Error• Authorship Issues• Legal Reasons• Not Reproducible

Page 10: Scientific Fraud, Retractions, and the Future of Scientific Publishing

Most Retractions Due to Misconduct

PNAS online October 1, 2012

Page 11: Scientific Fraud, Retractions, and the Future of Scientific Publishing

Who Retracts?

Page 12: Scientific Fraud, Retractions, and the Future of Scientific Publishing

Which Journals Retract?

-Infection and Immunity 2011

Page 13: Scientific Fraud, Retractions, and the Future of Scientific Publishing

What Happens to Retracted Papers’ Citations?

-Assn of College & Research Libraries 2011

Page 14: Scientific Fraud, Retractions, and the Future of Scientific Publishing

What Happens to Retracted Papers’ Citations?

Budd et al, 1999: • Retracted articles received more than 2,000 post-

retraction citations; less than 8% of citations acknowledged the retraction

• Preliminary study of the present data shows that continued citation remains a problem

• Of 391 citations analyzed, only 6% acknowledge the retraction

Page 15: Scientific Fraud, Retractions, and the Future of Scientific Publishing

The Most Highly Cited

Page 16: Scientific Fraud, Retractions, and the Future of Scientific Publishing

Who’s Harmed?

Page 17: Scientific Fraud, Retractions, and the Future of Scientific Publishing

Do Journals Get the Word Out?

Page 18: Scientific Fraud, Retractions, and the Future of Scientific Publishing

Do Journals Get the Word Out?

“Journals often fail to alert the naïve reader; 31.8% of retracted papers were not noted as retracted in any way.”

Page 19: Scientific Fraud, Retractions, and the Future of Scientific Publishing

The Euphemisms

an “approach”

Page 20: Scientific Fraud, Retractions, and the Future of Scientific Publishing

The Euphemisms

an “approach”“significant originality issue”

Page 21: Scientific Fraud, Retractions, and the Future of Scientific Publishing

The Euphemisms

an “approach”“significant originality issue”“inadvertently copied text”

Page 22: Scientific Fraud, Retractions, and the Future of Scientific Publishing

The Euphemisms

an “approach”“significant originality issue”“inadvertently copied text”“inadequate procedural or methodological

practices of citation or quotation,” causing an “unacceptable level of text parallels”

Page 23: Scientific Fraud, Retractions, and the Future of Scientific Publishing

The Euphemisms

• an “approach”• “significant originality issue”• “inadvertently copied text”• “inadequate procedural or methodological

practices of citation or quotation,” causing an “unacceptable level of text parallels”

• “Some sentences…are directly taken from other papers, which could be viewed as a form of plagiarism”

Page 24: Scientific Fraud, Retractions, and the Future of Scientific Publishing

Is This A Useful Retraction Notice?

“At the request of the authors, the following manuscript has been retracted:” [citation]

-Journal of Neuroscience

Page 25: Scientific Fraud, Retractions, and the Future of Scientific Publishing

Why The Opacity?

Page 26: Scientific Fraud, Retractions, and the Future of Scientific Publishing

Now This Is Good News

The JBC’s practice of saying very little in retraction and withdrawal notices has been described by many in the community as opaque—and rightfully so. After reviewing the practices of other journals and consulting with our legal counsel and publications committee, we’ve reconsidered our approach. JBC retraction and withdrawal notices now will explain, with as much detail as possible, why papers have been withdrawn or retracted.

-Journal of Biological Chemistry

Page 27: Scientific Fraud, Retractions, and the Future of Scientific Publishing

What Should Retraction Notices Look Like?

www.PublicationEthics.org

Page 28: Scientific Fraud, Retractions, and the Future of Scientific Publishing

Post-Publication Peer Review On The Rise

Page 29: Scientific Fraud, Retractions, and the Future of Scientific Publishing
Page 30: Scientific Fraud, Retractions, and the Future of Scientific Publishing

http://nautil.us

Page 31: Scientific Fraud, Retractions, and the Future of Scientific Publishing
Page 32: Scientific Fraud, Retractions, and the Future of Scientific Publishing

http://blog.scienceexchange.com/

Page 33: Scientific Fraud, Retractions, and the Future of Scientific Publishing

Keeping Journals – and Researchers -- Honest

Page 34: Scientific Fraud, Retractions, and the Future of Scientific Publishing

PubPeer takes an altogether more sinister tone, however, in its self-proclaimed authority to represent the scientific community and give “referees and members of committees for recruitment, promotion or funding … [the community’s] opinions about the quality and reliability of applicants’ research.”2 Legitimate authority demands consensual recognition and identity, both currently lacking for PubPeer. As scientists, we recognize the authority that comes with knowledge and expertise. We expect the identities of those who wield authority to be in the public domain. 

Not Everyone Is Happy

Page 35: Scientific Fraud, Retractions, and the Future of Scientific Publishing

Not Everyone Is Happy

Page 36: Scientific Fraud, Retractions, and the Future of Scientific Publishing

Crime Doesn’t Pay Anymore

Page 37: Scientific Fraud, Retractions, and the Future of Scientific Publishing

Doing The Right Thing Does

Page 38: Scientific Fraud, Retractions, and the Future of Scientific Publishing

Don’t Do This

Page 39: Scientific Fraud, Retractions, and the Future of Scientific Publishing

Contact Info/AcknowledgementsoransiØ[email protected]

http://retractionwatch.com

@retractionwatch

Thanks:

The MacArthur Foundation

The Arnold Foundation

The Helmsley Trust

Nancy Lapid, Reuters Health