67
What is the value of a scientific article? Thoughts about the state of scholarly publishing Anders Kastberg @kast12berg November, 2014 1/35

What is the value of a scientific article?

Embed Size (px)

DESCRIPTION

Seminar given in Nice, France, 19th November 2014 (in French). Also published on figshare: http://dx.doi.org/10.6084/m9.figshare.1243749

Citation preview

Page 1: What is the value of a scientific article?

What is the value of a scientific article?

Thoughts about the state of scholarly publishing!

Anders Kastberg @kast12berg

November, 20141/35

Page 2: What is the value of a scientific article?

The past

-

current

status

Now -

Changes Near f

uture -

What’s

happening

? Moving on

-

Do WE ne

ed

to chang

e?

Outline:

time

2/35

Page 3: What is the value of a scientific article?

Current state of affairs

Current state of affairs3/35

Page 4: What is the value of a scientific article?

How do we diffuse our research?

Articles!

Current state of affairs4/35

Page 5: What is the value of a scientific article?

How do we diffuse our research?

Articles!

Format determined by technical limitations Current state

of affairs4/35

Page 6: What is the value of a scientific article?

Evaluations are dominated by publication statistics

Current state of affairs

Evaluation of journals Impact factor

Evaluation of articles Citation statistics

Evaluation of scientists/Number of publications

institutes/universitiesh-factor

5/35

Page 7: What is the value of a scientific article?

So, is there a problem with all this?

changes = problems

Problems/Changes6/35

Page 8: What is the value of a scientific article?

Who is in control?

Thomson Reuter has the power to control global research policies

Problems/Changes7/35

Page 9: What is the value of a scientific article?

There are other sources than ISI

Who should I trust? Problems/Changes8/35

Page 10: What is the value of a scientific article?

There are other sources than ISI

254

165

Who should I trust? Problems/Changes8/35

Page 11: What is the value of a scientific article?

Misconduct / malpractice

• Plagiarism

• Cheating

• Citation cartels

• Predatory Open Access

Problems/Changes9/35

Page 12: What is the value of a scientific article?

Is it possible to communicate science in any other way?

We have always communicated in more ways!

Problems/Changes10/35

Page 13: What is the value of a scientific article?

Is it possible to communicate science in any other way?

We have always communicated in more ways!

WHAT’S NEW? other things than articles leave

searchable traces! Problems/Changes10/35

Page 14: What is the value of a scientific article?

The internet!

Problems/Changes

How often is an article downloaded? How often is an article read?

11/35

Page 15: What is the value of a scientific article?

The internet!

Problems/Changes

How often is an article downloaded? How often is an article read?

Reports in media

11/35

Page 16: What is the value of a scientific article?

The internet!

Problems/Changes

How often is an article downloaded? How often is an article read?

Reports in media

Social media

11/35

Page 17: What is the value of a scientific article?

The internet!

Problems/Changes

How often is an article downloaded? How often is an article read?

Reports in media

Social media

Blogs, other places on the web …

11/35

Page 18: What is the value of a scientific article?

The internet!

Problems/Changes

How often is an article downloaded? How often is an article read?

Reports in media

Social media

Blogs, other places on the web …

11/35

Page 19: What is the value of a scientific article?

The internet!

Problems/Changes

How often is an article downloaded? How often is an article read?

Reports in media

Social media

Blogs, other places on the web …

Things that CAN be measured WILL be measured!

11/35

Page 20: What is the value of a scientific article?

Digital identifiersDOI - the fingerprint of a scientific article

crossref.org

Problems/Changes12/35

Page 21: What is the value of a scientific article?

Digital identifiersDOI - the fingerprint of a scientific article

crossref.org

Exemple:

Problems/Changes12/35

Page 22: What is the value of a scientific article?

Digital identifiersDOI - the fingerprint of a scientific article

crossref.org

More than 70 million registered linksProblems/Changes12/35

Page 23: What is the value of a scientific article?

Digital identifiersORCID - the digital ID of researchers

orcid.org

Problems/Changes13/35

Page 24: What is the value of a scientific article?

Digital identifiersORCID - the digital ID of researchers

orcid.org

Problems/Changes13/35

• Searching articles facilitated

• Ensures that you are properly credited

• Change of name or institute no longer a problem

• Standardized CV and list of publications online

Page 25: What is the value of a scientific article?

Digital identifiersORCID - the digital ID of researchers

orcid.org

Problems/Changes13/35

• Searching articles facilitated

• Ensures that you are properly credited

• Change of name or institute no longer a problem

• Standardized CV and list of publications online

Page 26: What is the value of a scientific article?

Digital identifiersORCID - the digital ID of researchers

orcid.org

Problems/Changes13/35

• Searching articles facilitated

• Ensures that you are properly credited

• Change of name or institute no longer a problem

• Standardized CV and list of publications online

Page 27: What is the value of a scientific article?

Types of publications - possible problems with traditional journals

• Pseudo-monopoly - market signals don’t work

• Huge increase in submissions

• ⇒ price increase

• Could this be solved by Open Access? Maybe, maybe not

Problems/Changes14/35

Page 28: What is the value of a scientific article?

Types of publications - new types of journals

• Pure Open Access journals (OA gold)

• You pay for publishing - reading is free

• Changes to peer review • post-peer review

• Incorporated article metrics

Problems/Changes15/35

Page 29: What is the value of a scientific article?

Types of publications - new types of journals

Problems/Changes

One example: “The Public Library of Science”

16/35

Page 30: What is the value of a scientific article?

Types of publications - new types of journals

Problems/Changes16/35

Page 31: What is the value of a scientific article?

PLOS ONE

Problems/Changes17/35

Page 32: What is the value of a scientific article?

PLOS ONE

• Open for all fields of science

• Impact factor: 3.534 (2013)

• 31520 articles published 2013

• Publication cost: USD 1350

• Peer review: a bit different

Problems/Changes17/35

Page 33: What is the value of a scientific article?

PLOS ONE - peer review

Problems/Changes

The “interest” will not be assessed by the referees

Instead, there is a “post-peer review”, via comments and metrics

18/35

Page 34: What is the value of a scientific article?

PLOS ONE - peer review

Problems/Changes

The “interest” will not be assessed by the referees

Instead, there is a “post-peer review”, via comments and metrics

18/35

Page 35: What is the value of a scientific article?

PLOS ONE - peer review

Problems/Changes

The “interest” will not be assessed by the referees

Instead, there is a “post-peer review”, via comments and metrics

18/35

Page 36: What is the value of a scientific article?

PLOS ONE - peer review

Problems/Changes

The “interest” will not be assessed by the referees

Instead, there is a “post-peer review”, via comments and metrics

18/35

Page 37: What is the value of a scientific article?

PLOS ONE• No copy editing

• Life science dominates

• Subject areas identified automatically?

Problems/Changes19/35

Page 38: What is the value of a scientific article?

PLOS ONE

Problems/Changes

one example: quantum tunneling in PLOS ONE

19/35

Page 39: What is the value of a scientific article?

PLOS ONE

Problems/Changes

one example: quantum tunneling in PLOS ONE

discussion on: !http://anderskastberg.wordpress.com19/35

Page 40: What is the value of a scientific article?

Types of publications - new types of journals

Other new journals

Do we dilute science publishing? Problems/Changes20/35

Page 41: What is the value of a scientific article?

Types of publications - not limited by articles

• Data

• Software

• Images

• Videos

• Experimental setups

• Negative results

• Reproduction of previous research

Problems/Changes21/35

Page 42: What is the value of a scientific article?

Biomedicine rules

Problems/Changes

Many policies based on needs in biomedicine

Things are different in fields less intense on citations

This is not necessarily good for us

22/35

Page 43: What is the value of a scientific article?

Developments already on the way

Alternative metrics

What’s happening now?23/35

Page 44: What is the value of a scientific article?

Alternative metics? Complementary metrics?

What’s happening now?24/35

Page 45: What is the value of a scientific article?

Societal impact• Citations

• Downloads

• Saves in Mendeley, etc.

• Mentions in books

• Wikipedia

• Exposure in media

• Blogs

• Social media

• Patents

• Impact on legislation

• Policy documents

How can such things be measured, and normalized in a fair way? What’s

happening now?25/35

Page 46: What is the value of a scientific article?

This already exists!

What’s happening now?26/35

Page 47: What is the value of a scientific article?

This already exists!

What’s happening now?26/35

Page 48: What is the value of a scientific article?

This already exists!

What’s happening now?26/35

Page 49: What is the value of a scientific article?

This already exists!

What’s happening now?26/35

Page 50: What is the value of a scientific article?

This already exists!

What’s happening now?26/35

Page 51: What is the value of a scientific article?

Example of Altmetrics in action:

What’s happening now?27/35

Page 52: What is the value of a scientific article?

Example of Altmetrics in action:

What’s happening now?27/35

Page 53: What is the value of a scientific article?

Example of Altmetrics in action:

What’s happening now?27/35

Page 54: What is the value of a scientific article?

Example of Altmetrics in action:

What’s happening now?27/35

Page 55: What is the value of a scientific article?

Example of Altmetrics in action:

What’s happening now?27/35

Page 56: What is the value of a scientific article?

Example of Altmetrics in action:

What’s happening now?27/35

Page 57: What is the value of a scientific article?

Example of Altmetrics in action:

What’s happening now?27/35

Page 58: What is the value of a scientific article?

It’s not just about evaluations

• Can facilitate literature searches GREATLY!

• Helps me select between thousands of articles

• Vanity! Who reads my article?

What’s happening now?28/35

Page 59: What is the value of a scientific article?

What should we do?

Do we need to adapt?29/35

Page 60: What is the value of a scientific article?

What should we do?

Do we need to adapt?

Does everything have to be evaluated?

Isn’t peer review enough? Can competence ever be reduced to a number?

A world totally void of quantified evaluations will probably never exist

30/35

Page 61: What is the value of a scientific article?

Unfortunately unavoidable

Do we need to adapt?

Someone WILL measure our work. Isn’t better if we have some insight/control in this?

31/35

Page 62: What is the value of a scientific article?

Who should decide how science is evaluated?

Do we need to adapt?

Maybe we need a new, community driven, non-for profit organization?

Maybe a good thing that we have more than ONE type of measuring?

32/35

Page 63: What is the value of a scientific article?

ORCID Yes!

ResearchID, Google scholar, Scopus, PubMed …… Maybe

twitter, blogs If you like it

Mendeley, Zotero ….. If it helps your productivity

Should we register at all these sites? Should we be active on social media?

Do we need to adapt?33/35

Page 64: What is the value of a scientific article?

What is the value of a scientific article?

Do we need to adapt?

Think about it!

Should we persist with articles as the only true method for dissemination and evaluation?

34/35

Page 65: What is the value of a scientific article?

What is the value of a scientific article?

Do we need to adapt?

The general public is ignorant about science (?) Who’s fault is that?

Think about it!34/35

Page 66: What is the value of a scientific article?

What is the value of a scientific article?

Do we need to adapt?

• New types of journals • New types of metrics • Social media and such nonsense

Think about it!

The younger among us may need to adapt!

34/35

Page 67: What is the value of a scientific article?

¡Muchas gracias!

Anders Kastberg @kast12berg

November, 201435/35

this talk is published on figshare: