Altmetrics 101 · 2014. 8. 12. · Altmetrics 101 . Metrics provide a Feedback 2 Loop 2 Redefining:...

1

Mike Buschman

Co-founder, Plum Analytics

August 5, 2014

@amichalek | @PlumAnalytics

Altmetrics 101

2

Metrics provide a Feedback

Loop

2

Redefining:

How Scholarship is Measured

3

Current state of

Scholarly Measure

3

Journal

Impact Factor

3.161

4

Metrics provide a Feedback

Loop

4

What impact has our research

had in the past 18 months?

5

Researchers have

Moved Online

6

Sources of Data Exhaust

• Amazon

• Bit.ly

• CrossRef

• Delicious

• Dryad

• dSpace

• EBSCO

• ePrints

• Facebook

• Figshare

• Github

• Google+

• Medwave

• Mendeley

• PLOS

• PubMed Central

• Reddit

• Research

Blogging

• Scopus

• SlideShare

• SourceForge

• Stack Overflow

• Twitter

• USPTO

• Vimeo

• Wikipedia

• Worldcat

• YouTube

7

Metrics Categories

USAGE (clicks, downloads, views,

library holdings, video plays)

CAPTURES (bookmarks, code forks, favorites,

readers, watchers)

MENTIONS (blog posts, comments, reviews,

Wikipedia links)

SOCIAL MEDIA (+1s, likes, shares, tweets)

CITATIONS (PubMed Central, Scopus,

patents)

8

Changing the focus

COUNTER how much your university uses the collection

Article-level metrics and

PlumX

how much the world uses your research

on metrics

9

Metrics provide

a Feedback Loop

10

Open Metrics Open Science

11

Visualizing Impact: Plum Print

12

13

Group and Researcher

Widgets

14

16

Citations are lagging indicators

• Scopus = 2

• Web of

Science = 0

• Google

Scholar = 8

• PubMed = 1

16

Photo credit: A. Wayne Vogl and Nicholas D.

Pyenson / Smithsonian Institution.

Research output is

more than articles…

Measure all of it

17

Beyond the Journal Article

• Articles

• Blog posts

• Book chapters

• Books

• Cases

• Clinical Trials

• Conference Papers

• Data Sets

• Figures

• Grants

• Interviews

• Letters

• Media

• Patents

• Posters

• Presentations

• Reports

• Source Code

• Theses /

Dissertations

• Videos

• Web Pages

18

Books count!

19

How does this help me?

Performing Research

Funding Research

Publishing Research

20

Given how tight budgets are around

the world, governments are rightfully

demanding effectiveness in the programs

they pay for.

To address these demands, we

need better measurement tools

to determine which approaches

work and which do not.”

Bill Gates

Gates Foundation Annual Letter 2013

“

21

NIH: The Competition for

Research $$$

http://report.nih.gov/NIHDatabook/Charts/Default.aspx?showm=Y&chartId=20&catId=2

4 in 5 people do

NOT get funded

22

Who Gets Funded? N

um

ber

of P

roposals

Almost

Always

Funded

Almost

Never

Funded

“Gray Zone” Typically

Funded

Adapted from:

http://nuweb.neu.edu/nhe/insideview%20NSF.pdf

23

Metrics provide a Feedback

Loop

23

An opportunity for libraries

and the office of research

to work together

24

Funders are using PlumX

25

Citations are lagging indicators

• Scopus = 2

• Web of

Science = 0

• Google

Scholar = 8

• PubMed = 1

25

Photo credit: A. Wayne Vogl and Nicholas D.

Pyenson / Smithsonian Institution.

Thank You!

26

26

27

Citations are lagging indicators

• Scopus = 2

• Web of Science = 0

• Google Scholar = 8

• PubMed = 1

Photo credit: A. Wayne Vogl and Nicholas D.

Pyenson / Smithsonian Institution.

28

“Same” Article,

Different Places