28
1 Mike Buschman Co-founder, Plum Analytics August 5, 2014 @amichalek | @PlumAnalytics Altmetrics 101

Altmetrics 101 · 2014. 8. 12. · Altmetrics 101 . Metrics provide a Feedback 2 Loop 2 Redefining: How Scholarship is Measured . Current state of 3 Scholarly Measure Journal Impact

  • Upload
    others

  • View
    6

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Altmetrics 101 · 2014. 8. 12. · Altmetrics 101 . Metrics provide a Feedback 2 Loop 2 Redefining: How Scholarship is Measured . Current state of 3 Scholarly Measure Journal Impact

1

Mike Buschman

Co-founder, Plum Analytics

August 5, 2014

@amichalek | @PlumAnalytics

Altmetrics 101

Page 2: Altmetrics 101 · 2014. 8. 12. · Altmetrics 101 . Metrics provide a Feedback 2 Loop 2 Redefining: How Scholarship is Measured . Current state of 3 Scholarly Measure Journal Impact

2

Metrics provide a Feedback

Loop

2

Redefining:

How Scholarship is Measured

Page 3: Altmetrics 101 · 2014. 8. 12. · Altmetrics 101 . Metrics provide a Feedback 2 Loop 2 Redefining: How Scholarship is Measured . Current state of 3 Scholarly Measure Journal Impact

3

Current state of

Scholarly Measure

3

Journal

Impact Factor

3.161

Page 4: Altmetrics 101 · 2014. 8. 12. · Altmetrics 101 . Metrics provide a Feedback 2 Loop 2 Redefining: How Scholarship is Measured . Current state of 3 Scholarly Measure Journal Impact

4

Metrics provide a Feedback

Loop

4

What impact has our research

had in the past 18 months?

Page 5: Altmetrics 101 · 2014. 8. 12. · Altmetrics 101 . Metrics provide a Feedback 2 Loop 2 Redefining: How Scholarship is Measured . Current state of 3 Scholarly Measure Journal Impact

5

Researchers have

Moved Online

Page 6: Altmetrics 101 · 2014. 8. 12. · Altmetrics 101 . Metrics provide a Feedback 2 Loop 2 Redefining: How Scholarship is Measured . Current state of 3 Scholarly Measure Journal Impact

6

Sources of Data Exhaust

• Amazon

• Bit.ly

• CrossRef

• Delicious

• Dryad

• dSpace

• EBSCO

• ePrints

• Facebook

• Figshare

• Github

• Google+

• Medwave

• Mendeley

• PLOS

• PubMed Central

• Reddit

• Research

Blogging

• Scopus

• SlideShare

• SourceForge

• Stack Overflow

• Twitter

• USPTO

• Vimeo

• Wikipedia

• Worldcat

• YouTube

Page 7: Altmetrics 101 · 2014. 8. 12. · Altmetrics 101 . Metrics provide a Feedback 2 Loop 2 Redefining: How Scholarship is Measured . Current state of 3 Scholarly Measure Journal Impact

7

Metrics Categories

USAGE (clicks, downloads, views,

library holdings, video plays)

CAPTURES (bookmarks, code forks, favorites,

readers, watchers)

MENTIONS (blog posts, comments, reviews,

Wikipedia links)

SOCIAL MEDIA (+1s, likes, shares, tweets)

CITATIONS (PubMed Central, Scopus,

patents)

Page 8: Altmetrics 101 · 2014. 8. 12. · Altmetrics 101 . Metrics provide a Feedback 2 Loop 2 Redefining: How Scholarship is Measured . Current state of 3 Scholarly Measure Journal Impact

8

Changing the focus

COUNTER how much your university uses the collection

Article-level metrics and

PlumX

how much the world uses your research

on metrics

Page 9: Altmetrics 101 · 2014. 8. 12. · Altmetrics 101 . Metrics provide a Feedback 2 Loop 2 Redefining: How Scholarship is Measured . Current state of 3 Scholarly Measure Journal Impact

9

Metrics provide

a Feedback Loop

Page 10: Altmetrics 101 · 2014. 8. 12. · Altmetrics 101 . Metrics provide a Feedback 2 Loop 2 Redefining: How Scholarship is Measured . Current state of 3 Scholarly Measure Journal Impact

10

Open Metrics Open Science

Page 11: Altmetrics 101 · 2014. 8. 12. · Altmetrics 101 . Metrics provide a Feedback 2 Loop 2 Redefining: How Scholarship is Measured . Current state of 3 Scholarly Measure Journal Impact

11

Visualizing Impact: Plum Print

Page 12: Altmetrics 101 · 2014. 8. 12. · Altmetrics 101 . Metrics provide a Feedback 2 Loop 2 Redefining: How Scholarship is Measured . Current state of 3 Scholarly Measure Journal Impact

12

Page 13: Altmetrics 101 · 2014. 8. 12. · Altmetrics 101 . Metrics provide a Feedback 2 Loop 2 Redefining: How Scholarship is Measured . Current state of 3 Scholarly Measure Journal Impact

13

Group and Researcher

Widgets

Page 14: Altmetrics 101 · 2014. 8. 12. · Altmetrics 101 . Metrics provide a Feedback 2 Loop 2 Redefining: How Scholarship is Measured . Current state of 3 Scholarly Measure Journal Impact

14

Page 15: Altmetrics 101 · 2014. 8. 12. · Altmetrics 101 . Metrics provide a Feedback 2 Loop 2 Redefining: How Scholarship is Measured . Current state of 3 Scholarly Measure Journal Impact
Page 16: Altmetrics 101 · 2014. 8. 12. · Altmetrics 101 . Metrics provide a Feedback 2 Loop 2 Redefining: How Scholarship is Measured . Current state of 3 Scholarly Measure Journal Impact

16

Citations are lagging indicators

• Scopus = 2

• Web of

Science = 0

• Google

Scholar = 8

• PubMed = 1

16

Photo credit: A. Wayne Vogl and Nicholas D.

Pyenson / Smithsonian Institution.

Research output is

more than articles…

Measure all of it

Page 17: Altmetrics 101 · 2014. 8. 12. · Altmetrics 101 . Metrics provide a Feedback 2 Loop 2 Redefining: How Scholarship is Measured . Current state of 3 Scholarly Measure Journal Impact

17

Beyond the Journal Article

• Articles

• Blog posts

• Book chapters

• Books

• Cases

• Clinical Trials

• Conference Papers

• Data Sets

• Figures

• Grants

• Interviews

• Letters

• Media

• Patents

• Posters

• Presentations

• Reports

• Source Code

• Theses /

Dissertations

• Videos

• Web Pages

Page 18: Altmetrics 101 · 2014. 8. 12. · Altmetrics 101 . Metrics provide a Feedback 2 Loop 2 Redefining: How Scholarship is Measured . Current state of 3 Scholarly Measure Journal Impact

18

Books count!

Page 19: Altmetrics 101 · 2014. 8. 12. · Altmetrics 101 . Metrics provide a Feedback 2 Loop 2 Redefining: How Scholarship is Measured . Current state of 3 Scholarly Measure Journal Impact

19

How does this help me?

Performing Research

Funding Research

Publishing Research

Page 20: Altmetrics 101 · 2014. 8. 12. · Altmetrics 101 . Metrics provide a Feedback 2 Loop 2 Redefining: How Scholarship is Measured . Current state of 3 Scholarly Measure Journal Impact

20

Given how tight budgets are around

the world, governments are rightfully

demanding effectiveness in the programs

they pay for.

To address these demands, we

need better measurement tools

to determine which approaches

work and which do not.”

Bill Gates

Gates Foundation Annual Letter 2013

Page 21: Altmetrics 101 · 2014. 8. 12. · Altmetrics 101 . Metrics provide a Feedback 2 Loop 2 Redefining: How Scholarship is Measured . Current state of 3 Scholarly Measure Journal Impact

21

NIH: The Competition for

Research $$$

http://report.nih.gov/NIHDatabook/Charts/Default.aspx?showm=Y&chartId=20&catId=2

4 in 5 people do

NOT get funded

Page 22: Altmetrics 101 · 2014. 8. 12. · Altmetrics 101 . Metrics provide a Feedback 2 Loop 2 Redefining: How Scholarship is Measured . Current state of 3 Scholarly Measure Journal Impact

22

Who Gets Funded? N

um

ber

of P

roposals

Almost

Always

Funded

Almost

Never

Funded

“Gray Zone” Typically

Funded

Adapted from:

http://nuweb.neu.edu/nhe/insideview%20NSF.pdf

Page 23: Altmetrics 101 · 2014. 8. 12. · Altmetrics 101 . Metrics provide a Feedback 2 Loop 2 Redefining: How Scholarship is Measured . Current state of 3 Scholarly Measure Journal Impact

23

Metrics provide a Feedback

Loop

23

An opportunity for libraries

and the office of research

to work together

Page 24: Altmetrics 101 · 2014. 8. 12. · Altmetrics 101 . Metrics provide a Feedback 2 Loop 2 Redefining: How Scholarship is Measured . Current state of 3 Scholarly Measure Journal Impact

24

Funders are using PlumX

Page 25: Altmetrics 101 · 2014. 8. 12. · Altmetrics 101 . Metrics provide a Feedback 2 Loop 2 Redefining: How Scholarship is Measured . Current state of 3 Scholarly Measure Journal Impact

25

Citations are lagging indicators

• Scopus = 2

• Web of

Science = 0

• Google

Scholar = 8

• PubMed = 1

25

Photo credit: A. Wayne Vogl and Nicholas D.

Pyenson / Smithsonian Institution.

Thank You!

Page 27: Altmetrics 101 · 2014. 8. 12. · Altmetrics 101 . Metrics provide a Feedback 2 Loop 2 Redefining: How Scholarship is Measured . Current state of 3 Scholarly Measure Journal Impact

27

Citations are lagging indicators

• Scopus = 2

• Web of Science = 0

• Google Scholar = 8

• PubMed = 1

Photo credit: A. Wayne Vogl and Nicholas D.

Pyenson / Smithsonian Institution.

Page 28: Altmetrics 101 · 2014. 8. 12. · Altmetrics 101 . Metrics provide a Feedback 2 Loop 2 Redefining: How Scholarship is Measured . Current state of 3 Scholarly Measure Journal Impact

28

“Same” Article,

Different Places