91
Altmetrics in the Academy Implementing strategies in the library for better academic engagement, dissemination and measurement

Altmetrics Day Workshop - Internet Librarian International 2014

Embed Size (px)

DESCRIPTION

Altmetrics in the Academy - Implementing strategies in the library for better academic engagement, dissemination and measurement Workshop abstract: Altmetrics are increasingly gaining support and interest as an alternative way of disseminating and measuring scholarly output. Championed by early career researchers, librarians and information professionals, Altmetrics are to research as MOOCs are to learning. Like MOOCs most still do not understand their potential or how they could fit with or replace existing modes of delivery and assessment. The first half of the workshop will help delegates gain an understanding of what Altmetrics are and how they can fit within academic library services. The second half of the session will deliver case studies, tools and techniques to help LIS professionals encourage better usage of Altmetrics. 10:00: What do you want from the day? What are your experiences of Altmetrics 10.40am: Altmetrics: an overview or Altmetrics and the day/where are we now? A history, roadmap, how it fits in 11 am: Altmetrics within institutions: data, IR integration/other tools/library catalogue integration what data is there? coverage of articles/datasets/other research outputs, mendeley demographic data case studies of uses examples of IR integration/motivations primo/summon/other ones.. altmetric for institutions - integration with existing platforms free explorer (and we’ll explore the data using this later) 11.30 Break 12.00pm Altmetrics in the Academy - getting academics and librarians on board 12.40 Brainstorming session: Value in Altmetrics: what questions do people have around this? what are their biggest concerns? 13.00 Lunch 2 pm: Getting familiar with the tools - practical session experimenting with the Altmetric explorer - half an hour (set tasks - eg create a list, pull out the most interesting mentions) Good practice, guidelines, tips 2:45pm: At the coal face - experiences of a researcher using Altmetrics in practice 3.30pm: Break 3.45 pm: Getting mobile, how using mobile apps can help you engage more with Altmetrics 4.05 pm What’s on the horizon? What does the future for scholarly dissemination and impact. 4.40 wrap up and questions

Citation preview

Page 1: Altmetrics Day Workshop - Internet Librarian International 2014

Altmetrics

in the

Academy

Implementing strategies in the library for better academic

engagement, dissemination and measurement

Page 2: Altmetrics Day Workshop - Internet Librarian International 2014

Who we are part 1

Page 3: Altmetrics Day Workshop - Internet Librarian International 2014

10.00 Welcome and introductions10.10 What do you want from the day? What are your experiences of Altmetrics?10:30 An overview of Altmetrics - what, why, where? 11.30 Break12.00 Altmetrics in the Academy - getting academics and librarians on board12.40 Brainstorming session: Value in altmetrics: what questions do people have around this? what are their biggest concerns?1.00 Lunch

Page 4: Altmetrics Day Workshop - Internet Librarian International 2014

Do you use any of these?

Page 5: Altmetrics Day Workshop - Internet Librarian International 2014

And these?

Page 6: Altmetrics Day Workshop - Internet Librarian International 2014

Do you recognise these?

Page 7: Altmetrics Day Workshop - Internet Librarian International 2014

An overview of Altmetrics - what, why where?

Page 8: Altmetrics Day Workshop - Internet Librarian International 2014

The dissemination and communication of research is changing

Presentations and seminars

Funding and ethics applications

Academic books

Journal articles and posters

Term papers and essays

Meetings and conferences

Correspondence

Open access

Supplementary data

Online reference managers

Press

Post-publication peer-review

Social media

Blogs

Page 9: Altmetrics Day Workshop - Internet Librarian International 2014

Traditional metrics struggle to reflect this

- Slow to accrue- Focus mostly on published articles

Published June 2014:

Starting to impact the behaviour of academics

Page 10: Altmetrics Day Workshop - Internet Librarian International 2014

Development of altmetrics

● to complement, not replace traditional metrics

● help people understand how research is being received and used,

and by who

● not intended as an indicator of quality

● can help provide further evidence of engagement and ‘societal

impact’

● give credit for research outputs other than articles

Page 11: Altmetrics Day Workshop - Internet Librarian International 2014

So, what are they?

Page 12: Altmetrics Day Workshop - Internet Librarian International 2014

And who provides them?

Page 13: Altmetrics Day Workshop - Internet Librarian International 2014

Altmetrics at Altmetric

● data quality and curation

● valid, relevant sources

● intuitive user interface

● customer support

● community engagement

Page 14: Altmetrics Day Workshop - Internet Librarian International 2014

Sources of attention

Page 15: Altmetrics Day Workshop - Internet Librarian International 2014

Policy documents

● AWMF - Association of Scientific Medical Societies

● European Food Safety Authority (EFSA)

● Food and Agriculture Organization

● GOV.UK - Policy papers, Research & Analysis

● Intergovernmental Panel on Climate Change (IPCC)

● International Monetary Fund (IMF)

● Mental Health Foundation (UK) - NEW

● NICE Evidence

● UNESCO

● World Health Organization (WHO)

More being added each week…

Page 16: Altmetrics Day Workshop - Internet Librarian International 2014

Aggregating attention

Follow a list of sources(manual curation)

Search for links to papers(automated collection)

Collate attention(disambiguation)

Display data in “Altmetric details pages”

Col

lect

ing

Rep

ortin

g

Page 17: Altmetrics Day Workshop - Internet Librarian International 2014

Digging in to the data

Page 18: Altmetrics Day Workshop - Internet Librarian International 2014

Demographics

Twitter data from bio’s

Mendeley data based on who has saved the article to their library - anonymised

Page 19: Altmetrics Day Workshop - Internet Librarian International 2014

The Altmetric score and donut● developed to give an at-a-glance summary of the attention work has received● not an indicator of quality of the research! ● useful when looking at data for lots of articles at once

Page 20: Altmetrics Day Workshop - Internet Librarian International 2014

Context

Page 21: Altmetrics Day Workshop - Internet Librarian International 2014

Implementations

Page 22: Altmetrics Day Workshop - Internet Librarian International 2014

Publisher uses

Page 23: Altmetrics Day Workshop - Internet Librarian International 2014

And funders...

Page 24: Altmetrics Day Workshop - Internet Librarian International 2014

Librarian access

● Free Altmetric Explorer accounts● Search for data on any article, from any publisher● Share with researchers or admins

Page 25: Altmetrics Day Workshop - Internet Librarian International 2014

“Can I see the data for authors and work just from my institution?”

Page 26: Altmetrics Day Workshop - Internet Librarian International 2014

Altmetric for Institutions

Page 27: Altmetrics Day Workshop - Internet Librarian International 2014

Explore your institution

Page 28: Altmetrics Day Workshop - Internet Librarian International 2014

Reporting

- save search filters

- set up automated email alerts

- export to excel, or reports on individual articles

- API output

- set up direct links into other systems

Page 29: Altmetrics Day Workshop - Internet Librarian International 2014

Who can use the data?

Page 30: Altmetrics Day Workshop - Internet Librarian International 2014

Institutional repositories

- free donut badge embeds

- just 2 lines of code: api.altmetric.com

- helps encourage deposits

- collates attention from all versions

- let us know your domain!

[email protected]

Page 31: Altmetrics Day Workshop - Internet Librarian International 2014
Page 32: Altmetrics Day Workshop - Internet Librarian International 2014

Discovery platforms

Free primo plugin availableIn discussion with ProQuest re: Summon

Page 33: Altmetrics Day Workshop - Internet Librarian International 2014

Researchers

altmetric.it

Page 34: Altmetrics Day Workshop - Internet Librarian International 2014

Details pages alerts

Page 35: Altmetrics Day Workshop - Internet Librarian International 2014

Impact Story

Page 36: Altmetrics Day Workshop - Internet Librarian International 2014

New tools: Kudos

Page 37: Altmetrics Day Workshop - Internet Librarian International 2014

Researcher feedback

Page 38: Altmetrics Day Workshop - Internet Librarian International 2014
Page 39: Altmetrics Day Workshop - Internet Librarian International 2014

They’re still fairly new...

- ongoing review, HEFCE

- project to create standards, NISO

- looking towards Horizon 2020 and next RAE in

Australia

Page 40: Altmetrics Day Workshop - Internet Librarian International 2014

Concerns about gaming and misinterpretation

● part of the reason that we make sure all of our

data is auditable

● and don’t show things like Facebook likes

● systems in place to flag up suspect activity

● beware siloed usage data

Page 41: Altmetrics Day Workshop - Internet Librarian International 2014

But at the end of the day...

Page 42: Altmetrics Day Workshop - Internet Librarian International 2014

Ways to keep up to date

- ImpactStory newsletter

- Altmetric blog

- Plum analytics blog

- Regular webinars

- Follow #altmetrics hashtag on Twitter

Page 43: Altmetrics Day Workshop - Internet Librarian International 2014

Image CC BY Cheryl Foong http://bit.ly/1slDTUW

Page 44: Altmetrics Day Workshop - Internet Librarian International 2014

Altmetrics:

A new role for library and information professionals

Image CC BY mkhmarketing http://bit.ly/1qwdZHC

Page 45: Altmetrics Day Workshop - Internet Librarian International 2014

Who we are part 2

Page 46: Altmetrics Day Workshop - Internet Librarian International 2014

It’s not just Altmetrics that’s hot

MOOCsOpen AccessImpact Big Data

Page 47: Altmetrics Day Workshop - Internet Librarian International 2014

The research process

Have an ideaSearch for research

Filter and review the research

Publish anddisseminate the research

Measure anddiscuss the research

Page 48: Altmetrics Day Workshop - Internet Librarian International 2014

The research process and you

Have an ideaSearch for research

Filter and review the research

Publish anddisseminate the research

Measure anddiscuss the research

LIS Professionals host, catalogue and search published research

LIS Professionals carry out systematic and literature reviews from search results

LIS Professionals experts in publishing and communication.OA, Social Media, blogging

LIS Professionals experts in measurement,bibliometrics,work in neutral role

Page 49: Altmetrics Day Workshop - Internet Librarian International 2014

Appraising

Social Media

Com

munications

ImpartialFlexibleHelpful

NetworkedCentrally based

Bibliometrics

Sear

chin

g Indexing

T

echn

ologis

t

Filt

erin

g

Where the LIS professional fits in

Page 50: Altmetrics Day Workshop - Internet Librarian International 2014

Every researcher is different

An early career researcher who uses a social media every day, mostly for their personal life wants to use social media and altmetrics within their professional setting. They have an idea of the basics, but are also concerned that their line manager who is an older, established academic might perceive the use of such tools as not constituting as work.

How do you resolve that?

Page 51: Altmetrics Day Workshop - Internet Librarian International 2014

● Find evidence which peers are using altmetrics ● Show them tools and shortcuts that highlight this is real work with

real outputs - Tweetdeck, IFTTT, altmetric bookmarklet● Those who have established altmetrics companies are often early

career researchers wanting to get more from their work.● They may have datasets or other outputs they wish to share● It could have the offset of bringing the senior academic on board● Explain it can be a way to build social ties - with publishers,

potential collaborators, fund holders, bloggers and journalists

Page 52: Altmetrics Day Workshop - Internet Librarian International 2014

Every researcher is different

A senior academic asks the question; ‘is Altmetrics a good use of my time?’ They a couple of decades into their career, possibly a professor and have several published papers in a high impact, peer-review journals. They are thinking about engaging with social media and Altmetrics but are not sure whether it would actually benefit their career at this stage.

How do you resolve that?

Page 53: Altmetrics Day Workshop - Internet Librarian International 2014

● Academics like to debate their areas of expertise - explain that on social media there is a conversation taking place right now about their research with some of their peers involved

● Show evidence that altmetrics are a good indicator of future research and hot topics

● Breath life into old research - show how altmetrics gives them new and interesting metrics on their existing papers - where globally a paper is being talked about or saved

● Explain how this can fit in with the growing impact agenda

Page 54: Altmetrics Day Workshop - Internet Librarian International 2014

Rogers’ Diffusion of Innovation

Page 55: Altmetrics Day Workshop - Internet Librarian International 2014

''All mankind is divided into three classes: Those that are immovable, those that are movable, and those that move''.

Benjamin Franklin

Page 56: Altmetrics Day Workshop - Internet Librarian International 2014

Getting academics to the waterhole

Images CC BY Whatleydude http://bit.ly/1wPc0my Kyknoord http://bit.ly/1wgTLZ8

Page 57: Altmetrics Day Workshop - Internet Librarian International 2014

#Understand

Image CC BY Glen Edelson http://bit.ly/1o3tFb8

● Their way of working -long periods doing the same thing

● Their concernsPressure to publish research

● Their fearsMay not be used to Social Media ortechnology for that matter

● How busy they are● What they can get out of

Altmetrics

and what you can do to help them

Page 58: Altmetrics Day Workshop - Internet Librarian International 2014

#Demystify

Image CC BY Sarah http://bit.ly/ZyiXxw

● Explain that Altmetrics are notabout Justin Bieber’s Tweets to his Beliebers

● That using tools like Altmetrics,Mendeley, Twitter and ImpactStorywill show them where their researchis reaching globally

● Help build case studies toshow what is out there

● Show junior researchers andstudents that their research andprofile will benefit

Page 59: Altmetrics Day Workshop - Internet Librarian International 2014

#TrainImage CC BY Sarah http://bit.ly/ZyiXxw

Image CC BY Michael Younghttp://bit.ly/Zyk2Wh

● Bite size sessions● Workshops● Video tutorials● Webinars● Hangouts

Page 60: Altmetrics Day Workshop - Internet Librarian International 2014

#Champion● Look to see who on your

campus uses technology and social media

● Take them for a coffee● Get them to present a

session on how they use it

Image CC BY edwin.11 http://bit.ly/1ufH2kP

Page 61: Altmetrics Day Workshop - Internet Librarian International 2014

#Network● Seek out natural

alliesImpact and research support, open access advocates, MOOCsters, library and information professionals, technicians,learning technologists,communications and marketing

Image CC BY Bruno Girinhttp://bit.ly/1zeQnlc

Page 62: Altmetrics Day Workshop - Internet Librarian International 2014

#Practice

Page 63: Altmetrics Day Workshop - Internet Librarian International 2014

Social Media/Altmetric Case study

● Took over Chair of our Communications and Impact (CIG) group in Feb 2014

● Wanted to get more staff using social tools to improve research impact and engagement

● Staff want EVIDENCE ● that it works

Image by: West Midlands Police: https://www.flickr.com/photos/westmidlandspolice/ used via CC BY-SA 2.0 https://creativecommons.org/licenses/by-sa/2.0/

Page 64: Altmetrics Day Workshop - Internet Librarian International 2014

Project!● Agreed to develop a small group of staff

who were not currently using social media to promote their research

● Gave training in Twitter● Regular emails to inform and encourage● Curated Twitter List to monitor their

activities

Page 65: Altmetrics Day Workshop - Internet Librarian International 2014

Results!● All of them are now tweeting at least once

per fortnight● All have gained 30+ followers● Some are much more active, writing own

tweets, MT-ing, etc.● But! Lots of them just retweet :0(● But then again, its early days :0)

...Next, I begged, borrowed and stole their PPTs and Posters...

Page 66: Altmetrics Day Workshop - Internet Librarian International 2014

Slideshare!

● ...to do a companion, comparative study on Slideshare

● Slides of posters and conference PPTs currently on web pages also uploaded to SlideShare

● Half tweeted, half not● Compared views for each ● half of ‘trial’

Page 67: Altmetrics Day Workshop - Internet Librarian International 2014

Results!● All slides/posters have had over 35 views

in 5 months● 70% have over 100● Tweeted ones have average of 166● Non-Tweeted ones have average of 55

views● So these things work in ● tandem with eachother!

MICHELLE PORUCZNIK ANIMATED GIFSOURCE: porucz.tumblr.com

Page 68: Altmetrics Day Workshop - Internet Librarian International 2014

Brainstorming sessionValue in Altmetrics:

What questions do people have around Altmetrics? What are their biggest concerns?What is missing from Altmetrics?What are you doing already?

Page 69: Altmetrics Day Workshop - Internet Librarian International 2014

Lunch

Page 70: Altmetrics Day Workshop - Internet Librarian International 2014

Afternoon Agenda

3.30: Break3.50: Ehsan continued…4.00: Getting mobile, how using mobile apps can help you engage more with Altmetrics 4.20: The Altmetric Explorer4.30: What’s on the horizon? What does the future for scholarly dissemination and impact?4.45: Wrap up and questions

Page 71: Altmetrics Day Workshop - Internet Librarian International 2014

Getting mobile, how using mobile apps can help you engage more with Altmetrics

● The working day is busy enough already● Your mobile device is with you most of the time● 1 or 2 minutes per day (on a commute?) could reap benefits● Twitter is an obvious win for the time- pressed, but what else?

Image by David Lytle: https://www.flickr.com/photos/dlytle/:, used via CC BY 2.0 https://creativecommons.org/licenses/by/2.0/

Page 72: Altmetrics Day Workshop - Internet Librarian International 2014

The Altmetrics Home Screen!

Twitter: tweet links, retweet, start discussions, promote yourself and what you do- your ‘brand’

BBC News: a great source of news stories- if one relates to your research areas, move quickly! Tweet it, and your research papers- make the link in people’s minds.

Page 73: Altmetrics Day Workshop - Internet Librarian International 2014

The Altmetrics Home Screen!

Podcasts: Listen and learn, not just about other’s research, but how to talk about it in lay terms, for a podcast audience

Camera/Photos: You never know when an opportunity to get a shot that could be used with a blog post/podcast will arise- be ready!

Page 74: Altmetrics Day Workshop - Internet Librarian International 2014

The Altmetrics Home Screen!

Blogger: Blog on the go! Dictate content and add images via blogging apps, save and publish later if needs be- get that idea down!

Hootsuite: post to multiple social networks in one! Facebook, Twitter, LinkedIn and more, and use auto-schedule, to avoid pre-work ‘blackspots’ on social media

Page 75: Altmetrics Day Workshop - Internet Librarian International 2014

The Altmetrics Home Screen!

LinkedIn- post to ‘groups’ for targeted impact- can post same things you’d tweet, but with more characters to play with!

audioBoom! (formerly audioBoo): record short audio- yourself or things around you, and share, embed, etc- podcasting ‘lite’

Page 76: Altmetrics Day Workshop - Internet Librarian International 2014

3 things you can do

1. Find what works for you2. Be patient and keep trying3. Look on social and altmetric sites and see

whether they have app versions

Page 77: Altmetrics Day Workshop - Internet Librarian International 2014

Altmetric Explorer: Tasks to try

1. Which article published in the Lancet has seen the most attention in the last week?

2. Find 3 DOIs for articles published by your researchers - and then search for them in the Explorer

3. How many articles mentioned in the last year and published in the Journal of Personality & Social Psychology have been mentioned in a policy document?

http://bit.ly/M0aQmz

Page 78: Altmetrics Day Workshop - Internet Librarian International 2014

What’s on the horizon? What does the future for scholarly dissemination and impact

http://www.theguardian.com/higher-education-network/blog/2012/sep/19/peer-review-research-impact-altmetrics

Page 79: Altmetrics Day Workshop - Internet Librarian International 2014
Page 80: Altmetrics Day Workshop - Internet Librarian International 2014

New era for peer review?

Page 81: Altmetrics Day Workshop - Internet Librarian International 2014

http://www.ncbi.nlm.nih.gov/pubmedcommons/ (Last Accessed 14/10/2014)

Page 82: Altmetrics Day Workshop - Internet Librarian International 2014

http://www.papercritic.com/

Page 83: Altmetrics Day Workshop - Internet Librarian International 2014
Page 84: Altmetrics Day Workshop - Internet Librarian International 2014

https://theconversation.com/profiles/tom-stafford-91781/articles

Page 85: Altmetrics Day Workshop - Internet Librarian International 2014
Page 86: Altmetrics Day Workshop - Internet Librarian International 2014

https://www.youtube.com/watch?v=ysa5OBhXz-Q

Page 87: Altmetrics Day Workshop - Internet Librarian International 2014

http://www.cdc.gov/phpr/zombies_novella.htm

Page 88: Altmetrics Day Workshop - Internet Librarian International 2014
Page 90: Altmetrics Day Workshop - Internet Librarian International 2014

Wrap up and questions

Page 91: Altmetrics Day Workshop - Internet Librarian International 2014

Thank you

For more information@catherinelucy@andy_tattersall@beakybeecroft@ehsanwlv@altmetric@scharrlib