DAF Survey Results, research data network

06/09/2016

Research Data Network Meeting

Understanding researchers’ needs2016 DAF survey findings – Rob Johnson (Research Consulting)@rschconsulting

The DAF Toolkit

The Data Asset Framework (DAF) toolkit allows institutions to:»Identify, Locate, and Describe digital assets»Assess how they are managed

06/09/2016

Jisc Shared Research Data Pilot Meeting

Towards a refined DAF surveyResearch Consulting was tasked with the development of a refined version of the DAF survey.

06/09/2016


2016

Today

Apr May Jun Jul Aug

Analysis of existing DAF surveys from pilot institutions1/4/2016

Begin development of a refined DAF survey25/4/2016 Pilot institution

feedback26/5/2016

Final version of the refined DAF survey28/6/2016

Launch of the DAF survey at 6 pilot institutions4/7/2016

Analysis of the survey results and reporting5/8/2016

06/09/2016

Shared Research Data Pilot Meeting

Profile of the survey respondents

Profile of respondents by Institution

06/09/2016


»The survey gathered a total of 1,185 responses.

37%

25%

21%

10%5% 1%

The University of CambridgeSt Andrews UniversityPlymouth UniversityLancaster UniversityCRESTThe Royal College of Music (RCM)

06/09/2016


Survey Results

»Full anonymised dataset is now online:» Johnson, Rob; Chiarelli, Andrea; Parsons, Tom (2016):

Data asset framework (DAF) survey results 2016. figshare.

»http://dx.doi.org//10.6084/m9.figshare.3796305

»Or just google it!Jisc Shared Research Data Pilot Meeting06/09/201

6

http://dx.doi.org/10.6084/m9.figshare.3796305


Top 10 types of digital research data

06/09/2016


Audio files (e.g. interviews, music)Models/algorithms

Simulation data, models & software codeObservational dataText files (e.g. .txt)

Digital photographs and other imagesData collected from sensors/instruments (e.g. microscopes)

Data automatically generated from or by computer programsSpreadsheets

Documents or reports (e.g., Word, PDF, etc.)

0% 10% 20% 30% 40% 50% 60% 70% 80%Percentage of respondents

Research Data Management

06/09/2016


40%

37%

23%

NoYesNot sure

»Do researchers have a research data management plan?

Sensitive research data

06/09/2016


»What types of sensitive data do researchers hold?

Patient identifiable data

Other types of confidential/restricted data

Commercially sensitive data

Sensitive personal data

Personal data about identifiable living individuals

0% 5% 10% 15% 20% 25%Percentage of respondents

Sensitive research data

06/09/2016


“It would be helpful to clarify the rules for storing anonymised data on cloud services. My

departmental rules say this is never OK, however this seems to contradict University rules.”

Location of research data

06/09/2016


»Professors vs. PGR Students

University-managed network storage

Cloud service – Dropbox

Hard disk drive of a computer owned by the University

Hard disk drive of a privately-owned computer

External hard drive or memory stick/USB/Flash drive

0% 50% 100%

PGR Students (N=443)

Percentage of respondents






0% 50% 100%

Professors (N=105)



University services to support RDM

“Support is woeful in the university currently, in particular long-term data archiving is critically

required. Most of my non-current data is rotting on CD's and hard-drives.”

06/09/2016

Impacts of research data loss

06/09/2016


»17% of respondents had lost data, resulting in…

Failure to meet regulatory requirements

Failure to meet funder requirements

Reputational damage

Reduction in quality of research outputs

Delay to publication

Wasted research effort

0% 10% 20% 30% 40% 50% 60% 70% 80%Percentage of respondents with lost data

Preservation of research data

06/09/2016


»How much data has long-term value?

Not sure

More than 1 TB

501GB-1TB

101 GB- 500 GB

51-100 GB

<50 GB

0% 5% 10% 15% 20% 25% 30% 35% 40%

Data owned at presentData expected to have long term value



06/09/2016


»How would respondents expect to preserve their data?

General data repository

Discipline-specific data repository

Other - Please specify:

Institutional data repository



06/09/2016


“I currently spend about £1,200 pa on data storage from my own salary. I have the highest data needs in my School, and there is no plan in

place for storing my data.”


06/09/2016


»For how long do respondents expect their data to be preserved?

5-10 years

>10 years

I don't know

1-5 years

0% 5% 10%15%20%25%30%35%40%45%

For how long would you expect this data to be preserved?



06/09/2016


»Do you follow guidelines for metadata?

48%

34%

18%

NoNot sureYes

Sharing research data

06/09/2016


»68% of respondents either already share data or expect to do so in the future. What motivates them?

University Research Data PolicySaves time and effort of sharing results with individuals

My funder requires data sharingSafeguards research integrityIncreases citation and impact

Verification of research findingsPotential for others to re-use the data

Research is a public good and should be open to all



06/09/2016


»Do researchers use university services to support data management and sharing?

35%

29%

16%

10%

10% 0%I don't know what services are available

I don't currently use these services, but I expect to in future

I already use these services I don't expect to use these services

Not sure There are no services available

Training needs on Research Data Management

06/09/2016


Technical support for data processing, e.g. database design, High Per-formance Computing (HPC)

Ethics, consent and legal issues with research data

Copyright and intellectual property rights within a data context

Funder requirements for research data management

Guidance on costing data management in grant applications

Publishing research data

Security of data

Collaboration and sharing of data

Developing a research data management plan for a funding application

Long-term storage of your data

0% 10% 20% 30% 40% 50%



06/09/2016


“Please, individualise the support. Workshop are useless, emails with information are useless, brochures are useless, posters are useless.”

Lessons learned

06/09/2016


»Incentives› voucher for first N

respondents + draw for the rest of the respondents

› higher amount of smaller vouchers

»Dissemination› direct emails› weekly staff newsletter› library blog› library tweets› research office/research staff blog› staff portal› PGR portal› link on RDM guidance page/newsletter› targeted reminders to “missing” departments

06/09/2016


Institutional focus groups

Focus groups

06/09/2016


1. To allow researchers to make Jisc aware of their issues and concerns

2. To collect use cases for the RDSS3. To inform and stimulate discussion on

important data and metadata issues

»What are the aims of the focus groups?

»Timeline of focus groups

Focus groups

06/09/2016


2016

Today

May Jun Jul Aug Sep Oct

Oct/Nov TBCUniversity of Surrey Lancaster University St George's Hospital Medical School University of York University of St Andrews Cardiff University

Focus groups

06/09/2016


Business development managers“I want to create news stories around the data sets, so as to use them as impact case studies.“

»Sample use cases:Researchers“I want to be able to encrypt data uploaded to the repository, so sensitive or commercial data can be safely stored.“

“I want to know who is reusing my data, so that I can collaborate and learn more about their use.“Reusers of data“I want to know licence and policy for reuse, so that I am clear what I can do with the data. “

Conclusions

06/09/2016


Filling a gap75% of respondents look first to their institution to preserve their data

AdvocacyOnly 16% of respondents are currently accessing university RDM support services

Public datasets>70% recognise that research is a public good and should be publicly released

MetadataOnly 18% of respondents say they follow established metadata guidelines

Sensitive data41% of respondents have some form of sensitive data

Uptake of RDMOnly 40% of respondents have a Research Data Management plan


The DAF dataset

»The data used for this analysis is available as a csv dataset at:

»http://dx.doi.org//10.6084/m9.figshare.3796305

Contact: [email protected]

@rschconsulting 06/09/2016



mailto:[email protected]

06/09/2016


Additional slides2016 DAF survey findings – Rob Johnson (Research Consulting)@rschconsulting

Profile of respondents by Role

06/09/2016


»The survey respondents had 9 different roles.

38%

18%

16%

9%

9%

4%4%1% 1%

Postgraduate student (e.g. MA, MSc, MEng, PhD, etc.)Lecturer/Research FellowResearch Assistant/Post DocSenior Lecturer/Senior Research FellowProfessorAssistant/Associate Pro-fessorOtherAdministrative/ProfessionalTechnician

Volume of research data

06/09/2016


»How much data do researchers hold?

Not sure

More than 1 TB

501GB-1TB

101 GB- 500 GB

51-100 GB

<50 GB

0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50%

Professors (N=105)PGR students (N=442)All respondents

Location of research data

06/09/2016


»Where is research data stored (Top 5)?






0% 10%20%30%40%50%60%70%80%

All respondents


Loss of research data

06/09/2016


»Have researchers ever lost data?

83%

17%

NoYes

Top 3 causes for loss of data1.Hardware failure2.Human error3.Equipment stolen

Sharing research data

06/09/2016


»How do you share data with other researchers?

By upload to a web site or FTP server accessible to that researcher

Institutional file-sharing service

Share it on an academic social network (e.g. Academia, ResearchGate, Mendeley)

Using portable storage such as CDs, DVDs, memory sticks etc.

Using a cloud storage service e.g. Dropbox, Google Drive etc.

By emailing data files

0% 20% 40% 60% 80%Percentage of respondents

Education

DAF Survey Results, research data network