27
Managing Your Data What to do when a research project ends Sandi Caldrone Purdue University Research Repository (PURR) [email protected] April 22. 2020

Your Da ta Ma na g ing€¦ · 01. d a ta a b out other d a ta (e.g . la b els , titles , units , ta g s , etc .) (noun) Meta d a ta. Title Au th o r (s) Abstr a ct Ke y te r ms If

  • Upload
    others

  • View
    0

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Your Da ta Ma na g ing€¦ · 01. d a ta a b out other d a ta (e.g . la b els , titles , units , ta g s , etc .) (noun) Meta d a ta. Title Au th o r (s) Abstr a ct Ke y te r ms If

ManagingYour DataWhat to do when a research project ends

Sandi Caldrone

Purdue University Research Repository (PURR)

[email protected]

April 22. 2020

Page 2: Your Da ta Ma na g ing€¦ · 01. d a ta a b out other d a ta (e.g . la b els , titles , units , ta g s , etc .) (noun) Meta d a ta. Title Au th o r (s) Abstr a ct Ke y te r ms If

To-DoCapture metadata

Consider publication

Back up and archive

Update your resume or CV

1.

2.

3.

4.

Page 3: Your Da ta Ma na g ing€¦ · 01. d a ta a b out other d a ta (e.g . la b els , titles , units , ta g s , etc .) (noun) Meta d a ta. Title Au th o r (s) Abstr a ct Ke y te r ms If

CaptureMetadata 01

Page 4: Your Da ta Ma na g ing€¦ · 01. d a ta a b out other d a ta (e.g . la b els , titles , units , ta g s , etc .) (noun) Meta d a ta. Title Au th o r (s) Abstr a ct Ke y te r ms If

data about other data (e.g. labels, titles,units, tags, etc.)

(noun)

Metadata

Page 5: Your Da ta Ma na g ing€¦ · 01. d a ta a b out other d a ta (e.g . la b els , titles , units , ta g s , etc .) (noun) Meta d a ta. Title Au th o r (s) Abstr a ct Ke y te r ms If

TitleAuthor(s)AbstractKey termsIf sharing or publishing

LicenseCitation

Dataset Metadata

For example: Netherly, T. G., Trout, M. E., Bell, E., Buckmaster, D. (2019). Combined annual crop yields and dailyweather data for Midwest counties 1970-2015. Purdue University Research Repository. doi:10.4231/5P9A-KQ03

Page 6: Your Da ta Ma na g ing€¦ · 01. d a ta a b out other d a ta (e.g . la b els , titles , units , ta g s , etc .) (noun) Meta d a ta. Title Au th o r (s) Abstr a ct Ke y te r ms If

For example: Netherly, T. G., Trout, M. E., Bell, E., Buckmaster, D. (2019). Combined annual crop yields and dailyweather data for Midwest counties 1970-2015. Purdue University Research Repository. doi:10.4231/5P9A-KQ03

Page 7: Your Da ta Ma na g ing€¦ · 01. d a ta a b out other d a ta (e.g . la b els , titles , units , ta g s , etc .) (noun) Meta d a ta. Title Au th o r (s) Abstr a ct Ke y te r ms If

a text file provided by the author with thebackground information necessary forsomeone else to understand and use thedataset

(noun)

ReadMe File

Page 8: Your Da ta Ma na g ing€¦ · 01. d a ta a b out other d a ta (e.g . la b els , titles , units , ta g s , etc .) (noun) Meta d a ta. Title Au th o r (s) Abstr a ct Ke y te r ms If

1. RESEARCHDESCRIPTION

2. INSTRUMENTS ANDSOFTWARE USED

3. FILE MANIFEST 4. DATA DICTIONARY

Purpose, data collectionmethods, analyses conducted,and any connection to largerprojects.

All tools used to collect andanalyze the data includinginstrument calibrations andsoftware versions.

List with a brief description ofeach file (or group of files), filetype, and the software used tocreate it.

Define all column labels,abbreviations, acronyms, keyterms, and units ofmeasurement.

What to include in a ReadMe file?

More information on creating a ReadMe file: https://purr.purdue.edu/kb/metadata

Page 9: Your Da ta Ma na g ing€¦ · 01. d a ta a b out other d a ta (e.g . la b els , titles , units , ta g s , etc .) (noun) Meta d a ta. Title Au th o r (s) Abstr a ct Ke y te r ms If

ReadMeexample datadictionary

Peel, S., Haas, M. H., Turco, Jr, R. F. (2016). Biological, chemical and flowcharacteristics of five river sampling sites in the Wabash River watershed nearLafayette, Indiana – 2015. Purdue University Research Repository. doi:10.4231/R7RR1W7B

Page 10: Your Da ta Ma na g ing€¦ · 01. d a ta a b out other d a ta (e.g . la b els , titles , units , ta g s , etc .) (noun) Meta d a ta. Title Au th o r (s) Abstr a ct Ke y te r ms If

ConsiderPublication02

Page 11: Your Da ta Ma na g ing€¦ · 01. d a ta a b out other d a ta (e.g . la b els , titles , units , ta g s , etc .) (noun) Meta d a ta. Title Au th o r (s) Abstr a ct Ke y te r ms If

PUBLISH

Public goodValidationFunder or publisherrequirementsAuthor credit

To publish or protect?

PROTECT

ConfidentialityIntellectual propertyLegal restrictions

More information on sensitive data: http://guides.lib.purdue.edu/sensitivedata

Page 13: Your Da ta Ma na g ing€¦ · 01. d a ta a b out other d a ta (e.g . la b els , titles , units , ta g s , etc .) (noun) Meta d a ta. Title Au th o r (s) Abstr a ct Ke y te r ms If

CheckoutThe Teaching withPURR Data LibGuidehas a directory ofsample publisheddatasets

LibGuide: https://guides.lib.purdue.edu/c.php?g=899358

Page 14: Your Da ta Ma na g ing€¦ · 01. d a ta a b out other d a ta (e.g . la b els , titles , units , ta g s , etc .) (noun) Meta d a ta. Title Au th o r (s) Abstr a ct Ke y te r ms If

Login with Purdue credentials

Create a private project space

Upload data files, ReadMe file, and any other supporting

documents to your private space

Use PURR's publication wizard to add publication metadata (title,

description, etc.)

Submit for review by the PURR team

1.

2.

3.

4.

5.

PURR Publication Process

Step-by-step video tutorials: https://purr.purdue.edu/guides

Page 15: Your Da ta Ma na g ing€¦ · 01. d a ta a b out other d a ta (e.g . la b els , titles , units , ta g s , etc .) (noun) Meta d a ta. Title Au th o r (s) Abstr a ct Ke y te r ms If

Back Up andArchive03

Page 16: Your Da ta Ma na g ing€¦ · 01. d a ta a b out other d a ta (e.g . la b els , titles , units , ta g s , etc .) (noun) Meta d a ta. Title Au th o r (s) Abstr a ct Ke y te r ms If

save(passive)

preserve(active)

Don't just save. Preserve.

Page 17: Your Da ta Ma na g ing€¦ · 01. d a ta a b out other d a ta (e.g . la b els , titles , units , ta g s , etc .) (noun) Meta d a ta. Title Au th o r (s) Abstr a ct Ke y te r ms If

a series of managed activities, policies,strategies and actions to ensure theaccurate rendering of digital content foras long as necessary, regardless of thechallenge of media failure and technological change.

(noun)

Digital Preservation

Page 18: Your Da ta Ma na g ing€¦ · 01. d a ta a b out other d a ta (e.g . la b els , titles , units , ta g s , etc .) (noun) Meta d a ta. Title Au th o r (s) Abstr a ct Ke y te r ms If

1. TEXT 2. SPREADSHEETS

3. IMAGES 4. AUDIO

plain text, comma separatedvalues, tab delimited,OpenDocument Text, PDF/A

OpenDocument spreadsheets,comma separated values, tabdelimited

TIFF, JPG 2000 WAVE

Archival File Formats

More recommendations: https://purr.purdue.edu/legal/file-format-recommendations

Page 19: Your Da ta Ma na g ing€¦ · 01. d a ta a b out other d a ta (e.g . la b els , titles , units , ta g s , etc .) (noun) Meta d a ta. Title Au th o r (s) Abstr a ct Ke y te r ms If

When it comes time to share, publish, or archive your data, save files

in two formats: the proprietary format native to the software, and an

archival format like plain text, csv, or tiff.

Also, be sure to keep a record of the software and version you used

to create your files.

If you're using proprietary software...

Page 20: Your Da ta Ma na g ing€¦ · 01. d a ta a b out other d a ta (e.g . la b els , titles , units , ta g s , etc .) (noun) Meta d a ta. Title Au th o r (s) Abstr a ct Ke y te r ms If

3 2DIFFERENT KINDS OF

STORAGE

COPIES OFIMPORTANT FILES

1AT A REMOTE

LOCATION

3-2-1 Back Up Strategy

Page 21: Your Da ta Ma na g ing€¦ · 01. d a ta a b out other d a ta (e.g . la b els , titles , units , ta g s , etc .) (noun) Meta d a ta. Title Au th o r (s) Abstr a ct Ke y te r ms If

Keeping your USB drive next to your PC

Backing up Google Drive files to another

folder on Google Drive

Assuming ITaP is doing it for you

Only keeping 1 version of active files

Setting an auto back-up and not checking it

Not a back up

Page 22: Your Da ta Ma na g ing€¦ · 01. d a ta a b out other d a ta (e.g . la b els , titles , units , ta g s , etc .) (noun) Meta d a ta. Title Au th o r (s) Abstr a ct Ke y te r ms If
Page 23: Your Da ta Ma na g ing€¦ · 01. d a ta a b out other d a ta (e.g . la b els , titles , units , ta g s , etc .) (noun) Meta d a ta. Title Au th o r (s) Abstr a ct Ke y te r ms If

Update YourResume or CV04

Page 24: Your Da ta Ma na g ing€¦ · 01. d a ta a b out other d a ta (e.g . la b els , titles , units , ta g s , etc .) (noun) Meta d a ta. Title Au th o r (s) Abstr a ct Ke y te r ms If

KNOWLEDGE

Collection methodsSecurity or lab protocolsSpecific tools andsoftware

What have you gained? Be specific.

EXPERIENCE

CollectionOrganizationCleaningAnalysisVisualizationPublicationPreservation

Page 25: Your Da ta Ma na g ing€¦ · 01. d a ta a b out other d a ta (e.g . la b els , titles , units , ta g s , etc .) (noun) Meta d a ta. Title Au th o r (s) Abstr a ct Ke y te r ms If

AuthorStatsavailable for allPURR publications

Netherly, T. G., Trout, M. E., Bell, E., Buckmaster, D. (2019). Combined annual cropyields and daily weather data for Midwestcounties 1970-2015. Purdue UniversityResearch Repository. doi:10.4231/5P9A-KQ03

Page 26: Your Da ta Ma na g ing€¦ · 01. d a ta a b out other d a ta (e.g . la b els , titles , units , ta g s , etc .) (noun) Meta d a ta. Title Au th o r (s) Abstr a ct Ke y te r ms If

Step-by-step video tutorials on using PURR: purr.purdue.edu/guides

Sensitive data LibGuide: guides.lib.purdue.edu/sensitivedata

Directory of sample datasets: guides.lib.purdue.edu/c.php?g=899358

Creating a ReadMe file: purr.purdue.edu/kb/metadata

Real life example of ReadMe files and data dictionary: Peel, S., Haas, M. H., Turco,

Jr, R. F. (2016). Biological, chemical and flow characteristics of five river sampling

sites in the Wabash River watershed near Lafayette, Indiana – 2015. Purdue

University Research Repository. doi:10.4231/R7RR1W7B

Archival file format recommendations: purr.purdue.edu/legal/file-format-

recommendations

Resources

Page 27: Your Da ta Ma na g ing€¦ · 01. d a ta a b out other d a ta (e.g . la b els , titles , units , ta g s , etc .) (noun) Meta d a ta. Title Au th o r (s) Abstr a ct Ke y te r ms If

Thank youSend questions to [email protected].

Sandi Caldrone

Purdue University Research Repository (PURR)

April 22. 2020