Embed Size (px)
Citation preview
Martha Kyrillidou
Brinley Franklin
Terry Plum
MINESfor LibrariesTM
ASSOCIATION OFRESEARCH LIBRARIES
Assessing the Value of Networked Electronic Services: The MINES survey
ARL Statistics and Measurement
…To describe and measure the
performance of research libraries and their contribution to
teaching, research, scholarship and community service …
ARL Statistics and Measurement
…To describe and measure the performance of research libraries and their
contribution to teaching, research, scholarship and community service …
Web Presence
StatsQUAL™StatsHome
LibQUAL+DigiQUAL(/digiqual)
MINES(/mines)
SAILS(/sails)
E-Metrics(/emetrics)
ARL Statistics(/arlstats)
Interactive Statistics
(/interactive)?
Login
UserProfile
InstitutionProfile
www.libqual.org
SurveyManagement
• A research methodology consisting of a web-based survey form and a sampling plan.
• Measures who is using electronic resources, where users are located at the time of use, and their purpose of use
• Adopted by the Association of Research Libraries (ARL) as a part of the “New Measures” toolkit in May, 2003.
• Different from other electronic resource usage measures that quantify total usage (e.g., COUNTER, EQUINOX, E-Metrics, ICOLC guidelines, ISO and NISO standards) or measure how well a library makes electronic resources available (LibQUAL+TM, DigiQUALTM).
What is MINES?
• How extensively do sponsored researchers use the new digital information environment?
• Are researchers more likely to use networked electronic resources from inside or outside the library?
• Are there differences in usage of electronic information based on the user’s location (e.g., in the library; on-campus, but not in the library; or off-campus)?
• What is a statistically valid methodology for capturing electronic services usage both in the library and remotely through web surveys?
• Are particular network configurations more conducive to studies of digital libraries patron use?
Questions Addressed
• A representative sampling plan, including sample size, is determined at the outset. Typically, there are 48 hours of surveying over 12 months at a medical library and 24 hours a year at a main library.
• Random moment/web-based surveys are employed at each site.
• Participation is usually mandatory, negating non-respondent bias, and is based on actual use in real-time.
• Libraries with database-to-web gateways or proxy re-writers offer the most comprehensive networking solution for surveying all networked services users during survey periods.
MINES Methodological Considerations
Library web architecture
Web Survey Design Guidelines
• Simple text for different browsers – no graphics– Different browsers render web pages differently
• Few questions per screen or simply few questions• Easy to navigate• Short and plain• No scrolling• Clear and encouraging error or warning messages• Every question answered in a similar way - consistent
– Radio buttons, drop downs• ADA compliant• Introduction page or paragraph• Easy to read
– Must see definitions of sponsored research. • Can present questions in response to answers
Dillman, D.A. 2000 (December). Mail and Internet Surveys, The Tailored Design Method. 2nd Ed. New York: John Wiley & Sons.
Library User Survey
Data was collected at seven main campus libraries and seven academic health science libraries in the U.S., between January, 2003 and January, 2005.
Recent DataCollection Activities
Main University Libraries Academic Medical Libraries
University of Colorado University of Connecticut Health Center
University of Connecticut University of North Carolina
University of North Carolina University of Texas Medical Branch
Oregon State University University of Texas Southwestern
University of Utah University of Utah
University of Virginia University of Virginia
Washington University Washington University
•More than 45,000 networked electronic services uses were surveyed.
•At each library, the MINES survey was one component of a comprehensivecost analysis study that assigned all library costs to sponsored research, instruction/education/non-sponsored research, patient care, other sponsored activities and other activities.
Recent DataCollection Activities
•MINES is also being conducted by the Ontario Council of University Libraries (OCUL) in 2004-2005 in conjunction with ARL.
25%
27%9%
39%
SponsoredResearch
Instruction
Patient Care
Other
On-Campus, Not in the Libraryn = 15,423
In the Libraryn = 6,312
Purpose of Use By LocationMedical Libraries
2003 – 2005
Off-Campusn = 4,375
*83% of sponsored research usage occurred outside the library. 92% of this use took place on-campus.
Overall Usen = 26,110
31%
14%10%
45%
34%37%
13%16%
14%
49%
18%19%
Purpose of Use By Location Main Campus Libraries
2003 – 2005
5%
66%
3%
26%
Sponsored Research
Instruction
Other
Other SponsoredActivities
In the Libraryn = 7,618
On-Campus, not in the Libraryn = 6,641
11%63%
24%
2%
All Usagen = 19,271
•72% of sponsored research usage of electronic resources occurred outside the library; 83% of this took place on campus.
6%
59%
33%
2%
Off-Campusn = 5,012
21%63%
14%2%
Location of Users2003-2005
6,312
19,798
In Library UsersRemote Users
7,618
11,653
Medical Library Main Library
All Libraries
13,930
31,451
30%
40%60%
70%
76%24%
Demographics by Location of UserMain Libraries
20%
27%
8%
45%
GraduateStudents
Faculty, Staff,Research Fellows
UndergraduateStudents
All Other Users
40%
33%
24%3%
27%
12%
22%
39%
38%
62%
In the LibraryOutside the Library
On Campus, Not in the Libraryn = 6,391
Inside the Libraryn = 7,064
Off-Campusn = 4,953
Total Usersn = 18,408
Off-Campusn = 5,133
Demographics by Location of UserMedical Libraries
Inside the Libraryn = 6,635
On Campus, Not in the Libraryn = 19,244
31%
45%
6%
18%
Graduate Students
Faculty, Staff,Research Fellows
UndergraduateStudents
All Other Users
20%
52%
1%
27%
21%
79%
In the LibraryOutside the Library
33%
32%
4%
31%
Total Usersn = 31,012
Electronic Services Sponsored Research Use Compared to Print Journal and Total Library Use
Medical Libraries
0%
10%
20%
30%
40%
50%
E-Resources
Print Journals
Total
Electronic Services Sponsored Research Use Compared to Print Journal and Total Library Use
Main Libraries
0%5%
10%15%20%25%30%35%40%
E-Resources
Print Journals
Total Use
