Cultivating Change Through Assessment and …...BE BOLD. Shape the Future. 8 NMSU Employee Performance Evaluation-Assessment Goals 2017 Finalized Goals and Objectives Statement Agreed

Cultivating Change Through Assessment and Innovation

DR. ELIZABETH TITUS & KATHERINE TERPIS, NEW MEXICO STATE UNIVERSITYKATY O’NEIL, NOTRE DAME LIBRARY

New Directions in Academic Research Library Assessment Programs

DR. ELIZABETH TITUS AND KATHERINE TERPISNEW MEXICO STATE UNIVERSITY LIBRARY

Elizabeth Titus

Dean of the NMSU Library

Katherine Terpis

Associate Dean of the NMSU Library

New Mexico State University Library

4

1. Presence of an assessment culture throughout the entire organization. • Five-Year Plan• Assessment Component of Library’s Strategic Plan• Employee-Performance Evaluation include assessment goals

2. The organization applies what it has learned to continue or improve the organization.

3. The more you integrate assessment into the organization, the more informed decision-making and awareness of what works, what needs tweaking, and what does not work happens.

BE BOLD. Shape the Future.5

Key elements which contribute to building culture of assessment in the library:

• Implement a sustainable and stable funding and assessment model that addresses the current fiscal environment.

• Increase the use of data-driven, decision-making methods and assessment activities


NMSU Library 5-Year Plan 2013-2018

BE BOLD. Shape the Future. 7

NMSU Library Annual Strategic Plan 2017-2018


NMSU Employee Performance Evaluation-Assessment Goals2017 Finalized Goals and Objectives StatementAgreed upon goals and objectives for the forthcoming year or evaluation period.

Guidelines: A goal is a broad statement explaining the purpose of a particular activity. An objective is a specific and measurable statement or statements in support of the goal. Goals and objectives should not involve routine job tasks. They should be challenging, but also attainable within the evaluation period. It is not necessary for every goal to align with an organizational goal, but there should be some relationship between individual goals and the goals and objectives of the department, the Library Strategic Targets, the library’s five year plan, and the University (Vision 2020) as appropriate. Faculty are encouraged to periodically review and chart progress toward goals and objectives.

Goal 1: Direct a programmatic assessment of the library’s instruction program.Objectives: Collaborate and work with the Instruction Coordinator to assess and review current instruction assessment and data gathering tools. Objectives: Work with Instruction Coordinator to review and enhance current teaching methods among library faculty, including the development of a review/observation cycle.

NMSU Library 5-Year Plan (2013-2018) Goal: Increase the use of data-driven, decision-making methods and assessment activities.


This presentation focuses on the NMSU Library’s assessment activities in partnership with the University’s Office of Assessment


AccreditationHigher Learning Commission

In addition to reviewing distance or correspondence education courses and programs through its substantive change processes, HLC evaluates delivery whenever it comprehensively reviews an institution. In these comprehensive reviews, HLC examines the institution’s capacity to provide education to its students and the quality of its performance in doing so, whether via distance or correspondence education or traditional face-to-face modes. Comprehensive reviews examine curriculum, staffing, support services, access to appropriate laboratory andlibrary resources, and all other facets of quality higher education.

Source: https://www.hlcommission.org/Accreditation/distance-delivery

https://www.hlcommission.org/Accreditation/distance-delivery


Academic Department Program Review (ADPR)

The focus on ADPR assessment is on the question “Are there adequate academic research level library resources to support and meet information resource and access needs for students (undergraduate and graduate) and faculty in the College/Department being assessed?”


Q: Who in the library is typically engaged? • Associate Dean-Team Coordinator

• Dean-Signatory authority

• Collections Coordinator

• Acquisitions Librarian

• Subject Specialists/varies with program under review

• Access Services Manager (ILL, Document Delivery, User Services)

• Library Instruction Coordinator

Q: Who in the university is typically engaged? • Department head or designee re: Academic

Department Program Review.

• Office of Assessment: Program Review Coordinator


Examples of Data Tools Used: • Alma Analytics-Expenditure Reports

• Counter Reports-Standard Usage Compiled by Database Provider

• ILLiad

• Library data metrics

• Scimago Journal and Country Rank

• Specialized tools, eg. JSTOR Analytics, Kanopy Analytics


Office of Assessment-our role in the University level assessment is defined in the ADPR Handbook


III. Self-Study ReportData Sources….p. 9The NMSU Library will provide a report assessing the use of its holdings, research tools, and services relevant to the department/program under review including: monographs, serials, databases, information delivery services, and instruction and reference. When appropriate, the report will also include Government Documents, Archives and Special Collections, and Digital Projects. The assessment will cover a five-year period, when data is available. Based on the assessment, NMSU Library will develop recommendations for optimizing the use of library resources and services and will provide a statement on the Library’s ability to adequately support the program under review.

Note: NMSU Library completes an estimated 7-9 Academic Department Program Reviews per academic year.


E-Process for Requesting a Library Report


E-Process for Requesting a Library Report


Categories typically included in the Library’s Departmental Assessment Report.

Collections• Holdings• Comparisons for Select Peer Institutions• Database Usage• Journals Usage• Expenditures

Interlibrary loan/Document Delivery• Usage by User Type within Department being reviewed

Research Assistance & Instruction• LibGuide Views• # of Instruction Sessions by Courses/User type

Recommendations


Collections


Collections: Select Peer Institutional Comparisons

• Definition: Select Peer Institutions is defined as those program areas where the Academic Department being reviewed has identified other academic institutions it wants to be compared against.


Select Database Usage


Select Journal Usage

Definition of Scimago Journal and Country Rank


Document Delivery and Interlibrary Loan FY 2013-FY 2017

For CAS Biology

Department


Research Assistance & InstructionResearch Assistance & InstructionLibrary subject specialist provide course-related instruction sessions to discuss research methods, highlight discipline-specific resources, and support course assignments. CAS English Department Instruction

CAS LibGuide # of Guides & Views


Recommendations for College of Arts and Sciences History Department


Lessons learned on the way and next steps:• The more we have embedded assessment throughout all levels of our

organizational, we gain greater awareness of needs to be refined and/or discontinued.

• We need more personalized face-to-face conversations between departments being assessed and library.

• E-submission is efficient, but is substantially enhanced by having face-to-face conversations.

• Start the process as early as possible.

• Everyone learns more about whether we are actually we are meeting the needs of the academic departments and there is always room for improvements.

• A zero result is a result, you still need to report it. It triggers a larger question…Why you have a zero result?

BE BOLD. Shape the Future.

Katherine TerpisNMSU LIBRARY

[email protected]

Elizabeth TitusNMSU LIBRARY

[email protected]

Three years and changeMaking friends in all the right places to innovate

KATY O’NEILL, LOYOLA / NOTRE DAME LIBRARY

Katy O’NeillAssociate DirectorResearch & Technology Services

Independent academic library in Northwest Baltimore serving:

§ Loyola University Maryland

§ Notre Dame of Maryland University

§ 6,100 FTE

§ FY18 Acquisitions – 91% electronic

§ 125,000 sf building renovated in 2008

At LNDL, it takes two… ?

Objectives:

§ Provide vision for technologies that expand access and usability of library resources in support of the teaching, learning, and research priorities of Loyola and Notre Dame

§ Recommend a baseline of hardware, software, server hosting, and data storage that is financially feasible

§ Describe a year by year plan for purchasing which can be modified as needs evolve

Technology audit launched in 2015?

Three year technology plan adopted?Future Services

§ Combined service desk

§ 21st Century Instruction Labs

§ Student Innovation Lab / Makerspace

§ Faculty Teaching and Learning Lab

§ Digital Scholarship Center

§ Upgrade of Library’s ILS

Core Operations

§ Hardware modernization

§ Optimize contracted software services

§ Improve access with Single Sign On

§ Stabilize operations with migration of servers to Loyola Technology Services

§ Upgrade web presence usability and accessibility

§ Digitization and preservation of Archives and Special Collections

§ Service Level Agreements

2013 2014 2016

Introduced Adaptive Technology Lab

Expanding Access to Collections

Updated Gallery & Cyber Café with New Furniture

ChargedStudent Advisory & Social Media Committees

2015

Upgraded Auditorium and Instruction Labs Technology

Opened Copyright Information Center

Started Building Use & MarketingStudies

Installed Virgin Mary Seated With Christ Child Exhibit

Expanding Access to Collections Library Liaison Program Updated

Building Audit and Implementation

Universities Strategic Planning: LUM & NDMU

Phased Space Plan Reports & Assessment Audit

Technology Audit and Implementation

Growing Institutional Capacity

LNDL is co-creating technology enabled experiences and spaces with users…

?

2017 2018

Opened Collaboratory in the Library

Conducted Website Usability Study

Launched Makerspace and Pop Up Class Series

Mainstreamed Adaptive Technology

Piloted Digital Pop Up Classes

Integrated Circulation & Reference into Single Help Desk

Replaced Curtain Wall of Windows and an Outdoor Terrace

Opened Digital Learning Commons on Main Level with New Collaborative Learning Spaces

Launched New Library Website

Piloting IDEA Space Innovation Partnership with New Furniture

The Innovation Station Updates: Virtual Reality, Visualization Wall, and Recording Studio

Assessment Review

…to support research, teaching and learning?

Innovating through partnerships supporting teaching and learningImage from Aperio/Women’s Literary Club of Baltimore

Innovating through partnerships in physical space planningImage from Aperio/Women’s Literary Club of Baltimore

Innovating through partnerships in virtual spaceImage from Aperio/Women’s Literary Club of Baltimore

Ensemble Video

Single Sign On Preservica

Innovating the user experienceImage from Aperio/Women’s Literary Club of Baltimore

It’s about continuous outreach and engagement…?

And none of this happens without a creative staff and a culture of assessment?

Katy O’NeillLOYOLA / NOTRE DAME LIBRARY

[email protected]