11
Achieving Quality Enhancement Achieving Quality Enhancement Through Institutional Effectiveness Through Institutional Effectiveness
in Changing Timesin Changing Times
Ms. Phuong T. T. Nguyen, Dr. Diane E. Oliver, & Dr. T. Gilmour ReeveMs. Phuong T. T. Nguyen, Dr. Diane E. Oliver, & Dr. T. Gilmour Reeve
Texas Tech UniversityTexas Tech University
2005 SACS-COC Annual Meeting; December 3-6, 2005; 2005 SACS-COC Annual Meeting; December 3-6, 2005; Atlanta, GeorgiaAtlanta, Georgia
22
Co-authorCo-authorss
ModeratorModerator
– T. Gilmour Reeve, Ph.D.:T. Gilmour Reeve, Ph.D.: Director of Strategic Director of Strategic Planning, President’s Office, Texas Tech UniversityPlanning, President’s Office, Texas Tech University
PresenterPresenter
– Phuong T. T. Nguyen: Phuong T. T. Nguyen: Doctoral Candidate Doctoral Candidate (December 2005), Higher Education Program, (December 2005), Higher Education Program, College of Education, Texas Tech UniversityCollege of Education, Texas Tech University
Co-authorCo-author
– Diane OliverDiane Oliver, , Ph.D.:Ph.D.: Visiting Assistant Professor, Visiting Assistant Professor, College of Education, Texas Tech University College of Education, Texas Tech University
33
PanelistsPanelists
– Dr. Mary C. Jones, Dr. Mary C. Jones, Jefferson Community & Jefferson Community & Technical CollegeTechnical College
– Dr. A. Rebecca Owens, Dr. A. Rebecca Owens, Texas Tech Texas Tech UniversityUniversity
– Dr. Teresa A. Summers, Dr. Teresa A. Summers, Louisiana State Louisiana State University SystemUniversity System
44
FormatFormat
Research-Based PresentationResearch-Based Presentation
Interviews with higher education Interviews with higher education professionals involved in institutional professionals involved in institutional effectiveness effectiveness
Discussion by PanelistsDiscussion by Panelists
The practice of institutional effectiveness The practice of institutional effectiveness
Audience Discussion, Questions, and Audience Discussion, Questions, and AnswersAnswers
55
BackgroundBackground
Two primary environmental challenges for higher Two primary environmental challenges for higher education institutions:education institutions: – a funding crisisa funding crisis (fiscal, human, and physical resources; (fiscal, human, and physical resources;
increased enrollments)increased enrollments)
– increased accountabilityincreased accountability
How to retain core values and continuous quality How to retain core values and continuous quality enhancement while coping with these enhancement while coping with these challengeschallenges
66
DefinitionsDefinitions
Quality Quality enhancementenhancement
Institutional Institutional effectivenesseffectiveness
Comprehensive efforts to Comprehensive efforts to improve the institution and improve the institution and its programsits programs
““Presumes that each institution is Presumes that each institution is engaged in an ongoing quest for engaged in an ongoing quest for quality and can demonstrate how quality and can demonstrate how well it fulfills its stated purpose” well it fulfills its stated purpose” (SACS-COC, 1998, p. 17) (SACS-COC, 1998, p. 17)
- Broad-based- Broad-based- Planning and assessment - Planning and assessment - A multi-layered system- A multi-layered system
77
Institutional Effectiveness ParadigmInstitutional Effectiveness Paradigm
Purpose Statement
GOATs (Goals,
Objectives, Activities, & Tasks)
Use of Assessment
Results
Assessment& Evaluation
ASSESSMENT
Formative & Summative
PLANNING
SWOT analysis,
specific measurable outcomes,
assessment methods
IMPLEMENTATION OF PLANS
ADJUSTMENTS FOR IMPROVEMENT
88
PurposesPurposes
To identify how institutional effectiveness To identify how institutional effectiveness benefits institutions in achieving quality benefits institutions in achieving quality enhancementenhancement
To identify how institutional effectiveness not To identify how institutional effectiveness not only benefits the institution, departments, and only benefits the institution, departments, and units, but also the work of faculty and staffunits, but also the work of faculty and staff
99
SignificanceSignificance
To fill a void in the literature by considering To fill a void in the literature by considering institutional effectiveness at each level of the institutional effectiveness at each level of the institutioninstitution
Planning and assessment Planning and assessment (critical components of (critical components of
institutional effectiveness)institutional effectiveness) help higher education help higher education professionals to maintain core values by enhancing professionals to maintain core values by enhancing their ability to anticipate and effectively address their ability to anticipate and effectively address environmental challenges in changing timesenvironmental challenges in changing times
1010
MethodsMethods
Review of the literature on institutional Review of the literature on institutional effectiveness effectiveness
Interviews with professionals who are Interviews with professionals who are knowledgeable concerning institutional knowledgeable concerning institutional effectiveness practices at four institutions effectiveness practices at four institutions in the SACS region in the SACS region
1111
Findings Regarding Benefits of Findings Regarding Benefits of Institutional EffectivenessInstitutional Effectiveness
For all levelsFor all levels (the institution, departments and (the institution, departments and units, and the work of faculty and staff)units, and the work of faculty and staff)
For the institution, departments, and For the institution, departments, and unitsunits
For the work of faculty and staffFor the work of faculty and staff
1212
Findings Regarding Benefits of Findings Regarding Benefits of Institutional EffectivenessInstitutional Effectiveness
For all levelsFor all levels (the institution, departments and units, and the (the institution, departments and units, and the work of faculty and staff)work of faculty and staff), , institutional effectivenessinstitutional effectiveness::
– Provides evaluative data analysis forProvides evaluative data analysis forDecision makingDecision makingResponding to unpredictable environmental challenges Responding to unpredictable environmental challenges Evaluating progress toward achieving the mission and goalsEvaluating progress toward achieving the mission and goals
– Enables university-wide ongoing planning and Enables university-wide ongoing planning and evaluation in breadth and depth, meeting external evaluation in breadth and depth, meeting external accountability while maintaining unique identity and accountability while maintaining unique identity and core values core values
– Helps obtain resources from the state and Helps obtain resources from the state and stakeholdersstakeholders
1313
Findings Regarding Benefits of Findings Regarding Benefits of Institutional EffectivenessInstitutional Effectiveness
For For the institution, departments, and unitsthe institution, departments, and units, , institutional effectiveness:institutional effectiveness:
– provides evidence and support for SACS-COC provides evidence and support for SACS-COC
reaffirmation as well as programmatic accreditationreaffirmation as well as programmatic accreditation
– improves curriculum and instruction as well as improves curriculum and instruction as well as programs and services for students programs and services for students
– helps to strategically allocate resourceshelps to strategically allocate resources
1414
Findings Regarding Benefits of Findings Regarding Benefits of Institutional EffectivenessInstitutional Effectiveness
For the work of faculty and staffFor the work of faculty and staff, institutional , institutional effectivenesseffectiveness::
– Leads to a more integrated overall effort, a stronger sense of Leads to a more integrated overall effort, a stronger sense of ownership of programs and services, and a clearer measure of ownership of programs and services, and a clearer measure of expected outcomes expected outcomes
– Gives faculty and staff a voice in planning and assessmentGives faculty and staff a voice in planning and assessment
For faculty:For faculty:Helps the faculty members to move from only concentrating Helps the faculty members to move from only concentrating on the individual class to an awareness of the need to on the individual class to an awareness of the need to improve the quality of the overall academic program improve the quality of the overall academic program Provides an opportunity for professional developmentProvides an opportunity for professional development
For staff:For staff:Engages staff in the institution, department, and unit Engages staff in the institution, department, and unit missions missions
1515
Recommendations Regarding Good Practices Recommendations Regarding Good Practices for Improving Institutional Effectivenessfor Improving Institutional Effectiveness
Promote a culture of planning and assessmentPromote a culture of planning and assessment
Integrate institutional effectiveness with budgeting, and Integrate institutional effectiveness with budgeting, and resource allocation resource allocation
Keep the process simple and minimize extra work Keep the process simple and minimize extra work
Provide training and one-on-one tutorials Provide training and one-on-one tutorials
Involve broad-based participationInvolve broad-based participation
Develop accessible assessment documentationDevelop accessible assessment documentation
1616
ConclusionsConclusions
Good practices can address some negative aspects of Good practices can address some negative aspects of institutional effectivenessinstitutional effectiveness (e.g., time-consuming, resistance to change)(e.g., time-consuming, resistance to change)
Institutional Effectiveness:Institutional Effectiveness:
– is an essential tool for achieving quality enhancement and is an essential tool for achieving quality enhancement and preserving core values preserving core values
– helps to project environmental challenges, identify problems, helps to project environmental challenges, identify problems, and make adjustments thus enabling quality enhancement and make adjustments thus enabling quality enhancement
Ultimately institutional effectiveness benefits students by Ultimately institutional effectiveness benefits students by improving the learning environmentimproving the learning environment
1717
Panel CommentsPanel Comments
MODERATORMODERATOR
– Dr. T. Gilmour ReeveDr. T. Gilmour Reeve, Texas Tech University, Texas Tech University
PANELISTSPANELISTS
– Dr. Mary Jones, Dr. Mary Jones, Jefferson Community & Technical Jefferson Community & Technical CollegeCollege
– Dr. Rebecca Owens, Dr. Rebecca Owens, Texas Tech UniversityTexas Tech University
– Dr. Teresa A. Summers, Dr. Teresa A. Summers, Louisiana State University Louisiana State University SystemSystem
1818
Dr. Mary C. JonesDr. Mary C. Jones
DirectorDirector
Institutional Effectiveness, Institutional Effectiveness, Research & Planning Research & Planning
Jefferson Community & Technical Jefferson Community & Technical CollegeCollege
2020
Dr. Rebecca OwensDr. Rebecca OwensManaging DirectorManaging Director
Office of the Provost, Texas Tech UniversityOffice of the Provost, Texas Tech University
Programs for Academic Programs for Academic Support ServicesSupport Services
Learning CenterLearning Center
Supplemental InstructionSupplemental Instruction
XL: Strategies for XL: Strategies for LearningLearning
Developmental Education Developmental Education ProgramProgram
Testing AccommodationsTesting Accommodations
Academic Testing ServicesAcademic Testing Services
National and State National and State Standardized TestingStandardized Testing– Admission ExamsAdmission Exams– Certification ExamsCertification Exams– CLEP (course credit)CLEP (course credit)
Extended Studies and Extended Studies and Outreach ExaminationsOutreach Examinations
Make-up Examination Make-up Examination ServiceService
2121
Benefits of Institutional EffectivenessBenefits of Institutional EffectivenessPlanningPlanning– Provides a “map” for the upcoming yearProvides a “map” for the upcoming year– Increases awareness of each unit’s contributionsIncreases awareness of each unit’s contributions– Understanding of other’s job demands and Understanding of other’s job demands and
responsibilitiesresponsibilities– Drawing upon each person’s expertiseDrawing upon each person’s expertiseAssessmentAssessment– Clarify what is importantClarify what is important– Opportunities for growth and developmentOpportunities for growth and development– Curricular changes in programsCurricular changes in programs– Revise strategic planRevise strategic plan
2222
Dr. Teresa A. SummersDr. Teresa A. Summers
Assistant Vice-President for Assistant Vice-President for Academic AffairsAcademic AffairsLouisiana State University SystemLouisiana State University System
Cliff & Nancy Spanier Alumni Cliff & Nancy Spanier Alumni Professor in Human EcologyProfessor in Human Ecology
2323
Institutional Effectiveness at LSUInstitutional Effectiveness at LSU
Used to develop QEPUsed to develop QEPFocused on issues/concerns revealed in:Focused on issues/concerns revealed in:– Institutional dataInstitutional data
– Graduating Student surveysGraduating Student surveys
– Longitudinal study of Gen EducationLongitudinal study of Gen Education
– Coop. Inst. Research Project (CIRP)Coop. Inst. Research Project (CIRP)
– Your First College Year (YFCY)Your First College Year (YFCY)
– National Survey of Student Engagement National Survey of Student Engagement (NSSE)(NSSE)
2424
Institutional Effectiveness at LSUInstitutional Effectiveness at LSU
For example….For example….
Comparisons of LSU results on NSSE: Comparisons of LSU results on NSSE: – LSU seniors comparable to seniors at peer LSU seniors comparable to seniors at peer
institutionsinstitutions
– LSU freshmen lower on NSSE Benchmarks LSU freshmen lower on NSSE Benchmarks than peer freshmenthan peer freshmen
Level of Academic ChallengeLevel of Academic Challenge
Active and Collaborative LearningActive and Collaborative Learning
Student-Faculty InteractionStudent-Faculty Interaction
Enriching Educational ExperiencesEnriching Educational Experiences
2525
Institutional Effectiveness at LSUInstitutional Effectiveness at LSU
As part of QEP….As part of QEP….
Implemented Implemented SSummer ummer RReading eading PProgramrogram– Introduces incoming freshmen to academic/ Introduces incoming freshmen to academic/
intellectual culture intellectual culture – Fall semester begins with Academic Convocation Fall semester begins with Academic Convocation
with Book authorwith Book author– After Convocation, students meet and discuss After Convocation, students meet and discuss
Book with faculty members and other students Book with faculty members and other students – Book tied to other campus events, courses Book tied to other campus events, courses
throughout yearthroughout year– ((www.lsu.edu/srpwww.lsu.edu/srp))