Program ReviewOverview

October 19, 2007

• To improve the quality of teaching and learning by systematically reviewing goals, priorities,

activities and outcomes. Continual improvement requires a review process that evaluates progress toward goal achievement and assists in refinement of goals and objectives.

• It allows faculty and administrators to assess the program’s contribution to BCTC’s mission, values, and goals

Purpose

Program Review

• Reorganized under broad concepts that demonstrate program vitality (and currency), effectiveness, and efficiency

• Incorporates annual program review summaries

• Eliminates unnecessary or duplicative elements

Revised – What’s New?

Program Review

• All academic programs/areas are reviewed on a 5-year summative cycle

Cycle of Review

Program Review

2002-03 2003-04 2004-05 2005-06 2006-07

IMDRCPRADBT

NursingDental HygieneEnvironmentalDental LabNuclear Medicine

ArchitectureGen. Ed.Electrical CIT (deferred)ECE (deferred)

CIT (deferred from 03-04)Industrial maintenanceHVACWelding

Civil Eng.IECERCPCollision RepairCarpentryAuto. Tech

2007-08 2008-09 2009-10 2010-11 2011-12IMD/ITCADRADMachine ToolBUSMed. Assist.

Surg. TechDental HygieneDental LabDental AssistNMTEnv. Science

ArchitectureGen. Ed. Electrical Tech. ParaeducatorFire RescueEng. Tech.

Cosmetology/Esth.Industrial Maint.CITHVACWeldingRNLPNNurse Aide

IECECivil Eng.RCPCollision RepairCarpentryAuto Tech

• Currency/Vitality?• Students• Alumni• Advisory Committees• Employers

• Effectiveness• Quality• Measures

• Efficiency• Program Cost• Space Utilization• Full-time to Adjunct Faculty• Space Utilization• Course Section Capacity

Are our programs viable and improving?

Program Review

Annual Program Review Summary - Quality of Education

Program Review

Program Name:                          

EffectivenessIndicators

PerformanceStandard

Measurement/ Data Source

Responsiblefor collecting data

2001- 2002

2002- 2003 AP2 2003-

2004 AP2 2004-2005 AP2 2005-

2006 AP2 2006-2007 AP2

I. Effectiveness                            A. Quality of Education                          

StudentSatisfaction

At least 85% of AAS graduates will indicate they are satisfied with the quality of their education.

Exit and Alumni Surveys

IEP

                     

ProfessionalLicensure

Graduates will successfully pass professional licensure exams at or above available norms (national or state).

Board and/or Certification Exam Scores

ProgramCoordinator

                     

Employer Satisfaction

At least 85% of employers will indicate graduates are academically prepared for employment.

Employer Survey IEP

                     At least 85% of employers will indicate graduates are competent in general education.

Employer Survey IEP

                     

Faculty Credentials

100% of faculty must meet SACS criteria.

Faculty Credential File

AcademicAffairs

                     100% of faculty must meet external accreditation standards

Faculty Credential File

Program Coordinator

                     

Annual Program Review Summary - Vitality

Program Review

Program Name:                          

EffectivenessIndicators

PerformanceStandard

Measurement/ Data Source

Responsiblefor collecting data

2001- 2002 2002- 2003 AP* 2003- 2004 AP* 2004-

2005 AP* 2005- 2006 AP* 2006-2007 AP*

B. Vitality                            

Job Placement

At least 90% of graduates will secure employment in their field of study within six months of graduation.

Exit and Alumni Surveys

IEP

                     Annual Unduplicated Headcount of Program Majors

At least 12 students enrolled in program in most recent full term. (Fall)

IPEDSCPE

IEP

                     

Advisory Committee Participation

At least 75% of external members will attend one meeting within the Academic year.

Advisory Committee Members

Program Coordinator

                     

Advisory Committee

At least 85% of Advisory Committee survey respondents will indicate they agree or strongly agree with survey items.

Program Advisory Committee Survey1

IEP

                     

GraduatesAt least 12 graduates per year (CPE).

CPE Data IEP

                     

Student Retention

Adequate to ensure program efficiency (excludes graduates from retention %).

Fall to fall retention data excluding transfers and readmits

IEP

                     

Annual Program Review Summary - Efficiency Program Review

Program Name:                          

EffectivenessIndicators

PerformanceStandard

Measurement/ Data Source

Responsiblefor collecting data

2001- 2002

2002- 2003 AP* 2003-

2004 AP* 2004-2005 AP* 2005-

2006 AP* 2006-2007 AP*

II. Efficiency                            

 

Annual Program Costs Annual Program Efficiency Report

IEP

                     Space Utilization Annual Program

Efficiency ReportIEP

                     Full-Time to Adjunct Faculty

Course Capacity Report

IEP

                     Average Course Section Capacity

Course Capacity Report

IEP

                     1More information available on request 2Action Plans - All effectiveness indicators not meeting performance standards must be addressed by Action Plans. Action Plans must indicate action(s) to be implemented to eliminate the deficiency(ies) to allow for meeting the performance standard. This is a program responsibility requiring immediate attention with the development of a detailed plan effect positive change in meeting the performance standard. Any action required will be incorporated into the following year's program planning. The overall responsibility will be that of the Program Coordinator and Division Chair.

Program Coordinator Date

Division Chair Date

• Annual Program Review Summary/Action Plans• Review of Annual Action Plans by Deans of Academic

Affairs• Preparation of Self-Study (5-Year)• Evaluation by External Review Team• Vice President’s Leadership Team reviews Team

Report and Action Plan

Components of Periodic Review Process

Program Review

• How does this relate to the annual program review?

• Data collection on cycles

• Established performance standards

• On-going annual analysis at program level

• Relevance to goal-planning

Desired Institutional Outcomes

Program Review

• Program Description and Information

• Quality of Education

• Vitality

• Efficiency

• Summary and Recommendations

Format

Program Review

Calendar -

Program Review

Bluegrass Community and Technical CollegeProgram Review Distribution of Activities Calendar

Date Institutional Effectiveness and Planning OfficeOngoing IE provides the Area/Program Coordinator with all necessary data to complete the program review

Academic Affairs OfficeMay 07 AA provides orientation to the Area/Program CoordinatorMay 07 AA provides Program Review Guide and the Program Review Report template to the Area/Program CoordinatorSept 07 AA recruits external and student review team members and finalizes team membershipOct 07 AA arranges for official appointment letters to be sent to review team membersDec 07 AA schedules orientation for review team chairs Dec 07 AA distributes the Program Review Guide and completed Program Review Report to review team chairsJan 08 AA coordinates dates for availability of the LCC President, Academic Dean, and conference room and sends these dates to team

chairs and coordinatorsJan 08 AA arranges food for site-visit daysJan 08 AA schedules laptop computer for use in conference room on the site-visit dayFeb 08 AA provides an onsite evaluation survey to be completed by review team members at the end of site-visitMar 08 AA monitors the submission of the Program Review Report and the Program’s Action Plan to Academic Council by the appropriate

deadlineSum 08 AA assembles and maintains a notebook as a permanent record for each program review that includes all key features of the

review processSum 08 AA compiles surveys and makes necessary adjustments to the process for the following year

Calendar-Continued

Program Review

Area/Program CoordinatorFall 07 Coordinator works with program members to prepare report

Jan 08 Coordinator submits reports to the Division Assistant Dean and Deans of Academic Affairs for review and signaturesFeb 08 Coordinator works with the Review Team Chair to determine the site-visit date and agenda and communicates this

information to the Academic Affairs OfficeFeb 08 Coordinator schedules students, advisory board, and faculty presence on the site-visit dayFeb 08 Coordinator arranges for advisory board parkingFeb 08 Coordinator provides any supplementary information/documentation needed by review team membersFeb 08 Coordinator confirms student, faculty, and advisory committee member attendance prior to site-visitApril 08 Coordinator makes any factual corrections to the final draft of the site-visit reportApril 08 Coordinator begins meeting with program faculty to prepare an action plan addressing any program

recommendations identified in the preliminary site-visit report including who is responsible for the action and the date of e expected completion

April 08 Coordinator sends one electronic and one hardcopy of the action plan to the Academic Affairs Office by the appropriate deadline

Review Team ChairJan 08 Chair attends the program review orientation

Feb 08 Chair arranges first meeting with review team members and schedules future meetings as necessaryFeb 08 Chair distributes the Program Review Guide and the completed Program Review Report to all review team members Feb 08 Chair establishes review team member’s responsibilities/dutiesMar 08 Chair leads review team activities during site-visit and assumes responsibility for team’s preliminary reportMar 08 Chair reports preliminary findings to the President and Academic Dean at the end of the site-visit dayMar 08 Chair sends a final draft of the preliminary site-visit report to the other review committee members and the Coordinator to make any factual corrections necessaryMar 08 Chair confirms accuracy of the report and submits one electronic and two hardcopies of the final report to the Academic Affairs Office by the appropriate deadline

Note: Exact dates will be established and provided for critical steps in the process.

• Purpose• Provide program/area with an external perspective

of quality and effectiveness of educational outcomes

• Composition of Review Team – 5 members(2 past or present program/area coordinators from outside the division, 1 faculty member from within the program, 1 member from outside the college, 1 student)

External Review Team

Program Review

• Reorganized under broad concepts that demonstrate program vitality (and currency), effectiveness, and efficiency

• Incorporates annual program review summaries

• Eliminates unnecessary or duplicative elements

Revised – What’s New?

Program Review

• Program Coordinator and Review Team Chair select site visit date and develop agenda in coordination with dates from Academic Affairs and president’s Office

• Review Team conducts site visit and develops report

• Review Team report distributed to Program/Area Coordinators

External Review Team

Program Review

Agenda

Program Review

Time Description8:00-8:15 a.m. Introduction and Overview-Meeting with the President, VP and Deans of Academic

Affairs, Program Coordinator, Division Assistant Dean

8:15-8:45 a.m. Meeting, VP and Deans of Academic Affairs

9:00-9:45 a.m. Meeting with Program Advisory Committee

9:45-10:00 a.m. Break

10:00-11:00 a.m. Meeting with program faculty (full-time, part-time, voluntary)

11:00-11:15 a.m. Tour of educational facilities

11:15 a.m-12:00 p.m. Meeting with currently enrolled students

12:00-3:00 p.m. Working lunch-Team discuss findings and prepare report

3:15-4:00 p.m. Presentation of preliminary findings-President, VP and Deans of Academic Affairs, Program Coordinator, Division Assistant Dean, program faculty

• Programs develop Action Plans

• CRC, Faculty Senate and Vice President of Academic Affairs Leadership Team review Site Team Report and Action Plan

• President prepares an Executive Summary Report

College Roles

Program Review

• Program Review Document will be in a form with expandable text boxes

• Pre-set tables

Fall 2007

Program Review

It’s about students…….

Questions??