SECOND ANNUAL MEMBER SECOND ANNUAL MEMBER MEETING AND TRAININGMEETING AND TRAINING

MEMBER UPDATE AND FOCUS MEMBER UPDATE AND FOCUS ON MEASUREMENT TOOLSON MEASUREMENT TOOLS

COSMA UpdateCOSMA Update

40 institutional members40 institutional members21 individual members21 individual members2 accredited institutions2 accredited institutions14 institutions have achieved 14 institutions have achieved

Candidacy StatusCandidacy Status5 institutional site visits between 5 institutional site visits between

October 2010 and May 2011October 2010 and May 2011

TrainingTraining

Two full trainings held each yearTwo full trainings held each yearOctober – AAHPERD October – AAHPERD

headquartersheadquartersMarch – AAHPERD ConventionMarch – AAHPERD Convention

Additional training – NASSM Additional training – NASSM ConferenceConference

Webinar training - TBAWebinar training - TBA

Website Payment Website Payment OptionOption

Annual dues and site visit application fee online Safe and secure portal requiring member login Receipt sent to your inbox Take credit card payment only

Accreditation Accreditation PrinciplesPrinciplesOutcomes AssessmentOutcomes AssessmentStrategic PlanningStrategic PlanningCurriculumCurriculumFacultyFacultyScholarly & Professional ActivitiesScholarly & Professional ActivitiesResourcesResources Internal & External RelationshipsInternal & External RelationshipsEducational InnovationEducational Innovation

Principle 1: Outcomes Principle 1: Outcomes AssessmentAssessment

Five assessment areas – mission and goals, student Five assessment areas – mission and goals, student learning outcome measures, basic skill development, learning outcome measures, basic skill development, personal development, operational outcomes measurespersonal development, operational outcomes measures

Included in the Self Study:Included in the Self Study:

1. Copy of O/A plan1. Copy of O/A plan2. Results of implementation in five assessment 2. Results of implementation in five assessment

areasareas3. Summary of changes, improvements needed3. Summary of changes, improvements needed4. Summary of action plans to make changes4. Summary of action plans to make changes5. Summary of realized outcomes from action plans5. Summary of realized outcomes from action plans6. Narrative showing integration of O/A results into 6. Narrative showing integration of O/A results into

strategic planstrategic plan

Creating the O/A Plan

Mission and broad based goals Student learning outcomes Basic skills development Student personal development Operational outcomes measures

Mission and Broad-Based Goals

Student Learning Outcomes

What is a learning outcome? Description of what Description of what

your students are your students are able to doable to do

Clear and Clear and measurablemeasurable

Related to the goals Related to the goals of the institutionof the institution

Identify Identify measurement tools measurement tools you will use/rubric you will use/rubric designdesign

Institutional Goals

Program Learning Outcome

Communicate effectively both orally and written.

Comprehension and application of professional written and oral communication business skills.

Measuring Learning Outcomes

• Identify a minimum of:• two direct measures• two indirect measures

• Explain the process for how your measures will provide meaningful results

• Provide copies of your instruments/rubrics in the appendix

Direct Measures of Student Learning

Demonstrate direct evidence of student learning:

• Comprehensive exams • Standardized national exams • Pretest and posttest assessments • Required structured internship• Portfolios (electronic or traditional)• Capstone project assessment• Thesis/Dissertation• External certification program (e.g., NSSE)

Indirect Measures of Student Learning

Ask students about their learning:

• Graduate survey• Alumni survey• Employer survey• Exit interview• Advisory Boards• Student focus groups• Anecdotal evidence

Sample Measurement Tools

Saint Leo University – Phil Hatlem

Dowling College – Marilyn Mather

California University of PA – Charles Crowley

Troy University – Christina Martin

York College of PA – Molly Hayes Sauder

Liberty University – Vicky Martin

University of North Florida – Jennifer Kane

Basic Skills Development

Prepare a statement on the “Basic Skills” development program at your institutionDescribe how this is administered within the SM department

• Programs to help students with writing deficiencies• Tutoring services

Personal Development of Students

Prepare a statement on the “Personal Development” of students at your institution

Describe how this is administered within your SM department

-- Special programs focused on personal development – interpersonal skills, student leadership

-- First year seminar

Operational MeasuresHow you will measure effectiveness of your SM

program and accomplish goals and objectives outlined in strategic plan:

• Graduate and internship placement rates• Teaching evaluations• Retention rates• Graduation rates• SWOT analysis• Faculty scholarship• University-based assessments (okay for

program level)

Institutional Goals

Program Learning Outcome

Benchmark Measurement Tool

Communicate effectively both orally and written.

Comprehension and application of professional written and oral communication skills.

80% of the students will meet defined proficiency standards in writing skills using the writing rubric

80% of the students will meet defined proficiency standards in presentation skills using the presentation rubric

Written assignments in BU450 evaluated with Rubric

Presentations in BUS 311 evaluated with Rubric

Final Step – Action Plans

Institutional Goals

Student Learning Outcomes

Benchmark Measurement Tool

Results Action Plan

Communicate effectively both orally and written.

Comprehension and application of professional written and oral communication business skills.

80% of the students meet proficiency standards in writing - measured using writing rubric

Written assignments

in BU210

and BU404

85.6% of the student in BU210 & BU404 met the standard

Continue to record scores for writing evaluation the these two courses.

Discuss the possibility of a standardized test in the core courses to meet this competency

Problem Areas

• Direct measures – linking measure to specific outcome

• Rubric development & data collection-- Go beyond using course grades

• Role of teaching evaluations

Useful Resources for Rubric Development

1. http://course1.winona.edu/shatfield/air/rubrics.htm

2. http://academic.scranton.edu/department/assessment/ksom/