Introduction to Assessment – Support Services Andrea Brown Director of Program Assessment and...

Introduction to Assessment – Support Services

Andrea BrownDirector of Program Assessment and Institutional Research

Dr. Debra BryantAccreditation Liaison

The Three Questions of Assessment

• What are we trying to do?– What is our purpose or mission?

• How well are we achieving our purpose? – How well are we doing it?

• How can we improve?– What can we do better?

Why Assessment?

• Purpose– To clarify our purpose, why we exist

• Effectiveness and Accountability– To answer the question, are we effective– To be accountable to our customers

• Success/Improvement– To tout our success– To find areas of weakness to improve

• Planning– To plan for the future

You Already Do Assessment

• You already do assessment, BUT we don’t document it well– What process, policy, software, equipment,

position have you changed or added in the last year?

– Why did you do it? What evidence did you have that led you to the decision for change?

– Assessment is documenting that process

Use Results to Make Improvements and

Revise

Gather & Analyze Data Interpret Findings

Establish Measures/Benchmarks

for each Objective

Identify Department Objectives (1-2)

University Mission & Core ThemesLearning, Values, Community

Diagram adapted from The Assessment Model – University of San Francisco

Assessment Model

Map Department Objectives to Core Themes

Getting Started

• 1) University’s Mission Statement Core Themes and Objectives– Mission Statement: Dixie State University is a

teaching institution that strives to enrich its community and the lives of its students by promoting a culture of learning, values, and community.

– Core Themes and Objectives, see handout

Getting Started

• 2) Department Mission Statement – Have or create a mission statement for your

department/unit– All staff members should be involved– It should clarify what your purpose is– How do you link back to the University’s mission

statement?– Is it available on your website?

Getting Started

• 3) Department Objectives– Have or create 3-4 department objectives– All staff members should be involved– They should be specific, clear, concise and

measureable– They should link back to your department mission

statement– This is the “how” you will fulfill your mission

statement

Getting Started

• 4) Align Objectives– Align your department objectives to the

University’s Core Theme Objectives– You do not need to link to all of the Core Themes– You do not get any extra points for linking to all

Core Themes or any punishment for not linking to the Core Themes

– Aligning with the Core Themes may help us at the University level find more data

Getting Started

• 5) Know Your Data– What data do you currently have or collect that

would speak to your mission statement and hence your objectives

– Know what data is worth collecting• What does it tell you?• What can you do about it?• Is it Quantitative? – Numbers, how many• Is it Qualitative? – Satisfaction, how good

Getting Started

• SSAR Form A– All the getting started data is collected on the

SSAR Form A– The SSAR Form A once created will just need to be

revisited each year for updates and revisions– Due June 28, 2013

Use Results to Make Improvements and

Revise

Gather & Analyze Data Interpret Findings

Establish Measures/Benchmarks

for each Objective

Identify Department Objectives (1-2)

University Mission & Core ThemesLearning, Values, Community

Diagram adapted from The Assessment Model – University of San Francisco

Assessment Model

Map Department Objectives to Core Themes

Yearly Assessment

• 1) Identify 1-2 Objectives to Assess– Pick what you want to evaluate this year– We recommend evaluating all of your Objectives

the first year, that way you have a better idea of what data you need, what data you want, and how to get it, it will also help you plan for questions in the Institutional Surveys

Yearly Assessment

• 2) Establish Measures/Benchmarks– What are you going to measure• One should be Quantitative (Numbers, how many)• One should be Qualitative (Satisfaction, how well)

– What is the Benchmark• Baseline – First time/look at the data• Threshold – Minimum acceptable mark• Target – Your ultimate goal

Assessment Tools

• Things you may want to consider for measurements – Qualitative– Institutional Surveys (Graduating/Alumni, Student,

Faculty/Staff, Community, Employer)– Department Surveys (Students, Customers,

Community, etc.)– Focus groups (1-2 hours of high usage customers to

give you feedback)– SWOT Analysis (Strengths, Weaknesses,

Opportunities, Threats)

Yearly Assessment

• 3) Gather and Analyze Data – Interpret Findings– Gather Data

• How will you collect your data• Who is the target, what is the sample• What is the time frame

– Analyze Data• What does this tell you• Who does this tell you about, who doesn’t it tell you about

– Interpret Findings• What can you do about it• What should you do about it

Yearly Assessment

• 4) Use Results to Make Improvement and Revise – Close the Loop– Use Results• Propose and implement changes

– Revise if Necessary• Make changes to your objectives• Make changes to your measures/benchmarks• Make changes to your data gathering process

Yearly Assessment

• SSAR Form B– Will be created each year and will be completed in

two parts – Planning, and Implementing– Will need to be updated in July each year (this

year 2013) up through the Data Collection Method - Planning

– Then at the end of May the following year (next year, 2014) the rest of the form will be completed and submitted with your results and actions taken - Implementing

Uses of SSAR Forms

• A guide to improve department functionality– It is for you, don’t make it just paperwork

• Submitted to and archived by your chain of command up to the Vice President, and to Program Assessment and Institutional Research

• Used in the University’s Annual Report 2013/2014 year

Timeline

• Due Dates– SSAR A Form – Due June 28, 2013– SSAR B Form – Planning section, up through Data

Collection – Due August 2, 2013– SSAR B Form – Implementing section, with Results

and Action Taken – Due May 30, 2014– SSAR A Form – Due May 30, 2014 (for 2014/2015

year)

Questions

• Questions about the process?• Questions about the SSAR Forms?• Questions about the use of the SSAR Forms?• Questions about the timeline?