Assessment of

Academic Advising

Tuesday, April 21, 2015

Carolyn Blattner (UCAE) & Elena Payne-Wiens (CoAA)

Goals

• Discuss basic principles of assessment of advising• Consider tools for assessment• Review current UNC Charlotte academic advising

assessments• Discuss best practices for assessment of

academic advising• Consider challenges of assessment

Assessment

Palomba and Banta (1999). Assessment Essentials.

“Assessment is the systematic collection, review, and use of information about educational programs undertaken for the purpose of improving student learning and development.”

What do we assess?

Customer satisfaction• How satisfied with advising overall…

Learning Outcomes/Objectives• UNCC has 7 Advising Learning Outcomes

Patterns/trends• Numbers of contacts, survey data over time

Why do we assess?

• Improve services• Help students attain goals• Understand strengths/barriers

Continuous Improvement

UNCC Advising Outcomes (1)

As a result of the academic advising process at UNC

Charlotte, students will be able to

1. Evaluate personal interests and abilities leading to the

creation of realistic academic and professional goals.

2. Access and navigate the University online resources

and processes.

3. Develop an educational plan that leads to the timely

completion of educational goals.

UNCC Advising Outcomes (2)As a result of the academic advising process at UNC

Charlotte, students will be able to

4. Access University academic and student support services

and resources.

5. Follow academic and administrative policies and procedures.

6. Develop the critical thinking and independent decision-

making skills to make and accept responsibility for academic

decisions.

7. Discover and integrate co- and extra-curricular activities and

programs that enhance the collegiate experience.

Current University Surveys

1. SOAR surveys (every session)• Response rate: FR = 89%, TR = 46%• 6-7 questions on advising

2. Nat’l Survey of Student Engagement - NSSE• First-years and Seniors every other Spring (2014, 2016…)• 2014 Response rate: FR= 17%, SR = 20%• 11 questions on advising

3. Sophomore Survey – every 3rd Spring (2013, 2016…)

• 13 questions on advising

4. Graduating Senior Survey - every 3rd Spring (2013, 2016...)

• 2013 Response rate: 77%• 6 questions on advising

Other advising surveys• BCoB – email (9 Qs), certain weeks of advising – SurveyShare

• CoE – email (5 Qs), annually (March) – Campus Labs

• CHHS – email (26 Qs), annually, after reg. – Qualtrics

• CoAA – email (10 Qs), annually, after reg. – Campus Labs

• UCOL – email (24 Qs), during advising – SurveyShare

• Criminal Justice – email (9 Qs), during advising– SurveyShare

• CLAS – computer (8 Qs), after advising session – Qualtrics

• CoED – computer, Seniors, required – TaskStream

• OASES – comp./email (16 Qs), during advising – Campus Labs

4 Common Question GroupsTIME

• sufficient• quality• availability

INFORMATION• courses, requirements, degrees• policies, procedures• support options, referrals• special opportunities• career and grad school

DEMEANOR• professional, courteous, • friendly, approachable• listened carefully, concerned

OVERALL SATISFACTION & Comments

How can the data be used?

In several ways:

1. Provide informal feedback to advisors

2. Gauge effectiveness of services and processes

3. Gain general understanding of student satisfaction

4. Identify new initiatives, training, technology, etc.

5. Test effectiveness of new initiatives, technology, etc.

6. Other?

Challenges?

Feedback loop – sharing results

Using results

“Complainers” (how information is used)

Other?

Brainstorm!

Other ways to assess advising?

What else are we curious about?Feedback from advisors, directors, other constituents

besides students?

Resources

Advising Redesign Report 2015: Academic Advising

Assessment Questions and Longitudinal Data – UNC Charlotte,

February, 2015 – includes data on all University surveys over

time. (Ask Advising Redesign rep)

Palomba, C.A., & Banta, T. W. (1999). Assessment essentials. San Francisco, CA: John Wiley & Sons, Inc.

NACADA website – nacada.ksu.eduAssessment of Academic Advising BibliographyAssessment of Academic Advising Overview