BUILDING A CULTURE OF ASSESSMENT AT ALBANY

STATE UNIVERSITY

Ian Sakura-LemessyRuth Salter

Amitabh Singh

Workshop Goals

Explain and describe new assessment process and timeline

Illustrate key elements of new five-column reporting format

Describe and explain new web-based submission process

Detail key aspects of new assessment plan due September, 2008

What is Assessment?

Academic Assessment is the systematic and ongoingmethod of gathering, analyzing and using informationfrom measured outcomes to improve student learning.Academic assessment involves three tasks:

•Identify student learning outcomes

•Measure whether the department is achieving the student learning outcomes, and

•Provide steps for improvement based on the results of data

What is Evaluation?

Evaluation uses assessment information tosupport decisions on maintaining, changing, ordiscarding instructional or programmaticpractices. These strategies can impact:

•The nature and extent of learning or the provision of academic support services

•Curricular decision making

•Correspondence between learning and the aims and objectives of teaching and service provision

•The relationship between learning and the environments in which learning takes place

Changes in ASU’s Assessment Reporting (2008-2010)

Converted from a one-year reporting cycle to a two-year cycle

Implementation of a new web-based submission format for all assessment reports

New five-column reporting format Assessment activities coordinated

by Dr. Ruth Salter and Mr. Amitabh Singh

New timeline

Summer, 2008 : Assessment workshops September, 2008: Submit plans September ‘08 - April ’09: Implement

plans and provide mid-term results August ’09 - April ‘10: Continue

implementation April 2010: Submit findings and changes

to be implemented based on the findings

Assessment TimelineSeptember 2008 Assessment plan must be submitted via ASU’s

new electronic submission process in the five-column format that is available on ASU’s assessment website.

Be sure to use the form that applies to your academic or administrative unit.

You can also view a demo at the accreditation website that explains the online submission process in greater detail.

URL: http://asu-sacs.asurams.edu/assessment.aspx

Elements of the Assessment Plan

Department or Program Goals: •Each academic unit must submit an assessment

plan with one major unit goal.•Each Administrative or educational support unit

must submit two goals. Outcomes:

•For each goal, all units must submit three objectives (student learning or administrative outcomes) for each goal.

Means of Assessment:•Each academic unit must submit three means of

assessment for each student learning outcomes.•Each administrative unit must submit at least one

means of assessment for each objective.

Spring 2009

Each unit must submit an annual progress report indicating action steps toward closing the loop on the 2008-2010 assessment cycle.

Spring 2009

Describe and discuss the evaluation method (means of assessment) for each outcome. •Target Audience

•Data Collection

•Tools Used

•Data Analysis

Spring 2009

Implementation of AssessmentDescribe who will be doing what and when

theywill be doing it.

•data collection

•analysis of data

•writing the results

• reporting them

•making decision on results and in what time frame?

Spring 2009

This is also an opportunity to list your resource or research limitations, if there are any•Who is responsible for what?

•Time Line: this time-line should demonstrate action steps taken in meeting critical tasks related to completing assessment report

•Allocation of Resources

•Data, technical support, surveys and other needs

Spring 2010

Full report documenting results of 2008-2010 two-year assessment plan submitted via the web-based submission process. The final report should include goals, objectives, expected outcomes and documentation of use of results (closing the loop).

• What did the results of your assessment show?

• What did you learn about the outcomes assessed?

• What was your assessment plan not able to tell you?

• Based on your results, what decisions were made about program, planning, policy and your assessment plan?

• What was changed? What was kept? And how have they affected: Planning, Budgeting and Policy

WHO NEEDS TO COMPLY

All degree granting programs

All administrative and academic support units

Elements of the Nichols five-column Reporting Format

See Handout

Assessment Plan Due September 2008

See Handout Only three columns of the five-

column format should be filled•Goal

•Objectives

•Means of assessment

How to develop goal statements

Must be linked to your unit’s mission and the overall mission of Albany State University

Must be general and broad

Goal or Objective?

Both are used to describe intended results of education activities

Both provide direction for assessment

What’s the difference: level of precision

Goals

Express results in general terms Describe broad learning concepts

like clear communication, problem solving, ethical awareness

Often come from the University’s mission statement

ASU’s mission

The primary mission of Albany State University is to educate students to become outstanding contributors to society. Offering Bachelor's, Master's and Education Specialist degrees and a variety of non-degree educational programs, the University emphasizes the liberal arts as the foundation for all learning by exposing students to the humanities, fine arts, social sciences and the sciences. Global learning is fostered through a broad-based curriculum, diverse University activities and the expanding use of technology.

Sample goals from ASU’s mission

The primary mission of Albany State University is to educate students to become outstanding contributors to society. Offering Bachelor's, Master's and Education Specialist degrees and a variety of non-degree educational programs, the University emphasizes the liberal arts as the foundation for all learning by exposing students to the humanities, fine arts, social sciences and the sciences. Global learning is fostered through a broad-based curriculum, diverse University activities and the expanding use of technology.

Sample Goals from the Mission

Upon completion of the baccalaureate degree ASU graduates will:

Contribute to society Apply a strong foundation in the

liberal arts to work and life activities Think globally Use technology effectively

Objectives/Outcomes

Express results in specific terms Describe specific behaviors

students should exhibit Always come from the faculty who

teach and assess the program or staff who implement and assess the service

Elements of Expected Outcomes (Objectives)

Describe and outline expected outcomes in clear and concise language

Expected outcomes may include the following: • Intended Program Outcomes

• Intended Process Outcomes

• Intended Student Learning Outcomes

• Intended Student Development Outcomes

• Intended Faculty Development Outcomes

• Intended Staff Development Outcomes

Blooms Taxonomy

Knowledge Comprehension Application Analysis Synthesis Evaluation

Knowledge Verbs

Cite Define Describe Identify Indicate Know Label List

Match Memorize Name Outline Recall Recognize Record Select

Comprehension Verbs Arrange Classify Convert Describe Defend Diagram Discuss Distinguish Estimate Explain

Extend Generalize Infer Locate Outline Paraphrase Predict Restate Summarize Translate

Application Verbs

Apply Change Compute Construct Demonstrate Discover Dramatize Employ Illustrate

Modify Organize Operate Practice Prepare Solve Use Schedule Manipulate

Analysis Verbs Analyze Appraise Break down Calculate Categorize Debate Determine Diagram Test Relate

Differentiate Distinguish Examine Experiment Identify Infer Outline Question Select Solve

Synthesis Verbs

Arrange Assemble Collect Combine Compile Compose Construct Create

Design Devise Explain Formulate Generate Perform Re-construct Revise

Evaluation Verbs

Appraise Assess Choose Compare Conclude Contrast Evaluate Grade Rate

Criticize Decide Relate Revise Score Select Summarize Support Value

Sample Outcomes/Objectives from the Goals

Upon completion of ASU 1200 100% of the students will document

completion of 120 hours of community service

100% will communicate clearly in a 2 page written paper

90% of the students will have a passport

100% will use RamMail for course activities

Means of AssessmentAcademic unitsAcademic units must submit three means of

assessment for each student learning outcome (objectives)

One means of assessment must be a “direct” measure of evaluation• Require students to display their knowledge and skills

as they respond to the instrument itself. • Examples: Objective tests, essays, presentations, and

classroom assignments One means of assessment may be “indirect”

• Students reflect on their learning rather than to demonstrate it

• Examples: Surveys, interviews and focus groups The final means of assessment can either be a direct or

indirect measure

Means of AssessmentSupport units

Non-Academic units (support units) must submit at least one means of assessment for each learning outcome

RESOURCES

Assessment Workshops Survey design and analysis

assistance, data resources, and other support from IR&E

Resources available on the web

Your turn…

Questions? Comments? Suggestions?

Demonstration

Amitabh Singh will demonstrate the submission process

Contacts

Assessment Support: Ruth Salter, ACAD 383G ext. 3986

Technical Support:Amitabh Singh, President’s Building

ext. 7845