Using Assessment to Develop and Expand 

Interdisciplinary Writing Standards across College Levels:

A Collaborative Model for Two- and Four-Year InstitutionsCharlotte Mandell, Vice Provost for Undergraduate Education, University of

Massachusetts Lowell

Elise Martin, Associate Dean of Assessment, Middlesex Community College

Richard Siegel, Professor and Chair of Psychology, University of Massachusetts Lowell

Suzanne Van Wert, Professor of English, Northern Essex Community College

Ellen Wentland, Associate Dean of Academic & Institutional Effectiveness, Northern Essex Community College

University of Massachusetts Boston, April 23, 2012AMCOA Regional Conference

Project Purpose

Use VALUE rubric to collaborate between 2 and 4 year institutions

Identify benchmarks for student achievement

Project Methodology

IRB approval Cohort selection Scorer selectionNorming with rubricRubric modificationArtifact collectionScoring process

Project Results

0 1 2 3 4 NA

118

193

70

100

9

Frequency of differences in scorers’ ratings

Difference between scorers' ratings

Inter-rater reliability = about 30%

Aggregate Results: Average Score by Level

1 2 3 40

0.5

1

1.5

2

2.5

3

Average Rating

Project Insights from Scorers

Division between writing and critical thinking or content mastery

Variation in content area expertise among raters

Issues with use of sources

Project Challenges

Inter-rater reliabilityLogistics of the processIRB process across campusesInconsistent alignment between

rubric and assignmentsIntra- vs. inter-campus use

Project Implications & Recommendations

Establish exemplars Incorporate a 3rd scorer Encourage faculty engagement Define IRB boundaries Align learning outcomes vertically Achieve alignment across institutions

to support successful student transfer

Thanks to our raters!

Dina Bozicas, Lecturer, English Department, University of MA Lowell

Alice Frye, Lecturer, Psychology Department, University of MA Lowell

Patricia Morrow, Professor, Business Department, Northern Essex Community College

Suzanne Van Wert, Professor, English Department, Northern Essex Community College

Stan Hitron, Professor, Humanities and English Departments, Middlesex Community College

Peyton Paxson, Professor, Social Science and Human Services Departments, Middlesex Community College