ETS Criterion® ETS Criterion®

Using Computer Technology to Improve Student Writing

Using Computer Technology to Improve Student Writing

Presentation for 21st Century Teaching Symposium, San Jose State UniversityKim V. Morin, California State University, Fresno

Patricia Backer, San Jose State UniversitySeptember, 2012

Currently Active102 Faculty 319 Classes8, 990 Students

Currently Active102 Faculty 319 Classes8, 990 Students

2

Improving Student Writing Initiative

Improving Student Writing Initiative

September 2012

How This All BeganHow This All Began

In 2009-

I was looking for a solution!

In 2009-

I was looking for a solution!

3September 2012

All GE Courses have a Writing Requirement:

All GE Courses have a Writing Requirement:

1,000 words – lower division 2,000 words – upper division Must be iterative with opportunities for

revision

1,000 words – lower division 2,000 words – upper division Must be iterative with opportunities for

revision

4September 2012

I Believed In Giving Writing Assignments To Students…I Believed In Giving Writing Assignments To Students…

“Writing helps with

–Making personal connections–Problem solving–Reasoning–Communication skills.”

5September 2012

Especially with the needs of students on our Campus…Especially with the needs of students on our Campus…

DEMOGRAPHICS: First generation college:

68% English proficiency:

63% freshmen require English remediation

Prior instruction in grammar often inconsistent

DEMOGRAPHICS: First generation college:

68% English proficiency:

63% freshmen require English remediation

Prior instruction in grammar often inconsistent

6September 2012

But I Kept Asking…But I Kept Asking…

“Where Is the Time to Grade

All of Those

Essays?”

“Where Is the Time to Grade

All of Those

Essays?”7September 2012

So I Discovered…So I Discovered…

ETS Criterion®A Computer Essay Scoring program

ETS Criterion®A Computer Essay Scoring program

8September 2012

About ETS Criterion®About ETS Criterion®

• Students write and revise essays online

• Diagnostic Feedback / Holistic Score within 20 seconds

• Faculty can create their own prompts or use the ETS Topics Library

• Errors are highlighted but not corrected

• Students write and revise essays online

• Diagnostic Feedback / Holistic Score within 20 seconds

• Faculty can create their own prompts or use the ETS Topics Library

• Errors are highlighted but not corrected

9September 2012

About ETS CriterionAbout ETS Criterion

Instructors can provide comments Quick access to summary reports Bilingual feedback available (Spanish Simple Registration

• Students purchase Access codes through Bookstore -$13-$15

• One fee provides student use in all classes per term/semester

Instructors can provide comments Quick access to summary reports Bilingual feedback available (Spanish Simple Registration

• Students purchase Access codes through Bookstore -$13-$15

• One fee provides student use in all classes per term/semester

10September 2012

So Far, Evidence suggests- So Far, Evidence suggests-

Criterion® helps improve student writing when combined with effective instructor practice

Criterion® appears useful for editing grammar and mechanics

Students who use Criterion® are more engaged with the writing process

Criterion® helps improve student writing when combined with effective instructor practice

Criterion® appears useful for editing grammar and mechanics

Students who use Criterion® are more engaged with the writing process

11September 2012

Surveys-What Students Liked Surveys-What Students Liked

Available online 24 hours a dayIt allowed them to correct grammatical or mechanical errors before turning in a paperIt gave immediate feedback

Available online 24 hours a dayIt allowed them to correct grammatical or mechanical errors before turning in a paperIt gave immediate feedback

12September 2012

What

Students

Found

Challenging:

What

Students

Found

Challenging:

Criterion® identified technical terms or citations as errorsThe program identified errors but did not correct themThe program did not grade for content

  

Criterion® identified technical terms or citations as errorsThe program identified errors but did not correct themThe program did not grade for content

  

13September 2012

Faculty Feedback – Positive CommentsFaculty Feedback – Positive Comments

Papers were easier to grade The program improved their students’

writing skills Students spent more time revising

written assignments Program promoted critical thinking about

writing process

Papers were easier to grade The program improved their students’

writing skills Students spent more time revising

written assignments Program promoted critical thinking about

writing process

14September 2012

Faculty Feedback - ChallengesFaculty Feedback - Challenges Made mistakes identifying errors Did not reduce their workload Did not do as much as they had

hoped Questioned the cost for the

students Not as effective for technical

writing

Made mistakes identifying errors Did not reduce their workload Did not do as much as they had

hoped Questioned the cost for the

students Not as effective for technical

writing

15September 2012

Comments From StudentsComments From Students

“Awesome program. I find it really useful.” “I like that it is really convenient and I found

myself using the program for all my classes.”

“I started noticing themes in my writing that could use improvement.”

“Awesome program. I find it really useful.” “I like that it is really convenient and I found

myself using the program for all my classes.”

“I started noticing themes in my writing that could use improvement.”

16September 2012

Student VideosStudent Videos Click Here to View Playlist on YouTube Click Here to View Playlist on YouTube

17September 2012

Criterion Pilot at San Jose StateCriterion Pilot at San Jose State

Tech 198, Technology & Civilization 137 students enrolled First research paper assignment due 9/20 96 students submitted their first drafts on

time

Tech 198, Technology & Civilization 137 students enrolled First research paper assignment due 9/20 96 students submitted their first drafts on

time

18September 2012

Error AnalysisError Analysis

19September 2012

Take A TourTake A Tour

ETS CRITERION Online Tour

Click Here

ETS CRITERION Online Tour

Click Here

20September 2012

Contact InformationContact Information

21September 2012

ISWI Broadly Endorsed & Supported By:ISWI Broadly Endorsed & Supported By: Writing Competency Subcommittee (subcommittee of Senate’s GE Committee) Professional Development Subcommittee (subcommittee of Senate’s Personnel Committee) Chair of the GE Committee Office of Undergraduate Studies Division of Graduate Studies Institutional Research & Assessment Planning Director leading faculty ISWI Assessment

Team Provost’s Office as implemented by the Associate Provost through the Center for the

Scholarly Advancement of Learning and Teaching (CSALT) & Technology Innovations for Learning and Teaching (TILT)

Note: The ISWI program was originally conceived and facilitated by Associate Provost Dr. Ellen Junn in Fall, 2009.

Writing Competency Subcommittee (subcommittee of Senate’s GE Committee) Professional Development Subcommittee (subcommittee of Senate’s Personnel Committee) Chair of the GE Committee Office of Undergraduate Studies Division of Graduate Studies Institutional Research & Assessment Planning Director leading faculty ISWI Assessment

Team Provost’s Office as implemented by the Associate Provost through the Center for the

Scholarly Advancement of Learning and Teaching (CSALT) & Technology Innovations for Learning and Teaching (TILT)

Note: The ISWI program was originally conceived and facilitated by Associate Provost Dr. Ellen Junn in Fall, 2009.

22September 2012