Pace/NACTEL Online Testing FIPSE Learning Anytime Anywhere Partnership (LAAP) Grantee

1999 - 2002

David Sachs – Co-Director of NACTEL Program

Nancy Hale - Co-Director of NACTEL Program

Tricia Ahern – Online Testing Coordinator

Testing in an Online Course

Types of assessment: Weekly quizzes Submission of homework and projects (individual

and/or group work) Participation in class discussions Midterm and/or Final exam

Exams composed of: Objective questions (multiple choice, true/false,

fill-in) Essay/ Short Answer responses Hands-on project

Questions that come to mind1. How do we know if the student who is

enrolled in the class, is actually the person taking the exam without assistance from another person or using a resource that is not permitted?

2. Will the student finish the course with the knowledge he/she needs to continue with the program and successfully complete the program with the hopes of utilizing this knowledge in his/her everyday work environment?

Online Testing Issues Need to provide an affordable

method of verifying the identity of test takers

Need to provide a solution that is in keeping with the asynchronous mode of instruction

Need to provide an “immediate” solution

Possible Solutions Incorporate a Proctoring Program Investigate hardware Investigate software

Purpose of Proctoring Program The proctoring program was

designed to focus on the issue of periodic student verification when taking an examination in an online course.

Method of Proctoring Program The student selects a qualified

person who will be able to supervise and administer any major examinations throughout the student’s course.

Brief History Early 1999 - NACTEL program established Summer 1999 - FIPSE Grant awarded to

NACTEL Program October 1999 - Initialized pilot phase for

Late Fall 1999 semester January – August 2000 - Continued pilot

phase through Early Spring, Late Spring and Summer 2000 semesters

September 2000 – Full integration into program

Initial Research Conducted Current online testing methods in

distance education Use of proctoring when taking an

exam NACTEL instructors’ input on

incorporating the use of a proctor

Where to begin? Establish guidelines:

Proctors Students

Make information available online Develop temporary proctor

database

Proctor Requirements Criteria Responsibilities

Student Guidelines Proctor Application Process Prior to Day of Examination Day of Examination After the Examination

1st Pilot of Proctoring Program Late Fall 1999 semester Incorporate into 2 courses

Technical Math DC/AC Electrical Circuits

Student notification

Problems/Concerns Late notification of students Difficulty finding proctor Questioned need of proctor Administration of exams

Surveys conducted Student Surveys Proctor Surveys IOTA

Proctor Database Microsoft Access (temporary

database) SQL (Interact)

Statistics

SEMESTER TOTAL COURSES TOTAL SECTIONS TOTAL STUDENTS STUDENTS WITH PROCTORS

Late Fall 1999 2 2 31 27

Early Spring 2000 3 5 95 95

Late Spring 2000 4 4 53 53

Summer 2000 6 7 112 112

Early Fall 2000 12 17 314 314

TOTALS: 27 35 605 601

Proctoring Program Summary

As of October 1, 2000

NOTE: Numbers are based on students enrolled in each class. Please note that some students are taking more than one

proctored course at a time.

Total Sections

02468

1012141618

Late Fall1999

EarlySpring2000

LateSpring2000

Summer2000

Early Fall2000

TOTAL SECTIONS

Total Students with Proctors

0

50

100

150

200

250

300

350

Late Fall1999

EarlySpring2000

LateSpring2000

Summer2000

Early Fall2000

STUDENTS WITH PROCTORS

Pace/NACTEL Proctor Web site

http://csis.pace.edu/nactel/proctor/proctoring_program.html

Proctor Criteria Principal or Superintendent of an

Educational Institution, either public or private

Dean, Academic Department, or Official Testing Service of an Accredited University or college

Full-Time High School or College Instructor

High School Guidance Counselor Librarian Military Educational Officer Union Representative Official Learning/Tutoring Center Other – Specify(contact Tricia

Ahern)

Added to list: Supervisor Resource/General

Manager Corporate Instructor Company

President/Vice-President

Clergy Law Enforcement

Officer Certified Elementary

Instructor

Responsibilities (initial) Receive the examination via mail, fax, or

computer If received via mail or fax, contact the student to

confirm receipt of the examination Adhere to the specific Proctor Guidelines when

administering the examination Return the completed examination and

Student/Proctor Verification Form by the due date

Proctor may be required to have e-mail and Internet access depending on the course

Responsibilities (changes) Receive the examination online via

CourseInfo using the provided password Student is responsible for contacting

proctor to make necessary arrangements

Proctor is required to have e-mail and Internet access