32
Proctoring Best Practices NCTA and ATP Whitepaper

Proctoring Best Practicesmedia01.commpartners.com/NCTA/2015Conference...encourage test organizations to collaborate in addressing test security concerns. The goals of the Committee

  • Upload
    others

  • View
    1

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Proctoring Best Practicesmedia01.commpartners.com/NCTA/2015Conference...encourage test organizations to collaborate in addressing test security concerns. The goals of the Committee

Proctoring Best Practices

NCTA and ATP Whitepaper

Page 2: Proctoring Best Practicesmedia01.commpartners.com/NCTA/2015Conference...encourage test organizations to collaborate in addressing test security concerns. The goals of the Committee

Agenda

- Project background

- General proctoring overview

- Best Practices highlights

- Conclusion and closing comments

Page 3: Proctoring Best Practicesmedia01.commpartners.com/NCTA/2015Conference...encourage test organizations to collaborate in addressing test security concerns. The goals of the Committee

National College Testing

Association (NCTA)

- NCTA is dedicated to the promotion of professionalism and quality in the

administration of testing services and programs, including issues relating

to test administration, test development, test scoring and assessment.

- The objectives of the organization are to enhance professional testing

practices, offer opportunities for professional development, encourage

professional support activities, and advance collaborative efforts among

testing professionals, testing companies, and other policy-making

agencies.

Page 4: Proctoring Best Practicesmedia01.commpartners.com/NCTA/2015Conference...encourage test organizations to collaborate in addressing test security concerns. The goals of the Committee

Association of Test Publishers (ATP)

and Security Committee (ATP SC)

- The Association of Test Publishers was founded in 1992 to promote and

develop testing and assessment best practices and to facilitate an

environment that would benefit test-takers, businesses, educational

organizations, and society in general.

- Since 2009, the ATP Security Committee (ATP SC) provides a forum to

encourage test organizations to collaborate in addressing test security

concerns. The goals of the Committee are to (1) identify methods to

improve test security, (2) establish and disseminate security best practices,

and (3) protect the integrity of tests and test programs.

Page 5: Proctoring Best Practicesmedia01.commpartners.com/NCTA/2015Conference...encourage test organizations to collaborate in addressing test security concerns. The goals of the Committee

Background

- NCTA and ATP joint effort

- Proctors are #1 way breaches are detected

- Proctoring is a key test security component

Page 6: Proctoring Best Practicesmedia01.commpartners.com/NCTA/2015Conference...encourage test organizations to collaborate in addressing test security concerns. The goals of the Committee

Background

- Document highlights key proctoring

responsibilities for paper and pencil, CBT

and online proctoring:

Preparing the testing facilities

Admitting the test taker

Proctoring during the test

Concluding the test

Completing test responsibilities

Page 7: Proctoring Best Practicesmedia01.commpartners.com/NCTA/2015Conference...encourage test organizations to collaborate in addressing test security concerns. The goals of the Committee

Committee Members - NCTA

• James Wollack, Co-Chair, University of Wisconsin-Madison

• Jarret Dyer, College of DuPage

• Rosemary Freer, Arkansas State University

• Kim McCrackin, Oklahoma State University-Tulsa

• Diane Patterson, Three Rivers College

• Sara Rieder Bennett, The University of Akron

• Steve Saladin, University of Idaho

Page 8: Proctoring Best Practicesmedia01.commpartners.com/NCTA/2015Conference...encourage test organizations to collaborate in addressing test security concerns. The goals of the Committee

Committee Members – ATP

• Rory McCorkle, Co-Chair, PSI

• Kim Brunnert, Elsevier

• Joe Brutsche, Pearson VUE

• Christy Frederes, Ascend Learning

• Jennifer McGlashon, Kryterion

• Roger Meade, Prometric

• Rachel Schoenig, ACT

• Camille Thompson, ACT

• Christie Weidner, Pearson VUE

Page 9: Proctoring Best Practicesmedia01.commpartners.com/NCTA/2015Conference...encourage test organizations to collaborate in addressing test security concerns. The goals of the Committee

What is proctoring?

Page 10: Proctoring Best Practicesmedia01.commpartners.com/NCTA/2015Conference...encourage test organizations to collaborate in addressing test security concerns. The goals of the Committee

What is proctoring?

- Critical test security role

- examine test taker behavior

- enforce test sponsor policies

- facilitate fair & standardized administration

- Examinee support and care

Page 11: Proctoring Best Practicesmedia01.commpartners.com/NCTA/2015Conference...encourage test organizations to collaborate in addressing test security concerns. The goals of the Committee

Proctor responsibilities by stage

Preparation

Admission

During Tests

Test Conclusion

Test Completion

Page 12: Proctoring Best Practicesmedia01.commpartners.com/NCTA/2015Conference...encourage test organizations to collaborate in addressing test security concerns. The goals of the Committee

General Best Practices

- Conflicts of interest

- Confidentiality obligations

Page 13: Proctoring Best Practicesmedia01.commpartners.com/NCTA/2015Conference...encourage test organizations to collaborate in addressing test security concerns. The goals of the Committee

General Best Practices

- Irregularity reports

Page 14: Proctoring Best Practicesmedia01.commpartners.com/NCTA/2015Conference...encourage test organizations to collaborate in addressing test security concerns. The goals of the Committee

General Best Practices

- Overall Test Center Management

Page 15: Proctoring Best Practicesmedia01.commpartners.com/NCTA/2015Conference...encourage test organizations to collaborate in addressing test security concerns. The goals of the Committee

Paper and Pencil Best Practices

Securing Testing Assets

Admission

Identification

Test Administration

Page 16: Proctoring Best Practicesmedia01.commpartners.com/NCTA/2015Conference...encourage test organizations to collaborate in addressing test security concerns. The goals of the Committee

Paper and Pencil Best Practices

Securing Testing Assets

Test Administration

Image from ACT

Page 17: Proctoring Best Practicesmedia01.commpartners.com/NCTA/2015Conference...encourage test organizations to collaborate in addressing test security concerns. The goals of the Committee

Paper and Pencil Best Practices

Securing Testing Assets Admission

Test Administration

Images from Office ClipArt

Page 18: Proctoring Best Practicesmedia01.commpartners.com/NCTA/2015Conference...encourage test organizations to collaborate in addressing test security concerns. The goals of the Committee

Paper and Pencil Best Practices

Identification

Test Administration

Image from Office ClipArt

Page 19: Proctoring Best Practicesmedia01.commpartners.com/NCTA/2015Conference...encourage test organizations to collaborate in addressing test security concerns. The goals of the Committee

Paper and Pencil Best Practices

Test Administration

Test Administration

Image from ACT

Page 20: Proctoring Best Practicesmedia01.commpartners.com/NCTA/2015Conference...encourage test organizations to collaborate in addressing test security concerns. The goals of the Committee

CBT Best Practices

Environment

Identification

Admission

Prohibited Items

Page 21: Proctoring Best Practicesmedia01.commpartners.com/NCTA/2015Conference...encourage test organizations to collaborate in addressing test security concerns. The goals of the Committee

CBT Best Practices

Environment

Identification

Admission

Prohibited Items

Page 22: Proctoring Best Practicesmedia01.commpartners.com/NCTA/2015Conference...encourage test organizations to collaborate in addressing test security concerns. The goals of the Committee

CBT Best Practices

Environment

Identification

Admission

Prohibited Items

Page 23: Proctoring Best Practicesmedia01.commpartners.com/NCTA/2015Conference...encourage test organizations to collaborate in addressing test security concerns. The goals of the Committee

CBT Best Practices

Environment

Identification

Admission

Prohibited Items

Page 24: Proctoring Best Practicesmedia01.commpartners.com/NCTA/2015Conference...encourage test organizations to collaborate in addressing test security concerns. The goals of the Committee

CBT Best Practices

Environment

Identification

Admission

Prohibited Items

Page 25: Proctoring Best Practicesmedia01.commpartners.com/NCTA/2015Conference...encourage test organizations to collaborate in addressing test security concerns. The goals of the Committee

Online Proctoring Best Practices

Approach

Environment

View

Test Administration

Page 26: Proctoring Best Practicesmedia01.commpartners.com/NCTA/2015Conference...encourage test organizations to collaborate in addressing test security concerns. The goals of the Committee

Online Proctoring Best Practices

Approach

Test Administration

• Record & Review vs Live Proctoring

• Authentication

Page 27: Proctoring Best Practicesmedia01.commpartners.com/NCTA/2015Conference...encourage test organizations to collaborate in addressing test security concerns. The goals of the Committee

Online Proctoring Best Practices

Environment

Test Administration

• Level of Control

• Public vs. private

Page 28: Proctoring Best Practicesmedia01.commpartners.com/NCTA/2015Conference...encourage test organizations to collaborate in addressing test security concerns. The goals of the Committee

Online Proctoring Best Practices

View

Test Administration

• Ideal vs. acceptable

• Built-in webcams

• Continuous audio

Page 29: Proctoring Best Practicesmedia01.commpartners.com/NCTA/2015Conference...encourage test organizations to collaborate in addressing test security concerns. The goals of the Committee

Online Proctoring Best Practices

Test Administration

Test Administration

• Breaks

• Supplemental testing materials or aids

Page 30: Proctoring Best Practicesmedia01.commpartners.com/NCTA/2015Conference...encourage test organizations to collaborate in addressing test security concerns. The goals of the Committee

Best Practices Selection

- Which ones are best for you?

Page 31: Proctoring Best Practicesmedia01.commpartners.com/NCTA/2015Conference...encourage test organizations to collaborate in addressing test security concerns. The goals of the Committee

Publication Availability

- NCTA members can access the publication

for free at www.ncta-testing.org

- ATP members can access the publication for

free at www.testpublishers.org

- Members and non-members can purchase a

paperback version from either source for

$24.95

Page 32: Proctoring Best Practicesmedia01.commpartners.com/NCTA/2015Conference...encourage test organizations to collaborate in addressing test security concerns. The goals of the Committee

Thank You!! Jarret Deyer, College of DuPage [email protected]

Rory McCorkle, PSI [email protected]

Steve Saladin, University of Idaho [email protected]

Rachel Schoenig, ACT, Inc.

[email protected]

Jim Wollack, University of Wisconsin-Madison

[email protected]