From Good to Great -- Administering a Successful LSAT Administration Presented by: The Law School...

From Good to Great -- Administering a

Successful LSAT Administration

Presented by:

The Law School Admission CouncilTerri Neuman

Frances MercedesDawn TroutmanAnne McKernan

8/8/09

2

What do we mean by a successful administration?

• Accountability and security of test materials.

• Satisfactory testing environment.

• Detailed documentation.

Overall goal:Valid scores

3

Stealing ofTest

Materials

Staff

Impersonation

Timing

Collusion

Cheating

TestingEnvironment

Factorsthat affect

score validity

Pre-Knowledge

4

Stealing ofTest

Materials

Staff

Impersonation

Timing

Collusion

Cheating

TestingEnvironment

Factorsthat affect

score validity

Pre-Knowledge

5

Stealing ofTest

Materials

Staff

Impersonation

Timing

Collusion

Cheating

TestingEnvironment

Factorsthat affect

score validity

Pre-Knowledge

6

Spacing and Seating

Checking ID

Prohibited Items

Test Book Security

Addressing Security Concerns

7

Addressing Security Concerns

Spacing between test takersThere must be:

•Room for proctors to walk in front of and behind all test takers.

•At least 5 feet (side- to-side) from one test taker to the next.

Spacing and Seating

Checking ID

Prohibited Items

Test Book Security

LSAT Spacing Requirements

42"

30"

Head Table 

30"

5 ft.

42"

9

Some Notes on Random Seating…

1. Test takers should be seated in no discernible pattern

• Definitely not alphabetical

2. Create seating charts in advance if possible.

10

Addressing Security Concerns

We accept only government-

issued ID that is current (not expired) and

contains a photo and signature.

Acceptable forms include passport

books and driver’s licenses.

Spacing and Seating

Checking ID

Prohibited Items

Test Book Security

11

Addressing Security Concerns

We do not accept government-

issued employment ID’s

or passport cards.

Exceptions are made for some international

students on a case-by-case basis

Spacing and Seating

Checking ID

Prohibited Items

Test Book Security

First & last nameon admission ticket

must match ID EXACTLY.

12

Addressing Security Concerns

We distinguish

betweenelectronic and non-electronic

items.

Spacing and Seating

Checking ID

Prohibited Items

Test Book Security

13

Addressing Security Concerns

After “Check-In,”

test takers who are seen with

electronic items are immediately dismissed and

reported.

Spacing and Seating

Checking ID

Prohibited Items

Test Book Security

14

Addressing Security Concerns

After “Check-In,” non-electronic prohibited items are

confiscated and reported.

Spacing and Seating

Checking ID

Prohibited Items

Test Book Security

15

If you see it…

16

Act on it.

WarningNotice

Steps to take every time:

•Verbal notification to test taker.

•Written citation to test taker.

•Detailed SMIR form to LSAC.

For more detailssee our manual,

pages 31-32

17

Addressing Security Concerns

1. Prior to test day: Keep test materials secure.

2. On test day: Never leave materials unguarded.

3. Follow published procedures.

Spacing and Seating

Checking ID

Prohibited Items

Test Book Security

18

Receiveshipment of test materials

from LSAC

Countmaterials

Repack and storematerialssecurely

Check on storedmaterial fromtime to time

Distribute toRoom Supervisors

on test day

Ensuring Test Material Security

Step

#1Fax or e-mail

acknowledgmentform

Reminder:Retain thecardboard

carton!

19

Distribute toRoom Supervisors

on test day

Countmaterials

Room Supervisorcounts

materials

Proctorsdistribute totest takers

Ensuring Test Material Security

Step

#2Record serial

numbers on SRF

Record serialnumbers on

RSRF

20

Proctorsdistribute totest takers

Collect materialsat break

Ensuring Test Material Security

Step

#3

Serpentinestyle only

Directly placeeach packet

on each desk

Record used/unused numbers

on RSRF

In serialnumber

order

21

“Serpentine” Book Distribution

Back of the Room

Front of the Room

22

Re-distribute after the break

Check every ID

Collect materialsbefore the

writing sample

Ensuring Test Material Security

Step

#4

Redistribute inthe same order

as collected.

Serpentinestyle only

Directly placeeach packet

on each desk

23

Collect materialsbefore the

writing sample

Collectanswer sheets

Steps to takeduring and after the

writing sample

Ensuring Test Material Security

Step

#5

Collecttest booklets

Confirm receipt of allanswer sheets and

test booklets

Distributewriting sample

topic sheets

24

Prepare materialsfor return to

LSAC

Ensuring Test Material Security

Step

#6

After the writingsample, collect

response sheets

Collecttopic sheets

During thewriting sample

Confirm receipt of allresponse sheetsand topic sheets

Re-verify receiptof all answer sheets

and test booklets

After thewriting sample

Allow test takersto leave

25

Prepare appropriatematerials for return

to LSAC within48 hours

Deliver to UPS

Ensuring Test Material Security

Step

#7

Print identifying infoon white envelopes

For furtherdetails, see p. 42 of the Supervisor’s

Manual

Check off appropriateboxes on white envelopes

Place white envelopes intoUPS “Next Day Air Packs”

Pack requestedmaterials into white

Tyvek envelopes

Place “ExpressPak”labels on the UPS

envelopes

26

Prepare remainingmaterials for

return to LSACwithin 72 hrs.

Deliver to UPS

Ensuring Test Material Security

Step

#8

Secure plasticcontainer with

fasteners (provided)

For furtherdetails, see p. 43 of the Supervisor’s

ManualAffix UPS “Ground

Service” label on carton

Pack remainingmaterials into

plastic container

Seal carton with twokinds of tape (provided)

Place plastic containerinto cardboard carton

27

Stealing ofTest

Materials

Staff

Impersonation

Timing

Collusion

Cheating

TestingEnvironment

Factorsthat affect

score validity

Pre-Knowledge

28

Stealing ofTest

Materials

Staff

Impersonation

Timing

Collusion

Cheating

TestingEnvironment

Factorsthat affect

score validity

Pre-Knowledge

29

Factors that affect the Testing Environment

• Timing• Lighting• Temperature• Noise

– traffic, construction, other campus events

• Writing Surface• Restroom

accessibility

30

Tips from our Supervisors:Identifying Staff

1. Recruit from academic institutions.• Your own and nearby schools.• Faculty, staff, and graduate students.

2. Consider other mature, responsible individuals.

3. Key qualities and skills include:• Respect for the testing process.• Reliability and trustworthiness.• Ability to follow directions and work quietly.

31

Tips from our Supervisors:Retaining Staff

1. Stay in touch with staff between tests.• Create an e-mail list so you can easily

send reminders or tips every 6-8 weeks.

2. Evaluate performance after each test.• The group as a whole and each staff

person.

3. Focus on professional development.• Mentoring or “teaming up.”• Encourage proctors to develop “Room

Supervisor” skills.

32

Tips from our Supervisors:Retaining Staff

4. Provide training.• LSAC launched its training program in

November, 2008.

• Present setting is an interactive workshop format that provides a forum for: Explanation of our procedures. Exchange of ideas. Resolution of center-specific concerns.

• Future plans include online tools.

33

Wrap-Up:

In today’s presentation we shared some high-level information about:

• Factors that affect score validity.• How LSAC is addressing test security

issues.• Some of our procedures for handling

test materials and administering our test.

• Advice from our Supervisors about identifying and retaining staff.

• Our new training program.

34

Q & A