25
Manual Data Entry TRAINING Quick Reference Guide Judith D. Swisher, PhD www.paesauthor.com Author: The PAES® Practical Assessment Exploration System The PAES-Scan® Scoring System © Life Productions 2009 [email protected]

Manual Data Entry TRAINING Quick Reference Guidepaesauthor.com/pdf/16 MANUAL Data Entry QRG.pdf · Manual Data Entry TRAINING Quick Reference Guide Judith D. Swisher, ... SM5 WB5

Embed Size (px)

Citation preview

Page 1: Manual Data Entry TRAINING Quick Reference Guidepaesauthor.com/pdf/16 MANUAL Data Entry QRG.pdf · Manual Data Entry TRAINING Quick Reference Guide Judith D. Swisher, ... SM5 WB5

Manual Data Entry

TRAINING

Quick Reference Guide

Judith D. Swisher, PhD www.paesauthor.com

Author: The PAES® – Practical Assessment Exploration System The PAES-Scan® Scoring System

© Life Productions 2009 [email protected]

Page 2: Manual Data Entry TRAINING Quick Reference Guidepaesauthor.com/pdf/16 MANUAL Data Entry QRG.pdf · Manual Data Entry TRAINING Quick Reference Guide Judith D. Swisher, ... SM5 WB5

PAES-Scan – Quick Reference Guide MANUAL Data-Entry

Outline

PART 1 – PAES Overview A. PAES Terms and Definitions ................................................................................. 1 B. PAES Components / Units / Jobs ......................................................................... 2

PART 2 – PAES Lab Management

C. Work Procedure – Chart ..................................................................................... 3 D. Work Procedure – Checklist for Evaluators ......................................................... 4 E. Cumulative Record ............................................................................................... 5 F. Weekly Planning................................................................................................... 6 G. Student Orientation ............................................................................................. 7

PART 3 – The Enhanced PAES Summary of Performance Report

H. PAES-Scan Scoring System – Manual Data Entry or Scan Data Entry ................. 8 I. PAES Summary of Performance – Enhanced Report Features ........................... 9 J. PAES Summary of Performance – Report PAGE 1 ............................................ 10

PART 4 –Assigning PAES Assessment Scores – What to Record

K. Workplace Skills Inventory – Checklist .............................................................. 11 L. Workplace Skills Inventory – Anecdotal Form ................................................... 12

M. PAES Assessment Terms and Definitions .......................................................... 13 N. PAES Scores ........................................................................................................ 14 O. Graduated Levels of Assistance ........................................................................ 15

PART 5 – Recording PAES Scores – Where to Record

P. Data Collection Forms ........................................................................................ 16 Q. Accommodations .............................................................................................. 17 R. Anecdotal Form for PAES Jobs .......................................................................... 18

PART 6 – Recording PAES Scores – When and Where to Record

S. Scoring Guide ..................................................................................................... 19 T. Scoring Guide Checklist ..................................................................................... 20 U. Subtask Assessment Form ................................................................................ 21

PART 6 – Achieving Valid Assessment Results ......................................................................... 22 PART 7 – Backing Up the PAES-Scan Database ........................................................................ 23

Page 3: Manual Data Entry TRAINING Quick Reference Guidepaesauthor.com/pdf/16 MANUAL Data Entry QRG.pdf · Manual Data Entry TRAINING Quick Reference Guide Judith D. Swisher, ... SM5 WB5

1 PAES-Scan Terms

Components: 5 PAES Components

•  Business / Marketing •  Computer /Technology •  Construction /Industrial •  Processing / Production •  Consumer / Service

Units: Each PAES component has either 8 or 10 units

Jobs: Each unit has 6 jobs – Levels 1 through Level 6 – PAES has 264 Jobs Job Codes: Each Job has a unique alpha-numeric code. For example, AB1 – DE1 – SM1 – BA1 – FM1

Component Charts: Students use the Component Charts to identify which Component contains their assigned Job.

Job Card Boxes: There are 5 Job Card boxes – one for each of the 5 PAES Components.

Job Card: Each of the 264 PAES Jobs has a Job Card that includes a list of needed Equipment, Materials and Procedures the student will follow to perform the Job.

Job Boxes: Materials / equipment for a majority of Jobs are contained in individual boxes. Large equipment / materials are located in the designated Component area.

Component Manuals: Supervisors use the 5 Component Manuals for Set-Up, Scoring, and Disassembly instructions.

Equipment Manuals: Equipment manuals include photos of all Equipment used in Jobs for Business – Construction – and Consumer Components. Students use these manuals for Tool and Equipment Identification.

Work Procedure Chart:

The PAES Work Procedure is a series of steps students follow each day to perform Jobs. Work Folder: Each student has a Work Folder with forms that document which Jobs have been attempted. The Work Folder usually contains the following forms:

Work Record – A chronological record of job attempts Cumulative Record – A one-page record of all attempted and correctly performed Jobs Daily Points Record – A one-page review of Workplace Skills performance for the week Component Job Lists – A one-page list of Job descriptions for each of the 5 Components

Student Assessment Folder: – Contains all of the forms needed to record assessment data Workplace Skills Inventory: – A checklist with 30 skills employers consider as needed for success Weekly Planning Form: – A form used to assign Jobs to each student for five consecutive days

Page 4: Manual Data Entry TRAINING Quick Reference Guidepaesauthor.com/pdf/16 MANUAL Data Entry QRG.pdf · Manual Data Entry TRAINING Quick Reference Guide Judith D. Swisher, ... SM5 WB5

PAES – Components / Units / Jobs

BUSINESS / MARKETING

AB1 IF1 NS1 CO1 MC1 TK1 CR1 TP1 AB2 IF2 NS2 CO2 MC2 TK2 CR2 TP2 AB3 IF3 NS3 CO3 MC3 TK3 CR3 TP3 AB4 IF4 NS4 CO4 MC4 TK4 CR4 TP4 AB5 IF5 NS5 CO5 MC5 TK5 CR5 TP5 AB6 IF6 NS6 CO6 MC6 TK6 CR6 TP6

AB – Alphabetizing NS – Number Sorting MC – Making Change CR – Cash Register IF – Identification/Filing CO – Collating TK – Ten Key Calculator TP - Typing

COMPUTER TECHNOLOGY

DE1 WD1 MT1 EM1 IT1 IM1 PP1 DP1 DE2 WD2 MT2 EM2 IT2 IM2 PP2 DP2 DE3 WD3 MT3 EM3 IT3 IM3 PP3 DP3 DE4 WD4 MT4 EM4 IT4 IM4 PP4 DP4 DE5 WD5 MT5 EM5 IT5 IM5 PP5 DP5 DE6 WD6 MT6 EM6 IT6 IM6 PP6 DP6

DE – Data Entry MT – Mailing Technology IT – Information Technology PP – Power Point WD – Word Processing EM – E- Mail IM – Information Management DP – Digital Photos

CONSTRUCTION / INDUSTRIAL

SM1 WB1 SN1 SS1 WP1 MP1 EP1 PI1 SM2 WB2 SN2 SS2 WP2 MP2 EP2 PI2 SM3 WB3 SN3 SS3 WP3 MP3 EP3 PI3 SM4 WB4 SN4 SS4 WP4 MP4 EP4 PI4 SM5 WB5 SN5 SS5 WP5 MP5 EP5 PI5 SM6 WB6 SN6 SS6 WP6 MP6 EP6 PI6

SM – Shop Measurement SN – Screws and Nails WP – Wood Project EP – Electrical Project WB – Wrenches and Bolts SS – Shop Saws MP – Metal Project PI – Parts Identification

PROCESSING / PRODUCTION

BA1 PA1 CA1 FD1 PD1 VP1 TD1 PC1 AT1 DT1 BA2 PA2 CA2 FD2 PD2 VP2 TD2 PC2 AT2 DT2 BA3 PA3 CA3 FD3 PD3 VP3 TD3 PC3 AT3 DT3 BA4 PA4 CA4 FD4 PD4 VP4 TD4 PC4 AT4 DT4 BA5 PA5 CA5 FD5 PD5 VP5 TD5 PC5 AT5 DT5 BA6 PA6 CA6 FD6 PD6 VP6 TD6 PC6 AT6 DT6

BA – Bolt Assembly CA – Color Assembly PD – Peg Design TD – Thread Design AT – Analogue Time PA – Pipe Assembly FD – Form Design VP – Visual Perception PC – Paper Cutting DT – Digital Time

CONSUMER / SERVICE

FM1 FP1 KA1 FS1 FW1 CM1 HS1 MS1 CC1 HC1 FM2 FP2 KA2 FS2 FW2 CM2 HS2 MS2 CC2 HC2 FM3 FP3 KA3 FS3 FW3 CM3 HS3 MS3 CC3 HC3 FM4 FP4 KA4 FS4 FW4 CM4 HS4 MS4 CC4 HC4 FM5 FP5 KA5 FS5 FW5 CM5 HS5 MS5 CC5 HC5 FM6 FP6 KA6 FS6 FW6 CM6 HS6 MS6 CC6 HC6

FM – Food Measurement KA – Kitchen Appliances FW – Food Weights HS – Hand Sewing CC – Cloth Construction FP – Food Preparation FS – Food Service CM – Cloth Measurement MS – Machine Sewing HC – Housekeeping Custodial

Page 5: Manual Data Entry TRAINING Quick Reference Guidepaesauthor.com/pdf/16 MANUAL Data Entry QRG.pdf · Manual Data Entry TRAINING Quick Reference Guide Judith D. Swisher, ... SM5 WB5

3 PAES® Work Procedure

Students follow a typical work routine each day to perform Jobs. PAES Staff members record assessment data at Step 5 and Step 10.

PAES WORK PROCEDURE Time In Get Work Folder Get Stopwatch Get Job Assignment from Work Record Use PAES Charts to locate Job Assignment

1. Get Job Card 2. Get Job Materials 3. Fill Out Work Record:

(Date, Job, Start Time) 4. Look over Job Card

5. Call a Supervisor to Begin the Job

6. Start Stopwatch 7. Do the Job 8. Stop Stopwatch 9. Write Stop Time and Check Interest

10. Call a Supervisor to Check Your Work

Repeat Job if performed incorrectly. Follow Steps 3 – 10. If the Job is performed correctly, put away materials. Get next Job assignment and follow Steps 1 – 10.

CHECK OUT

Mark  a  “+”  for  unmarked  skills  on Daily Points Record Time Out Check Out – Take Time Card and Work Folder to Supervisor

Page 6: Manual Data Entry TRAINING Quick Reference Guidepaesauthor.com/pdf/16 MANUAL Data Entry QRG.pdf · Manual Data Entry TRAINING Quick Reference Guide Judith D. Swisher, ... SM5 WB5

PAES-Scan Manual Data Entry 4 Work Procedure Checklist for Supervisors

� Before students arrive, write the first  Job  Code  Assignment  on  each  student’s  Work  Record. � As  students  arrive  and  begin  locating  materials  and  equipment,  go  to  each  student’s  work  station  and  

open the Data Collection Booklet to the appropriate page

Step 5 on the PAES Work Procedure Chart – When the student calls to begin a job

Check to be sure your student has the following:

� Work Folder

� Stopwatch

� Job Card – The correct Job Card for the assigned job � Materials and Equipment – All materials – equipment – supplies listed on the Job Card � Date and Start Time from the PAES Lab clock written on the Work Record

� Check to be sure the Job was properly disassembled by the previous student � Ask  the  student:  “Do  you  know  how  to  do  this  job?”

� Provide amount of assistance needed to begin the Job � Tell the student to start the stopwatch and begin

FOLLOW the PAES Scoring Guide instructions for Step 5

� Walk away and give the student a chance to perform the entire Job

Step 10 on the PAES Work Procedure Chart – When the student calls to check their work

Check to be sure the student has done the following:

� Stop Time from the PAES Lab clock is written on the Work Record � Interest is marked on the Work Record � Check Stopwatch to see if the time has stopped and if the amount of time appears to be an

accurate indication of the amount of time it took to perform the job

� Review Scoring Criteria in the Component Manual � Check  the  student’s  work

FOLLOW the PAES Scoring Guide instructions for Step 10 � Reset the Stopwatch to  “0” � Review the Disassembly instructions for that Job and assist or tell the student to disassemble the job

so it will be ready for the next student. � Choose  the  student’s  next  job  assignment and write it on the Work Record.

Check Out: � Go  to  each  student  individually.  “It  is  time  to  disassemble  your  Job  and  put  it  away.” � Write the total number of points earned that day in the margin of the Work Record. � When a student brings Time Card, Work Folder and Points Record for check-out,

Check Time Card entry and write Total Points earned for the day on Points Record. � Tell the student to put away their Time Card and Work Folder.

Page 7: Manual Data Entry TRAINING Quick Reference Guidepaesauthor.com/pdf/16 MANUAL Data Entry QRG.pdf · Manual Data Entry TRAINING Quick Reference Guide Judith D. Swisher, ... SM5 WB5

5 PAES Cumulative Record

An at-a-glance planning tool for assigning PAES jobs

BASELINE Assessment - Students attempt Level One PAES Jobs to identify areas of strength and potential. Once they have attempted as many Level 1 Jobs as possible, they attempt Levels 2 through 6 in Units of identified strength and potential.

The Cumulative Record documents which PAES jobs have been Attempted and which Jobs have been Performed Correctly.

Attempted Jobs are those with marked tallies. Jobs Performed Correctly have a circle drawn around the tallies.

Page 8: Manual Data Entry TRAINING Quick Reference Guidepaesauthor.com/pdf/16 MANUAL Data Entry QRG.pdf · Manual Data Entry TRAINING Quick Reference Guide Judith D. Swisher, ... SM5 WB5

PAES Weekly Planning Form 6 Students work in a different PAES Component each day.

The Weekly Planning Form is used alongside the PAES Cumulative Record to assign the first Job of the day. Students attempt as many BASELINE Level One Jobs as possible each day to identify Units of strength and potential. Once all BASELINE Level One Jobs have been attempted, students continue to work in a different Component each day on Units of identified Strength and Potential.

Page 9: Manual Data Entry TRAINING Quick Reference Guidepaesauthor.com/pdf/16 MANUAL Data Entry QRG.pdf · Manual Data Entry TRAINING Quick Reference Guide Judith D. Swisher, ... SM5 WB5

7 PAES Lab Student Orientation

Orientation Activities include the following topics: A. Explain how the PAES Lab is set up to be as much like a real job as possible:

1. Employees use a Time Clock to check in and check out 2. Entry-level employees typically stand while working –Counter height tables recommended 3. Employees do what supervisors ask them to do 4. Employees use their time wisely and keep busy working 5. Employees are respectful and considerate of co-workers 6. Employees are compensated for their work:

(20 points once the Job is performed correctly – 5 points each time the Job is attempted) (Each PAES Lab sets up a compensation strategy that works for their students)

B. Group Practice Activities to Introduce the PAES Work Procedure: Part One – Practice Getting Started 1. Timing In using the PAES Time Clock and Time Cards practice 2. Locating Work Folder and Stopwatch 3. Starting and Stopping the Stopwatch

(Students start and stop their watches. Supervisors always reset the watches.) 4. Locating Job Assignments on Work Record 5. Locating Job Assignments on Component Charts 6. Locating Job Cards

Part Two – Practice Job Setup 1. Using Materials list on a Job Card to Locate Job Materials 2. Using PAES Equipment manuals for Business – Construction – Consumer

Components to locate and identify Equipment and Materials

Part Three – Practice Doing Parts of Level One Jobs – No Assessment Data is Recorded

1. Writing Date, Job, and Start Time (from PAES Lab clock) on Work Record 2. Doing what they can to figure out how to do a Job 3. Calling a Supervisor 4. Performing parts of Level One Jobs 5. Writing Stop Time (from PAES Lab clock) and Interest on Work Record 6. Calling a Supervisor 7. Disassembling and putting the Job away Part Four – Practice Student CHECK OUT Tasks 1. Disassembling and putting Jobs away – (Supervisors go to each student at the end of the lab

period  and  say:  “It’s  time  to  disassemble  and  put  your  Job  away.”) 2. Putting  “+” in each box of the Daily Points Record that has not been marked by the Supervisor 3. Timing Out and taking the following items to a Supervisor for Check Out:

Time Card – Work Folder – Daily Points Record 4. Putting away Time Card, Work Folder and Daily Points Record

Page 10: Manual Data Entry TRAINING Quick Reference Guidepaesauthor.com/pdf/16 MANUAL Data Entry QRG.pdf · Manual Data Entry TRAINING Quick Reference Guide Judith D. Swisher, ... SM5 WB5

PAES-Scan Scoring System 8

Two Data Entry Options

Manual Data Entry Assessment data is recorded on PAES-Scan Standard Data Collection Forms and manually entered in the PAES-Scan Software.

Scan Data Entry: Assessment data is recorded on PAES-Scan Cards that are scanned through a card reader.

Both Data Entry Options produce the same…

Enhanced PAES Summary of Performance Report

Data-driven – Research-based – Age-appropriate Transition Assessment

Page 11: Manual Data Entry TRAINING Quick Reference Guidepaesauthor.com/pdf/16 MANUAL Data Entry QRG.pdf · Manual Data Entry TRAINING Quick Reference Guide Judith D. Swisher, ... SM5 WB5

9 PAES-Scan® – Enhanced Report Options

Page 1 Potential for Paid and Unpaid Employment:

Quantity of Work Aptitude and Interests

Page 2 Aptitude Factors: Composite Scores - NEW

Amount of Assistance Needed to Perform Quality of Work Work Rate Number of Trials (Attempts) Needed to Perform Job Correctly

Page 3 PAES Jobs – Strengths and Progress Report: NEW

Jobs Performed Correctly Progress and Overall Performance on each PAES Unit

Page 4 Workplace Skills – Strengths and Needs: NEW

Pre-Employment Skills – Performance & Productivity Work Habits and Attitudes – Learning & Transfer of Skills Interaction with Supervisors and Co-Workers

Page 5 Accommodations: NEW

Reasonable Accommodations – Provided and Useful Needed Modifications

------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Pgs 6–10 Performance on Individual PAES Jobs:

Assistance and Trials Needed to Perform Job Correctly Interest in Performing Each Job Accommodations Provided for Each Job NEW Instructional Recommendations NEW

Pgs 11 + Subtask Assessment & Anecdotal Comments

Subtasks Performed Independently NEW Anecdotal Comments specific to Job Performance / Needs

PAES Transition Summary NEW

Post-Secondary Transition Goals Considerations Preparation Considerations for Post-Secondary Goals PAES Summary of Performance pages 1 – 3 – 4 Spanish Option – PAES Transition Summary NEW

PAES Basic Report Pages 1 – 5 PAES Jobs Report Pages 6 – 10 PAES Subtask Report Pages 11+ PAES Progress Report Page 3 PAES Transition Summary Pages 1, 3 and 4

Transition Summary has English and Spanish options

Page 12: Manual Data Entry TRAINING Quick Reference Guidepaesauthor.com/pdf/16 MANUAL Data Entry QRG.pdf · Manual Data Entry TRAINING Quick Reference Guide Judith D. Swisher, ... SM5 WB5
Page 13: Manual Data Entry TRAINING Quick Reference Guidepaesauthor.com/pdf/16 MANUAL Data Entry QRG.pdf · Manual Data Entry TRAINING Quick Reference Guide Judith D. Swisher, ... SM5 WB5

11 PAES Workplace Skills Inventory Students are rated at the beginning and end of their PAES Lab experience.

The Workplace Skills Inventory is based on skills employers consider as needed for success in community-based employment. Ratings are based on how the student performs in comparison to average entry-level employees that PAES supervisors encounter in the community, e.g. grocery sackers, fast food workers, etc.

Page 14: Manual Data Entry TRAINING Quick Reference Guidepaesauthor.com/pdf/16 MANUAL Data Entry QRG.pdf · Manual Data Entry TRAINING Quick Reference Guide Judith D. Swisher, ... SM5 WB5

Anecdotal Workplace Skills Form 12

Allows evaluators to make on-going brief comments that support and clarify ratings assigned on the PAES Workplace Skills Inventory.

Page 15: Manual Data Entry TRAINING Quick Reference Guidepaesauthor.com/pdf/16 MANUAL Data Entry QRG.pdf · Manual Data Entry TRAINING Quick Reference Guide Judith D. Swisher, ... SM5 WB5

PAES-Scan – Assessment Terms and Definitions 12 Assessment Data collected on PAES Jobs: Quality Describes how well the student performed the job on the First Attempt Work Rate Amount of time the student spent performing the job on the First Attempt Interest Amount of interest expressed or indicated by the student on the First Attempt Assistance Maximum amount of assistance needed to perform the job.

Provide students the amount of assistance they need to learn how to do the job. Most students are capable of doing more of their own work and more of their own thinking. The goal is to help students find out what they can do on their own with as little help as possible. Try asking the “W”  Questions!  “What do you think? etc.

Trials One Trial is marked each time the Evaluator walks away and lets the student

attempt to perform the job on their own.

If the Evaluator intervenes and assists while the student is performing a job, the intervention is counted as a Trial. Be sure to document the extra trial.

Accommodations

Accommodations are supports that make it possible for the student to perform Jobs that otherwise they would not be able to do. Accommodations DO NOT CHANGE expected Job outcomes. Examples below would be considered as reasonable accommodations at community job sites:

Examples: Job Sample Assistive Devices / Jigs Entire Job Model Assistive Technology Visual Guides Behavior Supports Large Print Extra Time Interpreter Color Coding

Modifications CHANGE expected job outcomes.

Examples: Does not perform all steps (Subtasks) listed on the Job Card Correctly performs all Subtasks but produces fewer items Produces expected job outcomes with extra supplies removed

Recommendations for Follow-up Instruction:

When appropriate, whole Jobs or Job Subtasks are marked for follow-up instruction.

Baseline Assessment: Baseline Assessment documents student performance on Level 1 Jobs in all PAES Components

e.g., (AB1, IF1, NS1, CO1). The purpose is to identify areas of strength and potential strength for further exploration in Level 2 through 6 Jobs, e.g., (AB2, 3, 4, 5, 6).

Subtask Assessment: Subtask Assessment documents which part(s) of a job the student can perform when unable to perform the entire job.

Workplace Skills Assessment: Documents student performance on skills employers consider as needed on a job

Page 16: Manual Data Entry TRAINING Quick Reference Guidepaesauthor.com/pdf/16 MANUAL Data Entry QRG.pdf · Manual Data Entry TRAINING Quick Reference Guide Judith D. Swisher, ... SM5 WB5

PAES-Scan Scores 14

Qual = Quality of Performance – First Trial (Attempt) Only

1 = Totally Correct – No errors and DID NOT HAVE Guided Practice before First Trial 2 = Few Errors – Few errors – 1 or 2 errors 3 = Many Errors – Many errors – 3 or more errors

Rate = Work Rate – First Trial (Attempt) Only 1 = Competitive – Less than smallest amount of time posted on Job Card 2 = Semi-Competitive – Between two amounts of time posted on Job Card 3 = Non-Competitive – More than largest amount of time posted on Job Card

Int = Interest – First Trial (Attempt) Only 1 = High 2 = Moderate 3 = Low

Asst = Assistance Scores – Maximum Amount of Assistance needed to perform the job Score can Increase. Do Not REDUCE this score.

1 = Independent – NO assistance needed to perform entire job 2 = Verbal Assistance – Evaluator TELLS the student how to do the job

3 = Demonstration – Evaluator SHOWS the student how to do part or all of the job 4 = Guided Practice – Evaluator CORRECTS / ASSISTS while the Student PRACTICES

(Guided Practice assistance requires that Q is > 1 and T is > 1) Evaluator WALKS AWAY and gives the student a chance to attempt the entire job.

Trials = Number of Trials (Attempts) needed to perform Entire Job Correctly Number of Trials Can INCREASE. Do Not REDUCE the number of Trials. Each attempt of the entire job is counted as a Trial. If the Evaluator intervenes to assist/correct, the intervention is counted as a Trial.

Partially completed jobs at the end of a lab period do not count as a Trial. Subtask Assessment:

Consider Subtask Assessment when: Student CANNOT perform the Whole Job but is likely able to perform Specific Subtask(s).

Before going to Subtask Assessment:

Mark the following scores on the Data Collection Form: Assist = 4 Trials as > 1 Quality as > 1 Rate = 3 Interest = ? Acc = M

On the Subtask Form mark the following:

Mark V = When the student is able to perform a subtask independently with a Verbal prompt Mark R = When it is appropriate to Recommend Follow-Up Instruction for Specific Subtask(s) Circle Subtask Letter (A – H) when Subtask has been attempted but not performed correctly

If all Subtasks can be performed with a verbal prompt, student should attempt the entire job.

Page 17: Manual Data Entry TRAINING Quick Reference Guidepaesauthor.com/pdf/16 MANUAL Data Entry QRG.pdf · Manual Data Entry TRAINING Quick Reference Guide Judith D. Swisher, ... SM5 WB5

Gra

duat

ed L

evel

s of

Ass

ista

nce –

Man

ual D

ata

Entry

Ev

alua

tor

Stud

ent

Eval

uato

r St

uden

t Ev

alua

tor

Assi

stan

ce

“Do  yo

u k

now

h

ow to

do

this  job?

“Yes

” or    “No”

It’s  op

tiona

l  to  sa

y:  

“S

how  m

e  wha

t  you

 th

ink

you

will

do.”

“W

hat w

ill y

ou d

o ne

xt?”…

 etc.,

until

you

th

ink

the

stud

ent k

now

s ho

w to

do

the

job.

Stu

dent

cor

rect

ly d

escr

ibes

or

demon

strates  the  job                      ►

If

Stud

ent d

oes

not d

escr

ibe

or  dem

onstrate  correctly              ►

TELL

the

stud

ent h

ow to

do

th

e jo

b

A =

1

A =

2

Af

ter V

erba

l Ass

t: It’s  op

tiona

l  to  sa

y:  

“N

ow s

how

me

wha

t yo

u th

ink

you

will

do.”

“W

hat w

ill y

ou d

o ne

xt?”…

 etc.,

until

you

th

ink

the

stud

ent k

now

s ho

w to

do

the

job.

Stu

dent

cor

rect

ly d

escr

ibes

or

demon

strates  the  job                      ►

If

Stud

ent d

oes

not d

escr

ibe

or  dem

onstrate  correctly              ►

SHO

W th

e st

uden

t how

to d

o th

e jo

b

A =

2

A =

3

Af

ter D

emon

stra

tion:

It’s  op

tiona

l  to  sa

y:  

“N

ow s

how

me

wha

t yo

u th

ink

you

will

do.”

“W

hat w

ill y

ou d

o ne

xt?”…

 etc.,  

until

you

th

ink

the

stud

ent k

now

s ho

w to

do

the

job.

Stu

dent

cor

rect

ly d

escr

ibes

or

demon

strates  the  job                        ►

If

Stud

ent d

oes

not d

escr

ibe

or  dem

onstrate  correctly              ►

Giv

e G

UIDE

D PR

ACTI

CE ►

Tr

ials

mus

t be

> 1

Qua

lity

mus

t be

> 1

A =

3 A

= 4

T >

1 Q

> 1

S

ubta

sk A

sses

smen

t If

the

stud

ent c

onsi

sten

tly

does

not

cor

rect

ly

dem

onst

rate

spe

cific

su

btas

k(s)

of t

he jo

b, g

o to

Sub

task

Ass

essm

ent.

Id

entif

y su

btas

ks th

e st

uden

t can

per

form

in

depe

nden

tly w

hen

give

n a

verb

al p

rom

pt.

Be

fore

goi

ng to

Sub

task

As

sess

men

t: M

ark

the

follo

win

g sc

ores

on

the

Data

Col

lect

ion

Form

:

Q

ual–

Rate–I

nter

est

Ass

t – T

rials

A

ccom

mod

atio

ns

Q >

1

R =

3 I

= St

uden

t

In

tere

st

A =

4 T

> 1

Acc

= M

Page 18: Manual Data Entry TRAINING Quick Reference Guidepaesauthor.com/pdf/16 MANUAL Data Entry QRG.pdf · Manual Data Entry TRAINING Quick Reference Guide Judith D. Swisher, ... SM5 WB5

PAES-Scan – Manual Data Entry 16 Standard Data Collection Forms

Each student has a Data Collection Booklet for assessment data:

Quality – Rate – Interest – Assistance – Trials – Accommodations

The Data Collection booklet provides a hard copy record of performance on all Jobs that were attempted and those that were performed correctly.

Trials tallies on the Data Collection Form should match Trials tallies on the Cumulative Record.

Page 19: Manual Data Entry TRAINING Quick Reference Guidepaesauthor.com/pdf/16 MANUAL Data Entry QRG.pdf · Manual Data Entry TRAINING Quick Reference Guide Judith D. Swisher, ... SM5 WB5

17 Manual Data Entry Accommodations PAES Accommodations are supports that enable students to perform Jobs that otherwise they would not be able to do. Accommodations (A – K) listed below are considered as reasonable accommodations that could be provided to students who have paid employment in the community. As many as three Accommodation Codes can be marked  in  the  “Acc”  space  located  on  the  Data  Collection  Booklet  form.

Accommodations: (A – K) Do Not Change the Expected Job Outcomes.

Modifications: (M – Job Modification) indicates a Change in Job Outcomes.

Modified Jobs can be considered as performed correctly under 6 conditions:

1. An attempt has been made to perform entire Job without any Modification and appropriate First Trial scores are marked on the Data Collection form:

(Quality Rate Interest) 2. Subtask Form is marked to show which Subtasks can be preformed Independently

with a Verbal Prompt 3. Assistance Score = 4 and Trials Score = 3 or 4 4. “M”  is  marked  on  the  “Acc”  space  on  the  Data  Collection  form. 5. Modification of the Job is described on the Anecdotal Form for PAES Jobs 6. Student can perform the designated Modified Job without errors When a Modified Job has been performed correctly, draw  a  circle  around  the  “Trial”  

tallies on the Data Collection form and the Cumulative Record

PAES Accommodations: A. Job Sample – Model of Part of the Job B. Entire Job Model C. Visual Guides – Charts / Diagrams / Templates D. Enlarged Print / Illustrations E. Taped Audio Prompts F. Color Coding G. Interpreter – Hearing loss / English learners H. Assistive Device – Jig / Tool / Tape / Velcro I. Assistive Technology J. Extra Time = More than double the largest time on Job Card K. Behavior Supports

PAES Modified Jobs: M. Modified Job – Examples: On-going Prompts / Intervention

Reduced Work Load Does not perform all Subtasks Extra Materials Removed Performs all Subtasks w/ Prompts

Page 20: Manual Data Entry TRAINING Quick Reference Guidepaesauthor.com/pdf/16 MANUAL Data Entry QRG.pdf · Manual Data Entry TRAINING Quick Reference Guide Judith D. Swisher, ... SM5 WB5

Anecdotal Form for PAES Jobs 18

Allows evaluators to describe Accommodations that were provided and to make brief comments about unique needs and characteristics of the student as they perform PAES Jobs. For example:

Page 21: Manual Data Entry TRAINING Quick Reference Guidepaesauthor.com/pdf/16 MANUAL Data Entry QRG.pdf · Manual Data Entry TRAINING Quick Reference Guide Judith D. Swisher, ... SM5 WB5
Page 22: Manual Data Entry TRAINING Quick Reference Guidepaesauthor.com/pdf/16 MANUAL Data Entry QRG.pdf · Manual Data Entry TRAINING Quick Reference Guide Judith D. Swisher, ... SM5 WB5

PAES-Scan – Manual Data Entry 20

Scoring Guide Checklist

Step 5 – When the student calls to begin a Job

� Ask the Student: Do you know how to do this Job? � It’s  optional  to  ask  W  questions  like:  What do you think you will do? � Follow the Graduated Levels of Assistance Guide to assign the appropriate Assistance score.

Data Collection Form: � RECORD the Maximum Amount of Assistance provided in the space for Asst. � If more Assistance is provided at a later time, change the Assistance score to reflect the additional Assistance.

Step 10 – First Trial – When the student calls to check their work

Data Collection Form: � 1. Mark scores for: Quality – Rate – Interest � 2. Mark a tally in the Trials space � 3. If Accommodation(s) are provided write the appropriate Accommodation Code in the ACC space � 4. If the Job was  changed  or  modified  write  “M”  in  the  ACC  space  and  describe  how  the  Job  was  changed  or  modified  on  

on the Anecdotal Form

Cumulative Record: � 5. Mark a Trial tally on the Cum Record

If NO ERRORS: If there are ERRORS:

Data Collection Form:

� 6. Circle the number of Trial tally(s) 6. DO NOT circle Trial tally(s) on Data Collection Form

Cumulative Record: � 7. Circle the number of Trial tally(s) 7. DO NOT circle Trial tally(s) on Cumulative Record

Step 10 – 2nd, 3rd, or 4th Trials – Student calls to check work Do NOT CHANGE scores for Quality – Rate – Interest

These scores are recorded ONLY on the FIRST TRIAL

Do NOT REDUCE scores for Assistance or Trials These scores can INCREASE – They CANNOT be REDUCED

If NO ERRORS: If there are ERRORS: Data Collection Form: Data Collection Form: � 1. Mark another Trial tally. � 1. Mark another Trial tally � 2. Circle the number of Trial tally(s) Cumulative Record: Cumulative Record: � 2. Mark another Trial tally � 3. Mark a Trial tally DO NOT circle Trial tally(s) on Data Collection Form � 4. Circle the number of Trial tally(s) DO NOT circle Trial tally(s) on Cumulative Record

Page 23: Manual Data Entry TRAINING Quick Reference Guidepaesauthor.com/pdf/16 MANUAL Data Entry QRG.pdf · Manual Data Entry TRAINING Quick Reference Guide Judith D. Swisher, ... SM5 WB5

21 Subtask Forms

Each Component has a set of Subtask Forms with written descriptions of all Jobs and all Job Subtasks. Subtasks are scored as follows:

V = Subtask can be Performed Independently with a Verbal Prompt R = Subtasks is Recommended for Follow-Up Instruction

Circled Subtask Letter = Subtask was Attempted but not yet Performed Correctly

Subtask Assessment

Purpose:

To document Parts of a Job the student can perform if he/she is not able to perform the entire Job To identify Accommodations that enable the student to perform the Job without supervisor intervention To recommend Follow-up instruction that will potentially build on identified strengths To produce The PAES Summary of Performance Report that more accurately describes student strengths and potential for jobs requiring similar types of skills in both supported and non-competitive employment settings

Page 24: Manual Data Entry TRAINING Quick Reference Guidepaesauthor.com/pdf/16 MANUAL Data Entry QRG.pdf · Manual Data Entry TRAINING Quick Reference Guide Judith D. Swisher, ... SM5 WB5

Achieving Valid PAES Summary of Performance Reports 22 Manual Data Entry

Reports are valid representations of student potential when assessment data is:

1) Assigned properly according to PAES-Scan Scores and the PAES-Scan Scoring Guide

2) Recorded properly on PAES-Scan Data Collection Forms

3) Entered properly in the PAES-Scan Scoring Software

4) Interpreted properly

Entering Assessment Data in the PAES-Scan Software: 1) When learning to use the PAES-Scan Software, it is a good idea to enter scores at least

once a week to identify and correct common scoring errors.

2) Most scoring errors are detected by the software and are listed on the software screen

when data is manually entered.

3) Common Errors include:

If Q > 1, then T Must be > 1

If T > 1, then Q Must be > 1

If A = 4, then Q and T Must be > 1

Missing Scores

4) When errors are displayed in the Manual Data Entry screen, the error must be corrected

before moving to the next PAES Job and before leaving the Manual Data Entry screen.

Types of Errors the PAES-Scan software cannot detect:

ERRORS on the Data Collection Forms: 1) Assistance provided but not recorded

2) Quality scores on the First Trial that do not accurately reflect the number of errors

3) Number of Trials scores that do not accurately reflect the number of attempts the student

has made to perform the job

4) Scores recorded in the wrong space on the Data Collection Form

5) Modified Jobs (M) not reported and described on the Anecdotal Form for PAES Jobs

6) Scores recorded later in the day

ERRORS when Entering Data in the PAES-Scan Scan Software: 7) The  “Performed  Successfully”  box  is  checked in the Manual Data Entry screen when the

entire job has not yet been completed correctly without supervisor intervention

8) Assigning the same PAES ID number to two students in the PAES-Scan Software

Interpreting Assessment Results - Issues that Effect Assessment Validity 1) As much as possible, consider the assessment results in context of the entire assessment process,

rather than interpreting individual scores in isolation from other important data.

2) When interpreting assessment data on the PAES Performance Summary, keep in mind what you

have learned and observed about the student throughout the assessment process.

3) Did the student have the opportunity to attempt and explore each Level One Baseline Job?

4) Did the student have the opportunity to attempt higher Levels of Jobs in PAES Units where

potential was demonstrated on Level One Baseline Jobs?

5) Did the student work as much as possible in a different PAES Component each day?

6) Which Accommodations made it possible for the student to perform Jobs that otherwise they

would not have been able to do?

7) How often did the student perform Jobs correctly with Job Modifications?

Page 25: Manual Data Entry TRAINING Quick Reference Guidepaesauthor.com/pdf/16 MANUAL Data Entry QRG.pdf · Manual Data Entry TRAINING Quick Reference Guide Judith D. Swisher, ... SM5 WB5

23 Back Up PAES-Scan Software Database Back Up Database Feature – Allows you to back up your PAES database

1. Contact your IT person to see if your school automatically backs up your files.

2. If your school does not automatically backup your files, you should use a flash drive or an external server to periodically back up your PAES Database.

3. When you execute the Back Up menu option, it creates a suggested filename for you, in the format  of  “PAES_BACKUP_20110122131224”  (year-month-date-24hour-minute-seconds.

4. You can change the name to whatever they want. You can also choose whatever folder and drive you want.

To Back Up the PAES Database:

1. Open “File” and click on “Back Up Database”.

2. Select the location where you want to backup your PAES database.

3. Click on “Save.”    Each time you click on Save, the database will save with a new date.

If you change computers OR your computer crashes, you will need to do the following:

1. Contact your PAES-Scan® representation.

2. Re-install the PAES scoring software.

3. Open the software. An Installation ID pop-up screen will appear.

4. Send an email to the address located below the Install ID to request your Application Unlock Code,

5. You will receive the Application Unlock Code by email or through your PAES-Scan® representative.

6. Open the software. An Installation ID pop-up screen will appear once more.

7. Enter the Application Unlock Code.

8. Open the software and click on OK to create your password on the next screen.

Restore your PAES Database Backup, by performing the following steps in this order:

a. Copy your PAES_BACKUP_(date).PBF file. Paste it in the LP-PAES2011 folder. Copy and Paste – Do Not Drag the file to the LP-PAES2011 folder.

b. Delete the ISD_LOCAL.MDB file that is in the LP-PAES2011 folder.

c. Rename the PAES_BACKUP_(date).PBF file to ISD_LOCAL.MDB