How to Interpret the O*NET Ability Profiler Results

1

How to Interpret the O*NET Ability How to Interpret the O*NET Ability Profiler ResultsProfiler Results

How to Interpret the O*NET Ability How to Interpret the O*NET Ability Profiler ResultsProfiler Results

Dr. Janet E. WallDr. Janet E. WallSenior Trainer, ONET Academy

Dr. Janet E. WallDr. Janet E. WallSenior Trainer, ONET Academy

An O*NET Academy BriefingAn O*NET Academy Briefing

2

Relax and EnjoyRelax and Enjoy

• Session will be recorded and archived

• Can listen to the session again at http://www.onetacademy.com

• Can download slides

• Come in with questions as you have them

3

Part 3 of 3Part 3 of 3

• 3 part series– Introduction to the O*NET Tools and the Ability

Profiler (30 July)– How to Administer the Ability Profiler (31 July)– How to Interpret the Ability Profiler (1 August)

• After attending all 3 sessions – certificate of completion

• Any session stands on its own

4

Session 3 - Learning ObjectivesSession 3 - Learning Objectives

• Overview the Ability Profiler (AP)• Describe contents of the AP Score Report• Review percentiles• Overview norms• Overview how AP results are matched to

occupations• Review occupational information using O*NET

Online• Discuss example profile

5

Three InstrumentsThree Instruments

• O*NET Interest Profiler

• O*NET Work Importance Locator/Profiler

• O*NET Ability Profiler

6

O*NET Career Exploration ToolsO*NET Career Exploration Tools

Tool Format Purpose

O*NET Interest Profiler

Paper/Pencil Work-related Interests

O*NET Interest Profiler

Standalone or Network

Work-related Interests

O*NET Work Importance Locator

Paper/Pencil What is Important in a Job (Values)

O*NET Work Importance Profiler

Standalone or Network

What is Important in a Job (Values)

O*NET Ability Profiler

Paper/Pencil What Individual Can Do Well (Ability)

7

Proper UseProper Use

• Developed only for career exploration, career counseling

• Not for job selection or selection into job training programs

• Administered to 1 or more persons• Paper/pencil only

8

Ability Profiler Overview – 11 testsAbility Profiler Overview – 11 tests

• Computation• Arithmetic

Reasoning• Vocabulary• Name Comparison• Object Matching• Three Dimensional

Space

• Mark Making• Place • Turn• Assemble• Disassemble

9

Relationship Between Measured Constructs Relationship Between Measured Constructs and AP Exercisesand AP Exercises

What is Measured/ReportedWhat is Measured/Reported Exercise/SubtestExercise/Subtest

Verbal Ability Vocabulary

Arithmetic Reasoning Arithmetic Reasoning

Computation Computation

Spatial Ability Three-Dimensional Space

Form Perception Object Matching

Clerical Perception Name Comparison

Motor Coordination Mark Making

Manual Dexterity Place

Turn

Finger Dexterity Assemble

Disassemble

10

Tests Administered and ScoredTests Administered and Scored

11

OptionsOptions

• Hand data entry program can be downloaded from the www.onetcenter.org website

• Scoring Program and User’s Guide found on www.onetcenter.org website

12

Score Report (1)Score Report (1)

Person’s scores are compared to general working population – the norm group.

graphic, numerical and verbal information

13

Score Report (2)Score Report (2)

Reports the Constructs Measured – not the subtests

Percentiles

14

What is a Percentile?What is a Percentile?Raw No. People Cum Freq Cum Per

1 2 2 0.4%2 3 5 1.0%3 5 10 2.0%4 9 19 3.8%5 13 32 6.4%6 22 54 10.8%7 35 89 17.8%8 52 141 28.2%9 68 209 41.8%

10 50 259 51.8%11 72 331 66.2%12 65 396 79.2%13 20 416 83.2%14 15 431 86.2%15 14 445 89.0%16 12 457 91.4%17 10 467 93.4%18 9 476 95.2%19 7 483 96.6%20 5 488 97.6%21 6 494 98.8%22 3 497 99.4%23 2 499 99.8%24 1 500 100.0%25 0 500 100.0%

15

Score Report (3)Score Report (3)

Number Correct of Total Items

No number correct; number

attempted

16

Score Report (4)Score Report (4)

Note

17

NormsNorms

• Based on a sample of 4000 people selected to reflect the distributions of workers in five occupational categories as per the US Census Bureau

– Professional and Semi-professional– Clerical, Sales, and Kindred Workers– Craftsmen, Foreman, and Kindred Workers– Operatives and Kindred Workers– Laborers (except farm and mine)

18

General Working PopulationGeneral Working Population

• Norms developed in 1950s • Studies show Means and SDs stable over

time (USES Test Report No 148, 1984)• Sample called the General Working

Population

19

General Working Population (2)General Working Population (2)• Sample selected to represent the percent of population

by occupational groupings– Age Range = 18-54 years– Mean Education = 11 years

• Males, 10.2• Females, 11.7

– Gender• Males, 46%• Females, 54%

– Supplemented by many additional studies to include high school students

– See General Aptitude Test Battery, Development Report, Section III for details

20

Linking GATB Norms to the APLinking GATB Norms to the AP

• Equating study performed between GATB and AP

• Results sufficiently similar between GATB and AP so that the general working population norms could be used (Segall and Monzon, 1995)

21

Score Report (5)Score Report (5)

22

Score Report (6)Score Report (6)

23

Score Report (7)Score Report (7)

24

Selecting a Job ZoneSelecting a Job Zone

25

Occupational ReportsOccupational Reports

• Five occupational listings are generated, one for each job zone

26

Job Zone 1 OccupationsJob Zone 1 Occupations

27

Job Zone 2 OccupationsJob Zone 2 Occupations

28

Job Zone 3 OccupationsJob Zone 3 Occupations

29

Job Zone 4 OccupationsJob Zone 4 Occupations

30

Job Zone 5 OccupationsJob Zone 5 Occupations

31

Match Profile to Match Profile to Occupational Information (1)Occupational Information (1)

• Occupational Ability Profiles (OAPs) were created for each of the 950+ O*NET occupations (see available development report for more detail)

• Ability scores of job incumbents (1000+ jobs) along with information from the DOT (e.g., data, people things; SVP) were used to estimate the 9 ability scores for each occupation

• Occupation profiles were converted to the existing O*NET/SOC classification system

32

Match Profile to Occupational Match Profile to Occupational Information (2)Information (2)

• Person’s ability profile is matched to occupational profile – Using index of similarity (correlation)

• Shape of the profile matters, not the level or percentile

• Minimum of 10 occupations are generated for each job zone – up to 25 if they are “strong matches”– correlation cutoff depends on number of AP

subtests taken

33

Score Report (8)Score Report (8)

Fire InspectorRetail Salesperson

33-2021.0141-2031.0041-3011.00

Based on list of occupations, the client selects one job from Job Zone 1 and two from Job Zone 3

Advertising Sales Agent

34

Exploring an OccupationExploring an Occupation

• Select occupation to explore• Example: Fire Inspectors, Job Zone 3• Go to O*NET ONLINE

– http://online.onetcenter.org

35

36

37

38

39

40

41

42

43

44

45

Discussion – Joe LuwisDiscussion – Joe Luwis

46

Questions/CommentsQuestions/Comments

47

O*NET AP Administrators Training O*NET AP Administrators Training Tools available on O*NET AcademyTools available on O*NET Academy

• Online Self-Assessment Quiz !

Gauge your understanding of what it takes to successfully administer the Ability Profiler .

• Downloadable Lunch and Learn Training Packet

Includes PowerPoint Slides, FAQs, Administrator Checklist, and Scenarios for Group Discussion

www.onetacademy.com

• Check out www.onetcenter.org for more information

48

Supporting WebinarsSupporting Webinars• How to Download and Use the O*NET Interest Profiler

and Work Importance Profiler

• Overview of the O*NET Ability Profiler

• How to Administer the O*NET Ability Profiler

• How to Interpret the Ability Profiler

• O*NET for Job Seekers and Students

• New Enhancements to O*NET

• O*NET Tools for School Counselors

• O*NET Tools for Military in Transition

• Links between Occupations, Education, and Pay