ITAB IT Aptitude Battery © CogniMetrics, Inc., 2006 NAMIS Product Fair Fairfax, VA. January 11 th, 2006

ITABITAB IT Aptitude BatteryIT Aptitude Battery

© CogniMetrics, Inc., 2006

NAMIS Product FairFairfax, VA.January 11th, 2006

Content Content navigatornavigator

ITAB: IT Aptitude Battery• What is the ITAB?• ITAB and the U.S. Navy

ITAB: procedural skills• What is “procedural skill”?• Examples of “procedural skills”

ITAB: tests• Measurement purpose• ITAB 1: Hidden Target Test• ITAB 2: Battery Test• Computer game-like tests• How do ITAB tests measure PKL aptitude?• Innovative features• ITAB: Test Data• ITAB: Test Report

ITAB: Information• ITAB: technical information• ITAB: access information

The compass icon appears on many slides in the slide show. Click on one of its arrows to return to the navigator page.© CogniMetrics, Inc., 2006


The ITAB is the world’s first battery of fully interactive tests of human intelligence.

A product of:CogniMetrics, Inc. San Antonio, TX

What is the ITAB?



The Navy Mission requires its personnel to be able to operate a great variety of technical systems. The cognitive skill required for using such systems is called procedural knowledge, or procedural skill.

Traditional tests of intelligence, such as the ASVAB, were not designed to measure aptitude for procedural skill learning.

ITAB and the U.S. Navy


ITABITAB procedural skillsprocedural skills

Procedural skill is knowledge that a person uses to interact with a physical, or conceptual, system to achieve a particular goal.

What is “procedural skill”?


Procedural skills vary in complexity from performing operator maintenance on a M16A1 rifle, to preparing board weapon systems for operation, to operating board weapon systems, and to remotely controlling UAVs.

Cognition research in the nineties has deepened our insight into how procedural skills are learned.

Examples of “procedural skill”

ITABITAB procedural skillsprocedural skills


ITABITAB teststests

The ITAB tests measure the aptitude to learn procedural skills (procedural knowledge).

We will refer to this aptitude as PKL aptitude (procedural knowledge learning aptitude).

Measurement purpose


ITABITAB teststests

ITAB 1: Hidden Target Test

Task: The Interface of the Hidden Target test generates a two-dimensional search space consisting of a rectangular grid of equally spaced horizontal and vertical lines.

The subject is required to determine where a target is located in as few steps as possible. The subject can move a cursor across the two-dimensional space from junction to junction using a set of arrow keys. To indicate his or her first guess the subject clicks at the <TEST> key. The feedback of the task-environment indicates the distance between the tested location and the location of the hidden target in City Block metric..

<START> bar

<MOVE> <TEST> keys

HELP menu


ITABITAB teststests

ITAB 2: Battery Test

Task: the test requires the individualto test whether the presented batteries work. Each new trial starts with a set of nine batteries to be tested. The battery tester is designed such that batteries have to be tested in pairs. The goal of the task is to identify the defective batteries in as few steps as possible. Each set of nine batteriescontains two defective batteries.

HELP MENU

<REJECT> button<TEST> button

<START> button

Feedback window


The feel of a computer game

Combining a game-like character and an intuitive interface gives ITAB tests an advantage in testing populations that have developed an aversion against school math and the static logic of traditional intelligence tests.

ITABITAB teststests


How do ITAB tests measurePKL aptitude?

The tests provide an interactive task environment in which the individual has to achieve a goal. The tests measure:

• how feedback is incorporated into follow-up actions• how quickly this leads to a more or less efficient procedure

ITABITAB teststests


Innovative features

1. ITAB tests provide an (interactive) task environment.

2. Actions of individuals are not scored as singleton answers to distinct problems, but analyzed as sequence patterns.

======3. The test report is organized according to an

empirically tested structural equations model.

ITABITAB teststests

© CogniMetrics, Inc., 2006CONTINUE

ITAB: TEST DATA

Each ITAB test provides an interactive task-environment. An examinee action (user action) changes the environment (system action) and the examinee receives feedback about the new state of the task-environment (system output).

The diagnostic components of the ITAB tests measure these changes per user step and analyses:

• sequential aspects of the user actions

• The informational content of each new system state

ITABITAB teststests


ITAB: TEST REPORT

The diagnostic components of the ITAB tests organize the many measurements into three scores that are intuitively accessible.

The individual test reports provide these scores for prediction purposes as well as detailed analysis of test performance that may help understanding and improving it.

ITABITAB teststests


ITAB: TEST REPORT

systematicapproach

e5

e4

intelligence

e7

e6

e3

e2

e1

PKL(B)

ENT_B e9

MEAN_BRT e10

VAR_BRT e11

e8

ITABITAB teststests


ITAB: TEST REPORT

systematicapproach

e5

e4

intelligence

e7

e6

e3

e2

e1

PKL(B)

ENT_B e9

MEAN_BRT e10

VAR_BRT e11

e8

ITABITAB teststests


systematicapproach

e5

e4

intelligence

e7

e6

e3

e2

e1

diagnostic information

ITAB: TEST REPORT

PKL(B)

ENT_B e9

MEAN_BRT e10

VAR_BRT e11

e8

predictor score

procedural learningaptitude score

ITABITAB teststests


ITAB: TEST REPORT

systematicapproach

e5

e4

intelligence

e7

e6

e3

e2

e1

diagnostic information

PKL(B)

ENT_B e9

MEAN_BRT e10

VAR_BRT e11

e8

predictor score

consistent and carefulwork style

efficiency informationprocessing

ITABITAB teststests


ITAB: TEST REPORT

systematicapproach

e5

e4

intelligence

e7

e6

e3

e2

e1

PKL(B)

ENT_B e9

MEAN_BRT e10

e8

Battery Test

VAR_BRT e11

ITABITAB teststests


ITAB: TEST REPORT

systematicapproach

e5

e4

intelligence

e7

e6

e3

e2

e1

PKL(H)

ENT_H e9

MEAN_HRT e10

e8

Hidden Target Test

VAR_HRT e11

RETURN

ITABITAB teststests


Measurement claim: procedural knowledge handling(aspect of general intelligence)

Number of tests: 2 (HTT and BT)Administration time: 10 minutes per test (average)Languages: English, Spanish, German,

Dutch

Test Publisher: CogniMetrics, Inc.Published: March 2004Price: see: www.cognimetrics.com

bulk discounts negotiable

Reliabilities: HTT (0.88 – 0.97)BT (0.80 – 0.87)

Validities:• construct validity studies: see: FOR MORE INFORMATION• predictive validity studies:currently under way with:

- Air Force Research Lab, Brooks City Base;

- Navy Directorate Selection and

Classification, Washington, D.C.

FOR MORE INFO...

• Download ITAB manuals: www.cognimetrics.com• Report on construct validity: www.internationalmta.org/2004 (paper 066; powerpoint presentation 066).

ITABITAB informationinformation

ITAB: Technical Information


ITAB: Access Information

Web site: www.cognimetrics.com

Select <login tests>

Select language: English, Spanish, German, Dutch

Username: Password: Test:

ASMR ASMRS Hidden Target

ASMR ASMRU Battery Test

ITABITAB informationinformation


Thanks for reviewing thisCogniMetrics proposal

For further information,Please contact:

Dr. Martin J. Ippel

(210) 481 – [email protected]


Interactive Task Environment:

Complete interactivity is achieved by creating an internal representation of the task-environment.

Artificial Intelligence technology is used to compute the “intelligence” of each step.

RETURN


ITABITAB teststests

Analysis of behavior sequences

Unlike traditional tests, ITAB tests do not consists of items with a standard set of responses. The individual is free to act within the task-environment. The individual must produce a sequence of actions to achieve a goal, while using the feedback provided by the task-environment. Performance assessment is based on analysis of these action sequences.

RETURN


ITABITAB teststests

Documents

ITAB IT Aptitude Battery © CogniMetrics, Inc., 2006 NAMIS Product Fair Fairfax, VA. January 11 th, 2006