2007 Annual Conference

Considerations forContinuous CBTÉ

Grady Colson Barnhill, Director,Recertification & Professional Assessment

Commission on Dietetic Registration

What is CCT?CBT = Computer-Based TestingCCT = Computerized Classification Test

• Competent or Not Competent?• Focus on measurement precision near cut score • Focus on reliability of decision2007 Annual Conference

Council on Licensure, Enforcement and Regulation

Atlanta, Georgia

The Testing Programs

2007 Annual Conference

Council on Licensure, Enforcement and Regulation

Atlanta, Georgia

Program # Items#

Pretest Items

Time allowed

RD 100-120 25 3 hours

DTR 80-100 30 3 hours

(CBT since 9/1/99)

The Testing Programs

2007 Annual Conference

Council on Licensure, Enforcement and Regulation

Atlanta, Georgia2007 Annual Conference

Council on Licensure, Enforcement and Regulation

Atlanta, Georgia

ProgramTotal # Items

Minimum

sec./item

Avg. Item

Latency

RD 125-145 74 sec. 46 sec.

DTR 110-130 83 sec. 51 sec.

The Testing Blueprints

2007 Annual Conference

Council on Licensure, Enforcement and Regulation

Atlanta, Georgia2007 Annual Conference

Council on Licensure, Enforcement and Regulation

Atlanta, Georgia

Content RD DTRFood &

Nutrition15% 10%

Nutrition Srvcs:Commun./

Clinical40% 38%

Educ. (& Research)

7% 7%

Foodservice Sys.

18% 25%

Management 20% 20%

The Testing Programs

2007 Annual Conference

Council on Licensure, Enforcement and Regulation

Atlanta, Georgia2007 Annual Conference

Council on Licensure, Enforcement and Regulation

Atlanta, Georgia2007 Annual Conference

Council on Licensure, Enforcement and Regulation

Atlanta, Georgia

ProgramTotal #

Examinees/yr.

% Passing

RD 4,221 72%

DTR 351 57%

2007 Annual Conference

Council on Licensure, Enforcement and Regulation

Atlanta, Georgia2007 Annual Conference

Council on Licensure, Enforcement and Regulation

Atlanta, Georgia2007 Annual Conference

Council on Licensure, Enforcement and Regulation

Atlanta, Georgia

Sequential Probability Ratio

Test (SPRT)RD DTR

Min. Ability Level -0.69 -0.34

Zone of Indifference +/-0.20 +/-0.20

Acceptable Error Rate

5% 5%

The Pros

Candidates love instant results!

Helps control item exposure (esp. with no review)

Year-round testing provides more flexibility - more locations

Computer testing provides more potential for creativity - fidelity

2007 Annual Conference

Council on Licensure, Enforcement and Regulation

Atlanta, Georgia

2007 Annual Conference

Council on Licensure, Enforcement and Regulation

Atlanta, Georgia

The ConsQuality control usually = once/yr.

Item analysis/review corrective “for next time” - not linked to candidate score

Expense

Sometimes variable-length test seen as disadvantage

2007 Annual Conference

Council on Licensure, Enforcement and Regulation

Atlanta, Georgia

Security Considerations

Innocent Conversations

Internet Brain Dump sites

Test Prep AgenciesTechnology (text

message, camera phones, tie cams)

2007 Annual Conference

Council on Licensure, Enforcement and Regulation

Atlanta, Georgia

Item Exposure Over-exposure of items at popular ability

levels Computer routines to control item over-

exposure (Simpson-Header Control)

2007 Annual Conference

Council on Licensure, Enforcement and Regulation

Atlanta, Georgia

Challenges

•Small sample size = Hard to get sufficient N for item analysis

•Small sample size = Hard to get sufficient N for pretest items

•Small sample size = Hard to get sufficient $ for program

2007 Annual Conference

Council on Licensure, Enforcement and Regulation

Atlanta, Georgia

Text

Future?

•More candidates!

•Dietetics Education Task Force

•Minimum for 3 Parameter = 300?

•Rasch?

Council on Licensure, Enforcement and RegulationAtlanta, Georgia2007 Annual Conference

Speaker Contact InformationThank you for your attention..

Grady Colson Barnhill, Director

Recertification & Professional Assessment

Commission on Dietetic Registration

(312)-899-4768

Gbarnhill@eatright.org