An Exciting Time in the Field of Testing ! Testing Industry Momentum Growth and Change $ Multi-Billion $

An Exciting Time in the Field of Testing !

Testing Industry Momentum

Growth and Change

$ Multi-Billion $

Testing Companies are Increasing

in Size and in Number

Paper & Pencil Volumes Worldwide

are Continuing to Move to CBT

This academic year more than

one million P&P tests will move to CBT

Tens of millions of tests

still remain P&P

New “service providers” are entering the field

supporting all aspects of testing

New test delivery vendors are emerging

focusing on selected market niches

Larger test delivery vendors are growing by

buying smaller testing-related companies

Even large test delivery vendors are being

sold to other large test delivery vendors

“Independent commercial” test centers

are just starting to emerge around world

promising to introduce a new dynamic

into the traditional academic and

corporate designations.

Emerging technologies are introducing

new paradigms for test delivery

Continuing advances in reconciling

psychometric opportunities with

existing business restrictions

Is there growth and change underway in

the nations colleges that could enhance

the value of college testing departments?

So what’s going on in academia?

Increased need for secure testing

to support On-Line Learning

Increased recognition of the

importance of Placement Testing

Assessment in general is more integrated

into the institutional process then ever before

In Academia:

Increasing demand for

centralized make-up testing

Increasing demand centralized

testing for on-campus courses

Increased value of test revenue

in financially demanding times

In Academia:

As our value to our colleges increases

what do we find?

reduced budgets

reduced staffing

increased work load

increased expectations

College administrators aren’t really sure

about what they should do with us

Student Affairs?Academic Affairs?

Counseling?

Enrollment Management?

Institutional Assessment?

Student Retention?

College administrators aren’t really sure

about who we are or what we do!

College Testing Professional ? ? ?

College Testing ProfessionalCollege Testing Professional

Dedicated to established national standards & professional practices in the administration of testing programs and servicesCommitted to fair and consistent testing maintaining the security and standardization demanded for the equitable and reliable administration of life impacting assessments.

Dedicated

Committed


Negotiate agreements with outside vendors

Respond to changes ina commercial industry

Provide services to individuals outside your college community

UNIQUE !

Skills Require

d ?

Skills Require

d ?


Establish Budgets

Hire andSupervise

Operate MultipleSoftware Systems

Handle Revenue

Oversee Inventory

Adapt to Multiple Outside Operational Protocols

Purchasing& Invoicing

DevelopPublications

Maintain Web Page Content

Work Directly with Local and National Vendors

Offer Services Daytime, Evenings, & Weekends

Provide Support to Both Academic & Student Affairs


It seems

there is never

enough time and

nothing goes

as planned!!



Help


Professional Colleagues Resources & Guidance

How-To HelpNational Standards Best Practices

Professional Credibility Within Your Institution

A Personal PerspectiveA Personal Perspective

The College Testing ProfessionalThe College Testing Professional

The Future and NCTAThe Future and NCTA

NCTA is at a CrossroadNCTA is at a Crossroad

“Duh”! Our name says it all.

NCTA should serve only Colleges.

WHO SHOULD NCTA SERVE?

What about the testing professionals in the nations public elementary and secondary school districts?


What about the thousands of testing professionals working in licensing agencies and certification bodies, and in non-profit organizations, and in State Departments of Education?

These are not college people !


Let those other testing people do their own thing and we’ll do our thing ! !

The is a rich history of leadership by

assessment and testing professionals

within the nations colleges that has

created the fields of psychometrics,

assessment and testing.

The Precedents for College Leadership

Edward L Thorndike applied the scientific method to the constructionof tests that measure academicperformance.

Lewis Terman at Stanford created the Intelligence Quotient (IQ) by dividing mental age by chronological age.

The College Entrance Examination Board published subject syllabi for schools to teach and colleges to test.

Researchers at University of Iowadeveloped the Iowa Test of Basic Skills.

The Stanford Achievement Tests were created to assess subject knowledge.

First Scholastic AptitudeTest was introduced.

The CaliforniaAchievement Testwas published.

Universities and the CollegeBoard were operating their own commercial testing businesses

These tests were delivered throughout the country

The Universities were doing their own test development, delivery, scoring and reporting

The Universities actually werethe nation’s Testing Industry!

The post WWII demand for college entrance testing led to the establishment of ETS in 1947.

American Councilon Education

The Carnegie Foundation

http://www.actstudent.org/index.html

For-profit testing companies are a relatively

new phenomenon in the field of testing.

The Colleges historically led the way.

Why should it be different now?

NCTA is the only national organization

dedicated to the development and

promotion of professional standards and

practices in testing.

Here’s the NCTA Mission:

“NCTA is dedicated to the promotion of

professionalism and quality in the administration

of testing services and programs, including issues

relating to test administration, test development,

test scoring and assessment.”

It doesn’t say just for colleges!

IT IS BETTER TO LEAD THAN TO FOLLOW

. . . IF YOU ARE ALREADY THE LEADER

NCTA SHOULD LEAD THE TESTING WORLD !

This Past Year in NCTA:

Implemented the NCTA Board Grant Program

Created a Volunteer Service Program

Completed the Phase-1 Pilot of the NCTA Test Center Certification Program

Refocused the Professional Development Initiative

Launched a Marketing Committee Initiative

Launched a Recruitment Committee Initiative

Restructured the Conference Sponsorship Program

Completed the first phase of the Web Site Redesign

Completed Board Position Manuals

Restructured the Treasurer Role and Finances

Launched Multiple Communications Initiatives

Introduced a New Award Category for Service

Expanded Board Size and Extended Officer Terms

The BOARD GRANT PROGRAMThe BOARD GRANT PROGRAM

Brian Endicott

Committee Chair

Brian Endicott

Committee Chair

Grant Committee Members

Brian Endicott (Chair) The Ohio State University, Columbus

Jill Carlson San Juan College, Farmington, NM

Lea Brown East Tennessee State U, Johnson City

Mike Davis Austin Community College, Austin

Roberto Voci University of Oklahoma, Norman

NCTA BOARD GRANT PROGRAM

Support the formation of State testing organizations

Encourage professional support activities for members

Offer professional development opportunities for members

Support projects and activities that promote the Mission

PURPOSE


ELIGIBILITY

NCTA members and groups of members in good standing

Other Groups and organizations supporting the Mission

Award Recipients may not apply again for two years

The NCTA Board may modify these Eligibilities in the future


AWARDS

Grants will initially range between $300 and $3,000

The NCTA Board will set the Award Pool total annually


The Board set aside $12,000 for Grant Awards for FY10

FY10 Awards Granted total $10,400

Fall Semester Announcement, Application Submissions

Award Announcements at ConferenceSummer

Application Evaluations, Award Decisions Spring Semester

Implement Funded Project or Activity Fall & Spring

Grantee Reports on OutcomesSummer

Inaugural Year Grant Program Time Line

The timeline for FY11 Award cycle will be available at the breakout session and will be published on the NCTA website.

FY10 AWARD RECIPIENTS

$3,000 FACTA – Florida Association of College Test Administrators

Support for the 2nd Annual FACTA Conference

$1,400 Indiana University/Purdue University at Indianapolis

Support for Expanding Testing Services Available to Faculty

$1,800 Kentucky College Testing Mini-Conference

Support for a Statewide Meeting of KY College Testing Staff

$1,200 Winthrop University at Rock Hill, SC Support for Staff Training and Professional Development

$3,000 Arizona College Testing Association

Support to Launch the Organization and Hold a First Meeting

Professional Development CommitteeProfessional Development Committee

Steve Saladin

Committee Chair

Connie Lorrick, University of Texas, Arlington (Past Chair)

Steve Saladin, University of Idaho (Chair)

Kay Alford, Coastal Carolina University

Cristina Ariza, University of the Incarnate Word

Cheryl Downey-Eber, Missouri U. of Science & Technology

Alice A Mitchell, University of Maryland, College Park

Shannon Siebler, Northwest Arkansas Community College

Wendy Gruver, Texas A&M University, Commerce

Professional Development CommitteeProfessional Development Committee

Webinars - Topical trainings - Live / Interactive - Library of Recorded Trainings

Conference Recordings – Podcasts with Synchronized Audio and PowerPoint

Standards & Guidelines for Testing Professionals

Maximize the Professional Development Opportunities within the Certification Process

Professional Development InitiativesProfessional Development Initiatives

Volunteer Service ProgramVolunteer Service Program

Sally Frazee

Chair

Sally Frazee

Chair

NCTA Volunteer Service ProgramNCTA Volunteer Service Program

Maximize volunteer service to the organization by actively recruiting volunteers

Match NCTA positions and projects with members who volunteer to serve

Initial Steps Taken & Completed Initial Steps Taken & Completed

Reviewed and identified areas in need of volunteer help

Focused on key initiatives: Recruitment Committee,

Marketing Committee, and Newsletter Reporters

Developed a web page listing volunteer opportunities

Sent out information on the mailing list

Matched volunteers to open positions

2009-2010 Volunteer Highlights

• Make a point to talk to me over the next few days

• Send me an e-mail when you get back to the office

• Watch for mailing list announcements

• Check the website for Volunteer Service opportunities

• Make a point to talk to me over the next few days

• Send me an e-mail when you get back to the office

• Watch for mailing list announcements

• Check the website for Volunteer Service opportunities

If you are even

the slightest bit interested in

joining the cause….

If you are even

the slightest bit interested in

joining the cause….

Sally Frazee

NCTA Volunteer Service ProgramNCTA Volunteer Service Program

[email protected]

Marketing CommitteeMarketing Committee

Joleen Reynolds

Committee Chair

NCTA Marketing Committee

Joleen Reynolds, (Chair) University of Texas - San Antonio

Nancy Ness, Boise State University

Theresa Scott, Florida Atlantic University

Mary Vaughn, Mississippi State University

Increase awareness of NCTA as Leader in the testing field

NCTA Marketing Objectives

Promote the NCTA “brand”

Facilitate the development of State testing organizations

Expand the awareness of the benefits of membership

Promote increased member participation in NCTA

• Non-Members in Four-Year Colleges

Targeted NCTA Markets

• National Certification Organizations

• Assessment and Testing Related Corporations

• Current NCTA members

• Non-Members in Two-Year Colleges

• State Licensing Agencies

• Public School District Administrators

• International Testing Professionals

Developed a List of Marketing Resources

Initial Committee Activities

First: Market the CCTC to On-Line Learning Departments

Developed a List of Actions for Each Market

Aligned the Objectives with the Targeted Markets

• Acquired a list of all major On-Line Learning Departments in domestic Colleges with contact names and e-mail addresses

• Developed marketing-focused correspondence

• Acquired a dedicated NCTA marketing e-mail address

Target the “low hanging fruit” next

Immediate Next Steps

Establish a detailed Action Plan for each target

Develop a variety of marketing resources

Complete a comprehensive Marketing Plan

Continue to push ahead !

[email protected]

Recruitment CommitteeRecruitment Committee

Joseph Fenty

Committee Chair

NCTA Recruitment Committee

Joseph Fenty, (Chair) Washtenaw Community College

Kay Alford, Coastal Carolina University

Regina Beach, Morehead State University

Cynthia Bertalott, University of Central Missouri

Anastasia Brown, College of the Bahamas

BJ Stasek, University of South Florida

Linda Trevarthan, Michigan State University

Recruitment Committee Activities

Develop a State Liaison “Kit” to support founding and growing State Testing Organizations

Reach out to non-member community colleges to attract new members (Conducted outreach in MI, FL & SC)

Attract GED Test Centers into NCTA as Members(Conducted outreach in MI)

Enlisted the help of NCTA State Liaison members to identify non-NCTA members in their States

Motivate current collegiate members to actively recruit colleagues as members

Recruitment Committee FY11 Objectives

Collaborate with the Marketing Committee to develop recruitmenttools, identify market segments and coordinate outreach.

Collaborate with the State Liason Committee to benefit fromthe relationship they have established.

Develop publications and other recruiting materials.

Develop a comprehensive Member Recruitment Plan targetingpotential Collegiate, Non-Collegiate and Corporate members

Test Center Certification Project

Certifying What ?

Certify “Test Centers” - - - Not People

Facilities Staffing

Resources Policies

Procedures

etc.

Standards

“Testing Programs”

Certifying that . . . ?

Certifying that the Test Center meets

established Professional Standards . . .

. . . has in place the facilities, resources,

staffing, standards, policies, procedures,

etc, as prescribed and published by NCTA

“meets” =

Your State Department of Motor Vehicles

“certifies” your car is road worthy.

It does not certify how well you drive it!

NCTA is not certifying how well staff

are applying professional standards

That would require an “Audit”

An audit demands on-site observations

and detailed analyses of the program’s

performance and management.

We are not implementing an Audit Program.

A Future NCTA Test Center Audit Program ?

YET . . . ?

For Certification Program Information:

Go to: www.NCTA-Testing.org

Click on “About”

Click on “Committees”

Click on “Reference Documents”

Scroll down to: “Certification . . .”

http://www.ncta-testing.org/ncta/committees/files/index.php

Certification Program Information:

2007-08 and 2008-09 Project Objectives.doc

Cert Process Graph.doc

Certfication Tasks & Standards.doc

Certification-2008 Presentation Outline.doc

Current Committee Members.doc

Proposed Certification Standards.doc

Standards NCTA Self St. 3-Column Criteria June 2003.doc

Test Center Certification Presentation 2008 Conf.pps

FY10 Test Center Certification


http://www.ncta-testing.org/ncta/committees/files/testcentercertification/2007-08%20and%202008-09%20Project%20Objectives.doc

http://www.ncta-testing.org/ncta/committees/files/testcentercertification/Cert%20Process%20Graph.doc

Certification Program Information:

MEETING MINUTES

Test Center Certification Committee

Minutes from Sixty One Meetings

from February 2008 to the Present


Review and Evaluation Procedures

Review and Evaluation Procedures

CertificationHelp-LineSupport

CertificationHelp-LineSupport

CertificationSelf-Study

CertificationSelf-Study

Guide to the Certification

Process

Guide to the Certification

Process

Descriptive & Objective Data

Collected

Descriptive & Objective Data

Collected

CertificationApplication

CertificationApplication

Documents,Samples and

Photos

Documents,Samples and

Photos

Use Internal or External Verification

Use Internal or External Verification

ApplicationReview

ApplicationReview

Review for Completeness with “Advisor”

Review for Completeness with “Advisor”

Forward Application

for Evaluation

Forward Application

for Evaluation

Notify Applicantof Status

Notify Applicantof Status

CertificationOutcome

CertificationOutcome

“Pending” Action or Data

Still Needed

“Pending” Action or Data

Still Needed

“Provisional” Minor Change

Needed

“Provisional” Minor Change

Needed

Certification “Awarded”

Certification “Awarded”

Send to Boardwith

Recommendation

Send to Boardwith

Recommendation

ApplicationEvaluationApplicationEvaluation

Evaluate on NCTA Standards

Evaluate on NCTA Standards

Interact with Applicant as Needed

Interact with Applicant as Needed

NCTA Test Center Certification Process OutlineNCTA Test Center Certification Process Outline


Test Center Certification Program

Duane Goupell

Committee Chair

Test Center Certification Committee

Gayle Veltman Wichita State University

Duane Goupell, Chair U of Wisconsin - Oshkosh

Vicki Black University of Memphis

Kimberly Moody Temple University

Steve Saladin University of Idaho

Theresa Scott Florida Atlantic University

Accomplishments for 2009-2010

• Developed Criteria for Evaluation

• Developed Application and Other Forms

• Developed Review Processes & Procedures

• Completed Phase 1 of Pilot and Launched Phases 2 and 3

• Prepared Time-Line & Budget for Project Completion

• First NCTA Test Center Certifications Awarded

Goals for 2010-2011

Develop Q & A for Website

Complete Phases 2 and 3 of Pilot

Recruit Volunteers for Certification Review Committee

Launch Certification Program

Finalize all Forms, Policies and Procedures

Establish Time Lines for Process

Submit Final Project Report and Recommendations to Governing Board

NCTA Certified Test Centers

Florida Atlantic University, Boca Raton, FL

Michigan State University, East Lansing, MI

Washtenaw Community College, Ann Arbor, MI

Just Ahead

Moving the NCTA

Test Center Certification

Program from Pilot to Operation

Will be Both Challenging and Demanding

David Espinoza

University of Oregon

NCTA President Elect