Embed Size (px)
Citation preview
www.caveon.com 1
The Certified Exam Security Professional
September 2, 2015
Caveon Webinar Series
www.caveon.com 2
Presenters
Jamie Mulkey, CESP Executive Director
David Foster, Caveon CEO
Mark Poole, Test Security Professional and CESP
Certification dedicated to the exam security professional– Recognizes experience and skills in
exam security– Covers the breadth of exam security
challenges– Provides clear standards in promoting
the integrity of high-stakes testing programs
What is CESP?
www.caveon.com
Who should take the exam?
• Designed for testing professionals
• Demonstrated skills and knowledge to protect examinations
• Prepared to handle possible test security threats
www.caveon.com
• Cost of exam $175 for each attempt
• You may attempt the exam 2 times.
• Three month wait after 2nd failed attempt
• No more than 5 attempts without permission
Exam Cost and Retake Policy
www.caveon.com
www.caveon.com 6
Obtaining Level 2 Certification• Must obtain a score of
170 on the exam• May retake exam up to
two times, after passing the level 1 exam
• 3 month waiting period after 2nd failed attempt
www.cespcert.org • CESP Resource list• General texts• White papers• Breach summaries• Industry standards and
guidelines• Training resources coming
How should I study for the exam?
www.caveon.com
What to expect during the exam• Application process• Two devices needed• Online proctoring• Exam Administration• Score results• Digital badge
Dave Foster’s Topics
• Designing CESP exam• Building the CESP exam• Administering the CESP Exam
Designing the CESP Exam• Brief exam• Primarily assesses knowledge retrieval
skills regarding a broad and comprehensive set of test security topics
• Embedded pre-test Items• Security was a major concern as we
designed the test– Prevent/reduce exposure of content– Deter cheating and theft
Test Design for Security
• Two major design features–Adaptive Testing–Super-DOMC Items• Target of 10 options per item• Ended up with between 5 and 15 options per item
Building the CESP Exam• Industry experts involvement at every stage• Priority use of Internal SMEs• Distributed use of External SMEs
– Strong contracts• Steps
– Job analysis– Blueprint– Item Authoring– Item Reviews (edit and accuracy)– Item Difficulty Rating using Information Integration
Theory• For setting the cutscore• For supporting the adaptive test
www.caveon.com
Evidence of Validity
• Development Process• Study #1– Rating of Caveon employees by
executive management as to Pass/Fail decision
– Correct classification rate of .74.
Administering the CESP Securely• Taking the test wherever• Online proctoring– Using candidate cell phones– Large view of the room– Constant audio– Control over testing session
• Strong examinee agreements• Authentication using photographs,
identifying documents and proctor familiarity – Post verification process
www.caveon.com
Other CESP Security Measures
• Data Forensics• Web monitoring• Investigationswww.caveon.com
Testing Firsts
• First certification exam to use DOMC
• First to use super-DOMC• DIY online proctoring• Adaptive test using item
difficulty ratings• Use of Information Integration
Theory for setting cutscores
www.caveon.com
A CESP’s Experience
www.caveon.com
• Certification security professional for 15 years
• Skills developed organically• Test security maturing as a
profession • Standards and best practices
becoming more important• Need for consistent industry-
specific learning and skills development path
Benefits of CESP Certification
www.caveon.com
• Exam security professionals– Comprehensive understanding of a
broad set of test security topics, vs. expertise in one or two areas
– Currency with standards, best practices and recent developments
– Visibility and recognition with CESP designation
• Exam sponsors– Establish a baseline level of competency
for exam security personnel
Benefits of CESP Certification
www.caveon.com
• Testing community– Strengthen professional
development– Less time and effort discussing
and explaining fundamentals – Professional skills alignment to
recognized standards and best practices
• Test takers and public– Increase public confidence in
exam security– Improving perception of fairness
What will the CESP Certificant Receive?• CESP-Generalist
Certification• Digital badge for
successful certification completion
• Recognized industry experience
• MOC• Additional levels• Recertification
• LinkedIn Group• Follow the CESP program for
updates• Facebook and Twitter
Groups/Networking Opportunities
www.caveon.com
www.caveon.com 22
Thank You!
Jamie Mulkey, Executive [email protected]
Dave Foster, [email protected]
Mark Poole, Test Security Professional & CESP - Generalist
www.cespcert.org
