NCDPI Observer Calibration Training

Introduction & Demo

Agenda2

Introduction to OCT Overview of Platform Live Demo

Why?3

N.C. recognizes that the accurate and reliable evaluation of teachers is more important then ever High stakes decisions Teachers need and want coaching

Clear message from principals, human resources and superintendents –

“We need more training on the NCEES”

Approximate Time Commitment: 20 hours

BloomBoard5

Easy access to a marketplace of supplemental professional growth opportunities, resources, and services tailored to each educator’s unique needs. Thousands of articles, videos/video clips, and

links to web based resources at your fingertips Further support the work you’re doing through

Observation Engine’s scoring studies and calibration events

What is Observation Engine?

• An online tool that uses classroom videos to ensure accurate and reliable classroom observations

• Videos from the MET library have been master-scored on the NCEES teacher evaluation rubric to create learning opportunities for teacher evaluators in North Carolina

Observation Engine will provide NC evaluators:

1. Observer Calibration Events & ReportingProvides rating practice and helps increase rater agreement to

target scores using Scoring Studies

2 Scoring Studies completed during pilot

2. Supplemental Learning ExercisesProvides targeted, self-paced online exercises focused on specific

NCEES elements using Lessons

17 Lessons completed during the pilot

2 videos per lesson

1. Calibrate through Scoring Studies

• Improves rater agreement to target scores

• Builds consensus among evaluation staff and helps establish a mutual understanding of the best ratings

• Facilitates group learning through discussion of areas of disagreement

3b Knows Content for Specialty

3d Makes Instruction Relevant

4g Communicates Effectively

4a Knows How Learning Takes Place

4d Integrates TechnologyVideo 1: Distribution of Ratings by NCEES Element

*

*

*

*

*

* = Target Score

Calibration Reports – sample figures

Calibration Reports – sample figures cont’d

2. Rating practice through Lessons

• Complete self-paced practice exercises

• Watch and rate short video(s) clips, focusing on NCEES indicators

• Receive immediate on-screen feedback

Live Demo

Lesson

Plans

Observation

Rubric

Note Guide:

Poll Everywhere

Please rate the teacher in video clip 1 using Element IVc: Teachers use a variety of instructional methods.

Text the code for your choice to 22333

Rating feedback

Rating feedback

Table Talk

What do you think of OCT?

What questions or need for clarification do you have?

If your LEA would like to participate, please contact:

Kimberly.simmons@dpi.nc.gov