Embed Size (px)
Citation preview
Program Evaluation Data
Department of EducationSUNY Cortland
Points of ViewPoints of View
NYSTCELAST & ATS-WState Dept of Ed
View
Student TeacherRating Scale
Field SupervisorView
Grad SurveyStudent View
Education DepartmentPerformance
New York State Teacher Certification ExaminationsNew York State Teacher
Certification ExaminationsAssessment of Teaching Skills (ATS)
Elementary Version Required for provisional certificate Taken upon completion of pedagogical coursework
and field experiencesLiberal Arts and Sciences Test (LAST)
80 Multiple Choice Questions and an essay questionTaken sophomore or junior yearRequired for provisional certification
NYSTCE . . .
14126 NYSTCE Records14126 NYSTCE Records
Initial examination includes only Overall Scores (n = 2592)
In the Spring we plan to examine subtest scores
2592
11534
Overall Subtests
NYSTCE . . .
2592 Overall Records2592 Overall Records
Many test records were duplicated
Identical dates, tests, scores
Non-identical matriculation status
Non-identical degree type (i.e. BS or BA)
13871205
Original Copies
NYSTCE . . .
1387 Overall Test Scores1387 Overall Test Scores
The LAST & ATS constituted 91% of the scores (1259 records)
The current analysis focuses on LAST & ATS results
25103
688571
LAST ATS content CTSCTS
NYSTCE . . .
Tests taken more than once
Tests taken more than onceAn additional 63 cases were removed from
analysis because they were retakenTest retakes occurred when students failed the
first administrationIf students failed the retake, their most recent
attempt was kept for analysis (previous administrations were removed)
Many of the students in the 2001 administrations have not had the opportunity to retake the test, therefore their scores are lower
Number of Tests TakenNumber of Tests Taken
Less than 100 test scores were reported in 1998
The number of test records have increased substantially each year
2001 administration includes non-graduates (sophomores, juniors & seniors)
NYSTCE . . .
The Pass Rate: GraduatesThe Pass Rate: GraduatesNYSTCE . . .
Decline in 2001 attributable to lack of opportunity for students who failed to retake the exam
Mean Scores: GraduatesMean Scores: GraduatesNYSTCE . . .
Scores show a slight decline since 1998
The cut score for passing = 220
The highest possible score = 300
Field Supervisor RatingsField Supervisor RatingsField supervisors rate candidates’ performance
at the end of student teachingEvaluation rating scales aggregated for the past
three years (1999-2001)Rating scale was modified after the 2000
administration
Student Teaching Evaluations
Rating Scale ModificationsRating Scale Modifications
19 old items were deleted and 18 new items were added
19 items only partially overlapped43 items with nearly complete overlapOnly the 43 overlapping items were compared
across years
Student Teaching Evaluations
Overall EvaluationsOverall Evaluations
43 itemsLarge dip in
the spring 2000 ratings
Student Teaching Evaluations
Content KnowledgeContent Knowledge
5 items
Student Teaching Evaluations
Implementing & Facilitating
Implementing & Facilitating
10 items
Student Teaching Evaluations
Communicating & Questioning
Communicating & Questioning
8 items
Student Teaching Evaluations
DispositionsDispositions
14 items
0
0.2
0.4
0.6
0.8
1
1999 2000 2001
Outstanding
Very Good
Satisfactory
NeedsImprovement
Student Teaching Evaluations
Graduate SurveyGraduate Survey
Aggregated student opinion surveys 1998-2000Survey format changed somewhat, but questions
comparable
Grad Survey . . .
Faculty AdvisementFaculty AdvisementGrad Survey . . .
Faculty SupportFaculty SupportGrad Survey . . .
Quality of TeachingQuality of TeachingGrad Survey . . .
Quality of CoursesQuality of CoursesGrad Survey . . .
Student TeachingStudent TeachingGrad Survey . . .
Academic PreparationAcademic PreparationGrad Survey . . .
