11

Teacher performance evaluations consist of two components ... fileSummative evaluation ratings are not comparable from school to school due to evaluator subjectivity and percentage

  • Upload
    others

  • View
    4

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Teacher performance evaluations consist of two components ... fileSummative evaluation ratings are not comparable from school to school due to evaluator subjectivity and percentage

Page 2: Teacher performance evaluations consist of two components ... fileSummative evaluation ratings are not comparable from school to school due to evaluator subjectivity and percentage

The demonstrated teaching skills and impact on K-12 students graphic provided visualizes the performance evaluations of candidates who have completed a program at the institution and are employed in an Illinois public school.

Teacher performance evaluations consist of two components: student growth and professional practice. Student growth means a demonstrable change in a student’s or group of students’ knowledge or skills, as evidenced by gain and/or attainment on two or more assessments, between two or more points in time.

Districts may designate any percentage of the evaluation toward each component. Student growth must comprise at least 30 percent of the evaluation. Districts may also utilize any rubric in evaluations.

Summative evaluation ratings are not comparable from school to school due to evaluator subjectivity and percentage of evaluation utilized for each component.

USF Graduates’ Demonstrated Teaching Skills andImpact on K-12 Students 2017 (N=44)

Page 3: Teacher performance evaluations consist of two components ... fileSummative evaluation ratings are not comparable from school to school due to evaluator subjectivity and percentage

Demographics of the three schools included

SCHOOLEducation Graduate School Demographics

Grad Year PEL Type Race/Ethnicity Low- Income LEP Mobility

A.O. Marshall Joliet

2017 Elementary

W: 3.5%B: 12.8%H: 68.1%

99.8% 58.9% 8.5%2017Elementary+ Bilingual

2016Elementary+ Bilingual

Jones Elementary Minooka

2015 Elementary W: 59%B: 8%H: 27%

30.0% 5.0% 6.0%2015 Elementary

Reed- Custer H.S.Braidwood

2013 Math W:91%B: 0%H: 6%

36.0% 1.0% 8.0%2013 Visual Art

Employer Satisfaction Interviews: 2017-19 Cycle In order to assess employers’ satisfaction with our graduates, the College of Education (COE) conducts bi-annual employer interviews. The interview method is a good fit with our institution due to our size (relatively small number of graduates) and the fact that most of our graduates are employed within a 20-mile radius. The interview method with its mix of qualitative and quantitative data provides deeper and more comprehensive view of employers’ satisfaction with our graduates when compare to surveys.

The construction of interview protocol included developing questions that are aligned with the InTASCStandards and that assess our candidates’ impact on PK-12 student learning. The personal face-to-face interviews allow us to probe beyond just basic agreement or disagreement and determine specific areas of strength or areas for improvement. In addition, interviews provide an opportunity for triangulation and increased validity as areas of agreement or divergence among employers and other measures can be observed.

For the interviews, a purposive sample was used to collect a representative sample across all COE programs over the next five years. In order to select this cycle’s sample, the COE reviewed reports indicating where candidates who graduated within the past five years were employed. Schools and principals with more than one graduate employed were considered. Three schools were selected with graduates from the elementary (5), secondary math (1), and visual arts (1) programs.

The COE’s field experience coordinator contacted the principals to explain the process and request their cooperation in completing an anonymous survey and meeting for an in person interview. All three principals agreed. Prior to the face-to-face interview, the survey was sent out via Survey Monkey. The survey asked the principals to, “Please respond to the statements regarding teachers at your school who completed an education degree at the University of St. Francis since 2013”. Then they were asked to indicate their level of agreement (Strongly Agree to Strongly Disagree) regarding several statements (see table below). After the principals completed the survey, the field experience coordinator arranged a meeting at each of the schools to conduct the interviews. At the interview, principals were asked to describe the performance of the recent graduates in the following categories: 1) The Learner and Learning, 2) Content Knowledge, 3) Instructional Practice, and 4) Professional Responsibility. The field experience coordinator asked follow-up questions for clarification and to gather more robust evidence of their respective performances. The interviews were recorded and notes were taken by the field experience coordinator.

VIEW SURVEY RESULTS

Page 4: Teacher performance evaluations consist of two components ... fileSummative evaluation ratings are not comparable from school to school due to evaluator subjectivity and percentage

Demographics of the three schools includedFollowing the interview, the field experience coordinator reviewed the notes and examined relevant themes. The themes that emerged aligned with the INTASC standards and categories: Learner and Learning, Content Knowledge, Instructional Practice, and Professional Responsibility.

Principals reported the following strengths: • Strong ability to make connections and build

relationships with students • Innovative classroom practices for effective

instruction and student learning • Demonstrated leadership with colleagues • Engagement in school and local community

beyond the classroom

Principals reported the following opportunities for improvement: A potential area for improvement was noted as one principal reported that one alumni was not receptive to constructive feedback and did not effectively build relationships with students. While this was not echoed in the feedback related to any of the other alumni teaching in the three schools, it points to an opportunity to review the COE quality assurance system as the weaknesses did not emerge when the teacher was a candidate in the program.

Survey Statement (n = 7 graduates, 3 principals)Strongly Agree

or AgreeStrongly Disagree

or Disagree

The teacher understands how learners grow and develop and designs and implements developmentally appropriate and challenging learning experiences.

100% 0%

The teacher has a demonstrable (evidence-based) positive impact on student learning and development. 100% 0%

The teacher uses understandings of individual differences and diverse cultures to enable each learner to meet high standards.

100% 0%

The teacher works with others to create environments that encourage positive social interaction, active engagement in learning, and self-motivation.

100% 0%

The teacher creates learning experiences that make the discipline accessible and meaningful for learners to assure mastery of the content.

100% 0%

The teacher understands how to connect concepts and use differing perspectives to engage learners in critical thinking, creativity, and collaborative problem solving.

100% 0%

The teacher understands and uses multiple methods of assessment to engage learners in their own growth, to monitor learner progress, and guide the teacher’s and learners’ decision making.

100% 0%

The teacher understands and uses a variety of instructional strategies to encourage learners to develop dep understanding of content areas and their connections, and to build skills to apply knowledge in meaningful ways.

100% 0%

The teacher engages in ongoing professional learning and uses evidence to continually evaluate his/her practice. 100% 0%

The teacher seeks appropriate leadership roles and opportunities to take responsibility for student learning, to collaborate with learners, families, colleagues and other school professionals, and community members to ensure learner growth, and to advance the profession.

100% 0%

Page 5: Teacher performance evaluations consist of two components ... fileSummative evaluation ratings are not comparable from school to school due to evaluator subjectivity and percentage

Exit Survey Results from Program Completers, Fall 2016-Summer 2018

*If the 2016-2017 completers were fewer than 5, results were combined with 2015-2016

ELEMENTARY EDUCATION SPECIAL EDUCATION VISUAL ARTS & SECONDARY EDUCATION

2016-2017N=14

2017-2018N=15

2016-2017N=8

2017-2018N=2

*2015-2017N=7

2017-2018N=5

How well did USF prepare you? Well to Excellently

100% 100% 62.5% 100% 100% 100%

College of Education Instructors: Agree to Strongly Agree

Demonstrated thorough knowledge of content

100% 100% 100% 100% 100% 100%

Held high expectations for students in class

100% 100% 100% 100% 85.7% 80%

Modeled professional dispositions and USF values

100% 100% 100% 100% 100% 80%

Encouraged the class to become a community of learners

100% 100% 100% 100% 100% 80%

Page 6: Teacher performance evaluations consist of two components ... fileSummative evaluation ratings are not comparable from school to school due to evaluator subjectivity and percentage

Exit Survey Results from Program Completers, Fall 2016-Summer 2018

*If the 2016-2017 completers were fewer than 5, results were combined with 2015-2016

SPECIAL EDUCATION READING SPECIALIST TEACHER LEADER PRINCIPAL PREPARATION SUPERINTENDENT

*2015-2017N=10

2017-2018N=16

2016-2017N=14

2017-2018N=8

*2015-2017N=11

2017-2018N=3

2016-2017N=9

2017-2018N=3

*2015-2017N=20

2017-2018N=10

How well did USF prepare you? Well to Excellently

92.8% 100% 100% 100% 100% 100% 100% 100%

College of Education Instructors: Agree to Strongly Agree

Demonstrated thorough knowledge of content

100% 100% 100% 100% 100% 100% 100% 100% 100% 100%

Held high expectations for students in class

100% 100% 100% 100% 85.7% 80% 100% 100% 100% 100%

Modeled professional dispositions and USF values

92.8% 100% 92.8% 100% 100% 80% 100% 100% 100% 100%

Encouraged the class to become a community of learners

92.8% 100% 92.8% 100% 100% 80% 100% 100% 100% 100%

Page 7: Teacher performance evaluations consist of two components ... fileSummative evaluation ratings are not comparable from school to school due to evaluator subjectivity and percentage

Graduation rates based on expected completion of 2018-2019 cohorts National undergraduate graduation rate = 55%; Illinois rate = 62%. National doctoral rate = 57%.

Education ProgramPercent Completing within

Expected Time

Initial Teacher Education Programs (Undergraduate)

Elementary Education 91%

Music, Visual Arts, & Secondary Education

- Graduated with content area major degree 100%

- Graduated with teaching license 50%

Special Education 91%

Initial Teacher Education Programs (Graduate)

All Programs Combined (n < 10) 83%

Subsequent Endorsement

Special Education 92%

Advanced Programs

Educational Leadership: Principal/Teacher Leader (M.S.) 95%

Reading (M.S.) 80%

Teaching & Learning (M.S.) 93%

Educational Leadership: Superintendent (Ed.D.) 82%

Page 8: Teacher performance evaluations consist of two components ... fileSummative evaluation ratings are not comparable from school to school due to evaluator subjectivity and percentage

Pass Rates of Completers by Program, Fall 2016-Summer 2018

Illinois State Board of Education Program TestsCompleters

N 2016-2017Completers

N 2017-2018Pass Rate

2016-2018

Elementary - Test 1 18 15 100%

Elementary - Test 2 18 15 100%

Elementary - Test 3 18 15 100%

Elementary - Test 4 18 15 100%

Special Education - LBSI 9 <5 100%

Special Education - General Curriculum 9 <5 100%

Art and Secondary <5 <5 100%

LBSI - Subsequent Endorsement 8 24 100%

LBSI - General Curriculum 8 24 100%

Reading Specialist 20 18 100%

Superintendent 20 23 100%

Principal Preparation - Test 1 27 39 100%

Principal Preparation - Test 2 27 39 100%

Additional State Requirement for Initial LicensureCompleters

N 2016-2017Completers

N 2017-2018Pass Rate

2016-2018

edTPA 29 21

Program CompletedCandidates Entitled N

2016-2017Candidates Entitled N

2017-2018

Elementary 18 15

Special Education 9 2

Biology 1 1

History 1 0

Visual Arts 0 1

Mathematics 0 2

English Language Arts 0 0

Principal 27 39

Reading Specialist 20 18

Superintendent 20 23

Subsequent LBSI 8 24

Teacher Leader 8 12

Title II Completers/Entitled for Licensure Candidates, Fall 2017-Summer 2018

Page 9: Teacher performance evaluations consist of two components ... fileSummative evaluation ratings are not comparable from school to school due to evaluator subjectivity and percentage

2017-18 CohortElementary

Education (14)Special Education (2)

Visual Arts &

Secondary Education (5)TOTAL (21)

Employed Full-time

in Education100% 100% 100% 100%

Not teaching 0% 0% 0% 0%

2016-17 Cohort Elementary Education (18) Special Education (9) Secondary Education (2) TOTAL (29)

Employed Full-time

in Education89% 100% 100% 93%

Chose not to pursue

licensure6% 0% 0% 3%

Not teaching 6% 0% 0% 3%

Employment Rates: Initial ProgramsThe table below indicates the employment status of graduates for the academic year immediately following their graduation.

Page 10: Teacher performance evaluations consist of two components ... fileSummative evaluation ratings are not comparable from school to school due to evaluator subjectivity and percentage
Page 11: Teacher performance evaluations consist of two components ... fileSummative evaluation ratings are not comparable from school to school due to evaluator subjectivity and percentage