Update on Program Review

Margie CrutchfieldAACTEFebruary, 2009

Timeliness Rates Approval Rates SASB Task Force on SPA Standards Policy Changes What’s Coming Up Possible future options for program

review (current process will not change!)

Timeliness Rates

Program reports are now returned to the institutions on time

Fall 07 95% returned on time N = 660

Spring 08 95% returned on time N = 939

Fall 08 98% returned on time N = 1068

Approval Rates, Initial Submissions

Fall 07, Initial Spring 08, InitialTotal R + C % Total R + C %

494 314 63.5 513 301 58.6

R = Nationally Recognized, C = Nationally Recognized with Conditions

Fall 08, Initial

Total R + C %

660 403 61.1

Approval Rates, Rev/RC reports

Fall 08, Rev/RCTotal R + C %

408 349 85.5

Rev = Revised Reports, RC = Response to Conditions ReportsR = Nationally Recognized, C = Nationally Recognized with Conditions

Fall 07, Rev/RC Spring 08, Rev/RC

Total R + C % Total R + C %

166 143 86.1 426 348 81.8

Approval Rates, Initial Reports

SPA Fall 07 Spring 08 No. of

initial reports

No. R No. C % R+C No of initial reports

No. R No. C % R+C

AAHE 9 5

55.6%

4

44.4%

9

100%

9 2

22.2%

2

22.2%

4

44.4%

ACEI 30 14 46.7%

6

20%

20

66.7%

37 20

54%

9

24.3%

29

78.3%

ACTFL 23 3

13%

26%

19

39%

37 1

2.7%

12

32.4%

13

35.1%

AECT 3 3

100%

3

100%

2 1

50%

1

50%

ALA 7 2

28.6%

4

57.1%

6

85.7%

2 1

50%

1

50%

2

100%

CEC 53 16

30.2%

29

57.1%

45

87.3%

81 10

12.4%

52

64.2%

62

76.6%

Initial (cont.)

SPA Fall 07 Spring 08 No. of

initial reports

No. R No. C % R+C No of initial reports

No. R No. C % R+C

ELCC 37 7

19%

9

24.3%

16

42.3%

42 3

7.1%

9

21.4%

12

28.5%

IRA 15 3

20%

12

80%

15

100%

18 5

27.8%

10

55.6%

15

83.4%

ISTE 1 1

100%

1

100%

7 4

57.1%

1

14.3%

5

71.4%

ITEA 4 2

50%

2

50%

4

100%

2 2

100%

2

100%

NAEYC 34 12

35.3%

16

47%

28

82.3%

41 15

36.6%

10

24.4%

25

61%

NAGC/

CEC

2 2

100%

2

100%

NASP 38 20

52.6%

15

39.5%

35

92.1%

14 6

42.9%

1

7.1%

7

50%

NASPE 27 2

7.4%

8

29.6%

10

37%

19 1

5.3%

8

42.1%

9

47.4%

Initial (cont.)

SPA Fall 07 Spring 08

No. of initial reports

No. R No. C % R+C No of initial reports

No. R No. C % R+C

NCSS 44 5

11.4%

12

27.3%

17

38.7%

44 7

15.9%

13

29.6%

20

45.5%

NCTE 44 7

16%

8

18.2%

15

34.2%

42 11

26.2%

10

23.8%

21

50%

NCTM 48 13

27%

23

48%

36

75%

48 7

14.6%

17

35.4%

24

50%

NMSA 14 6

43%

4

28.6%

10

71.6%

15 8

53.3%

5

33.3%

13

86.6%

NSTA 53 14

26.4%

14

26.4%

28

52.8%

43 8

18.6%

19

44.2%

17

62.8

TESOL 10 3

30%

4

40%

7

70%

8 2

25%

6

75%

8

100%

Approval Rates, Rev. and Cond.

SPA Fall 07 Spring 08 No. of

initial reports

No. R No. C % R+C No of initial reports

No. R No. C % R+C

AAHE 2 1

50%

1

50%

10 6

60%

3

30%

9

90%

ACEI 8 7

87.5%

7

87.5%

22 19

86.4%

3

13.6%

21

99%

ACTFL 14 9

64.3%

3

21.4%

12

85.7%

28 3

10.8%

13

46.4%

16

57.2%

AECT 2 2

100%

2

100%

ALA 3 1

33.3%

1

33.3%

2

66.6%

CEC 25 10

40%

15

60%

25

100%

39 15

38.5%

20

51.3%

35

89.8%

SPA Fall 07 Spring 08

No. of initial reports

No. R No. C % R+C No of initial reports

No. R No. C % R+C

ELCC 6 3

50%

3

50%

6

100%

39 12

30.8%

14

35.9%

26

66.7%

IRA 11 6

54.6%

4

36.4%

10

91%

18 7

38.9%

11

61.2%

18

100%

ISTE 1 1

100%

1

100%

2 2

100%

2

100%

ITEA

NAEYC 13 6

46.1%

5

38.46%

11

84.6%

28 11

39.3%

17

60.7%

28

100%

NAGC/

CEC

1 1

100%

1

100%

NASP 4 4

100%

4

100%

NASPE 17 7

41.2%

4

23.5%

11

64.7%

28 6

21.4%

16

57.1%

22

78.5%

SPA Fall 07 Spring 08

No. of initial reports

No. R No. C % R+C No of initial reports

No. R No. C % R+C

NCSS 18 10

55.6%

6

33.3%

16

88.9%

45 21

46.7%

21

46.7%

42

93.4%

NCTE 18 7

38.9%

8

44.4%

15

83.3%

51 12

23.5%

22

43.2%

34

66.7%

NCTM 17 8

47.1%

9

52.9%

17

100%

52 25

48.1%

22

42.3%

47

90.4%

NMSA 1 1

100%

1

100%

5 5

100%

5

100%

NSTA 12 4

33.3%

3

25%

7

58.3%

43 19

44.2%

11

25.6%

30

69.8%

TESOL 1 1

100%

1

100%

8 2

25%

3

37.5%

5

62.5%

Task Force to look at SPA standards

SPA standards are very diverse In number, organization, specificity In coverage of content and pedagogy

Task Force has developed a set of 4 guiding/organizing principles

For a complete discussion, attend session The Next Generation of NCATE Program

Standards, Saturday, 12:15 – 1:30, Regency D

Task Force Charge

The existing SASB guidelines for SPA standards need to be rethought in light of current research, national experience, and constructive feedback. As a result the SASB chair will appoint an inclusive task force to create a conceptual framework with comprehensive guidelines for the development of SPA program standards.

Four principles; aligned with NCATE Unit Standard 1

Unit standard 1: Content knowledge

Principle 1: Content knowledge

Unit standard 1: Pedagogical content knowledge and skills

Principle 2: Content pedagogyPrinciple 3: Learning environments

Unit standard 1: Professional and pedagogical knowledge and skills

Principle 4: Professional knowledge and skills

Principles 1: Content Knowledge

1. SPA standards address: Candidates’ knowledge of content they plan to teach or use as school professionals, and their ability to explain important principles and concepts delineated in professional standards.

Principle 2: Content Pedagogy

2. SPA standards address: Candidates knowledge of content pedagogy (effective teaching strategies to impart the specialized knowledge of a subject area) or of a professional practice (such as planning, instruction, analysis, and evaluation), including:

Knowledge of how students develop and learn, Students’ diversity and differing approaches to learning, Cultural influences on learning, Students’ preconceptions that must be engaged for

effective learning, and Familiarity with standards-based instruction,

assessment, and learning.

Principle 3: Learning Environments

3. SPA standards address: Candidates’ ability to apply their knowledge appropriately in their education role by creating and maintaining safe, supportive, fair, and effective learning environments for all students—among them linguistically and culturally diverse students and those with exceptionalities—including:

individual and group motivation for a disciplined learning environment and engagement in learning,

Assessment and analysis of student learning, making appropriate adjustments in instruction, and monitoring student progress to assure meaningful learning experiences for all students, and

Use of a variety of instructional strategies, materials, and applications of technology to encourage students’ development of critical thinking, problem solving, and performance skills.

Principle 4: Professional Knowledge and Skills

4. SPA standards address: Candidates’ knowledge of professional practices in their field and readiness to develop them, including:

engagement in professional experiences, and reflection on them, to enhance their own professional growth;

understanding and ability to demonstrate a commitment to equitable and ethical treatment of all students and colleagues; knowledge of the collaborative roles of other school professionals and readiness to work with colleagues, families, and community agencies; and

ability to identify opportunities for collaborative and leadership roles as members of teams.

In addition….

the principles will serve as an organizer or framework for standards (as they do for NBPTS)

Will be limited in number Can have only one level of elements

below standard Will be focused on what is MOST

critical for each SPA’s specialty.

Current Streamlining Changes

Middle level programs Change in policy for review of true middle

level programs Must meet criteria for middle level programs Programs submit one report to NMSA 80% of candidates must pass state test in

content areas Secondary program must reach national

recognition If not secondary program, state must review

content preparation program

Programs in secondary content areas that do not provide content preparation

This year NCATE will develop option for these programs

During this year, these programs can defer review until NCATE develops process and they have time to implement

Programs will not address SPA standards, they will address a generic set of standards (Task Force principles?) Will submit one report Will be expected to have assessments

demonstrating candidate competence

Streamline current program report

Possible options Section I: Question 1 to be answered if

needed; delete questions 3, 4, and 5; delete faculty information; other deletions are under consideration.

Section II: Flexibility to consolidate some assessments.

Section IV: Condense and clarify instructions

Section V: Move to unit review?

Decrease required amount of data 1 to 2 years?

Investigate strategies for reviewing programs with extremely low enrollments

Potential Options for Program Review

Current process will still remain an option!!!!!!

Options for Initial Review Allow institutions to choose all of their

own assessments (with some constraints) No more than 8 Must submit state test data Must demonstrate content, pedagogical

content knowledge and skills, and impact on student learning

SPAs develop set of pre-approved assessments

Options for continuing review Reduce requirements for “continuing”

national recognition so that only new assessments need to be approved and minimal data provided. Focus on what is now Section V—self study and

continuous improvement

Permit an institution to conduct validity studies of its assessments in lieu of other program report evidence requirements

Resources on NCATE web site

www.ncate.org, click on Institutions, click on Program Reviews Program Report Forms Guidelines, Instructions Examples of Assessments Examples of Reports Archived Web Seminars Mini-videos on how to use PRS