Nevada Commission on Professional Standards
ETS Educator Series:
CKT, SLA, and Recent Program Changes Educational Testing Service
Terry Owens, Ph.D. , Client Relations Director December 5, 2016
About ETS
ETS’s Mission is to advance quality and equity in education worldwide
ETS is a not for profit organization
ETS Values are social responsibility, equity, opportunity, and quality
Our assessments are valid and reliable
Fair, accurate, and meaningful products and services – from research to delivery
2 Copyright © 2016 by Educational Testing Service. All rights reserved. ETS and the ETS logo are registered trademarks of Educational Testing Service (ETS). MEASURING THE POWER OF LEARNING is a trademark of ETS. 33537
ETS Educator Series
3
Copyright © 2016 by Educational Testing Service. All rights reserved. ETS and the ETS logo are registered trademarks of Educational Testing Service (ETS). MEASURING THE POWER OF LEARNING is a trademark of ETS. 33537
Praxis Core
ProEthica
ParaPro Assessment
Praxis Professional Assessments
Other Praxis Assessments
School Psychologist Speech-Lang Pathology Audiology
Braille, ASLPI, ESOL
Pedagogy Praxis PLT
Performance NOTE, PPAT
Praxis Content Assessments
Over 90 titles
School Leadership
Series SSA, SLLA
Praxis Updates
New Policy on Calculator Use • Test taker-supplied calculators are not permitted
• Tutorials available to practice
• On-screen calculator can be displayed with questions and moved around
• Includes math subtests in the Elementary Education series, middle school and secondary math, Algebra, and Praxis Core Math
• Scientific, Graphing, and Four-Function available, depending on the test
5
New Ways to Cheat = New Security Measures
• Increased availability and use of spy devices
• Devices being hidden inside glasses, ties, large jewelry, hats, analog watches, and Bluetooth devices concealed under test takers’ hair, scarves, or other headwear
• Extending visual inspection for electronic devices to items such as jewelry, hair accessories and eye glasses, effective as of October 15, 2016
30
• Allowed but inspected: ― Eyeglasses, small earrings, wedding/engagement
rings, small hair accessories (clips, barrettes, head bands, combs), neck ties
• Inspected/stored if brought to the test center: ― Large jewelry (earrings, pendant, bracelets,
necklaces), large hair accessories
• Added to Admission ticket and Website
For more information on test day policies, visit: https://www.ets.org/praxis/test_day/bring
https://www.ets.org/praxis/test_day/procedures https://www.ets.org/praxis/test_day/policies/dismissals
31
“Spy Devices” at Testing Centers
8
New Test – Algebra I (5162)
9
• Developed in response to state requests for another math test
• Multistate Standard Setting Study completed October, 2016
• 13 states were represented by 18 panelists
• Recommended passing score is 157
• Now available
Regeneration – Computer Science (5652)
10
• Computer 5651 first launched June, 2015
• Updating content
• National Advisory Committees (NAC) November 2016 and March 2017
• Better alignment with International Society for Technology in Education (ISTE) and Computer Science Teachers Association (CSTA) standards for computer science educators
• Administration launch in September, 2018
Regeneration – Science
11
Code Test Name NAC Standard Setting
Admin. Date
7806 Elementary Education: Science – CKT
N/A May, 2017 Sept., 2017
5442 Middle School Science January & June, 2017
May, 2018 Sept., 2018
(Various) Secondary Sciences January & June, 2018
May, 2019
Sept., 2019
• Regeneration for alignment with Next Generation Science Standards (NGSS)
EPP Diversity Research
12
• Ongoing multi-level research exploring solutions to diversify the teacher candidate pipeline – EPP survey: attract, admit, and support successful
candidates from diverse backgrounds – Literature review: examine approaches – Interview EPP leaders, staff, and students on promising
programs, strategies, supports – Praxis data analyzed to explore test-taking patterns
• Partner with states and EPPs to disseminate information on promising practices
Content Knowledge for Teaching (CKT)
A new kind of performance assessment:
NOTE
National Observational Teaching Exam
Simulation-based performance assessments designed to test
high-leverage practices (HLPs) of teaching
A new kind of content assessment:
Content Knowledge for Teaching
assessments
Designed to test CKT, the specialized knowledge of content that a teacher
uses in the work of teaching
ETS is collaborating with TeachingWorks at the University of Michigan
to create two kinds of assessment that test teachers on the work of
teaching
14
Content Knowledge for Teaching
• Our newest Elementary Education test
• Developed in collaboration with TeachingWorks, University of Michigan
• Multiple Subjects model with CKT added
• Two versions: MC only, or MC/CR
• CKT questions test knowledge of content applied to a task of teaching
• ELA & Math sections in 2016; Science 2017
16
PRAXIS 5001
Elementary Education: Multiple Subjects
READING & LANGUAGE ARTS
MATHEMATICS
SOCIAL STUDIES
SCIENCE
Subtests with separate scaled scores. Allows a separate passing standard for each subject.
Introduced 2016-17
Elementary Education:
CKT READING & LANGUAGE ARTS
MATHEMATICS
SOCIAL STUDIES
SCIENCE
Assessment of specialized knowledge for teaching in Mathematics and ELA.
PRAXIS 5018
Elementary Education: Content Knowledge
READING & LANGUAGE ARTS MATHEMATICS SOCIAL STUDIES SCIENCE
Evolution of CKT Next step in elementary licensure tests; improving assessment
of critical content knowledge
New for 2016-17: Content Knowledge for Teaching Code Test Name First Admin.
Date 7801 Elementary Education: Content October, 2016
Knowledge for Teaching (MC Only) 7802 Reading and Language Arts CKT Subtest 7803 Mathematics CKT Subtest
7901 Elementary Education: Applied Content October, 2016 Knowledge for Teaching (MC/CR)
7902 Reading and Language Arts CKT Subtest 7903 Mathematics CKT Subtest
17
18
7801 7901 Praxis Praxis Elementary Education: Elementary Education: Content Knowledge for Teaching Applied Content Knowledge for Teaching
Task Format
Selected Response Selected Response Numeric Entry (for Mathematics) Numeric Entry (for Mathematics)
Short Constructed Response
Price
Combined $199 Combined $210 ―Reading & Language Arts-CKT $74 ―Reading & Language Arts-Applied CKT $79 ―Mathematics-CKT $74 ―Mathematics-Applied CKT $79 ―Science $60 ―Science $60 ―Social Studies $60 ―Social Studies $60
Timing
Combined 4:35 (appt. time: 5:30) ―Reading & Language Arts-CKT 90 mins ―Mathematics-CKT 85 mins ―Science 50 mins ―Social Studies 50 mins
Elementary Education: Instructional Practice and Applications (5019)
• Current Nevada assessment
• Contains constructed response items
• Reading/Language Arts; Math; Social Studies; Science; Art; Music; and Physical Education
• Includes Applications (short content essays)
• Sub-topics for each subject area: ― Curriculum ― Instruction ― Assessment
Elementary Ed: Content Knowledge for Teaching (7801)
• Reading/Language Arts; Math, Social Studies; Science • Focus is on recognizing, understanding and responding to
content problems teachers encounter as they teach • CKT assesses knowledge needed to teach the subjects, rather
than subject matter knowledge alone • Demonstrate ability to do the work of the student curriculum • Apply knowledge to the work of teaching specific content topics • Content assessed by:
― Selecting a representation to explain specific content; ― Modifying a student task to support a specific content learning goal; ― Recognizing common patterns of student thinking including common
misconceptions; and ― Carrying out another piece of content-specific teaching work that
represents a component part of engaging in a high-leverage teaching practice
Elementary Ed: Instructional Elementary Ed: CKT (7801) Practice and Application (5019) Elementary Ed: Applied CKT (7901)
Number of 5019: 120 SR; 4 CR 7801: 220 SR and numeric entry questions 7901:208 SR and numeric entry; 4 CR Time 2 hours and 50 minutes 4 hrs., 35 min. (4 separately timed subjects) Content I. Reading and Language Arts I. Reading & Language Arts (CKT) Categories II. Mathematics a) Foundational Literacy Skills
b) Language III. Science c) Constructing Meaning IV. Social Studies II. Mathematics (CKT) V. Art, Music, & Physical Education a) Counting and Operations with Whole Numbers VI. Applications (short content b) Place Value and Decimals
c) Fractions, Operations with Fractions, and Ratios essays) d) Early Equations and Expressions, Measurement and Geometry All: III. Science
a) Earth Science a) Curriculum b) Life Science
b) Instruction c) Physical Science c) Assessment IV. Social Studies
a) U.S History, Government and Citizenship b) Geography, Anthropology and Sociology c) World History and Economics
Types of Selected-response and constructed- SR and numeric entry; CR (7901 only). On-screen four-questions response function calculator provided. Scoring SR questions are computer scored. SR and numeric-entry questions are computer scored. CR
CR questions are scored by trained questions are scored by trained raters (two independent raters (two independent raters per raters per response). response). 21
22
Assessing CKT: Tasks of Teaching
For ELA, tasks include: • Analyzing a student writing
sample to identify strengths or weaknesses
• Evaluating instructional texts for their support of a specific learning goal
• Identifying a prompt that will elicit student thinking about a particular ELA concept
For mathematics, tasks include: • Analyzing the mathematical
validity and generalizability of a student’s mathematical explanation
• Evaluating mathematical manipulatives for their support of a specific instructional purpose
• Anticipating how a student error will replicate across similar problems
Some questions call for the candidate to show the ability to do the work of the student curriculum.
23
In the formula x = 10y , if y is positive and the value of y is multiplied by 2, then the value of x is
divided by 10 multiplied by 10 halved doubled
Mr. Keller’s sixth-grade class is learning about algebraic equations. In his teachers’ edition of the textbook, Mr. Keller finds a page that suggests he ask students to critique the following two solutions to determine if they are valid.
Which of the following is most clearly highlighted by asking students to critique the invalid strategies? Understanding the meaning of the equal sign Understanding the importance of combining like terms Understanding the use of properties of operations to
simplify expressions Understanding the use of inverse operations to solve
equations .
Topic: early algebraic equations
CKT specialized content knowledge common content knowledge
Assessing CKT a comparison with traditional content assessment
= = = =
12 12 12 ÷ 6 2
4x + 2 6x x x
= = = =
2x + 3 5x x 1
5 5
5 ÷ 5 x
NOTE Practices for Teaching Content
Modeling and Explaining Content
Leading Group Discussion
Eliciting Student Thinking
Designed to assess HLPs for teaching content:
and virtual smartboard
A simulation-based performance assessment using
a simulated classroom
Grade level: Third grade Content area: Mathematics Task: Model the traditional addition algorithm and use base ten blocks to show how to solve 273 + 152.
… Model how to solve the problem using the traditional addition algorithm. … Show how the addition algorithm connects to the problem using base ten blocks to illustrate the meaning of each step. … Explain the process as you would for a group of third graders. Be sure to
narrate your thinking and make your decision-making explicit to ensure that your students could use the process for solving a multidigit addition problem that requires regrouping.
Materials: Virtual whiteboard with base ten block models. Performance time: 10 minutes
“
Modeling and Explaining Content Leading Group Discussion Eliciting Student Thinking
Practices for Teaching Content Elementary Education
Aspects of modeling and explaining content – Thinking aloud and demonstrating – Narrating the work to make strategies
and processes explicit
“
Modeling and Explaining Content Leading Group Discussion Eliciting Student Thinking
Practices for Teaching Content Elementary Education
Grade level: First Grade Content area: English Language Arts Task: The candidate will facilitate a small group discussion aimed at helping
students develop their ability to make and support inferences. ─ elicit thinking from all students by asking targeted questions about the main
character in the book – what he is like as a person ─ coordinate students’ ideas and steer the discussion toward the learning goal ─ represent the content accurately, either verbally or visually as you would do
with typical first graders ─ conclude the discussion by summarizing the key ideas covered during the
discussion Materials: Pet Show! by Ezra Jack Keats Performance time: 15 minutes.
Aspects of leading group discussion – Launching the discussion – Supporting students in doing the work of the
discussion – Coordinating student contributions and moving
the discussion in a productive discussion – Bringing the discussion to a productive close
Grade level: Fifth grade Content area: English Language Arts Scenario: A student has read the story “Frog Aisle” independently and has been asked to
think about what the two characters Sam and Violet think of each other. Task: Elicit the student’s ideas about what the characters think of each other, the student’s
reasons for those ideas, and how the student arrived at them. In order to do this. • Ask questions about both characters and what they think of each other. • Elicit how and why the student arrived at his or her ideas. • Ask for specific language and aspects of the text that the student used to make
meaning. • Probe for breakdowns in the student’s understanding.
Materials: The text “Frog Aisle” on a workspace shared with the student Performance time: 10 minutes Post-performance questions (focus on interpreting): 10 minutes
“
Modeling and Explaining Content Leading Group Discussion Eliciting Student Thinking
Practices for Teaching Content Elementary Education
Aspects of eliciting student thinking – Posing questions and tasks that provoke or
allow students to share their thinking – Considering and checking alternative
interpretations of the student’s ideas – Analyzing and interpreting student responses
School Leadership Series
Regeneration – School Leadership Series
29
Code Test Name NAC Standard Setting
Admin. Date
6990 6011
School Leaders Licensure Assessment
October, 2016 & Feb. 2017
January, 2018 Sept., 2018
5412 5411
Education Leadership and Supervision
October, 2016 & Feb. 2017
January, 2018 Sept,. 2018
6991 6021
School Superintendent Assessment
TBA TBA Sept., 2019
• Regeneration to align with CCSSO Professional Standards for Education Leaders (PSEL)
• Replaces ISLLC standards
• Second NAC will be held February 10-12, 2017
30
Cost: $120
31 Cost: $425
32
Cost: $350
For further information/questions: Terry Owens