39
Dynamic Learning Maps Alternate Assessment Consortium Neal Kingston Project Director Center for Educational Testing and Evaluation University of Kansas The present publication was developed under grant 84.373X100001 from the U.S. Department of Education, Office of Special Education Programs. The views expressed herein are solely those of the author(s), and no official endorsement by the U.S. Department should be inferred.

Dynamic Learning Maps Alternate Assessment Consortium ... · subitizing . Compare two quantities up to ten using models . Explain set Compare sets Imitate . Compare objects Identify

  • Upload
    others

  • View
    6

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Dynamic Learning Maps Alternate Assessment Consortium ... · subitizing . Compare two quantities up to ten using models . Explain set Compare sets Imitate . Compare objects Identify

Dynamic Learning Maps Alternate Assessment Consortium Neal Kingston Project Director Center for Educational Testing and Evaluation University of Kansas

The present publication was developed under grant 84.373X100001 from the U.S. Department of Education, Office of Special Education Programs. The views expressed herein are solely those of the author(s), and no official endorsement by the U.S. Department should be inferred.

Page 2: Dynamic Learning Maps Alternate Assessment Consortium ... · subitizing . Compare two quantities up to ten using models . Explain set Compare sets Imitate . Compare objects Identify

State Participants

Page 3: Dynamic Learning Maps Alternate Assessment Consortium ... · subitizing . Compare two quantities up to ten using models . Explain set Compare sets Imitate . Compare objects Identify

Let’s start with lessons learned

• When an assessment system is embedded in an accountability system there will be consequences – Many teachers will narrowly teach to the test – Some teachers and administrators will act counter

to their professional responsibilities

Page 4: Dynamic Learning Maps Alternate Assessment Consortium ... · subitizing . Compare two quantities up to ten using models . Explain set Compare sets Imitate . Compare objects Identify

Let’s start with lessons learned

• Teachers need more information about student learning – Timely – Actionable

Page 5: Dynamic Learning Maps Alternate Assessment Consortium ... · subitizing . Compare two quantities up to ten using models . Explain set Compare sets Imitate . Compare objects Identify

How does DLM respond to these lessons?

• Common Core Essential Elements • Instructionally-embedded (and summative)

assessments • Instructionally-relevant tasks • Learning maps • Dynamic assessment • Professional development • Technology platform to tie it all together

Page 6: Dynamic Learning Maps Alternate Assessment Consortium ... · subitizing . Compare two quantities up to ten using models . Explain set Compare sets Imitate . Compare objects Identify

Common Core Essential Elements Are:

• Links to grade level Common Core State Standards (CCSS)

• Statements of content and skills that provide a bridge for students with significant cognitive disabilities to achieve grade differentiated expectations

• Provide challenge and rigor appropriate for students with significant cognitive disabilities in consideration of the significance of their disabilities

Are not:

• Downward extension to pre-K

• General essence statements

• Statements of functional skills

Page 7: Dynamic Learning Maps Alternate Assessment Consortium ... · subitizing . Compare two quantities up to ten using models . Explain set Compare sets Imitate . Compare objects Identify

Identify Essential Elements and Create ALDs: Why • Standardize meaning for users to

understand targets for learning • Provide consistency in expectations across

grades and achievement levels • Emphasize similarities in content learning

and skill achievement even though ways of performing may be highly diversified

• Ground the alternate assessments in clear expectations for learning and achievement

Page 8: Dynamic Learning Maps Alternate Assessment Consortium ... · subitizing . Compare two quantities up to ten using models . Explain set Compare sets Imitate . Compare objects Identify

CCSS

Essential Elements

Instructional Achievement

Level Descriptors

Assessment Achievement

Level Descriptors

EXAMPLES

Examples Are

Essential Too

8

Page 9: Dynamic Learning Maps Alternate Assessment Consortium ... · subitizing . Compare two quantities up to ten using models . Explain set Compare sets Imitate . Compare objects Identify

Geometric measurement: understand concepts of angle and measure angles. 4.MD.5. Recognize angles as geometric shapes that are formed wherever two rays share a common endpoint, and understand concepts of angle measurement: An angle is measured with reference to a circle with its center at the common endpoint of the rays, by considering the fraction of the circular arc between the points where the two rays intersect the circle. An angle that turns through 1/360 of a circle is called a “one-degree angle,” and can be used to measure angles. An angle that turns through n one-degree angles is said to have an angle measure of n degrees.

Geometric measurement: understand concepts of angle and measure angles. 4.MD.5. Recognize angles in geometric shapes

Page 10: Dynamic Learning Maps Alternate Assessment Consortium ... · subitizing . Compare two quantities up to ten using models . Explain set Compare sets Imitate . Compare objects Identify

Grade 4 Mathematics 4MD5. Recognize angles in geometric shapes

Example 1. Label different types of angles in geometric shapes. Ex. Construct geometric shapes using styrofoam and toothpicks. Then determine whether angles are right, obtuse or acute Ex. Given a square, determine whether the angles are right, obtuse or acute.

10

Page 11: Dynamic Learning Maps Alternate Assessment Consortium ... · subitizing . Compare two quantities up to ten using models . Explain set Compare sets Imitate . Compare objects Identify

4MD5. Recognize angles in geometric shapes

Level 2. Recognize angles in geometric shapes. Ex. Teacher draws a geometric shape, student will draw an arc to identify the angles. Ex. Give students pictures of different geometric shapes. Sing a song about shapes and ask students to hold up shapes with right angles (or acute angles...).

Grade 4 Mathematics

11

Page 12: Dynamic Learning Maps Alternate Assessment Consortium ... · subitizing . Compare two quantities up to ten using models . Explain set Compare sets Imitate . Compare objects Identify

4MD5. Recognize angles in geometric shapes

Level 3 example. Identify an angle. Ex. Presented with drawings with angles and circles, point to the shape that doesn’t contain an angle. Ex. On the playground, identify as many angles as they can see or feel.

Grade 4 Mathematics

12

Page 13: Dynamic Learning Maps Alternate Assessment Consortium ... · subitizing . Compare two quantities up to ten using models . Explain set Compare sets Imitate . Compare objects Identify

Recognize angles in geometric shapes

Level 4 example. Attend to angles in the environment. Ex. Use styrofoam and toothpicks to make angles. Ex. Bend a pipe cleaner and identify the bend as the vertex.

Grade 4 Mathematics

13

Page 14: Dynamic Learning Maps Alternate Assessment Consortium ... · subitizing . Compare two quantities up to ten using models . Explain set Compare sets Imitate . Compare objects Identify

Instructionally-embedded (and summative) assessments

• Teachers need feedback on a timely and frequent basis – About student learning – About their teaching

• Students need feedback on a timely and frequent basis – Modeling increasing expectations

• Two important questions – Can results be aggregated for accountability purposes? – How do we do this without assessment diminishing the

time for instruction?

Page 15: Dynamic Learning Maps Alternate Assessment Consortium ... · subitizing . Compare two quantities up to ten using models . Explain set Compare sets Imitate . Compare objects Identify

Instructionally Relevant Tasks

• Modeling good instructional practice – Set of activities related to a unit of study – Student interaction driven by cognitive goals – Structured scaffolding

Page 16: Dynamic Learning Maps Alternate Assessment Consortium ... · subitizing . Compare two quantities up to ten using models . Explain set Compare sets Imitate . Compare objects Identify

Learning Maps &

Learning Progressions

Page 17: Dynamic Learning Maps Alternate Assessment Consortium ... · subitizing . Compare two quantities up to ten using models . Explain set Compare sets Imitate . Compare objects Identify

Progressions

• Vertical progression

toward learning target

• Sequenced building

blocks

• Research-based

• Linked to high-quality

assessments

Presenter
Presentation Notes
Often characterized as a vertical progression within a domain, but differ in scope, breadth and grain size (Heritage, 2008). “…carefully sequenced set of building blocks that students must master on route to a more distant curricular aim” Popham (2007). “descriptions of successively more sophisticated ways of thinking about an idea that follow one another as students learn” (Wilson & Berenthal, 2005). Four Interrelated Guiding Principles (Hess, 2008) Developed (and refined) using available research and evidence Have clear binding threads that articulate the essential core concepts and processes of a discipline Articulate movement toward increased understanding Go hand-in-hand with well-designed and aligned assessments
Page 18: Dynamic Learning Maps Alternate Assessment Consortium ... · subitizing . Compare two quantities up to ten using models . Explain set Compare sets Imitate . Compare objects Identify

Use numbers to decide which is bigger, smaller,

same size

Uses place value to distinguish and order

whole numbers

Uses decimal notation to two places

Uses the symbols =, < and > to order numbers and make comparisons

Uses percentages to make straightforward

comparisons

Masters, G. & Forster, M. (1997). Developmental Assessment. Victoria, AU: The Australian Council for Education Research Ltd.

Page 19: Dynamic Learning Maps Alternate Assessment Consortium ... · subitizing . Compare two quantities up to ten using models . Explain set Compare sets Imitate . Compare objects Identify

What are ?

Network of connected learning targets (nodes)

Maps students’ “knowledge terrain”

Presenter
Presentation Notes
A learning map is a network of connected learning targets (some connections indicate preferred learning sequences) models of landscape learning progressions, which depict many-to-many relationships among concepts and skills (Tatsuoka, 2009) facilitates mapping students’ progress give a clearer view of a student’s knowledge terrain (think Google Earth) support instructionally relevant information for determining the best strategies to help students meet important learning targets
Page 20: Dynamic Learning Maps Alternate Assessment Consortium ... · subitizing . Compare two quantities up to ten using models . Explain set Compare sets Imitate . Compare objects Identify

Create a model of quantity

Recognize wholeness

Identify one

Identify more than one

Use perceptual subitizing

Compare two quantities up to

ten using models

Explain set

Compare sets

Imitate Compare objects

Identify different

number of

Identify same number of

Recognize same Recognize

different

Equal quantity

Identify more

number of

Identify fewer

number of

Page 21: Dynamic Learning Maps Alternate Assessment Consortium ... · subitizing . Compare two quantities up to ten using models . Explain set Compare sets Imitate . Compare objects Identify

Learning Progressions vs. Learning Maps

Centralizes notion of “superhighway”

Delineates multiple pathways

Presenter
Presentation Notes
Learning progressions are more linear, larger, and have grosser grain size. They represent the “superhighway” route, typical for most. “A description of skills, understanding and knowledge in the sequence in which they typically develop: a picture of what it means to ‘improve’ in an area of learning.” Masters & Forster (1997) Learning maps are landscape learning progressions that are not necessarily vertical. They have a finer grain size and will cover content learning that occurs birth to college. Unlike linear learning progressions, they delineate alternate pathways thus creating alternate learning progressions. (Tatsuoka, 2009)
Page 22: Dynamic Learning Maps Alternate Assessment Consortium ... · subitizing . Compare two quantities up to ten using models . Explain set Compare sets Imitate . Compare objects Identify

Multiple Pathways ELA

Aware of same and different phonological

units as visual or tangible

Can identify syllables

Demonstrates receptive rhyming

Aware of same and different

phonological units as sounds

Demonstrates understanding letter sounds

Can demonstrate articulatory

movements for letter sounds

Presenter
Presentation Notes
Learning maps allow for multiple pathway – ex. Deaf/hard of hearing potential route (not only possible route)
Page 23: Dynamic Learning Maps Alternate Assessment Consortium ... · subitizing . Compare two quantities up to ten using models . Explain set Compare sets Imitate . Compare objects Identify

Maps were intended to be an Internal System

Page 24: Dynamic Learning Maps Alternate Assessment Consortium ... · subitizing . Compare two quantities up to ten using models . Explain set Compare sets Imitate . Compare objects Identify

1. Review of literature 2. Node development and

placement 3. Connection placement 4. Validation process

Multi-disciplinary Team Completes the Following:

Presenter
Presentation Notes
Determine prominent researchers in specific areas of mathematics and English language arts. Locate and synthesize empirical literature base with expert knowledge Edited works such as chapters from research handbooks, etc. Nodes developed from cognitive and concept shifts that are observable and testable Node placement and connections are hypothesized Critical nodes are exposed as pathways are developed Mapping typical and identifying sources that may shed light on multiple pathways that can be connected after the general map is established The map is ever-changing and evolving particularly with a perpetual review that is necessitated as more literature Expert review by practitioners and content specialists
Page 25: Dynamic Learning Maps Alternate Assessment Consortium ... · subitizing . Compare two quantities up to ten using models . Explain set Compare sets Imitate . Compare objects Identify

1. Review of Literature

Identify seminal literature Synthesize literature

with expert knowledge

Presenter
Presentation Notes
Determine prominent researchers in specific areas of mathematics and English language arts. Locate and synthesize empirical literature base with expert knowledge Edited works such as chapters from research handbooks, etc.
Page 26: Dynamic Learning Maps Alternate Assessment Consortium ... · subitizing . Compare two quantities up to ten using models . Explain set Compare sets Imitate . Compare objects Identify

Node (learning target)

Instruction

Curricular

Cognitive Develop-

ment

2. Node Development

Page 27: Dynamic Learning Maps Alternate Assessment Consortium ... · subitizing . Compare two quantities up to ten using models . Explain set Compare sets Imitate . Compare objects Identify

What is the observable knowledge (skill, conceptual, procedural, factual)

we want students to exhibit ?

In Sum….

Page 28: Dynamic Learning Maps Alternate Assessment Consortium ... · subitizing . Compare two quantities up to ten using models . Explain set Compare sets Imitate . Compare objects Identify

3. Connection Placement

Connection = predicted relationship between skills

Single direction Multiple connections Represents integrated

approach to skill development

Presenter
Presentation Notes
Node placement and connections are hypothesized Critical nodes are exposed as pathways are developed Mapping typical and identifying sources that may shed light on multiple pathways that can be connected after the general map is established
Page 29: Dynamic Learning Maps Alternate Assessment Consortium ... · subitizing . Compare two quantities up to ten using models . Explain set Compare sets Imitate . Compare objects Identify

Mathematics Section

Page 30: Dynamic Learning Maps Alternate Assessment Consortium ... · subitizing . Compare two quantities up to ten using models . Explain set Compare sets Imitate . Compare objects Identify

Learning Map (Math)

Page 31: Dynamic Learning Maps Alternate Assessment Consortium ... · subitizing . Compare two quantities up to ten using models . Explain set Compare sets Imitate . Compare objects Identify

Learning Map (Math)

Page 32: Dynamic Learning Maps Alternate Assessment Consortium ... · subitizing . Compare two quantities up to ten using models . Explain set Compare sets Imitate . Compare objects Identify

English Language Arts Section

Page 33: Dynamic Learning Maps Alternate Assessment Consortium ... · subitizing . Compare two quantities up to ten using models . Explain set Compare sets Imitate . Compare objects Identify

English Language-Arts

Page 34: Dynamic Learning Maps Alternate Assessment Consortium ... · subitizing . Compare two quantities up to ten using models . Explain set Compare sets Imitate . Compare objects Identify

Learning Map (ELA and Math)

*Note – these will eventually be connected into a single map

Page 35: Dynamic Learning Maps Alternate Assessment Consortium ... · subitizing . Compare two quantities up to ten using models . Explain set Compare sets Imitate . Compare objects Identify

4. Validation

Reviews Internal Teacher Expert

Cognitive labs Pilot study Field tests

35

Page 36: Dynamic Learning Maps Alternate Assessment Consortium ... · subitizing . Compare two quantities up to ten using models . Explain set Compare sets Imitate . Compare objects Identify

Dynamic Assessment

• Adaptive testing based on the learning map, not some general unidimensional concept of item difficulty – Navigating within neighborhoods – Navigating across neighborhoods

Page 37: Dynamic Learning Maps Alternate Assessment Consortium ... · subitizing . Compare two quantities up to ten using models . Explain set Compare sets Imitate . Compare objects Identify

Professional Development

• On demand • Multiple approaches

– “Raw” PowerPoint version – Narrated movie version of PowerPoint presentation – Fully prepared Facilitator Training Packet – Self-guided version – Video examples of students with the most significant

disabilities engaging in instructional tasks – Video examples of students with a variety of

disabilities doing similar tasks – Sample lesson plans

Page 38: Dynamic Learning Maps Alternate Assessment Consortium ... · subitizing . Compare two quantities up to ten using models . Explain set Compare sets Imitate . Compare objects Identify

Technology Platform

• KITE – will be available to all participating states to

deliver DLM on computers and tablets – Can be inexpensively licensed to deliver any other

assessments

Page 39: Dynamic Learning Maps Alternate Assessment Consortium ... · subitizing . Compare two quantities up to ten using models . Explain set Compare sets Imitate . Compare objects Identify

THANK YOU!

For more information, please contact: [email protected]

or Go to: www.dynamiclearningmaps.org

The present publication was developed under grant 84.373X100001 from the U.S. Department of Education, Office of Special Education Programs. The views expressed herein are solely those of the author(s), and no official endorsement by the U.S. Department should be inferred.