State Board of Education Presentation

Jeffrey Hauger, Ed.D.Peggy McDonald, Ed.D. Elizabeth Celentano, M.Ed.January 11, 2016

NEW JERSEY DYNAMIC LEARNING MAPS (DLM) ALTERNATE

ASSESSMENT: Standard Setting and Results

Overview of the DLM Alternate Assessment

DLM 2014-2015 Results2

DLM measures the performance of students with the most significant intellectual disabilities on skills linked to the CCSS in English Language Arts and Mathematics. These skills are of lower

complexity and difficulty levels than the skills assessed in PARCC.

DLM is an online computer-adaptive assessment that assesses what a student knows and can do.

Approximately 9,960 New Jersey students were assessed by the 2014-2015 DLM from grades 3 through 8 and grade 11.

Overview of DLM Alternate Assessment

The 2014-2015 administration was the first operational administration of DLM.

In prior years, ELA and math were assessed using the Alternate Proficiency Assessment portfolio system.

IEP teams determine whether students with disabilities participate in the PARRC or the DLM based on specific criteria.

The DLM provides an opportunity to assess the knowledge and skills of students with the most significant intellectual disabilities on more challenging concepts.

3 DLM 2014-2015 Results

What is a Learning Map?

DLM 2014-2015 Results4

Think of a learning map as a common road map.

Although students may share the same destination, they all begin their journeys from different starting points on the map.

A map shows where a student is starting from, as well as the main route, which is the shortest, most direct way to reach the destination.

However, a good road map does more than show a single route. It also shows several alternate routes in case the main route cannot be taken.

DLM Math Major Tested AreasMath Major Claims

1.Students demonstrate increasingly complex understanding of number sense.2.Students demonstrate increasingly complex spatial reasoning and understanding of geometric principles.3.Students demonstrate increasingly complex understanding of measurement, data, and analytic procedures.4.Students solve increasingly complex mathematical problems, making productive use of algebra and functions.

Example of Tested Concepts Related to Each Claim for Grade 3

1.Demonstrate understanding of place value to tens.

2.Recognize that shapes can be partitioned into equal areas.

3.Use picture or bar graph data to answer questions about data.

4.Identify arithmetic patterns.

DLM 2014-2015 Results5

DLM ELA Major Tested Areas

ELA Major Claims

1.Students can comprehend text in

increasingly complex ways.

2.Students can produce writing for a range of

purposes and audiences.

Example of Tested Concepts Related to Each

Claim for Grade 11

1.Recount the main events of the text which are related to the theme or central idea.

2.Use complete, simple sentences, as well as compound and other complex sentences as

appropriate.

DLM 2014-2015 Results6

DLM 2014-2015 Results7

Computer Adaptive Process of DLMThe computer-adaptive assessment assigns the difficulty

level of the first group of test items based on teacher-completed survey questions. The answers relate to a student’s current level of demonstrated skill in math and ELA.

Test items for each skill are written at multiple difficulty levels.

Example of the computer adaptive process: A student completes a small set of test items (3-5) and the

DLM system scores the answers. Then the system delivers another group of test items that are

either slightly easier, slightly harder, or about the same level. The level of the new items depends on how the student

answered the previous questions. This process continues until the student has finished the

assessment. The total number of test items varies depending

on the subject area and grade level.8 DLM 2014-2015 Results

DLM Example –Engagement in ELA Reading

DLM 2014-2015 Results9

The first time the student reads the ELA text acts as the engagement activity.

The first read through is considered a shared reading activity between the test administrator and student.

The test administrator may ask factual questions about the text and graphics. This is to facilitate student interaction and engagement with the information, with the expectation of promoting student comprehension.

http://hwcdn.net/n5d3p8v5/cds/assessment/apa/dlm/dlm.mp4

DLM Standard SettingStates were invited to nominate 6-7 teachers to

participate in the standard setting process of setting cut scores.

Six teachers from New Jersey and other consortium state educators met with DLM staff June 15-19, 2015 to set standards on the DLM ELA and math assessments. This was done for each grade level and subject area.

The standard setting process determined the student’s test performance results to be categorized as Emerging, Approaching the Target, At Target, or Advanced.

Department of Education staff reviewed the standard setting committee recommendations based on the statistical data, the method used, and the DLM Technical Advisory committee’s approval of the standard setting method.

10 DLM 2014-2015 Results

Results - English Language Arts

DLM 2014-2015 Results11

Grade %Emerging % Approaching % Target %Advanced%Target and

Advanced

3 48.3 14.1 33.6 4 37.6

4 43.5 15.8 35.4 5.3 40.7

5 41.6 17.4 31.2 9.9 41.1

6 35.1 16.2 26.6 22.1 48.7

7 36.4 15.1 23.6 24.9 48.5

8 37.8 19.5 25.3 17.5 42.811 35.6 21.6 31.5 11.3 42.8

Results - Mathematics

DLM 2014-2015 Results12

Grade %Emerging % Approaching % Target %Advanced%Target and

Advanced

3 48.3 12.4 23.7 15.5 39.24 44.7 16.7 21.6 17 38.65 45 18.6 17.4 19.1 36.56 47.2 19.7 18.1 15 33.17 49 27.8 13.8 9.4 23.28 50.7 27.8 17 4.5 21.5

11 56.7 27.6 15.3 0.5 15.8

Results – English Language Arts

DLM 2014-2015 Results13

Results - Mathematics

DLM 2014-2015 Results14

Resolution: Threshold Scores for ELA and Math Minimum Raw Scores for Each Performance

DLM 2014-2015 Results15

Cut Points

Subject GradeApproachin

g Target Advanced

ELA 3 36 50 71

ELA 4 38 57 75

ELA 5 35 53 76

ELA 6 27 46 65

ELA 7 27 52 73

ELA 8 23 48 72

ELA 11 18 47 70