[PPT]Summative Assessment Test Administration … · Web viewNSCAS Summative Assessment Overview...

Summative Assessment Test Administration Workshop

February 2018

Welcome• Valorie Foy, Director of Assessment, NDE• Jeremy Heneger, Assistant Director of Assessment,

NDE• Rhonda True, Enhanced Assessment Grant

Coordinator, NDE• Terri Ough, NAEP Coordinator, NDE• Tyrina Webster, Administrative Assistance• Dacia Hopfensperger, Sr. Program Manager, NWEA • Rock Sharma, Sr. Technical Consultant, NWEA 

Agenda

• NSCAS Summative Assessment Overview• Technology Readiness• Summative Assessment Management• Student Experience• Resources• Communication & Help Desk• Questions & Answers

Summative Assessment Overview

State Components of NSCAS

• MAP® Growth™ (3-8) • Reading • Language • Science • Mathematics

• OpenEd, ACT Online Prep, Practice Tests (11)

• Local

• NSCAS Summative• NSCAS Alternate • ACT

• TestWiz and Navigate Item Bank

• OpenEd, ACT Online Prep, Practice Tests (11)

• Local

NSCAS Summative Assessment Overview 

Subjects and Grades• English Language Arts and Mathematics (College and Career Ready

Standards)- Grades 3 – 8 • Science (Legacy Standards) - Grades 5 and 8 Test Window • March 19 – April 27• Make Up Window April 30 – May 4Modes of Delivery: Online and Paper/Pencil• Online assessments will be minimally adaptive in Spring • In subsequent years the assessments will be fully adaptive

Resource: NSCAS Summative Paper/ Pencil Tips and Task Sheet Location: https://cdn.nwea.org/docs/NE/Paper+Pencil+Tips+Sheet_2.15.18.pdf

Testing Time and Scheduling Recommendations 

Grade Level Content Area  Approximate number of test

questions

Estimated test taking time 

3-8  Mathematics 48 90 minutes

3-8  English Language Arts 48  90 minutes

5 and 8 Science  50 – 60  60 minutes

Districts/Schools have flexibility in scheduling test sessions Testing times are M-F, 6:00am to 7;00pm CT 

Recommendation: two to four sittings per content area For example, given the 90-minute estimated test taking time, Districts/Schools can

schedule two 45-minute sittings –OR– three 30-minute sittings

Resource: Schedule Guidance for the Spring Summative AssessmentLocation: https://cdn.nwea.org/docs/NE/Schedule+Guidance+for+the+Spring+Summative_2.15.18.pdf

Testing Time and Scheduling -Recommendations and Considerations

• Estimated test taking time does not include:o Test ticket distributiono Starting the test sessiono Launching the secure browsero Student log in

• Students’ tests can only be paused by Proctor

• Student will be automatically logged out of the test after 10 min of inactivity• Note: Proctor action required for the Student to resume testing

Technology Readiness

Technology Readiness 

• System Requirements – Secure browser or app is REQUIRED for all devices

Resource: System and Technology – Summative GuideLocation: https://teach.mapnwea.org/impl/cap/SystemTechnologySummative.pdf

Browser/ App Current Version Release Date Mac Lock Down Browser 

4.0.0.2 Tuesday, February 20

PC Lock Down Browser 

5.4.90 Tuesday, February 20

Chromebook App 3.0.1 Tuesday, February 20iPad App 3.1 Monday, February 26

• Windows 7, 8.0, 8.1, or 10– Chrome 41 or higher– Firefox 50 or higher– Microsoft Edge or IE 11

• Mac OS X v10.9 to 10.13– Safari 7.0 to 11

• Mac and Chromebook– Chrome 41 or higher– Firefox 50 or higher

Proctor Station 

Supported Devices

• Windows 7, 8.0, 8.1, or 10• Mac OS X v10.9 to 10.13• iOS 9 to 11• Chromebook OS 41 or higher

Notes: July 2018 – support ends for Windows 8.0, Mac OS X v 10.9 and Safari 7 (Proctor and Student)

Student Devices 

Technology Readiness 

• System and Technology – Summative Guide – Add to your White lists– Exclude from caching– Prioritize the traffic

• Diagnostic Tool– Anticipated release week of Feb 19th

Resource: System and Technology – Summative GuideLocation: https://teach.mapnwea.org/impl/cap/SystemTechnologySummative.pdf

Communication Overview

• NDE-District-NWEA Partnership Update • Assessment Portal 

– https://community.nwea.org/community/nebraska

• Incident Reports/Communication – Incident notification message directing you

the status page – http://status.nwea.org/

Help Desk

• Policy questions: Contact NDE – Phone: 402-471-2495  – Email: nde.stateassessment@nebraska.gov

• Summative or MAP Growth inquires or support: Contact NWEA– Phone: (855) 225-9926– Email: NWEANebraska@nwea.org– 7:00 a.m. – 5:00 p.m. Central Time (CT), Monday – Friday 

Summative Assessment Management

Summative Assessment Management

• MAP Growth users will be familiar with the platform• MAP Growth users will use the same username and

password credentials • New partners will receive their log in credentials during

the implementation and onboarding process with NWEA. District Assessment Contact will receive admin rights to roster all users.

• After logging into the platform, users will see the Summative Testing module

Summative – Assessment Management

Summative Tasks Comprehensive Assessment Platform 

• Manage User Accounts• Update/add additional Student Roster information • Create Test Sessions • Update Accessibility information• Print Test Tickets • Manage Online Test Sessions• Monitor Student Progress• Data Clean Up

Resource: Assessment Coordination Guide - SummativeLocation: https://teach.mapnwea.org/impl/cap/AssessmentCoordGuideSum.pdf

Summative Testing - Roles

Role Manage Users

Roster Students

Manage Students

Manage Sessions

Proctor Sessions

District Assessment Coordinator X X

Data Administrator X X X X

District Proctor X X

School Assessment Coordinator X X

School Proctor X

Resource: Student/Staff Management Guide-SummativeLocation: https://teach.mapnwea.org/impl/cap/StudentsStaffManagementGuideSum.pdf

Summative – Rostering

Students must be rostered to the Spring 2017-18 term with the following required fields populated:

• First Name• Last Name• Student ID• State Student ID• Gender• Grade• Ethnic Group Name• School Name• School Code• Teacher Information

After adding the student, you must wait for overnight processing before the student is available for testing.

Roster information will also support MAP Growth for the Spring term

Accommodations

Students with disabilities may be included in state assessment and accountability in the following ways:

• Students may be tested on the NSCAS Summative assessments without accommodations.

• Students may be tested on the NSCAS Summative assessments with approved accommodations specified in the student’s IEP. Accommodations provided to students must be specified in the student’s IEP and used during instruction throughout the year. Accommodations may require paper/pencil testing.

Resource: NSCAS Summative & Alternate Accessibility ManualLocation: https://www.education.ne.gov/assessment

Accessibility

Universal Tools – Scratch paper (lined or blank scratch paper or blank

graph paper)• Grades 4 – 8 Math Reference Sheets: Must be printed, from

the NDE & NWEA State Portal, prior to students testing online. 

• Embedded resources Highlighter Eraser Line Guide Answer Eliminator Notepad Zoom

Accessibility

• Linguistic Supports – Text to Speech – Online Spanish Test – Paper Pencil in Spanish– Additional non-embedded supports

• Accommodations – Text to Speech – Additional non-embedded supports

Text to Speech

• When enabled Text to Speech will display in the toolbar• Students must click on an icon for each item • All text will be read aloud in Math and Science.  On ELA,

passages will not be read.

Resource: Text to Speech InstructionsLocation: https://cdn.nwea.org/docs/NE/TextToSpeechInstructions_FINAL_2.9.18.pdf  

Accessibility in CAPNon embedded Universal Tools Setting

Non embedded Linguistic Supports Bilingual dictionary Native language translation

Embedded Linguistic Support/ Accommodation Text to Speech

Non embedded Accommodations Computation supports Assistive Technology Specialized presentation of test Scribe

Non-Tested Codes

Resource: Location:

Code Description Explanation of Use

ALT Alternate Assessment Student participated in the alternate assessment.

EMW Emergency Medical Waiver

Student was not tested because of an approved Emergency Medical Waiver.

NLE No Longer Enrolled Student was not tested because of relocation from district/school after data submission but prior to testing.

PAR Parental Refusal Student was not tested because of a written request from parent or guardian.

PPA Paper-Pencil Administration

Student was administered a paper/pencil test and will not generate an online test score.

SAE Student Absent for the Entire Testing Window

Student was not tested because student was absent from school from the beginning of testing till the end of testing.

UTT District Unable to Test Student

District was unable to test the student during the testing window and none of the other not-tested codes is applicable.

Test Session Management

• Creating a Test Session

• Editing/Modifying Session

• Assigning Accommodations and Non-Tested Codes

• Printing Test Tickets

• Starting a Test Session

• Ending a Test Session

Roles for Testing Students

District Assessment Coordinator

School Assessment Coordinator

District Proctor School Proctor

Create Test Sessions X X

Assign Accommodations X X

Add or Remove Students from Test Sessions X X

View and Access Summative Test Sessions Assigned to Them 

X X X X

Print Test Tickets X X X X

Monitor Individual Students in a Test Session X X X X

Test Session Management Demonstration

Print Student Test Tickets

• Two ways:– From Test Sessions Multiple sessions at once, if required Prints tickets for all students in selected sessions– From Proctor Console Print for one or multiple Students at once, if required

• Default: test tickets print 4 to a page – Test tickets can also be exported

Student Test Tickets

Testing Progress 

Resource: Assessment Coordination - SummativeLocation: https://teach.mapnwea.org/impl/cap/AssessmentCoordGuideSum.pdf

• Within District Transfers – Original school removes the student from sessions for

any tests that are not complete.– Student roster information needs to be updated to new

school– New school needs to add student to sessions for any

tests that are not complete

Student Mobility

• Between District Transfers – Original school needs to apply Non-Tested Code of NLE

for any tests the student did not complete– New district/school needs to roster student to their new

district/school using standard rostering process.– New district/school needs to add student to sessions for

all content areas– New district/school needs to apply Non-Tested Code of

NLE for any tests the student completed in their original district.

Student Mobility

Proctor/Student Experience

Proctor / Student Experience - Login

Step 1: Student launches secure

browser

Step 2: Student enters session

name and session

password

Step 3: Student enters

student ID and student code from test ticket

Step 4: Start Test

Proctor Experience – Generate a Session Password

Proctor Experience

Student Experience: Session Name & Password

Student Experience: State Student ID & Student Code

Student Experience: Confirmation Page

Proctor Experience – Confirm Students

Student Experience: Ready to Test

Proctor ExperienceTesting Progress

Student Experience - Pause

Student Experience - Pause

Student Experience: Inactivity Timeout

Student Experience – End of Test

Proctor Experience – Exit Session

Proctor Experience

Summative – Student Tutorials

• Available for students to learn how to use the online test platform. – How to use the online tools– How to navigate through the test– How to respond to different item types– Test-Taking Tips

Resource: Student Tutorial Location:https://teach.mapnwea.org/impl/captraining/StudentTutorialNE/index.html

Summative – Practice Tests

Username: nePassword: Practice

Preparing for Summative Assessment

• Review technical requirements for Summative Testing• Download Latest Secure Browsers – confirm version

numbers• Run NWEA Diagnostic Tool on devices used for testing• Review NDE guidelines for accessibility and identify

individual students in need of specific accommodations • Consider structure for Test Sessions • Review NDE Test Security Manual  

Suggestions for a Smooth Testing Experience

• Enable audio on devices used for TTS• Create sessions in advance• Ensure all students are included in test sessions and

accessibility feature enabled, as need• Validate school proctors rights have been assigned • Proctor station will refresh every 60 seconds.

Communicate this functionality with proctors • Use the student testing progress dashboard to monitor

testing progress throughout the test window

User Feedback 

• User surveys – Survey link will be send via NDE-District-NWEA

Communication to DACs– Forward to others in your district

• Interviews – Google doc will be sent via NDE-District-NWEA

Communication to recruit interested proctor, district and school assessment coordinators

– 60 minute 1:1 virtual interviews • Focus Groups

– Held at numerous meetings over the summer (i.e. content workshops, ALD workshops, Administrator Days) 

Summative Assessment  – Important Dates 

• February 2: Districts roster all Students • February 26: Districts Begin Test Session Management Activities • March 1 – 2: Paper/pencil test materials delivered to districts from initial

orders• March 5 – April 24: Districts place additional orders for paper/pencil

materials• March 19 – April 27: Test administration window• April 30 – May 4: Make up window • May 8: Last Day for Districts to Enter non-embedded Accommodation Codes,

Non-tested Codes• May 8: Last Day for UPS to Pick Up Paper/Pencil Materials • September – October: Score Reports Available

Summative Assessment  – Resources 

• Summative Help Centerhttps://teach.mapnwea.org/impl/caphelp/Content/SummativeHelpCenter.htm

Assessment Coordination Guide: electronic only Proctor Guide: electronic only System and Technology Guide : electronic only Students/Staff Management: electronic only

• Assessment Portalhttps://community.nwea.org/community/nebraska

Practice Test Manual: electronic only Test Administration Manual for Online Test (English version): electronic only Test Administration Manual for Paper/Pencil Test (English version): electronic and

printed copies available Test Administration Manual for Online Test (Spanish version): electronic only Test Administration Manual for Paper/Pencil (Spanish version): electronic and printed

copies available Recorded trainings for test session management activities

Communication & Help Desk

Communication Overview

• NDE-District-NWEA Partnership Update • Assessment Portal 

– https://community.nwea.org/community/nebraska

• Incident Reports/Communication – Incident notification message directing you

the status page – http://status.nwea.org/

Help Desk

• Policy questions: Contact NDE – Phone: 402-471-2495  – Email: nde.stateassessment@nebraska.gov

• Summative or MAP Growth inquires or support: Contact NWEA– Phone: (855) 225-9926– Email: NWEANebraska@nwea.org– 7:00 a.m. – 5:00 p.m. Central Time (CT), Monday – Friday 

Questions & Answers