Copy of ACT Aspire Saipan Intro to ACT Aspire

Welcome Saipan ACT Aspire

Test Coordinators

Schedule for Monday Feb 23rd, 2015

Time Topic

8:30 – 9:00am • Registration: Overview of ACT Aspire Summative and Periodic Assessments – Audience: ACT Aspire Test Administrators and Test Coordinators

9:00 – 10:30am • Agenda and Topic Review • What is ACT Aspire? • High Level Schedule Overview • Training and Resources • Assessment Preparation, Administration, After Testing

10:30 – 10:45am • Break

10:45 – 11:45am • Let’s Compare Summative and Periodic

11:45am – 1:00pm • Lunch

1:00 – 1:45pm • ACT Aspire Portal Overview

1:45 – 2:40pm • Technology Readiness • Customer Service

2:40 – 3:00pm • Open Q and A

Saipan Test Coordinator Training 2

Introduction to ACT Aspire

Agenda

General Information

Assessment Preparation

Preparing Your Personnel

Assessment Administration

Post Assessment Steps

2

Portal Overview

Customer Service

Saipan Test Coordinator Training

Training Resources

Technology Readiness High Level

Color Coding

Training will cross several phases of testing; slides will change to reflect the phases they represent:

5

General Information



Post-Assessment Steps

Reporting & Data Usage

Pre-Test Tech Readiness


General Information

(Summative and Periodic)

What is ACT Aspire?

ACT Aspire is a vertically articulated, standards-based assessment system comprised of:

summative interim classroom-based assessments

7

Periodic


What is the assessment format?

Computer-based Testing (CBT) Grades

6-9/10 (EHS)

Paper-based Testing (PBT) Grades 3-5


What types of assessments are available?

Summative

Typically given 1x per year,

Fall or Spring

(Reading, English, writing, math, science)

Grades 3-10

*Periodic

Interim:

Three assessments per grade

(Reading, English, mathematics, science)

Grades 3-10

Classroom:

Five, 5-item mini assessments per grade

(Reading, English, mathematics, science)

Grades 3–8


*Available on Computer-based Testing Platform

ONLY

What might my testing cycle look like?


• Interim (all students)

•Classroom (some students)

Fall

• Interim (all students)


Winter •Summative (all students)


Spring

ACT Aspire Goals

11

• Measures student growth towards college and career readiness grades 3-10

• Identifies early learning gaps to help all students graduate from high school ready for college and career opportunities


English Reading Writing Math Science

Subjects and Grades Assessed

12

Saipan: Grades 3-10

English, Reading, Writing (N/A Periodic), Math, Science


Common Core Alignment

ACT Aspire scores will be linked to the ACT College Readiness Standards and results presented in reporting categories that are aligned to the Common Core State Standards. The Common Core State Standards draw heavily from ACT College Readiness Standards and research. The ACT Aspire system will go beyond Common Core to measure other critical areas by providing insights on science skills and offering career-readiness measures that prepare students to graduate, ready for both college and career.

13 Saipan Test Coordinator Training

Items per Grade and Subject

14

English Reading Writing

Math Science

Depending on the grade and subject, most assessments have between 30-60 items.


Summative Test Administration Times

Note: Administration times begin after students have completed pre-test gridding and Verbal Instructions have been given. If two or more tests will be administered in a single sitting, you will need to allow 5–10 minutes between each test to collect completed materials and go over instructions for the next test.


16

TOTAL TIME Grades 3, 4, 5: 3 hours, 50 minutes

Grades 6 & 7: 4 hours

Grade 8: 4 hours, 5 minutes

Early HS: 4 hours, 10 minutes


Summative Total Administration Time

ACT Aspire Question Types


Selected Response

Constructed Response

Technology Enhanced Items (TEI’s)

Question Formats

• Selected-response tasks • Constructed-response tasks • Technology-enhanced tasks


Saipan Summative Schedule

• ACT Aspire received Organizational File from Saipan – No Action Needed 1/16/15

• ACT Aspire received the Student Data Upload (SDU) file to populate students – No Action Needed 1/23/15

• Students available in the ACT Aspire Portal – No Action Needed • Portal invites sent to all staff listed on the Org File

1/26/15

• Test Coordinators (TCs) invite additional users to the Portal and assign permissions

1/26-3/25/15

• TCs select Personal Needs Profile (PNP) info for accommodations into the Portal (must be complete prior to test session set-up)

1/26/-3/25/15


Saipan Summative Schedule, cont.

• Paper-based Test Session set-up window 2/27-3/25/15

• Computer-based Test Session set-up window 3/9-5/11/15

• School Test Coordinators (STCs) receive shipments of test materials – Contact Ray

5/4-5/18/15

• ACT Aspire Summative tests are administered • Scorable Answer Documents are returned to ACT Aspire – Contact

Ray

5/18-5/29/15

• Nonscorable test materials are returned to ACT Aspire – Contact Ray

5/29-6/8/15


Saipan Summative Testing Window

21

Spring 2015 Test Schedule All subjects May 18 – May 29, 2015


ACT Aspire Landing Page

22

http://actaspire.pearson.com


http://actaspire.pearson.com/�

Landing Page – Training and Manuals


Exemplars – Online samples of test

questions

– Booklet provides overview, concepts measured, and answer key

– Requires login

– Should not be accessed from tablets or smartphones


Exemplars…

Avocet – Online indexing of

ancillaries, manuals, program resources

– Only the latest version will be posted

– Requires no login

– Mobile-ready


…Information…

– CBT via Avocet

– PBT via Avocet

Avocet - Process Flow Charts


Training Management System (TMS)

– Enables convenient self-paced training

– Requires email to login

– Transcript feature tracks training

– Mobile-ready


…and Free Training Videos

TMS – Summative and Periodic Track


TMS Features

Many new features! Saipan Test Coordinator Training 29

30

Key Web Links


Pre-Test Tech Readiness

(Summative CBT and Periodic)

Online Assessment Components

• Assess computer readiness SystemCheck

• Assists TestNav in the delivery of content

Proctor Caching

• Administrative site for managing all assessment functions Portal

• Delivery engine by which students interact with the assessment TestNav


Pre-Test Tech Readiness Overview


Technology Coordinator Reviews Tech Readiness on TMS and Avocet Documentation

Run SystemCheck for TestNav

Install, verify, and test

proctor cache software

Use SystemCheck

Testing Capacity test to determine

system bandwidth and

estimated testing capacity

Log into ACT Aspire portal

and set default caching

computer(s) for district or

school

Ensure enough working

headphones, mice, and

keyboards for all

simultaneous testers

SystemCheck

• SystemCheck validates that testing workstations meet the minimum requirements needed to run TestNav 8.

• SystemCheck also provides the ability to run bandwidth speed checks to help plan for online testing capacity.


Tech Set-Up – System Requirements


*Requirements subject to change.

Why is Pre-Test Tech Readiness so critical?


Teaches staff how to assess the

preparedness of school /districts technology and allows time to

respond

Provides the steps to follow to prepare for

implementing this assessment

Allows coordinators time to ask questions

of our technology experts directly

Ensures your assessment

experience will be smooth



Assessment Preparation Overview

38

Saipan provides ACT Aspire with organizational and student data upload (SDU) files

ACT Aspire invites Test Coordinators to the ACT Aspire Portal

Add additional users to the ACT Aspire Portal with the appropriate permissions (user roles)

Enter Personal Needs Profile (PNP) information into system for EACH student that has accommodations

Navigate to applicable product tab, Create test sessions, selecting the Online or Paper form option

Receive materials and keep shrink wrapped for security

If students move in after ??, contact ACT Aspire Customer Service if more materials are needed


User Roles Learning Points

39

Use

r Ty

pes

Tenant Roles

Tenant Roles determine what a user can do within ACT Aspire –

Uploading organization

and student data

View Members

Manage User permissions

Invite/delete users

Associate users to Orgs

Create test sessions

View/edit student

profiles


User Roles Learning Points

40

Use

r Ty

pes

Test Session Roles

Test Session roles determine what a user can do within a Test Session

Add/remove users/proctors

Add/remove students

Edit test session details

like dates, times, and

titles.

Add/Edit Test Session roles

for users

Print authorization tickets

or rosters

Start/end a test session


User Role Types

41

Tenant Roles

Administrator

Test Coordinator

Educator

Guest

Test Session Roles

Test Supervisor

Room Supervisor

Guest



Tenant User Roles


Test Session User Roles

Can you find these topics on Avocet?

• Portal User Roles • Checklists • Hardware and Software Requirements for TestNav • Manuals for Summative and Periodic • Accessibility and Accommodations


Materials Overview

• Test Coordinators are responsible for the management and handling of materials

• Materials are secure, and must be handled according to security protocol and procedure, as outlined in the Test Coordinator manual

• ACT Aspire recommends all testing staff receive local Security of Test Material overview training prior to testing


Initial Shipment of Test Materials

Material Type Window

Initial Shipment 5/4-5/18 (Contact Ray)


• Test materials are provided only for students added to test sessions in the Portal before the submission deadline

• Quantities are derived from the Portal

• Pre-ID documents are sorted by subject, grade, and session according to the information provided in the Portal

• Test booklets are not personalized, and are sent in packs of 10

• Test booklets are serialized and tracked for security; do not resort booklets from the order you receive them in

• Manuals are available on Avocet

Initial Shipment Contents

Initial Shipment

Packing List

Security Checklist

Test Coordinator Kit (includes return materials)

One test booklet per student • Each test booklet will include one subject test (English, Mathematics, Reading, Science, or Writing)

One answer document per student • Answer documents are specific to the subject of the test booklet; each student name provided is

printed on the front cover of the answer document


Shipment Memorandums

Memos included in shipments

Initial Shipment Contents

Return Instructions


Receiving Test Materials

Examine shipment and verify contents match the packing list

Count, but do not open, all items to confirm receipt

49

Verify that the materials have not been tampered with in any way

If there are any discrepancies or concerns, contact ACT Aspire Customer Support immediately


Storing Test Materials

After you have verified receipt of all materials:

Reseal the boxes

Lock them in a secure place such as a storage room, closet, cabinet, or school vault that is not accessible to unauthorized personnel

Protect the materials in such a way as to avoid accidental damage, possible theft or loss, and any conditions that could allow prior knowledge of the tests by students, teachers or others

Immediately after testing, return materials to secure storage until they are shipped back for processing

50

Exercise vigilance concerning the security and handling of all test materials before, during, and after the tests are administered


Materials Provided by the School

Other Materials

Timers

No. 2 Pencils

Scratch Paper

Calculators (optional)


http://www.actstudent.org/faq/calculator.html�



Key Summative Manuals


Key Periodic Manual


• Found on Avocet (P)

Periodic

• CBT

Portal User Guide


• PBT

• CBT

• Found on Avocet (P)

Portal User Guide

Test

Coordinator

Checklist


• PBT

• CBT

• Found on

Avocet - (C)

Checklists

Room

Supervisor

Checklists


• PBT

• CBT

• Found on

Avocet - (C)

Checklists

Seating

Arrangements

• Acceptable and unacceptable seating configurations chart and information is now contained within the Test Coordinator and Room Supervisor Manuals


Desirable Testing Conditions

Adequate writing surfaces, ample seating, good lighting, comfortable temperatures, quiet atmosphere, freedom from distraction

Surface should accommodate a test booklet and answer document side by side (NO lapboards)

Whenever possible, seat students in rows to facilitate distribution and collection of materials

Students should be minimally 3 feet apart shoulder to shoulder and front to back; students should face the same direction

Cover content related maps, charts, bulletin boards, posters, etc.



(Summative PBT – Grades 3-5)

Gridding an Answer Document – A-C

Box A – Leave blank

Box B – District & School Name

Box C – Student Name


Gridding an Answer Document – D-E

Box D – Test Form

Box E – Date of Birth


Gridding an Answer Document – F-G

Box F – ACT Aspire Portal ID

Box G – Student Statement


Gridding an Answer Document – H-I

Box H – Today’s Date

Box I – State or Local Student ID


Answer Document Pre-ID Layout


– Note #3 shows the location of the Test Session Name you create

– Answer Docs are shrink wrapped by Test Session

Test Book – Form Location




Assessment Administration Overview – PBT

Materials are delivered to classrooms

Room Supervisors follow Verbal Instructions in the Room Supervisor Manual for the correct grade and subject

Students begin assessments!

Room Supervisors actively monitor during test sessions and report testing irregularities immediately after testing

Room Supervisors return materials to Test Coordinators


Assessment Administration Overview – CBT

Ensure test sessions are started the morning of testing

Room Supervisors follow Verbal Instructions in the Room Supervisor Manual for the correct grade and subject, and distribute student authorization tickets

Students begin assessments!

Room Supervisors actively monitor during test sessions and report testing irregularities immediately after testing

After all students have finished testing and irregularities are entered, close test sessions


Reporting Irregularities - PBT and CBT

Irregularity flow: – Document any

circumstances that affect student scores

– Documentation must be completed by school personnel

– Should first be recorded by Room Supervisors

– Test Coordinators should be notified after the irregularity is recorded


Irregularities – Provided in RS-Paper Manual


Post Assessment Steps

(Summative PBT Grades 3-5)

Post Assessment Steps Overview

Test Coordinators return scoreables

& nonscoreables as noted in their

manual

Test Coordinators enter irregularities

and close test sessions in the

Portal

Room Supervisors return materials

and Testing Irregularity

Reports to Test Coordinator

Room Supervisors gather materials


After Testing – Handling Materials

• After testing, materials must also be stored in a locked, secure place until they are shipped

• All test booklets and other materials provided by ACT Aspire must be returned to Fasefulu Raymond Tigilau per your schedule

• You will need to prepare, package, and return the test materials; this includes returning all nonscorable materials


After Testing – Review Documents

• Have you:

checked test booklets for scorable answer documents?

checked answer documents to verify the booklet Test Form is filled in?

checked answer documents to confirm student Portal information is either personalized or hand gridded?


General Packing Information

Pack return materials using the original shipping boxes

– If the original boxes have been damaged, ship the materials using ECT 44 (275lb)-rated boxes

– Replacement boxes can also be ordered by calling ACT Aspire Customer Service

Do not overfill a box; if the materials do not completely fill the box, add filler material

Remove any previous markings or labels from each box before applying new labels

Do not combine your scorable box count with your nonscorable box count


General Sealing / Labeling Information

To ensure that a box is securely closed, apply three strips of tape to both the top and the bottom of the box in an “H” pattern as shown

Place the shipping labels on the top of the box as

shown; note the colored label


Packing Scorable Materials, Steps 1-4

1. Gather all scorable answer documents

2. Stack the answer documents carefully in each original shipping box

3. Seal each box securely with packaging tape

4. Locate the package labeled “Test Coordinator Kit”

– This package contains lavender labels, yellow labels, and UPS labels


Packing Scorable Materials, Steps 5-6

5. Place one lavender return shipping label on top of each box

6. Count the number of boxes. On the return label that reads “Box __ of __,” fill in the sequence of boxes being returned


Packing Scorable Materials, Step 7

7. Affix one UPS second-day air label to the top of each box of scorable material


Packing Nonscorable Materials, Steps 1-4

1. Gather the nonscorable materials

2. Pack materials for each subject as follows, from bottom to top, starting with your highest-numbered box and working back:

1) Used test booklets 2) Unused answer documents 3) Unused UPS ARS labels and scratch paper

3. Seal each box securely with packaging tape

4. Locate the package labeled “Test Coordinator Kit”

– This package contains lavender labels, yellow labels, and UPS labels


Packing Nonscorable Materials, Steps 5-6

5. Place one yellow return shipping label on top of each box

6. Count the number of boxes. On the return label that reads “Box __ of __,” fill in the sequence of boxes being returned


Packing Nonscorable Materials, Step 7

7. Affix one UPS ground service label to the top of each box of nonscorable material


Complete Security Checklist: Prepare to give a copy to Ray at your paper material drop off!!

• Every book must be accounted for • Use checklist to track assignment of materials, date returned;

if not returned, note the reason


After Packing Materials

• Have you:

Have you populated your Security Barcode Checklist and have prepared a copy for Ray at drop off?

Have you packed answer documents and test books with the appropriate labels?

Have you sealed your boxes?

Have you numbered your boxes?


Let’s Compare!

Summative

vs.

Periodic Products

Base Offer – Summative


CBT Assessments (Standard Forms, Audio Forms) Grades 3-8, EHS (Standard) – Math, Reading, Science, English,

Writing Grades 3-8, EHS (Audio) – Math, Science, Writing

PBT Assessments (Standard, Accommodated, & Read Aloud Forms) Grades 3-8, EHS (Standard Forms) – Math, Reading, Science, English, Writing Grades 3-8, EHS (Large Print/Braille) – Math, Reading, Science, English,

Writing Grades 3-8, EHS (Read-A-Loud) – Math, Science, Writing Grades 3-8, EHS (ASL) – Math, Reading, Science, English, Writing (local

administration) NO Readers Scripts/NO CDs

Online Manuals, Information Repository, & Training Modules Avocet Site Training Management Site Landing Page Discover ACT Aspire



CBT Readiness Support System Check Tool Infrastructure Trial Exemplars Proctor Caching OTI Support

Chromebooks are supported

Personalized Answer Docs (PBT only) Improves Data Integrity Reduces the Need for Gridding Minimizes Additional Orders Requires More Time Alpha By Test Session

Packaging/Distribution of Test Booklets and Answer Docs Overage Packed by School, Delivered to District Materials are shrink-wrapped – Test Books in packs of 10; Answer Docs are

Alpha Last name by Test Session



Return of Test Booklets and Answer Docs Keep Your Boxes the materials were shipped in Return Shipping Labels (lavender, yellow, UPS) Test Booklets are Highly Secure – we perform a security reconciliation Security Barcode Checklist Answer Docs are Processed, Scanned, Edited, etc…

Machine Scoring Multiple Choice Responses Technology Enhanced Items – Computer-based Testing Only; Math and

Science

Performance Scoring Part of the Assessment Construct = Open Ended Items Appear (Math, Science,

Reading, Writing) Goal: Artificial Scoring with KT engine Must be matched up with Machine Scores



Reporting Individual Student Reports (ISRs) – pdf format Student Performance File (SPF) – csv format (District, State) Current Progress Report (Teacher, School, District, State) Supplemental Scores (Teacher, School, District, State) Subject Proficiency by Demographic (School, District, State) Subject Proficiency by Grade Level (School, District, State) Subject Proficiency by Student Proficiency Summary – “Pathway” (Teacher, School) Skill Proficiency by Student (Teacher, School) Subject Proficiency by School (District) Subject Proficiency by District (State)



Reporting, cont. 45-60 Day Result Turnaround Timeframe Accessed via the ACT Aspire Portal Online Access only (Printed ISRs available for a fee) Some HTML reports are static and some are dynamic Avocet Resources (Report Samples) TMS Reporting and Data Usage Tab

Summative Reporting – Avocet Support


Understanding Your ACT Aspire Summative Results


Base Offer – Interim


CBT Assessment Basic Information A test may be taken multiple times, but customers have to

set-up new test sessions, print authorization tickets, etc. Immediate reporting Chromebooks and iPads are supported

Visit Avocet – (P) Periodic

Visit TMS – Periodic Section

CBT Readiness Support SystemCheck Tool Infrastructure Trial Exemplars (pre-select Selected Response items only) Proctor Caching Online Technology Implementation (OTI) Support



CBT Assessment Only (Standard, & Audio) Grades 3-8, EHS (Standard) – Math, Reading, Science,

English Grades 3-8, EHS (Audio Interim I Only) Math, Science Braille test book offered based off Interim I form – Student

must respond online, there are no Answer Documents No Writing! No Open Ended Scoring, All Machine Scored All Selected Response item types Three forms per school year – 20 to 45 items per form The current set-up process mimics Summative set-up

(Org/SDU/Test Sessions/Authorization Tickets, etc.) Timer appears at 00:00, test are not timed No Calculator Rules like the Summative Assessment



Packaging/Distribution of Interim I Braille book Ordered Via Customer Service Center via a Additional Order

(A/O) Form that they provide you upon contact Packed by School, Delivered to District Student Responds Online via CBT/TestNav Interim I Braille Books do NOT get returned – re-use for

interim II and III

Reporting Avocet Resources (How to Access, Report Samples, Report Packages) TMS Reporting and Data Usage Tab

Periodic – Avocet Support


Understanding Your

ACT Aspire Interim

Results


Base Offer – Classroom


CBT Assessment Grades 3-8 (Standard Forms) – Math, Reading, Science English in releases 3 through 5 only; not in 1 and 2 Five - 5 item quizzes released for each Interim form No Accommodations No Writing! No Open Ended Scoring, All Machine Scored All Selected Response item types The current set-up process mimics Summative set-up

(Org/SDU/Test Sessions/Authorization Tickets, etc.) Timer appears at 00:00, test are not timed No Calculator Rules like the Summative Assessment A test may be taken multiple times, but customers have to

set-up new test sessions, print authorization tickets, etc.

Base Offer – Classroom


Reporting Immediate Results Accessed via the ACT Aspire Portal Online Access only All HTML – No PDFs to Print Avocet – (P) Periodic – Report Packages, Accessing Your

Reports TMS – Periodic Track - Accessing Interim Reports Module

Periodic Advantages

• iPads (app)

• Chromebooks (app)

• Local control – choice of test dates

• Content Analysis

• Item Summary

• Alignment with Summative Reporting Categories

• Starting in 2015-2016 school year Interim will link with Summative – Allowing more predictability

• Timely reporting – Immediate Instructional Adjustment


Availability of Periodic Assessments

Currently available: • Interim Assessments (Interim I and Interim II) • Interim Reports

– Subject Proficiency report – Student Performance report – Response Analysis report – Content Analysis report

• Classroom Assessments (Classroom 1 and 2) • Classroom Reports

– Assessment Results report – Student Performance report – Response Analysis report – Content Analysis report


Availability of Periodic Assessments

Available by end of 2014-15 academic year: • Interim Assessments (Interim III) • Classroom Assessments (Classroom 3 – 5)


Information sent via email on January 30th

Periodic Release

Schedule


ACT Aspire Portal Overview

Summative and Periodic

Dashboard

(Summative CBT/PBT and Periodic)

Dashboard – Assessment Types

• Navigate between Summative, Interim, or Classroom with the navigation bar or by Dashboard tabs


Dashboard – Organizations

• Some tasks will require you to select a specific organization • Clicking Switch Organization allows you to change

organizations, as needed


Dashboard Lights

• Dashboard lights provide an at-a-glance view of test session attributes

• Lights will update as actions are performed


Managing Members


Organization Members

• Go to Organizations > Organization Members • Ability to invite new members (users), update

permissions on existing users, remove users, and more


Inviting Existing People In The Portal


Student Data:

Transfers within a Tenant


Transfers within a Tenant

• Access via the Student Menu

118

• Student’s new School initiates a transfer request

• Student Transfer Queue lists all requests coming and going from a school

• Student score will be reported out in the school they reside in at the time of reporting


Transfers within a Tenant cont’d...

• Access via the Student Menu


*In order to be transferred students must be removed or force closed from existing test sessions in the old school

• Required to fill in First Name, Last Name, School ID, DOB, other fields are optional

• If new school does not have student ID, contact with the old school is required before a transfer can be initiated



• Students must be either force closed within a test session (shown to the left) or removed from test sessions before a transfer can be approved by the Old School


Transfer Request History • Contains incoming requests and outgoing transfer

activity all in one location • 3 reminders will be sent; an escalation path is built

in



Old School Must Take Action • Transfer requests can be Approved or Rejected • Comments for a Student can be entered


What Does and Does Not Get Transferred?

• Student Data that does get transferred: – Student Profile data at the time of the request, including

current PNP selections – Completed Test Scores – Responses – Longitudinal Data

• Student Data that does not get

transferred: – Old PNP selections – Past Test Sessions


Who should own transfers?

• 3 email notifications will be sent to all Portal Admin user roles in a building

• Notifications sent from [email protected]

• 48 hours to take action in between notifications

• Escalation path to Tenant Owner


mailto:[email protected]�

Who should own transfers?

• Communicate and have a building plan! That’s a lot of emails floating around!

• Building Test Coordinators are the ONLY Portal Admin roles who should be managing transfers for a school.

• BTCs tell all other Admin Portal user roles that even though a Transfer Notification email will show up for them, they should ignore it.

• Use the transfer queue to help track test materials


Student Data:

Manually Adding & Updating Student Data


Manually Adding Student Data

• Select Students > Add Student to manually add an individual student


Finding a Student

• Go to Students > Find Students


Finding a Student, cont.

Enter search criteria, then click Search


Finding a Student, cont.

• Click on the Student ID to go to the Student Profile screen


Manually Updating Student Basic Information

• Click Edit to update Basic Information, then Save


Manually Updating Other Student Details


Deleting a Student Profile


Note: Students cannot be deleted when in a test session

Student Data:

Manually Updating the Personal Needs Profile (PNP)


Personal Needs Profile Overview

136

The Personal Needs Profile (PNP) defines a student’s specific test supports for testing. Keep in mind:

– PNP supports apply to all subjects

– Some PNP supports cannot be edited if the student is in a test session

– Orders must be placed prior to the testing window for necessary paper-based materials

– Students with PNP supports do not always require a separate test session

– Individual settings are recommended for some PNP supports

– One manual contains Summative and Periodic information


Editing a Student’s PNP


Editing a Student’s PNP, continued

138

Alerts you if a student is in a test session

Adding a form-specific support gives an error


PNP and Periodic Assessments

• Interim offers a Braille companion book for the Online Text-to-Speech Form

• 2 steps to the ordering process

• Student Responds via CBT

• No return shipment required

• Don’t forget to check out the Accessibility User’s Guide to review Periodic selection options


Periodic Braille Ordering

Step 1: Select Text-to-Speech English Audio + Orienting Description and then place them in a CBT test session.


Periodic Braille Ordering

Step 2: Order braille via Customer Service (Help is located on page 32 of Accessibility Users Guide)


Test Sessions


Test Session Overview

Students must be placed into test sessions for both computer and paper-based testing. By creating test sessions:

– Students receive the correct form type dictated by their PNP

– Students are able to log into TestNav

– ACT Aspire can assess and deliver the appropriate number and type of paper materials for your students

– ACT Aspire is able to generate and pre-print the student’s answer document


Test Session Workflow

144

Set up test sessions for the applicable Product and mode

Add students to test sessions

Add authorized users, as needed

Print Paper rosters for each test session; handle materials securely. For CBT, print student authorization tickets.

On the day of testing, start sessions; sessions must be started individually

During testing, Room Supervisors monitor the room and note any irregularities

After all students have completed testing, enter irregularities, if necessary, and then close test sessions


Test Sessions:

Creating and Using Groups


Groups Overview

Groups are easily accessible lists of students.

Groups: – are separate from test

sessions;

– can be used to add students to test sessions, once created;

– allow you to easily identify sub-sets of students.


Steps to Create Groups

1. Log into the ACT Aspire Portal 2. Choose the school at which the students you wish

to group are located 3. Go to Students > Create Group on the navigation

bar 4. Enter the required information and click Save 5. From the group dashboard, click Add/Remove

Students, check the box next to the student(s) that you would like to add to the group and then click Save


Creating Groups


View Avocet

• Go to Students and select Create Group • Provide details and Save • Click Add/Remove Students to manage

students in group; then Save

http://actaspire.avocet.pearson.com/actaspire/home�

http://actaspire.avocet.pearson.com/actaspire/home�

Finding Groups

149

• Select Students > Find Groups to help you quickly locate students by sub-sets


Selecting a Group

150

• Select the name of the group you want to view


Using and Updating Groups

151

• Select Add/Remove Students to manage students • Click on a Student ID to view the student’s profile


Test Sessions:

Creating Test Sessions


Creating New Test Sessions

• Select the appropriate tab or the menu drop down for

the product you are setting up


Creating New Test Sessions

• After selecting your school, select the appropriate tab and click New Test Session, or select Create a Test Session from the Summative Tests menu


Session Details – Selecting a Test Summative

Click the list icon to

access the Select a Test

window

Choose Online or Paper for Mode, as applicable


Session Details – Selecting a Test Periodic

Click the list icon to

access the Select a Test

window

Choose Online for

Mode


Session Details – Testing Schedule

Determine your testing window,

and set start and end dates,

times, and active days of

testing

Note: Allow enough time to

start test sessions in the morning before testing begins


Session Details – Title and Instructions

158

Define a title and any special

instructions for the session.

Note: For paper-

based test sessions, only

the first 6 characters

appear on the pre-ID.

Note: Test

booklets are not bundled by

session; answer documents are

bundled alphabetically by

test session.


Session Details – Proctor Caching

159

If default proctor cache settings

have been defined, verify

they are correct.

If no settings have been

entered, you may enable proctor

caching and enter details.

Proctor Cache Health Check

opens the Proctor Cache Diagnostics

screen for the specified machine.


Test Session Details

• Test Session Details allows you to monitor the test session and student progress, manage students in session, and authorize users and their access


Test Sessions:

Adding & Removing Students


Adding Students to Test Sessions

• Click Add to select students for the session


Adding Students to Test Sessions, cont.

• Able to use filters or search functions to find students • Select students to add, then click Done


Groups and Test Sessions

• Groups can help you manage adding students to test sessions

• From the Test Session Details, click Add and use the Groups Selector filter to select one or more groups


Removing Students from Test Sessions

• Test Session status must be either Ready or Scheduled • Check the box next to students to remove, and then click

Remove


Students and Paper-based Testing

166

• Students must be added to sessions by the administration deadline in order to receive pre-printed materials

• Students added late reflect “too late for processing” at the session level, and “Manual Grid” at the student level

• System ID number will need to be generated for gridding purposes


Test Sessions:

Adding & Removing Authorized Users


Test Session Details – Invite New Users

• Invite new Room Supervisors to the Portal


Test Session Details – Add/Edit Existing Users

• Add/Edit existing users to update access to the test session


Test Sessions:

Student Authorization Tickets

(Summative CBT and Periodic)

Student Authorization Ticket Overview

Student Authorization tickets: – Contain the URL and login

information for students to access TestNav

– Can be printed for an entire school, individual test sessions, or individual students

– Should be treated as secure material


Printing Authorization Tickets – School


• Go to the applicable Tests menu and select Test Session Print • Click Print and then Authorization Tickets • Print options manage how tickets print

Printing Authorization Tickets – Session


• From Test Session Details, click Authorization and then For All Students

• Print options manage how many tickets print per page

Printing Authorization Tickets – Student


• From Test Session Details, checkbox student name(s) • Click Authorization and then For Selected Students • Print options manage how many tickets print per page

Student Authorization Ticket Review

Test Name (subject)

Session Name

Student’s Name; now alpha by last name

Student specific User Name and Password

Note: Passwords will no longer contain I/1/O/0

Authorization tickets can only be used by the student listed

on the ticket; failure to do so will result in testing and

reporting irregularities


Test Sessions:

Other Printables


Comments

• Comments opens a CSV file with comments/irregularities


Roster

• Roster opens a CSV file with all students currently in session


PNP Roster

• Personal Needs opens a tab detailing all student PNP supports


Test Sessions:

Test Session Management


During Testing, Room Supervisors Should:

Count test materials before beginning

Be aware which students need accommodations

Ensure students do NOT have any mobile devices on their person

Ensure calculators are on the approved list

Once students are seated, distribute the answer documents and test booklets to each student, or student authorization tickets, as applicable

Read the appropriate Verbal Instructions from your manual, EXACTLY as stated

Ensure student have gridded in key information on their answer document

Move about the room observing students as they test & noting irregularities (e.g. student becomes ill)


Verbal Instructions – Differ by Product and Mode

• Instructions should be studied before the day of testing to ensure familiarity with the material

• Verbal instructions begin with “All Tests” section, then continue to the appropriate subject and grade level

• In some cases, multiple versions of the verbal instructions are provided to address different grade levels of students


Timing Tests


Use a stopwatch or interval timer to ensure the exact time is allowed for each test

You may post the Start and Stop Times / time allowed on the board

Students are allowed bathroom breaks Time away should be tracked; time should not be

subtracted from student’s testing time Breaks are not recorded on the Testing Irregularity Report

Announce when 5 minutes remain before the end of each test

Breaks


Individual students do not need to be accompanied

Multiple students must be supervised

Students must not be left alone in the testing room

Students are not allowed to use any device, including calculators, to share or exchange information at any time during the tests or during break

Students may not remove test materials, including test questions or answers, from the test room

Make-Up Testing

• Students who are absent, become ill, or who can no longer test due to other local interruptions or emergencies, are eligible for make-up testing

• Test security must be maintained; students may not return to questions previously answered

185

• Make-up testing may be completed any time within the designated testing window; check local testing policies

Note: The designated window must be within the Saipan Summative 2015 Spring testing window (May 18 – May 29)


Starting Test Sessions


• From Test Session Details, click the test status button and choose Start Test

• Click OK on the confirmation and Auto Refresh notification; session status will update to In Progress

Viewing Student Status - CBT


• View student test status and number of questions student has answered on the Test Session Details screen

• Sections update as student progresses through the test

Reporting Irregularities Overview


Irregularity flow: – Document any

circumstances that affect student scores

– Documentation must be completed by school personnel

– Should first be recorded by Room Supervisors

– Test Coordinators should be notified after the irregularity is recorded

Irregularities


Student Irregularities


• Comments icon will allow you to enter an irregularity reason and comment

• Click Save to complete entry

Test Session Irregularities


• From Test Session Details, click the Comment button and select Add Comment; enter a reason and comment, then click Save

Closing Test Sessions


• From Test Session Details, click the test status button and choose Close Test

• Warning will ask if you are sure; click OK to continue • Once a session is closed, you can no longer enter irregularity

information for a student

Technology Readiness

Computer-based Testing

• Computer-based Testing (CBT) – Uses traditional testing devices – Chromebooks (Summative and Periodic testing) – iPad (Periodic testing only)

• Components of CBT – ProctorCache – SystemCheck – TestNav 8 – The ACT Aspire Portal


CBT Resources

ACT Aspire Landing Page


• http://ACTAspire.Pearson.com

• Easily locate news, resources, and training


Avocet

• New Categories – Role Based – Assessment Based – Work Instructions – Most Popular


Technology

Coordinator

Checklist

Avocet • Located under “C” for

Checklist ACT Aspire Landing Page • Located on the

Technology Set-up page


Training Management System

• Repository for training modules - enables convenient self paced training

• Transcript feature shows date/time training was taken

• Requires email to log in and can be accessed on your smartphone or device


Handy Technical Resources

• ACT Aspire Landing Page – Technology Set-up page

• System Requirements: TestNav & ProctorCache – A list of minimum system requirements

• Technology Coordinator Checklist – A list of technology activities

• Testnav 8 Error Codes – List of error codes and troubleshooting / resolution steps

• ProctorCache Quick Guide – Steps for configuring ProctorCache – Step by Step on last two pages

Each of These Resources Found on Avocet and Landing Page – http://ACTAspire.Avocet.Pearson.com – http://ACTAspire.Pearson.com


http://actaspire.avocet.pearson.com/�


System Requirements

System Requirements – General Requirements


System Requirements

• Available for 3 Systems:

– ACT Aspire Portal

– TestNav 8

– ProctorCache

• Locations

– ACT Aspire Landing Page: Technology Set-up section

– Avocet: See each individual component section

• Online resources always up to date


Computer-based Testing Components

Computer-based Testing Components

• ProctorCache – Works with TestNav 8 to reduce bandwidth requirements

• SystemCheck for TestNav 8 – Web-based tool for assessing

readiness

• TestNav 8 – Test delivery engine – TestNav 8 Early Warning

System

• The ACT Aspire Portal – Assessment administration

portal – Manage student data, test sessions, Personal Needs Profiles,

access reports


Environment Configuration


• Identify Testing Devices and Rooms – Which computers and labs will you use? – Do you need to gather any extra peripherals?

• Mice / keyboards / power strips

– Set up temporary testing labs • Whitelist URLs and Open Ports

– Configure your firewalls, security devices, and content filters to allow traffic flow to the URLs and ports listed on the system requirements

• Determine and Account For Unique Considerations – Does your infrastructure have any unique needs or

considerations? • Do you use upstream proxies? • Specific devices that should not be used for testing? • Bandwidth shaping or throttling?



• Wired or Wireless – Use best practices for either type of connectivity. – Know the capacity of your access points and take care not

to exceed the maximum connections • Background Applications and Notifications

– Pop-ups will pull students out of the test – Effort must be made to suppress, disable, or reschedule any

application or notification from launching in the background • Screensavers • Antivirus scan reports • Power, email, message, or update notifications • Reschedule applications that automatically run

• Install and Verify ProctorCache – New installers added to documentation and Landing Page


SystemCheck for TestNav 8

SystemCheck

• http://SystemCheck.ACTAspire.org


http://systemcheck.actaspire.org/�

SystemCheck – Check Your System

Check Your System:

• Validates system requirements are met on testing workstations

• Provides steps to verify whether TestNav can run on the workstation


SystemCheck – Verification


SystemCheck – Testing Capacity

Testing Capacity: • Bandwidth testing for internet and proctor caching connections • Volume estimates for capacity planning • Click Add Caching Computer to add your potential proctor caching

machine for a local network bandwidth test


SystemCheck – Testing Capacity

• Tests bandwidth between the workstation and Pearson servers

• Click Add Caching Computer to add your potential proctor caching machine for a local network bandwidth test


ProctorCache

ProctorCache

ProctorCache is Pearson-supplied software that is used in conjunction with TestNav to reduce bandwidth requirements and accelerate the delivery of test content.

Proctor caching: • allows you to pre-cache test

content to your local network before a test;


• reduces the burden on your internet service provider (ISP) by eliminating redundancy in requests for test content; and

• stores an encrypted local copy of all pre-cached tests.

ProctorCache

• Reduces Bandwidth – Accelerates Content Delivery

• Minimal Installation, Configuration

• Flexible Requirements

– Does not require server class operating system

– Runs on Mac OS X and Windows Operating Systems

• Verify Connectivity

– Use SystemCheck to verify connectivity and throughput between testing workstations and ProctorCache machine

• ProctorCache Diagnostics Page

– View status of cached content and connecting clients

– Refresh, reload, or purge content


ProctorCache


ProctorCache – System Requirements

• Runs on Windows and Mac OS X

• Utilizes TCP Ports 80, 443, 4480, and 4481

• Proctor caching requires a fixed internal IP address


ProctorCache - Setup

1. Download installer

– Installers can be found on ProctorCache documentation or the ACT Aspire Landing Page

2. Run installer and start service

– Service is normally started by default

– Shortcuts exist to start or stop the service, if necessary

3. Verify service is running

– Open ProctorCache Diagnostics screen

4. Verify connectivity with SystemCheck

– Add caching computer on the Testing Capacity tab

– Run test to verify connectivity and throughout


ProctorCache – Diagnostics Screen

• Select the Tests tab for information about test content and caching status

• Select the Clients tab to monitor client connectivity


ProctorCache – Diagnostics Screen – Tests

• Content is displayed at the Test and Form level.

• Functionality is available to refresh, reload, or purge selected test content.

• Clicking on a test name will display the Content Details screen which displays individual items in a test.


ProctorCache – Diagnostics Screen – Clients

• Clients that have connected to TestNav are listed by IP address.

• Clicking on a computer will display the Client Details screen which displays information regarding a particular computer connecting to proctor caching


ProctorCache - The ACT Aspire Portal

• Manage proctor cache in the ACT Portal • TestNav will detect and use proctor cache settings entered into

the Portal • No need to configure individual student work stations for

proctor caching • Set default proctor cache settings for district and schools • Default settings can be applied to test sessions



• Go to Organizations > Proctor Cache Settings • Default proctor cache settings will be set for each school

• Once saved, settings can be applied to any test sessions at that school

• Default settings must be entered before tests can be pre-cached



• Enter fixed internal IP address for the proctor cache machine

• Enter port 4480 • Check Status allows you to quickly navigate to the

Proctor Caching Diagnostics page Saipan Test Coordinator Training 234


• Pre-caching test content gathers all of the test content that students will need

• Test content is encrypted and stored locally




• Pre-caching test content gathers all of the test content that students will need

• Test content is encrypted and stored locally


• Verify that content has been cached successfully from the Proctor Caching Diagnostics screen – Content will be listed on the Tests tab – Each subject that you selected should appear here – Verify that there is a green ‘OK’ indicator in the Status

column for each test form



• After they have been saved, default settings can be applied to test sessions at the organization selected.


TestNav 8

TestNav 8


TestNav 8 – System Requirements

• Mac OS X and Windows Supported – Mac OS X 10.6 through 10.10 – Windows XP (sp3) through Windows 8.1

• All Major Browsers Supported – Chrome, Internet Explorer, Firefox, Safari – Version number is dependent on operating system

• Dependencies – Java (version dependent on OS and browser) – Pop-ups enabled for ACT Aspire sites – Requires read/write file access to local home directory – Disable Skype plugin in Windows 7 and Firefox – Minimum screen resolution of 1024 x 768


TestNav 8 – Setup

• No Installation – Completely browser based – No individual system configuration

• Network Configuration – Firewalls, content filters, spam filters, and any other routing

or blocking systems should be set to allow access to the following:

• *.tn.actaspire.org: 80 • *.tn.actaspire.org: 443 • *.pearsontestcontent.com • S3.amazonaws.com


TestNav 8 - Usage

• Students Visit TestNav 8 URL – http://tn.actaspire.org

• Use Authorization Ticket to Log In – Printed from ACT Aspire Portal – Contains unique session specific login information


http://tn.actaspire.org/�

TestNav 8 Early Warning System (EWS)

TestNav 8 EWS – Early Warning System

• Early Warning System – Designed to alert users of issues that arise during testing

– Part of TestNav 8 • No additional software to install or configure

– Provides fail-safes to preserve student responses in the event of unexpected network disruptions

• Early Warning Training Module – “TestNav 8.0 Overview” training module on the TMS

contains info around Early Warning System

• Early Warning System Resources – Avocet ‘Early Warning and System Error Codes”

– ACT Aspire Landing Page – TestNav 8 Resources


TestNav 8 EWS – Student Response File

• Student Response File (SRF)

– EWS Writes to Student Response File in the background

– Captures student responses locally

• Periodically Transmitted

– Responses bundled into packets and transmitted to Pearson servers

• Verification

– TestNav 8 will wait for handshake acknowledgement

– If handshake is not received, multiple attempts are made

– If transmission is successful process begins with new SRF


TestNav 8 EWS – Scenarios

Scenario 1: Response File Location Unreachable TestNav is unable to read or write to the SRF location

– Results in an immediate Test Proctor Click Here notification.

Scenario 2: Test Content TestNav is unable to download portions of the test.

– Results in an immediate Test Proctor Click Here notification.

Scenario 3: Student Response Upload Repeated attempts to upload the SRF have failed.

– Results in a Test Proctor Click Here notification only if the student attempts to Exit or Submit the test.


TestNav 8 – Early Warning System

• Prompt Displayed to the Screen

• Students Should Alert Proctor

• Note : Technology Coordinators or local staff may be the first contact if these messages appear

• Interruptions Stop Timer – Timer will be resumed when the student logs back in.


Best Practice

Best Practice

• Planning – Make use of the Technology Coordinator Checklist

– Create communication and contingency plans

– Keep Test Coordinators informed

• Preparing your environment – Do you have additional security devices to account for?

– Have you suppressed system tray notifications?

– Desktop restoration – thaw / exclude Pearson folder

– Have some extra mice / keyboards available


Best Practice

• ProctorCache – Consider setting up a few ProctorCache machines and test

connectivity for each

– Use a wired connection

– Do not proctor cache to a workstation that will be used for testing

• Wireless Testing – Prevent aggressive roaming of devices

– Turn off automatic channel switching

– Are your WAP’s secure – prevent non-testing devices from connecting

– Consider range and location

– Be aware of WAP capacity • Overloading / ‘popcorn effect’ / degraded performance


Best Practice

• Bandwidth – Contact your ISP to let them know when you are testing

– Do you need to set ‘testing’ rules on your network? • Bandwidth throttling

• Reschedule bandwidth heavy activities

• Block bandwidth intense sites

• Partner With an Experienced Neighbor – Share best practices and tips


Support

Support Contacts

Fasefulu Raymond Tigilau Office of Accountability, Research, & Evaluation PSS Assessment Coordinator • Phone: 670-237-3199 (Central Office) • Phone: 670-237-3024 (Assessment Center) • Email: [email protected] • Fax: 670-664-3796


Support Contacts

Joe Torres Office of Accountability, Research, & Evaluation Technology Coordinator • Phone: 670-237-3056 (Office) • Email: [email protected]


mailto:[email protected]�

Questions?