PASA-Science Administration Manual - PASA Digital Booklet for the non-digital and partially-digital administration formats, and on the screen of an electronic device for the fully-digital

PASA-Science Administration Manual

PASA-SCIENCE ADMINISTRATION MANUAL

University of Pittsburgh PASA-Science Project Team [email protected]


i

Important Dates

Activity Date Enrollment January 9 – February 3, 2017 Test Administrator Training February 27 – March 24 2017 Test Materials shipped to assessment coordinators March 24, 2017 Test Administration Window April 10 – May 5, 2017 Response Validation Conference May 19 – May 21, 2017 Score Reports Mailed August 15, 2017

Enrollment Enrollment for the 2016-2017 PASA-Science will begin Monday, January 9, 2016 and continue through Friday, February 3, 2017. Once again, enrollment data will ‘rollover’ from the PASA-ELA/Math website and verification will be completed through the PASA-Science website (https://sci.pasadigital.com/). Test Levels Like last year, the PASA-Science assessment will have only two levels of cognitive difficulty; Tier 1 and Tier 2. Students will be placed into one of the two Tiers based on their PASA Reading and Math designations. Brief descriptions of the tasks associated with the different Tiers are listed below. Further explanations and sample items are available under the “Materials” tab on the PASA-Science website. As in past years, requests for Tier changes will be considered on a case-by-case basis. Test Administrator Training Again this year all test administrators and assessment coordinators will be required to undergo separate training for the PASA-Science prior to the opening of the testing window in April. While training modules cover the same content as last year (accessing the assessment(s), recording student responses, camera positioning, test administration, and test security procedures), they have been revised to include new features added this year. This year test administrators and assessment coordinators will be required to complete the trainings in order to access their students’ assessments. Test Security All test administrators and coordinators will be required to sign an electronic document certifying they will adhere to test security procedures. A separate test security sign off is required for PASA-Science.

https://sci.pasadigital.com/


ii

Procedures for Accessing the Assessment(s) and Recording Student Responses The PASA-Science assessment for 2016-2017 will again be administered through the PASA-Science website. Once an assessor has logged in, they will access the test(s) for their student(s) by clicking on the individual student’s name or downloading a copy under the “Tests” tab. Students may view their answer choices on a second electronic device or in a hard copy picture book. Score Submission In order for each student’s score to be recorded on a score report, the test administrator must carry out the following steps:

1. Ensure each student is enrolled in the PASA-Science using the digital site (https://sci.pasadigital.com)

2. Enter each student’s responses to each item into the digital site, AND 3. Upload the video recording of each student’s assessment to the digital site or mail the

recording to PASA-Science. 4. Confirm that each student’s responses have been entered and the video of the student’s

administration has been uploaded or mailed. Failure to complete these steps for any student will result in that student being marked as NOT ASSESSED for 2016-2017. Test Format Each test consists of 35 three-option multiple choice items. PASA-Science items again will feature an initial item prompt, three answer choices and a scripted ‘extra’ prompt to administer to students if they do not answer correctly after the initial item prompt. Test administrators must follow the item scripts for all items exactly as they are written, with no adjustments or additions being made to the item scripts. An ‘opt-out’ option is still available for students for whom testing is terminated. Again this year, test administrators will be required to select a reason for terminating the test. Also, a practice opportunity will be available so that assessors can familiarize themselves with the item format and the computer delivery system. All test administrators must enter all students’ responses into the PASA-Science digital site without exception. Assessors, however, have different options for test administration and submission of videos of student assessment. Test Administration There are three possibilities for test administration:


iii

For the non-digital test administration option, test administrators need an electronic device for entry of student scores, a printed Student Materials Booklet provided in the Test Administration Kit, and a copy of the Assessor Materials Booklet (test items) printed from the website. For the partially-digital test administration option, test administrators need an electronic device for entry of student scores and to view the assessor materials as well as the printed Student Materials Booklet provided in the Test Administration Kit mailed to your Assessment Coordinator.

For the fully-digital test administration option, test administrators need two electronic devices simultaneously, one for entry of student scores and to view the assessor materials, and one for the student to view the assessment items. Submission of Videos Districts are classified as either digital districts or non-digital districts. The choice to be a digital or non-digital district was made by the district assessment coordinator. The designation of digital or non-digital refers to the way in which videotaped assessments are submitted to PASA-Science. Assessors who are in a Non-Digital district/IU/Charter School must submit their videotaped assessments by mail. Assessors who are in a digital district can choose Electronic Upload after Testing or Streaming Upload during Testing. Please review these sections of the administration manual for details.


iv

Table of Contents Important Dates ........................................................................................................................... i Project Staff ............................................................................................................................... vi Introduction ................................................................................................................................ 1

Purpose .................................................................................................................................. 1 Overview ................................................................................................................................ 1 Test Administration Window ................................................................................................... 3 Content ................................................................................................................................... 3 Task Development.................................................................................................................. 3 Test Levels ............................................................................................................................. 4

Tier 1 .................................................................................................................................. 4 Tier 2 .................................................................................................................................. 4

Guidelines for Participation ........................................................................................................ 6 Exemptions from Testing ........................................................................................................... 7

Religious Exemption ............................................................................................................... 7 Taking the PSSA .................................................................................................................... 7

Test Security .............................................................................................................................. 9 Preparing to Administer the Assessment...................................................................................11

Enrollment .............................................................................................................................11 Adding or Assigning Assessors ..........................................................................................11

Training .................................................................................................................................12 Determine Student Accommodations ....................................................................................13 Prepare Test Materials ..........................................................................................................13 Practice the Test ...................................................................................................................13

Test Materials Description .........................................................................................................14 Test Materials Kit ...................................................................................................................14 Returning Materials ...............................................................................................................14

Assessment Design ..................................................................................................................15 Overview of Test and Item Format .........................................................................................15 Student Response Modes .....................................................................................................15

Test Administration Procedures ................................................................................................17 Test Administration Options ...................................................................................................17

Fully-Digital Test Administration Option .............................................................................17 Partially-Digital Test Administration Option ........................................................................19 Non-Digital Test Administration Option ..............................................................................20

Estimation of Student Performance Level ..............................................................................22 Video Submission Options .....................................................................................................23

Digital District Options ........................................................................................................23 Non-Digital District Options ................................................................................................24 Narrative Notes ..................................................................................................................24

Administration Tips and Guidelines .......................................................................................25 Discontinuing the Test ...........................................................................................................27 Non-Assessed Students ........................................................................................................27


v

Administration Instructions for Special Circumstances ...........................................................28 Tactual Test (Blind and Low Vision) ...................................................................................29 Deaf and Hard-of-Hearing Test ..........................................................................................30 Students who are Multiple Handicapped, Physically Challenged, and/or Non-Verbal .........31

Scoring Tests ............................................................................................................................32 Score Reporting ........................................................................................................................32 Appendix A ...............................................................................................................................33 Appendix B ...............................................................................................................................35


vi

Project Staff Dr. Steven R. Lyon, Director Dr. Debra W. Moore, Associate Director Dr. Pete Heh Dr. Mary Hansen Ms. Sue Graham


PASA-Science Project - 1

Introduction The Pennsylvania Alternate System of Assessment (PASA) is a statewide alternate assessment designed for students with the most significant cognitive disabilities. It is administered on a one-to-one basis to students who are unable to participate in the Pennsylvania System of School Assessment (PSSA) as determined by their Individualized Education Plan (IEP). Administration of the PASA achieves compliance with several federal laws and Pennsylvania School Code. The PASA-Science is part of the PASA and is designed to assess science content knowledge. Purpose Administration of the PASA-Science serves 3 main purposes, to:

1. measure the degree to which students attain the knowledge and skills described in the statewide alternate eligible content, which is linked to the Pennsylvania Academic Standards for Science

2. provide information regarding district and school accountability; and 3. improve curricular and instructional practice for students with significant cognitive

disabilities and increase student learning.

Overview The PASA-Science is an individually administered 3-option multiple choice test given to students in grades 4, 8, and 11. Each test consists of 35 items which are designed to cover the Alternate Eligible Content in Science. Each PASA-Science item consists of 1) a context, 2) an item prompt, 3) an extra prompt, and 4) 3 answer choices and is standardized through the use of a script. Students with significant cognitive disabilities are a diverse population with a range in level of communication, level of independence, and ability to function at an abstract level. Many researchers believe that this diversity requires more than one level of test to fairly accommodate the wide range of abilities. For this reason, two tests are constructed per grade level; a Tier 1 test and a Tier 2 test. There are three options for administering the PASA-Science: fully digital, partially digital and non-digital. For all administration formats,

• The test administrator is responsible for administering each fully scripted items, exactly according to the item script, to examinees.

• The test administrator is responsible for entering each examinee’s response to each item electronically within the PASA digital site. The process for data entry for the fully digital and partially digital administration options differs slightly from the process for data entry to the non-digital administration option. However, for all test administrations, the test



administrator is responsible for entering each examinee’s response to each item electronically within the PASA digital site.

• Students do NOT interact directly with any device to respond to items using any of the test administration formats.

For the partially-digital and non-digital formats, the test administrator will utilize the printed Student Materials Booklet that accompanies the Test Materials that were sent to the Assessment Coordinator. For the fully digital format, student materials will be presented to the student on a second electronic device. Both the paper and digital formats of the Student Materials Booklet present the same 2-dimensional images. That is, the same graphics are displayed to students in print in the Student Materials Booklet for the non-digital and partially-digital administration formats, and on the screen of an electronic device for the fully-digital administration format. For the non-digital administration, assessors need an electronic device (i.e., computer, laptop) to designate as the ‘Assessor Device,’ for data entry of student responses, a printed copy of the Student Materials Booklet sent to the Assessment Coordinator in the Test Administration Kit, and a copy of the Assessor Materials Booklet (test items) printed from the website. For the partially-digital administration, test administers will need an electronic device (i.e., computer, laptop) to designate as the ‘Assessor Device’ to access the test items and for data entry of student responses as well as the printed copy of the Student Materials Booklet sent to the Assessment Coordinator in the test Administration Kit. For the fully-digital administration, test administrators will need two electronic devices simultaneously, an electronic device (i.e., computer, laptop) to designate as the ‘Assessor Device,’ to access the test items and for data entry of student responses, and an additional electronic device (e.g., iPad, computer, laptop, white board) on which student materials will be displayed. Student performance MUST be video-taped and submitted, online or by mail. Districts are The test administrator is responsible for uploading a video recording of each assessment into the digital site or mailing a media recording of the assessment to PASA-Science. Whether you upload or mail assessment recordings to PASA-Science depends on whether your district is designated as a “Digital Districts” or a “Non-Digital Districts”. Digital districts ae required to upload their videos directly to the PASA digital website while non-digital districts are allowed to mail a media recording of the assessment to PASA-Science. Videos from each assessor are randomly chosen and ‘validated’ to monitor compliance with administration protocols.



Please note that the PA Bureau of Special Education has requested that all districts upload assessment videos directly to the PASA digital website for the 2017-2018 school year.

Test Administration Window The test administration window for the PASA-Science opens Monday, April 10, 2017 and closes Friday, May 5, 2017. All non-digital media must be received by Friday, May 12, 2017. Due to a change in reporting deadlines, no extensions can be granted. The PASA-Science assessment may be given in more than one sitting. If a student is becoming unduly fatigued during the assessment, it is permissible to stop testing and continue testing again at another time. In some cases, small numbers of items completed every day across several days may be in the best interest of the student. For such cases, be sure to record and upload the full test administration.

Content The PASA-Science is aligned to the appropriate grade level academic content standards through the Alternate Eligible Content in science. The Alternate Eligible Content in science represent a reduction in breadth, depth, and/or level of complexity of the associated grade level standards. The link to Alternate Eligible Content supports increased access to the general education curriculum at an entry point appropriate for this student population. The Alternate Eligible Content was developed by a team of university faculty, special education teachers, science teachers, science content experts, and experts in the field of special education. Alternate Eligible Content were designed to specify essential learning outcomes in science and conceive a population-appropriate learning progression across grade levels. The Alternate Eligible Content for science can be found on the PASA-Science website. A separate document entitled Understanding the Alternate Eligible Content is available which outlines the Alternate Eligible Content and the overall sequence of the framework. Both files can be found on the PASA-Science website under the link for Administrators’ (https://sci.pasadigital.com/For_Administrators) Task Development Tasks are developed by special education and science experts across the state who are familiar with instructional practices for this special population of students and/or science content. In addition to internal review and revision by content and measurement experts, new items are reviewed by a series of outside special education, science content, and measurement experts and field tested prior to being placed on the test.



Test Levels Tier 1 Tier 1 tasks are predominately basic recall and application tasks, whether targeting concrete or abstract concepts, and require a limited degree of discrimination. Stimuli for item contexts and answer choices for these items tend to be simple and present only one picture for each. At this level, abstract refers mostly to the association of simple, basic scientific terminology with iconic exemplars that students are most likely to encounter in their everyday life or during classroom instruction. Items also are almost exclusively 1-step problems. Some basic application tasks targeting a concrete concept can be Tier 1 tasks as long as the distractors are unrelated to the correct answer (i.e., low degree of discrimination). Additionally, it is expected that a proportion of the students will rely on the assistance of the extra prompt to answer the items correctly (i.e., modifications to the task will be needed). The scripted extra prompts for this level provide assistance by:

• giving definitions of basic scientific vocabulary in basic everyday language, • giving concrete examples for abstract ideas and concepts, • restating the question differently, • drawing attention to the important idea needed to answer the question.

Tier 2 Tier 2 tasks are predominately application and strategic thinking problems. The tasks also require a higher level of discrimination in that stimuli for item contexts and answer choices can be complex pictures of places and groups of objects. Demonstrated understanding of more sophisticated scientific vocabulary is expected and most tasks will involve some 2-step processes. Tasks involving the application of concrete concepts should require a complex degree of discrimination and involve more than 1-step in order to be considered a Tier 2 item.

Students at this level are expected to be more independent although because items feature more complex cognitive processes, extra prompts are still provided. The scripted extra prompts for this level give assistance by providing:

• a single or combination of ‘hints’ such as those given at Tier 1; giving definitions of basic scientific vocabulary in basic everyday language, giving concrete examples for abstract ideas and concepts, restating the question differently, drawing attention to the important idea needed to answer the question;

• a procedure to solve the problem; • the solution to step 1 of a multistep problem.



Table 1. Summary of Tier 1 and Tier 2 tasks Tier 1 Tier 2 Tasks are fully scripted and should be administered by reading the script exactly as it is shown. Tasks are predominately basic recall tasks targeting both concrete and abstract concepts. However, basic application tasks are appropriate.

Tasks require a low level of discrimination in that pictures used for the items and answer choices tend to be simple and present only one or two objects for each choice.

At this level, abstract refers mostly to the association of simple, basic scientific terminology with iconic exemplars that students are most likely to encounter in a science class.

Tasks mostly involve 1-step processes.

It is expected that a proportion of the students will rely on the assistance of the extra prompt to answer the items correctly.

Tasks are fully scripted and should be administered by reading the script exactly as it is shown. Tasks are predominately application and strategic thinking problems targeting both concrete and abstract concepts.

Tasks require a higher level of discrimination in that pictures used for items and answer choices can be complex pictures of places and groups of objects.

More sophisticated scientific vocabulary is appropriate. Many tasks will involve 2-step processes.

It is expected that these students will be more independent than Tier 1 students, although extra prompts are still provided.



Guidelines for Participation The alternate assessment is appropriate for students who have significant cognitive disabilities and who require intensive instruction and extensive support in order to perform and/or participate meaningfully and productively in the everyday activities of integrated school, home, community, and work environments. These students require substantial modifications of the general education curriculum as well as instruction in areas not presently assessed by the PSSA or Keystone exam. The decision about participation in the standard or the alternate statewide assessment is made by the IEP Team. The following questions should guide their decision-making. Figure 1. Eligibility for PASA participation questions 1. By September 1of the school year in which this IEP will be operative, will the

student be in grade 4, 8, or 11? YES

AND 2. Does the student have significant cognitive disabilities? YES

AND 3. Does the student require intensive instruction to learn? YES

AND 4. Does the student require extensive adaptation and support In order to perform

and/or participate meaningfully and productively in the everyday life activities of integrated school, home, community, and work environments?

YES

AND 5. Does the student require substantial modifications to the general education

curriculum? YES

AND 6. Does the student's participation in the general education curriculum differ

substantially in form and/or substance from that of most other students (i.e., different objectives, materials, or activities)?

YES

If the answer was "Yes" to all of these questions, it would be appropriate for the IEP team to consider assigning the student to the Pennsylvania Alternate System of Assessment (PASA). If the answer was "No" to any of the above questions, the PASA-Science is not the appropriate statewide assessment for the student.



Exemptions from Testing Religious Exemption Participation in the statewide assessment is a federal and state requirement for all students. The only legally accepted reason for a student to be excused from testing is that it conflicts with the parent/guardian(s) and/or student's religious beliefs [Pennsylvania Code Title 22 Chapter 4, section 4.4]. A religious exemption cannot be denied; however, it can only be granted if all of the following steps are completed.

1. The student must be enrolled for testing so there is an official record of eligibility for the PASA-Science and so that testing materials are sent for the parent/guardian(s) to review. The enrollment record is also needed so the district (assessor) can document officially that the student was not assessed due to religious beliefs. A religious exemption should not be granted until after the parent/guardian(s) has reviewed the test materials.

2. The parent/guardian(s) must schedule a time with the student’s assessor and the district’s assessment coordinator to review the assessment. The parent/guardian(s) must sign a confidentiality/non-disclosure form with the district to maintain test security [Pennsylvania Code Title 22 Chapter 4, section 4.4]. Test materials cannot be removed from school grounds.

3. If after reviewing the assessment the parent/guardian does not want their student to participate, they must write a letter to the district requesting a religious exemption. No specific religious beliefs or specifics about what conflicts with the beliefs of that religion should be listed. This would violate the non-disclosure agreement. The exemption is then granted and the district keeps the letter as documentation of the request.

4. At the end of the testing window, the student's assessor (or assessment coordinator) indicates in the student's PASA-Digital record that the student was not assessed and selects "religious exemption" as the reason. This information is reported to the state.

Districts need to be aware, however, that students with religious exemptions are still factored into accountability data and could negatively affect school performance profiles. Taking the PSSA In some cases, the student may be scheduled to take the PSSA. In these cases, the student should still be enrolled for the PASA-Science. Once the PASA-Science test window opens, update the student’s record in the “Was This Student Assessed? Window by selecting “NO” and then selecting “Took PSSA” from the dropdown menu (Figure 2).



Figure 2. Was this student assessed? window



Test Security Maintaining test security is an important responsibility for all assessment coordinators and assessors. Test security is important for several reasons. First and foremost, all students need to have the same testing experience. If students have different testing experiences, their scores could be impacted either negatively or positively and stakeholders will not be able to interpret test scores accurately. Also, some test items are used across years and test forms. This provides important longitudinal data for curriculum planning. Further, item development and item replacement is expensive, and breaches in test security require new sets of items to be developed. This process includes writing, reviewing, and piloting new items which requires many people and many months to complete. Finally, student data must remain secure and confidential. Maintaining test security refers to keeping test materials (including individual items) secure even AFTER the testing window is closed and test materials have been returned, inventorying materials before and after administration, keeping student data confidential, and adhering to test administration protocols. This is especially relevant to PASA assessments since, unlike general assessments, administration of the PASA-Science requires that you review the test items prior to administering them to your student(s), and can involve saving a video recording of the assessment to your computer. Although not an exhaustive list, some examples of test security violations are as follows:

• practicing test items with another person who does NOT have a signed test security certificate

• allowing an unauthorized person to deliver test materials or delivering test materials to an unauthorized person

• allowing students to practice test items prior to administration. • allowing an unauthorized person to access or view digital test materials prior to

administration. • coaching students inappropriately during the test • entering a response other than the student’s true response • leaving test materials in plain view when not in the room even if no one is in the room or

scheduled to be in the room • leaving items displayed on an electronic device when not in the room even if no one is in

the room or scheduled to be in the room • allowing students to see the correct answers on the screen before or while the student

completes the item • giving students additional information not included in the script • failure to return all test materials, including downloaded hard copies of teacher materials • editing the recording of an assessment before uploading • keeping a copy of the recording of the assessment • returning materials to an unauthorized person



• discussing specific items with another person whether authorized or not • using items as teaching materials • making an electronic/digital copy of any test items or test materials.

It is important to know that under Pennsylvania School Code, there are consequences for teachers if test security procedures are not followed. They include: verbal reprimand, written reprimand, suspension with or without pay, termination, revocation of teaching certification and/or criminal charges. Additionally, it is the responsibility of district personnel to report violations of test security procedures to the appropriate person in their building, district, or PA Department of Education. Failure to report violations of test security procedures can result in the same consequences as those imposed for violating the security procedures. A test security affidavit is included online as a banner at the top of the page upon sign-in to the PASA-science website and must be ‘signed’ before assessor test materials will be released.



Preparing to Administer the Assessment

Below are actions assessors should take to prepare for administration of the PASA-Science assessments. These actions are also included in Appendix A is a checklist. The first step in preparing to administer the test is to confirm that you have a PASA-Science account by logging in to the website and accessing your student roster. This account will be used to enroll students, complete test administration training, access test materials, upload videos and update your student records. If you do not have an account or cannot view your student roster, please contact your Assessment Coordinator. Enrollment For the 2016-17 administration, enrollment in PASA-Science is simply a verification that you are still providing educational services for the student(s) appearing on your roster. All PASA-Science student rosters are based on verified students who were enrolled through PASA-Reading & Math in the fall of 2016. Information about students (name, ID, grade, assessor, level of test, primary disability, etc.) enrolled in grades 4, 8, or 11 were automatically transferred to the PASA-Science roster upon enrollment in PASA-ELA/Math. Only assessors with assigned students in grades 4, 8, or 11 will have a student roster when the testing window opens. Currently, students taking the Level A PASA-Reading and PASA-Math test will be assigned to the Tier 1 PASA-Science test. All other students will be assigned to the Tier 2 PASA-Science test. All students must be assigned a Tier for enrollment to be verified. Assessors should NOT change the Tier level for any student unless given approval by PASA-Science. Tier changes should be requested via the online link located in the test information block of the student record. Tier changes are NOT automatically granted, but are considered on a case-by-case basis. Decisions regarding tier changes are based on the reason provided in the application, information provided in the student record related to performance, and prior performance on all tests. To be officially enrolled, the student record must be verified by the assessor and the assessment coordinator. When a student has been successfully enrolled, the date on which they were officially enrolled will appear in the ‘enrolled’ column. Adding or Assigning Assessors Assessment coordinators are responsible for assigning assessors for each student. Assessors are assigned through the student record using the following steps. Click on the student’s name and scroll down through the student record until you reach the field for the Assessor’s Name. From



the drop-down box, select the assessor’s name. If the assessor’s name does not appear in the drop-down box, assessment coordinators can create an assessor account under the “Admin” tab by selecting “Add Account”, completing all of the required information, and selecting the “Create New Account” button. If you are an assessor and a student does not appear on your assessor roster, please contact your assessment coordinator and have him or her assign the student to your roster. A training module on enrollment for the PASA-Science can be found online at https://sci.pasadigital.com under the “Training” link. This training module provides step-by-step instructions for enrolling students and screenshots of the digital system for clarification. Make sure all of your students are enrolled through the PASA-Science website by the deadline given in the update materials to ensure delivery of your test materials on time. Training To support assessors in transitioning across the administration changes for the redesigned PASA-Science assessment, training in how to administer the assessments is mandatory for all assessment coordinators and assessors again this year. Four training modules were created to cover the following topics:

1. Accessing Test Materials, 2. Administering the Test, 3. Entering Student Responses, 4. Camera Positioning and Uploading Video, and 5. Test Security.

These modules have been revised to address common administration errors encountered during last year’s administration and also include NEW features available for this year’s administration. Again, each training module is associated with a brief (4-5 question) ‘proficiency’ test which highlights critical aspects of the module for emphasis. Although a passing score is not required in order to administer the assessment, assessors and assessment coordinators are strongly encouraged to review information for items not answered correctly. Also, upon completion of the test security module, an affidavit must be electronically signed attesting to the assessors’ assurance to adhere to the test security guidelines. Training modules will be accessed through the PASA-Science digital site under the “Training” tab. Teachers will use the same email and password used to access their student rosters.

https://sci.pasadigital.com/



Assessor Test Booklets will not be released until the training modules have been completed and the test security affidavit is signed. Determine Student Accommodations Check the student’s IEP for eligibility and to ensure that any accommodation (e.g., assistive technology, enlarged print, etc.) are provided during administration of the test. The PASA-Science is designed to provide many accommodations to make the tests accessible in the tiered cognitive structure of the test, the multiple choice format for universal access, and presentation of item contexts and/or answer choices in picture format. Additional allowable adaptions and accommodations can be found in Administration Instructions for Special Circumstances. Prepare Test Materials When you receive your test materials from PASA-Science, verify that all the necessary materials were sent. If you are missing materials, please contact your Assessment Coordinator. Please retain any boxes, bags and labels sent with your materials. You will use these same containers to return your test materials after the testing window closes. Although procedures may vary depending on use of the digital versus non-digital test delivery system, you should review test security requirements and decide how and where to store your test materials until they are returned to PASA-Science. Again, although procedures may vary depending on use of the digital versus non-digital test delivery system, prepare and organize your test materials and adapt test materials to the specific needs of your student(s). Practice the Test Tests for which you have students enrolled will be available for online preview one week before the test windows open. When selecting a test for preview, be sure to select the PREVIEW option. Rehearse administering each item so that you are familiar with the prompts, answer choices and vocabulary needed to present each item. You should also become familiar with any setup, adaptations, and/or special instructions associated with each item.



Test Materials Description Test Materials Kit Included in the test materials sent to your Assessment Coordinator were:

1. A letter to assessors providing additional special instructions 2. Student Materials Booklet – a spiral bound easel book of images used to display

answer choices and any contextual information for each item the Tier 1 and Tier 2 tests for each grade level test you are administering

3. Assessor permission form 4. Parent/Guardian permission form 5. An Assessor Return Materials Checklist (Appendix B) 6. If a non-digital district, media bags and student labels 7. A UPS return shipping label

As last year, Assessor Booklets which include the test items will be accessed online for the 2016-17 administration of the PASA-Science. More information about accessing Assessor Booklets is available in the next section of the manual. If any of the above materials are missing, please contact your Assessment Coordinator immediately. Returning Materials After the assessment is complete, return the following materials to your Assessment Coordinator as soon as possible:

1. A completed Assessor Returned Materials Checklist (Appendix B) 2. Student Materials Booklet 3. Completed and signed Assessor permission form 4. Completed and signed Parent/Guardian permission forms 5. Media containing videotaped assessment (if applicable) or Narrative Notes (if approved) 6. ALL printed materials including tests printed for non-digital administration and enlarged

copies of images Note: When a copy of the test is printed, a record of that action is delivered to PASA-Science. This copy MUST be returned to PASA-Science at the end of testing.

7. Optional scoring sheets A return UPS shipping label is provided with your Test Administration Kit. Failure to return materials will be considered a violation of test security protocols.



Assessment Design

Overview of Test and Item Format The items are standardized through the scripting of each part of the item. Test assessors are given a script which specifies what to say to:

1. present the item context, 2. ask the question, 3. present the answer choices and 4. present one additional prompt that provides assistance in answering the item.

The items should be administered exactly as they are scripted. No additional teacher prompts besides those scripted as part of the items should be administered. The theoretical and conceptual foundation for the structure of the items and the sequence of item administration are based on two evidence-based paradigms widely used in the education of students with significant cognitive disabilities: applied behavioral analysis and direct instruction. Applied behavioral analysis is based on the work of B.F. Skinner and the operant learning paradigm. In the field of special education, this has been translated into a system of least prompts in which students receive a set of gradually increasing prompts until they are able to perform the targeted response. It is this system of least prompts that guided the development of the underlying structure of the items. In tandem, direct instruction is instruction that is explicit, scripted and teacher-led. It is the scripted sequence of prompts, student responses, and teacher feedback found in direct instruction that provides further support for the item structure and administration procedure.

Item stimuli and answer choices are presented in picture format. In some cases, answer choices may be accessible words. The test is available in both digital and paper format, and both formats present the same 2-dimensional images. In other words, the same graphics are displayed on a computer screen or in print in a test booklet, and the student chooses their answer from the available pictures. Students do NOT interact with the computer to respond to items.

Student Response Modes Students with the most severe cognitive disabilities do not necessarily communicate in traditional ways. On the PASA-Science assessment, students are allowed to indicate their answer choice in different ways, including but not limited to:

• saying/signing the letter associated with their choice, • saying/signing a word or words associated with their choice, • pointing to their answer choice,



• touching the picture of their answer choice, • gazing at their answer choice, • nodding their head or gesturing in some other way at their answer choice, • using assistive technology, or • using a combination of these.

The response mode selected for the test administration should be the same as that used during daily instruction.

Hand-over-hand guidance should NOT be used on the PASA-Science. Students who do not respond independently using one of the response modes listed should receive an entry of “No Response” for the item.



Test Administration Procedures There are three options for administering the PASA-Science: fully-digital, partially-digital and non-digital. In all cases, a student is not considered assessed unless:

1. student responses to each item have been entered into the digital site AND 2. a video recording of the assessment was uploaded to the digital site or sent to PASA-

Science. It is highly recommended that you read directions for all administration options including submission of video recording well before the test administration window opens so you can plan for the test administration and video submission options of your choice.

Test Administration Options Fully-Digital Test Administration Option To administer the test using all available digital options, you will need a computer and an additional electronic device (e.g., iPad, computer, laptop, white board) on which to display the student materials. To prepare to administer the test:

1. Choose a device to be the ‘Assessor Device’ 2. Sign into your PASA-Science digital account on that device (sci.pasadigital.com) 3. Select the ‘Assess’ tab on the menu bar at the top of the page 4. Choose the student from your roster for which you want to administer the test and select

the ‘Live Administration’ link next to their name. You will be asked to verify the student’s name before proceeding.

5. Designate the device as the ‘Assessor Device’ 6. Answer the questions about mode of delivery for student materials and mode of video

submission 7. Choose a device to be the ‘Student Materials Device’ 8. Sign into your PASA-Science digital account on that device (sci.pasadigital.com) 9. Choose the SAME student and select the ‘Live Administration’ link next to their name.

You will be asked to verify the student’s name before proceeding. 10. Designate the device as the ‘Student Materials Device’

To administer the test: 1. If not automatically displayed, select the button for Item 1 on the item bar at the top of the

page



2. To sync the ‘Assessor Device’ and ‘Student Materials Device’ select the ‘Display on Student Device’ link under the left-hand image which duplicates the student materials for the item. To have the devices automatically sync as the test is advanced, select the auto-display option under the ‘Display on Student Device’ link.

Note: Once the student device is synced, a blue ‘Currently Displayed’ icon with the word ‘active’ will appear on the screen under the image. If the picture displayed does not match the item being administered, a warning will appear to remind you to select the ‘Display on Student Device’ link. 3. Read the provided script for the item as given and provide the student an opportunity to

respond after the question has been asked 4. Record the student’s response to the initial prompt by selecting the appropriate response

option box (A, B, C or No Response)

If the student answers correctly: 1. Select the ‘Next Question’ box at the bottom of the page

NOTE: You will not be able to advance to the next question of the test until a response or responses are entered for the item. If the student answers incorrectly:

1. Read the script for the extra prompt for the item as given and provide an opportunity for the student to respond to the question again

2. Record the student’s response to the extra prompt by selecting the appropriate response option box (A, B, C or No Response)

3. Select the ‘Next Question’ box at the bottom of the page NOTE: You will not be able to advance to the next question of the test until a response or responses are entered for the item.

Repeat this process until all items on the test have been administered. When all items have been administered, select the ‘Complete Test’ button which will appear in the same position as the ‘Next Question’ box. You will be asked to confirm that the test is complete. Select ‘OK’ and the test will be submitted to the digital system. NOTE: Once you submit the test, you will no longer have access to the test items or responses for this student. If you need to cease the test permanently, select the ‘End the Test’ button below the item frame. Three reasons will be listed. Select the appropriate reason and exit the test by selecting the ‘Exit to Student List’ link at the right of the Item Bar at the top of the page. If you need to cease the test temporarily and will resume at a later time or day, select the ‘Exit to Student List’ link at the right of the Item Bar at the top of the page. All answers previously



entered will be saved. When you log back into the site and select ‘Live Administration’ for this student, the test will resume at the item where the test was stopped. Partially-Digital Test Administration Option To administer the test using a partially-digital option, you will need an electronic device (i.e., computer, laptop) to designate as the ‘Assessor Device’ as well as the printed Student Materials Booklet provided in the Test Administration Kit mailed to your Assessment Coordinator. To prepare to administer the test:

1. Collect the Student Materials Booklet provided in the Test Administration Kit 2. Choose a device to be the ‘Assessor Device’ 3. Sign into your PASA-Science digital account on that device (sci.pasadigital.com) 4. Select the ‘Assess’ tab on the menu bar at the top of the page 5. Choose the student from your roster for which you want to administer the test and select

on the ‘Live Administration’ link next to their name. You will be asked to verify the student’s name before proceeding.

6. Designate the device as the ‘Assessor Device’ 7. Answer the questions about mode of delivery for student materials and mode of video

submission

To administer the test: 1. If not automatically displayed, select the button for Item 1 on the item bar at the top of the

page 2. Display the correct page of the Student Materials Booklet for the student 3. Read the provided script for the item as given and provide the student an opportunity to


option box (A, B, C or No Response)

If the student answers correctly: 1. Select the ‘Next Question’ box at the bottom of the page 2. Advance the page in the Student Materials Booklet

NOTE: You will not be able to advance to the next question of the test until a response or responses are entered for the item. If the student answers incorrectly:




2. Record the student’s response to the extra prompt by selecting the appropriate response option box (A, B, C or No Response)

4. Select the ‘Next Question’ box at the bottom of the page 5. Advance the page in the Student Materials Booklet

NOTE: You will not be able to advance to the next question of the test until a response or responses are entered for the item. Repeat this process until all items on the test have been administered. When all items have been administered, select the ‘Complete Test’ button which will appear in the same position as the ‘Next Question’ box. You will be asked to confirm that the test is complete. Select ‘OK’ and the test will be submitted to the digital system. NOTE: Once you submit the test, you will no longer have access to the test items or responses for this student. If you need to cease the test permanently, select the ‘End the Test’ button below the item frame. Three reasons will be listed. Select the appropriate reason and exit the test by selecting the ‘Exit to Student List’ link at the right of the Item Bar at the top of the page. If you need to cease the test temporarily and will resume at a later time or day, select the ‘Exit to Student List’ link at the right of the Item Bar at the top of the page. All answers previously entered will be saved. When you log back into the site and select ‘Live Administration’ for this student, the test will resume at the item where the test was stopped. Non-Digital Test Administration Option To administer the test using the non-digital option, you will still need an electronic device (i.e., computer, laptop) to designate as the ‘Assessor Device’ as well as the printed Student Materials Booklet provided in the Test Administration Kit mailed to your Assessment Coordinator and a copy of the Assessor Materials Booklet (test items) printed from the website. To make a printed copy of the Assessor Materials Booklet, you should:

1. Sign into your PASA-Science digital account on that device (sci.pasadigital.com) 2. Select the ‘Tests’ tab on the menu bar at the top of the page 3. Select the link for the appropriate grade and tier test for the student to which you plan to

administer the test 4. Select print from the available options

Note: When a test is printed, a record is sent to PASA-Science. ALL printed materials including this copy of the test, must be returned to PASA-Science at the end of the testing window. Failure to do so will be considered a violation of test security protocol.



Once a copy of the test has been printed: 1. Collect the Student Materials Booklet provided in your Test Administration Kit. 2. Sign into your PASA-Science digital account on that device (sci.pasadigital.com) 3. Select the student from your roster for which you want to administer the test and select the

‘Data Entry’ box next to their name. You will be asked to verify the student’s name before proceeding.

4. An electronic answer sheet will be displayed on the computer screen with which to record student responses

To administer the test: 1. Find Skill 1 in the Assessor Materials Booklet printed from the digital site 2. Display the correct page of the Student Materials Booklet for the student 3. Read the provided script for the item as given and provide the student an opportunity to


option box on the electronic data entry sheet (A, B, C or NR). Make sure to record the response under the Prompt 1 column.

If the student answers correctly:

1. Advance the page in the Assessor Materials Booklet 2. Advance the page in the Student Materials Booklet

If the student answers incorrectly:


2. Record the student’s response to the extra prompt by selecting the appropriate response option box on the electronic data entry sheet (A, B, C or NR). Make sure to record the response under the Prompt 2 column.

3. Advance the page in the Assessor Materials Booklet 4. Advance the page in the Student Materials Booklet

If you do not have access to a computer with which to administer the test, contact PASA-Science at [email protected] to request an electronic answer sheet that can be printed as needed to record your students’ responses. NOTE: Student responses must be entered into the digital system or your student will be counted as NOT ASSESSED. You can enter the student responses at any time by accessing the ‘Data Entry’ link for your student(s) as outlined above and entering the information you recorded on the printed answer sheet during the test. This printed document must be returned with the rest of the test materials once the testing window closes.

mailto:[email protected]



Estimation of Student Performance Level Once a student’s test responses have been submitted, each assessor will be asked to rate the student’s performance level (Emerging, Novice, Proficient, Advanced) based on their perception of the student’s test performance and all other academic information the assessor knows about the student. Specific definitions of each of these categories vary by grade level and tier of the test being administered, but will be presented to the assessor as they make their decision. If the assessor is not the student’s regular science teacher, the assessor should collect pertinent information from the student’s regular science teacher in order to make an informed decision.



Video Submission Options To be considered complete, all assessments must be accompanied by a videotape (or narrative notes, if approved) of the assessment. To be considered a viable recording, the student’s choice of responses needs to be visible in the recording frame at all times. Also, the video angle should show that the student cannot see the test items that are presented in the Assessor Materials. Digital District Options Electronic Upload after Testing For this option, the assessor must have a computer that is connected to the Internet during video uploading. To upload a video file to the PASA-Science digital site, you should:

1. Sign into your PASA-Science digital account on that device (sci.pasadigital.com) 2. Select the ‘Video’ tab on the menu bar at the top of the page 3. Select ‘Upload’ for the student for whom you are uploading the video 4. Select the file you want to upload. You will be asked to verify student name and content

area before proceeding. Note: If your videotaped assessment consists of more than 1 file, choose ‘Upload and Combine Multiple Clips’ by selecting the box. Select all of the files for the student’s video and submit. Videos files will be automatically merged into a single file.

5. Remain on the website while the video uploads. Times will vary depending on Internet speed and size of the file(s) you are uploading.

6. Once the file has finished uploading and encoding, view the uploaded file to ensure that both the video and audio are present.

Streaming Upload during Testing Assessors choosing this option will need:

1. a webcam to capture the video and audio, 2. a computer that is connected to the internet, 3. a consistent and constant Internet speed of at least 2 Mbps. 4. to use Google Chrome browser during the entire assessment

Additionally, this option will only work in conjunction with the digital delivery system. To use the streaming upload during testing, you should:

1. Sign into your PASA-Science digital account on that device (sci.pasadigital.com) 2. Select the ‘Assess’ tab on the menu bar at the top of the page 3. Select ‘Assessor Screen’



4. Select ‘Record Live from Webcam’ option 5. Perform test of computer and internet capability by selecting the ‘test’ link and performing

the introductory video clip. A box will be displayed to tell you the computer system and internet is sufficient to support the streaming option.

Note: If computer system and internet FAILS the test, do NOT continue with the streaming upload of video option.

6. Adjust the webcam to capture the student selecting their responses in the video frame 7. Select ‘Record’ to start recording. A red ‘record’ icon will be displayed if the video is

recording. 8. When the assessment is complete, remain the page until the recording indicates that

uploading has been completed or until 5 minutes has passed. If the video does NOT finish loading in 5 minutes, exit the test and contact PASA-Science at [email protected] to report the incident.

Non-Digital District Options Mailed Submission Assessors who are in a Non-Digital district/IU/Charter School must submit their videotaped assessments by mail. To mail in a videotaped assessment, you should:

1. Record the assessment using DVD, mini-DVD, mini-DV, SD card, flash drives, 8mm video tape

2. Put student label on media if doing so does NOT impact playback. If in doubt, do NOT place the student label directly on the media. Instead, write the student ID number on the media and place the student label on the case or other container.

3. Put media in the student baggie 4. Place student label on student baggie 5. Submit all assessment media and other assessment materials to your Assessment

Coordinator. Narrative Notes In specific situations, assessors may be granted permission by the Bureau of Special Education to submit Narrative Notes of the assessment in place of a video recording of the assessment. If you have questions about obtaining permission to use Narrative Notes or are in need of a Narrative Notes form, contact PASA-Science at [email protected]. Narrative Notes should be completed during the assessment and submitted to your Assessment Coordinator for return to PASA-Science with the rest of the testing materials.





Administration Tips and Guidelines A few general guidelines and tips based on frequently asked administration questions and common administration errors seen on videotaped assessments follow.

1. The PASA-Science is an individually administered test and care should be taken to ensure other students are not listening or viewing the assessment as it is given to another student.

2. Items should be presented and completed in the order they are presented in the Assessor Materials Booklet.

3. The script for each item must be followed exactly as it is written. Do should not shorten, embellish, add clarifications, define words, rephrase, or reword the items in any way during administration.

4. Read the script at a pace appropriate for the student. 5. Practice the scripts beforehand so you do not stumble over the prompts or pronunciation

of words. 6. Do NOT reduce the array of answer choices (remove or cover the incorrect choice) if the

student chooses an incorrect answer after the first prompt. 7. Do NOT teach a skill as you administer the test. 8. If a student an image that does NOT represent an answer choice (contextual picture),

record the answer to the first prompt as a No Response (NR) and proceed to the extra prompt.

9. If the student does NOT provide a response after the first prompt, it is permissible to read the question one additional time to elicit a response. If no response is forthcoming, record the first prompt as No Response (NR) and proceed to the extra prompt. The same procedure of repeating the extra prompt one time is permissible when administering the extra prompt.

10. If you need to stop the test and restart it later, do NOT re-administer any item already completed.

11. If you accidentally skip an item, you may go back and administer it. However, it is not permissible to deliberately skip an item or to skip items at the student’s request.

12. If hand-over-hand instruction is used during the assessment, the student’s response to every item should be recorded as No Response (NR) since the student is not making the answer choice selections.

13. Any prompting which allows the student additional chances to answer the item or directs them to the correct answer is NOT permitted. However, routine behavioral supports can be used during the administration. Redirecting the student’s attention to the task is not considered an additional prompt as long as the question is not asked again (except in the case outlined previously).

14. Directing a student to ‘Try again’ or other such phrases after an incorrect response is NOT permitted. The student should be administered the extra prompt in such cases.



15. Pointing to the images (unless specified not to do so) to focus a student’s attention is permissible as long as it is done in such a way that each picture is equally emphasized. In other words, pointing does NOT happen in such a way as to give the student the correct answer OR give the student any clue to the correct answer.



Discontinuing the Test If a student is unable to participate meaningfully in the PASA-Science assessment despite the accommodations and modifications provided, you may discontinue testing. The lack of meaningful participation is defined as three consecutive skills in which the students is only passively participating (No Response for both the first and second prompt) within the first 4 skills administered on the test. Three consecutive non-responses in the middle of the test does not necessarily signify a ‘lack of meaningful’ participation. In the case of a discontinued test, a student will receive the lowest score possible (200) and assigned the lowest performance category, but will be included for accountability purposes. Two other reasons exist for terminating the test; disruptive or dangerous behavior or a medical incident. When terminating the test for any reason, a reason must be recorded in the student record. The list of acceptable reasons for termination are:

1. Student did not actively participate (i.e., did not orient towards or show awareness of the presence of test materials, did not demonstrate any response to assessor's prompts in any mode).

2. Student displayed disruptive and dangerous behavior (e.g., severe self-injurious behavior) that interrupted test administration even with the use of preventative behavioral supports and could not be reassessed even after repeated rescheduling.

3. Student experienced a medical incident (e.g., illness, fatigue, etc.) that interrupted test administration and could not be reassessed even after repeated rescheduling.

Non-Assessed Students Every effort should be made to assess every student on your roster during the testing window. If a student canNOT be assessed despite your best efforts, the student record should be updated to reflect this. In the “Was This Student Assessed?” window, select “NO” and provide the reason (Figure 1). Reasons include:

• ELL Exemption (for first year in US only) • Extended Absence • Deceased • Medical Emergency • Inappropriate Grade (1, 2, 9, 10, Or 12) • No Longer Taught By This Service Provider • Taking PSSA • Student Refused To Test • Religious Exemption • Other

Please be aware that, as in the case of religious exemptions, these students are factored into accountability data and could negatively affect school performance profiles.



Administration Instructions for Special Circumstances The PASA-Science test has been designed for students who have significant cognitive disabilities. Inherent in the design of the test are several accommodations such as the tiered cognitive structure of the tests, presentation of items via picture cues rather than words, a multiple choice answer format which decreases language demand, and the acceptance of a variety of response modes (e.g., signing, nodding, eye gaze). However, sometimes additional accommodations are needed. By definition, accommodations are adjustments to test administration that reduce the impact of the student’s disability but do not change the construct being measured or reduce the learning expectations for the student. Any accommodation used on the assessment should be an accommodation used in the classroom during regular instruction. Some general accommodations include:

• cutting apart the item context and answer choice images to provide more space between options as long as the answer choices are displayed in the same order and orientation as the original page,

• adding texture to letters, charts or graphs, • adding Braille words to answer choices or pictures, • taking frequent breaks and/or allowing students to take the test over several days, • providing an interpreter to administer the test in the student’s native language.

Please be aware that some accommodations are NOT acceptable. These include, but are not limited to:

• reducing the array of choices after one incorrect response, • displaying the answer choices in a different order or orientation as the original, • using hand-over-hand to guide students to the correct answer and record the answer as if

the student made the selection themselves (record ‘No Response’ for these items), • if using sign language, using signs to present the item which gives away the correct

answer. In addition, use of the phrase “Try again” to provide additional opportunities to the student is not allowed. In general, adaptations or accommodations that do not change the meaning, intent or difficulty of the item are acceptable. If you have questions about accommodating a specific disability not addressed here or have questions about a specific adaptation or accommodation, contact PASA-Science directly at [email protected] and provide contact information for the appropriate person.




Despite the accommodations outlined above, alternatives for a few low incidence populations within the PASA-Science are sometimes required. A set of special instructions for those populations follows. Tactual Test (Blind and Low Vision) The PASA-Science test has been adapted for students who are blind or have low functional vision with significant cognitive disabilities. There are several adaptations for students with low functional vision that can be applied to any item:

• Separating the contextual picture from the answer choice pictures by cutting the page apart, • Cutting out the answer choices and presenting them in the same order AND orientation, but

with an appropriate amount of space between them and/or in the best visual field, • Covering or removing the letters A, B and C from the answer choices to remove visual

clutter whether cutting the page apart or not. However, make sure answer choices are presented in the same order AND orientation,

• Using black occluder squares to present one answer choice at a time and/or covering the contextual picture after presentation,

• Enlarging the size of the pictures presented to the student (enlarged copies should be returned with test materials),

• Presenting the object or picture options against a black background.

Additionally, you may tactually enhance pictures using adaptation materials (e.g., tactile stickers, Wikki Stix). Please do not tactually adapt shared test materials. Contact PASA-Science for additional copies of the Student Materials Booklets. Some students, however, might benefit from using the Tactual Version of the PASA-Science as an accommodation. The Tactual Version of the PASA-Science assessment has recommendations for tactual adaptations and/or substitution items for students with limited functional vision. If it was indicated on a student’s PASA enrollment form that he/she meets the following criterion:

• Visual Impairment – primarily uses senses other than vision (e.g. tactile and auditory) the assessor will be able to preview and/or print a copy of the Tactual Test Version for that student from the PASA-Science website under the “Tests” tab. The assessor should review the skills in both test versions and decide whether the adapted items are appropriate for the student. If the Test Administrator decides to use the Tactual Version of the PASA-Science assessment, he/she may request a Tactual Version materials kit by contacting [email protected]. Tactual materials kits will only be sent to those assessors who contact the project. Even if you



indicated the need for a Tactual Version of the test at enrollment, you must still request a test kit. Please include the following information in your email:

• Assessor’s name • School name • Mailing address • Phone number or email address • Grade • Tier (1,2) • Specify that the materials being requested are for the Tactual Version

Tactual Version materials kits for PASA-Science will provide some, but not all, of the materials required for the suggestions in the Tactual Version. Additionally, it is highly recommended that assessors substitute objects that were used during the instruction of the student whenever possible for those objects suggested by the Tactual Version or provided in the kits. Deaf and Hard-of-Hearing Test The PASA-Science test has been adapted for students who are deaf/hard of hearing with significant cognitive disabilities. During the presentation of materials, test administrators may use the following script:

1. Point to the picture as you say and/or sign: present the item materials 2. Point to each picture as you say and/or sign: present answer choice options 3. Correct responses from the student may be:

• Points to picture • Says and/or signs “Answer” • Says and/or signs “A, B, C”

4. If the student answers incorrectly on the first prompt, say and/or sign: present clarification

5. Say and/or sign: present the extra prompt

The material script above and contained in the Assessor Test Booklet may be presented to the student in the modality and sign system (ASL, SEE, or PSE) that the student uses for daily communication and instruction. In addition, when the presentation of material script uses the following adverbial terms, the test administrator may point to the test item pictures or sign above the test item: here, this, which one, which of these, which group of things, or this arrow means. As the PASA-Science test is a content specific test, it contains specific technical vocabulary associated with Pennsylvania Standards. It is understood that during the course of daily instruction, the educational team may develop signs to convey the technical vocabulary to the student. These signs may be used as part of the test administrators’ sign selection. However,



select signs should NOT signal correct item responses. To further clarify sign interpretation, suggestions for administration may be indicated on specific test item skills. This version of the test is available under the “Tests” tab for those assessors indicating a student who is deaf/hard of hearing during enrollment. Students who are Multiple Handicapped, Physically Challenged, and/or Non-Verbal The PASA-Science test has been adapted for students who are multiply handicapped, physically challenged, and/or non-verbal with significant cognitive disabilities. During the presentation of materials, test administrators should:

1. Point to the picture as you present stem item 2. Point to each picture as you present answer choice options 3. Present ALL answer choices a second time separately asking ‘yes’ or ‘no’ for each

choice. You MUST present all answer choices each time so that you can be sure that the student is indicating the correct answer and ONLY the correct answer. Make sure the camera is catching the student’s responses.

4. If he gives a ‘yes’ response to more than one answer, direct him to choose only 1 answer and then repeat #3.

5. At this point, after presenting ALL answer choices as indicated in #3: a. If a correct response is chosen, record it and move on. b. If more than one response or an incorrect response is chosen, record the/an

incorrect response and administer the extra prompt found in the script. 6. Once the extra prompt is administered, follow the same procedure (#3 and #4).

Students also may use assistive technology, yes/no cards, eye gaze, or switches to select their response. Again, cutting the answer choices apart and enlarging them or the contextual pictures are appropriate if student is also visually impairment and one or both of these along with black occluders that highlight one answer choice at a time can be used in conjunction with the above protocol to administer any skill.



Scoring Tests Test assessors record a student’s response (or responses) to an item by entering the letter which matches the answer choice indicated by the student into the computer before moving on to the next item. After the assessment is uploaded, the response(s) to each item are scored according to the following scoring rubric: Table 2. Scoring Rubric for Student Responses on the PASA-Science

3 2 1 0 Correct Unassisted

Response Correct Assisted

Response Incorrect Response No Response

The student chooses the correct answer after the ITEM PROMPT without requiring the EXTRA PROMPT.

The student chooses the correct answer after receiving the ITEM PROMPT AND the EXTRA PROMPT.

The student does not choose the correct answer even after receiving the EXTRA PROMPT.

The student does NOT respond.

Score Reporting Raw scores of a student’s performance are transformed into scale scores. Scale scores are associated with performance categories (Emerging, Novice, Proficient, Advanced) based on a standard setting performed in fall of 2016. This allows scores for students taking the PASA-Science to be aggregated with scores for students taking the PSSA for accountability purposes. Performance category, scale score, mean score and number of items by content strand answered with and without assistance are reported on a Student Score Report generated for parents by PASA-Science and mailed to schools the fall following the test administration. A guide to interpreting the student score reports is available online at sci.pasadigital.com under the ‘For Administrators’ and ‘For Parents’ links at the bottom of the homepage. No login is required to access this information. A description of the performance categories as well as the Alternate Eligible Content on which the test is based can be found on the same website.



Appendix A

Checklist for PASA-Science Administration



Checklist for PASA-Science Administration

Before the Test Materials Arrive (January – March 2017) Review IEP(s) for eligibility. Make sure your PASA-Science account is accessible (e.g., reset password). Enroll student(s). Complete online training modules and proficiency tests. Review administration instructions as outlined in the PASA-Science Administration

Manual Before the Test Window (April 2017) Catalog materials sent in Test Administration Kit for accuracy. Preview and practice test items through the PASA-Science website. Decide on preferred test administration option (e.g., fully-digital, partially-digital). Collect materials needed for preferred test administration option. If approved, request Narrative Notes form If applicable, request electronic copy of Answer Recording Sheet If applicable, adapt test materials for specific accommodations outlined in IEP.

If applicable, decide if Tactual version of the test is more appropriate than Standard version and request appropriate materials.

During the Test Window (April 10 - May 5, 2017) Follow the script exactly to administer each item. Enter response(s) for each item on the test. Video-tape the assessment(s) OR use the live video upload feature. Provide an estimated performance level for the student(s) assessed. If testing was ceased, provide reason(s) as well as an estimated performance level.

After the Test Window (May 2017)

Collect all test materials for delivery to Assessment Coordinator (see Returned Materials Checklist).

Upload video(s) to website under correct student name(s) for the correct content area. Update student record for any student not assessed.



Appendix B

Returned Materials Checklists for PASA-Science



Assessor Returned Materials Checklist for PASA-Science

Completed Returned Materials Checklist Student Materials Booklets for each grade assessed. If applicable, copies of any Assessor Test Item Booklets printed from the website. Completed and signed Assessor Permission Form. Completed and signed Parent/Guardian Permission Forms. If applicable, completed Answer Recording Sheet(s). If applicable, labeled media recording of each assessment completed. If approved, Narrative Notes for each student without a video-recorded assessment. If applicable, tactual test kit.

Documents

PASA-Science Administration Manual - PASA Digital Booklet for the non-digital and partially-digital administration formats, and on the screen of an electronic device for the fully-digital