Smarter Balanced Pilot Test

  • View
    41

  • Download
    0

Embed Size (px)

DESCRIPTION

Smarter Balanced Pilot Test. February 2013. Purpose of the Scientific Pilot. Provide an opportunity for students to interact with new, innovative test items that will be part of future Smarter Balanced assessments. - PowerPoint PPT Presentation

Text of Smarter Balanced Pilot Test

  • Smarter Balanced Pilot Test

    February 2013 *

  • Purpose of the Scientific PilotProvide an opportunity for students to interact with new, innovative test items that will be part of future Smarter Balanced assessments. Gather data about the implementation of the Online Testing System, the functioning of the items and their technical quality, and survey administration procedures. Identify and inform areas of improvement prior to the 2014 Field Test and 2015 operational administrations.

    *

  • Smarter Balanced Key Milestones*

  • Design of the Scientific Pilot

    Pilot Window and Participation Pilot testing will take place between February 20 and May 24, 2013.Schools will administer the Pilot during a specified two-week period. The Pilot will include a sample of approximately 1 million students in about 6,000 schools in the Smarter Balanced governing states. The sample represents approximately 10% of the schools in each state. School selection for the scientific sample was based on demographic sampling parameters (such as district/school size, race, gender, urban/rural population) to ensure that the Pilot data collected are representative of the Consortium states. *

  • Design of the Scientific PilotPilot Window and Participation Sample schools will be contacted by recruitment staff between December and February. Schools will be notified of their test window and the grades, content areas, and item types they have been assigned to administer. Additional schools may be contacted if more participants are needed to fulfill the sampling requirements. Schools not selected as part of the scientific sample may volunteer by March 27 to participate in another format of the Pilot by completing an online survey at: https://www.surveymonkey.com/s/SmarterBalancedPilot. Schools that were scientifically selected may also fill out this registration and volunteer to test additional grades. Volunteers will have the opportunity to test using a separate form of items that will be available beginning of April. *

  • Design of the Scientific PilotPilot Assessment Design:Computer-administered tests in English Language Arts (Reading and Writing) and Mathematics in grades 311.Items include selected-response items, constructed-response items, technology-enhanced items, and performance tasks. Selected grades and content areas may take one of the three following assessment types:1.Computer-administered test items2.Computer-administered test items plus one performance task3.Computer-administered test items plus one performance task with a classroom activity*

  • Design of the Scientific PilotPilot Assessment Design:Samples of these items and content specifications may be viewed at http://www.smarterbalanced.org/.Pilot Test items are representative of the item types intended for use on Smarter Balanced assessments; however, the Pilot Test forms will not be administered adaptively, thus will not be a full representation of the operational test forms slated for use in 20142015.The Pilot Test is not timed, but we estimate that most students will take approximately two to three hours to complete the test. Some schools will be assigned a test that includes a classroom-based performance task. This will add approximately one half hour to the estimated testing time. The test may be administered over multiple sessions and multiple days. *

  • Preparing for the Pilot Participate in training opportunities:Take the training test accessible through the Smarter Balanced Portal (http://sbac.portal.airast.org/).Review the five self-paced online training modules posted on the Smarter Balanced Portal.Review the Test Administration Manual, Test Coordinator Manual, TIDE and Test Administrator User Guides, FAQs, and other relevant Pilot materials in the Resources and Documentation tab on the Smarter Balanced Portal.*

  • Sample Test Layout*

  • Online ResourcesPilot Test Smarter Balanced web page http://www.smarterbalanced.org/pilot-test/OverviewPilot Test participation detailsFrequently asked questionsPilot Test flyer for schoolsSecure Scientific Sample Portalhttp://sbac.portal.airast.org/Secure browserTIDETraining Test

    *The purpose of the Scientific Pilot is to: Provide an opportunity for students to interact with new, innovative test items that will be part of future Smarter Balanced assessments. Gather data about the implementation of the Online Testing System, the functioning of the items and their technical quality, and test administration procedures. Identify and inform areas of improvement prior to the 2014 field test and 2015 operational administrations.

    *The Pilot Test is the first of two large-scale tryouts of the assessments prior to implementation in the 2014-2015 school year.

    In 2012, K-12 teachers and higher education faculty from Smarter Balanced Governing States collaborated with content experts to write and review items and performance tasks that appear in the Pilot Test.

    In addition, Smarter Balanced conducted more than 900 cognitive labs around the country in 2012. Through these one-on-one sessions, students provided valuable feedback on innovative item types, the test interface, and accessibility features. Small-scale trials in more than 500 schools in 23 states also provided critical information for the development of the Pilot Test.

    Later this year, results from the Pilot Test will be analyzed and will inform the development of assessment items and performance tasks for the Field Test, which will be conducted in spring 2014. *The pilot testing will take place between February 20 and May 24, 2013.Schools will administer the Pilot during a specified two-week period. The Pilot will include a sample of approximately 1 million students in about 6,000 schools in the Smarter Balanced governing states. School selection for the scientific sample was based on demographic sampling parameters (such as district/school size, race, gender, urban/rural population) to ensure that the Pilot data collected are representative of the Consortium states.

    *Pilot Window and Participation Sample schools will be contacted by recruitment staff between December and February. Schools will be notified of their test window and the grades, content areas, and item types they have been assigned to administer. Additional schools may be contacted if more participants are needed to fulfill the sampling requirements. Schools not selected as part of the scientific sample may volunteer to participate in another format of the Pilot by completing an online survey at the URL noted in the slide. Schools that were scientifically selected may also fill out this registration and volunteer to test additional grades. Volunteers will have the opportunity to test using a separate form of items that will be available beginning of April. *The pilot Assessment Design includes:

    Computer-administered tests in English Language Arts (Reading and Writing) and Mathematics in grades 311.

    Items include selected-response, constructed-response, and technology-enhanced items, as well as performance task items.

    Selected grades and content areas may take one of the three following assessment types:1.Computer-administered test items2.Computer-administered test items plus one performance taskComputer-administered test items plus one performance task with a classroom activity

    Every student in a selected grade within a school will receive the same assessment type.*Samples of these items and content specifications may be viewed at the Smarter Balanced Website at the link provided. Pilot Test items are representative of the item types intended for use on Smarter Balanced assessments; however, the Pilot Test forms will not be administered adaptively, thus will not be a full representation of the operational test forms slated for use in 20142015. The pilot test is not timed, but we estimate that most students will take approximately two to three hours to complete the test. Some schools will be assigned a test that includes a classroom-based performance task. This will add approximately one half hour to the estimated testing time. The test may be administered over multiple sessions and multiple days.

    *The Smarter Balanced portal contains a wide range of information for the Pilot. Visit the portal before the administration to become familiar with its contents. To prepare for the pilot, take advantage of training opportunities designed to help staff get ready for the online administration.

    There is a training test that is now available through the portal that will show students and administrators how to navigate the Online Testing System and expose them to the types of items that will be on the pilot. You are encouraged to have your students take this training test before you administer the pilot to students.

    Additionally, there will also be five self-paced online training modules posted on the Smarter Balanced Portal.

    Prior to the administration you should review the Test Administration Manual, Test Coordinator Manual, TIDE and Test Administrator User Guides, FAQs, and other relevant Pilot materials in the Resources and Documentation tab on the Smarter Balanced Portal.*This is a sample test layout. On this slide, you will see the icons at the top of the screen that allow students to perform such functions as zoom, save, and marking the item for review. Take a moment to review the layout features. *