Smarter Balanced ELA Interim Assessment Scoring ... The complete set of THSS materials is located in

  • View
    0

  • Download
    0

Embed Size (px)

Text of Smarter Balanced ELA Interim Assessment Scoring ... The complete set of THSS materials is located in

  • Smarter Balanced ELA Interim Assessment Scoring TEACHER HAND SCORING SYSTEM (THSS) MATERIALS

    Presenter Presentation Notes Welcome….

  • Interims: Purpose and Intent Purpose:

    • Support learning and teaching Intended uses:

    • Check student progress • Inform classroom instruction • Practice with accessibility tools

    2/3/2017

    OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

    2

    Presenter Presentation Notes Smarter Balanced designed the interim assessments for instructional use to support learning and teaching throughout the school year in order to -allow teachers to check student progress -provide information to improve classroom instruction -provide practice with accessibility tools used on the summative

  • Benefits of Hand Scoring Calibration: • Teachers calibrate scoring • Student responses calibrated to fixed rubric • Scoring aligned to Smarter Balanced assessments • Materials consistent across grade levels, content areas, item types

    Interpretation of student learning:

    • Allows teachers to identify areas of strength and weakness

    2/3/2017

    WASHINGTON STATE OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

    Presenter Presentation Notes The greatest benefit of hand scoring is that it allows teachers to interpret strengths and weaknesses for their students in the particular skill being assessed. Student responses can be one piece of evidence (of multiple measures). Similar to formative assessment processes used in the classroom, teachers can evaluate the constructed responses to determine next instructional steps.

    On a larger scale, these items allow for calibration to a fixed rubric, to provide a consistent ruler among students and teachers, and they help teachers and students better understand expectations of the summative assessment.   Across grade levels, content areas and item types, THSS materials are formatted in similar styles. Each item has a training guide and exemplars.

  • Interim Assessment Process Step 1: Planning and Preparation Use Assessment Viewing Application (AVA), the interim blueprints (inside Test Administration Resources), and THSS Materials (inside TIDE)

    Step 2: Administration and Scoring

    Use Test Administration interface (TA) to manage student tests Train and score constructed response items in Interim Teaching Hand Scoring System (THSS)

    Step 3: Reflection

    View summary reports in the Online Reporting System and/or more detailed item-level and student-level reports in AIR Ways Reporting

    Presenter Presentation Notes The Teacher Hand Scoring materials are used in the midst of a set of assessment events.   To help them determine which Interim assessment to give to students, educators should access the Assessment Viewing Application (AVA), the teacher hand-scoring (THSS) materials located in TIDE, and the interim blueprints posted in the General Information folder on the WCAP Portal.   The Test Administration interface and the Washington Secure browser are used to administer the Interim Comprehensive Assessments (ICA) and the Interim Assessment Blocks (IAB) to students.   Student responses to constructed response items are then scored at the local level via the Teacher Hand Scoring System by educators, using the THSS materials.   After hand-scoring is completed, data is available in both the Online Reporting System (ORS) and in the AIR Ways reporting system. If no hand-scoring is needed, which is true for many of the IABs, scores are available in ORS and AIR Ways soon after the completion of testing.   Each of these systems has their own User Guide and Training Module available on the WCAP Portal. Please refer to those materials for more specific questions about ORS and AIR Ways.  

  • Step 1: Planning and Preparation ASSESSMENT VIEWING APPLICATION (AVA) INTERIM BLUEPRINTS TEACHER HAND SCORING SYSTEM (THSS) MATERIALS IN TIDE

  • Planning: Using AVA Purpose: • Allows educators to view interim assessments for

    planning and preparation

    • Provides an understanding of content being assessed and time needed to complete interims

    What is available to view: • Actual interim assessment items presented online in

    the same format as students will see the items

    2/3/2017

    OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

    6

  • Planning: Available IABs

    7

    Hand Scoring Grades 3–7 Grade 8 High School

    Read Literary Texts Read Literary Texts Read Literary Texts

    Read Informational Texts Read Informational Texts Read Informational Texts

    Brief Writes Brief Writes Brief Writes

    Revision* Edit/Revise*** Revision*

    Language and Vocabulary Use* Language and Vocabulary Use*

    Editing* Editing*

    Listen/Interpret Listen/Interpret Listen/Interpret

    Research** Research** Research**

    Performance Task Performance Task Performance Task

    *IAB is new for 2016–17 ** IAB includes new items in 2016–17 *** The Edit/Revise IAB for grade 8 will be separated as soon as possible when items are available in the item bank

      

    Presenter Presentation Notes This is a list of ELA Blocks for 2016-17.

    The check marks indicate IABs that have some hand-scored items. Most of these blocks contain 1-2 hand-scored items, with the exception of brief writes which are all hand-scored.

    Specific writing types for Performance tasks can be seen in AVA. G3: Opinion, G4-5: Narrative, G6: Argumentative, G7: Explanatory, G8: Explanatory, HS: Explanatory

    For more information about the interims: https://portal.smarterbalanced.org/library/en/interim-assessments-overview.pdf

  • Planning: Using Interim Blueprints Access blueprints: Test Coordinator Resources > General Information > Blueprint ELA/Literacy Interim Assessment

    Sample:

    2/3/2017

    OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

    8

    Presenter Presentation Notes The Blueprints show the break down for each block: total number of items, targets assessed with accompanying DOK, detailed information about the items, such as how many are machine scored and how many are short text (meaning they would need hand scoring). Note: Some are labeled as human scored rather than short text.

  • Planning: Time for Training and Scoring Training:

    • Allow time for training PRIOR to scoring in the system • 1–2 hours per training guide and exemplars set • Training time should decrease with familiarity

    Scoring:

    • Time varies by item and number of student responses

    2/3/2017

    WASHINGTON STATE OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

    11

  • Preparation: Materials in TIDE

    2/3/2017

    OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

    10

    Presenter Presentation Notes The complete set of THSS materials is located in TIDE. Click on the arrow next to the “General Resources” and then choose THSS Materials. A pop up window with a downloadable list of materials will appear which includes: this presentation “Overview of Scoring ELA Interims.ppx” grade level zip files.

  • Preparation: Using THSS materials Download materials from TIDE:

    • Grade-level zip files • Reference document (labeled “InterimItems2016”) • Training Guide (labeled “SG”) • Exemplars (labeled “TM”)

    Note: Materials also available in the THSS while scoring but only for the particular item being scored

    2/3/2017

    OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

    11

    Presenter Presentation Notes The THSS materials help prepare educators to score student responses from the Smarter Balanced Interim Assessments (IABs, and ICAs).   The materials are located in zip files by grade level. They include a reference guide for the grade level and Training Guide (labeled “SG”) and Exemplars (labeled “TM”) for each hand-scored item.

    These materials (Training Guide and Exemplars) are also accessible in the THSS after students have completed the interim assessment, but only for the particular item being scored.

  • Download materials from TIDE

    2/3/2017

    OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

    12

    Presenter Presentation Notes In TIDE: located in zip files by grade level Reference document (labeled “InterimItems2016”) Training Guide (labeled “SG”) Exemplars (labeled “TM”)

  • Reference Guide—Zip folder

    2/3/2017 13

    Presenter Presentation Notes The purpose of the Reference Guide is to provide a summary of the various items with the following: item number, title, claim, target, item stem, and test selection name. This can be used for planning purposes.

  • Training Guide—Zip folder

    2/3/2017 14

    Presenter Presentation Notes There are also Training Guides (labeled “SG”)

  • Exemplars—Zip folder

    2/3/2017 15

    Presenter Presentation Notes And Exemplars (labeled “TM”) for each hand-scored item

  • WASHINGTON STATE OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

    Training Guides for ELA • Instructions • Stimulus • Item stem • Target specific rubric • Condition codes • Target chart

    2/3/2017

    Presenter Presentation Notes Each training guide contains item specific stimulus, item stem, target specific rubric, condition codes and a target chart. The condition codes are the only part that is the same

Recommended

View more >