Embed Size (px)
Citation preview
LOS ANGELES UNIFIED SCHOOL DISTRICT
Student Testing Branch
O f f i c e o f D a t a a n d A c c o u n t a b i l i t y
California Assessment of Student Performance and Progress Program
Smarter Balanced
Interim Assessments
Principal’s TrainingVersion: 090915
2
Interim AssessmentPrincipal’s Training
Agenda1) Interim Assessment Principal’s Training Objectives2) LAUSD Comprehensive Assessment Program Help Desk Reference Guide3) Interim Assessment LAUSD Policy (REF-6507.1)4) Interim Assessment Purpose5) Interim Assessment Types
a) Smarter Balanced Interim Comprehensive Assessments (ICA)b) Smarter Balanced Interim Assessment Blocks (IAB)
6) TOMS and Digital Library Accounts7) Interim Assessment Viewing System “Teacher View” LD8) Interim Assessment Administration – with Live Demonstrations (LD)
a) Designated Supports and Accommodations (REF-6420) LDb) Student Log in Information LDc) Test Administrator Interface LD
9) Interim Assessment Hand Scoring System LDa) Interim Assessments Estimated Hand Scoring Timesb) Hand Scoring System Overview
10) Interim Assessment Reporting Systema) Requirements for viewing Interim Assessment Scores (Digital Library account)b) ICA Score Reportsc) IAB Score Reports
11) Interim Assessment General Informationa) LAUSD – Division of Instruction Smarter Balanced Assessment Scoring Training Planb) Technology Updatesc) TOMS System Downtimed) Earbudse) For More Information – Contact Information
3
Interim AssessmentPrincipal’s Training
Training Objectives• To provide school site Principals with an overview of the
Smarter Balanced Interim Assessments and its components.
• To provide school site Principals with an overview of the comprehensive training that the school site Testing Coordinators will receive that will enable them to guide their schools in the administration of the Interim Assessments.
4
LAUSDComprehensive Assessment Program
Help Desk Reference Guide
LAUSD Interim Assessment Policy
5
PURPOSE: The purpose of this Reference Guide is to provide information about the Comprehensive Assessment Program for 2015-2016. The Comprehensive Assessment Program is designed to be formative and to provide multiple measures to drive decisions about instruction and intervention. This document details program policies and also provides the 2015-2016 assessment schedules in calendar form.
MAJOR CHANGES:For 2015-2016, the District will adopt the Smarter Balanced Assessment Consortium’s Interim Assessment Blocks* (IAB) in Mathematics and English/Language Arts for Grades 3rd -11th (9th and 10th grade students can only take the 11th grade IABs). Science and History/Social Science assessments will continue to be the District’s California State Standards-based assessments. For ELA and Mathematics, grades 3rd -12th, schools will have the option to:
(1) give the SBAC IABs, or (2) give the District’s CA State Standards-based interim assessments in ELA and Math, or (3) give CCSS-based interim assessments determined by the school and with approval of the Local District Superintendent (see Attachment J).
The District’s Interim ELA and Math assessments for grades TK-2nd will continue to be the California State Standards-based interim assessments. Kindergarten Literacy interim assessments will not be optional, as they were in 2014-2015. Additionally, Grade 3 will have an end-of-year Integrated Unit, joining the Integrated Units for Grade 4 and 5. *NOTE: The Interim Comprehensive Assessment (ICA) is another version of the SBAC Summative and requires as much time as the Summative for administration. Use of the ICA is ultimately a school decision and may replace or supplement one of the options above.
Smarter BalancedInterim Assessments
6
Standards set expectations
on path to college and
career readiness
All students graduate college
and career ready
Teachers and schools have
information and tools to improve
teaching and learning
Interim assessments Flexible, open, used for
actionable feedback
Summative assessments benchmarked to college
and career readiness(Grades 3-8 and 11)
Digital Library: Formative assessment
tools and practicesfor teachers to improve
instruction
Interim Assessment Purpose
• The Interim Assessments are one component of the Smarter Balanced assessment system and are designed to support teaching and student learning throughout the year. The items are developed under the same conditions, protocols, and review procedures as those used in the summative assessments.
‒ Not secure, but not public‒ Limited access to only those individuals within the District
who have a professional interest in the use of the assessments
7
Interim Assessment Purposecont.
• The interim assessments are optional, but are recommended. They enable teachers to check student progress throughout the year, providing actionable information to inform instruction and help students meet the challenge of college-and career-ready standards.
8
Interim Assessment Purposecont.
• The content of the tests have been aligned to the Common Core State Standards in grades 3–8 and high school. The grade level to assess should be based on the purpose of the testing event.
• Each test can be administered to students in any grade (e.g., a grade 7 interim test is not limited to grade 7 students, but can be administered to students in grades 6 or 8).
9
Interim Assessment Types
• Two types of interim assessments:
1. Interim Comprehensive Assessments (ICAs)– English language arts/literacy (ELA) test
and performance task– Mathematics test and performance task
2. Interim Assessment Blocks (IABs)– There are between 5 and 17 IABs per
grade and content area10
Smarter BalancedInterim Comprehensive Assessments (ICA)
• Fixed form• Use the same blueprints and assess the same
standards as the summative assessments• Include the same item types and formats, including
performance tasks, as the summative assessments• Yield overall scale scores, overall achievement level
designations, and claim score information– Report against the same scale as the summative
test
11
Smarter BalancedInterim Comprehensive Assessments (ICA)
• Examples of the use of ICAs include:
− A new student from another state is given the previous year’s ICA.
− Mid-year a teacher gives an ICA to gauge how students might perform on the summative assessment.
12
Smarter BalancedInterim Comprehensive Assessments (ICA)
• This document is intended to assist LEA CAASPP coordinators, site coordinators, and test administrators in planning for the administration and local hand scoring of the interim comprehensive assessments (ICA). The following table provides key information, including the total number of items appearing on each ICA. This total includes items that are both machine scored and hand scored. Also included on this table are the number of items that require local hand scoring on the non-Performance Task (PT) constructed response, the PT constructed response, and the PT essay.
13
http://www.cde.ca.gov/ta/tg/ca/icahandscoring.asp
Smarter BalancedInterim Assessment Blocks (IABs)
• Fixed form• Focus on fewer sets of skills (e.g., Geometry) • Flexible; supports instruction and curriculum• Include the same item types and formats, including
classroom activities and performance tasks, as the summative assessments
• Yield overall information for each block• Results are reported as Below Standard, At/Near
Standard, and Above Standard
14
Smarter BalancedInterim Assessment Blocks (IABs)
• Examples of the use of IABs include:
− A teacher uses the argument performance task to determine the degree of a student’s understanding before or after instruction.
− A team of teachers uses a block to become informed about how a group of students are performing in geometry.
15
Smarter BalancedInterim Assessment Blocks (IABs)
16
The following tables are intended to assist LEAs in planning for the administration and local hand scoring of the Interim Assessment Blocks (IAB). Included in each table are the total number of items on each IAB. The total number of items shown includes both machine scored and hand scored items. Each table also provides the number of constructed response and essay items that require local hand scoring.
The entire list of available IABs for grades 3-8 and 11 can be found at
the following web link
http://www.cde.ca.gov/ta/tg/ca/iabhandscoring.asp
TOMS and Digital LibraryACCOUNTS
17
• In order to administer, score and view reports of the Interim Assessments, staff will need to have an active TOMS and Digital Library account
• All TOMS and Digital Library accounts from 2014-2015 are still active and are to be used to administer, score and view reports of the Interim Assessments
• Procedures to create new TOMS or Digital Library accounts, and/or to reset any TOMS or Digital Library account remain the same as last year and are the following:
TOMSACCOUNT CREATING OR RESETTING
18
TOMS Accounts
All teachers need to verify that their existing TOMS accounts from last year are working by logging in to TOMS. If their accounts are not working:
1. They should try to reset their password themselves by clicking on the “Forgot my password” button
2. If any teacher cannot reset their TOMS account, they should contact their school Testing Coordinator and request that the Coordinator reset their TOMS account for them. If their Testing Coordinator isn't able to reset their TOMS account, the Testing Coordinator needs to send an email to Nancy Foote at [email protected] and request that she reset their accounts
3. If any teacher does not have a TOMS account: a. They should contact their school Testing Coordinator and request that the Coordinator create a TOMS account for them. The Testing Coordinator will need to have the staff member sign and submit to them a Security Affidavit before they are granted a TOMS account. If their Testing Coordinator isn't able to create the NEW TOMS accounts, the Testing Coordinator needs to send an email to Nancy Foote at [email protected] and request that she create a TOMS for them
DIGITAL LIBRARYACCOUNT CREATING OR RESETTING
19
DIGITAL LIBRARY Accounts
All teachers need to verify that their existing Digital Library accounts from last year are working by logging in to the Digital Library. If their accounts are not working:
1. They should try to reset their password themselves by clicking on the “Forgot my Password” button
2. If any teacher cannot reset their Digital Library account, they should contact their school Testing Coordinator and request that the Coordinator reset their Digital Library account for them. If their Testing Coordinator isn't able to reset their Digital Library account, the Testing Coordinator needs to send an email to James Overturf at [email protected] and request guidance on the procedures to create a Digital Library account or refer to MEMO-6423 for detailed instructions
3. If any teacher does not have a Digital Library account: a. They should contact their school Testing Coordinator and request that the Coordinator create a Digital Library account for them. If their Testing Coordinator isn't able to create the NEW Digital Library accounts, the Testing Coordinator needs to send an email to James Overturf at [email protected] and request guidance on the procedures to create a Digital Library account or refer to MEMO-6423 for detailed instructions
Note: Coordinators need to log in to the Log in to Digital Library for Coordinators link located at the Student Testing Branch website behind the “Digital Library” tab or (art.smarterbalanced.org)
Interim AssessmentViewing System
20
Interim Assessment Viewing System
Teacher View enhancement is available for TOMS account holders to use for planning and or training purposes
Is accessible through the caaspp.org website
21
Preview the Tests
22
Preview the Tests cont..
23
Interim Assessment Administration
24
Interim Assessment AdministrationDesignated Supports and Accommodations
25
Designated Supports Must be designated prior to the first
day of testing window Available to ELs for whom the need
has been indicated Decision made by educators familiar
with the student’s characteristics and needs
Supports the student has been using during instruction/assessments
Non-embedded supports are to be provided by the school
ELs with an IEP or a 504 Plan have to have the designated supports and accommodations listed on the IEP or 504 Plan.
Interim Assessment AdministrationStudent Log In
26
Interim Assessment AdministrationConsiderations
27
The performance task is the same for both the ICA and IAB for the same grade and subject (i.e., grade 3 ELA),.
Each performance task requires administration of a classroom activity 1 to 3 days before the performance task is administered.
Classroom activities and guidelines are available for download on the TA Resources for the Interim Assessments page at caaspp.org.
Interim Assessment Administration
• Accessing and Administering Interim Assessments• Interim Assessments are administered in the same way as summative tests.
The test administrator (TA) must use the TA Interface and the student must log onto the test through the secure browser.
1. Select the [Test Administrator
Interface] button on the CAASPP
portal at http://caaspp.org.
2. Log onto the TA Interface
using your sign in credentials.
28
Interim Assessment Administration
29
3.Select the test category or grade and content area.
Interim Assessment Hand Scoring
30
Interim Assessment Hand Scoring
31
This table is a Smarter Balanced document that describes a range of estimated times required to complete the hand-scoring portion of the interim assessments.
Non-PT Items Performance Tasks
Grade ELA ReadingShort-Text Items and Brief Writes
Math Short-Text Items
ELA Research Short-Text Items
ELA Full Writes
Math Short-Text Fill-In Table Itemswithout dependencies
Math Short-Text Fill-In Table Itemswith dependencies
Grade 3 15-40 sec. N/A 15-44 sec. 28-646 sec. 5-30 sec. 11-82 sec.
Grade 4 10-46 sec. 17-24 sec. 15-55 sec. 319-1042 sec.4-39 sec.
7-51 sec.
Grade 5 18-61 sec. 11-25 sec. 18-79 sec. 288-1037 sec.3-141 sec.
13-68 sec.
Grade 6 103-393 sec. 17-18 sec. 14-60 sec. 139-146 sec. 55-231 sec. 72-432 sec.
Grade 7 120-345 sec. 13-34 sec. 12-75 sec. 134-148 sec. 81-150 sec. 49-291 sec.
Grade 8 106-475 sec. 10-29 sec. 12-76 sec. 124-151 sec. 87-402 sec. 67-394 sec.
High School 21-107 sec. 8-37 sec. 10-67 sec. 85-177 sec.31-360 sec.
45-301 sec.
Interim Assessment Hand Scoring
32
Most interim assessment items are scored by the Smarter Balanced test delivery engine.
Hand scoring of constructed-response items and performance tasks is a local responsibility.
Results for individual students are generated only after the constructed-response item scores and performance task scores are inputted into the Interim Assessment Hand Scoring System (IAHSS). (Processing time of up to 48 hours)
Scoring is supported by training guides, rubrics, exemplars (i.e., anchor and practice papers).
Interim Assessment Scoringcont.
33
IABs That Do Not Require Local Hand Scoring
ELA, all grades Edit/Revise Listen/Interpret Research
Mathematics, all grades All blocks, except Performance Task blocks
Training Guides and Exemplars
34
• Training Guides and Exemplars for all constructed response items and performance tasks are accessible in TOMS.
• LEAs can access these materials for professional development and training purposes.
35
Videos, Training Guides and Exemplars
Interim Assessment ScoringLogging In…
36
The Interim Hand Scoring System is part of the connected suite of Single Sign-On systems (e.g., TOMS, TA Interface, Completion Reports, etc.)
Hand Scoring SystemHome Page
37
Scoring Responses
38
Training Guides and Exemplars
39
Prep and Check
Sets
Instr
uctio
ns a
nd
Info
rmat
ion
Interim Assessment Hand Scoring Guide
40
http://caaspp.org/ta-resources/interim.html
The Interim Assessment Hand Scoring System User Guide
can be found at the following web link
Interim AssessmentReporting System
41
Interim AssessmentReporting System cont.…
42
Teachers will use their Digital Library logon credentials to access the Data Warehouse to view Interim Assessment
student reports.
Requires same logon credentials used for the Digital Library
Interim Assessment Reporting System Results
43
Reports for lists of students and individual student reports. No aggregate reports.
ICA: Overall scale score (i.e., 2000 to 3000); Achievement Level (Level 1, 2, 3, or 4); and Claim level (Below, At/Near, or Above Standard).
IAB: Level of Below, At/Near, or Above Standard for each Block.
Exportable data file.
Interpreting Interim Assessment Results
44
The extent to which interim assessments were administered under standardized conditions will affect the interpretations.
Interim assessment results should only be used in combination with other evidence of student learning; they should not be the sole basis for making any high-stakes decisions.
IA Reporting System Home Page
45
List of Districts
“List of Students” Display
Presents the following information listed by individual student name: Individual results for students within grade or
subgroup. Overall scores, achievement levels, and error
bands for individual student performance (ICA only).
Overall individual student performance by claim (ICA) or block (IAB).
46
Interim Comprehensive Assessment List of Students
47
ICA Student Report
Student’s Mathematics and ELA/literacy overall score and achievement level (i.e., Level 1, 2, 3, or 4)
Overall score is displayed (scale is 2000 to 3000) and surrounded by error bands marked with brackets
Claim level of Below Standard, At/Near Standard, or Above Standard
List of student accommodations
48
ICA Student Report
49
IAB Student Report
Block level of Below Standard At/Near Standard Above Standard
Multiple blocks on the same report
Current and previous results for each block on the same report
Overall scores, error bands, and achievement levels NOT reported for blocks
50
Interim Assessment BlockList of Students
51
Interim Assessment BlockStudent Report
52
Interim Assessment General Information
LAUSD –DIVISION OF INSTRUCTION
Smarter Balanced Assessment
Scoring Training Plan
Working with the Los Angeles County Office of Education, the Division is arranging training in
Building Educator Assessment Literacy (BEAL) for four 30-person teams of trainers in each of
four areas:
Elementary Math, Secondary Math, Elementary Literacy and Secondary Literacy.
Using secure SBAC items, performance
tasks will be examined and implications for instruction will be discussed. The trainers will then
be eligible to
lead BEAL training of teachers in their local district.53
Interim Assessment General Informationcont.
Technology Updates
1. iOS Upgradea) DO NOT update any pending i-Pad iOS upgrade.
2. All testing device carts should be opened, devices accounted for (including keyboards) and charged
3. For technical assistance or issues with testing devices or infrastructure, email or contact:
a) Testing Hotline - (323) 224-2450i. For immediate issues affecting test environment or technical assistance with testing devices
b) ITD Hotline - (213) 241-5200i. For trouble calls
c) Joe Oliver, Director Information Technology Division 213-241-3837 @ [email protected]
i. For assistance with Testing Device Carts or inventory of Testing Devices
54
Interim Assessment General Informationcont.
TOMS Updates
Test Operations Management System (TOMS) Downtime
Please note that TOMS will be offline
October 1–14
During the downtime, LEAs will not be able to download student data files or score report PDFs; access the Online
Reporting System, interim assessments, or hand scoring for interim assessments; add/delete users; or view completion
status for interim assessments. We anticipate the system to be back online Thursday, October 15, with new system
enhancements that will make 2015–16 version of TOMS easier to use.
55
Interim Assessment General Informationcont.
56
Earbuds
Smarter Balanced Summative Assessments 2015-2016
The Student Testing Branch will provide schools that are not
participating in the iPad 1-to-1 program with earphones for the
Smarter Balanced Summative Assessment.
Schools will receive earphones to accommodate their student
enrollment in grades 3-8 and 11 two to six weeks prior to the
opening of their Smarter Balanced Summative Assessment
testing window.
For More Information
CDE Interim Assessments Web Pagehttp://www.cde.ca.gov/ta/tg/sa/sbacinterimassess.asp
ETS CAASPP Web Sitehttp://www.caaspp.org
California Technical Assistance Center (for LEA CAASPP Coordinators)
LAUSD Student Testing Branchhttp://achieve.lausd.net/testing
213-241-4104
Office of Curriculum, Instruction, and School Supporthttp://achieve.lausd.net/instruction#spn-content
213-241-5333
57
