Smarter Balanced UpdatesGetting Ready for 2014-15 Administration
Jan Martin [email protected]
605-773-3246
Field Test Overview
Smarter Balanced Field Test in South Dakota by the numbers
• 150/151 Public school systems• 20/20 BIE/Tribal systems• 36/53 Non-public systems
• 70,560 student took tests • 279,137 tests started • 278,164 tests submitted• 1,200+ district personnel involved• 4 SD DOE Staff with tech support from BIT
Were the schools ready?
• Yes and no. • A key learning was while the schools have
the technology, how it is used with students vary across the state.– Schools with one-to-one Chromebooks,
iPads, or other devices – less student issues.
- Schools with limited access especially in the elementary, more significant issues.
Themes that emerged from the survey feedback:
• If students and staff did practice tests, the field test went smoother
• Tech staff must be involved • Shift to on-line testing created confusion
and concerns with accommodations• Text-to-speech and sound the biggest
problem across all respondents.• Help desk was used with varying success
A comment from the field
• Overall, for the field test, it went well. We all knew the test would be challenging. As a parent, my own son came home and shared that he was very glad that the writing part could be done with a keyboard. He stated, “I don’t like to write, but if I could do it on a computer,…that makes it a lot easier! I wrote a lot for the Smarter Balanced test!”
Getting Started for 2015
Coming Attractions
• Smarter Balanced is more than a single test!
• Test Window – March 2 – May 15, 2015• (Grade 11 starts testing March 30)
By late fall, public schools will have access to resources for formative (Digital Library) and interim assessments (comprehensive and content blocks) .
Next Steps
• AIR (American Institutes for Research) will be the vendor to deliver Smarter Balanced for South Dakota
• October 6- 17, 2014 Online Panel for Achievement Setting – To register, go to
SmarterBalanced.org/OnlinePanel
Next Steps: Setting Achievement Levels A Two Part Process
• Part 1 October 6- 17, 2014 Online Panel for Achievement Setting – To register, go to
SmarterBalanced.org/OnlinePanel – This process is open to educators,
administrators, parents, community members – 6 hours of time to complete
Next Steps: Setting Achievement Levels A Two Part Process
• Part 2 In- person Panels • October 13 – 20
– Educators from across the participating states– South Dakota has an equal voice in the
panels
In early November, all participating states will vote on the achievement levels for each grade and each content.
Smarter Balanced and Accountability • PHASE-IN OF SCHOOL PERFORMANCE INDEX
– School Performance Index same indicators as in 2012-13:
• High School: Student Achievement, High School Completion, College & Career Ready
• Elementary and Middle School: Student Achievement, Attendance • Reset AMO targets and goals due to new assessment, then reset every six
years • Set Baseline for student growth using assessment results• • 2015-16• Add Academic Growth Indicator at the Elementary and Middle School level• Incorporate two years of achievement results into the Student Achievement • Indicator• Incorporate Accuplacer, and NCRC scores into College and Career Ready
Indicator• • • 2016-17• Incorporate SBAC scores into College and Career Ready Indicator• Incorporate three years of achievement results into the Student
Achievement • Indicator
School Performance Index – High School
Indicator #1Student Achievement
Indicator #2High School Completion
Indicator #3College and Career Ready
2014-15 Points: 50 2014-15 Points: 25 2014-15 Points: 25--Percent proficient or higher in ELA and math in grade 11 on 2015 state assessment (math and ELA equally weighted)
SBAC - current juniors
-- Graduation rate --Completer Rate (Completer and 4 year Graduation rates weighted equally)
--percent of 2013-14 graduates with ACT math sub-scores 20 or higher--Percent of 2013-14 graduates with ACT English sub-scores 18 or higher(Math and English rated equally)
2015-16 Points: 40 2015-16 Points: 30 2015-16 Points: 30--Percent proficient and advanced in ELA and math in grade 11 on state assessment (2015 and 2016 assessments included; math and ELA equally weighted) Calculation includes: --Gap Group score--Non-Gap Group score
SBAC – current juniors
-- Graduation rate --Completer Rate (Completer and 4 year Graduation rates weighted equally)
-- College Ready – percent of 2014-15 graduates meeting ACT, or Accuplacer benchmarks in reading or math (Math and Reading are equally weighted)-- Career Ready – percent of 2014-15 graduates earning a NCRC certificate (Up to 10 points if the school uses the assessment; if not, all 30 points come from college readiness)
2016-17 Points:40 2016-17 Points: 30 2016-17 Points: 30
--Percent proficient and advanced in ELA and math in grade 11 on state assessment (2015, 2016, 2017 assessments included; math and ELA equally weighted) Calculation includes: --Gap Group score--Non-Gap Group score
SBAC – current juniors
-- Graduation rate --Completer Rate (Completer and 4 year Graduation rates weighted equally)
-- College Ready – percent of 2015-16 graduates meeting ACT,
SBAC or Accuplacer benchmarks in reading or math SBAC scores from 2015-16 -- Career Ready – percent of 2015-16 graduates earning a NCRC certificate (Up to 10 points if the school uses the assessment; if not, all 30 points come from college readiness)
Smarter Balanced is more than a summative test
Digital Library & Interim Assessments
Interim Assessments
• Comprehensive fixed form interim assessment • Blocks for specific elements such as literary reading• Adaptive interim assessment• Scoring of constructed-response items done at local
level and added to the student score for a complete score.
• First of the interim assessments will be live early January
• Optional for use at the local level• One more resource to better understand the
assessment system
Planning for test administration
Test Window
• Grades 3 – 8 students can start testing after March 10 and the window closes on May 15.
• Grade 11 students can start testing after March 30 and the window closes on May 15.
• Why the difference? – Consortium determined that in order to have
comparability between states, especially for grade 11 there needed to be some specificity for when testing could happen.
Planning for Administration – Set up
• Install browsers after updates are released • Control automatic updates for Google and Apple
products • Install Julie voicepack for Windows machines • Set designated supports and accommodations in
ART (was TIDE) • Determine who will be administering tests• All test administrators must go through online
training • Non-certified staff can’t administer tests• Keep IC up to date
Training Modules
• Available for use at local level in mid-November
What is a CAT?Administration and Registration Tools (ART)Smarter Balanced Test Administration
OverviewTest Administrator InterfaceStudent InterfacePerformance Task OverviewUniversal ToolsAccessibility and Accommodations
Training Expectations
• Anyone involved with administration will be required to watch all modules and pass an on-line training test.
• Modules and test will be available with plenty of time to complete needed training.
Planning for Administration – Timing
• Plan a minimum of 4 days or time for at least 7 sessions (4 sessions for ELA and 3 for Math) plus time for classroom activities.
• The CAT tests must be divided into several sessions so students can have breaks. The test is untimed.
• Classroom activities must be done before the performance task is administered.
• Once a CAT is started, student has 45 days to complete before test expires.
• Once a PT is started, student has 10 days to complete before test expires.
Estimated testing times CAT must be divided into multiple
sessions!
Resources for Practice
• http://sbac.portal.airast.org/practice-test/calculators/
• http://sbac.portal.airast.org/practice-test/
• http://sbac.portal.airast.org/
Test Blueprints and Scoring Information
Sample of test blueprints
http://www.smarterbalanced.org/wordpress/wp-content/uploads/2014/05/ELA_Preliminary_-Blueprint-2014_04-30Final.pdf
Scores
English Language Arts
Total Scale Score and Achievement Level + information on: Reading
Writing
Speaking/Listening
Research
Mathematics
Total Scale Score and Achievement Level + information on:
Concepts & Procedures
Problem Solving & Modeling/Data Analysis
Communicating Reasoning
Claims and Achievement Level Descriptors
• Information on Achievement Level Descriptors and Content Claims http://www.smarterbalanced.org/achievement-levels/
• Overall claims are focused on progress toward college and career readiness in the subject
Sample Grade 3 ELA Descriptor
Reading Literary Texts • Target 1.Key Details: Use explicit details
and information from the text to support answers or basic inferences
• 4 levels of claims/achievement levels with 3 or higher the goal for students to be on-track for career and college readiness. – Level 3 Claim: Students should be able to use
explicit details and information from the text to support answers or basic inferences in texts of moderate-to-high complexity.
Critical Odds and Ends
• Security issues are of the utmost importance and districts must revisit their cell phone policies and practices. Students can not have a cell phone on their body during testing sessions. Department policy is that there are no cell phones allowed in a testing session.
More Odds and Ends
• JDC/Colony/other juvenile facilities without internet access – paper/pencil will be available and managed in a different manner. Paper/pencil is limited and not available for except for the special cases.
• As more details are available, district coordinators will be sent information.
Questions
Main Smarter Balanced Contact:Jan Martin [email protected]
AccommodationsBeth Schiltz [email protected]
Recommended
