Click here to load reader

Smarter Balanced Assessment Consortium. Smarter Balanced Membership

  • View

  • Download

Embed Size (px)

Text of Smarter Balanced Assessment Consortium. Smarter Balanced Membership

PowerPoint Presentation

Smarter BalancedAssessment ConsortiumSmarter Balanced Membership

2 The Assessment ChallengeHow do we get from here?All studentsleave high school college and career ready Common Core State Standards specify K-12 expectations for college and career readiness...and what can an assessment system do to help?Concerns with Today's Statewide AssessmentsEach state bears the burden of test development; no economies of scale Each state pays for its own assessmentsStudents in many states leave high school unprepared for college or careerBased on state standardsInadequate measures of complex skills and deep understandingHeavy use of multiple choiceTests cannot be used to inform instruction or affect program decisions Results delivered long after tests are givenDifficult to interpret meaning of scores; concerns about access and fairness Accommodations for special education and ELL students varyCostly, time consuming, and challenging to maintain securityMost administered on paperNext Generation AssessmentsRigorous assessment of progress toward college and career readinessCommon cut scores across all Consortium statesProvide both achievement and growth information Valid, reliable, and fair for all students, except those with significant cognitive disabilitiesAdminister onlineUse multiple measuresOperational in 2014-15 school yearSource: Federal Register / Vol. 75, No. 68 / Friday, April 9, 2010 pp. 18171-85The U.S. Department of Education has funded two consortia of states with development grants for new assessments aligned to the Common Core State StandardsSmarter BalancedBackground The Purpose of the ConsortiumTo develop a comprehensive and innovative assessment system for grades 3-8 and high school in English language arts and mathematics aligned to the Common Core State Standards, so that... [The assessments shall be operational across Consortium states in the 2014-15 school year]State LedCommitted to Transparency

State-Led GovernanceStates Join Consortium as Governing or Advisory State Governors Education ChiefsState Legislatures State Boards of EducationState Representatives Serve on Executive Committee2 elected co-chairs4 representatives elected by governing statesLead procurement state (WA)Higher education representativesSmarter Balanced StaffWestEd, Project Management PartnerAdvisory CommitteesWho We AreExecutive CommitteeCo-Chairs: Deb Sigman, Ph.D. (CA), Joseph Martineau, Ph.D. (MI)Committee: Deb Sigman (CA); Dan Hupp (ME); Michael Hock, Ph.D. (VT); Mike Middleton (WA); Lynette Russell, Ph.D. (WI); Charles Lenth, Ph.D. (SHEEO-Higher Education Representative); Beverly Young, Ph.D. (CA-Higher Education Representative) Staff Executive Director: Joe Willhoft, Ph.D.Chief Operating Officer: Tony Alpert Director of Strategic Communications and PIO: Eddie Arnold, APRLead Psychometrician: Marty McCall, Ph.D. Director of Higher Education Collaboration: Jacqueline King, Ph.D.Director of English Language Arts / Literacy: Barbara Kapinus, Ph.D.Director of Mathematics: Shelbi Cole, Ph.D.Director of Support for Under-Represented Students: Magda Chia, Ph.D. AdvisorsPolicy Coordinator: Sue Gendron, Ph.D. (former Maine Education Commissioner)Senior Research Advisor: Linda Darling-Hammond, Ph.D. (Stanford University)Technical Advisory CommitteeJamal Abedi , Ph.D.UC Davis/CRESSTRandy Bennett, Ph.D.ETSDerek C. Briggs, Ph.D.University of ColoradoGregory J. Cizek, Ph.D.University of North CarolinaDavid T. Conley, Ph.D.University of OregonLinda Darling-Hammond, Ph.D.Stanford UniversityBrian Gong, Ph.D.The Center for Assessment

Edward Haertel, Ph.D. Stanford UniversityJoan Herman, Ph.D.UCLA/CRESSTJames W. Pellegrino, Ph.D.University of Illinois, ChicagoW. James Popham, Ph.D.UCLA, EmeritusJoseph Ryan, Ph.D.Arizona State UniversityMartha Thurlow, Ph.D.University of Minnesota/NCEO

Smarter BalancedApproachA Balanced Assessment SystemCommon Core State Standards specify K-12 expectations for college and career readinessAll students leave high school college and career ready Teachers and schools have information and tools they need to improve teaching and learning

Interim assessments Flexible, open, used for actionable feedbackSummative assessments Benchmarked to college and career readinessTeacher resources for formative assessment practicesto improve instruction13A Balanced Assessment SystemSchool YearLast 12 weeks of the year*DIGITAL LIBRARY of formative tools, processes and exemplars; released items and tasks; model curriculum units; educator training; professional development tools and resources; scorer training modules; and teacher collaboration tools.ELA/Literacy and Mathematics, Grades 3-8 and High SchoolComputer AdaptiveAssessment andPerformance TasksComputer AdaptiveAssessment andPerformance TasksScope, sequence, number and timing of interim assessments locally determined*Time windows may be adjusted based on results from the research agenda and final implementation decisions.Performance Tasks

ELA/literacyMathematicsComputer Adaptive AssessmentELA/literacyMathematicsOptional InterimAssessmentOptional InterimAssessmentRe-take option availableSummative Assessment for AccountabilityAssessment system that balances summative, interim, and formative components for ELA and mathematics: Summative Assessment (Computer Adaptive)Mandatory comprehensive assessment in grades 38 and 11 (testing window within the last 12 weeks of the instructional year) that supports accountability and measures growthSelected response, short constructed response, extended constructed response, technology enhanced, and performance tasks Interim Assessment (Computer Adaptive)Optional comprehensive and content-cluster assessmentLearning progressionsAvailable for administration throughout the yearSelected response, short constructed response, extended constructed response, technology enhanced, and performance tasks Formative Processes and Tools Optional resources for improving instructional learningAssessment literacy

Using Computer Adaptive Technology for Summative and Interim AssessmentsProvides accurate measurements of student growth over timeIncreased precisionItem difficulty based on student responsesTailored for Each StudentLarger item banks mean that not all students receive the same questionsIncreased SecurityFewer questions compared to fixed form testsShorter Test LengthTurnaround time is significantly reducedFaster ResultsGMAT, GRE, COMPASS (ACT), Measures of Academic Progress (MAP)Mature TechnologyK-12 Teacher InvolvementWrite and review items/tasks for the pilot test (2012-13) and field test (2013-14)Develop formative assessment practices and curriculum tools for inclusion in digital library (2013-14)Data Review of the Pilot test itemsDevelop scoring criteria for performance tasks Smarter Balanced Digital LibraryYour state is part of the Smarter Balanced Consortium, which is designing new summative and interim assessments for member states.Smarter Balanced is guided by the belief that the effective use of a balanced assessment system can improve teaching and learning.Smarter Balanced is designing a Digital Library to provide resources, tools and professional learning support for educators in your state.Your instructional expertise will be a valuable contribution in the development of this powerful resource.

Page 17

State Network of Educators (SNE)Smarter Balanced and Wisconsin are seeking the expertise of a highly selective group of educators to:Review and contribute resources for the Digital LibraryGet early access to resourcesTake advantage of new collaboration functionality

We invite you to apply between May 1 May 30, 2013. Page 18

Who should apply for the SNE?The State Network of Educators will be comprised of qualified educators in K-12 and higher education with expertise in:Formative Assessment (e.g., collecting evidence of student learning as you teach and using it to adjust instruction)Common Core State Standards for English Language Arts (ELA) and/or MathematicsGeneral EducationGifted and Talented students English Language Learners (ELL)Students With Disabilities (SWD)Note: A few positions for science and social science educators are available.

Page 19

We invite you to be part of this opportunity, where you will connect with colleagues in common grade levels and content areas throughout the Smarter Balanced states.Higher Education CollaborationInvolved 175 public and 13 private systems/institutions of higher education in applicationTwo higher education representatives on the Executive CommitteeHigher education lead in each state and higher education faculty participating in work groupsGoal: The high school assessment qualifies students for entry-level, credit-bearing coursework in college or universityAssessment System ComponentsSummative Assessment (Computer Adaptive)Assesses the full range of Common Core in English language arts and mathematics for students in grades 38 and 11 (interim assessments can be used in grades 9 and 10)Measures current student achievement and growth across time, showing progress toward college and career readinessIncludes a variety of question types: selected response, short constructed response, extended constructed response, technology enhanced, and performance tasksAssessment System ComponentsInterim Assessment (Computer Adaptive)Optional comprehensive and content-cluster assessment to help identify specific needs of each studentCan be administered throughout the yearProvides clear examples of expected performance on Common Core standardsIncludes a variety of question types: selected response, short constructed response, extended constructed response, technology enhanced, and performance tasksAligned to and reported on the same scale as the summative assessmentsFully accessible for instruction and professional development

Assessment System ComponentsExtended projects demonstrate real-world writing and analytical skillsMay include online research, group projects, presentationsRequire 1-2 class periods to completeIncluded in both interim and summative assessmentsApplicable in all grades being assessedEvaluated by teachers using consistent scoring rubricsThe use of performance measures has been foundto increase the intellectual challenge in classroomsand to support higher-quality teaching.

- Linda Darling-Hammond and Frank Adamson, Stanford UniversityPerformance TasksAssessment System ComponentsFew initiatives are backed by evidence that they raise achievement. Formative assessment is one of the few approaches proven to make a difference.

- Stephanie Hirsh, Learning ForwardFormative Assessment PracticesResearch-based, on-demand tools and resources for teachers Aligned to Common Core, focused on increasing student learning and enabling differentiation of instruction Professional development materials include model units of instruction and publicly released assessment items, formative strategiesAssessment System ComponentsData are only useful if people are able to access, understand and use them For information to be useful, it must be timely, readily available, and easy to understand. -Data Quality CampaignOnline ReportingStatic and dynamic reports, secure and public viewsIndividual states retain jurisdiction over access and appearance of online reportsDashboard gives parents, students, practitioners, and policymakers access to assessment informationGraphical display of learning progression status (interim assessment) Feedback and evaluation mechanism provides surveys, open feedback, and vetting of materialsSupport for Special PopulationsAccurate measures of progress for students with disabilities and English Language LearnersAccessibility and Accommodations Work Group engaged throughout developmentOutreach and collaboration with relevant associationsCommon-Core Tests to Have Built-inAccommodations

- June 8, 2011

Technology Guidelinesfor New PurchasesMinimum for NewHardwareProcessor SpeedRAMAvailable Memory/StorageResolutionDisplay Size1.0 GHz1 GB1 GB1024x76810 ClassDesktops, laptops, netbooks (Windows, Mac, Chrome, Linux), virtual desktops, thin client, tablets (iPad, Windows, and Android), and hybrid laptop/tablets will be compatible devices provided they are configured to meet the established hardware, operating system, and networking specificationsand are able to be locked down.Operating SystemsWindows 7Mac 10.7Linux (Ubuntu 11.10; Fedora 16)ChromeApple iOS 6Android 4.0(June 2012)Minimum specifications for legacy systems and network requirements will be informed by the Technology Readiness Tool and will be available in August 2012. The most recent version of the document can be found at More on Security:Eligible devices of any form factor or operating system must have the administrative tools and capabilities to lock down the device, to temporarily disable features, functionalities, and applications that could present a security risk during test administration. These include, but are not limited to, Web browser access, cameras (still and video), screen capture (live and recorded), email, instant messaging, Bluetooth connections, application switching, and printing.27TimelineFormative Processes, Tools, and Practices Development BeginsWriting and Review of Pilot Items/Tasks (including Cognitive Labs and Small-Scale Trials)Field Testing of Summative and Interim Items/Tasks ConductedContent and Item Specifications DevelopmentPilot Testing of Summative and Interim Items/Tasks ConductedPreliminary Achievement Standards (Summative) Proposed and Other Policy Definitions AdoptedOperational Summative Assessment AdministeredProcurement Plan Developed

Writing and Review of Field Test Items/Tasks(throughout the school year)Final Achievement Standards (Summative) Verified and AdoptedSummative Master Work Plan Developed and Work Groups LaunchedSample ItemsIllustrate rigor and complexity of ELA/literacy and mathematics items on Smarter Balanced assessments Signal to educators the shifts in instruction that will be required to help students meet the demands of the Common Core and new assessmentsShowcase variety of item types:Selected responseConstructed responseTechnology enhancedPerformance tasksSample items are available at

The sample items illustrate the knowledge and skills students will be expected to demonstrate on the Smarter Balanced assessments, giving educators clear benchmarks to inform their instruction.

While the items are not intended to be used as sample tests, educators can use the items to begin planning the shifts in instruction that will be required to help students meet the demands of the new assessments.

In addition, the sample items showcase the variety of item and task types under development by Smarter Balanced.

It is important to note that these samples represent only a small fraction of the 10,000 items and tasks currently in development to support the Pilot Test in early 2013.29Exploring the Sample ItemsAccessed online through a simulated test platformViewable by:Grade band (3-5, 6-8, and high school) Content claimSelect types (technology enhanced and performance tasks)Themes illustrating learning progressions across grades and difficulty progressionsItem metadata includes:Grade levelContent claimAssessment targetBrief descriptionsSelected scoring rubricsSelected response and technology enhanced items are machine scorable Online feedback and phone support availableThe sample items are interactive within a simulated test platform. Users can select or construct a response.

They can also view the items in a variety of waysby grade band, by content claim across grades and by type.

Items illustrating the learning progressions across grades within the CCSSas well as the range of student achievement within a computer adaptive testare also available.

Users are able to score selected response and technology enhanced items and receive feedback on their answers.

30Accessibility and AccommodationsSample items have some accessibility and accommodations featuresFull range of accessibility tools and accommodations options under development guided by:Magda Chia, Ph.D., Director of Support for Under-Represented StudentsAccessibility and Accommodations Work GroupStudents with Disabilities Advisory CommitteeChair: Martha Thurlow (NCEO)English Language Learners Advisory CommitteeCo-Chairs: Jamal Abedi (UC Davis); Kenji Hakuta (Stanford)Accessibility & Accommodations Framework

The Smarter Balanced assessment system will provide valid, fair, and reliable measures of achievement and growth for English language learners and students with disabilities.

The samples are displayed in a simulated test platform that includes some accessibility and accommodations tools that will be available when the assessments are administered to studentssuch as Braille, translation options, and the ability to change font size, highlight text, or magnify portions of items.

The operational system in the 2014-15 school year will include tools to address visual, auditory, and physical access barriersas well as the unique needs of ELLs

31Find Out MoreSmarter Balanced can be found online at: