2010 SAS Institute Bridging Research and Practice

2010 SAS Institute2010 SAS InstituteBridging Research and PracticeBridging Research and Practice

Implementation of the Keystone Implementation of the Keystone ExamsExams

ObjectivesObjectives

Participants will examine and discuss the Participants will examine and discuss the Keystone Exam’s design and Keystone Exam’s design and implementation. implementation.

Participants will view curriculum maps Participants will view curriculum maps designed to complement the Keystone designed to complement the Keystone Exams. Exams.

Participants will review information from Participants will review information from Dr. Maraschiello’s General Session Dr. Maraschiello’s General Session presentation on the Keystone Exams.presentation on the Keystone Exams.

ActivityActivity

In groups of 4-5 discuss how to craft a In groups of 4-5 discuss how to craft a presentation for your colleagues based on presentation for your colleagues based on what you have learned thus far at the what you have learned thus far at the Institute.Institute.

Articulate the model on poster paper.Articulate the model on poster paper.

Share out to large group.Share out to large group.

Keystone ResourcesKeystone Resources

Course curriculum maps are being Course curriculum maps are being developed to aid districts in the developed to aid districts in the development of curriculum.development of curriculum.

Developed by educators.Developed by educators.

Algebra I, Biology, and Literature maps Algebra I, Biology, and Literature maps are in the final stages of development.are in the final stages of development.

Curriculum Course MapsCurriculum Course Maps

Each map has the same organizational Each map has the same organizational structure structure

AlignmentAlignment

Materials and ResourcesMaterials and Resources

CompetenciesCompetencies

Tier 3 VocabularyTier 3 Vocabulary

Keystone Exam DesignKeystone Exam Design

ModulesModules

Skill and content basedSkill and content based

Type of questionsType of questions

Students must also meet local district Students must also meet local district credit and attendance requirements and credit and attendance requirements and complete a culminating project, along with complete a culminating project, along with any additional district requirements.any additional district requirements.

Keystone Keystone AssessmentAssessment

JeopardyJeopardy

Are you ready to

play?

State State Assess-Assess-mentsments

Keystone Keystone DesignDesign

HowHow FAQFAQ

100 100 100 200

200 200 200 400

300 300 300 600

400 400 400 800

500 500 500 1000

600 600 600 1200

State Assessment for 100State Assessment for 100

QUESTION: QUESTION:

What grade levels will continue What grade levels will continue to take the PSSAs?to take the PSSAs?

State Assessment for State Assessment for 100100

ANSWER: ANSWER:

33rdrd-8-8thth and 11 and 11thth


QUESTION: QUESTION: Will the accommodations in place for Will the accommodations in place for

students with IEPs or 504 plans for the students with IEPs or 504 plans for the PSSA assessment apply to the PSSA assessment apply to the Keystone Exams as well?Keystone Exams as well?

State Assessment for 200State Assessment for 200ANSWER: ANSWER: YesYes


QUESTION: QUESTION: What forms the basis of the What forms the basis of the

Keystone and PSSA exams?Keystone and PSSA exams?


ANSWER: ANSWER: Eligible ContentEligible Content


QUESTION: QUESTION: What are two of the four What are two of the four

specific accommodations for specific accommodations for students with an IEP or a students with an IEP or a 504 Plan?504 Plan?


ANSWER: ANSWER: -Presentation

Accommodation-Response

Accommodation-Setting

Accommodation-Timing/Scheduling

Accommodation

http://www.portal.state.pa.us/portal/server.pt/community/testing_accomodations___security/7448


QUESTION: QUESTION:

What are two of the four types of What are two of the four types of accommodations available to accommodations available to ALLALL students taking a state students taking a state assessment?assessment?

State Assessment for 500State Assessment for 500ANSWER: ANSWER: TimeTime

Scheduled extended time Scheduled extended time

PlacePlace

Classroom adaptations Classroom adaptations

GroupingGrouping

Small group testing Small group testing

OtherOther

Other accommodations, not Other accommodations, not listed herelisted here

http://www.portal.state.pa.us/portal/server.pt/community/testing_accomodations___security/7448


QUESTION: QUESTION:

What is PVAAS?What is PVAAS?


ANSWER: ANSWER:

Pennsylvania Value-Added Pennsylvania Value-Added Assessment System (PVAAS).Assessment System (PVAAS).

PVAAS is a statistical analysis of PSSA PVAAS is a statistical analysis of PSSA assessment data, and provides districts assessment data, and provides districts and their schools with progress data to and their schools with progress data to add to achievement data.add to achievement data.

http://www.portal.state.pa.us/portal/server.pt/community/http://www.portal.state.pa.us/portal/server.pt/community/bureau_of_assessment___accountability/7332 bureau_of_assessment___accountability/7332

Keystone Design for 100Keystone Design for 100

QUESTION: QUESTION: What three Keystone Exams will be What three Keystone Exams will be

available to all districts in 2011available to all districts in 2011??


LiteratureLiteratureAlgebra IAlgebra IBiologyBiology

PDE. Keystone Exams Program Overview. Keystone PDE. Keystone Exams Program Overview. Keystone Exams Schedule. Page 3Exams Schedule. Page 3


QUESTION: QUESTION:

The Keystone Exams are aligned to The Keystone Exams are aligned to what standards?what standards?


ANSWER: ANSWER:

The Pennsylvania Keystone Course The Pennsylvania Keystone Course Standards, Assessment Standards, Assessment Anchors/Eligible Content and the Anchors/Eligible Content and the Curriculum Frameworks, each of Curriculum Frameworks, each of which were developed by which were developed by Pennsylvania educators. Pennsylvania educators.

(PDE. Keystone Exams Program Overview. (PDE. Keystone Exams Program Overview.

““Keystone Assessment Anchors/Eligible Content.” Keystone Assessment Anchors/Eligible Content.”

Pg. 3)Pg. 3)


QUESTION: QUESTION: The Algebra I Keystone Exam will have two The Algebra I Keystone Exam will have two

different types of constructed response different types of constructed response items. Both types of constructed response items. Both types of constructed response items will be scored on a scale ranging from items will be scored on a scale ranging from 0-4 points. What are these types of 0-4 points. What are these types of constructed response items?constructed response items?

Keystone Design for 300Keystone Design for 300ANSWER: ANSWER: Scaffolding Completion ItemsScaffolding Completion Items are constructed response are constructed response

items that elicit two-to-four distinct responses from a student.items that elicit two-to-four distinct responses from a student.

Extended Scaffolding Completion ItemsExtended Scaffolding Completion Items are constructed are constructed response items that require students to respond with extraneous response items that require students to respond with extraneous work or explanation for at least part of the item.work or explanation for at least part of the item.

(PDE. Keystone Exams Program Overview. “Algebra I.” Pg. 5)(PDE. Keystone Exams Program Overview. “Algebra I.” Pg. 5)

(That really was too easy for 300 points!)(That really was too easy for 300 points!)


QUESTION: QUESTION: What is the What is the point scalepoint scale for the for the

constructed responseconstructed response items items on the on the BiologyBiology Keystone Keystone Exam?Exam?

0-30-30-40-40-50-5

0-100-10


ANSWER: ANSWER:

0-30-3

(PDE. Keystone Exams Program Overview. “Biology.” Pg. 7)(PDE. Keystone Exams Program Overview. “Biology.” Pg. 7)


QUESTION: QUESTION: What types of questions will be on the What types of questions will be on the

Keystone Exam?Keystone Exam?


ANSWER: ANSWER:

Multiple ChoiceMultiple Choice

(approximately 65% of total (approximately 65% of total score)score)

Constructed ResponseConstructed Response

(approximately 35% of total (approximately 35% of total score)score)

(PDE. “Pennsylvania Keystone Exams.” Frequently Asked (PDE. “Pennsylvania Keystone Exams.” Frequently Asked Questions.)Questions.)


QUESTION: QUESTION:

What is the time limit that should be allotted What is the time limit that should be allotted for each Keystone Exam?for each Keystone Exam?


ANSWER: ANSWER:

There is no time limit for taking There is no time limit for taking the Keystones; however, each the Keystones; however, each Keystone Exam will take Keystone Exam will take approximately 2.5 hours to approximately 2.5 hours to complete.complete.

(PDE. “Pennsylvania Keystone Exams.” Frequently (PDE. “Pennsylvania Keystone Exams.” Frequently Asked Questions.)Asked Questions.)

Keystone Implementation for Keystone Implementation for 100100

QUESTION: QUESTION:

For the graduating classes of 2015 and For the graduating classes of 2015 and 2016, students must demonstrate 2016, students must demonstrate successful completion of secondary level successful completion of secondary level course work in what disciplines?course work in what disciplines?

Keystone Implementation Keystone Implementation for for 100100

ANSWER: ANSWER:

Algebra IAlgebra I

BiologyBiology

Literature Literature

English CompositionEnglish Composition

(PDE. (PDE. Keystone Exams Program OverviewKeystone Exams Program Overview. “Demonstration of . “Demonstration of Proficiency ... As Determined by:” Pg. 2)Proficiency ... As Determined by:” Pg. 2)


QUESTION: QUESTION:

Can students retake a Keystone Exam?Can students retake a Keystone Exam?


ANSWER: ANSWER:

Yes. Students who do not score proficient or Yes. Students who do not score proficient or above may retake the exam (or exam above may retake the exam (or exam module) at the next available testing date.module) at the next available testing date.

(PDE. “Stronger high School Graduation Requirements: Fact Sheet and (PDE. “Stronger high School Graduation Requirements: Fact Sheet and Frequently Asked Questions.Frequently Asked Questions.” Pg3)” Pg3)


QUESTION: QUESTION:

Can a student who scores proficient or Can a student who scores proficient or advanced retake a Keystone Exam?advanced retake a Keystone Exam?


ANSWER: ANSWER:

Yes. The regulation does not preclude Yes. The regulation does not preclude proficient or advanced students from re-proficient or advanced students from re-taking a Keystone Exam.taking a Keystone Exam.



QUESTION: QUESTION:

Can students “test-out” of a course by Can students “test-out” of a course by passing a Keystone Exam?passing a Keystone Exam?


ANSWER: ANSWER:

Yes, Yes, at the district’s discretionat the district’s discretion and and provided that the student scores provided that the student scores “Advanced” on the related Keystone.“Advanced” on the related Keystone.



QUESTION: QUESTION: Will Keystone Exam scores for students Will Keystone Exam scores for students

in middle school count toward high in middle school count toward high school graduation requirements?school graduation requirements?


ANSWER: Yes. The student must also meet the district’s graduation requirements (attendance, course requirements, etc.)

(PDE. “Stronger high School Graduation Requirements: Fact Sheet and Frequently (PDE. “Stronger high School Graduation Requirements: Fact Sheet and Frequently Asked Questions.Asked Questions.” Pg3)” Pg3)


QUESTION: QUESTION:

When will the Keystone Exam scores for When will the Keystone Exam scores for students in middle school count students in middle school count toward AYP? toward AYP?


ANSWER: ANSWER:

A student in middle school who takes a A student in middle school who takes a Keystone Exam may have his/her scores Keystone Exam may have his/her scores “banked” for AYP attribution at a later “banked” for AYP attribution at a later date. date.

(PDE. “FAQ” p.9)(PDE. “FAQ” p.9)

FAQ for 200FAQ for 200

QUESTION:QUESTION:

How will students qualify to complete a How will students qualify to complete a project-based assessment?project-based assessment?


Any student who does not score Any student who does not score proficient on a Keystone Exam after proficient on a Keystone Exam after two attempts will be eligible to two attempts will be eligible to complete a project-based assessment, complete a project-based assessment, provided the student has taken the provided the student has taken the course and met local attendance and course and met local attendance and supplemental instruction requirements.supplemental instruction requirements.(PDE. “Stronger high School Graduation Requirements: Fact Sheet and (PDE. “Stronger high School Graduation Requirements: Fact Sheet and Frequently Asked Questions.Frequently Asked Questions.” Pg5)” Pg5)


QUESTION: QUESTION: Can a student who scores proficient or Can a student who scores proficient or

advanced complete a project-based advanced complete a project-based assessment to raise their score?assessment to raise their score?

FAQFAQ for 400 for 400

No. The project-based assessment is No. The project-based assessment is designed expressly to help students designed expressly to help students supplement a Keystone Exam score in supplement a Keystone Exam score in order to meet the graduation requirement order to meet the graduation requirement of proficiency. A project-based of proficiency. A project-based assessment can raise a student’s assessment can raise a student’s Keystone score to the Keystone score to the proficient cut proficient cut score, but not beyond it.score, but not beyond it.(PDE. “Stronger high School Graduation Requirements: Fact Sheet and (PDE. “Stronger high School Graduation Requirements: Fact Sheet and Frequently Asked Questions.Frequently Asked Questions.” Pg5)” Pg5)


QUESTION: QUESTION: If a project-based assessment raises a If a project-based assessment raises a

student’s Keystone score, will that student’s Keystone score, will that proficient score count toward AYP? proficient score count toward AYP?


No. The score from a student’s highest No. The score from a student’s highest Keystone exam will be used for the Keystone exam will be used for the purpose of determining AYP. purpose of determining AYP.


QUESTION: QUESTION: Are the Keystone Exams aligned with Are the Keystone Exams aligned with

the National Common Core the National Common Core Standards ?Standards ?


ANSWER:ANSWER:

There is a strong alignment between the There is a strong alignment between the Common Core Standards and the PA Common Core Standards and the PA Academic StandardsAcademic Standards; refer to the ; refer to the Keystone Assessment Anchors and Keystone Assessment Anchors and Eligible Content to see what specifically Eligible Content to see what specifically will be assessed.will be assessed.

(Dr. (Dr. RichardRichard Maraschiello and Dr. Jean Dyszel)Maraschiello and Dr. Jean Dyszel)


QUESTION:QUESTION:What are the four Performance Levels for What are the four Performance Levels for

the Keystone Exams?the Keystone Exams?


ANSWER:ANSWER:Below BasicBelow BasicBasicBasicProficientProficientAdvancedAdvanced

(Draft Proficiency Level Descriptors. 2010)(Draft Proficiency Level Descriptors. 2010)

FAQFAQ 1200 1200

QUESTION: QUESTION: What is the basis for the questions What is the basis for the questions

on the SAS Classroom Diagnostic on the SAS Classroom Diagnostic Tools?Tools?

FAQFAQ 1200 1200

ANSWER:ANSWER:

The Classroom Diagnostic Tools are The Classroom Diagnostic Tools are based on content covered by the based on content covered by the Keystone Exams and the Keystone Exams and the Pennsylvania System of School Pennsylvania System of School Assessments and includes an Assessments and includes an interactive and dynamic reporting interactive and dynamic reporting suite.suite.

BONUS ROUND!BONUS ROUND!

QUESTION: QUESTION:

Are Keystone Exams the only Are Keystone Exams the only component necessary to complete component necessary to complete graduation requirements? graduation requirements?

BONUS ROUNDBONUS ROUND

ANSWER:The Keystone Exams are one component of Pennsylvania’s new system of high school graduation requirements. To receive a diploma, students must also meet local district credit and attendance requirements, complete a culminating project, and pass any additional district requirements.

Documents

2010 SAS Institute Bridging Research and Practice