Virginia Department of Education August 2014 2014 - 2015 Alternate/Alternative Assessments Administrator Update Training

Virginia Department of Education

August 2014

2014 - 2015 Alternate/Alternative Assessments

Administrator Update Training

Purpose of this Training To update DDOTs, Special Education

Directors, Title III Coordinators, and instructional leaders on pertinent issues and changes regarding the Virginia Grade Level Alternative (VGLA), the Virginia Substitute Evaluation Program (VSEP), the Virginia Alternate Assessment Program (VAAP), and the Virginia Modified Achievement Standards Test (VMAST).

Administrators are expected to share this information with other school leaders, teachers, and parents.

2

Important Information Legislation in the 2014 General Assembly

eliminated the following Standards of Learning (SOL) tests:

Grade 3 Science Grade 3 History/ Social Science Grade 5 Writing United States History I United States History II

Based on the elimination of these tests, corresponding VGLA and VAAP assessments in these content areas will no longer be available.

3

Important Information

“Due to the number of VGLA Assessments and the significant decrease in the statewide participation in the VGLA, beginning with the 2015-2016 school year, the VGLA Assessments will be eliminated as an assessment option for student with disabilities in all content areas. Please note, however, that while VGLA Assessments are being eliminated for students with disabilities beginning in 2015-2016; at this time, the VGLA Reading tests will continue to be available for eligible students with limited English proficiency.”

Supt. Memo #202-14 dated August 1, 2014

4


Use of Interpreters for alternate/alternative participants who are Deaf or Hard of Hearing

Testing Memo No. 1104 ( September 10, 2013) provides guidance regarding the role of the interpreter before, during, and after the evidence gathering process.

The Virginia Assessment Program Interpreter’s Affidavit has been added to the 2014-2015 Implementation Manuals (VGLA - Appendix B, VAAP - Appendix D and VSEP – Appendix P).5


2014-2015 resources for the VGLA, VSEP and VAAP are available on the Virginia Department of Education web-site at http://www.doe.virginia.gov/testing/alternative_assessments/index.shtml Resources include:

Implementation Manuals* Administrator’s Manual* Participation Criteria Program Forms Professional Development Presentations Student Evidence Identification (SEI Tags) VAAP Aligned Standards of Learning VGLA Worksheets VSEP Evaluation Plans

* These manuals are also available locally from the Division Director of Testing6


The Virginia Modified Achievement Standards Test (VMAST) is only available for:

Algebra I and End-of Course (EOC) Reading to students with disabilities eligible to use credit accommodations for the Standard Diploma

Grade 8 mathematics and reading for students with disabilities pursuing a Modified Standard Diploma.

The Modified Standard Diploma is available only to students who entered the 9th grade for the first time prior to the 2013-2014 school year.

7

Program Updates will include…

Program Overview and Eligibility Information

What’s New for 2014-2015

Important Reminders

2014-2015 Important Dates

Information from 2013-2014 Scoring or Audits

2014-2015 Implementation Manuals will be referenced throughout the presentation. 8

Program Update

VGLA 2014-2015

9

VGLA 2014 - 2015 An evidence-based alternative assessment for the

Standards of Learning (SOL) tests

Available to eligible students with disabilities in Grade 5 Science, Grade 8 Science, Grade 8 Writing, Virginia Studies, and Civics and Economics.

Virginia Studies and Civics and Economics must be assessed at the same grade levels as their non-disabled peers.

Available to eligible Limited English Proficient (LEP) students in grades 3-8 in Reading only

2014 – 2015 VGLA Implementation Manual p. 1

10

Students with Disabilities

Eligibility determined by IEP Team/504 Committee and documented in the IEP or 504 plan.

Eligibility determinations must be made on an individual and course-by-course basis.

Eligibility must be based on Participation Criteria qualifying questions, supporting documentation, and justification statement.

Participation Criteria forms and additional information are provided in the Procedures for Participation of Students with Disabilities in Virginia’s Accountability System available atwww.doe.virginia.gov/testing/participation/index.shtml

2014– 2015 VGLA Implementation Manual p. 1

11

LEP Students

Eligibility for VGLA Reading must be determined by the LEP team and documented in the student’s LEP plan.

Eligibility decisions are based on:• WIDA ACCESS for ELLs Composite Score OR• WIDA-ACCESS Placement Test (W-APT) OR• WIDA Measurement of Developing English Language

(Model) Assessment Additional information is available in Limited English

Proficient Students: Guidelines for Participation in the Virginia Assessment Program available at www.doe.virginia.gov/testing/participation/index.shtml

2014-2015 VGLA Implementation Manual p. 112

LEP Students with Disabilities

Referred to as “dually identified” students

IEP/504 committees and LEP committees must work collaboratively to determine VGLA Reading participation and accommodations based on LEP and disability statuses.

Assessment participation and accommodations must be documented in the IEP/504 plan and the LEP Assessment Participation Plan.

2014-2015 VGLA Implementation Manual p. 1-213

Important Reminders

Anecdotal records and captioned photographs are not allowed as VGLA evidence.

VGLA evidence must be collected under “ Testing Conditions” in which the student does not have access to materials or resources that would provide an unfair advantage.

Multiple attempts to complete the same work sample are not allowed.

Collections of Evidence (COE) should be monitored during development and pre-scored prior to scoring.

2014-2015 VGLA Implementation Manual p. ix

14

Important Dates VGLA 2014-2015

January 5- June 5, 2015

Register students for 2015 VGLA COE submissions (via Student Data Upload or manually)

March 30- June 5, 2015

VGLA Score Entry

June 16, 2015Shipping materials for COE selected for audit arrive in divisions

June 22, 2015Deadline to ship COE selected for audit to Pearson

July 15, 2015Preliminary score reports available in PearsonAccess

July 17, 2015 Deadline for COE score correction requests

July 22, 2015 Audited COE returned to divisions

15

Scoring Issues from2013 -14 VGLA Audit

Evidence fails to address the appropriate Depth of Knowledge• A lack of understanding by the teachers of the expectations for evidence

submitted at each level of knowledge, especially for “Higher Order Thinking.”

Evidence violates Scoring Rule 1 (Student-Generated Work)• Use of open-book resources• Use of clues and hints that assist the student in answering correctly: pre-writing graphic organizers (with words, labels, etc.) reading passages containing answers to questions asked inclusion of examples inclusion of definitions Evidence showing multiple attempts of the same work

sample16

Depth of Knowledge

Students are expected to demonstrate the depth of knowledge addressed by the SOL when completing work samples for the VGLA COE.

If a work sample in the evidence does not demonstrate the depth of knowledge addressed by the SOL, the highest score point the student can achieve is “1.”

17

Depth of Knowledge

All elements of the SOL stem and bullets must be demonstrated.

Key verbs specified in the SOL indicate the cognitive demand that is expected.

Helpful resources:• VGLA Implementation Manual (Appendix B) • SOL Curriculum Frameworks and SOL Enhanced Scope

and Sequence www.doe.virginia.gov/testing/sol/standards_docs/index.shtml

• Enhanced Scope and Sequence Plus• www.ttaconline.org/staff/sol/sol.asp

18

Depth of Knowledge Categories

Higher Order Thinking Analysis, Synthesis & Evaluation

ApplicationUsing known information

to solve new problems

ComprehensionUsing recall information in a basic way

such as explaining a concept in one’s own words

RecallThe lowest level of cognitive process

involves remembering information

19

Sample Key Verbs Higher Order Thinking

Analyze, Arrange, Categorize, Compare & Contrast, Conclude, Construct,Create, Diagram, Differentiate, Discriminate, Justify, Plan, Synthesize

Application Compute, Demonstrate, Estimate,

Give Examples, Graph, Illustrate, Interpret, Investigate, Predict, Solve, Use, Verify

ComprehensionClassify, Collect, Compare, Conduct, Contrast,

Describe, Explain, Interpret, Locate, Order, Rephrase, Sequence, Summarize

RecallChoose, Define, Identify, Label, List,

Match, Observe, Quote, Recite, Select, State

20

Depth of Knowledge (“Recall” Demonstrated)

25

Science SOL 5.4 The student will investigate and understand that matter is anything that has mass and takes up

space; and occurs as a solid, liquid, or gas. Key concepts include

a) distinguishing properties of each phase of matter; The student is expected to

demonstrate understanding at the Comprehension level.

Only Recall understanding is

demonstrated since the properties are simply

identified.

Depth of Knowledge (“Comprehension” Demonstrated)

Science SOL 5.4 The student will investigate and understand that matter is anything that has mass and takes up

space; and occurs as a solid, liquid, or gas. Key concepts include

a) distinguishing properties of each phase of matter; The student is expected to

demonstrate understanding at the Comprehension level.

Understanding at the Comprehension level is

demonstrated by distinguishing properties.

22

Depth of Knowledge (“Higher Order Thinking” Demonstrated)

23

Do you agree that civic and social duties address community needs and serve the public good? Why or why not?Yes, civic and social duties address community needs and serves the public good. By volunteering helping people out and expressing concerns for those in need and by helping issues get solved and making the neighborhood a better place to live builds strong communities.

History/Social Studies SOL CE.3 The student will demonstrate knowledge of citizenship and the rights, duties, and responsibilities of citizens bye) evaluating how civic and social duties address community needs and serve the public good.

The student is expected to demonstrate Higher Order

Thinking.

24

Writing SOL 7.8dThe student will d) Use subject-verb agreement . . .

The student is expected to demonstrate understanding at

the Application level.


demonstrated since subject-verb agreement

is only identified.

Depth of Knowledge (“Application” not Demonstrated)

Scoring Rule 1 Violations Evidence must be Student-

Generated

If the work sample is copied from sources such as the chalkboard/dry-erase board, texts, or computer, the work cannot be considered in scoring.

If the work sample is based on a take-home test, open-book text, or homework, the work cannot be considered in scoring.

If the work sample includes examples or directions with hints, clueing, or prompts that would provide answers or unfair advantage, the work cannot be considered in scoring.

If the work sample is done as a part of a group project or assignment and the contribution of the student is not clearly identified, the work cannot be considered in scoring.

25

26

Hints and ClueingSince both the text and the given example provide clues to the student in completing the

worksheet, the evidence cannot be considered for credit for Science SOL PS.4 b.

Hints and Clueing

27

Since the selection clearly provides answers to the questions asked of the student, the evidence cannot be considered for credit for History/Social Science SOL 3.3 b.

28

Since the student is instructed to use the dictionary, if necessary, to complete the worksheet, the evidence cannot be considered for credit for Reading SOL 2.5 c.

Hints and Clueing

29

Hints and ClueingSince the graphic organizer guides the student in organizing his/her thoughts,

the evidence cannot be considered for credit for Writing SOL 6.7 b.

34

Student is given two attempts for the same worksheet, the evidence cannot be considered for

credit for Writing SOL 6.8 b.

Multiple Attempts

Please type your questions into the Chat Window and send to the host and

presenter.

VGLA Questions

31

Program Update

VSEP 2014 -2015

32

VSEP 2014 - 2015 An evidence-based alternative assessment for

the Standards of Learning (SOL) tests

Available to eligible students with disabilities • enrolled in courses or those who have passed courses with

End-of-Course SOL assessments and

• those who need grade 8 numeracy and literacy certification for the Modified Standard Diploma*

Available with special permission for students with disabilities in grades 3-8 in mathematics and reading

* The Modified Standard Diploma is only available to students who entered the 9th grade for the first time prior to the 2013-2014 school year.

2014 – 2015 VSEP Implementation Manual p. 1

33

English: Writing English: Reading Algebra I Algebra II Geometry Biology Earth Science Chemistry Virginia and United States History World History I World History II World Geography Grade 8 Reading Grade 8 Mathematics

2014 – 2015 VSEP Implementation Manual p. 1

34

VSEP Assessment is Available for the

Following Courses:

List of the Content Areas and Corresponding Standards Available for VSEP Course Work Compilations (CWC) Submissions for the 2014-2015 Administrations

•The SOL defended in the student’s CWC will depend on when the student was enrolled in the course. •Students may be working on previous standards dating back to 2001.

•To ensure students defend the appropriate standards, teachers should refer to the 2014-2015 VSEP Implementation Manual, p. 6 - 7.

1The Modified Standard Diploma is available only to students who entered the 9th grade for the first time prior to the 2013-2014 school year.

2Students submitting a CWC demonstrating the literacy requirement for a Modified Standard Diploma must use the Grade 8 Reading 2002 SOL.

Students in grades 9-12 VSEP CWC Submissions Current Standards

Students in grades 9-12 VSEP CWC Submissions Previous Standards

Numeracy- Grade 8 Mathematics (2009)1

Numeracy- Grade 8 Mathematics (2001)1

Literacy- Grade 8 Reading (2002)2

Literacy- Grade 8 Reading (2002)2

EOC Writing (2010) EOC Writing (2002)

EOC Reading (2010) EOC Reading (2002)

Algebra I (2009) Algebra I (2001)

Geometry (2009) Geometry (2001)

Algebra II (2009) Algebra II (2001 Revised)

Earth Science (2010) Earth Science (2003)

Biology (2010) Biology (2003)

Chemistry (2010) Chemistry (2003)

Virginia & U. S. History (2008)

World History I (2008)

World History II (2008)

World Geography (2008)352014-2015 VSEP Implementation Manual p.6-7

Typical VSEP EOC Students

Are able to demonstrate achievement in grade level content;

Are not able to access SOL tests even with accommodations due to the nature of their disabilities;

Need an alternative method of demonstrating knowledge and skill.

36

Typical VSEP Special Permission Students

Performs on grade level for the SOL in the subject/course to be assessed;

May have a new disability, a rapid deterioration of sensory functions, or a unique and/or challenging disability that precludes access to the SOL even with accommodations.

2014-2015 VSEP Implementation Manual p. 137

Eligibility Process

The IEP Team/504 Committee members complete the Intent to Participate form;

The DDOT and Special Education Director review the form and the DDOT submits to the VDOE through the Single Sign-on Web Systems (SSWS)Drop Box;

VDOE staff review the form to determine if the student has been selected based on VSEP participation criteria with supporting documentation and justification;

2014 – 2015 VSEP Implementation Manual p. 2- 5

38

Eligibility Process

Review results are returned to the DDOT;

Once approval is received, the VSEP Evaluation Plan/Worksheet is developed by the content teacher and the special education teacher;

Evaluation Plan/Worksheet is submitted for local review.

2014– 2015 VSEP Implementation Manual p. 2- 5

39

VSEP Resubmissions

40

What’s New for 2014-2015

41

VSEP Request for Rescore

Divisions may request a failing VSEP CWC be rescored if there is agreement between two division staff members with content expertise and knowledge of the VSEP rubric that the CWC should have received a higher score.

Requests must be reviewed and approved by the division before submission to Pearson.

DDOT must ensure that the original evidence is submitted for rescore and has not been changed in any way.

February 27, 2015 – Fall Request for Rescore Due Date

July 1, 2015 – Spring Request for Rescore Due Date 2014-2015 VSEP

Implementation Manual p. 23

42

Important Reminders

Students are not permitted to participate in the VSEP and the SOL assessment for the same subject area test during the same administration.

School leadership and administration must ensure that all Individualized Education Program (IEP) Teams/504 Committees understand VSEP participation criteria and apply them appropriately when considering students with disabilities for the VSEP.

VSEP evidence must be collected under “Testing Conditions” in which the student does not have access to materials or resources that would provide an unfair advantage.

2014-2015 VSEP Implementation Manual p. ix -x43

Important Reminders

44

VSEP End-of-Course Writing

VDOE will consider requests from school divisions to allow evidence presented in a multiple-choice format for selected students participating in the VSEP End-of-Course Writing assessment.

Requests of this type may be appropriate for students with significant physical disabilities.

Written requests must be submitted by the local Director of Special Education to the Division of Student Assessment and School Improvement prior to the development of the Evaluation Plan Worksheet.

This request is NOT an option for other End-of-Course VSEP assessments.

2014-2015 VSEP Implementation Manual p. 8

45

Important VSEP Dates for Submission of

Intent to Participate Forms

October 3, 2014Divisions are

encouraged to submit as early as possible. Late submissions will be reviewed only if

there are extenuating circumstances.

• Students enrolled in Year long Courses• Students enrolled in 1st

Semester Block Classes• Fall Term Graduates • Resubmissions considered for fall semester

February 6, 2015Divisions are

encouraged to submit as early as possible. Late submissions will be reviewed only if

there are extenuating circumstances.

• Students enrolled in 2nd Semester Block Classes• Spring Term Graduates• Resubmissions (Except for fall 2014 resubmissions)

February 20, 2015 • Resubmissions for fall 2014

46 2014-2015 VSEP Implementation Manual p. iii

Important Dates VSEP 2014-2015

VSEP FALL 2014August 25- November 26, 2014

Register students for fall VSEP CWC submissions (via Student Data Upload or manually)

January 5, 2015Shipping materials for CWC arrive in divisions

January 9, 2015 CWC shipped to Pearson

January 30, 2015Preliminary score reports available in PearsonAccess

January 30, 2015 CWC Returned to Divisions

February 27, 2015 Requests for Rescore shipped to Pearson

47

Important Dates VSEP 2014-2015

VSEP SPRING 2015January 5 – April 10, 2015

Register students for spring VSEP CWC submissions (via Student Data Upload or manually)

May 1, 2015Shipping materials for CWC arrive in divisions

May 15, 2015 CWC shipped to Pearson

June 8, 2015Preliminary score reports available in PearsonAccess

June 5,, 2015 CWC Returned to Divisions

July 1, 2015 Requests for Rescore shipped to Pearson

48

:

Scoring Issues from2013 - 14 VSEP Scoring

Evidence fails to address the appropriate Depth of Knowledge • Lack of understanding by the teachers of the expectations of

evidence submitted at each level of knowledge, especially “Higher Order Thinking”.

Evidence violates Scoring Rule 1 (Student-Generated Work)• Use of open-book resources• Use of clues and hints that assist the student in answering

correctly: pre-writing graphic organizers (with words, labels, etc.) reading passages containing answers to questions asked inclusion of examples inclusion of definitions

Incomplete Student Evidence Identification (SEI) Tags – Not all relevant bullets specified

49

Depth of Knowledge

All elements of the SOL stem and bullets must be demonstrated.

Key verbs specified in the SOL indicate the cognitive demand that is expected.

Helpful resources:

• Depth of Knowledge Categories Based on Bloom’s Taxonomy VSEP Implementation Manual (Appendix F) The list of verbs in each knowledge category has been expanded.

• SOL Curriculum Frameworks and SOL Enhanced Scope and Sequence www.doe.virginia.gov/testing/sol/standards_docs/index.shtml

• SOL Enhanced Scope and Sequence Plus www.ttaconline.org/staff/sol/sol.asp 50

Depth of Knowledge Categories

Higher Order Thinking Analysis, Synthesis & Evaluation

ApplicationUsing known information

to solve new problems

ComprehensionUsing recall information in a basic way

such as explaining a concept in one’s own words

RecallThe lowest level of cognitive process

involves remembering information

51

Key Verbs

Higher Order Thinking Analyze, Arrange, Categorize, Compare & Contrast, Conclude, Construct,

Create, Diagram, Differentiate, Discriminate, Justify, Plan, Synthesize

Application Compute, Demonstrate, Estimate,

Give Examples, Graph, Illustrate, Interpret, Investigate, Predict, Solve, Use, Verify

ComprehensionClassify, Collect, Compare, Conduct, Contrast,

Describe, Explain, Interpret, Locate, Order, Rephrase, Sequence, Summarize

RecallChoose, Define, Identify, Label, List,

Match, Observe, Quote, Recite, Select, State

52

58

History/Social Studies SOL VUS.4 The student will demonstrate knowledge of events and issues of the Revolutionary Period bya) Analyzing how the political ideas of John Locke and the ideas expressed in Common Sense helped shape the Declaration of Independence

Student Response: Thomas Paine wrote a pamphlet called Common Sense with parts of it being included in the Declaration of Independence. John Locke wrote life, liberty, and property and Thomas Jefferson wrote life, liberty and the pursuit of happiness in the Declaration of Independence. John Locke said everybody should be created equal and government should protect the natural rights of everybody in his ideas of social contract. Thomas Jefferson wrote that we hold these truths to be self-evident, that all men are created equal, that they are endowed by their Creator with certain unalienable Rights, that among these are Life, Liberty and the pursuit of Happiness.

Depth of Knowledge(Higher Order Thinking Demonstrated)

The student is expected to demonstrate Higher

Order Thinking.

Response goes beyond describing or explaining (comprehension) to connect and relate ideas and concepts of John Locke to those written by

Thomas Jefferson.

Response goes beyond describing or explaining (comprehension) to connect and relate ideas and concepts of John Locke to those written by

Thomas Jefferson.

54

Reading SOL 8.5 The student will read and analyze a variety of fictional texts, narrative nonfiction, and poetry.

c) Explain how authors use point of view to create meaning. The student is expected to

demonstrate

understanding at the

Comprehension level.


demonstrated since point of view is simply

identified.

Depth of Knowledge(“Comprehension” not Demonstrated)

55

Science SOL 2.1 The student will demonstrate an understanding of scientific reasoning, logic, and the nature of science by planning and conducting investigations in whiche) length, volume, mass, and temperature are measured in metric units and standard English units using the proper tools.

Temperature is measured, using proper tools.

The indicated temperature is identified.

No tool is used.Application is demonstratedApplication is demonstrated

Application is not demonstrated

Application is not demonstrated



Depth of Knowledge(“Application” Demonstrated/Not Demonstrated)

56

Geometry SOL G.7 The student, given information in the form of a figure or statement, will prove two triangles are similar, using algebraic and coordinate methods as well as deductive proofs.



No comparisons are made other than citing the theorem used.

Only Recall understanding is demonstrated.

Depth of Knowledge(“Application” not Demonstrated)

57

Work at the Application level is demonstrated for #6 by expressing the relationship of each pair of

sides using ratios.

Geometry SOL G.7 The student, given information in the form of a figure or statement, will prove two triangles are similar, using algebraic and coordinate methods as well as deductive proofs.



Work at the Application level is

not demonstrated for #7.

Depth of Knowledge(“Application” Demonstrated/not Demonstrated)

No statement is generated that gives examples of at least two pairs of angles that are equal.

58

Hints and Clueing

Since the student is given access to the textbook while completing the worksheet, the evidence cannot be considered for credit for History/Social Studies SOL WHI.3 e.

59

Hints and ClueingSince student has access to the textbook to answer questions, the evidence cannot be

considered for credit for Science SOL ES.10 b.

60

Since the student is using the internet to complete the worksheet, the evidence cannot be considered for credit for Science SOL 6.4 g.

Hints and Clueing

61

Hints and ClueingSince a video guide is provided to the student while viewing the video, the

evidence cannot be considered for credit for Science SOL BIO.3 d.

62

Since an example is provided to the student , the evidence cannot be considered for credit for Mathematics SOL A2 a.

Hints and Clueing

63

Since the definition of “personification” is given, the evidence cannot be considered for credit for Reading SOL 10.3 e.

Hints and Clueing

Additional credit could have been awarded for this evidence, if bullet “b” had been included on the SEI Tag for History/Social

Science SOL WHI.4 b.

Missing Bullet(s)

64


presenter.

VSEP Questions

65

Program Update

VAAP 2014 - 2015

66

VAAP 2014 - 2015 An evidence-based alternative assessment for

students with significant cognitive disabilities. Available to eligible students with disabilities in grades

3 – 8 and high school who are working on academic content reduced in depth and complexity.

Available in reading, writing, mathematics, science and history

High school students participating in VAAP must submit Collections of Evidence (COE) that include reading, writing, mathematics, science and history/social science by the end of their 11th grade school year or according to a schedule determined by the local school division.

2014 – 2015 VAAP Implementation Manual p. X, 1- 2

67

VAAP Division Flexibility for High School Divisions have the option either to continue the

submission of required VAAP content areas in grade 11 only or to develop a schedule in which one or more content areas are submitted in grades 9, 10, or 11.

For example, the division may determine that VAAP Science will be collected in grade 9, History/Social Science in grade 10, and Reading, Writing, and Mathematics in grade 11.

The division must provide this information to the Virginia Department of Education in SSWS for 2014-2015 by completing a form in the Education Registry Application called VAAP Grades. After completing the form in SSWS, click on “Verification Report” and fax the signed copy to (804) 530-4516 by August 22, 2014.

2014 – 2015 VAAP Implementation Manual p. x68

Eligibility Participation is determined by the IEP team based

on the VAAP participation criteria. Refer to the Procedures for the Participation of Students with Disabilities in Virginia’s Accountability system available at www.doe.virginia.gov/testing/participation/index.shtml

Additional information on VAAP Participation and the Determination of Significant Cognitive Disabilities is available at http://www.doe.virginia.gov/special_ed/disabilities/intellectual_disability/guidance_significant_cognitive_disabilities.pdf.

2014 – 2015 VAAP Implementation Manual p. 1.

69

What’s New for 2014 - 2015

History/Social Science Aligned Standards of Learning (ASOL) have been re-organized into three groups.Elementary (grades 4 or 5)Middle (grades 6, 7 or 8)High School (grades 9, 10 or 11)

Teachers must use the grade of student enrollment to select the appropriate History/Social Science group.

2014 – 2015 VAAP Implementation Manual p. vii

70

Important Reminders History/Social Science COE must be submitted

during the same administration as students participating in the SOL tests.

Teachers must select ASOL only from the grade level in which the student is enrolled for Reading, Writing, Mathematics and Science.

For the content areas listed above, the teacher must use the performance level system to indicate whether the student demonstrated the ASOL with:significant support and modification (Level I), partially demonstrated the ASOL (Level II), or fully demonstrated the ASOL (Level III).

71

Important Reminders For Reading, Writing, Mathematics and

Science, the highest score point a student may receive is:4 for Level III3 for Level II2 for Level I

If the performance level is not identified on the SEI tag, the evidence will be scored as Level III.

2014 – 2015 VAAP Implementation Manual p. ix

72

Important Reminders Local school divisions will continue scoring all

VAAP COE in 2014-2015. Audits of selected VAAP COE will be conducted in June to ensure that school division scorers are applying the scoring rubric to student evidence appropriately.

VAAP evidence must be completed under “testing conditions” in which the student does not have access to the subject content or curriculum, hints, clueing, prompts or test taking strategies that would provide an unfair advantage.

2014 – 2015 VAAP Implementation Manual p. ix and x.

73

Important Reminders

Anecdotal records must include the date of performance, a detailed description of the learning environment (instructions, materials and prompts provided) and observed student performance and a statement of accuracy describing the student’s level of achievement on the ASOL.

Work samples (Worksheets, tests or quizzes) that are submitted as evidence may not have been attempted before by the student individually or as a member of an instructional group.

2014 – 2015 VAAP Implementation Manual p. x74

Important Dates VAAP 2014 - 2015

August 22, 2014Deadline to complete “VAAP Grades” for your school division in SSWS in the Education Registry Application

January 5- May 22, 2015

Register students for 2015 VAAP Collection of Evidence (COE) submissions (via Student Data Upload or manually)

March 30-May 22, 2015

VAAP Score Entry

June 5, 2015Shipping materials for COE selected for audit arrive in divisions

June 12, 2015Deadline to ship COE selected for audit to Pearson

July 13, 2015Preliminary score reports available in Pearson Access

July 31, 2015 Audited COE returned to divisions

75

Dynamic Learning Maps (DLM)

Update DLM is a multi-state consortium lead by the University of

Kansas to develop online alternate assessments in reading, writing, and mathematics for students with significant cognitive disabilities.

As stated in Superintendent’s Memo #052-14 dated February 28, 2014, Virginia school divisions will not participate in the DLM operational assessments scheduled to begin in the 2014-2015 school year. Virginia school divisions will continue to administer and score the Virginia Alternate Assessment Program (VAAP) in 2014-2015.

Participation in DLM operational assessments remains under consideration for 2015-2016 and beyond.

76

DLM Update The Virginia Department of Education has developed a plan

of professional development activities to familiarize teachers of students with significant cognitive disabilities with all aspects of the DLM system and assessments. Professional development opportunities will be available beginning in the 2014- 2015 school year and will include: Completion of DLM Professional Development and Testing Modules Completion of the First Contact Survey for a selected student Completion of the Personal Needs Profile for a selected student Selection of Instructional Content in Reading and/or Mathematics Retrieval of instructional information from DLM system Completion of DLM Practice Items Participation in DLM Field Tests Completion of DLM and VDOE surveys and related documentation School divisions are encouraged to consider awarding recertification points to

teachers upon satisfactory completion of professional development activities under this plan.

Supt. Memo 218-14 (August 15, 2014)

77

Scoring Issues from2013 -14 VAAP Audit

Use of the Levels of Performance (Reading, Writing, Mathematics and Science)• Level III Evidence fails to address the skills and

knowledge in the ASOL stem• Level II evidence eliminates too many skills• Level I evidence does not address the basic concept or

skill in the ASOL Evidence violates Scoring Rule 2 (Student-Generated

Work)• Use of hints and clueing that assist the student in answering

correctly: inclusion of definitions and explanations reading passages containing answers to questions asked use of tracing or matching78

Levels of Performance

The Levels of Performance assist teachers in determining the level of performance for each ASOL that is most appropriate for the individual student.• Level I: The ASOL is demonstrated with significant

support and modification

• Level II: The ASOL is partially demonstrated

• Level III: The ASOL is fully demonstrated

2014-2015 VAAP

Implementation Manual p. ix79

Level III – Full Demonstration

The ASOL is fully demonstrated. The student fully demonstrates the knowledge and skill of the ASOL.

If the student’s performance is Level III, the highest score point the student can receive is “4.”

If the student’s level of performance is not identified on the SEI Tag, the evidence will be scored as though it were a Level III.

80

Level III – Earning a “3”

81

Science ASOL 5S-SI 1 The student will demonstrate an understanding of scientific reasoning, logic and the nature of science by planning and conducting investigations in whichc) Appropriate instruments are selected and used to measure length, mass, volume, and temperature in metric units.

Annotation:The evidence for ASOL 5S-SI 1c is presented at Level of Performance III – the student fully demonstrates the ASOL. At this Level of Performance ,the highest score point that can be earned is a “4”.

The evidence was given credit for conducting investigations in which appropriate instruments are selected and used to measure length, mass, volume, and temperature in metric units with 100% accuracy.There is no evidence of planning investigations.

Overall, for the Level of Performance III, the quality of the evidence presented is appropriate and satisfies many of the requirements of the ASOL.

Level III – Earning a “4”

History/Social Studies ASOL HSS-SI 1 The student will plan and conduct investigations in whiche) variables are manipulated with repeated trials.

Annotation:The evidence for ASOL HSS-SI 1e is presented at Level of Performance III – the student fully demonstrates the ASOL. At this Level of Performance, the highest score point that can be earned is a “4”.

•The evidence was given credit for planning the investigations by choosing the variables which would be manipulated. The evidence was also given credit for conducting investigations with multiple trials with 100% accuracy.

Overall, for the Level of Performance III, the quality of the evidence presented consistently and appropriately satisfies most of the requirements of the ASOL.

82

Level II – Partial Demonstration

The ASOL is partially demonstrated. The student demonstrates some of the knowledge and skill of the ASOL

If the student’s performance is Level II, the highest score point the student can receive is “3.”


83

Level II – Earning a “2”

84

Science ASOL 8S-ECO 1 The student will investigate and understand the natural processes and human interactions that affect watershed systems. Key concepts includeb) the location and structure of Virginia’s regional watershed

Annotation:The evidence for ASOL 8S-ECO 1b is presented at Level of Performance II – the student partially demonstrates the ASOL. At this Level of Performance the highest score point that can be earned is a “3”.The evidence shows a partial demonstration of the ASOL by eliminating the requirements of investigation and understanding the natural processes and human interactions that affect watershed systems.The evidence was given credit for locating Virginia’s regional watershed systems on a map with 100% accuracy.There is no evidence of the structure of Virginia’s regional watershed systems.Overall, for the Level of Performance II, the quality of the evidence presented does not satisfy many of the requirements of the ASOL.

Level II – Earning a “3”Writing ASOL 8E-WE 1 The student willa) use standard English rules when writing by using question marks at the end of written questions.

Annotation:The evidence for ASOL 8E-WE 1a is presented at Level of Performance II – the student partially demonstrates the ASOL. At this Level of Performance the highest score point that can be earned is a “3”.

•The evidence shows a partial demonstration of the ASOL by eliminating the requirement of multiple questions.

•The evidence was given credit for using standard English rules when writing by correctly using a question mark at the end of a written question.

Overall, for the Level of Performance II, sufficient evidence is provided for the ASOL.

85

Level I –Demonstrated with Significant Support and

Modification

The ASOL is demonstrated with significant support and modification. The student requires significant support and modification to simplify the task in order to demonstrate the ASOL.

If the student’s performance is Level I, the highest score point the student can receive is “2.”


86

Level I – Earning a “0”

Reading ASOL 7E-CN 1 The student will d) determine author’s point of view in nonfiction text and compare to own point of view

Annotation:The evidence for ASOL 7E-CN 1d is presented at Level of Performance I – the student demonstrates the ASOL with significant support and modification. At this Level of Performance the highest score point that can be earned is a “2”.

•The evidence was not given credit because the student identifies the author’s purpose rather than point of view as required by the ASOL. Therefore, the evidence does not align to the ASOL.

Overall, the evidence submitted does not show any level of individual achievement for the ASOL being defended.

87

Level I – Earning a “2”

Annotation:The evidence for ASOL 5M-NSCE 4b is presented at Level of Performance I – the student demonstrates the ASOL with significant support and modification. At this Level of Performance the highest score point that can be earned is a “2”.

•The evidence shows the ASOL modified to a basic skill of solving one-step word problems using addition. The supports provided were the spaces in which the student could draw pictures to represent the problems.

• The evidence was given credit for correctly solving single-step word problems.

Overall, for the Level of Performance I, sufficient evidence is provided for the ASOL.

Mathematics ASOL 5M-NSCE 4 The student will

b) solve two-step word problems using addition and subtraction of whole numbers.

88

History – Earning a “2”Note: Levels of Performance are not applied to History/Social

Science ASOL

History/Social Studies ASOL HS-G 8 The student will demonstrate knowledge of the physical geography and native peoples, past and present, of Virginia bya) Locating Virginia and its bordering states on maps of the United States

Annotation:The evidence provides only a partially sufficient demonstration of the student’s knowledge and understanding of HS-G 8a.

•The evidence was given credit for locating Virginia and its bordering states on a map of the United States with 100% accuracy.

•There is no evidence of the physical geography and native peoples, past and present, of Virginia or an additional map as required by the ASOL.

Overall, the quality of the evidence presented does not satisfy many of the requirements of the ASOL.

89

Hints and Clueing

90

Since the worksheet clues the student by providing definitions for fact and opinion, the evidence cannot be considered for credit for Reading ASOL HSE-CN 2b.

Hints and Clueing

91

Since the worksheet clues the student by providing explanations of money and bartering, the evidence cannot be considered for credit for History/Social Studies ASOL HS-E 5.

Hints and Clueing

92

Since the caption explains that the student was tracing and matching, the evidence cannot be considered for credit for Mathematics ASOL 3M-NSCE 1a.

Hints and Clueing

93

Since the student is instructed to find the answers on the next page, the evidence cannot be considered for credit for Science ASOL 8S-LS 1c.


presenter.

VAAP Questions

94

Thank you for participating. Please complete and return the

evaluation survey that Pearson will e-mail to you.

Virginia Department of EducationDivision of Student Assessment and School

[email protected]

(804) 225-2102

95

Documents

Virginia Department of Education August 2014 2014 - 2015 Alternate/Alternative Assessments Administrator Update Training