REPORTING STUDENT OUTCOMES PROJECT

WORKSHOP

February 2005

Workshop Outline

1. Background

2. Project Implementation

3. Matching Student Data to Test Results

4. Timeframe

5. Frequently Asked Questions

6. Further Assistance

7. Discussion and Questions

BackgroundTo Reporting Student Outcomes

Project

• Endorsement of National Goals for Schooling in the 21st Century

• Agreement to develop key performance measures in eight priority areas

• Establishment of Performance Measurement and Reporting Taskforce (PMRT)

MCEETYA Decisions 1999

The National Goals for Schooling state that students’ outcomes from schooling should be free of negative forms of discrimination based on sex, language, culture and ethnicity, religion or disability; and of differences arising from students’ socio-economic background or geographic location

Reporting by student group

Inform Australian parents of progress towards attainment of National Goals:

• Improving outcomes for all students, especially those who are educationally disadvantaged

• Increased public confidence in school education

• Measuring change and comparing student outcomes over time

Purpose of nationally comparable data

1. Literacy

2. Numeracy

3. Science

4. Civics and citizenship education

5. Information and communication technology

6. Student participation and attainment

7. Vocational education and training in schools

8. Enterprise education

Key Performance Measures

• Annual, full-cohort testing (literacy and numeracy at Years 3, 5 and 7)

• Triennial national sample assessments (science at Year 6, ICT at Years 6 & 10, civics & citizenship education at Years 6 & 10)

• Triennial assessment through OECD Programme for International Student Assessment (PISA) in reading, numeracy and science for 15 year-olds

Sources of Performance Data

Nationally consistent definitions developed to enable reporting on the progress of students by:

• Sex

• Indigenous status

• Language background

• Socioeconomic background

• Geographic location

(An agreed definition for Students with disabilities is still under consideration)

National Definitions

Data Required

• Sex

• Indigenous status

• Language Background– Main language spoken in the home– Country of birth

• Socioeconomic Background– Parental school and non-school education– Parental occupation

How the information will be collected

• For 2005

Special data collection forms for years 3,5 and 7

Student test forms for years 6 and 10 students• For 2006

Integrate data collection process with the enrolment process

Decide whether to collect the data for all students or only the students in the target years

Project Implementation

Does My School Have to be Involved?

• Secondary – no (data only applies for Years 3,5 and 7)

• Linked to Commonwealth funding for the 2005 – 2008 quadrennium

• Schools have a legal Agreement with the Commonwealth for funding

• This project is part of the accountability requirements for funding

Data Implementation Manual

• MCEETYA DATA IMPLEMENTATION MANUAL FOR ENROLMENTS FOR THE 2005 AND 2006 SCHOOL YEARS

• The purpose of the manual is to provide information to assist schools and school systems to make the changes to enrolment forms and associated data collection and storage processes

• Available at www.mceetya.edu.au/public/dm.htm• Hard copy sent to each school in late 2004

The Data Implementation Manual provides:

• A clear statement of tasks to be undertaken, when and why

• A set of “question modules” to be incorporated into enrolment forms

• Indicative layouts for enrolment forms

• Detailed technical specifications

Data Implementation Manual

• Via enrolment forms• Years 3, 5, 6 & 7 students’ sex, Indigenous status, language

background and socioeconomic background

• Via student test forms• Year 10/15 years old students as above plus geographic

location

• Via other means• Geolocation for Years 3, 5, 6 & 7 will be derived from the

school’s address• No action is required by schools

How the information will be collected

• Sex

• Indigenous status

• Language background• LBOTE or non-LBOTE• Main language other than English spoken in the home• Country of birth

• Socioeconomic background• Parental educational attainment• Parental occupation

Information collected via enrolment forms

Sex

• Coding Structure –

1 Male

2 Female

• Note – data must be stored as code; not “male” female” or “m” “f”

Indigenous Status

• Two options for question to collect this data (refer to Manual page 10)

• Coding Structure –1 Aboriginal but not Torres Strait Islander Origin2 Torres Strait Islander but not Aboriginal Origin3 Both Aboriginal and Torres Strait Islander Origin4 Neither Aboriginal nor Torres Strait Islander Origin9 Not stated/Unknown

Note: the not stated/unknown category is not to appear as an option for answering the question on forms

Parental School Education

• Code structure

4 Year 12 or equivalent

5 Year 11 or equivalent

6 Year 10 or equivalent

7 Year 9 or equivalent or below

0 Not stated/unknown

To be collected for both mother/parent 1/guardian 1 and father/parent 2/ guardian 2

Parental non-school education

• Code structure

7 Bachelor degree or above

8 Advanced diploma/Diploma

9 Certificate I to IV (including trade certificate)

8 No non-school qualification

0 Not stated/Unknown

Parental Occupation Group

• Parent should provide a group number – not the actual occupation (4 groups)

• Code structure1 Senior Management etc2 Other business managers etc3 Tradesman/women etc4 Machine operators etc8 Not in paid work in last 12 months9 Not stated or unknown

Main Language other than English Spoken at Home

• Two options for the question• Option 1 is a tick the box based on the most

common languages for a particular state/territory (refer to page 48 for the Queensland list) or a school could use its own list.

• Option 2 asks for specification of the language• Option 2 involves a more complex and time

consuming coding process at the school level

Main Language other than English Spoken at Home

• Coding Structure• There will be a four digit code based on the

Australian Standard Classification of Languages (refer Attachment 6 of the Manual)

• Note: there are over 2,600 languages listed in the Classification!

• Example - 1301 – German• Suggestion – put the codes on the form next to

the boxes if using Option 1 question – this will make it easier for data input

Country of Birth

• Two options for the question• Option 1 is a tick the box based on the most

common countries for a particular state/territory (refer to page 54 for the Queensland list) or a school could use its own list.

• Option 2 asks for specification of the country• Option 2 involves a more complex and time

consuming coding process at the school level

Country of Birth

• Coding Structure

• There will be a four digit code based on the Australian Standard Classification of Countries (refer Attachment 6 of the Manual)

• Note: there are nearly 1400 countries listed in the Classification!

• Example - 1201 – New Zealand

Actions for Schools

1. Check privacy requirements

2. Revise enrolment forms

3. Revise data storage

4. Collect the information

5. Provide data to testing agent

Key steps

• Privacy legislation does not prevent schools from collecting information on student characteristics for national reporting purposes

• Schools may need to review and revise their privacy policies and documentation for parents

• Privacy compliance manual available on AISQ’s Docushare : http://docushare/aisq.qld.edu.au

Privacy legislation

Information for Parents

• An information brochure is available for distribution to parents

• Agreed question modules are in the Manual

• Critical that agreed wording be used to ensure national comparability

• In some cases, there are two alternative question modules – schools may choose the one they prefer

Revise enrolment forms

• To ensure student data record includes all fields on background characteristics

• To ensure the fields match the response options on the enrolment forms

• Establish processes for entering data into computer files

Revise data storage

Software Update

If your school is using software provided by a supplier (eg Maze, PC Schools, Synergetic, Quad, TASS, School Pro)

Each of the suppliers has been notified of the new requirements. Each supplier has indicated that software will be updated to include the necessary fields.

Upgrading dates varies but most indicate early 2005.

Most suppliers have indicated that the upgrade will be provided at no cost.

If You Do Not Have Software

If you do not have specific software (eg using Excel or Access or a own school produced system)

• You will need to update your system to incorporate the necessary fields.

• AISQ can supply an Excel or Access version of a system to store the necessary data in the required fields.

Review school procedures for:

• Distribution and collection of enrolment forms

• Handling queries from parents

• Checking forms for completeness and accuracy

• Following up with parents if forms are incomplete

Collect the information

• Schools which collect student background data only at time of students’ initial enrolment (usually P/1 or 7/8) will need to conduct supplementary surveys so that they have the relevant details for students in Years 3, 5 & 7

• Schools selected to participate in Year 6 national sample assessments will also need to collect information from parents of Year 6 students

Collect the information

MATCHING STUDENT DATA TO TEST RESULTS

AISQ (along with EQ and QCEC) have been working with the Queensland Studies Authority in relation to the means by which student data will be linked to test results.

Link data to test forms

For 2005

• Schools will be asked to supply the data to QSA in an Excel spreadsheet (by email)

• QSA will supply the spreadsheet• It should be possible to simply cut and

paste from a downloaded file from the school’s database into the spreadsheet

• Or alternatively, schools will be apply to directly input the required data into the spreadsheet

For 2005

• The data required in the spreadsheet will include the school code, the school student ID (if applicable), student name, and the relevant student data coded

• Matching will principally be done on student name

For 2006

• It is QSA’s intention to extend the web-based Registration of Young People database to include P – 9 students in order to capture the necessary data

• This would mean a fairly simple upload of the required data to the QSA system or where uploading is not possible, simple web-based data input

For 2006

• However, there are some issues –QSA estimates the cost of extending the RYP system to P – 9 students is in the vicinity of $2.5 million. Proceeding with this will depend on the Government allocating the necessary fundingSecondly, this virtually would mean the implementation of a unique student ID for all students (this is Queensland Government policy), however, the independent sector has difficulties with this

For 2006

• If the RYP system is not extended to be ready for 2006, the system used in 2005 would more than likely be used again.

• AISQ will keep schools informed of progress in the development of the required systems for 2005 and 2006

LANA Tests

• For schools doing the LANA testing as an alternative to that provided by QSA, data will need to be transmitted to ACER.

• There has been no indication as to how this will be undertaken in 2005 or 2006.

• Schools should be in contact with ACER about this issue (AISQ will also be contact and keep schools informed).

TIMEFRAME

In 2005, collect student background information for:• Incoming enrolments• Year 3, 5 and 7 students participating in literacy

and numeracy testing• Year 6 students in selected sample schools for

ICT knowledge and skills testing

Implementation timeline

FREQUENTLY ASKED QUESTIONS

For Parents

• Why is this information being collected?• What are my family’s legal rights to privacy in

regard to the information the school has requested from us?

• Why is the school asking for my occupation details again, as I have already provided this information?

• I am the guardian of a child, but one or both of his/her real parents are alive. Who should answer these questions?

For Schools

• What should a school do if a parent refuses to complete the questionnaire?

• Are secondary schools required to collect the additional data?

• How will the data collection process change after this year?

• How frequently does a school need to revise the data it collects?

For Schools

• What is the reference to coding structure in the Data Implementation Manual all about?

• What do I need to know about the coding structure so that I can process the information I receive from parents?

• What is the difference between Sample A ad Sample B Data Collection Forms which are included in the Data Implementation Manual?

Assistance for schools

• Privacy Compliance Manual• Parent information brochure• Information slide show • Data collection form (2 samples)• Data entry program (if required)• FAQ’s for schools• Telephone/email support

Support materials

HELP LINES

• Email

studentdata@aisq.qld.edu.au

• Telephone 3228 1515

David Robertson

Deidre Thian

Robyn Collins

Help

• If you are having difficulties, AISQ staff can be made available for a school visit to assist.

• Contact David Robertson to discuss further – 3228 1515

• Resource implications for schools • School compliance• Parent compliance • Who should complete the form?• Enrolment data software systems• Training for school staff• FFPOS• Indigenous students• Multi-lingual documentation

Practical considerations

Questions and Discussion