Workshop onEnhanced Self-Evaluation Platform (SEP) on Information Technology in Education

LIU, Man Lee & HO, Chung Hong

Centre of ExcellenceTeachers of STFA Yung Yau College

Content of Presentation

Milestones of SEP Development

Basic Operations of SEP

Enhanced Features of SEP

Questions and Answers

Enhanced Features of SEP –Phase I & II

Phase I User Integration with other system Managing survey

Re-construct attribute(s) Assign and remove attribute(s) of multiple survey items Manage published survey Import and export questionnaire(s)

Questionnaire for PDA Enhanced multi-selection survey item Result export (raw data / report)

Phase II Data Sharing (DS) Knowledge Management (KM)

Basic Operation of SEP

Installation No Apache or MySQL installed; Download the SEP package from

SEP Websitehttp://www.emb.gov.hk/sep/eng

or http://www.emb.gov.hk/sep/chiESDA Websitehttp://svais.emb.gov.hk/kpmweb/eng

or http://svais.emb.gov.hk/kpmweb/chi

System Login username: esda password:+-*/

System Login username: admin password: admin

System Parameters Setting [System Tools] > System Parameters

Setting Define

School Year Setting Password Management Domain Name / IP Setting Other Links Setting Folder Setting System Registration

User Management Import User List

Extract Student Accounts from WebSAMS

1. Logon to WebSAMS, select “Data Management” > “Query Maintenance”

2. Click “Add Advance” button

3. Input the “Query Name” and “Query Description”

Extract Student Accounts from WebSAMS

In the “SQL Statement” field, input the script as below-

Group Management Set privilege of different group

Create Survey fromSurvey Item Bank (SIB)

“Survey Generator” > “Create Survey”

Click “Add Questionnaire” Select “From SIB” Select a questionnaire

Create Survey fromSurvey Item Bank (SIB)

Create Survey fromSurvey Item Bank (SIB)

Click “Publish” button; Select the language and click “OK”

button.

Report Generation

[Report Generator] > [Report Generator]

Cross-Group Comparison Cross-Item Comparison Cross-Timeframe Report

Cross-Group Comparison for Questionnaire

(See Section 7.3.3 of Operation Manual for details)

1. Mouse over to [Report Generator] and then click [Report Generator].

2. In the “Survey Search” table, click [Search] to find the questionnaire.

3. Go into either the “All-in-one Report” or “Click-to-view” report of the questionnaire.

4. Click [Cross Group Comparison].

5. Select the groups to compare the data and then click [Next Step].

Cross-Item Comparison for Questionnaire(See Section 7.3.4 of Operation Manual for details)

1. Mouse over to [Report Generator] and then click [Report Generator].

2. In the “Survey Search” table, click [Search] to find the questionnaire.

3. Click [Click-to-view] of the questionnaire.

4. Click [Cross Item Comparison] of a particular survey item.

5. The “Cross Item Comparison” template will be displayed.

Cross-Item Comparison for Questionnaire(See Section 7.3.4 of Operation Manual for details)

6. Click [Select Questionnaire] to select another questionnaire which you want to compare with the current questionnaire.

7. At “Questionnaire Search”i) Click [Search] to find the questionnaire.ii) Select the questionnaire and then click [Select].

8. At the “Cross Item Comparison” interface, select “No. of Item(s)” you want to compare between the two selected questionnaires.

9. Select the survey item(s) to be compared in respective questionnaires, and then click [Next Step].

Cross-Timeframe Report for Questionnaire(See Section 7.3.5 of Operation Manual for details)

1. Mouse over to [Report Generator] and then click [Report Generator].

2. In the “Survey Search” table, click [Search] to find the questionnaire.

3. Click [Cross Time Frame].

Enhanced Features of SEP - Phase I

User Integration with other system Managing survey

Re-construct attribute(s) Assign and remove attribute(s) of multiple

survey items Manage published survey Import and export questionnaire(s)

Questionnaire for PDA Enhanced multi-selection survey item Result export (raw data / report)

User Account Integration (UAI) with other system mapping SEP user account with various

system To do this

1. Prepare a PHP script called “SEPAuthorization.php” located in “[SEP]/userscript/”

2. Add a variable “$EnableOtherAuthorization” to “[SEP]/conf/profile.php” with value “true”

(See Section 3.6 and Appendix F of Administrator Manual for details)

Re-construction of Attribute List(See Section 4.3.6 of Operation Manual for the details)

Mouse over to [Survey Item Bank] and then click [Attribute List].

Click [Move Attribute]. Select a “Target Attribute” on the left-hand side Select a “Destination Attribute” on the right-hand side Click [Move Attribute]. A “confirmed moving” dialogue box will be displayed.

Click “Confirm” to complete the operation.

Assign and Remove Attribute(s) of Multiple Survey Items(See Section 4.4.7 for the details)

Mouse over to [Survey Item Bank] and then click [Survey Item].

Search the survey item by clicking the [Search].

In the interface, select the checkbox(es) next to the target survey item(s) and then click [Assign/Remove Attribute(s)].

Assign and Remove Attribute(s) of Multiple Survey Items(See Section 4.4.7 for the details)

To assign or remove attribute(s) from selected survey item(s), take the following actions and then click [Save].

i) To assign attribute(s), select attribute(s) and then click [Add].

ii) To remove attribute(s), select checkbox(es) next to the attribute(s) in “Common Attribute(s)” or “Other Attribute(s)” and then click [Delete].

Manage Published Survey

Able to change the Start/End Date of published surveys.

[Survey Generator] > [Modify Published Survey]

Import and Export Questionnaire(s)

Export Procedures –

Mouse over to [Survey Item Bank] and then click [Item Bank].

At the folder tree of “Survey Item Bank”, click the “School” folder or its subfolders.

Select the appropriate questionnaire(s) and then click [Export Questionnaire(s)]

Save the questionnaire data file.

Import and Export Questionnaire(s)

Import Procedures –

Mouse over to [Survey Item Bank] and then click [Item Bank].

At the folder tree of “Survey Item Bank”, click the “School” folder or its subfolders.

Click [Import Questionnaire(s)].

Browse a questionnaire data file and click [Import].

The page showing details of the selected folder / subfolder in Step 2 will be shown with the imported questionnaires displayed under the selected folder / subfolder.

Questionnaire for PDA

Mouse over to [Survey Item Bank] and then click [Item Bank].

Select “Survey Item Bank” from the folder tree. Click “Check PDA Questionnaire”. Click “OK” in the dialog.

Enhanced Multi-Selection Survey Item

Result Export (Raw Data)

Raw Data Export Procedure Mouse over to [Report Generator] and then

click [Report Generator]. In the “Survey Search” table, click [Search] to

find the log sheet. Go to either the “All-in-one” report or “Click-to-

view” report of the questionnaire. Click [Export Report] to export statistical data

in Excel format. In the download dialogue box, click [Save] to

save the statistical data in your workstation.

Result Export (Report)

Export Reports with Chart Procedures Go to either the “All-in-one” report or “Click-to-

view” (For “Click-to-view, click “View Overall Report”) report of the questionnaire.

Click [Export Report with Chart(s)] to export both statistical data and chart(s) in Excel format.

In the download dialogue box, click [Save] to save the zip file in your workstation.

Extract the files inside the zip file to the same directory.

Open the file “report.xls” to view the statistical data and chart(s).

SEP Enhancement – Phase II (1)

Data Sharing (DS)(P. 107 – 114 of Operation Manual) provides functions for EMB and schools

respectively to generate and disseminate questionnaire survey set(s) online to target respondents / a group of schools and gather survey results into a centralized system

cross-group or cross-school comparison reports can be generated from the collected responses

SEP Enhancement – Phase II (2)

Knowledge Management (KM)(P. 114 – 121 of Operation Manual)

provides a simple means for EMB / schools to

monitor ITEd progress

schools may administer KM survey(s) at any time

and review the results by means of the KM

reports

schools may on request administer the KM survey

and return the data to EMB

DS - Overview

EMB or

DS HostDS Client

DS Questionnaire

Local Target User(s)

PublishedQuestionnaireResponses

Responses

Cross-school, Cross-group Comparison Reports

Responsesfrom

DS Client

1.

2.3.

4.

5.

DS – Properties any SEP server can act as a host (DS HOST) to prepare

a survey and collect data other SEP servers may act as clients (DS CLIENT) to

administer a survey DS survey consists of ONE questionnaire only the questionnaire is prepared by DS Host and should

be distributed to DS clients DS Clients should administer the survey and return the

survey results back to the DS Host ONLY some survey groups can be pre-defined for the

questionnaire to facilitate subsequent data analysis DS Clients are responsible for assigning users to the

pre-defined groups properly

DS – Data Submission

EMB

DS Host

DS Client

DS ClientResponse Data File

(e.g. Email)

Response Data File(e.g. Email)

Online Submission

DS Host can disseminate the DS Questionnaire File to DS client(s) via different means Email FTP URL Zip and encrypt the file, if necessary

DS – DS Host & DS Client

DS – DS Client

ESDARegistration Key

DS / KMRegistration Key

School

1. Enable DS Client Feature2. Define School Sector3. Confirm School Identity

for Data Submission

Registration

1

2

DS - Demonstration

DS Host1. Prepare a DS

questionnaire2. Select target class

levels3. Prepare a target

school list4. Export a DS

questionnaire file9. Import a DS

response file10. View reports

DS Client5. Import a DS

questionnaire file6. Publish a DS

questionnaire7. Do a published

questionnaire8. Export responses to

a DS response file

Knowledge Management (KM)

The objective of school KM feature is to provide a simple means to schools to monitor ITEd progress KM Survey(s) consists of set(s) of questionnaire(s)

prepared by EMB specific KM reports can be generated based on a pre-set

framework schools may administer KM survey(s) at any time and

review the results of the KM reports schools may on request administer the KM survey and

return the data to EMB (via WebSAMS CDS or other means)

KM - Overview

EMB School

KM Questionnaire Set with specific reports

Local Target User(s)

PublishedQuestionnaireResponses

Responses

Cross-school, Cross-group Comparison Reports

Responsesfrom

Schools

1.

3.4.5.

6.

Data Collection Requirement File

2.

School KM Reports

Responses

a set of questionnaires is prepared by EMB in EMB SEP and exported as a KM questionnaire file

schools can download the questionnaire file and import it into School SEP and are free to publish the questionnaires within the KM questionnaire set

the questionnaires are designed with a pre-set framework and a set of special reports can be generated in the report generator

a data collection requirement file is decided for KM data collection

KM - Properties

KM - Dissemination of related files

KM questionnaire set and data collection requirement file can be disseminated to schools through :- SEP Homepage * Email * WebSAMS CDS

* Target for specific schools

KM – Import KM Questionnaire Set Import KM Questionnaire Set

The KM file is available at "School SEP Package Download" of SEP homepage.

Publish KM Questionnaire(s)

KM – Import Data Collection Requirement File Import Data Collection Requirement Fil

e

The requirement file may be made available at "School SEP Package Download" of SEP homepage.

Publish KM Questionnaire(s) based on the requirement file

KM – Export ResponsesExport Responses based on the

requirement file

-To export response data file, all questionnaires defined in the requirement file must be published.

-Only questionnaire data that fall within specific date range / class level(s) as stored in the data collection requirement file will be extracted to a response file.

KM – Data Submission

EMBKM Engine SchoolResponse Data File

(e.g. Email)

WebSAMS CDS

KM – Reports

Results Summary

Self-Evaluation Rubric

Stakeholders’ Questionnaire

Attributed Questionnaire Item