Multi Source Feedback. An Essential Tool for Enhancing

Multi Source Feedback. An Essential Tool for Enhancing Student Learning and Enriching Future

Education

Presentation to Bluenote EMEA Conference 2018

6-7 November 2018

Esam Agamy

Dean, QA, IE and Accreditation

Hiba Jadallah

Data Analyst

Contents

UoS at a glance

Multi Source Feedback. Concepts and Importance

MSF Implementation at UoS

Lessons Learnt and Recommendations

Contents

UoS at a glance

Multi Source Feedback. Concepts and Importance

MSF Implementation at UoS

Lessons Learnt and Recommendations

0

2

4

6

8

10

12

14

16

97-98 98-99 99-00 00-01 01-02 02-03 03-04 04-05 05-06 06-07 07-08 08-09 09-10

1. Shari’a & Law

2. Arts & Sciences

3. Business Admin.

4. Engineering

6. Fine Arts

12. Community

13. Graduate Studies &

Scientific Research

Launching

Khorfakkan

Campus

9. Medicine

10. Dentistry

11. Pharmacy 14. Sciences

Development of University Campuses and Colleges

5. Health Sciences

Launching

Kalba Campus7. Communication

8. Law

University of Sharjah Campuses

Main campusFine Arts & Design

CampusMedical Campus

Community College

Community College

Community College

Community College

Univ. Branch

Community College

Kalba

Diba

Khor Fakkan

Al Malaiha

Sharjah

160 km

Al Dhaid

Academic Programs Offered at the University

Program Level Number

Bachelor 52Undergraduate Diploma 14

Graduate Diploma 01

Masters 21Doctorate 11

Total 99

8

86979199

9694

1083311513

1244813300

1381114325

1507315301

0

2000

4000

6000

8000

10000

12000

14000

16000

18000

08-09 09-10 10-11 11-12 12-13 13-14 14-15 15-16 16-17 17-18 18-19

Total Enrolled Students

255

448542

693807

1349

11201281

13991464

1837

2050

1753

2041

2285

27082700

0

500

1000

1500

2000

2500

3000

00-01 01-02 02-03 03-04 04-05 05-06 06-07 07-08 08-09 09-10 10-11 11-12 12-13 13-14 14-15 15-16 16-17

Graduated Students

The University graduated 26,900 students by the end of 2017/2018

64.4%

39.4%

41.1%

8.3%

10.8%

10.7%

20.3%

40.1%

38.8%

6.9%

9.6%

9.4%

Graduate

Undergraduate

University Total

Enrolled Students by Nationality

UAE GCC Other Arabs Others

University students come from 98

different nationalities10

Medical & Health

Sciences Sector

Fine Arts &

Design Sector

Community College

Sector

Subject Based

Programs Sector

UoS Education Systems according to Curriculum

Structure and Main Delivery Methods

Integrated curricula

PBL/TBL

Clinical rotation

Modules

Creative work

Hands on

experience

Vocational training

Subject based

lectures and

practicals

Almost one

instructor per

subject

Semester wise

Multi instructor

modules

May lat for more

than a year

3 phases program

PBL/TBL weekly

sessions

10 week rotations

Workshops and

practical sessions

Field work

11

Contents

UoS at a glance

Multi Source Feedback. Concepts and Importance

MSF Implementation at UoS

Lessons Learnt and Recommendations

13

(1) formative decisions and feedback

about teaching improvement;

(2) summative decisions and feedback

for merit pay and contract renewal;

and

(3) formative decisions and feedback

about professional behaviors in the

academic setting.

MSF models allow:

14

can be configured for faculty to obtain feedback for

formative and summative decisions on teaching

performance

can be adapted to provide feedback on

professional behaviors of faculty in the academic

as well as clinical setting.

can provide more accurate, reliable, fair, and

equitable decisions than the one based on just a

single source.

15

Multisource ratings Quality feedback

Action plan to Improve Improved

performance

Timely standardized

administration, processing,

interpretation, and feedback the.

Most significant practical concerns

Contents

UoS at a glance

Multi Source Feedback. Concepts and Importance

MSF Implementation at UoS

Lessons Learnt and Recommendations

18

Student senior exit survey

Student satisfaction survey

Alumni survey

Employer survey

Faculty feedback

Accreditation bodies feedback

Advisory boards

External evaluators

Feedback tools

Portfolios used at UoS

Course e-portfolio

Program e-portfolio

Faculty e-portfolio

Field Placement/Practical training/Internship e-portfolio

20

Program e-portfolio

21

22

23

24

Course e-portfolio

25

26

27

28

29

SIS

(Banner)

Course delivery

platform

(Blackboard)

HR

System

(Logsis)

Survey

system

(Blue)

Assessment

Management

System

Administration

(Chancellor, VCs,

Deans, etc.)

Faculty

Staff

StudentsIR tools

(crystal report,

templates,

forms, etc.)

Inte

gra

tion

, re

port

ing,

etc

.

Institutional Effectiveness System

Public

Using IT to stimulate:

• Engagement

• Transparency

• E-portfolios

• Communication

• Effectiveness

• Quality culture

31

Semester 1

Sem. 2

Sem. 3

Sem. 4

Sem. 5

Sem. 6

Sem. 7

Sem. 8

Program Advisory Board

Alumni

Employers

An

aly

sis of o

utco

me a

chiev

emen

t (Institu

tion

al

Resea

rch)

Dev

elo

pm

ent

of

ob

ject

ives

, cu

rric

ulu

m,

tea

chin

g &

learn

ing

to

ols

& m

eth

od

s

Survey

Survey

Consultation

Summative Test

Formative Test

Element

Graduation Project

External Evaluation Reports

Student Exit Survey

Chart for Program Outcomes Assessment

(8 Semester Model)

Internship

Student Portfolio

Course Evaluation by faculty

Course Evaluation by Students

Midterm exam

Quizzes

Project

Report and Essay

Presentation

Tools of Assess/Evaluation

• Artificial

Intelligence

• Computing

• Advanced skills

• Innovation

• Entrepreneurship

• Health care

• Space

UAE National Agenda

CHOICE

INTEG-

RATION

APPLICATION

SYNTHESIS

ANALYSIS

COMMUNICATION

INFORMATION DATA KNOWLEDGE

OUTCOMES

• creativity

• research

• problem solving

• problem identification

• teaching / training

• self learning

• team work

• leadership

INPUTS

• community needs

• user expectations

• experience

• culture

• value

• ethics

• autonomous learning

• team work

• critical approach

ELEMENTS OF HIGHER EDUCATION

ENABLING SKILLS• logic / analysis

• interpersonal

• technical / physical

Integration of:

- Research into curricula

- Teaching/learning/assessment

into curricula

- Information Technology into

curricula and services

- Entrepreneurship and

Innovation into education

Current and Future Education

Interdisciplinary

- Research

- Programs

- Activities

Alumni relations

Supporting Policies and

Procedures

Logistic support services

Current and Future Education

Integration

THANK YOU

39

Characteristics of a good Assessment System

• Linked to student learning outcomes

• Ongoing (Continuous)

• Formative vs. summative balance

• Assessment drives learning/Assessment for learning

• Transparent to all parties concerned

• Engage faculty

• Engage students

• Immediate feedback

• Lead to closing the loop

40

41

Declared

Curriculum

Delivered

Curriculum

Learned

Curriculum

Gap in curriculum design/delivery/learning

What we assume/claim student learn What is actually presented

What student actually learn

42

Declared

Curriculum

Delivered

Curriculum

Learned

Curriculum

More overlap is needed

What we assume/claim student learn What is actually presented

What student actually learn