Self and Peer Assessment ToolBlackboard

Lesley Drumm

OverviewWhy peer assess?Using the Self and Peer Assessment Tool in

BlackboardProblems and issues

Why use peer assessment?Marking of cv and covering letters

A new approachPeer marking to get students to look at other students’ cvs from

an employer’s perspective – to put themselves in the shoes of an employer

Setting the system upSee attached notes

demo

Issues setting up the systemComplicated interface:

Peer Assessment upload (where the questions and answers go)

Control Panel, Course Tools, Self and Peer Assessment (to check who has uploaded/evaluated)

Drop down icon which only appears on rolloverGrade centre (where peer grades are sent so students can

access feedback via My Grades)

Issues using the system2 students said they couldn’t upload to peer

assessment (maybe they left it too late) ???System allocates people to people not work to work

BIG PROBLEM if a student doesn’t submitSolution – copy student work from BB and allocate to students

for evaluation via email (time consuming)

GradingStudents in general graded too high – even though

criteria were givenI graded based upon their evaluations rather than

submitted work – set up another column in grade centre

Student FeedbackComments that:They liked seeing other students’ workSome students didn’t anonymise their work – this

caused issues with some markersThey learned something about their own work from

marking others

Student were ok with the fact that their work was marked by others but their grade was for their evaluations.

Conclusion

The idea worked well but the tool could have been better had it assigned work to people rather than people to people.

Bibliography Chin, D. (2005). Peer assessment in the algorithms course. In: ITiCSE  ’05 Proceedings of

the 10th annual SIGCSE conference on Innovation and technology in computer science education. [Online]. 2005, pp. 69 – 73. Available from: http://dl.acm.org/citation.cfm?id=1067445.1067468&coll=DL&dl=ACM&CFID=299566787&CFTOKEN=88857688. [Accessed: 21 March 2013].

Hamer, J., Ma, K.T.K. & Kwong, H.H.F. (2005). A method of automatic grade calibration in peer assessment. In: Proceeding ACE  ’05 Proceedings of the 7th Australasian conference on Computing education - Volume 42. [Online]. 2005, pp. 67–72. Available from: http://dl.acm.org/citation.cfm?id=1082424.1082433&coll=DL&dl=ACM&CFID=299566787&CFTOKEN=88857688. [Accessed: 21 March 2013].

Hamer, J., Pruchase, H., Denny, P. & Luxton-Reilly, A. (2009). Quality of peer assessment in CS1. In: ICER  ’09 Proceedings of the fifth international workshop on Computing education research workshop. [Online]. 2009, pp. 27–36. Available from: http://dl.acm.org/citation.cfm?id=1584322.1584327&coll=DL&dl=ACM&CFID=299566787&CFTOKEN=88857688. [Accessed: 21 March 2013].