Embed Size (px)
DESCRIPTION
Citation preview
Práticas de Qualidade no Ensino e Aprendizagem – Pombo & Loureiro
Peer assessment as a strategy to promote quality in a bLearning context: a design-based approach
CIDTFF, DE, Universidade de Aveiro
Peer assessment as a strategy to promote quality in a bLearning context:
a design-based approach
Lúcia Pombo & Mª João Loureiro
Práticas de Qualidade no Ensino e Aprendizagem – Pombo & Loureiro
Peer assessment as a strategy to promote quality in a bLearning context: a design-based approach
CIDTFF, DE, Universidade de Aveiro
TopicsContextObjectiveMethodologyConception/implementationAnalysisEvaluationFinal thoughts
Práticas de Qualidade no Ensino e Aprendizagem – Pombo & Loureiro
Peer assessment as a strategy to promote quality in a bLearning context: a design-based approach
CIDTFF, DE, Universidade de Aveiro
contextPhD program in Multimedia in Education module
Distance Education (DE)f2f and at a distance group work (bLearning)
module aim - develop research competences related with literature review
search, select, systematize and synthesize literature related with DEcommunication, collaborative work and assessment competences (self- and peer- assessment)
Práticas de Qualidade no Ensino e Aprendizagem – Pombo & Loureiro
Peer assessment as a strategy to promote quality in a bLearning context: a design-based approach
CIDTFF, DE, Universidade de Aveiro
courseorganization
Ramos (2004)
Práticas de Qualidade no Ensino e Aprendizagem – Pombo & Loureiro
Peer assessment as a strategy to promote quality in a bLearning context: a design-based approach
CIDTFF, DE, Universidade de Aveiro
Objective: • to share an ongoing project aiming to develop and evaluate quality bLearning modules
Methodology:•Design-based approach
Práticas de Qualidade no Ensino e Aprendizagem – Pombo & Loureiro
Peer assessment as a strategy to promote quality in a bLearning context: a design-based approach
CIDTFF, DE, Universidade de Aveiro
2008/09 (Wiki) 2010/11 (social networking) 2011/12 (CMS)1st week -Closed individual
reflections (googleDocs) -Open individual reflections (Ning)
-Negotiation of theassessment framework (literature review)
-Open individual reflections (Drupal Group)-Negotiation of theassessment framework (literature review+quality feedback)
2nd week -Open formative PA+Teachers (paper’s structure)
3rd week -Open formative PA+Teachers (wiki)(1st version)
-Closed formative PA+Teachers(GoogleDocs)(1st version)
-Open formative PA+Teachers(CMS+email)(1st version)
4th week -Closed sumative self+PA+Teachers assessment (product & competences)
-Closed sumative self+PA+Teachers assessment (product & competences)
-Closed sumative self+PA (competences)+Teachers assessment (product)
Conception/implementation
Práticas de Qualidade no Ensino e Aprendizagem – Pombo & Loureiro
Peer assessment as a strategy to promote quality in a bLearning context: a design-based approach
CIDTFF, DE, Universidade de Aveiro
2008/09
2010/11
2011/12•Decrease the lack of confidence feelings and fear of exposing critical feedback•Opportunity for better interiorization of the assessment frameworks by re-using them
•Increase the transparency of the assessment process – negotiation of the assessment framework (end of 1st week)
Analysis
Práticas de Qualidade no Ensino e Aprendizagem – Pombo & Loureiro
Peer assessment as a strategy to promote quality in a bLearning context: a design-based approach
CIDTFF, DE, Universidade de Aveiro
Students’ perceptions of e-assessment
(Loureiro et al., 2011)
• increase positive perceptions(PA relevance increased)
Evaluation
Práticas de Qualidade no Ensino e Aprendizagem – Pombo & Loureiro
Peer assessment as a strategy to promote quality in a bLearning context: a design-based approach
CIDTFF, DE, Universidade de Aveiro
%0 20 40 60 80 100
Use of the negotiated criteria
Adequacy of the chosen vocabulary
Provision of constructive feedback(criticisms)
Provision of constructive feedback(questions)
Provision of constructive feedback(suggestions for improvement)
Fairness of the score
Adequacy of the final considerations
Evaluation of PA (Loureiro et al., 2012)
• PA could be better(lack of criticism, suggestions and questions)
Evaluation
2010/11
Práticas de Qualidade no Ensino e Aprendizagem – Pombo & Loureiro
Peer assessment as a strategy to promote quality in a bLearning context: a design-based approach
CIDTFF, DE, Universidade de Aveiro
Final thoughtsQuality of PA improved in the last year
“…a oportunidade de experimentarmos uma situação real de avaliação pelos pares…”
“…Relativamente à avaliação por pares, esta revelou-se uma boa estratégia, tanto nos momentos em que avaliei como nos que fui avaliada, uma vez que contribui para momentos auto-reflexivos sobre o trabalho desenvolvido.”
PA may improve Learning in bLearning contexts but... it needs trainingThere are difficulties to manage personal and professional agendas
Práticas de Qualidade no Ensino e Aprendizagem – Pombo & Loureiro
Peer assessment as a strategy to promote quality in a bLearning context: a design-based approach
CIDTFF, DE, Universidade de Aveiro
Thank you for your attention
questions???
Práticas de Qualidade no Ensino e Aprendizagem – Pombo & Loureiro
Peer assessment as a strategy to promote quality in a bLearning context: a design-based approach
CIDTFF, DE, Universidade de Aveiro
Criteria Indicators
Use of the negotiated criteria
Students used the negotiated criteria or words with the same significance explicitly.
Adequacy of the chosen vocabulary
Concepts are used with rigour and differentiated.
Provision of constructive feedback
criticismsPA text includes criticism (both positive and negative), pointing out aspects that could be improved, without making suggestions.
questionsPA text presents questions for reflection concerning, for example, the theme or the development of the literature review.
suggestions for improvement
PA text includes suggestions that can lead to the improvement of the literature review, like, new readings, proposing ways to systematize the corpus of the review....
Fairness of the score the PA includes a score which should be in accordance with the given feedback
Adequacy of the final considerations
A synthesis of the main positive and negative aspects of the review is presented.
Práticas de Qualidade no Ensino e Aprendizagem – Pombo & Loureiro
Peer assessment as a strategy to promote quality in a bLearning context: a design-based approach
CIDTFF, DE, Universidade de Aveiro
