26
Caroline Dominguez CIDTFF - University of Trás-os-Montes e Alto Douro Vila Real, Portugal [email protected] Ana Maia, Daniela Pedrosa CIDTFF/UTAD - University of Trás-os-Montes e Alto Douro Vila Real, Portugal {margaridam, dpedrosa}@utad.pt Gonçalo Cruz INESC TEC/UTAD - University of Trás-os- Montes e Alto Douro Vila Real, Portugal [email protected] Maria Nascimento CIDTFF - University of Trás-os-Montes e Alto Douro Vila Real, Portugal [email protected] Insights on web-based peer review: a case study with energy engineering students

Insights on web-based peer review: a case study with energy engineering students

Embed Size (px)

DESCRIPTION

Presentation made on october 31th 2013 at 1st International Conference of the Portuguese Society for Engineering Education (CISPEE).

Citation preview

Page 1: Insights on web-based peer review: a case study with energy engineering students

Caroline DominguezCIDTFF - University of Trás-os-Montes e Alto Douro

Vila Real, [email protected]

Ana Maia, Daniela PedrosaCIDTFF/UTAD - University of Trás-os-Montes e Alto Douro

Vila Real, Portugal{margaridam, dpedrosa}@utad.pt

Gonçalo CruzINESC TEC/UTAD - University of Trás-os-Montes e Alto Douro

Vila Real, [email protected]

Maria NascimentoCIDTFF - University of Trás-os-Montes e Alto Douro

Vila Real, [email protected]

Insights on web-based peer review: a case study with

energy engineering students

Page 2: Insights on web-based peer review: a case study with energy engineering students

I - Research Goal/Purpose

Page 3: Insights on web-based peer review: a case study with energy engineering students

What influences the development of communication skills trough web-based peer review activities?

Page 4: Insights on web-based peer review: a case study with energy engineering students

Cruz, G., Dominguez, C., Maia, A., Pedrosa, D., & Grams, G. (2013). Web-based Peer Assessment: A Case Study with Civil Engineering Students. International Journal of Engineering Pedagogy (IJEP), 3(S1), 64-70.

Page 5: Insights on web-based peer review: a case study with energy engineering students

As reviewers, are the perceptions of the students on the activity different from those as feedback “receivers”?

Page 6: Insights on web-based peer review: a case study with energy engineering students

Written communication skills (type of feedback)

Page 7: Insights on web-based peer review: a case study with energy engineering students

Intermediate grades vs. Final gradesPeer grades vs. Teacher grades

Page 8: Insights on web-based peer review: a case study with energy engineering students

II - Learning Activity

Page 9: Insights on web-based peer review: a case study with energy engineering students

1. Select an article

2. Create a Google Document

3. Summarize the article (synthesis)

4. Analyse the article (analysis)

5. Issue a personal opinion (argue)

Gonçalo Cruz Matos
Pode, por favor, me enviar esta imagem por e-mail? Preciso editá-la para que fique bem com o fundo. Obrigado
Gonçalo Cruz Matos
Talvez não fosse má ideia substituir este esquema por tópicos/lista e colocá-los alinhados à direira (tendo em conta a imagem de fundo).
Caroline Dominguez
Sim concordo Gonçalo
Page 10: Insights on web-based peer review: a case study with energy engineering students
Page 11: Insights on web-based peer review: a case study with energy engineering students
Maria Manuel da Silva Nascimento
aqui aumentei ligeiramente o esquema, caso contrário não se vê!!!
Gonçalo Cruz Matos
Convém re-fazer. Pois, desta forma, fica desproporcional - o que em termos estéticos não me parece boa opção.
Maria Manuel da Silva Nascimento
seja prático: percebe para que está com estéticas? Está muito bem assim. V. não tem também um doutoramento para fazer... picuínhas do caraças...
Page 12: Insights on web-based peer review: a case study with energy engineering students
Gonçalo Cruz Matos
as imagens estão formatadas para full screen.
Gonçalo Cruz Matos
Note-se, que a imagem do canto inferior direito é respetiva à atividade em Eng. Civil - onde o professor deu uma nota intermédia (diferente do que se passou aqui, em Eng. Energias). No entanto, acredito que não seja um problema.
Page 13: Insights on web-based peer review: a case study with energy engineering students

III - Research Method

Caroline Dominguez
aqui colocar : questionários análise de conteúdo dos trabalhos
Gonçalo Cruz Matos
A lupa aqui representa os vários instrumentos que utilizámos e que falamos na secção - questionário, feedback nos documentos e notas. Mas, podemos alterar se quiserem..
Page 14: Insights on web-based peer review: a case study with energy engineering students

IV - Evaluation

Page 15: Insights on web-based peer review: a case study with energy engineering students

Was Google Drive a barrier?

Gonçalo Cruz Matos
Era bom colocar aqui prints dos dados tratados pelo próprio google drive (gráficos circulares/barras, etc.) ou imagem que represente os resultados - em vez de lista de "bullets".. Idem aspas para os restantes slides desta secção.
Page 16: Insights on web-based peer review: a case study with energy engineering students

Did students found the activity useful (in terms of learning)?

Page 17: Insights on web-based peer review: a case study with energy engineering students

Are students self-confidents about their own work?

Page 18: Insights on web-based peer review: a case study with energy engineering students

Was there any difference between the grades?

Average grades Peer Reviewer Teacher

1st Cycle 0,75 0,77

2nd Cycle 0,84 0,88

3rd Cycle 0,87 0,83

4th Cycle 0,89 0,82

Page 19: Insights on web-based peer review: a case study with energy engineering students

Nelson & Schunn model Peer Reviewer Teacher

Summarizations 19 0

Problems Global 5 8

Local 67 88

Solutions Global 0 2

Local 44 18

Explanations 10 3

Praises 39 21

Mitigations 27 9

Counter-Argumentation 1 0

Feedback Implementation 8 2

n = 54

Gonçalo Cruz Matos
Talvez aqui colocar a tabela da Margarida, com ênfase nos resultados que queremos apresentar.
Caroline Dominguez
Sim...em outra cor ou assinalado os poucos problemas globaos, summarizations, e uso de feedback
Page 20: Insights on web-based peer review: a case study with energy engineering students

V - Discussion, Conclusion and Future Work

Page 21: Insights on web-based peer review: a case study with energy engineering students

Technology acceptance

Activity appreciation

Basic communication skills

Page 22: Insights on web-based peer review: a case study with energy engineering students

Need to continuous support

Low critical thinking skills

Low self-confidence for grading peers

Few improvements Neutral grades effect

Page 23: Insights on web-based peer review: a case study with energy engineering students

Blind vs. non-blind

Skills vs. approach

Grades scale

Activity value

Page 24: Insights on web-based peer review: a case study with energy engineering students

Overcome research limitations

FRISCO Approach & Cornell Test (Ennis,

1996)

Page 25: Insights on web-based peer review: a case study with energy engineering students

Similar conditions Coaching

Page 26: Insights on web-based peer review: a case study with energy engineering students

webPACT group

Gonçalo Cruz Matos
Convinha começar a pensar num logótipo ;)
Caroline Dominguez
Boa ideia !!! Não tinha pensado nisso !