Embed Size (px)
DESCRIPTION
Presentation of my PhD thesis status in the annuel meeting of the GAST research group of UC3M
Citation preview
Learning Analytics support for
Just-in-time Teaching
Israel GutiérrezJornadas GAST - 8 de julio de 2013
Just-in-time Teaching
Awareness
Learning Analytics
Lab sessions
photo: berkeleylab at flickr
Research Questions
Research Questions
“What are the problems that emerge in highly interactive face-to-face sessions?”
Research Questions
“Could a just-in-time teaching system be used to overcome the previous problems, facilitating the teacher management of the session driving it to the intended learning objectives and improving the efficiency of the students allowing them to focus on the assignment?”
“What are the problems that emerge in highly interactive face-to-face sessions?”
MethodologyDesign-based research
MethodologyDesign-based research
• Based on theory but pragmatic
MethodologyDesign-based research
• Based on theory but pragmatic
• Real-world setting
MethodologyDesign-based research
• Based on theory but pragmatic
• Real-world setting
• Iterative process
MethodologyDesign-based research
• Based on theory but pragmatic
• Real-world setting
• Iterative process
• Mixed methods
MethodologyDesign-based research
• Based on theory but pragmatic
• Real-world setting
• Iterative process
• Mixed methods
• Research agenda updated with findings
Problems in lab session
Literature Experiments
Experts
Literature
Lantern (Alavi & Dillenbourg, 2009)
PLITAZ (Dong & Hwang, 2012)
Problem Source Stakeholder
Demand an answer Alavi09 Students
Wait longer Alavi09 Students
Fails to notice requests Alavi09 Teachers
Heavy workload Dong12 Teachers
Isolation Dong12 Students
Limited awareness Dong12 Teachers
Simultaneous requests Dong12 Teachers
AMM11 (Gutiérrez Rojas, Crespo García, & Delgado Kloos, 11)
AS11 (Gutiérrez Rojas & Crespo García, 12)
AMM12 (Gutiérrez Rojas, Crespo García, & Delgado Kloos, 12)
Problem Source StakeholderMethodology increases workload AMM11 Teachers
Huge number of requests AS11 Teachers
Attention to personalized feedback AS11 Students
Ask without thinking AS11 Students
Shorten explanation if overwhelmed AS11 Teachers
Perceive not enough teachers AS11 Students
Attention order unfairness AS11 Teachers
Devote time monitoring the teacher AS11 Students
Not aware of time AS11 Teachers
Not like writing questions AMM12 Students
Not relevant not current info AMM12 Teachers
Interface not straight-forward AMM12 Teachers
Experiments
OUNLUC3M
Experts
KU LeuvenRWTH Aachen
Problem Source Stakeholder
Not support for project-based learning EXP Teachers
Not support for exchange questions EXP Students
Not support for exchange progress EXP Students
Not collecting evidences for summative EXP Teachers
RequirementsRequirement Stakeholder
Provide time management mechanisms Teachers
Provide info about students progression Teachers
Provide info about students requests Teachers
Straightforward UI Teachers
Responsive UI Teachers
Store and process students records Teachers
Support different teaching methods Teachers
Provide info to students for self-awareness Students
As much personalized feedback as possible Students
Enable students to focus on the assignment Students
Share and rate questions and answers Students
Share progression Students
in-Class Live Analytics for Assessment and
Orchestrationhttp://www.class-on.org
Student UI
Student UI
Teacher UI
Teacher UI
Analytics
Authentic experiments
AMM12 AS12 AMM13
Date March-May 2012
November 2012
February-May 2013
Duration 18 sessions 6 sessions 10 sessions*
Teachers 4 3 1
Students 70 121 30
Group settings Dyads Dyads Dyads
Results
Teachers interviews
Students surveys
Collected traces
Results
Teachers interviews
Students surveys
Collected traces
Results
Teachers interviews
Students surveys
Collected traces Requirements
Lessons Learned
Lessons Learned
Lessons Learned
Lessons Learned
Lessons Learned
Contributions
Contributions
Contributions
Contributions
Related Publications
Gutiérrez Rojas, I., Crespo García, R. M., & Delgado Kloos, C. (2012). Enhancing orchestration of lab sessions by means of awareness mechanisms. EC-TEL 2012: 21st century learning for 21st century skills: 7th European Conference of Technology Enhanced Learning, 18-21 September 2012, Saarbrücken (Germany) (Vol. 7563, pp. 113–125).
Gutiérrez Rojas, I., & Crespo García, R. M. (2012). Towards efficient provision of feedback in lab sessions. International Conference on Advanced Learning Technologies (ICALT) (Vol. 1). Rome.
Gutiérrez Rojas, I., Crespo García, R. M., & Delgado Kloos, C. (2011). Orchestration and feedback in lab sessions: improvements in quick feedback provision. Towards Ubiquitous Learning. 6th European Conference of Technology Enhanced Learning, EC-TEL 2011 Palermo, Italy, September 20-23, 2011 Proceedings. LNCS, 6964. doi:10.1007/978-3-642-23985-4
Future Work
Future Work
Thank you very much!
