Embed Size (px)
Citation preview
20/04/2016
Electronic Management of Assessment
The story so far……
» 2011-2014: worked with over 30 institutions across a three year programme on assessment and feedback
» 2012: baseline reviews of institutional practice
» 2013: case studies, videos and briefings
» 2014: Electronic management of assessment (EMA) project with HELF and UCISA
» July 2014: initial landscape study into EMA published Summer 2014
Background and context
20/04/2016
CC BY-NC-SA 2.0 ©comedynose via Flickr
Assessment and feedback challenges
› Highly devolved responsibility and inconsistent practices
› Lack of developmental focus› Traditional practices dominate› Timeliness, quality and
consistency of feedback
› Learner in passive role› Lack of relevance to world of
work
Assessment and feedback (2012) » Nuanced responses but broad
trends visible» Localised initiatives but
beginning to scale up
» System integration is a key problem area
» EMA exposes variability in business processes
EMA (2014)
20/04/2016
Top 20 EMA challenges
20/04/2016
Developing solutions through ‘co-design’
» Workshops in Dec 2014 and Jan 2015 explored possible solutions to these prioritised challenges
» 1st workshop – resulted in 30 solution ideas
» Ideas were synthesised down into 5 main areas
» 2nd workshop - worked these up into 3 detailed project specifications
Moving to solutions
10/09/2015
Moving from electronic management of assessment challenges to solutions
ema.jiscinvolve.org/
Developing solutions
1. Addressing the variation of business processes and systems not meeting all needs (1,7, 12, 14)
2. Assessment literacies, assessment design, risk aversion (4, 6, 8, 9, 11, 15)
3. EMA systems integration (3)4. Lack of a
longitudinal/holistic view of student feedback; student engagement with feedback (10, 5)
5. Addressing issues with reliable submission (2)
Challenge1. Specifying the range of
possible marking and moderation processes and surfacing how systems support them
2. Online toolkit sharing effective practice
3. IMS Global Consortium Assignment Task Force
4. Researching where Jisc can add value in the ‘feedback hub’ space
5. (Suppliers addressing these issues)
Solution
20/04/2016
Where are we now»Now available
› New online guide Transforming assessment and feedback with technology www.jisc.ac.uk/guides/transforming-assessment-and-feedback
› New accompanying online guide on EMA processes and system specification, including supplier responses to requirementshttp://bit.ly/EMA-processes-guide
»Coming soon› A self-assessment tool linking through to the guidance, by
institution/departments/faculty– Due May 2016
› Findings from the FE and skills e-assessment survey due May 2016
› Guidance and case studies for FE and skills, due June 2016
20/04/2016
05/03/2023 Title of presentation (Insert > Header & Footer > Slide > Footer > Apply to all) 8
Embedded in the resources
EMA case studies and examples» Queen’s University, Belfast» Institute of Education (now part of
UCL)» University of Hertfordshire» Keele University» Manchester Metropolitan University» Bedford College» Walsall College » Sheffield University
» Podcasts› Benefits of EMA› Managing an EMA project › Assessment and feedback lifecycle› Processes and systems› Value of Jisc resources
» Supplier responses to EMA requirements› Summary view across all
systems and individual supplier responses
» Videos» Employability and
assessment» e-Portfolios» Peer assessment» Reconceptualising
feedback
What you said…
»Using the resources for:› Source for discussion for basic tutor
training› Academic unit away day sessions› Institution-wide enhancement projects› Articulating benefits
to senior managers»What’s missing:› Online exams / tests
20/04/2016
The straightforward framework from MMU has enabled us to start programme level discussions
The content is pitched at the right level to be useful to any academic/technologist facilitating or supporting assessment.
Walkthrough
As a…. I want to…. So that….
Lecturer / teacher Explore how I might develop more effective strategies for engaging my students with the feedback they receive
I can ensure they learning from the opportunities that feedback provides
Learning technologist / EMA lead
Identify which educational systems could best support my departmental processes around online submission, marking and feedback
Ensure the system/s selected best meet our needs
Project manager Explore how to best manage a move to online submission, marking and feedback in my department
We can plan the project to ensure maximum take-up by staff and students20/04/201
6
20/04/2016
Find out more
20/04/2016
» Landscape report available from: bit.ly/jisc-ema
» Join the conversation on the blog: ema.jiscinvolve.org/
» and on twitter #jiscassess
» Join the mailing list: jiscmail.ac.uk/tech-enhanced-assessment
jisc.ac.uk
Except where otherwise noted, this work is licensed under CC-BY-NC-ND
Find out more…
Contact
Lisa GraySenior Co-Design Manager, Student [email protected]
20/04/2016
