40
Join the learning analytics party! Exploring the full potential of using data to support learning

Join the analytics party - exploring the full potential of using data to support learning

  • Upload
    jisc

  • View
    2.356

  • Download
    1

Embed Size (px)

Citation preview

Page 1: Join the analytics party - exploring the full potential of using data to support learning

Join the learning analytics party!Exploring the full potential of using data to support learning

Page 2: Join the analytics party - exploring the full potential of using data to support learning

> >Slide Join the learning analytics party!

Introduction>Strategic importance of learning analytics>What problems could we solve?>Evidence that it works>Business case

>Jisc national learning analytics>What Jisc is doing now

>The future>Where it could lead

02/05/2023

2

Page 3: Join the analytics party - exploring the full potential of using data to support learning

> >Slide Join the learning analytics party!

Strategic importance of learning analyticsDr. Phil Richards, Chief innovation officer, Jisc

02/05/2023

Page 4: Join the analytics party - exploring the full potential of using data to support learning

> >Slide 02/05/2023

Join the learning analytics party!

What do we mean by learning analytics?>The application of big data techniques such as

machine based learning and data mining to help learners and institutions meet their goals:

>Eg:>Improve retention>Improve achievement>Improve employability>Reduce differential outcomes

4

Page 5: Join the analytics party - exploring the full potential of using data to support learning

> >Slide Join the learning analytics party!

Problems: Retention, attainment, differentialsHESA non-continuation rates 2016-17 “headline increase from 6% to 6.2%”

Director of Fair Access Les Ebdon “particularly concerned that the non-continuation rates for young people from the most disadvantaged backgrounds have risen faster than for other groups”, and expects the next round of access agreements to particularly focus on the issue of retention. (WonkHE)

02/05/2023

5

Page 6: Join the analytics party - exploring the full potential of using data to support learning

> >Slide Join the learning analytics party!

Evidence>Columbus State

University College (USA) retention rose by 4.2% (5.7% for low-income students)

>Open University (UK) pilots have seen a 2.1% boost in retention

>University of New England (Australia) saw drop-out rates fall from 18% to 12%

02/05/2023

6

Page 7: Join the analytics party - exploring the full potential of using data to support learning

> >Slide 02/05/2023

Join the learning analytics party!

Business case outlines>Typical university 20,000 students, 6% first year

non-completion improves to 4%>Annual benefit in reducing lost fees £7.2M-£10.8M>(Annual LA cost < £0.1M)

>High retention university, 20,000 students 2% first year non-completion improves to 1.5%>Annual benefit £1.8M-£2.7M £

7

Page 8: Join the analytics party - exploring the full potential of using data to support learning

> >Slide Join the learning analytics party!

Evidence for LA in access agreementsClick to icon to add image

https://analytics.jiscinvolve.org/wp/2017/01/10/whats-the-evidence-for-learning-analytics/

02/05/2023

8

Page 9: Join the analytics party - exploring the full potential of using data to support learning

> >Slide 02/05/2023

Jisc – Developing the UK’s national learning analytics serviceRob Wyn Jones, Senior data and analytics integrator, Jisc

Join the learning analytics party!

Page 10: Join the analytics party - exploring the full potential of using data to support learning

> >Slide 02/05/2023

Join the learning analytics party!

Learning analytics – three strands

Learning analytics service

Toolkit Community

Jisc learning analytics

10

Page 11: Join the analytics party - exploring the full potential of using data to support learning

> >Slide Join the learning analytics party!

LA community>Blog (40+ blog posts)>http://analytics.jiscinvolve.org ~ 40

blog posts>Mailing: 500+ members (190+

organisations)>[email protected]

>9th network meeting ~600+ participants

02/05/2023

11

Page 12: Join the analytics party - exploring the full potential of using data to support learning

> >Slide 02/05/2023

Join the learning analytics party!

Legal and ethical>Code of Practice

jisc.ac.uk/guides/code-of-practice-for-learning-analytics

>Literature Reviewhttp://repository.jisc.ac.uk/5661/1/Learning_Analytics_A-_Literature_Review.pdf

>Template Learning Analytics Policyhttps://analytics.jiscinvolve.org/wp/2016/11/29/developing-an-institutional-learning-analytics-policy

>Guidance on consent for learning analyticshttps://analytics.jiscinvolve.org/wp/2017/02/16/consent-for-learning-analytics-some-practical-guidance-for-institutions

12

Page 13: Join the analytics party - exploring the full potential of using data to support learning

> >Slide 02/05/2023

Join the learning analytics party!

Learning analytics – accessibility and analytics labs>Blog Post: accessibility and considerations for learning

analyticshttps://analytics.jiscinvolve.org/wp/2016/12/14/accessibility-considerations-for-learning-analytics

>Invitation to join Jisc/ HESA analytics labs: April – July 17 - - FOC Agile delivery, BI Tableau + knowledge transfer)http://bit.ly/jisc_bi_team_application

13

Page 14: Join the analytics party - exploring the full potential of using data to support learning

> >Slide 02/05/2023

Join the learning analytics party!

UK learning analytics serviceJisc learning analytics open architecture: core

14

Page 15: Join the analytics party - exploring the full potential of using data to support learning

> >Slide 02/05/2023

Join the learning analytics party!

Our confirmed partners…>Look out for further

announcements soon….>Dynamic purchasing

agreement to make it easier for institutions…

15

Page 16: Join the analytics party - exploring the full potential of using data to support learning

> >Slide 02/05/2023

Join the learning analytics party!

LA product/ service roadmap

16

Page 17: Join the analytics party - exploring the full potential of using data to support learning

> >Slide Join the learning analytics party!

Now and for the future – Jisc UK learning analytics 2017-2019Rob Wyn Jones, Senior data and analytics integrator, Jisc

02/05/2023

Page 18: Join the analytics party - exploring the full potential of using data to support learning

> >Slide 02/05/2023

Join the learning analytics party!

Products and tools (as at March 2017)>Learning records warehouse (LRW) – active + APIs>Jisc Data Explorer – basic visualisations >Student Unified Data Definition – version 1.2.7, upcoming 1.3.0 and

examples major SRS and automated validation>VLE – xAPI recipe and plugins for Blackboard and Moodle>Attendance tracking – xAPI recipe (2 pilots)>Study Goal – version 1.0 on iOS and Android pilots - (3)>Tribal Student Insights and LAP (14)>Open Learning Analytics Processor (4)>Student Success Planner – SSP (2)

18

Page 19: Join the analytics party - exploring the full potential of using data to support learning

> >Slide Join the learning analytics party!

Current implementation approach

02/05/2023

Analyse and pilot Choose

full product

Historic data

Analyse results

Live data

Deploy dashboards/other tools

SuppliersInstitution team End users

Model build

Deploy Study Goal

Deploy DataX

Analyse and pilot

19

Page 20: Join the analytics party - exploring the full potential of using data to support learning

> >Slide Join the learning analytics party!

Study Goal (formely ‘Student App’)>First version includes:>Overall engagement>Comparisons>Self declared data>Consent management

Bespoke development by Therapy Box

02/05/2023

20

Page 21: Join the analytics party - exploring the full potential of using data to support learning

> >Slide 02/05/2023

Join the learning analytics party!

Jisc - Data Explorer>Basic dashboard/ vis

tool>Enables initial data

exploration and assist institutions to chose suitable commercial solutions and set a basic expectation

>Being used by several pilot institutions

>Demo uses dummy data from University of Jisc 21

Page 22: Join the analytics party - exploring the full potential of using data to support learning

> >Slide 02/05/2023

Join the learning analytics party!

Join us – getting startedLearning analytics – onboarding processhttps://analytics.jiscinvolve.org/wp/on-boarding

>Stage 1: Orientation>Stage 2: Discovery>Stage 3: Culture and organisation setup>Stage 4: Data integration (crucial too, and can take

time!)>Stage 5: Implementation planning

22

Page 23: Join the analytics party - exploring the full potential of using data to support learning

> >Slide 02/05/2023

Join the learning analytics party!

Learning analytics, and the unfolding education landscapeDr. Phil Richards, Chief innovation officer, Jisc

Page 24: Join the analytics party - exploring the full potential of using data to support learning

> >Slide 02/05/2023

Join the learning analytics party!

HESA data futures/ HEDIIP alignment for UDDClick to icon to add image

jisc.ac.uk/rd/projects/information-hub-prototype

24

Page 25: Join the analytics party - exploring the full potential of using data to support learning

> >Slide 02/05/2023

Join the learning analytics party!

HEFCE learning gain call – May 2015>Standardised tests>Grades>Self-reporting surveys>Mixed methods>Other qualitative

methods

25

Page 26: Join the analytics party - exploring the full potential of using data to support learning

> >Slide 02/05/2023

Join the learning analytics party!

Teaching excellence framework and quality assessment

26

Page 27: Join the analytics party - exploring the full potential of using data to support learning

> >Slide 02/05/2023

Join the learning analytics party!

LA warehouse: our DNA bank for higher e-learning?

Reference data» Demographics» Entry

qualifications» Learning and

employment – Longitudinal Educational Outcomes (LEO) data

Outcomes» Deep

understanding of e-learning

» Metrics for engagement, learning gain

» Personalised next generation e-learning and learner pathway guidance

Analytics number crunching

UK learning data warehouse

27

Page 28: Join the analytics party - exploring the full potential of using data to support learning

> >Slide 02/05/2023

Join the learning analytics party!

Blended curriculum design

28

Page 29: Join the analytics party - exploring the full potential of using data to support learning

> >Slide Join the learning analytics party!

AI and the analytics (r)evolution…

02/05/2023

29

Page 30: Join the analytics party - exploring the full potential of using data to support learning

> >Slide

jisc.ac.uk

Except where otherwise noted, this work is licensed under CC-BY-NC-ND

02/05/2023

Join the learning analytics party!> >

Contact details

Join the learning analytics journey

Slide

Dr. Phil RichardsChief innovation officer, [email protected]

Rob Wyn JonesSenior data and analytics integrator (Learning analytics)[email protected]

30

Page 31: Join the analytics party - exploring the full potential of using data to support learning

> >Slide 02/05/2023

Join the learning analytics party!

Exploring learning analyticsPaul Bailey, Senior co-design manager

Page 32: Join the analytics party - exploring the full potential of using data to support learning

> >Slide 02/05/2023

Exploring learning analytics

Find out more at Digifest>Day 1: Tues>16:15 Attendance monitoring (demo)>Day 2: Weds>9:15 Debate: Human vs machine interventions>10:15 Business intelligence in HE (demo)>11:15 Learning design and leaner analytics (Patrick

Lynch)>13:30 Study Goal and Data Explorer (demo)>14:45 Learning analytics for FE Colleges

32

Page 33: Join the analytics party - exploring the full potential of using data to support learning

> >Slide Exploring learning analytics

Learning analytics explained

02/05/2023

33

Page 34: Join the analytics party - exploring the full potential of using data to support learning

> >Slide Exploring learning analytics

Join us – getting startedLearning analytics – onboarding processhttps://analytics.jiscinvolve.org/wp/on-boarding

>Stage 1: Orientation>Stage 2: Discovery>Stage 3: Culture and organisation setup>Stage 4: Data integration (crucial too, and can take

time!)>Stage 5: Implementation planning

02/05/2023

34

Page 35: Join the analytics party - exploring the full potential of using data to support learning

> >Slide Exploring learning analytics

Learning analytics online modulesThe following videos are extracts from some learning analytics online modules available soon>Module 1 - Introduction to learning analytics>Module 2 - Student and staff perceptions>Module 3 - Institutional readiness>Module 4 - The Jisc architecture

02/05/2023

35

Page 36: Join the analytics party - exploring the full potential of using data to support learning

> >Slide Exploring learning analytics

Vision and goals for data analytics>Video Clip:

A shared vision for learning analytics (00:16 - 01:25)

>Discussion: What are your short-term (6-12 month) goals for learning analytics at your institution, and how are they aligned with your institutional goals?02/05/20

23

Lindsay Pineda, Unicon

36

Page 37: Join the analytics party - exploring the full potential of using data to support learning

> >Slide Exploring learning analytics

The need for governance>Governance structures –

 The role of governance in learning analytics (1:11 - 4:03)

>Discussion: Where do you believe the governance structures for learning analytics should fit into the rest of the institution?02/05/20

23

Patrick Lynch, University of Hull

37

Page 38: Join the analytics party - exploring the full potential of using data to support learning

> >Slide Exploring learning analytics

A code of practice>Legal and ethical issues - 

The need for a code of ethics (00:00 - 01:51)

>Discussion: What are some of the other ethical issues that arise in storing and combining learning data as we do in learning analytics? How can institutions ensure that they handle student data in a responsible manner?

02/05/2023

Martin Hall

38

Page 39: Join the analytics party - exploring the full potential of using data to support learning

> >Slide Exploring learning analytics

Data literacy>Digital literacy - 

Data literacy - towards a data-informed culture  (02:25 - 03:51)

>Discussion: How can technical staff and educators work together to ensure that learning analytics systems are optimised - both technically and pedagogically?02/05/20

23

Martin Hall

39

Page 40: Join the analytics party - exploring the full potential of using data to support learning

> >Slide

jisc.ac.uk

Except where otherwise noted, this work is licensed under CC-BY-NC-ND

02/05/2023

Exploring learning analytics> >

Contact details

Learning analytics

Slide

Paul BaileySenior co-design [email protected]

40