Let me intervene. . Influencing a learning environment through analytics

Let me interveneInfluencing a learning environmentthrough analytics

Joint European Summer Schoolon Technology Enhanced LearningEstoril, May 21st 2012

Abelardo Pardo (@abelardopardo)www.slideshare.net/abelardo_pardo

JiHo

Park

flickr.com

Abelardo Pardo Let me intervene. Influencing a learning environment through analytics 2

basykesflickr.com

Warning: Mud ahead!Real-world science ismessy

X (1 Pomodoro) Presentation

X (1 Pomodoro) Load, manipulate data set,group comment.

X (1 Pomodoro) Analyze and prepareintervention

X Rest: Group comment

1 pomodoro = 25 min (Check it out!)

Abelardo Pardo Let me intervene. Influencing a learning environment through analytics 3

fairlightworks

flickr.com

Abelardo Pardo Let me intervene. Influencing a learning environment through analytics 4

z287marc

flickr.com

LearningAnalyticstoday

Challenges Data setmanipulation

Abelardo Pardo Let me intervene. Influencing a learning environment through analytics 5

z287marc

flickr.com

LearningAnalyticstoday

Abelardo Pardo Let me intervene. Influencing a learning environment through analytics 6

http://blog.stephenwolfram

.com/2012/03/the-personal-analytics-of-m

y-life/

Is she pregnant?

Abelardo Pardo Let me intervene. Influencing a learning environment through analytics 7

Abelardo Pardo Let me intervene. Influencing a learning environment through analytics 8

http://sethgodin.typepad.com/seths_blog/2012/02/the-illusion-of-privacy-and-w

hat-we-actually-care-about.htm

l

No (unwanted) surprises!

Learning Analytics

Measurement, collection, analysisand reporting of data about learnersand their contexts, for purposes ofunderstanding and optimising learningand the environments in which itoccurs.

Abelardo Pardo Let me intervene. Influencing a learning environment through analytics 9

(US Dept. of Education)

Abelardo Pardo Let me intervene. Influencing a learning environment through analytics 10

C.E

lleflickr.com

(Campbell, De Blois, Oblinger 2007)

Collect

Report

Predict

Act

Refine

The five stepsof analytics

Abelardo Pardo Let me intervene. Influencing a learning environment through analytics 11

Abelardo Pardo Let me intervene. Influencing a learning environment through analytics 12

www.solaresearch.org

Abelardo Pardo Let me intervene. Influencing a learning environment through analytics 13

Toerisme

Leuven

Learning Analytics and KnowledgeConferenceApril 8-12, Leuven, Belgium

Abelardo Pardo Let me intervene. Influencing a learning environment through analytics 14

z287marc

flickr.com

LearningAnalyticstoday

Challenges

Abelardo Pardo Let me intervene. Influencing a learning environment through analytics 15

bodhithajflickr.com

(Jones, 2011)

Administration Students

Teachers Researchers

X Collect

X Report

X Predict

X Act

X Refine

Abelardo Pardo Let me intervene. Influencing a learning environment through analytics 16

Space

&Lightflickr.com

Abelardo Pardo Let me intervene. Influencing a learning environment through analytics 17

z287marc

flickr.com

LearningAnalyticstoday

Challenges Data setmanipulation

X 15 weeks. Sessions X, F 12-13:30

X 100 students

X 7 score tests per student

X Course notes with 30 “nodes” publishedgradually

X 5 events: forum_view, forum_post,visit_node, use_tool_1, use_tool_2

Make it your own course!

Abelardo Pardo Let me intervene. Influencing a learning environment through analytics 18

net_efektflickr.com

Factorsuser,factor_1,factor_2,factor_3,factor_4,factor_5,....,factor_Nuser1,3.1,Blue,25,25000,No,...,10.0user2,2.1,Red,27,12500,Yes,...,9.6.........userM,6.0,Magenta,32,32000,Maybe,...,1.2

user

Magenta

user1

user2

userM

factor_1 factor_2 factor_3 factor_4 factor_5 factor_N

3.1 Blue 25 25000 No 10.0

2.1 Red 27 12500 Yes 9.6

6.0 32 32000 Maybe 1.2

Can fk+1 be estimated by f (f1, . . . , fk )?

Abelardo Pardo Let me intervene. Influencing a learning environment through analytics 19

net_efektflickr.com

Observed Events

datetime

user6

2012-05-20 15:31:12

2012-05-20 15:31:15

2012-05-20 23:58:05

type field_1 field_2 field_3 field_4 field_Q

visit_url user1 bit.ly/..

forum_post user2 course.. 16 25 2

chat 32 1565 12

datetime,type,field_1,field_2,field_3,field_4,....,field_Q2012-05-20 15:31:12,visit_url,user1,http://bit.ly,,,...,2012-05-20 15:31:15,forum_post,user2,course A,16,25,...,2.........2012-05-20 23:58:05,chat,user5,user6,32,1565,...,12

Can be “transformed” into factors

Abelardo Pardo Let me intervene. Influencing a learning environment through analytics 20

net_efektflickr.com

Factors

Events Sensemaking

Combine

Predict?

fk+1

f1, f2,..., fk

Validate

Collect

Report

ACT!

Abelardo Pardo Let me intervene. Influencing a learning environment through analytics 21

Download the last three to your personal area

Abelardo Pardo Let me intervene. Influencing a learning environment through analytics 22

Exploring Scores

X Step 1: Load both data sets into “data frames”

X Step 2: Show a summary of the data just read

X Step 3: Histogram of the score_1 column ofscores.csv

X Step 4: Evolution of student scores

Abelardo Pardo Let me intervene. Influencing a learning environment through analytics 23

net_efektflickr.com

Exploring Events

X Step 5: Add 5 more columns to the eventdata-frame. Value “1” if event of certain type.

X Step 6: Count the events of each type andaggregate for each user

X Step 7: Merge previous columns with scorefactors. The result has 14 factors (9 scores +5 with number of events).

Can you predict anything?

Abelardo Pardo Let me intervene. Influencing a learning environment through analytics 24

net_efektflickr.com

Exploring data sets

X Do you have an idea about the type of factscollected?

X Is there any new information you discovered?

Abelardo Pardo Let me intervene. Influencing a learning environment through analytics 25

net_efektflickr.com

Potential predictions and interventions

X Which factor (present or new) would you liketo predict?

X What kind of intervention would it prompt?

Abelardo Pardo Let me intervene. Influencing a learning environment through analytics 26

net_efektflickr.com

Let me interveneInfluencing a learning environmentthrough analytics

Abelardo Pardo (@abelardopardo)www.slideshare.net/abelardo_pardo

JiHo

Park

flickr.com

References IStephen WolframThe personal analytics of my lifehttp://blog.stephenwolfram.com/2012/03/the-personal-analytics-of-my-life/

Daily MailHow Target knows when its shoppers are pregnant - and figuredout a teen was before her father didhttp://www.dailymail.co.uk/news/article-2102859/How-Target-knows-shoppers-pregnant--figured-teen-father-did.html?ito=feeds-newsxml

Seth GodinThe illusion of privacy (and what we actually care about)http://sethgodin.typepad.com/seths_blog/2012/02/the-illusion-of-privacy-and-what-we-actually-care-about.html

Abelardo Pardo Let me intervene. Influencing a learning environment through analytics 28

References IICampbell J., DeBlois P., Oblinger D.Academic AnalyticsEDUCAUSE White paper, 2007

Purdue UniversityThe signal projecthttp://www.itap.purdue.edu/studio/signals/

Last accessed April 2012

David JonesLearning analytics: Starvation and telling us what we alreadyknow?http://davidtjones.wordpress.com/2012/04/01/learning-analytics-starvation-and-telling-us-what-we-already-know/

Abelardo Pardo Let me intervene. Influencing a learning environment through analytics 29