29
Let me intervene Influencing a learning environment through analytics Joint European Summer School on Technology Enhanced Learning Estoril, May 21 st 2012 Abelardo Pardo (@abelardopardo) www.slideshare.net/abelardo_pardo Ji Ho Park flickr.com

Let me intervene. . Influencing a learning environment through analytics

Embed Size (px)

DESCRIPTION

Presentation given at the 8th JTEL Summer School held in May 2012 in Estoril. The hands-on workshop presented a description of Learning Analytics and then participants loaded two data sets into a statistical tool and manipulate them to deduce potential interventions

Citation preview

Page 1: Let me intervene. . Influencing a learning environment through analytics

Let me interveneInfluencing a learning environmentthrough analytics

Joint European Summer Schoolon Technology Enhanced LearningEstoril, May 21st 2012

Abelardo Pardo (@abelardopardo)www.slideshare.net/abelardo_pardo

JiHo

Park

flickr.com

Page 2: Let me intervene. . Influencing a learning environment through analytics

Abelardo Pardo Let me intervene. Influencing a learning environment through analytics 2

basykesflickr.com

Warning: Mud ahead!Real-world science ismessy

Page 3: Let me intervene. . Influencing a learning environment through analytics

X (1 Pomodoro) Presentation

X (1 Pomodoro) Load, manipulate data set,group comment.

X (1 Pomodoro) Analyze and prepareintervention

X Rest: Group comment

1 pomodoro = 25 min (Check it out!)

Abelardo Pardo Let me intervene. Influencing a learning environment through analytics 3

fairlightworks

flickr.com

Page 4: Let me intervene. . Influencing a learning environment through analytics

Abelardo Pardo Let me intervene. Influencing a learning environment through analytics 4

z287marc

flickr.com

LearningAnalyticstoday

Challenges Data setmanipulation

Page 5: Let me intervene. . Influencing a learning environment through analytics

Abelardo Pardo Let me intervene. Influencing a learning environment through analytics 5

z287marc

flickr.com

LearningAnalyticstoday

Page 6: Let me intervene. . Influencing a learning environment through analytics

Abelardo Pardo Let me intervene. Influencing a learning environment through analytics 6

http://blog.stephenwolfram

.com/2012/03/the-personal-analytics-of-m

y-life/

Page 7: Let me intervene. . Influencing a learning environment through analytics

Is she pregnant?

Abelardo Pardo Let me intervene. Influencing a learning environment through analytics 7

Page 8: Let me intervene. . Influencing a learning environment through analytics

Abelardo Pardo Let me intervene. Influencing a learning environment through analytics 8

http://sethgodin.typepad.com/seths_blog/2012/02/the-illusion-of-privacy-and-w

hat-we-actually-care-about.htm

l

No (unwanted) surprises!

Page 9: Let me intervene. . Influencing a learning environment through analytics

Learning Analytics

Measurement, collection, analysisand reporting of data about learnersand their contexts, for purposes ofunderstanding and optimising learningand the environments in which itoccurs.

Abelardo Pardo Let me intervene. Influencing a learning environment through analytics 9

(US Dept. of Education)

Page 10: Let me intervene. . Influencing a learning environment through analytics

Abelardo Pardo Let me intervene. Influencing a learning environment through analytics 10

C.E

lleflickr.com

(Campbell, De Blois, Oblinger 2007)

Collect

Report

Predict

Act

Refine

The five stepsof analytics

Page 11: Let me intervene. . Influencing a learning environment through analytics

Abelardo Pardo Let me intervene. Influencing a learning environment through analytics 11

Page 12: Let me intervene. . Influencing a learning environment through analytics

Abelardo Pardo Let me intervene. Influencing a learning environment through analytics 12

www.solaresearch.org

Page 13: Let me intervene. . Influencing a learning environment through analytics

Abelardo Pardo Let me intervene. Influencing a learning environment through analytics 13

Toerisme

Leuven

Learning Analytics and KnowledgeConferenceApril 8-12, Leuven, Belgium

Page 14: Let me intervene. . Influencing a learning environment through analytics

Abelardo Pardo Let me intervene. Influencing a learning environment through analytics 14

z287marc

flickr.com

LearningAnalyticstoday

Challenges

Page 15: Let me intervene. . Influencing a learning environment through analytics

Abelardo Pardo Let me intervene. Influencing a learning environment through analytics 15

bodhithajflickr.com

(Jones, 2011)

Administration Students

Teachers Researchers

Page 16: Let me intervene. . Influencing a learning environment through analytics

X Collect

X Report

X Predict

X Act

X Refine

Abelardo Pardo Let me intervene. Influencing a learning environment through analytics 16

Space

&Lightflickr.com

Page 17: Let me intervene. . Influencing a learning environment through analytics

Abelardo Pardo Let me intervene. Influencing a learning environment through analytics 17

z287marc

flickr.com

LearningAnalyticstoday

Challenges Data setmanipulation

Page 18: Let me intervene. . Influencing a learning environment through analytics

X 15 weeks. Sessions X, F 12-13:30

X 100 students

X 7 score tests per student

X Course notes with 30 “nodes” publishedgradually

X 5 events: forum_view, forum_post,visit_node, use_tool_1, use_tool_2

Make it your own course!

Abelardo Pardo Let me intervene. Influencing a learning environment through analytics 18

net_efektflickr.com

Page 19: Let me intervene. . Influencing a learning environment through analytics

Factorsuser,factor_1,factor_2,factor_3,factor_4,factor_5,....,factor_Nuser1,3.1,Blue,25,25000,No,...,10.0user2,2.1,Red,27,12500,Yes,...,9.6.........userM,6.0,Magenta,32,32000,Maybe,...,1.2

user

Magenta

user1

user2

userM

factor_1 factor_2 factor_3 factor_4 factor_5 factor_N

3.1 Blue 25 25000 No 10.0

2.1 Red 27 12500 Yes 9.6

6.0 32 32000 Maybe 1.2

Can fk+1 be estimated by f (f1, . . . , fk )?

Abelardo Pardo Let me intervene. Influencing a learning environment through analytics 19

net_efektflickr.com

Page 20: Let me intervene. . Influencing a learning environment through analytics

Observed Events

datetime

user6

2012-05-20 15:31:12

2012-05-20 15:31:15

2012-05-20 23:58:05

type field_1 field_2 field_3 field_4 field_Q

visit_url user1 bit.ly/..

forum_post user2 course.. 16 25 2

chat 32 1565 12

datetime,type,field_1,field_2,field_3,field_4,....,field_Q2012-05-20 15:31:12,visit_url,user1,http://bit.ly,,,...,2012-05-20 15:31:15,forum_post,user2,course A,16,25,...,2.........2012-05-20 23:58:05,chat,user5,user6,32,1565,...,12

Can be “transformed” into factors

Abelardo Pardo Let me intervene. Influencing a learning environment through analytics 20

net_efektflickr.com

Page 21: Let me intervene. . Influencing a learning environment through analytics

Factors

Events Sensemaking

Combine

Predict?

fk+1

f1, f2,..., fk

Validate

Collect

Report

ACT!

Abelardo Pardo Let me intervene. Influencing a learning environment through analytics 21

Page 22: Let me intervene. . Influencing a learning environment through analytics

Download the last three to your personal area

Abelardo Pardo Let me intervene. Influencing a learning environment through analytics 22

Page 23: Let me intervene. . Influencing a learning environment through analytics

Exploring Scores

X Step 1: Load both data sets into “data frames”

X Step 2: Show a summary of the data just read

X Step 3: Histogram of the score_1 column ofscores.csv

X Step 4: Evolution of student scores

Abelardo Pardo Let me intervene. Influencing a learning environment through analytics 23

net_efektflickr.com

Page 24: Let me intervene. . Influencing a learning environment through analytics

Exploring Events

X Step 5: Add 5 more columns to the eventdata-frame. Value “1” if event of certain type.

X Step 6: Count the events of each type andaggregate for each user

X Step 7: Merge previous columns with scorefactors. The result has 14 factors (9 scores +5 with number of events).

Can you predict anything?

Abelardo Pardo Let me intervene. Influencing a learning environment through analytics 24

net_efektflickr.com

Page 25: Let me intervene. . Influencing a learning environment through analytics

Exploring data sets

X Do you have an idea about the type of factscollected?

X Is there any new information you discovered?

Abelardo Pardo Let me intervene. Influencing a learning environment through analytics 25

net_efektflickr.com

Page 26: Let me intervene. . Influencing a learning environment through analytics

Potential predictions and interventions

X Which factor (present or new) would you liketo predict?

X What kind of intervention would it prompt?

Abelardo Pardo Let me intervene. Influencing a learning environment through analytics 26

net_efektflickr.com

Page 27: Let me intervene. . Influencing a learning environment through analytics

Let me interveneInfluencing a learning environmentthrough analytics

Abelardo Pardo (@abelardopardo)www.slideshare.net/abelardo_pardo

JiHo

Park

flickr.com

Page 28: Let me intervene. . Influencing a learning environment through analytics

References IStephen WolframThe personal analytics of my lifehttp://blog.stephenwolfram.com/2012/03/the-personal-analytics-of-my-life/

Daily MailHow Target knows when its shoppers are pregnant - and figuredout a teen was before her father didhttp://www.dailymail.co.uk/news/article-2102859/How-Target-knows-shoppers-pregnant--figured-teen-father-did.html?ito=feeds-newsxml

Seth GodinThe illusion of privacy (and what we actually care about)http://sethgodin.typepad.com/seths_blog/2012/02/the-illusion-of-privacy-and-what-we-actually-care-about.html

Abelardo Pardo Let me intervene. Influencing a learning environment through analytics 28

Page 29: Let me intervene. . Influencing a learning environment through analytics

References IICampbell J., DeBlois P., Oblinger D.Academic AnalyticsEDUCAUSE White paper, 2007

Purdue UniversityThe signal projecthttp://www.itap.purdue.edu/studio/signals/

Last accessed April 2012

David JonesLearning analytics: Starvation and telling us what we alreadyknow?http://davidtjones.wordpress.com/2012/04/01/learning-analytics-starvation-and-telling-us-what-we-already-know/

Abelardo Pardo Let me intervene. Influencing a learning environment through analytics 29