104
Openness, Analytics, and Continuous Quality Improvement David Wiley, PhD Department of Instructional Psychology & Technology Brigham Young University

Openness, Learning Analytics, and Continuous Quality Improvement

Embed Size (px)

DESCRIPTION

Keynote presentation at ELI 2011.

Citation preview

Page 1: Openness, Learning Analytics, and Continuous Quality Improvement

Openness, Analytics, and Continuous Quality Improvement

David Wiley, PhDDepartment of Instructional Psychology & Technology

Brigham Young University

Page 2: Openness, Learning Analytics, and Continuous Quality Improvement

Download These Slides

http://slideshare.net/opencontent/

Page 3: Openness, Learning Analytics, and Continuous Quality Improvement
Page 4: Openness, Learning Analytics, and Continuous Quality Improvement
Page 5: Openness, Learning Analytics, and Continuous Quality Improvement
Page 6: Openness, Learning Analytics, and Continuous Quality Improvement

http://www.flickr.com/photos/gls-conference/4687537285/

Page 7: Openness, Learning Analytics, and Continuous Quality Improvement

If the Book Didn’t Change Schools

Can the computer?Can the internet?

Page 8: Openness, Learning Analytics, and Continuous Quality Improvement
Page 9: Openness, Learning Analytics, and Continuous Quality Improvement

Openness… In Education?

Let’s begin by defining terms

Page 10: Openness, Learning Analytics, and Continuous Quality Improvement

Open, adj.

Describes educational artifacts

Page 11: Openness, Learning Analytics, and Continuous Quality Improvement

Open Textbooks

Open Educational Resources

Open Courseware

(Open Source Software)

Page 12: Openness, Learning Analytics, and Continuous Quality Improvement

Open, adj.

Teaching materials freely shared with permissions to engage in the “4R” activities

Page 13: Openness, Learning Analytics, and Continuous Quality Improvement

The 4Rs

Reuse – copy verbatimRedistribute – share with others

Revise – adapt and improveRemix – combine with others

Page 14: Openness, Learning Analytics, and Continuous Quality Improvement

Communicate 4Rs Permissions

Since this overrides default copyright,you must use a copyright license

Page 15: Openness, Learning Analytics, and Continuous Quality Improvement

Offers easy to use 4R’s licenses

Page 16: Openness, Learning Analytics, and Continuous Quality Improvement
Page 17: Openness, Learning Analytics, and Continuous Quality Improvement
Page 18: Openness, Learning Analytics, and Continuous Quality Improvement
Page 19: Openness, Learning Analytics, and Continuous Quality Improvement
Page 20: Openness, Learning Analytics, and Continuous Quality Improvement

While Nouns Differ…

The operationalizing actions are the same

Page 21: Openness, Learning Analytics, and Continuous Quality Improvement

Open, adj.

Generous, sharing, giving

Page 22: Openness, Learning Analytics, and Continuous Quality Improvement

Open, adj.

Providing (1) access and (2) local control

Page 23: Openness, Learning Analytics, and Continuous Quality Improvement

Your Inner Two-year Old

Overcoming the impulse to scream“Mine!”

Page 24: Openness, Learning Analytics, and Continuous Quality Improvement

Law and Policy “Enable” Us

To shout “Mine!” ever more loudly,convulse ever more uncontrollably,

and hit each other with ever larger toys

Page 25: Openness, Learning Analytics, and Continuous Quality Improvement

Society’s Siren Song

“Be selfish. Keep it to yourself. It’s legal. It’s ok.”

Page 26: Openness, Learning Analytics, and Continuous Quality Improvement

Education Is Not Immune

This kind of thinking is accepted

Page 27: Openness, Learning Analytics, and Continuous Quality Improvement

Role of Openness in Education?

A terrible, insidious question

Page 28: Openness, Learning Analytics, and Continuous Quality Improvement

Openness is the only means of doing education.

Page 29: Openness, Learning Analytics, and Continuous Quality Improvement

If There Is No Sharing

There is no education

Page 30: Openness, Learning Analytics, and Continuous Quality Improvement

Successful Educators

Share most thoroughly with the most students

Page 31: Openness, Learning Analytics, and Continuous Quality Improvement

Expertise Is Nonrivalrous

Can be given without being given away

Page 32: Openness, Learning Analytics, and Continuous Quality Improvement

“He who receives ideas from me, receives instruction himself without lessening mine; as he who lights his taper at mine receives light without darkening me.”

Thomas Jefferson

Page 33: Openness, Learning Analytics, and Continuous Quality Improvement

Expressions Are Different

To give a book you must give it away

Page 34: Openness, Learning Analytics, and Continuous Quality Improvement

Expressions Are Different

To give a book you must give it away

Page 35: Openness, Learning Analytics, and Continuous Quality Improvement

Expressions Are Different

Digital expressions are nonrivalrous

n’t^

Page 36: Openness, Learning Analytics, and Continuous Quality Improvement

E.g., Online Book

We can all read simultaneously

Page 37: Openness, Learning Analytics, and Continuous Quality Improvement

An Indescribable Advance

The first time in human history

Page 38: Openness, Learning Analytics, and Continuous Quality Improvement

Expertise and Its Expressions

Give without giving away

Page 39: Openness, Learning Analytics, and Continuous Quality Improvement

Unprecedented Capacity

We can share as never before

Page 40: Openness, Learning Analytics, and Continuous Quality Improvement

Unprecedented Capacity

We can educate as never before

Page 41: Openness, Learning Analytics, and Continuous Quality Improvement

Stewardship

For which we are accountable

Page 42: Openness, Learning Analytics, and Continuous Quality Improvement

Open Educational Resources

Open Course Ware

Open Course Ware

Open Courses

Open Courses

Open Textbooks

Open Textbooks

Page 43: Openness, Learning Analytics, and Continuous Quality Improvement

Repository Examples

Page 44: Openness, Learning Analytics, and Continuous Quality Improvement
Page 45: Openness, Learning Analytics, and Continuous Quality Improvement
Page 46: Openness, Learning Analytics, and Continuous Quality Improvement
Page 47: Openness, Learning Analytics, and Continuous Quality Improvement

OpenCourseWare Examples

Page 48: Openness, Learning Analytics, and Continuous Quality Improvement
Page 49: Openness, Learning Analytics, and Continuous Quality Improvement
Page 50: Openness, Learning Analytics, and Continuous Quality Improvement
Page 51: Openness, Learning Analytics, and Continuous Quality Improvement
Page 52: Openness, Learning Analytics, and Continuous Quality Improvement

Open Courses Examples

Page 53: Openness, Learning Analytics, and Continuous Quality Improvement
Page 54: Openness, Learning Analytics, and Continuous Quality Improvement
Page 55: Openness, Learning Analytics, and Continuous Quality Improvement
Page 56: Openness, Learning Analytics, and Continuous Quality Improvement

Open Textbook Examples

Page 57: Openness, Learning Analytics, and Continuous Quality Improvement
Page 58: Openness, Learning Analytics, and Continuous Quality Improvement
Page 59: Openness, Learning Analytics, and Continuous Quality Improvement

Expanded Funding

Page 60: Openness, Learning Analytics, and Continuous Quality Improvement

Department of Labor

$2 Billion for high-demand two year programs

Page 61: Openness, Learning Analytics, and Continuous Quality Improvement
Page 62: Openness, Learning Analytics, and Continuous Quality Improvement

Not Just Foundation Funding

Page 63: Openness, Learning Analytics, and Continuous Quality Improvement

Accreditation

Get credit for what you know

Page 64: Openness, Learning Analytics, and Continuous Quality Improvement
Page 65: Openness, Learning Analytics, and Continuous Quality Improvement

University of the People

Page 66: Openness, Learning Analytics, and Continuous Quality Improvement

OER University

Page 67: Openness, Learning Analytics, and Continuous Quality Improvement

Mozilla Badge Lab

Page 68: Openness, Learning Analytics, and Continuous Quality Improvement

Practical Analytics

Making use of data

Page 69: Openness, Learning Analytics, and Continuous Quality Improvement
Page 70: Openness, Learning Analytics, and Continuous Quality Improvement
Page 71: Openness, Learning Analytics, and Continuous Quality Improvement
Page 72: Openness, Learning Analytics, and Continuous Quality Improvement
Page 73: Openness, Learning Analytics, and Continuous Quality Improvement

Each and Every Interaction

Recorded and stored for analysis

Page 74: Openness, Learning Analytics, and Continuous Quality Improvement

If Only We Could Get Data!

We could do analyses (aka research) too

Page 75: Openness, Learning Analytics, and Continuous Quality Improvement
Page 76: Openness, Learning Analytics, and Continuous Quality Improvement
Page 77: Openness, Learning Analytics, and Continuous Quality Improvement
Page 78: Openness, Learning Analytics, and Continuous Quality Improvement

Canvas

Page 79: Openness, Learning Analytics, and Continuous Quality Improvement

Even the Grocer!

Almost every industry (1) gathers and (2) uses data more effectively than we do

Page 80: Openness, Learning Analytics, and Continuous Quality Improvement

What Kind of Data?

Assessment dataConstruct-relevant behavioral data

Page 81: Openness, Learning Analytics, and Continuous Quality Improvement

Assessment Data

Difficulty estimatesDiscrimination estimates

Per standard expertise estimates(Not just “grades”)

Page 82: Openness, Learning Analytics, and Continuous Quality Improvement

Behavioral Data

When they logged in, read, and workedHow long they logged in, read, and worked

Pathway informationSocial network analysis

&c.

Page 83: Openness, Learning Analytics, and Continuous Quality Improvement

What If You Could Know

Which students need the most help?Specifically what those students need help on

(academic or behavioral)?The least effective parts of you curriculum?

Which parts of your tests are malfunctioning?

Page 84: Openness, Learning Analytics, and Continuous Quality Improvement
Page 85: Openness, Learning Analytics, and Continuous Quality Improvement
Page 86: Openness, Learning Analytics, and Continuous Quality Improvement

Teaching as Science

With sufficient amounts of data,and appropriate commitment, it’s possible

Page 87: Openness, Learning Analytics, and Continuous Quality Improvement

Learning Analytics

Can tell us who and what needs help

Page 88: Openness, Learning Analytics, and Continuous Quality Improvement

Openness

Gives us permission to make changes / adaptations / improvements

Page 89: Openness, Learning Analytics, and Continuous Quality Improvement

Pointless

Knowing what needs fixed, when you don’t have permission to fix it

Page 90: Openness, Learning Analytics, and Continuous Quality Improvement

Pointless

Having permission to fix things,when you don’t know where to start

Page 91: Openness, Learning Analytics, and Continuous Quality Improvement

Openness + Analytics

Enable Continuous Quality Improvement

Page 92: Openness, Learning Analytics, and Continuous Quality Improvement
Page 93: Openness, Learning Analytics, and Continuous Quality Improvement

Curriculum Use

Curriculum Redesign

StudentPerformance

Data

Data Describing Curriculum

Performance

Data Supporting Strategic Tutoring

TheLoop

Page 94: Openness, Learning Analytics, and Continuous Quality Improvement

“Strategic Tutoring?”

What if we could do one-on-one tutoring just-in-time and just-on-topic?

Page 95: Openness, Learning Analytics, and Continuous Quality Improvement

You Would Have to Know

Who needs help right now?What do they need help on?

Page 96: Openness, Learning Analytics, and Continuous Quality Improvement

Strategic Tutoring

1. Online curriculum teaches as much as possible

2. Teachers do proactive, data-based, one-on-one outreach

Page 97: Openness, Learning Analytics, and Continuous Quality Improvement

Teacher Becomes Tutor

Has the computer replaced the teacher?

As broadcast machinery, yes.

Page 98: Openness, Learning Analytics, and Continuous Quality Improvement

The Loop and Conjoint CQI

Student learning AND curriculum effectivenessgrow simultaneously

Page 99: Openness, Learning Analytics, and Continuous Quality Improvement

But Tutoring Data are Out-of-Band!

Where does the data go?

Page 100: Openness, Learning Analytics, and Continuous Quality Improvement
Page 101: Openness, Learning Analytics, and Continuous Quality Improvement

If the Book Didn’t Change Schools

Can openness?Can analytics?

Can openness + analytics?

Page 102: Openness, Learning Analytics, and Continuous Quality Improvement
Page 103: Openness, Learning Analytics, and Continuous Quality Improvement

Reconsider Your Stewardship

CQI is possible today

Do you have an ethical or moral responsibility to engage?

Page 104: Openness, Learning Analytics, and Continuous Quality Improvement

Thank You

[email protected]@opencontent

http://davidwiley.org/