33
Did It Work? Evaluating the Impact of the Learning Resource Metadata Initiative for OER #LRMIforOER Darren Milligan Senior Digital Strategist Smithsonian Institution, Center for Learning and Digital Access @darrenmilligan Melissa Wadman Manager of Program Evaluation Smithsonian Institution, Center for Learning and Digital Access Sue Cowden Senior Director, Content Partnerships inBloom

Did It Work? Evaluating the Impact of the Learning Resource Metadata Initiative (LRMI) for OER

Embed Size (px)

DESCRIPTION

Presented at SXSWEdu March 6, 2014 Austin, TX, USA Sure, aligning commercial content to LRMI is becoming a standard for major publishers and those with deep pockets, but what about non-profits, museums, or research organizations? The Smithsonian will present their process for identifying resources, selecting teacher metadata creators, and implementing the code on their websites and into the Learning Registry. Attendees will learn how to develop effective methodologies to evaluate the impact on discoverability of LRMI-tagged content. Darren Milligan Senior Digital Strategist Smithsonian Institution, Center for Learning and Digital Access @darrenmilligan Melissa Wadman Manager of Program Evaluation Smithsonian Institution, Center for Learning and Digital Access Sue Cowden Senior Director, Content Partnerships inBloom #lrmiforoer - See more at: http://schedule.sxswedu.com/events/event_EDUP23498#sthash.TmtkMUrU.dpuf

Citation preview

Page 1: Did It Work? Evaluating the Impact of the Learning Resource Metadata Initiative (LRMI) for OER

Did It Work? Evaluating the Impact of the Learning Resource Metadata Initiative for OER

#LRMIforOER

Darren MilliganSenior Digital StrategistSmithsonian Institution, Center for Learning and Digital Access@darrenmilligan

Melissa WadmanManager of Program EvaluationSmithsonian Institution, Center for Learning and Digital Access

Sue CowdenSenior Director, Content PartnershipsinBloom

Page 2: Did It Work? Evaluating the Impact of the Learning Resource Metadata Initiative (LRMI) for OER
Page 3: Did It Work? Evaluating the Impact of the Learning Resource Metadata Initiative (LRMI) for OER

Audience Participation Time

Image adapted from the Department of Education, http://www.flickr.com/photos/departmentofed/9602545478/, used under a CC BY 2.0 license.

Page 4: Did It Work? Evaluating the Impact of the Learning Resource Metadata Initiative (LRMI) for OER

Audience Participation Time(Raise Your Hands)

Who has visited one or more Smithsonian museums in DC or New York?

Page 5: Did It Work? Evaluating the Impact of the Learning Resource Metadata Initiative (LRMI) for OER

Audience Participation Time(Raise Your Hands)

Who has visited one or more Smithsonian museums in DC or New York?

Who has visited a Smithsonian website, used a digital resource, or interacted with a Smithsonian scientist, curator, educator, or other staff online?

Page 6: Did It Work? Evaluating the Impact of the Learning Resource Metadata Initiative (LRMI) for OER
Page 7: Did It Work? Evaluating the Impact of the Learning Resource Metadata Initiative (LRMI) for OER

199523.6 million physical visits to our museums72,942 web visits

Page 8: Did It Work? Evaluating the Impact of the Learning Resource Metadata Initiative (LRMI) for OER

199523.6 million physical visits to our museums72,942 web visits

201330 million physical visits to our museums140 million digital visits

Page 9: Did It Work? Evaluating the Impact of the Learning Resource Metadata Initiative (LRMI) for OER

199523.6 million physical visits to our museums72,942 web visits

201330 million physical visits to our museums140 million digital visits

Physical: 30,000,000-23,600,000 / 23,600,000 X 100 = 27.12% increaseDigital: 140,000,000-72,942 / 72,942 X 100 = 191,833.32% increase

Page 10: Did It Work? Evaluating the Impact of the Learning Resource Metadata Initiative (LRMI) for OER

199523.6 million physical visits to our museums72,942 web visits

201330 million physical visits to our museums140 million digital visits

Physical: 30,000,000-23,600,000 / 23,600,000 X 100 = 27.12% increaseDigital: 140,000,000-72,942 / 72,942 X 100 = 191,833.32% increase

Page 11: Did It Work? Evaluating the Impact of the Learning Resource Metadata Initiative (LRMI) for OER

201030.2 million physical visits to our museums97.2 million digital visits

Page 12: Did It Work? Evaluating the Impact of the Learning Resource Metadata Initiative (LRMI) for OER

201030.2 million physical visits to our museums97.2 million digital visits

201330 million physical visits to our museums140 million digital visits

Page 13: Did It Work? Evaluating the Impact of the Learning Resource Metadata Initiative (LRMI) for OER

201030.2 million physical visits to our museums97.2 million digital visits

201330 million physical visits to our museums140 million digital visits

Physical: 0.66% decreaseDigital: 44.06% increase

Page 14: Did It Work? Evaluating the Impact of the Learning Resource Metadata Initiative (LRMI) for OER

What Can the Smithsonian Do to Help Young People Be Successful in Their Lives?

Page 15: Did It Work? Evaluating the Impact of the Learning Resource Metadata Initiative (LRMI) for OER

What Can Our Digital ResourcesDo to Help Young People Be Successful in Their Lives?

Page 16: Did It Work? Evaluating the Impact of the Learning Resource Metadata Initiative (LRMI) for OER

“We have ambitious plans to use new technologies to reach new audiences. … We have much to offer students and teachers in art, science, history, education, and culture. We want to give learners of all ages access to America’s treasures and our creative experts who bring them to life.”

– G. Wayne Clough

Page 17: Did It Work? Evaluating the Impact of the Learning Resource Metadata Initiative (LRMI) for OER
Page 18: Did It Work? Evaluating the Impact of the Learning Resource Metadata Initiative (LRMI) for OER
Page 19: Did It Work? Evaluating the Impact of the Learning Resource Metadata Initiative (LRMI) for OER
Page 20: Did It Work? Evaluating the Impact of the Learning Resource Metadata Initiative (LRMI) for OER
Page 21: Did It Work? Evaluating the Impact of the Learning Resource Metadata Initiative (LRMI) for OER
Page 22: Did It Work? Evaluating the Impact of the Learning Resource Metadata Initiative (LRMI) for OER

LRMI Survey Report August 2013 Update

43.7%: search online several times a week

30.5%: search online daily

64.8%: report “irrelevant results”

86.8%: more satisfied if they could filter

Page 23: Did It Work? Evaluating the Impact of the Learning Resource Metadata Initiative (LRMI) for OER
Page 24: Did It Work? Evaluating the Impact of the Learning Resource Metadata Initiative (LRMI) for OER

Survey responses from educators indicating the relative importance of descriptive metadata for learning resources (LRMI Survey Report August 2013 Update, Ease and Discoverability: Educators and Publishers on the Search for Educational Content).

LRMI Survey Report August 2013 Update

Page 25: Did It Work? Evaluating the Impact of the Learning Resource Metadata Initiative (LRMI) for OER
Page 26: Did It Work? Evaluating the Impact of the Learning Resource Metadata Initiative (LRMI) for OER

based on The Content Developers Guide to the Learning Resource Metadata Initiative and Learning Registry, 2013

Page 27: Did It Work? Evaluating the Impact of the Learning Resource Metadata Initiative (LRMI) for OER
Page 28: Did It Work? Evaluating the Impact of the Learning Resource Metadata Initiative (LRMI) for OER

Train and Share

Training Workshops

Training Video

Virtual Tagathons

LRMI Guide

Page 29: Did It Work? Evaluating the Impact of the Learning Resource Metadata Initiative (LRMI) for OER
Page 30: Did It Work? Evaluating the Impact of the Learning Resource Metadata Initiative (LRMI) for OER
Page 32: Did It Work? Evaluating the Impact of the Learning Resource Metadata Initiative (LRMI) for OER

Who are the best partners for developing strategy, implementation, and evaluation of an LRMI tagging project?

How do you evaluate/demonstrate the impact of LRMI implementation?

How does a large OER publisher implement LRMI?

Page 33: Did It Work? Evaluating the Impact of the Learning Resource Metadata Initiative (LRMI) for OER

Questions?

#LRMIforOER

Darren MilliganSenior Digital StrategistSmithsonian Institution, Center for Learning and Digital [email protected] / @darrenmilligan

Melissa WadmanManager of Program EvaluationSmithsonian Institution, Center for Learning and Digital [email protected]

Sue CowdenSenior Director, Content [email protected]