AAMC Implementation of the MedBiquitous Curriculum Inventory Data Exchange Standard Terri Cameron,...

AAMC Implementation of the MedBiquitous Curriculum Inventory Data Exchange Standard

Terri Cameron, MADirector of Curriculum Programs

Spring 2014

MedBiquitous Curriculum Inventory V1

• Working Group launched in December 2010• Susan Albright and Marc Triola, co-chairs 2010-2013• Charter:

“to develop XML standards for the exchange of curriculum data for benchmarking and educational research.” (Not just for AAMC Curriculum Inventory)

• Reasons for Undertaking Work:• Enable local curriculum management systems to upload data to

a central Curriculum Inventory• Identify curricular trends• Support curriculum benchmarking and reform

• Approved by CI Working Group: February 2013• Approved by ANSI: May 2013

www.aamc.org/medaps

CI Pilot• September – December

• 25 schools / six vendors

• 5 schools working with school-based systems

• Testing• Upload process• Accuracy of Verification Report to submitted

data• School Portal functionality

www.aamc.org/medapswww.aamc.org/medaps

CI Pilot Results• Increased file size limits

• Provided staging area for vendors

• Improved error messages

• Clarified AAMC Business Rules

• Improved appearance of School Portal

• Added curriculum file upload screen

www.aamc.org/medapswww.aamc.org/medaps

2012-2013 Upload Process• CI Portal Open: December 10• CI Portal Close: February 10: 65 Schools• One month follow up period for schools that

did not participate• CI Gateway Close on March 10: 90 Schools

• 85 US Medical Schools• 5 Canadian Medical Schools

• Additional schools were in process but unable to meet deadline

• All other schools contacted plan to participate in 2013-2014 Upload (August)

www.aamc.org/medaps

2012-2013 Upload Details• 50 Schools included competency mapping• 4968 Sequence Blocks• 107458 Events• 108031 Sequence Block Expectations• 283325 Event Expectations• 61249 Assessment Methods • 124068 Instructional Methods• 22421 Resources

www.aamc.org/medaps

2012-2013 Resource DetailsResource Type Number

1 Audience Response System 12582 Audio 12163 Cadaver 4584 Clinical Correlation 9975 Distance Learning - Asynchronous 2866 Distance Learning - Synchronous 147 Educational Technology 56758 Electronic Health/Medical Record (EHR/EMR) 1849 Film/Video 113410 Key Feature 211 Mannequin 9612 Plastinated Specimens 213 Printed Materials (or Digital Equivalent) 57014 Real Patient 80915 Searchable Electronic Database 10416 Standardized/Simulated Patient (SP) 34117 Task Trainer 7618 Virtual Patient 19319 Virtual/Computerized Laboratory 17720 Wet Laboratory 244

www.aamc.org/medaps

2012-2013 ‘Other’ Resources

www.aamc.org/medaps

Anatomy 8Biology of Cells 1inanimate models 1Medical equipment 19Museum 1Palliative Care 1Panel 3Panel discussions 21Personality/leadership test/profile (disc)

6

Plastinated Specimens 105Printed Materials (or Digital

161

Printed Materials (or Digital Equivalent)

8076

Scenarios 62

Searchable Electronic Database

68

Simulator (Harvey) 3

Small group discussion with facilitator

25

Small group discussion with mentor of a project review

3

theater project 2

Ultrasound 9

ventilator 1

Women's Health 1

Written assignments 8

• Reasons for not participating this year:• Focused on LCME Site Visit• Curriculum Review/Renewal/Change• Just started working with new curriculum

management system so did not have data completely entered / organized

• Do not have system / have not decided on a vendor yet / do not have technical staff

• Change in leadership / staff – needed time to come up to speed

• Concerns about Verification Report• Vendor did not upload as planned

www.aamc.org/medaps

2012-2013 Upload Process

• Biggest Hurdles:• Report Start and End Dates• Institution Information• Competencies

• Program to PCRS (related)• Hierarchy Levels (broader / narrower)

• Academic Levels• Start and End Dates• Sequence Blocks in multiple levels

• Unique Curricula• Multiple options for students

www.aamc.org/medaps

2012-2013 Upload Process

• Biggest Hurdles:• Organizing data• Documenting competencies in XML• CI Verification Report

• Assessment Counts• Summative / Formative

• Instructional Method Hour Counts• Constantly-changing environment

• Communication!

www.aamc.org/medaps

2012-2013 Upload Process

• Successes:• Curriculum Management System Vendors

• Massive changes to systems to support CI • Great communication and feedback• All but one uploaded as planned

• MedBiq Leadership / Support• Valerie Smothers• CI Implementers’ Listserv

• Webinars• Nearly every school participated

• Physician Competency Reference Set (PCRS)• Standardized Vocabulary• School Participation

www.aamc.org/medaps

2012-2013 Upload Process

CI Reports• Two Sources of Data:

• Curriculum Inventory• LCME Annual Questionnaire Part II

• Phased Approach for Reporting:• Short-term (6-12 months)

• Static Reports• Reports by Request (ciadmin@aamc.org)

• Intermediate-term (12- 18 months)• Dynamic Reports• Reports on Demand

• Long-term (2-3 years)• Enterprise-wide (AAMC) Reporting Solution

www.aamc.org/medaps

CI Reports• Reporting Options

• Short-term and Intermediate• Choose types of schools to include:

• All Schools• US Medical Schools• US Regional Medical Schools• Canadian Medical Schools• Osteopathic Schools

• Enter search criteria• Reports will include:

• Where and how often content is covered• Instructional methods• Assessment Methods• Competencies

www.aamc.org/medaps

Preparing for 2013-2014• CI School Portal Opens August 1

• Closes September 30

• Staging (for testing uploads) available in May• Vendors automatically have access• Available to school developers by request

• Webinars/Virtual Focus Groups:• Three-part Developer Series• Curriculum Deans and Administrators

• Developer-to-Developer Hands-on Workshop:• Develop and upload one course plus Program

Competencies mapped to PCRS

www.aamc.org/medaps

MedBiquitous Curriculum Inventory V2 • Working Group convened in February 2014• Susan Albright and Hugh Stoddard, co-chairs• Review of implementation of V1• Known Issues:

Academic Level Assessment Methods

– Requirement for Formative/Summative Event Duration (Assessments) Sequence Block Duration (Weeks) Resources (Require / Refine List ) Standardized Vocabulary Update

Resources• Curriculum Inventory Website:

www.aamc.org/cir • Webinar dates• Developer resources• Updates regarding reports• Vendor List• Participating Schools

• MedBiquitous: www.medbiq.org • Curriculum Inventory Working Group:

http://www.medbiq.org/curriculum_inventory

• Competencies Working Group:http://www.medbiq.org/working_groups/competencies/index.html

www.aamc.org/medaps

Questions?

www.aamc.org/medaps

©