33
Identifying and Overcoming Challenges to High-Quality Simulation-based Research: Improving Rigor and Impact Todd P Chang MD Marc Auerbach MD MSc Elizabeth Hunt MD MPH PhD David Kessler MD MSc Adam Cheng MD International Network for Simulation-based Pediatric Innovation, Research and Education #658 13:00

INSPIRE Workshop 2014 Slides

Embed Size (px)

Citation preview

Page 1: INSPIRE Workshop 2014 Slides

Identifying and Overcoming Challenges to High-Quality Simulation-based Research:

Improving Rigor and Impact

Todd P Chang MDMarc Auerbach MD MScElizabeth Hunt MD MPH PhDDavid Kessler MD MScAdam Cheng MD

International Network for Simulation-based Pediatric Innovation, Research and Education

#658 13:00

Page 2: INSPIRE Workshop 2014 Slides

• No relevant financial conflicts of interest• The INSPIRE Network infrastructure has

partial funding from:

International Network for Simulation-based Pediatric Innovation, Research and Education

Disclosures

Page 3: INSPIRE Workshop 2014 Slides

International Network for Simulation-based Pediatric Innovation, Research and Education

Page 4: INSPIRE Workshop 2014 Slides

INSPIRE Network

International Network for Simulation-based Pediatric Innovation, Research and Education

Page 5: INSPIRE Workshop 2014 Slides

INSPIRE Network

International Network for Simulation-based Pediatric Innovation, Research and Education

Page 6: INSPIRE Workshop 2014 Slides

INSPIRE Network

International Network for Simulation-based Pediatric Innovation, Research and Education

Page 7: INSPIRE Workshop 2014 Slides

• Evaluate characteristics of a simulation-based research question or protocol conducive to quality research & output

• Identify 6 specific challenges in simulation-based research that threaten rigor and quality of research output

• Demonstrate differences in problems faced by single-center vs. multi-center research

Objectives

International Network for Simulation-based Pediatric Innovation, Research and Education

Page 8: INSPIRE Workshop 2014 Slides

Format

International Network for Simulation-based Pediatric Innovation, Research and Education

Page 9: INSPIRE Workshop 2014 Slides

90 minutes

5

International Network for Simulation-based Pediatric Innovation, Research and Education

Page 10: INSPIRE Workshop 2014 Slides

90 minutes

5

15

10

International Network for Simulation-based Pediatric Innovation, Research and Education

Page 11: INSPIRE Workshop 2014 Slides

90 minutes

5

15

10

30

25

International Network for Simulation-based Pediatric Innovation, Research and Education

Page 12: INSPIRE Workshop 2014 Slides

90 minutes

5

15

10

30

25

5

International Network for Simulation-based Pediatric Innovation, Research and Education

Page 13: INSPIRE Workshop 2014 Slides

90 minutes

5

15

10

30

25

5

2 – 4 weeks

International Network for Simulation-based Pediatric Innovation, Research and Education

Page 14: INSPIRE Workshop 2014 Slides

13:05 Small Group I 13:19

International Network for Simulation-based Pediatric Innovation, Research and Education

Page 15: INSPIRE Workshop 2014 Slides

13:20 Overview 13:29

International Network for Simulation-based Pediatric Innovation, Research and Education

Page 16: INSPIRE Workshop 2014 Slides

1. Scenario development2. Outcome measurements3. Sharing and rating videos4. IT- and Mobile / Web solutions5. Standardizing research protocols6. Logistics, budgeting, staffing

6 Potential Challenges

International Network for Simulation-based Pediatric Innovation, Research and Education

Page 17: INSPIRE Workshop 2014 Slides

• Simulator capabilities

• Facility capabilities

• Institutional equipment

• Protocols, medicolegal elements

1. Scenario Development

International Network for Simulation-based Pediatric Innovation, Research and Education

Page 18: INSPIRE Workshop 2014 Slides

1. Scenario Development

International Network for Simulation-based Pediatric Innovation, Research and Education

Page 19: INSPIRE Workshop 2014 Slides

• Standardization

• Simulator capabilities

• Data capture

• Instrument validity

2. Outcome Measurements

International Network for Simulation-based Pediatric Innovation, Research and Education

Page 20: INSPIRE Workshop 2014 Slides

2. Outcome Measurements

International Network for Simulation-based Pediatric Innovation, Research and Education

Page 21: INSPIRE Workshop 2014 Slides

• Accessibility / Protection

• Videography quality

• Interobserver agreement

3. Sharing & rating videos

International Network for Simulation-based Pediatric Innovation, Research and Education

Page 22: INSPIRE Workshop 2014 Slides

3. Sharing video & reviews

International Network for Simulation-based Pediatric Innovation, Research and Education

Page 23: INSPIRE Workshop 2014 Slides

• Accessibility / Protection

• Platforms, Operating systems

• Institutional firewalls, blocked programs

• Firesharing

4. IT & Mobile Web

International Network for Simulation-based Pediatric Innovation, Research and Education

Page 24: INSPIRE Workshop 2014 Slides

4. IT & Mobile Web

International Network for Simulation-based Pediatric Innovation, Research and Education

Page 25: INSPIRE Workshop 2014 Slides

• Simulator capabilities

• Facility and personnel capabilities

• Clinical standard of care

• Buy-in

5. Standardizing protocols

International Network for Simulation-based Pediatric Innovation, Research and Education

Page 26: INSPIRE Workshop 2014 Slides

5. Standardizing protocols

International Network for Simulation-based Pediatric Innovation, Research and Education

Page 27: INSPIRE Workshop 2014 Slides

• Research coordinators

• Institutional Review Boards

• Academic credit, Legitimacy of authorship

• Communication, troubleshooting

6. Logistics

International Network for Simulation-based Pediatric Innovation, Research and Education

Page 28: INSPIRE Workshop 2014 Slides

1. Greater ‘n’

2. Reliability, Validity, Generalizability

3. Greater Expert pool

4. Greater Resources

Does multicenter solve everything?

International Network for Simulation-based Pediatric Innovation, Research and Education

Page 29: INSPIRE Workshop 2014 Slides

International Network for Simulation-based Pediatric Innovation, Research and Education

Brophy RH et al. Multi-investigator collaboration in orthopaedic surgery research compared to other medical fields. J Ortho Res 2012;30(10):1523-8.

Page 30: INSPIRE Workshop 2014 Slides

13:30 Small Group II 13:59

International Network for Simulation-based Pediatric Innovation, Research and Education

Page 31: INSPIRE Workshop 2014 Slides

14:00 Report Out 14:24

International Network for Simulation-based Pediatric Innovation, Research and Education

Page 32: INSPIRE Workshop 2014 Slides

14:25 Denouement 14:30

International Network for Simulation-based Pediatric Innovation, Research and Education

Page 33: INSPIRE Workshop 2014 Slides

Thank you

[email protected]

http://www.INSPIRESim.com/International Network for Simulation-based Pediatric Innovation, Research and Education