148
Results of the 2014 NRMP Program Director Survey www.nrmp.org June 2014

Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

  • Upload
    others

  • View
    2

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

Results of the 2014 NRMP Program Director Survey

www.nrmp.org

June 2014

mliang
Text Box
All rights reserved. Permission to use, copy and/or distribute any documentation and/or related images from this publication shall be expressly obtained from the NRMP.
Page 2: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

Requests for permission to use these data as well as questions about the content of this publication or the National Resident Matching Program data and reports may be directed to

Mei Liang, Director of Research, NRMP, at [email protected].

Questions about the NRMP should be directed to Mona M. Signer, Executive Director, NRMP, at [email protected].

Suggested CitationNational Resident Matching Program, Data Release and Research Committee: Results of the

2014 NRMP Program Director Survey. National Resident Matching Program, Washington, DC. 2014.

Copyright © 2014 National Resident Matching Program.

Page 3: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

Introduction .................................................................................................................................................................. 1 All Specialties............................................................................................................................................................... 2 Charts for Individual Specialties

Anesthesiology ....................................................................................................................................................... 8 Child Neurology ................................................................................................................................................... 14 Dermatology ......................................................................................................................................................... 20 Emergency Medicine ........................................................................................................................................... 26 Family Medicine ................................................................................................................................................... 32 Internal Medicine .................................................................................................................................................. 38 Internal Medicine/Pediatrics ................................................................................................................................. 44 Neurological Surgery ............................................................................................................................................ 50 Neurology ............................................................................................................................................................. 56 Obstetrics and Gynecology .................................................................................................................................. 62 Orthopaedic Surgery ............................................................................................................................................. 68 Otolaryngology ..................................................................................................................................................... 74 Pathology .............................................................................................................................................................. 80 Pediatrics .............................................................................................................................................................. 86 Physical Medicine and Rehabilitation .................................................................................................................. 92 Plastic Surgery ...................................................................................................................................................... 98 Psychiatry ........................................................................................................................................................... 104 Radiation Oncology ............................................................................................................................................ 110 Radiology-Diagnostic ......................................................................................................................................... 116 Surgery ............................................................................................................................................................... 122 Thoracic Surgery ................................................................................................................................................ 128 Transitional Year ................................................................................................................................................ 134 Vascular Surgery ................................................................................................................................................ 140

Table of Contents

Page 4: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

Introduction

1NRMP Program Director Survey Results, 2014

In March 2014, the National Resident Matching Program (NRMP) conducted its biennial survey of the directors of all programs participating in the Main Residency Match®. The primary purpose of the survey was to shed light on the factors that program directors use to (1) select applicants to interview and (2) rank applicants for the Match.

The survey was fielded during the 18 days between the rank order list deadline and Match Week so that program match outcomes would not influence respondents' answers.

The survey solicited information on: the number of applications received, screened, and

reviewed, as well as the number of applicants interviewed and ranked

whether the program typically interviews and ranks specific applicant groups

use of test scores in considering which applicants to interview, and

the factors used for both interview selection and for ranking applicants.

The overall response rate for all specialties in this report was 52.7 percent. Transitional Year and 22 specialties with 10 or more responses are included in this report. Their response rates are listed in the table below. Response rates for those specialties ranged from a high of 65.4 percent for Emergency Medicine and Pediatrics to a low of 42.6 for Radiology.

Several changes were made to the 2014 questionnaire. In the past, program directors were asked to indicate factors they used in selecting applicants to interview and to rate the importance of each factor in ranking. In this survey, program directors were asked to indicate factors they used in selecting applicants to interview and rank respectively. They were asked to rate the importance on a scale of 1 to 5 only for the factors they used in their selection process. In addition, this survey asked program directors how they handled unfilled positions after the 2013 Match and SOAP. Because the number of responses for that question was small, the results are only reported in the "All Specialties" section.

Numbers of responses are presented in most of the graphs. Some graphs use data from multiple survey questions. In those cases, different N's are listed. Numbers of applicants ranked and positions in the Match are extracted from the NRMP database. Graphs are suppressed for questions with fewer than five responses.

This report presents results by specialty on selected items from the survey. The NRMP hopes that program directors, medical school officials, and applicants find these data useful as they prepare for and participate in the Main Residency Match._______________

The NRMP's data reporting and research activities are guided by its Data Release and Research Committee. NRMP data and reports can be found at: www.nrmp.org/match-data/.

Specialty Surveys Sent Number Responding Response Rate

Anesthesiology 127 71 55.9%

Child Neurology 72 41 56.9%

Dermatology 110 60 54.5%

Emergency Medicine 159 104 65.4%

Family Medicine 429 236 55.0%

Internal Medicine 379 197 52.0%

Internal Medicine/Pediatrics 80 35 43.8%

Neurological Surgery 102 55 53.9%

Neurology 129 60 46.5%

Obstetrics and Gynecology 230 123 53.5%

Orthopaedic Surgery 147 87 59.2%

Otolaryngology 100 46 46.0%

Pathology 134 84 62.7%

Pediatrics 185 121 65.4%

Physical Medicine and Rehabilitation 77 34 44.2%

Plastic Surgery 63 39 61.9%

Psychiatry 180 84 46.7%

Radiation Oncology 84 44 52.4%

Radiology‐Diagnostic 176 75 42.6%

Surgery 275 121 44.0%

Thoracic Surgery 25 12 48.0%

Transitional Year 91 47 51.6%

Vascular Surgery 44 22 50.0%

All others 101 46 45.5%

Total 3,499 1,844 52.7%

Page 5: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

All Specialties Combined(N=1,844)

Page 6: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

Figure 1All SpecialtiesPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview(N=1,793)

100% 50% 0%

94%

86%

84%

80%

78%

75%

70%

70%

69%

69%

69%

65%

65%

63%

63%

61%

61%

61%

57%

57%

56%

56%

54%

48%

43%

39%

34%

28%

27%

27%

25%

25%

18%

USMLE Step 1/COMLEX Level 1 score

Letters of recommendation in the specialty

Medical Student Performance Evaluation (MSPE/Dean's Letter)

USMLE Step 2 CK/COMLEX Level 2 CE score

Personal Statement

Graduate of U.S. allopathic medical school

Grades in required clerkships

Gaps in medical education

Honors in clinical clerkships

Perceived commitment to specialty

Class ranking/quartile

Evidence of professionalism and ethics

Personal prior knowledge of the applicant

Audition elective/rotation within your department

Leadership qualities

Honors in clerkship in desired specialty

Grades in clerkship in desired specialty

Alpha Omega Alpha (AOA) membership

Pass USMLE Step2 CS/COMLEX Lvl2 PE

Perceived interest in program

Consistency of grades

Other life experience

Volunteer/extracurricular experiences

Graduate of highly regarded U.S. medical school

Demonstrated involvement and interest in research

Visa status*

Applicant was flagged with Match violation by the NRMP

Interest in academic career

Honors in basic sciences

Gold Society membership

Away rotation in your specialty at another institution

Fluency in language spoken by your patient population

USMLE/COMLEX Step 3 score

1 2 3 4 5

4.1

4.2

4.0

4.1

3.6

4.1

4.0

4.1

4.0

4.3

3.9

4.5

4.1

4.0

4.0

4.3

4.3

3.8

4.1

4.1

4.0

3.6

3.6

3.8

3.7

4.0

4.8

3.7

3.5

3.7

3.7

3.6

3.5

Percent Citing Factor Average Rating

¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only

3NRMP Program Director Survey Results, 2014

Page 7: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

100% 50% 0%

93%93%88%

82%80%

74%71%68%67%64%62%60%58%57%57%55%55%51%50%49%45%45%45%45%44%40%40%36%36%33%

26%23%22%20%20%20%19%

17%15%

Interactions with faculty during interview and visit

Interpersonal skills

Interactions with house staff during interview and visit

Feedback from current residents

USMLE Step 1/COMLEX Level 1 score

Letters of recommendation in the specialty

USMLE Step 2 CK/COMLEX Level 2 CE score

Medical Student Performance Evaluation (MSPE/Dean's Letter)

Perceived commitment to specialty

Evidence of professionalism and ethics

Perceived interest in program

Leadership qualities

Personal prior knowledge of the applicant

Class ranking/quartile

Graduate of U.S. allopathic medical school

Personal Statement

Audition elective/rotation within your department

Grades in required clerkships

Passing USMLE Step 2 CS/COMLEX Level 2 PE

Honors in clinical clerkships

Honors in clerkship in desired specialty

Gaps in medical education

Grades in clerkship in desired specialty

Alpha Omega Alpha (AOA) membership

Other life experience

Consistency of grades

Volunteer/extracurricular experiences

Demonstrated involvement and interest in research

Graduate of highly regarded U.S. medical school

Other post‐interview contact

Interest in academic career

Visa status*

Applicant was flagged with Match violation by the NRMP

Fluency in language spoken by your patient population

Gold Society membership

Honors in basic sciences

Second interview/visit

Away rotation in your specialty at another institution

USMLE/COMLEX Step 3 score

All SpecialtiesPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants(N=1,799)

Figure 2

1 2 3 4 5

4.84.84.74.6

4.14.14.14.0

4.34.5

4.14.14.3

4.04.1

3.64.3

4.04.14.04.24.14.2

4.03.7

4.03.73.73.94.0

3.84.0

4.73.83.8

3.53.73.9

3.7

Average RatingPercent Citing Factor

4NRMP Program Director Survey Results, 2014

¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only

Page 8: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

0%

20%

40%

60%

80%

100%

Yes, pass only Yes, target score No

31%

50%

19%

Scores required?

All SpecialtiesPrograms That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview

Figure 3

Percentage of Programs That Use USMLE Step 1 Score

Percentage of Programs That Use USMLE Step 2 (CK) Score

0%

20%

40%

60%

80%

100%

Yes, pass only Yes, target score No

31%

68%

1%

Scores required?

0%

20%

40%

60%

80%

100%

Never Seldom Often

26%

63%

11%

Would your program consider applicants who fail theexam on the first attempt?

0%

20%

40%

60%

80%

100%

Never Seldom often

35%

58%

6%

Would your program consider applicants who fail theexam on the first attempt?

N=1,746N=1,601

N=1,672 N=1,417

N=508N=684N=989

USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews

N=688

170

180

190

200

210

220

230

240

250

260

Scores Below Which Programs Generally Do Not Grant Interviews

170

180

190

200

210

220

230

240

250

260

Scores Above Which Programs Almost Always Grant Interviews

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol in the box represents the mean.

USMLE Step 2 CKUSMLE Step 1USMLE Step 2 CKUSMLE Step 1

5NRMP Program Director Survey Results, 2014

Page 9: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

17%10%

73%

COMLEX-USA Level 3*

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

36%41%

23%

COMLEX-USA Level 1*

N=610%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes No

78%

22%

USMLE Step 2 Clinical Skills (CS)

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

33% 33% 34%

COMLEX-USA Level 2-CE*

N=410%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

18%

11%

71%

USMLE Step 3

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

50%

12%

38%

COMLEX-USA Level 2-PE*

N=1,140 N=1,102

N=1,057 N=789

* Osteopathic applicants only

Figure 4 All SpecialtiesPercentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview

N=1,604 N=1,049

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores

6NRMP Program Director Survey Results, 2014

Page 10: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

U.S. Senior U.S. Graduate OsteopathicPhysician

Canadian Fifth Pathway U.S. IMG Non-U.S. IMG

99%

69% 71%

51%

35%

60%

48%

Percentage of Programs that Typically Interview and Rank Each Applicant Type

All SpecialtiesProgram's Interview Activities Figure 5

0

100

200

300

400

500

600

700

800

900

Number ofpositions in the

Match

Number ofapplications

received

Number ofinterview

invitations sent

Number ofapplicantsinterviewed

Number ofapplicants ranked

7

856

119 96 77

Average Number of Positions, Applications Received, InterviewInvitations Sent, and Applicants Interviewed and Ranked

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Percentage of applications rejected Percentage of applicants receivingan in-depth review

51%

44%

Average Percentage of Applicants Rejected and Reviewed

N=1,733 N=1,799

N=1,772

31% of all programs consider all applicant groups

N=1,799 N=1,776 N=1,791 N=1,844*N=1,844*

7NRMP Program Director Survey Results, 2014

* Data from the NRMP database. All Responding programs included

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

We want to receive only theERAS application

We will initiate contact withreferences and/or the

medical school, but we donot wish to be contacted

We want to be contacted bythe applicant’s medical

school after we have initiatedcontact with the applicant

Other

59%

24%

15%

2%

Preferred Type of Communication About Applicants During SOAP

N=1,582

Page 11: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

Anesthesiology (N=71)

NRMP Program Director Survey Results, 2014 8

Page 12: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

Figure AN-1AnesthesiologyPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview(N=67)

1 2 3 4 5

4.5

3.9

4.2

4.1

3.4

4.1

4.1

4.2

4.0

4.2

4.1

4.5

4.2

4.0

4.2

4.2

4.2

3.8

3.9

4.0

4.2

3.6

3.6

3.7

3.4

3.8

4.9

3.2

3.3

3.8

2.9

3.8

3.1

Average RatingPercent Citing Factor

¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only

100% 50% 0%

99%

81%

87%

82%

78%

85%

69%

75%

75%

60%

81%

70%

75%

75%

67%

48%

52%

69%

46%

51%

69%

60%

57%

52%

51%

45%

45%

27%

40%

36%

25%

13%

15%

USMLE Step 1/COMLEX Level 1 score

Letters of recommendation in the specialty

Medical Student Performance Evaluation (MSPE/Dean's Letter)

USMLE Step 2 CK/COMLEX Level 2 CE score

Personal Statement

Graduate of U.S. allopathic medical school

Grades in required clerkships

Gaps in medical education

Honors in clinical clerkships

Perceived commitment to specialty

Class ranking/quartile

Evidence of professionalism and ethics

Personal prior knowledge of the applicant

Audition elective/rotation within your department

Leadership qualities

Honors in clerkship in desired specialty

Grades in clerkship in desired specialty

Alpha Omega Alpha (AOA) membership

Pass USMLE Step2 CS/COMLEX Lvl2 PE

Perceived interest in program

Consistency of grades

Other life experience

Volunteer/extracurricular experiences

Graduate of highly regarded U.S. medical school

Demonstrated involvement and interest in research

Visa status*

Applicant was flagged with Match violation by the NRMP

Interest in academic career

Honors in basic sciences

Gold Society membership

Away rotation in your specialty at another institution

Fluency in language spoken by your patient population

USMLE/COMLEX Step 3 score

NRMP Program Director Survey Results, 2014 9

Page 13: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

AnesthesiologyPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants(N=67)

Figure AN-2

1 2 3 4 5

4.84.84.74.6

4.23.8

4.24.24.24.4

4.04.1

4.34.1

4.33.3

4.14.14.14.04.03.93.93.8

3.74.0

3.63.5

3.93.7

3.23.9

4.73.4

3.83.7

3.33.7

3.4

Average RatingPercent Citing Factor

¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only

100% 50% 0%

96%91%

85%81%

88%65%

69%74%72%

76%69%

75%66%

75%59%60%

68%59%

43%54%

37%49%

41%56%51%

59%41%38%

43%28%

19%21%21%7%

26%29%

16%10%

13%

Interactions with faculty during interview and visit

Interpersonal skills

Interactions with house staff during interview and visit

Feedback from current residents

USMLE Step 1/COMLEX Level 1 score

Letters of recommendation in the specialty

USMLE Step 2 CK/COMLEX Level 2 CE score

Medical Student Performance Evaluation (MSPE/Dean's Letter)

Perceived commitment to specialty

Evidence of professionalism and ethics

Perceived interest in program

Leadership qualities

Personal prior knowledge of the applicant

Class ranking/quartile

Graduate of U.S. allopathic medical school

Personal Statement

Audition elective/rotation within your department

Grades in required clerkships

Passing USMLE Step 2 CS/COMLEX Level 2 PE

Honors in clinical clerkships

Honors in clerkship in desired specialty

Gaps in medical education

Grades in clerkship in desired specialty

Alpha Omega Alpha (AOA) membership

Other life experience

Consistency of grades

Volunteer/extracurricular experiences

Demonstrated involvement and interest in research

Graduate of highly regarded U.S. medical school

Other post‐interview contact

Interest in academic career

Visa status*

Applicant was flagged with Match violation by the NRMP

Fluency in language spoken by your patient population

Gold Society membership

Honors in basic sciences

Second interview/visit

Away rotation in your specialty at another institution

USMLE/COMLEX Step 3 score

NRMP Program Director Survey Results, 2014 10

Page 14: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

170

180

190

200

210

220

230

240

250

260

AnesthesiologyPrograms That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview

Figure AN-3

Percentage of Programs That Use USMLE Step 2 (CK) Score

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Never Seldom Often

43%

57%

0%

Would your program consider applicants who fail theexam on the first attempt?

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Never Seldom often

45%

55%

0%

Would your program consider applicants who failthe exam on the first attempt?

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

15%

85%

0%

Scores required?

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

23%

48%

28%

Scores required?

N=68

N=63

N=64N=53

N=30N=53 N=42 N=26

Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews

Percentage of Programs That Use USMLE Step 1 Score

170

180

190

200

210

220

230

240

250

260

USMLE Step 2 CKUSMLE Step 1 USMLE Step 1 USMLE Step 2 CK

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.

Scores Above Which Programs Almost Always Grant Interviews

Scores Below Which Programs Generally Do Not Grant Interviews

NRMP Program Director Survey Results, 2014 11

Page 15: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

22%

53%

24%

COMLEX-USA Level 1*

N=61

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes No

64%

36%

USMLE Step 2 CS

AnesthesiologyPercentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview

Figure AN-4

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

26%33%

42%

COMLEX-USA Level 2-CE*

N=41

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

20%

7%

73%

USMLE Step 3

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

13% 13%

73%

COMLEX-USA Level 3*

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

47%

8%

45%

COMLEX-USA Level 2-PE*

N=61 N=41

N=45 N=43

N=38 N=30

* Osteopathic applicants only

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores

NRMP Program Director Survey Results, 2014 12

Page 16: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%100%

85% 84%

52%

31%

55%51%

U.S. Senior U.S. Graduate OsteopathicPhysician

Canadian Fifth Pathway U.S. IMG Non-U.S. IMG

Percentage of Programs that Typically Interview and Rank Each Applicant Type

Figure AN-5AnesthesiologyProgram's Interview Activities

0

100

200

300

400

500

600

700

800

900

1,000

Number ofpositions in the

Match

Number ofapplications

received

Number ofinterview

invitations sent

Number ofapplicantsinterviewed

Number ofapplicants

ranked

7

704

152 142102

Average Number of Positions, Applications Received, InterviewInvitations Sent, and Applicants Interviewed and Ranked

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Percentage of applicationsrejected

Percentage of applicantsreceiving an in-depth review

47% 46%

Average Percentage of Applicants Rejected andReviewed

N=68N=66N=71* N=71*N=68N=68

N=67

30% of Anesthesiology programs consider all applicant groups

* Data from the NRMP database. All Responding programs included

N=67

NRMP Program Director Survey Results, 2014 13

Page 17: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

Child Neurology (N=41)

NRMP Program Director Survey Results, 2014 14

Page 18: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

Figure CN-1Child NeurologyPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview(N=40)

1 2 3 4 5

3.9

4.3

4.2

3.9

3.7

4.0

4.1

4.1

4.1

4.2

3.8

4.2

3.5

3.9

3.9

4.1

4.3

3.6

4.0

4.3

4.0

3.5

3.5

3.9

3.7

4.0

4.7

3.6

3.8

3.6

3.4

3.5

3.8

Average RatingPercent Citing Factor

¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only

100% 50% 0%

93%

98%

95%

80%

83%

65%

80%

57%

83%

83%

73%

63%

57%

68%

70%

78%

78%

57%

73%

57%

55%

60%

53%

45%

63%

40%

18%

60%

35%

28%

23%

28%

53%

USMLE Step 1/COMLEX Level 1 score

Letters of recommendation in the specialty

Medical Student Performance Evaluation (MSPE/Dean's Letter)

USMLE Step 2 CK/COMLEX Level 2 CE score

Personal Statement

Graduate of U.S. allopathic medical school

Grades in required clerkships

Gaps in medical education

Honors in clinical clerkships

Perceived commitment to specialty

Class ranking/quartile

Evidence of professionalism and ethics

Personal prior knowledge of the applicant

Audition elective/rotation within your department

Leadership qualities

Honors in clerkship in desired specialty

Grades in clerkship in desired specialty

Alpha Omega Alpha (AOA) membership

Pass USMLE Step2 CS/COMLEX Lvl2 PE

Perceived interest in program

Consistency of grades

Other life experience

Volunteer/extracurricular experiences

Graduate of highly regarded U.S. medical school

Demonstrated involvement and interest in research

Visa status*

Applicant was flagged with Match violation by the NRMP

Interest in academic career

Honors in basic sciences

Gold Society membership

Away rotation in your specialty at another institution

Fluency in language spoken by your patient population

USMLE/COMLEX Step 3 score

NRMP Program Director Survey Results, 2014 15

Page 19: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

Child NeurologyPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants(N=40)

Figure CN-2

1 2 3 4 5

4.74.7

4.64.5

3.94.14.04.1

4.54.3

4.24.04.14.24.1

3.94.14.1

4.04.24.3

4.14.2

3.93.7

4.14.1

3.74.14.2

3.93.8

4.63.83.8

4.23.9

4.44.0

Average RatingPercent Citing Factor

¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only

100% 50% 0%

95%93%90%

75%83%

90%75%

83%75%

68%78%

60%57%

50%48%

70%60%57%

73%57%57%

38%55%

35%45%

33%43%

65%43%

45%50%

20%20%20%

10%25%

30%18%

45%

Interactions with faculty during interview and visit

Interpersonal skills

Interactions with house staff during interview and visit

Feedback from current residents

USMLE Step 1/COMLEX Level 1 score

Letters of recommendation in the specialty

USMLE Step 2 CK/COMLEX Level 2 CE score

Medical Student Performance Evaluation (MSPE/Dean's Letter)

Perceived commitment to specialty

Evidence of professionalism and ethics

Perceived interest in program

Leadership qualities

Personal prior knowledge of the applicant

Class ranking/quartile

Graduate of U.S. allopathic medical school

Personal Statement

Audition elective/rotation within your department

Grades in required clerkships

Passing USMLE Step 2 CS/COMLEX Level 2 PE

Honors in clinical clerkships

Honors in clerkship in desired specialty

Gaps in medical education

Grades in clerkship in desired specialty

Alpha Omega Alpha (AOA) membership

Other life experience

Consistency of grades

Volunteer/extracurricular experiences

Demonstrated involvement and interest in research

Graduate of highly regarded U.S. medical school

Other post‐interview contact

Interest in academic career

Visa status*

Applicant was flagged with Match violation by the NRMP

Fluency in language spoken by your patient population

Gold Society membership

Honors in basic sciences

Second interview/visit

Away rotation in your specialty at another institution

USMLE/COMLEX Step 3 score

NRMP Program Director Survey Results, 2014 16

Page 20: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

170

180

190

200

210

220

230

240

250

260

Child NeurologyPrograms That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview

Figure CN-3

Percentage of Programs That Use USMLE Step 2 (CK) Score

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Never Seldom Often

22%

76%

3%

Would your program consider applicants who fail theexam on the first attempt?

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Never Seldom often

32%

65%

3%

Would your program consider applicants who failthe exam on the first attempt?

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

38%

62%

0%

Scores required?

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

37%

50%

13%

Scores required?

N=39

N=37

N=38N=34

N=11N=16 N=11 N=8

Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews

Percentage of Programs That Use USMLE Step 1 Score

170

180

190

200

210

220

230

240

250

260

USMLE Step 2 CKUSMLE Step 1 USMLE Step 1 USMLE Step 2 CK

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.

Scores Above Which Programs Almost Always Grant Interviews

Scores Below Which Programs Generally Do Not Grant Interviews

NRMP Program Director Survey Results, 2014 17

Page 21: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

38%42%

19%

COMLEX-USA Level 1*

N=37

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes No

89%

11%

USMLE Step 2 CS

Child NeurologyPercentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview

Figure CN-4

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

35%42%

23%

COMLEX-USA Level 2-CE*

N=31

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

39%

29% 32%

USMLE Step 3

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

25%

35%40%

COMLEX-USA Level 3*

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

39% 39%

22%

COMLEX-USA Level 2-PE*

N=37 N=31

N=26 N=26

N=23 N=20

* Osteopathic applicants only

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores

NRMP Program Director Survey Results, 2014 18

Page 22: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%100%

73%78%

68%

45%

68%60%

U.S. Senior U.S. Graduate OsteopathicPhysician

Canadian Fifth Pathway U.S. IMG Non-U.S. IMG

Percentage of Programs that Typically Interview and Rank Each Applicant Type

Figure CN-5Child NeurologyProgram's Interview Activities

0

100

200

300

400

500

600

700

800

900

1,000

Number ofpositions in the

Match

Number ofapplications

received

Number ofinterview

invitations sent

Number ofapplicantsinterviewed

Number ofapplicants

ranked

2

8525 18 13

Average Number of Positions, Applications Received, InterviewInvitations Sent, and Applicants Interviewed and Ranked

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Percentage of applicationsrejected

Percentage of applicantsreceiving an in-depth review

49%

58%

Average Percentage of Applicants Rejected andReviewed

N=39N=39N=41* N=41*N=39N=39

N=40

43% of Child Neurology programs consider all applicant groups

* Data from the NRMP database. All Responding programs included

N=39

NRMP Program Director Survey Results, 2014 19

Page 23: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

Dermatology (N=60)

NRMP Program Director Survey Results, 2014 20

Page 24: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

Figure D-1DermatologyPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview(N=59)

1 2 3 4 5

4.3

4.5

4.0

4.1

4.0

4.2

4.2

3.6

4.3

4.5

4.3

4.6

4.5

4.4

4.3

4.5

4.4

4.0

4.1

4.2

4.3

3.8

3.7

3.8

3.9

4.1

4.9

4.1

3.9

4.2

3.9

3.1

4.0

Average RatingPercent Citing Factor

¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only

100% 50% 0%

92%

93%

83%

64%

85%

59%

64%

42%

76%

73%

59%

64%

75%

64%

63%

69%

58%

64%

25%

61%

68%

54%

51%

46%

53%

24%

17%

49%

39%

22%

29%

15%

10%

USMLE Step 1/COMLEX Level 1 score

Letters of recommendation in the specialty

Medical Student Performance Evaluation (MSPE/Dean's Letter)

USMLE Step 2 CK/COMLEX Level 2 CE score

Personal Statement

Graduate of U.S. allopathic medical school

Grades in required clerkships

Gaps in medical education

Honors in clinical clerkships

Perceived commitment to specialty

Class ranking/quartile

Evidence of professionalism and ethics

Personal prior knowledge of the applicant

Audition elective/rotation within your department

Leadership qualities

Honors in clerkship in desired specialty

Grades in clerkship in desired specialty

Alpha Omega Alpha (AOA) membership

Pass USMLE Step2 CS/COMLEX Lvl2 PE

Perceived interest in program

Consistency of grades

Other life experience

Volunteer/extracurricular experiences

Graduate of highly regarded U.S. medical school

Demonstrated involvement and interest in research

Visa status*

Applicant was flagged with Match violation by the NRMP

Interest in academic career

Honors in basic sciences

Gold Society membership

Away rotation in your specialty at another institution

Fluency in language spoken by your patient population

USMLE/COMLEX Step 3 score

NRMP Program Director Survey Results, 2014 21

Page 25: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

DermatologyPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants(N=59)

Figure D-2

1 2 3 4 5

4.94.94.94.8

4.14.2

3.94.0

4.44.6

4.14.3

4.64.24.2

3.94.7

4.33.8

4.24.5

4.04.3

3.94.0

4.34.04.1

3.73.6

4.14.3

4.63.83.8

3.62.0

3.93.8

Average RatingPercent Citing Factor

¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only

100% 50% 0%

97%95%95%

80%59%

71%39%

51%64%

68%63%

54%49%

34%34%

46%47%

37%20%

49%34%

20%34%36%

39%34%

37%39%

22%22%

39%5%

14%7%

15%27%

3%20%

7%

Interactions with faculty during interview and visit

Interpersonal skills

Interactions with house staff during interview and visit

Feedback from current residents

USMLE Step 1/COMLEX Level 1 score

Letters of recommendation in the specialty

USMLE Step 2 CK/COMLEX Level 2 CE score

Medical Student Performance Evaluation (MSPE/Dean's Letter)

Perceived commitment to specialty

Evidence of professionalism and ethics

Perceived interest in program

Leadership qualities

Personal prior knowledge of the applicant

Class ranking/quartile

Graduate of U.S. allopathic medical school

Personal Statement

Audition elective/rotation within your department

Grades in required clerkships

Passing USMLE Step 2 CS/COMLEX Level 2 PE

Honors in clinical clerkships

Honors in clerkship in desired specialty

Gaps in medical education

Grades in clerkship in desired specialty

Alpha Omega Alpha (AOA) membership

Other life experience

Consistency of grades

Volunteer/extracurricular experiences

Demonstrated involvement and interest in research

Graduate of highly regarded U.S. medical school

Other post‐interview contact

Interest in academic career

Visa status*

Applicant was flagged with Match violation by the NRMP

Fluency in language spoken by your patient population

Gold Society membership

Honors in basic sciences

Second interview/visit

Away rotation in your specialty at another institution

USMLE/COMLEX Step 3 score

NRMP Program Director Survey Results, 2014 22

Page 26: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

170

180

190

200

210

220

230

240

250

260

DermatologyPrograms That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview

Figure D-3

Percentage of Programs That Use USMLE Step 2 (CK) Score

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Never Seldom Often

57%

43%

0%

Would your program consider applicants who fail theexam on the first attempt?

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Never Seldom often

58%

39%

3%

Would your program consider applicants who failthe exam on the first attempt?

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

18%

82%

0%

Scores required?

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

29%

47%

24%

Scores required?

N=57

N=51

N=51N=38

N=19N=43 N=13 N=8

Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews

Percentage of Programs That Use USMLE Step 1 Score

170

180

190

200

210

220

230

240

250

260

USMLE Step 2 CKUSMLE Step 1 USMLE Step 1 USMLE Step 2 CK

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.

Scores Above Which Programs Almost Always Grant Interviews

Scores Below Which Programs Generally Do Not Grant Interviews

NRMP Program Director Survey Results, 2014 23

Page 27: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

18% 18%

65%

COMLEX-USA Level 1*

N=46

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes No

74%

26%

USMLE Step 2 CS

DermatologyPercentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview

Figure D-4

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

13%7%

80%

COMLEX-USA Level 2-CE*

N=24

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

17%13%

71%

USMLE Step 3

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

8%

0%

92%

COMLEX-USA Level 3*

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

13%7%

80%

COMLEX-USA Level 2-PE*

N=46 N=24

N=17 N=15

N=15 N=12

* Osteopathic applicants only

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores

NRMP Program Director Survey Results, 2014 24

Page 28: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%100%

74%

35%30%

19%26% 26%

U.S. Senior U.S. Graduate OsteopathicPhysician

Canadian Fifth Pathway U.S. IMG Non-U.S. IMG

Percentage of Programs that Typically Interview and Rank Each Applicant Type

Figure D-5DermatologyProgram's Interview Activities

0

100

200

300

400

500

600

700

800

900

1,000

Number ofpositions in the

Match

Number ofapplications

received

Number ofinterview

invitations sent

Number ofapplicantsinterviewed

Number ofapplicants

ranked

4

412

43 36 32

Average Number of Positions, Applications Received, InterviewInvitations Sent, and Applicants Interviewed and Ranked

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Percentage of applicationsrejected

Percentage of applicantsreceiving an in-depth review

33%

58%

Average Percentage of Applicants Rejected andReviewed

N=59N=54N=60* N=60*N=59N=59

N=57

18% of Dermatology programs consider all applicant groups

* Data from the NRMP database. All Responding programs included

N=59

NRMP Program Director Survey Results, 2014 25

Page 29: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

Emergency Medicine (N=104)

NRMP Program Director Survey Results, 2014 26

Page 30: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

Figure EM-1Emergency MedicinePercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview(N=101)

1 2 3 4 5

3.9

4.8

3.9

4.0

3.0

4.0

3.8

3.8

4.0

4.1

3.7

4.4

4.3

4.4

3.9

4.6

4.6

3.7

3.9

3.9

3.8

3.5

3.6

3.4

3.1

3.9

4.6

3.5

3.0

3.3

4.3

3.2

3.4

Average RatingPercent Citing Factor

¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only

100% 50% 0%

97%

99%

91%

94%

67%

83%

88%

72%

82%

81%

83%

69%

68%

87%

80%

86%

90%

75%

50%

65%

52%

72%

63%

61%

43%

37%

29%

30%

22%

39%

78%

22%

18%

USMLE Step 1/COMLEX Level 1 score

Letters of recommendation in the specialty

Medical Student Performance Evaluation (MSPE/Dean's Letter)

USMLE Step 2 CK/COMLEX Level 2 CE score

Personal Statement

Graduate of U.S. allopathic medical school

Grades in required clerkships

Gaps in medical education

Honors in clinical clerkships

Perceived commitment to specialty

Class ranking/quartile

Evidence of professionalism and ethics

Personal prior knowledge of the applicant

Audition elective/rotation within your department

Leadership qualities

Honors in clerkship in desired specialty

Grades in clerkship in desired specialty

Alpha Omega Alpha (AOA) membership

Pass USMLE Step2 CS/COMLEX Lvl2 PE

Perceived interest in program

Consistency of grades

Other life experience

Volunteer/extracurricular experiences

Graduate of highly regarded U.S. medical school

Demonstrated involvement and interest in research

Visa status*

Applicant was flagged with Match violation by the NRMP

Interest in academic career

Honors in basic sciences

Gold Society membership

Away rotation in your specialty at another institution

Fluency in language spoken by your patient population

USMLE/COMLEX Step 3 score

NRMP Program Director Survey Results, 2014 27

Page 31: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

Emergency MedicinePercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants(N=101)

Figure EM-2

1 2 3 4 5

4.84.84.74.6

3.84.7

4.03.8

4.14.5

4.04.1

4.43.8

4.13.0

4.53.83.94.0

4.43.6

4.43.9

3.73.83.8

3.43.83.9

3.64.0

4.53.63.6

2.93.4

4.33.5

Average RatingPercent Citing Factor

¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only

100% 50% 0%

89%93%91%88%86%87%

80%75%

66%61%62%

74%63%63%62%

43%75%

60%44%

57%71%

41%71%

50%58%

31%51%

28%41%36%

23%23%23%20%

28%16%

26%63%

11%

Interactions with faculty during interview and visit

Interpersonal skills

Interactions with house staff during interview and visit

Feedback from current residents

USMLE Step 1/COMLEX Level 1 score

Letters of recommendation in the specialty

USMLE Step 2 CK/COMLEX Level 2 CE score

Medical Student Performance Evaluation (MSPE/Dean's Letter)

Perceived commitment to specialty

Evidence of professionalism and ethics

Perceived interest in program

Leadership qualities

Personal prior knowledge of the applicant

Class ranking/quartile

Graduate of U.S. allopathic medical school

Personal Statement

Audition elective/rotation within your department

Grades in required clerkships

Passing USMLE Step 2 CS/COMLEX Level 2 PE

Honors in clinical clerkships

Honors in clerkship in desired specialty

Gaps in medical education

Grades in clerkship in desired specialty

Alpha Omega Alpha (AOA) membership

Other life experience

Consistency of grades

Volunteer/extracurricular experiences

Demonstrated involvement and interest in research

Graduate of highly regarded U.S. medical school

Other post‐interview contact

Interest in academic career

Visa status*

Applicant was flagged with Match violation by the NRMP

Fluency in language spoken by your patient population

Gold Society membership

Honors in basic sciences

Second interview/visit

Away rotation in your specialty at another institution

USMLE/COMLEX Step 3 score

NRMP Program Director Survey Results, 2014 28

Page 32: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

170

180

190

200

210

220

230

240

250

260

Emergency MedicinePrograms That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview

Figure EM-3

Percentage of Programs That Use USMLE Step 2 (CK) Score

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Never Seldom Often

19%

76%

5%

Would your program consider applicants who fail theexam on the first attempt?

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Never Seldom often

52% 48%

0%

Would your program consider applicants who failthe exam on the first attempt?

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

31%

69%

0%

Scores required?

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

22%

54%

24%

Scores required?

N=97

N=94

N=96N=85

N=46N=62 N=41 N=34

Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews

Percentage of Programs That Use USMLE Step 1 Score

170

180

190

200

210

220

230

240

250

260

USMLE Step 2 CKUSMLE Step 1 USMLE Step 1 USMLE Step 2 CK

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.

Scores Above Which Programs Almost Always Grant Interviews

Scores Below Which Programs Generally Do Not Grant Interviews

NRMP Program Director Survey Results, 2014 29

Page 33: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

24%

40% 37%

COMLEX-USA Level 1*

N=88

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes No

66%

34%

USMLE Step 2 CS

Emergency MedicinePercentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview

Figure EM-4

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

23%29%

48%

COMLEX-USA Level 2-CE*

N=55

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

15% 13%

73%

USMLE Step 3

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

11% 11%

78%

COMLEX-USA Level 3*

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

31%

10%

59%

COMLEX-USA Level 2-PE*

N=88 N=55

N=68 N=66

N=58 N=45

* Osteopathic applicants only

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores

NRMP Program Director Survey Results, 2014 30

Page 34: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%100%

72%77%

35%

24%

47%

22%

U.S. Senior U.S. Graduate OsteopathicPhysician

Canadian Fifth Pathway U.S. IMG Non-U.S. IMG

Percentage of Programs that Typically Interview and Rank Each Applicant Type

Figure EM-5Emergency MedicineProgram's Interview Activities

0

100

200

300

400

500

600

700

800

900

1,000

Number ofpositions in the

Match

Number ofapplications

received

Number ofinterview

invitations sent

Number ofapplicantsinterviewed

Number ofapplicants

ranked

11

830

174138 123

Average Number of Positions, Applications Received, InterviewInvitations Sent, and Applicants Interviewed and Ranked

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Percentage of applicationsrejected

Percentage of applicantsreceiving an in-depth review

41%

56%

Average Percentage of Applicants Rejected andReviewed

N=104N=99N=104* N=104*N=103N=104

N=101

20% of Emergency Medicine programs consider all applicant groups

* Data from the NRMP database. All Responding programs included

N=101

NRMP Program Director Survey Results, 2014 31

Page 35: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

Family Medicine (N=236)

NRMP Program Director Survey Results, 2014 32

Page 36: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

Figure FM-1Family MedicinePercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview(N=227)

1 2 3 4 5

3.8

4.0

4.0

4.1

3.9

4.1

3.9

4.3

3.7

4.5

3.5

4.6

4.2

4.0

3.9

3.9

4.1

3.4

4.2

4.2

3.8

3.7

3.8

3.6

3.3

4.3

4.8

3.2

2.9

3.5

3.2

3.7

3.4

Average RatingPercent Citing Factor

¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only

100% 50% 0%

91%

83%

80%

87%

87%

78%

68%

81%

52%

87%

56%

70%

69%

70%

60%

44%

51%

31%

81%

65%

54%

63%

65%

40%

10%

56%

38%

8%

20%

25%

12%

42%

24%

USMLE Step 1/COMLEX Level 1 score

Letters of recommendation in the specialty

Medical Student Performance Evaluation (MSPE/Dean's Letter)

USMLE Step 2 CK/COMLEX Level 2 CE score

Personal Statement

Graduate of U.S. allopathic medical school

Grades in required clerkships

Gaps in medical education

Honors in clinical clerkships

Perceived commitment to specialty

Class ranking/quartile

Evidence of professionalism and ethics

Personal prior knowledge of the applicant

Audition elective/rotation within your department

Leadership qualities

Honors in clerkship in desired specialty

Grades in clerkship in desired specialty

Alpha Omega Alpha (AOA) membership

Pass USMLE Step2 CS/COMLEX Lvl2 PE

Perceived interest in program

Consistency of grades

Other life experience

Volunteer/extracurricular experiences

Graduate of highly regarded U.S. medical school

Demonstrated involvement and interest in research

Visa status*

Applicant was flagged with Match violation by the NRMP

Interest in academic career

Honors in basic sciences

Gold Society membership

Away rotation in your specialty at another institution

Fluency in language spoken by your patient population

USMLE/COMLEX Step 3 score

NRMP Program Director Survey Results, 2014 33

Page 37: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

Family MedicinePercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants(N=227)

Figure FM-2

1 2 3 4 5

4.84.84.84.8

3.93.84.04.0

4.54.6

4.24.1

4.33.7

4.03.8

4.43.9

4.23.84.0

4.24.0

3.73.83.84.0

3.13.7

4.13.5

4.44.9

3.93.8

3.43.8

3.73.7

Average RatingPercent Citing Factor

¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only

100% 50% 0%

93%94%91%

84%79%

67%82%

69%84%

69%67%

59%64%

53%62%

68%61%

50%77%

36%30%

61%41%

27%52%

45%53%

12%31%

43%8%

29%25%

34%21%

13%36%

8%17%

Interactions with faculty during interview and visit

Interpersonal skills

Interactions with house staff during interview and visit

Feedback from current residents

USMLE Step 1/COMLEX Level 1 score

Letters of recommendation in the specialty

USMLE Step 2 CK/COMLEX Level 2 CE score

Medical Student Performance Evaluation (MSPE/Dean's Letter)

Perceived commitment to specialty

Evidence of professionalism and ethics

Perceived interest in program

Leadership qualities

Personal prior knowledge of the applicant

Class ranking/quartile

Graduate of U.S. allopathic medical school

Personal Statement

Audition elective/rotation within your department

Grades in required clerkships

Passing USMLE Step 2 CS/COMLEX Level 2 PE

Honors in clinical clerkships

Honors in clerkship in desired specialty

Gaps in medical education

Grades in clerkship in desired specialty

Alpha Omega Alpha (AOA) membership

Other life experience

Consistency of grades

Volunteer/extracurricular experiences

Demonstrated involvement and interest in research

Graduate of highly regarded U.S. medical school

Other post‐interview contact

Interest in academic career

Visa status*

Applicant was flagged with Match violation by the NRMP

Fluency in language spoken by your patient population

Gold Society membership

Honors in basic sciences

Second interview/visit

Away rotation in your specialty at another institution

USMLE/COMLEX Step 3 score

NRMP Program Director Survey Results, 2014 34

Page 38: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

170

180

190

200

210

220

230

240

250

260

Family MedicinePrograms That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview

Figure FM-3

Percentage of Programs That Use USMLE Step 2 (CK) Score

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Never Seldom Often

5%

60%

35%

Would your program consider applicants who fail theexam on the first attempt?

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Never Seldom often

13%

68%

19%

Would your program consider applicants who failthe exam on the first attempt?

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

57%

42%

0%

Scores required?

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

50%41%

8%

Scores required?

N=219

N=205

N=213N=194

N=65N=71 N=63 N=59

Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews

Percentage of Programs That Use USMLE Step 1 Score

170

180

190

200

210

220

230

240

250

260

USMLE Step 2 CKUSMLE Step 1 USMLE Step 1 USMLE Step 2 CK

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.

Scores Above Which Programs Almost Always Grant Interviews

Scores Below Which Programs Generally Do Not Grant Interviews

NRMP Program Director Survey Results, 2014 35

Page 39: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

61%

36%

4%

COMLEX-USA Level 1*

N=208

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes No

89%

11%

USMLE Step 2 CS

Family MedicinePercentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview

Figure FM-4

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

56%

32%

12%

COMLEX-USA Level 2-CE*

N=126

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

13%6%

80%

USMLE Step 3

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

16%

7%

77%

COMLEX-USA Level 3*

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

75%

9%16%

COMLEX-USA Level 2-PE*

N=208 N=126

N=200 N=193

N=191 N=117

* Osteopathic applicants only

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores

NRMP Program Director Survey Results, 2014 36

Page 40: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%100%

79%

95%

63%

47%

77%

53%

U.S. Senior U.S. Graduate OsteopathicPhysician

Canadian Fifth Pathway U.S. IMG Non-U.S. IMG

Percentage of Programs that Typically Interview and Rank Each Applicant Type

Figure FM-5Family MedicineProgram's Interview Activities

0

100

200

300

400

500

600

700

800

900

1,000

Number ofpositions in the

Match

Number ofapplications

received

Number ofinterview

invitations sent

Number ofapplicantsinterviewed

Number ofapplicants

ranked

7

1,149

106 80 64

Average Number of Positions, Applications Received, InterviewInvitations Sent, and Applicants Interviewed and Ranked

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Percentage of applicationsrejected

Percentage of applicantsreceiving an in-depth review

68%

29%

Average Percentage of Applicants Rejected andReviewed

N=228N=215N=236* N=236*N=225N=228

N=224

36% of Family Medicine programs consider all applicant groups

* Data from the NRMP database. All Responding programs included

N=223

NRMP Program Director Survey Results, 2014 37

Page 41: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

Internal Medicine (N=197)

NRMP Program Director Survey Results, 2014 38

Page 42: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

Figure IM-1Internal MedicinePercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview(N=194)

1 2 3 4 5

4.1

3.8

4.3

4.2

3.3

4.0

4.1

4.1

4.0

3.7

4.0

4.4

3.8

3.6

3.8

4.1

4.2

3.9

4.3

3.7

4.0

3.4

3.5

3.8

3.5

3.7

4.9

3.5

3.2

4.0

3.1

3.7

3.5

Average RatingPercent Citing Factor

¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only

100% 50% 0%

92%

73%

90%

89%

66%

79%

70%

73%

65%

51%

74%

64%

64%

54%

53%

57%

59%

58%

75%

47%

55%

46%

38%

45%

28%

40%

44%

21%

24%

29%

9%

31%

21%

USMLE Step 1/COMLEX Level 1 score

Letters of recommendation in the specialty

Medical Student Performance Evaluation (MSPE/Dean's Letter)

USMLE Step 2 CK/COMLEX Level 2 CE score

Personal Statement

Graduate of U.S. allopathic medical school

Grades in required clerkships

Gaps in medical education

Honors in clinical clerkships

Perceived commitment to specialty

Class ranking/quartile

Evidence of professionalism and ethics

Personal prior knowledge of the applicant

Audition elective/rotation within your department

Leadership qualities

Honors in clerkship in desired specialty

Grades in clerkship in desired specialty

Alpha Omega Alpha (AOA) membership

Pass USMLE Step2 CS/COMLEX Lvl2 PE

Perceived interest in program

Consistency of grades

Other life experience

Volunteer/extracurricular experiences

Graduate of highly regarded U.S. medical school

Demonstrated involvement and interest in research

Visa status*

Applicant was flagged with Match violation by the NRMP

Interest in academic career

Honors in basic sciences

Gold Society membership

Away rotation in your specialty at another institution

Fluency in language spoken by your patient population

USMLE/COMLEX Step 3 score

NRMP Program Director Survey Results, 2014 39

Page 43: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

Internal MedicinePercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants(N=194)

Figure IM-2

1 2 3 4 5

4.74.74.6

4.44.1

3.74.24.2

4.04.6

3.93.9

4.14.14.1

3.33.8

4.14.24.14.24.14.3

4.13.5

3.93.6

3.43.9

3.63.63.7

4.84.04.1

3.53.3

3.13.4

Average RatingPercent Citing Factor

¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only

100% 50% 0%

92%95%

82%73%

83%65%

86%79%

55%64%

55%55%

59%71%69%

52%47%

55%71%

51%52%

54%52%51%

36%46%

29%27%

40%21%21%

36%36%

28%25%

17%13%

7%24%

Interactions with faculty during interview and visit

Interpersonal skills

Interactions with house staff during interview and visit

Feedback from current residents

USMLE Step 1/COMLEX Level 1 score

Letters of recommendation in the specialty

USMLE Step 2 CK/COMLEX Level 2 CE score

Medical Student Performance Evaluation (MSPE/Dean's Letter)

Perceived commitment to specialty

Evidence of professionalism and ethics

Perceived interest in program

Leadership qualities

Personal prior knowledge of the applicant

Class ranking/quartile

Graduate of U.S. allopathic medical school

Personal Statement

Audition elective/rotation within your department

Grades in required clerkships

Passing USMLE Step 2 CS/COMLEX Level 2 PE

Honors in clinical clerkships

Honors in clerkship in desired specialty

Gaps in medical education

Grades in clerkship in desired specialty

Alpha Omega Alpha (AOA) membership

Other life experience

Consistency of grades

Volunteer/extracurricular experiences

Demonstrated involvement and interest in research

Graduate of highly regarded U.S. medical school

Other post‐interview contact

Interest in academic career

Visa status*

Applicant was flagged with Match violation by the NRMP

Fluency in language spoken by your patient population

Gold Society membership

Honors in basic sciences

Second interview/visit

Away rotation in your specialty at another institution

USMLE/COMLEX Step 3 score

NRMP Program Director Survey Results, 2014 40

Page 44: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

170

180

190

200

210

220

230

240

250

260

Internal MedicinePrograms That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview

Figure IM-3

Percentage of Programs That Use USMLE Step 2 (CK) Score

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Never Seldom Often

16%

77%

6%

Would your program consider applicants who fail theexam on the first attempt?

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Never Seldom often

33%

65%

2%

Would your program consider applicants who failthe exam on the first attempt?

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

29%

71%

1%

Scores required?

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

25%

65%

11%

Scores required?

N=184

N=173

N=178N=167

N=100N=112 N=81 N=72

Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews

Percentage of Programs That Use USMLE Step 1 Score

170

180

190

200

210

220

230

240

250

260

USMLE Step 2 CKUSMLE Step 1 USMLE Step 1 USMLE Step 2 CK

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.

Scores Above Which Programs Almost Always Grant Interviews

Scores Below Which Programs Generally Do Not Grant Interviews

NRMP Program Director Survey Results, 2014 41

Page 45: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

28%

55%

17%

COMLEX-USA Level 1*

N=172

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes No

86%

14%

USMLE Step 2 CS

Internal MedicinePercentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview

Figure IM-4

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

27%

50%

23%

COMLEX-USA Level 2-CE*

N=119

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

13% 12%

76%

USMLE Step 3

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

14% 12%

74%

COMLEX-USA Level 3*

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

57%

15%

27%

COMLEX-USA Level 2-PE*

N=172 N=119

N=132 N=130

N=131 N=94

* Osteopathic applicants only

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores

NRMP Program Director Survey Results, 2014 42

Page 46: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100% 97%

74%82%

63%

44%

85%

76%

U.S. Senior U.S. Graduate OsteopathicPhysician

Canadian Fifth Pathway U.S. IMG Non-U.S. IMG

Percentage of Programs that Typically Interview and Rank Each Applicant Type

Figure IM-5Internal MedicineProgram's Interview Activities

0

100

200

300

400

500

600

700

800

900

1,000

Number ofpositions in the

Match

Number ofapplications

received

Number ofinterview

invitations sent

Number ofapplicantsinterviewed

Number ofapplicants

ranked

18

2,864

309251

178

Average Number of Positions, Applications Received, InterviewInvitations Sent, and Applicants Interviewed and Ranked

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Percentage of applicationsrejected

Percentage of applicantsreceiving an in-depth review

61%

30%

Average Percentage of Applicants Rejected andReviewed

N=190N=178N=197* N=197*N=189N=190

N=190

39% of Internal Medicine programs consider all applicant groups

* Data from the NRMP database. All Responding programs included

N=187

NRMP Program Director Survey Results, 2014 43

Page 47: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

Internal Medicine/Pediatrics (N=35)

NRMP Program Director Survey Results, 2014 44

Page 48: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

Figure IMP-1Internal Medicine/PediatricsPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview(N=34)

1 2 3 4 5

4.1

4.0

4.1

3.9

3.6

4.2

4.2

4.2

3.9

4.3

4.2

4.4

3.7

3.2

3.7

4.4

4.6

4.0

4.2

4.1

3.8

3.3

3.5

3.9

2.9

3.9

4.8

3.0

3.4

3.8

3.0

3.2

3.6

Average RatingPercent Citing Factor

¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only

100% 50% 0%

94%

65%

74%

85%

71%

74%

82%

68%

68%

59%

74%

56%

56%

38%

71%

65%

68%

71%

53%

41%

59%

47%

62%

47%

24%

29%

24%

18%

24%

68%

9%

15%

21%

USMLE Step 1/COMLEX Level 1 score

Letters of recommendation in the specialty

Medical Student Performance Evaluation (MSPE/Dean's Letter)

USMLE Step 2 CK/COMLEX Level 2 CE score

Personal Statement

Graduate of U.S. allopathic medical school

Grades in required clerkships

Gaps in medical education

Honors in clinical clerkships

Perceived commitment to specialty

Class ranking/quartile

Evidence of professionalism and ethics

Personal prior knowledge of the applicant

Audition elective/rotation within your department

Leadership qualities

Honors in clerkship in desired specialty

Grades in clerkship in desired specialty

Alpha Omega Alpha (AOA) membership

Pass USMLE Step2 CS/COMLEX Lvl2 PE

Perceived interest in program

Consistency of grades

Other life experience

Volunteer/extracurricular experiences

Graduate of highly regarded U.S. medical school

Demonstrated involvement and interest in research

Visa status*

Applicant was flagged with Match violation by the NRMP

Interest in academic career

Honors in basic sciences

Gold Society membership

Away rotation in your specialty at another institution

Fluency in language spoken by your patient population

USMLE/COMLEX Step 3 score

NRMP Program Director Survey Results, 2014 45

Page 49: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

Internal Medicine/PediatricsPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants(N=34)

Figure IMP-2

1 2 3 4 5

4.74.74.7

4.64.1

3.64.24.14.3

4.24.3

3.93.6

4.14.3

3.43.7

4.04.4

4.24.3

3.84.2

3.73.4

3.83.8

3.34.2

3.33.8

4.34.3

2.33.9

3.32.8

3.74.5

Average RatingPercent Citing Factor

¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only

100% 50% 0%

94%86%

91%86%

89%71%

83%71%

77%77%

49%80%

49%83%

54%57%

34%71%

60%60%57%

60%57%

71%51%

46%66%

31%37%

26%11%

17%11%

9%40%

31%11%

9%11%

Interactions with faculty during interview and visit

Interpersonal skills

Interactions with house staff during interview and visit

Feedback from current residents

USMLE Step 1/COMLEX Level 1 score

Letters of recommendation in the specialty

USMLE Step 2 CK/COMLEX Level 2 CE score

Medical Student Performance Evaluation (MSPE/Dean's Letter)

Perceived commitment to specialty

Evidence of professionalism and ethics

Perceived interest in program

Leadership qualities

Personal prior knowledge of the applicant

Class ranking/quartile

Graduate of U.S. allopathic medical school

Personal Statement

Audition elective/rotation within your department

Grades in required clerkships

Passing USMLE Step 2 CS/COMLEX Level 2 PE

Honors in clinical clerkships

Honors in clerkship in desired specialty

Gaps in medical education

Grades in clerkship in desired specialty

Alpha Omega Alpha (AOA) membership

Other life experience

Consistency of grades

Volunteer/extracurricular experiences

Demonstrated involvement and interest in research

Graduate of highly regarded U.S. medical school

Other post‐interview contact

Interest in academic career

Visa status*

Applicant was flagged with Match violation by the NRMP

Fluency in language spoken by your patient population

Gold Society membership

Honors in basic sciences

Second interview/visit

Away rotation in your specialty at another institution

USMLE/COMLEX Step 3 score

NRMP Program Director Survey Results, 2014 46

Page 50: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

170

180

190

200

210

220

230

240

250

260

Internal Medicine/PediatricsPrograms That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview

Figure IMP-3

Percentage of Programs That Use USMLE Step 2 (CK) Score

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Never Seldom Often

29%

71%

0%

Would your program consider applicants who fail theexam on the first attempt?

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Never Seldom often

48% 52%

0%

Would your program consider applicants who failthe exam on the first attempt?

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

24%

76%

0%

Scores required?

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

30%

58%

12%

Scores required?

N=34

N=31

N=33N=27

N=18N=23 N=20 N=14

Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews

Percentage of Programs That Use USMLE Step 1 Score

170

180

190

200

210

220

230

240

250

260

USMLE Step 2 CKUSMLE Step 1 USMLE Step 1 USMLE Step 2 CK

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.

Scores Above Which Programs Almost Always Grant Interviews

Scores Below Which Programs Generally Do Not Grant Interviews

NRMP Program Director Survey Results, 2014 47

Page 51: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

23%

64%

14%

COMLEX-USA Level 1*

N=32

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes No

88%

13%

USMLE Step 2 CS

Internal Medicine/PediatricsPercentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview

Figure IMP-4

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

32%

50%

18%

COMLEX-USA Level 2-CE*

N=19

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

5%

16%

79%

USMLE Step 3

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

7%

20%

73%

COMLEX-USA Level 3*

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

57%

24%19%

COMLEX-USA Level 2-PE*

N=32 N=19

N=22 N=22

N=21 N=15

* Osteopathic applicants only

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores

NRMP Program Director Survey Results, 2014 48

Page 52: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%100%

35%

62%

35%

21%

47%

26%

U.S. Senior U.S. Graduate OsteopathicPhysician

Canadian Fifth Pathway U.S. IMG Non-U.S. IMG

Percentage of Programs that Typically Interview and Rank Each Applicant Type

Figure IMP-5Internal Medicine/PediatricsProgram's Interview Activities

0

100

200

300

400

500

600

700

800

900

1,000

Number ofpositions in the

Match

Number ofapplications

received

Number ofinterview

invitations sent

Number ofapplicantsinterviewed

Number ofapplicants

ranked

5

245

69 53 49

Average Number of Positions, Applications Received, InterviewInvitations Sent, and Applicants Interviewed and Ranked

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Percentage of applicationsrejected

Percentage of applicantsreceiving an in-depth review

48%42%

Average Percentage of Applicants Rejected andReviewed

N=34N=34N=35* N=35*N=35N=34

N=34

15% of Internal Medicine/Pediatrics programs consider all applicant groups

* Data from the NRMP database. All Responding programs included

N=35

NRMP Program Director Survey Results, 2014 49

Page 53: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

Neurological Surgery (N=55)

NRMP Program Director Survey Results, 2014 50

Page 54: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

Figure NS-1Neurological SurgeryPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview(N=54)

1 2 3 4 5

4.4

4.7

3.8

4.0

3.7

4.3

4.3

3.9

4.2

4.6

3.9

4.5

4.3

4.2

4.3

4.3

4.3

3.8

3.9

4.3

4.0

3.6

3.5

3.8

4.1

4.0

4.6

4.1

3.4

3.4

3.9

3.7

4.5

Average RatingPercent Citing Factor

¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only

100% 50% 0%

93%

98%

81%

65%

78%

72%

59%

61%

69%

80%

59%

74%

63%

67%

74%

61%

44%

81%

39%

61%

61%

57%

56%

65%

80%

39%

22%

59%

41%

15%

56%

20%

4%

USMLE Step 1/COMLEX Level 1 score

Letters of recommendation in the specialty

Medical Student Performance Evaluation (MSPE/Dean's Letter)

USMLE Step 2 CK/COMLEX Level 2 CE score

Personal Statement

Graduate of U.S. allopathic medical school

Grades in required clerkships

Gaps in medical education

Honors in clinical clerkships

Perceived commitment to specialty

Class ranking/quartile

Evidence of professionalism and ethics

Personal prior knowledge of the applicant

Audition elective/rotation within your department

Leadership qualities

Honors in clerkship in desired specialty

Grades in clerkship in desired specialty

Alpha Omega Alpha (AOA) membership

Pass USMLE Step2 CS/COMLEX Lvl2 PE

Perceived interest in program

Consistency of grades

Other life experience

Volunteer/extracurricular experiences

Graduate of highly regarded U.S. medical school

Demonstrated involvement and interest in research

Visa status*

Applicant was flagged with Match violation by the NRMP

Interest in academic career

Honors in basic sciences

Gold Society membership

Away rotation in your specialty at another institution

Fluency in language spoken by your patient population

USMLE/COMLEX Step 3 score

NRMP Program Director Survey Results, 2014 51

Page 55: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

Neurological SurgeryPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants(N=54)

Figure NS-2

1 2 3 4 5

4.84.84.9

4.74.44.5

4.23.5

4.54.6

4.44.44.6

3.64.3

3.84.6

3.84.14.04.03.94.04.03.94.03.94.1

4.04.24.2

3.54.6

3.73.33.4

3.93.9

5.0

Average RatingPercent Citing Factor

¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only

100% 50% 0%

94%85%87%85%

70%89%

44%70%

78%74%74%

65%56%

33%46%

56%65%

43%26%

50%43%

28%39%

48%31%

37%33%

63%43%

46%52%

20%13%13%

6%19%

31%37%

2%

Interactions with faculty during interview and visit

Interpersonal skills

Interactions with house staff during interview and visit

Feedback from current residents

USMLE Step 1/COMLEX Level 1 score

Letters of recommendation in the specialty

USMLE Step 2 CK/COMLEX Level 2 CE score

Medical Student Performance Evaluation (MSPE/Dean's Letter)

Perceived commitment to specialty

Evidence of professionalism and ethics

Perceived interest in program

Leadership qualities

Personal prior knowledge of the applicant

Class ranking/quartile

Graduate of U.S. allopathic medical school

Personal Statement

Audition elective/rotation within your department

Grades in required clerkships

Passing USMLE Step 2 CS/COMLEX Level 2 PE

Honors in clinical clerkships

Honors in clerkship in desired specialty

Gaps in medical education

Grades in clerkship in desired specialty

Alpha Omega Alpha (AOA) membership

Other life experience

Consistency of grades

Volunteer/extracurricular experiences

Demonstrated involvement and interest in research

Graduate of highly regarded U.S. medical school

Other post‐interview contact

Interest in academic career

Visa status*

Applicant was flagged with Match violation by the NRMP

Fluency in language spoken by your patient population

Gold Society membership

Honors in basic sciences

Second interview/visit

Away rotation in your specialty at another institution

USMLE/COMLEX Step 3 score

NRMP Program Director Survey Results, 2014 52

Page 56: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

170

180

190

200

210

220

230

240

250

260

Neurological SurgeryPrograms That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview

Figure NS-3

Percentage of Programs That Use USMLE Step 2 (CK) Score

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Never Seldom Often

42%

58%

0%

Would your program consider applicants who fail theexam on the first attempt?

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Never Seldom often

61%

39%

0%

Would your program consider applicants who failthe exam on the first attempt?

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

19%

79%

2%

Scores required?

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

32%

47%

21%

Scores required?

N=52

N=48

N=47N=33

N=19N=35 N=24 N=13

Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews

Percentage of Programs That Use USMLE Step 1 Score

170

180

190

200

210

220

230

240

250

260

USMLE Step 2 CKUSMLE Step 1 USMLE Step 1 USMLE Step 2 CK

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.

Scores Above Which Programs Almost Always Grant Interviews

Scores Below Which Programs Generally Do Not Grant Interviews

NRMP Program Director Survey Results, 2014 53

Page 57: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

24%

12%

65%

COMLEX-USA Level 1*

N=46

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes No

76%

24%

USMLE Step 2 CS

Neurological SurgeryPercentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview

Figure NS-4

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

17%

6%

78%

COMLEX-USA Level 2-CE*

N=28

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

21%

4%

75%

USMLE Step 3

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

6%0%

94%

COMLEX-USA Level 3*

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

18%

0%

82%

COMLEX-USA Level 2-PE*

N=46 N=28

N=17 N=18

N=17 N=16

* Osteopathic applicants only

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores

NRMP Program Director Survey Results, 2014 54

Page 58: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100% 96%

53%

26%

40%

23%

40% 42%

U.S. Senior U.S. Graduate OsteopathicPhysician

Canadian Fifth Pathway U.S. IMG Non-U.S. IMG

Percentage of Programs that Typically Interview and Rank Each Applicant Type

Figure NS-5Neurological SurgeryProgram's Interview Activities

0

100

200

300

400

500

600

700

800

900

1,000

Number ofpositions in the

Match

Number ofapplications

received

Number ofinterview

invitations sent

Number ofapplicantsinterviewed

Number ofapplicants

ranked

2

202

50 38 27

Average Number of Positions, Applications Received, InterviewInvitations Sent, and Applicants Interviewed and Ranked

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Percentage of applicationsrejected

Percentage of applicantsreceiving an in-depth review

40%

57%

Average Percentage of Applicants Rejected andReviewed

N=53N=52N=55* N=55*N=53N=53

N=53

21% of Neurological Surgery programs consider all applicant groups

* Data from the NRMP database. All Responding programs included

N=53

NRMP Program Director Survey Results, 2014 55

Page 59: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

Neurology (N=60)

NRMP Program Director Survey Results, 2014 56

Page 60: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

Figure N-1NeurologyPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview(N=59)

1 2 3 4 5

4.0

4.3

4.2

4.0

3.7

4.2

4.2

4.1

4.1

4.2

4.0

4.3

4.0

4.0

3.9

4.2

4.4

3.9

4.1

4.1

4.0

3.4

3.4

3.9

3.3

4.0

4.7

3.3

3.4

3.6

3.5

3.4

3.7

Average RatingPercent Citing Factor

¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only

100% 50% 0%

90%

92%

85%

75%

71%

71%

63%

76%

61%

71%

75%

63%

63%

59%

56%

58%

61%

56%

64%

49%

56%

44%

53%

58%

49%

39%

34%

39%

22%

31%

22%

27%

25%

USMLE Step 1/COMLEX Level 1 score

Letters of recommendation in the specialty

Medical Student Performance Evaluation (MSPE/Dean's Letter)

USMLE Step 2 CK/COMLEX Level 2 CE score

Personal Statement

Graduate of U.S. allopathic medical school

Grades in required clerkships

Gaps in medical education

Honors in clinical clerkships

Perceived commitment to specialty

Class ranking/quartile

Evidence of professionalism and ethics

Personal prior knowledge of the applicant

Audition elective/rotation within your department

Leadership qualities

Honors in clerkship in desired specialty

Grades in clerkship in desired specialty

Alpha Omega Alpha (AOA) membership

Pass USMLE Step2 CS/COMLEX Lvl2 PE

Perceived interest in program

Consistency of grades

Other life experience

Volunteer/extracurricular experiences

Graduate of highly regarded U.S. medical school

Demonstrated involvement and interest in research

Visa status*

Applicant was flagged with Match violation by the NRMP

Interest in academic career

Honors in basic sciences

Gold Society membership

Away rotation in your specialty at another institution

Fluency in language spoken by your patient population

USMLE/COMLEX Step 3 score

NRMP Program Director Survey Results, 2014 57

Page 61: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

NeurologyPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants(N=59)

Figure N-2

1 2 3 4 5

4.94.8

4.74.5

3.94.2

3.84.14.34.4

4.04.14.2

4.14.1

3.64.1

4.04.04.04.24.14.24.1

3.54.0

3.33.3

4.04.0

3.63.8

4.73.73.9

3.44.03.94.0

Average RatingPercent Citing Factor

¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only

100% 50% 0%

97%98%

93%73%

80%81%

68%73%75%

61%56%

59%61%

68%51%

54%47%49%

53%49%47%47%46%44%41%

46%37%

44%44%

37%39%

22%22%

25%25%

20%22%20%19%

Interactions with faculty during interview and visit

Interpersonal skills

Interactions with house staff during interview and visit

Feedback from current residents

USMLE Step 1/COMLEX Level 1 score

Letters of recommendation in the specialty

USMLE Step 2 CK/COMLEX Level 2 CE score

Medical Student Performance Evaluation (MSPE/Dean's Letter)

Perceived commitment to specialty

Evidence of professionalism and ethics

Perceived interest in program

Leadership qualities

Personal prior knowledge of the applicant

Class ranking/quartile

Graduate of U.S. allopathic medical school

Personal Statement

Audition elective/rotation within your department

Grades in required clerkships

Passing USMLE Step 2 CS/COMLEX Level 2 PE

Honors in clinical clerkships

Honors in clerkship in desired specialty

Gaps in medical education

Grades in clerkship in desired specialty

Alpha Omega Alpha (AOA) membership

Other life experience

Consistency of grades

Volunteer/extracurricular experiences

Demonstrated involvement and interest in research

Graduate of highly regarded U.S. medical school

Other post‐interview contact

Interest in academic career

Visa status*

Applicant was flagged with Match violation by the NRMP

Fluency in language spoken by your patient population

Gold Society membership

Honors in basic sciences

Second interview/visit

Away rotation in your specialty at another institution

USMLE/COMLEX Step 3 score

NRMP Program Director Survey Results, 2014 58

Page 62: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

170

180

190

200

210

220

230

240

250

260

NeurologyPrograms That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview

Figure N-3

Percentage of Programs That Use USMLE Step 2 (CK) Score

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Never Seldom Often

22%

76%

2%

Would your program consider applicants who fail theexam on the first attempt?

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Never Seldom often

24%

73%

2%

Would your program consider applicants who failthe exam on the first attempt?

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

40%

60%

0%

Scores required?

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

34%

50%

16%

Scores required?

N=58

N=51

N=58N=49

N=23N=28 N=20 N=16

Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews

Percentage of Programs That Use USMLE Step 1 Score

170

180

190

200

210

220

230

240

250

260

USMLE Step 2 CKUSMLE Step 1 USMLE Step 1 USMLE Step 2 CK

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.

Scores Above Which Programs Almost Always Grant Interviews

Scores Below Which Programs Generally Do Not Grant Interviews

NRMP Program Director Survey Results, 2014 59

Page 63: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

27%

51%

22%

COMLEX-USA Level 1*

N=57

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes No

77%

23%

USMLE Step 2 CS

NeurologyPercentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview

Figure N-4

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

23%

40% 38%

COMLEX-USA Level 2-CE*

N=40

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

13%20%

68%

USMLE Step 3

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

7%

25%

68%

COMLEX-USA Level 3*

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

28% 25%

47%

COMLEX-USA Level 2-PE*

N=57 N=40

N=41 N=40

N=36 N=28

* Osteopathic applicants only

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores

NRMP Program Director Survey Results, 2014 60

Page 64: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100% 97%

71%80%

71%

53%

81% 85%

U.S. Senior U.S. Graduate OsteopathicPhysician

Canadian Fifth Pathway U.S. IMG Non-U.S. IMG

Percentage of Programs that Typically Interview and Rank Each Applicant Type

Figure N-5NeurologyProgram's Interview Activities

0

100

200

300

400

500

600

700

800

900

1,000

Number ofpositions in the

Match

Number ofapplications

received

Number ofinterview

invitations sent

Number ofapplicantsinterviewed

Number ofapplicants

ranked

5

443

73 59 51

Average Number of Positions, Applications Received, InterviewInvitations Sent, and Applicants Interviewed and Ranked

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Percentage of applicationsrejected

Percentage of applicantsreceiving an in-depth review

48% 50%

Average Percentage of Applicants Rejected andReviewed

N=60N=59N=60* N=60*N=59N=60

N=59

53% of Neurology programs consider all applicant groups

* Data from the NRMP database. All Responding programs included

N=59

NRMP Program Director Survey Results, 2014 61

Page 65: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

Obstetrics and Gynecology (N=123)

NRMP Program Director Survey Results, 2014 62

Page 66: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

Figure OG-1Obstetrics and GynecologyPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview(N=117)

1 2 3 4 5

4.2

4.1

3.9

4.1

3.5

4.2

4.1

4.2

4.2

4.2

4.0

4.4

4.1

3.9

4.0

4.4

4.4

3.7

4.0

4.0

4.0

3.6

3.7

3.6

3.6

4.2

4.8

3.5

3.2

3.6

3.7

3.5

3.7

Average RatingPercent Citing Factor

¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only

100% 50% 0%

97%

92%

76%

84%

81%

68%

75%

72%

72%

58%

72%

64%

69%

62%

65%

67%

62%

62%

57%

50%

57%

57%

51%

38%

43%

33%

33%

22%

21%

35%

13%

21%

14%

USMLE Step 1/COMLEX Level 1 score

Letters of recommendation in the specialty

Medical Student Performance Evaluation (MSPE/Dean's Letter)

USMLE Step 2 CK/COMLEX Level 2 CE score

Personal Statement

Graduate of U.S. allopathic medical school

Grades in required clerkships

Gaps in medical education

Honors in clinical clerkships

Perceived commitment to specialty

Class ranking/quartile

Evidence of professionalism and ethics

Personal prior knowledge of the applicant

Audition elective/rotation within your department

Leadership qualities

Honors in clerkship in desired specialty

Grades in clerkship in desired specialty

Alpha Omega Alpha (AOA) membership

Pass USMLE Step2 CS/COMLEX Lvl2 PE

Perceived interest in program

Consistency of grades

Other life experience

Volunteer/extracurricular experiences

Graduate of highly regarded U.S. medical school

Demonstrated involvement and interest in research

Visa status*

Applicant was flagged with Match violation by the NRMP

Interest in academic career

Honors in basic sciences

Gold Society membership

Away rotation in your specialty at another institution

Fluency in language spoken by your patient population

USMLE/COMLEX Step 3 score

NRMP Program Director Survey Results, 2014 63

Page 67: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

Obstetrics and GynecologyPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants(N=117)

Figure OG-2

1 2 3 4 5

4.84.84.84.7

4.13.94.0

3.74.2

4.54.24.24.1

3.94.1

3.44.2

4.04.24.14.14.2

4.04.0

3.74.0

3.63.7

4.14.0

3.73.9

4.73.83.9

3.13.53.6

4.2

Average RatingPercent Citing Factor

¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only

100% 50% 0%

96%91%91%

86%79%

72%74%

58%67%

61%57%

60%60%

53%54%

49%53%

46%45%

48%54%

42%46%47%42%

36%34%

28%29%

35%20%

16%17%15%

25%12%

22%10%11%

Interactions with faculty during interview and visit

Interpersonal skills

Interactions with house staff during interview and visit

Feedback from current residents

USMLE Step 1/COMLEX Level 1 score

Letters of recommendation in the specialty

USMLE Step 2 CK/COMLEX Level 2 CE score

Medical Student Performance Evaluation (MSPE/Dean's Letter)

Perceived commitment to specialty

Evidence of professionalism and ethics

Perceived interest in program

Leadership qualities

Personal prior knowledge of the applicant

Class ranking/quartile

Graduate of U.S. allopathic medical school

Personal Statement

Audition elective/rotation within your department

Grades in required clerkships

Passing USMLE Step 2 CS/COMLEX Level 2 PE

Honors in clinical clerkships

Honors in clerkship in desired specialty

Gaps in medical education

Grades in clerkship in desired specialty

Alpha Omega Alpha (AOA) membership

Other life experience

Consistency of grades

Volunteer/extracurricular experiences

Demonstrated involvement and interest in research

Graduate of highly regarded U.S. medical school

Other post‐interview contact

Interest in academic career

Visa status*

Applicant was flagged with Match violation by the NRMP

Fluency in language spoken by your patient population

Gold Society membership

Honors in basic sciences

Second interview/visit

Away rotation in your specialty at another institution

USMLE/COMLEX Step 3 score

NRMP Program Director Survey Results, 2014 64

Page 68: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

170

180

190

200

210

220

230

240

250

260

Obstetrics and GynecologyPrograms That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview

Figure OG-3

Percentage of Programs That Use USMLE Step 2 (CK) Score

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Never Seldom Often

19%

75%

6%

Would your program consider applicants who fail theexam on the first attempt?

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Never Seldom often

41%

53%

6%

Would your program consider applicants who failthe exam on the first attempt?

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

25%

75%

0%

Scores required?

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

27%

54%

19%

Scores required?

N=114

N=104

N=112N=97

N=46N=71 N=50 N=34

Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews

Percentage of Programs That Use USMLE Step 1 Score

170

180

190

200

210

220

230

240

250

260

USMLE Step 2 CKUSMLE Step 1 USMLE Step 1 USMLE Step 2 CK

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.

Scores Above Which Programs Almost Always Grant Interviews

Scores Below Which Programs Generally Do Not Grant Interviews

NRMP Program Director Survey Results, 2014 65

Page 69: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

29%

50%

21%

COMLEX-USA Level 1*

N=109

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes No

79%

21%

USMLE Step 2 CS

Obstetrics and GynecologyPercentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview

Figure OG-4

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

25%

35%41%

COMLEX-USA Level 2-CE*

N=60

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

23%

5%

72%

USMLE Step 3

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

20%

4%

76%

COMLEX-USA Level 3*

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

44%

11%

44%

COMLEX-USA Level 2-PE*

N=109 N=60

N=72 N=69

N=63 N=45

* Osteopathic applicants only

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores

NRMP Program Director Survey Results, 2014 66

Page 70: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100% 97%

54%

75%

34%

18%

48%

30%

U.S. Senior U.S. Graduate OsteopathicPhysician

Canadian Fifth Pathway U.S. IMG Non-U.S. IMG

Percentage of Programs that Typically Interview and Rank Each Applicant Type

Figure OG-5Obstetrics and GynecologyProgram's Interview Activities

0

100

200

300

400

500

600

700

800

900

1,000

Number ofpositions in the

Match

Number ofapplications

received

Number ofinterview

invitations sent

Number ofapplicantsinterviewed

Number ofapplicants

ranked

5

425

89 72 63

Average Number of Positions, Applications Received, InterviewInvitations Sent, and Applicants Interviewed and Ranked

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Percentage of applicationsrejected

Percentage of applicantsreceiving an in-depth review

52%

44%

Average Percentage of Applicants Rejected andReviewed

N=122N=117N=123* N=123*N=122N=122

N=116

15% of Obstetrics and Gynecology programs consider all applicant groups

* Data from the NRMP database. All Responding programs included

N=119

NRMP Program Director Survey Results, 2014 67

Page 71: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

Orthopaedic Surgery (N=87)

NRMP Program Director Survey Results, 2014 68

Page 72: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

Figure OS-1Orthopaedic SurgeryPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview(N=85)

1 2 3 4 5

4.4

4.2

4.0

4.0

3.3

4.5

4.2

3.8

4.3

4.1

4.2

4.5

4.4

4.6

4.1

4.5

4.4

3.9

3.6

3.9

4.2

3.6

3.6

3.9

3.7

4.0

4.8

3.8

3.8

3.4

3.7

3.9

Average RatingPercent Citing Factor

¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only

100% 50% 0%

95%

92%

79%

64%

82%

81%

74%

52%

87%

53%

72%

75%

67%

64%

74%

69%

58%

84%

19%

55%

66%

64%

59%

46%

69%

19%

20%

25%

40%

12%

32%

9%

0%

USMLE Step 1/COMLEX Level 1 score

Letters of recommendation in the specialty

Medical Student Performance Evaluation (MSPE/Dean's Letter)

USMLE Step 2 CK/COMLEX Level 2 CE score

Personal Statement

Graduate of U.S. allopathic medical school

Grades in required clerkships

Gaps in medical education

Honors in clinical clerkships

Perceived commitment to specialty

Class ranking/quartile

Evidence of professionalism and ethics

Personal prior knowledge of the applicant

Audition elective/rotation within your department

Leadership qualities

Honors in clerkship in desired specialty

Grades in clerkship in desired specialty

Alpha Omega Alpha (AOA) membership

Pass USMLE Step2 CS/COMLEX Lvl2 PE

Perceived interest in program

Consistency of grades

Other life experience

Volunteer/extracurricular experiences

Graduate of highly regarded U.S. medical school

Demonstrated involvement and interest in research

Visa status*

Applicant was flagged with Match violation by the NRMP

Interest in academic career

Honors in basic sciences

Gold Society membership

Away rotation in your specialty at another institution

Fluency in language spoken by your patient population

USMLE/COMLEX Step 3 score

NRMP Program Director Survey Results, 2014 69

Page 73: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

Orthopaedic SurgeryPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants(N=85)

Figure OS-2

1 2 3 4 5

4.64.64.64.6

4.24.3

4.03.94.1

4.54.04.1

4.54.0

4.43.5

4.74.0

4.34.14.14.0

4.23.9

3.74.0

3.73.94.0

3.93.94.0

4.73.0

3.83.63.7

3.54.0

Average RatingPercent Citing Factor

¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only

100% 50% 0%

89%88%86%82%

70%73%

48%57%

46%64%

57%57%54%50%

61%46%

62%48%

11%52%48%

33%37%

55%39%38%38%

48%30%

15%23%

10%12%

2%11%

25%12%

21%1%

Interactions with faculty during interview and visit

Interpersonal skills

Interactions with house staff during interview and visit

Feedback from current residents

USMLE Step 1/COMLEX Level 1 score

Letters of recommendation in the specialty

USMLE Step 2 CK/COMLEX Level 2 CE score

Medical Student Performance Evaluation (MSPE/Dean's Letter)

Perceived commitment to specialty

Evidence of professionalism and ethics

Perceived interest in program

Leadership qualities

Personal prior knowledge of the applicant

Class ranking/quartile

Graduate of U.S. allopathic medical school

Personal Statement

Audition elective/rotation within your department

Grades in required clerkships

Passing USMLE Step 2 CS/COMLEX Level 2 PE

Honors in clinical clerkships

Honors in clerkship in desired specialty

Gaps in medical education

Grades in clerkship in desired specialty

Alpha Omega Alpha (AOA) membership

Other life experience

Consistency of grades

Volunteer/extracurricular experiences

Demonstrated involvement and interest in research

Graduate of highly regarded U.S. medical school

Other post‐interview contact

Interest in academic career

Visa status*

Applicant was flagged with Match violation by the NRMP

Fluency in language spoken by your patient population

Gold Society membership

Honors in basic sciences

Second interview/visit

Away rotation in your specialty at another institution

USMLE/COMLEX Step 3 score

NRMP Program Director Survey Results, 2014 70

Page 74: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

170

180

190

200

210

220

230

240

250

260

Orthopaedic SurgeryPrograms That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview

Figure OS-3

Percentage of Programs That Use USMLE Step 2 (CK) Score

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Never Seldom Often

61%

37%

3%

Would your program consider applicants who fail theexam on the first attempt?

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Never Seldom often

65%

33%

2%

Would your program consider applicants who failthe exam on the first attempt?

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

7%

93%

0%

Scores required?

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

20%

52%

28%

Scores required?

N=84

N=71

N=75N=55

N=30N=65 N=27 N=15

Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews

Percentage of Programs That Use USMLE Step 1 Score

170

180

190

200

210

220

230

240

250

260

USMLE Step 2 CKUSMLE Step 1 USMLE Step 1 USMLE Step 2 CK

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.

Scores Above Which Programs Almost Always Grant Interviews

Scores Below Which Programs Generally Do Not Grant Interviews

NRMP Program Director Survey Results, 2014 71

Page 75: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

7%

19%

74%

COMLEX-USA Level 1*

N=65

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes No

66%

34%

USMLE Step 2 CS

Orthopaedic SurgeryPercentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview

Figure OS-4

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

8% 8%

84%

COMLEX-USA Level 2-CE*

N=41

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

22%

5%

73%

USMLE Step 3

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

4% 4%

92%

COMLEX-USA Level 3*

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

8%4%

88%

COMLEX-USA Level 2-PE*

N=65 N=41

N=27 N=25

N=26 N=26

* Osteopathic applicants only

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores

NRMP Program Director Survey Results, 2014 72

Page 76: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100% 99%

51%

27%20%

14%23%

16%

U.S. Senior U.S. Graduate OsteopathicPhysician

Canadian Fifth Pathway U.S. IMG Non-U.S. IMG

Percentage of Programs that Typically Interview and Rank Each Applicant Type

Figure OS-5Orthopaedic SurgeryProgram's Interview Activities

0

100

200

300

400

500

600

700

800

900

1,000

Number ofpositions in the

Match

Number ofapplications

received

Number ofinterview

invitations sent

Number ofapplicantsinterviewed

Number ofapplicants

ranked

5

549

72 59 51

Average Number of Positions, Applications Received, InterviewInvitations Sent, and Applicants Interviewed and Ranked

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Percentage of applicationsrejected

Percentage of applicantsreceiving an in-depth review

46%49%

Average Percentage of Applicants Rejected andReviewed

N=84N=81N=87* N=87*N=83N=84

N=83

13% of Orthopaedic Surgery programs consider all applicant groups

* Data from the NRMP database. All Responding programs included

N=83

NRMP Program Director Survey Results, 2014 73

Page 77: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

Otolaryngology (N=46)

NRMP Program Director Survey Results, 2014 74

Page 78: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

Figure O-1OtolaryngologyPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview(N=46)

1 2 3 4 5

4.3

4.6

3.5

4.0

3.7

4.4

4.2

3.6

4.4

4.3

4.0

4.4

4.4

4.3

4.4

4.6

4.5

4.0

4.1

4.3

4.2

3.7

3.8

3.9

4.3

4.0

4.8

4.2

3.7

3.9

3.8

2.8

4.0

Average RatingPercent Citing Factor

¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only

100% 50% 0%

98%

100%

74%

59%

74%

67%

74%

61%

85%

67%

59%

65%

70%

63%

76%

76%

61%

83%

20%

54%

46%

59%

72%

48%

80%

17%

24%

35%

33%

17%

39%

13%

4%

USMLE Step 1/COMLEX Level 1 score

Letters of recommendation in the specialty

Medical Student Performance Evaluation (MSPE/Dean's Letter)

USMLE Step 2 CK/COMLEX Level 2 CE score

Personal Statement

Graduate of U.S. allopathic medical school

Grades in required clerkships

Gaps in medical education

Honors in clinical clerkships

Perceived commitment to specialty

Class ranking/quartile

Evidence of professionalism and ethics

Personal prior knowledge of the applicant

Audition elective/rotation within your department

Leadership qualities

Honors in clerkship in desired specialty

Grades in clerkship in desired specialty

Alpha Omega Alpha (AOA) membership

Pass USMLE Step2 CS/COMLEX Lvl2 PE

Perceived interest in program

Consistency of grades

Other life experience

Volunteer/extracurricular experiences

Graduate of highly regarded U.S. medical school

Demonstrated involvement and interest in research

Visa status*

Applicant was flagged with Match violation by the NRMP

Interest in academic career

Honors in basic sciences

Gold Society membership

Away rotation in your specialty at another institution

Fluency in language spoken by your patient population

USMLE/COMLEX Step 3 score

NRMP Program Director Survey Results, 2014 75

Page 79: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

OtolaryngologyPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants(N=46)

Figure O-2

1 2 3 4 5

4.94.84.84.7

3.74.3

3.73.7

4.54.24.34.3

4.73.9

4.53.6

4.34.14.04.24.2

3.44.1

3.73.8

3.64.14.24.14.34.2

4.04.8

2.53.4

3.05.0

3.93.0

Average RatingPercent Citing Factor

¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only

100% 50% 0%

96%96%96%96%

71%80%

31%38%

60%64%

53%73%

56%40%

44%42%

53%40%

4%53%51%

33%44%

49%40%

22%42%

64%20%20%

33%7%

18%7%

16%20%2%20%2%

Interactions with faculty during interview and visit

Interpersonal skills

Interactions with house staff during interview and visit

Feedback from current residents

USMLE Step 1/COMLEX Level 1 score

Letters of recommendation in the specialty

USMLE Step 2 CK/COMLEX Level 2 CE score

Medical Student Performance Evaluation (MSPE/Dean's Letter)

Perceived commitment to specialty

Evidence of professionalism and ethics

Perceived interest in program

Leadership qualities

Personal prior knowledge of the applicant

Class ranking/quartile

Graduate of U.S. allopathic medical school

Personal Statement

Audition elective/rotation within your department

Grades in required clerkships

Passing USMLE Step 2 CS/COMLEX Level 2 PE

Honors in clinical clerkships

Honors in clerkship in desired specialty

Gaps in medical education

Grades in clerkship in desired specialty

Alpha Omega Alpha (AOA) membership

Other life experience

Consistency of grades

Volunteer/extracurricular experiences

Demonstrated involvement and interest in research

Graduate of highly regarded U.S. medical school

Other post‐interview contact

Interest in academic career

Visa status*

Applicant was flagged with Match violation by the NRMP

Fluency in language spoken by your patient population

Gold Society membership

Honors in basic sciences

Second interview/visit

Away rotation in your specialty at another institution

USMLE/COMLEX Step 3 score

NRMP Program Director Survey Results, 2014 76

Page 80: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

170

180

190

200

210

220

230

240

250

260

OtolaryngologyPrograms That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview

Figure O-3

Percentage of Programs That Use USMLE Step 2 (CK) Score

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Never Seldom Often

55%

45%

0%

Would your program consider applicants who fail theexam on the first attempt?

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Never Seldom often

67%

33%

0%

Would your program consider applicants who failthe exam on the first attempt?

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

20%

80%

0%

Scores required?

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

29%

38%33%

Scores required?

N=46

N=40

N=42N=27

N=14N=32 N=15 N=8

Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews

Percentage of Programs That Use USMLE Step 1 Score

170

180

190

200

210

220

230

240

250

260

USMLE Step 2 CKUSMLE Step 1 USMLE Step 1 USMLE Step 2 CK

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.

Scores Above Which Programs Almost Always Grant Interviews

Scores Below Which Programs Generally Do Not Grant Interviews

NRMP Program Director Survey Results, 2014 77

Page 81: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

16%11%

74%

COMLEX-USA Level 1*

N=39

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes No

62%

38%

USMLE Step 2 CS

OtolaryngologyPercentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview

Figure O-4

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

16%

5%

79%

COMLEX-USA Level 2-CE*

N=28

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

14%11%

75%

USMLE Step 3

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

6%0%

94%

COMLEX-USA Level 3*

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

16%

5%

79%

COMLEX-USA Level 2-PE*

N=39 N=28

N=19 N=19

N=19 N=16

* Osteopathic applicants only

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores

NRMP Program Director Survey Results, 2014 78

Page 82: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100% 98%

70%

28% 28%24%

37%

28%

U.S. Senior U.S. Graduate OsteopathicPhysician

Canadian Fifth Pathway U.S. IMG Non-U.S. IMG

Percentage of Programs that Typically Interview and Rank Each Applicant Type

Figure O-5OtolaryngologyProgram's Interview Activities

0

100

200

300

400

500

600

700

800

900

1,000

Number ofpositions in the

Match

Number ofapplications

received

Number ofinterview

invitations sent

Number ofapplicantsinterviewed

Number ofapplicants

ranked

3

312

46 37 35

Average Number of Positions, Applications Received, InterviewInvitations Sent, and Applicants Interviewed and Ranked

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Percentage of applicationsrejected

Percentage of applicantsreceiving an in-depth review

31%

67%

Average Percentage of Applicants Rejected andReviewed

N=45N=45N=46* N=46*N=45N=45

N=46

24% of Otolaryngology programs consider all applicant groups

* Data from the NRMP database. All Responding programs included

N=45

NRMP Program Director Survey Results, 2014 79

Page 83: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

Pathology (N=84)

NRMP Program Director Survey Results, 2014 80

Page 84: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

Figure PA-1PathologyPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview(N=84)

1 2 3 4 5

4.3

4.5

4.0

4.0

3.8

4.0

3.8

4.1

3.5

4.6

3.8

4.4

4.1

3.9

3.9

4.1

4.1

3.6

4.0

4.4

4.0

3.5

3.5

4.1

3.7

3.9

4.8

4.2

3.8

3.3

3.6

4.3

3.5

Average RatingPercent Citing Factor

¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only

100% 50% 0%

94%

98%

83%

86%

83%

68%

60%

75%

57%

93%

57%

63%

57%

64%

54%

58%

68%

54%

71%

67%

58%

39%

40%

61%

60%

46%

45%

35%

42%

8%

42%

26%

36%

USMLE Step 1/COMLEX Level 1 score

Letters of recommendation in the specialty

Medical Student Performance Evaluation (MSPE/Dean's Letter)

USMLE Step 2 CK/COMLEX Level 2 CE score

Personal Statement

Graduate of U.S. allopathic medical school

Grades in required clerkships

Gaps in medical education

Honors in clinical clerkships

Perceived commitment to specialty

Class ranking/quartile

Evidence of professionalism and ethics

Personal prior knowledge of the applicant

Audition elective/rotation within your department

Leadership qualities

Honors in clerkship in desired specialty

Grades in clerkship in desired specialty

Alpha Omega Alpha (AOA) membership

Pass USMLE Step2 CS/COMLEX Lvl2 PE

Perceived interest in program

Consistency of grades

Other life experience

Volunteer/extracurricular experiences

Graduate of highly regarded U.S. medical school

Demonstrated involvement and interest in research

Visa status*

Applicant was flagged with Match violation by the NRMP

Interest in academic career

Honors in basic sciences

Gold Society membership

Away rotation in your specialty at another institution

Fluency in language spoken by your patient population

USMLE/COMLEX Step 3 score

NRMP Program Director Survey Results, 2014 81

Page 85: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

PathologyPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants(N=84)

Figure PA-2

1 2 3 4 5

4.84.74.74.7

4.34.3

4.14.0

4.54.54.5

4.04.2

3.84.0

3.84.1

3.94.0

3.83.9

4.24.04.0

3.23.9

3.34.04.0

4.34.1

3.94.8

4.52.5

3.93.93.9

3.8

Average RatingPercent Citing Factor

¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only

100% 50% 0%

95%93%89%89%89%85%

79%65%

82%64%

71%42%

54%52%

60%55%54%

37%61%

35%36%

46%40%

31%25%

37%21%

45%40%40%37%

31%30%27%

2%27%

21%19%

31%

Interactions with faculty during interview and visit

Interpersonal skills

Interactions with house staff during interview and visit

Feedback from current residents

USMLE Step 1/COMLEX Level 1 score

Letters of recommendation in the specialty

USMLE Step 2 CK/COMLEX Level 2 CE score

Medical Student Performance Evaluation (MSPE/Dean's Letter)

Perceived commitment to specialty

Evidence of professionalism and ethics

Perceived interest in program

Leadership qualities

Personal prior knowledge of the applicant

Class ranking/quartile

Graduate of U.S. allopathic medical school

Personal Statement

Audition elective/rotation within your department

Grades in required clerkships

Passing USMLE Step 2 CS/COMLEX Level 2 PE

Honors in clinical clerkships

Honors in clerkship in desired specialty

Gaps in medical education

Grades in clerkship in desired specialty

Alpha Omega Alpha (AOA) membership

Other life experience

Consistency of grades

Volunteer/extracurricular experiences

Demonstrated involvement and interest in research

Graduate of highly regarded U.S. medical school

Other post‐interview contact

Interest in academic career

Visa status*

Applicant was flagged with Match violation by the NRMP

Fluency in language spoken by your patient population

Gold Society membership

Honors in basic sciences

Second interview/visit

Away rotation in your specialty at another institution

USMLE/COMLEX Step 3 score

NRMP Program Director Survey Results, 2014 82

Page 86: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

170

180

190

200

210

220

230

240

250

260

PathologyPrograms That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview

Figure PA-3

Percentage of Programs That Use USMLE Step 2 (CK) Score

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Never Seldom Often

14%

79%

6%

Would your program consider applicants who fail theexam on the first attempt?

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Never Seldom often

13%

82%

6%

Would your program consider applicants who failthe exam on the first attempt?

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

35%

63%

1%

Scores required?

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

32%

52%

16%

Scores required?

N=82

N=77

N=77N=72

N=34N=42 N=33 N=27

Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews

Percentage of Programs That Use USMLE Step 1 Score

170

180

190

200

210

220

230

240

250

260

USMLE Step 2 CKUSMLE Step 1 USMLE Step 1 USMLE Step 2 CK

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.

Scores Above Which Programs Almost Always Grant Interviews

Scores Below Which Programs Generally Do Not Grant Interviews

NRMP Program Director Survey Results, 2014 83

Page 87: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

39%

50%

11%

COMLEX-USA Level 1*

N=73

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes No

84%

16%

USMLE Step 2 CS

PathologyPercentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview

Figure PA-4

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

41%38%

21%

COMLEX-USA Level 2-CE*

N=61

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

30%

7%

64%

USMLE Step 3

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

32%

13%

55%

COMLEX-USA Level 3*

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

55%

18%

27%

COMLEX-USA Level 2-PE*

N=73 N=61

N=62 N=56

N=55 N=47

* Osteopathic applicants only

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores

NRMP Program Director Survey Results, 2014 84

Page 88: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100% 99%93% 93% 91%

68%

94% 91%

U.S. Senior U.S. Graduate OsteopathicPhysician

Canadian Fifth Pathway U.S. IMG Non-U.S. IMG

Percentage of Programs that Typically Interview and Rank Each Applicant Group

Figure PA-5PathologyProgram's Interview Activities

0

100

200

300

400

500

600

700

800

900

1,000

Number ofpositions in the

Match

Number ofapplications

received

Number ofinterview

invitations sent

Number ofapplicantsinterviewed

Number ofapplicants

ranked

4

349

55 41 32

Average Number of Positions, Applications Received, InterviewInvitations Sent, and Applicants Interviewed and Ranked

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Percentage of applicationsrejected

Percentage of applicantsreceiving an in-depth review

56%

42%

Average Percentage of Applicants Rejected andReviewed

N=82N=80N=84* N=84*N=82N=82

N=81

67% of Pathology programs consider all applicant groups

* Data from the NRMP database. All Responding programs included

N=82

NRMP Program Director Survey Results, 2014 85

Page 89: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

Pediatrics (N=121)

NRMP Program Director Survey Results, 2014 86

Page 90: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

Figure P-1PediatricsPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview(N=120)

1 2 3 4 5

4.0

3.8

4.1

4.1

3.4

4.0

4.1

4.0

4.0

4.0

4.0

4.4

3.8

3.9

3.9

4.0

4.1

3.9

4.2

3.7

3.8

3.6

3.7

3.7

3.4

3.9

4.8

3.6

3.4

3.7

3.5

3.4

2.7

Average RatingPercent Citing Factor

¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only

100% 50% 0%

98%

77%

87%

81%

70%

77%

69%

77%

63%

56%

75%

54%

60%

65%

57%

63%

66%

62%

64%

39%

63%

52%

55%

44%

23%

33%

30%

18%

24%

39%

16%

33%

16%

USMLE Step 1/COMLEX Level 1 score

Letters of recommendation in the specialty

Medical Student Performance Evaluation (MSPE/Dean's Letter)

USMLE Step 2 CK/COMLEX Level 2 CE score

Personal Statement

Graduate of U.S. allopathic medical school

Grades in required clerkships

Gaps in medical education

Honors in clinical clerkships

Perceived commitment to specialty

Class ranking/quartile

Evidence of professionalism and ethics

Personal prior knowledge of the applicant

Audition elective/rotation within your department

Leadership qualities

Honors in clerkship in desired specialty

Grades in clerkship in desired specialty

Alpha Omega Alpha (AOA) membership

Pass USMLE Step2 CS/COMLEX Lvl2 PE

Perceived interest in program

Consistency of grades

Other life experience

Volunteer/extracurricular experiences

Graduate of highly regarded U.S. medical school

Demonstrated involvement and interest in research

Visa status*

Applicant was flagged with Match violation by the NRMP

Interest in academic career

Honors in basic sciences

Gold Society membership

Away rotation in your specialty at another institution

Fluency in language spoken by your patient population

USMLE/COMLEX Step 3 score

NRMP Program Director Survey Results, 2014 87

Page 91: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

PediatricsPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants(N=120)

Figure P-2

1 2 3 4 5

4.74.84.74.6

4.23.8

4.14.24.1

4.53.84.04.24.14.1

3.44.03.9

4.34.14.24.24.24.2

3.63.9

3.73.4

3.73.8

3.63.7

4.93.4

3.83.53.5

3.73.4

Average RatingPercent Citing Factor

¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only

100% 50% 0%

98%95%93%90%90%

76%88%

82%60%

67%56%

66%62%

77%68%

60%63%

69%71%

57%52%

56%56%52%

46%47%

57%30%

36%27%

21%23%23%

31%35%

21%18%

13%11%

Interactions with faculty during interview and visit

Interpersonal skills

Interactions with house staff during interview and visit

Feedback from current residents

USMLE Step 1/COMLEX Level 1 score

Letters of recommendation in the specialty

USMLE Step 2 CK/COMLEX Level 2 CE score

Medical Student Performance Evaluation (MSPE/Dean's Letter)

Perceived commitment to specialty

Evidence of professionalism and ethics

Perceived interest in program

Leadership qualities

Personal prior knowledge of the applicant

Class ranking/quartile

Graduate of U.S. allopathic medical school

Personal Statement

Audition elective/rotation within your department

Grades in required clerkships

Passing USMLE Step 2 CS/COMLEX Level 2 PE

Honors in clinical clerkships

Honors in clerkship in desired specialty

Gaps in medical education

Grades in clerkship in desired specialty

Alpha Omega Alpha (AOA) membership

Other life experience

Consistency of grades

Volunteer/extracurricular experiences

Demonstrated involvement and interest in research

Graduate of highly regarded U.S. medical school

Other post‐interview contact

Interest in academic career

Visa status*

Applicant was flagged with Match violation by the NRMP

Fluency in language spoken by your patient population

Gold Society membership

Honors in basic sciences

Second interview/visit

Away rotation in your specialty at another institution

USMLE/COMLEX Step 3 score

NRMP Program Director Survey Results, 2014 88

Page 92: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

170

180

190

200

210

220

230

240

250

260

PediatricsPrograms That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview

Figure P-3

Percentage of Programs That Use USMLE Step 2 (CK) Score

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Never Seldom Often

5%

77%

18%

Would your program consider applicants who fail theexam on the first attempt?

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Never Seldom often

27%

67%

6%

Would your program consider applicants who failthe exam on the first attempt?

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

43%

56%

1%

Scores required?

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

38% 42%

20%

Scores required?

N=116

N=113

N=113N=108

N=45N=54 N=49 N=40

Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews

Percentage of Programs That Use USMLE Step 1 Score

170

180

190

200

210

220

230

240

250

260

USMLE Step 2 CKUSMLE Step 1 USMLE Step 1 USMLE Step 2 CK

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.

Scores Above Which Programs Almost Always Grant Interviews

Scores Below Which Programs Generally Do Not Grant Interviews

NRMP Program Director Survey Results, 2014 89

Page 93: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

33%

52%

15%

COMLEX-USA Level 1*

N=111

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes No

82%

18%

USMLE Step 2 CS

PediatricsPercentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview

Figure P-4

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

29%

44%

27%

COMLEX-USA Level 2-CE*

N=67

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

13%6%

81%

USMLE Step 3

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

15%7%

79%

COMLEX-USA Level 3*

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

60%

10%

30%

COMLEX-USA Level 2-PE*

N=111 N=67

N=100 N=97

N=91 N=61

* Osteopathic applicants only

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores

NRMP Program Director Survey Results, 2014 90

Page 94: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%100%

72%

86%

69%

47%

72%

60%

U.S. Senior U.S. Graduate OsteopathicPhysician

Canadian Fifth Pathway U.S. IMG Non-U.S. IMG

Percentage of Programs that Typically Interview and Rank Each Applicant Type

Figure P-5PediatricsProgram's Interview Activities

0

100

200

300

400

500

600

700

800

900

1,000

Number ofpositions in the

Match

Number ofapplications

received

Number ofinterview

invitations sent

Number ofapplicantsinterviewed

Number ofapplicants

ranked

15

1,124

221192

161

Average Number of Positions, Applications Received, InterviewInvitations Sent, and Applicants Interviewed and Ranked

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Percentage of applicationsrejected

Percentage of applicantsreceiving an in-depth review

58%

35%

Average Percentage of Applicants Rejected andReviewed

N=118N=114N=121* N=121*N=116N=118

N=118

42% of Pediatrics programs consider all applicant groups

* Data from the NRMP database. All Responding programs included

N=116

NRMP Program Director Survey Results, 2014 91

Page 95: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

Physical Medicine and Rehabilitation (N=34)

NRMP Program Director Survey Results, 2014 92

Page 96: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

Figure PMR-1Physical Medicine and RehabilitationPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview(N=33)

1 2 3 4 5

4.0

4.3

4.2

4.0

3.9

3.7

3.9

4.2

3.9

4.5

3.8

4.4

3.9

4.3

4.1

4.0

4.4

3.5

4.2

4.2

4.2

3.6

3.6

3.6

3.8

3.6

4.6

2.9

3.4

3.5

3.8

3.9

3.8

Average RatingPercent Citing Factor

¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only

100% 50% 0%

91%

91%

88%

85%

79%

64%

76%

73%

55%

76%

67%

76%

55%

67%

48%

45%

58%

42%

73%

58%

67%

55%

67%

33%

42%

33%

39%

21%

27%

6%

39%

42%

33%

USMLE Step 1/COMLEX Level 1 score

Letters of recommendation in the specialty

Medical Student Performance Evaluation (MSPE/Dean's Letter)

USMLE Step 2 CK/COMLEX Level 2 CE score

Personal Statement

Graduate of U.S. allopathic medical school

Grades in required clerkships

Gaps in medical education

Honors in clinical clerkships

Perceived commitment to specialty

Class ranking/quartile

Evidence of professionalism and ethics

Personal prior knowledge of the applicant

Audition elective/rotation within your department

Leadership qualities

Honors in clerkship in desired specialty

Grades in clerkship in desired specialty

Alpha Omega Alpha (AOA) membership

Pass USMLE Step2 CS/COMLEX Lvl2 PE

Perceived interest in program

Consistency of grades

Other life experience

Volunteer/extracurricular experiences

Graduate of highly regarded U.S. medical school

Demonstrated involvement and interest in research

Visa status*

Applicant was flagged with Match violation by the NRMP

Interest in academic career

Honors in basic sciences

Gold Society membership

Away rotation in your specialty at another institution

Fluency in language spoken by your patient population

USMLE/COMLEX Step 3 score

NRMP Program Director Survey Results, 2014 93

Page 97: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

Physical Medicine and RehabilitationPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants(N=33)

Figure PMR-2

1 2 3 4 5

4.84.74.74.6

4.04.2

4.04.2

4.54.6

4.24.14.1

3.94.0

3.74.7

3.84.04.1

4.53.9

4.33.8

3.64.1

3.73.4

3.84.14.0

3.84.9

3.83.73.7

3.34.4

3.8

Average RatingPercent Citing Factor

¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only

100% 50% 0%

94%94%

85%79%

82%82%

76%76%

79%58%58%

48%52%52%

39%64%64%

58%70%

36%33%

45%45%

39%52%

61%36%

52%24%

30%15%

18%21%

27%9%

18%9%

33%27%

Interactions with faculty during interview and visit

Interpersonal skills

Interactions with house staff during interview and visit

Feedback from current residents

USMLE Step 1/COMLEX Level 1 score

Letters of recommendation in the specialty

USMLE Step 2 CK/COMLEX Level 2 CE score

Medical Student Performance Evaluation (MSPE/Dean's Letter)

Perceived commitment to specialty

Evidence of professionalism and ethics

Perceived interest in program

Leadership qualities

Personal prior knowledge of the applicant

Class ranking/quartile

Graduate of U.S. allopathic medical school

Personal Statement

Audition elective/rotation within your department

Grades in required clerkships

Passing USMLE Step 2 CS/COMLEX Level 2 PE

Honors in clinical clerkships

Honors in clerkship in desired specialty

Gaps in medical education

Grades in clerkship in desired specialty

Alpha Omega Alpha (AOA) membership

Other life experience

Consistency of grades

Volunteer/extracurricular experiences

Demonstrated involvement and interest in research

Graduate of highly regarded U.S. medical school

Other post‐interview contact

Interest in academic career

Visa status*

Applicant was flagged with Match violation by the NRMP

Fluency in language spoken by your patient population

Gold Society membership

Honors in basic sciences

Second interview/visit

Away rotation in your specialty at another institution

USMLE/COMLEX Step 3 score

NRMP Program Director Survey Results, 2014 94

Page 98: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

170

180

190

200

210

220

230

240

250

260

Physical Medicine and RehabilitationPrograms That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview

Figure PMR-3

Percentage of Programs That Use USMLE Step 2 (CK) Score

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Never Seldom Often

13%

67%

20%

Would your program consider applicants who fail theexam on the first attempt?

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Never Seldom often

7%

83%

10%

Would your program consider applicants who failthe exam on the first attempt?

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

48% 48%

3%

Scores required?

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

45%

32%

23%

Scores required?

N=31

N=30

N=31N=29

N=12N=11 N=7 N=8

Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews

Percentage of Programs That Use USMLE Step 1 Score

170

180

190

200

210

220

230

240

250

260

USMLE Step 2 CKUSMLE Step 1 USMLE Step 1 USMLE Step 2 CK

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.

Scores Above Which Programs Almost Always Grant Interviews

Scores Below Which Programs Generally Do Not Grant Interviews

NRMP Program Director Survey Results, 2014 95

Page 99: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

48%42%

10%

COMLEX-USA Level 1*

N=30

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes No

70%

30%

USMLE Step 2 CS

Physical Medicine and RehabilitationPercentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview

Figure PMR-4

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

45%

32%

23%

COMLEX-USA Level 2-CE*

N=23

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

17% 17%

65%

USMLE Step 3

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

26%

17%

57%

COMLEX-USA Level 3*

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

55%

10%

34%

COMLEX-USA Level 2-PE*

N=30 N=23

N=31 N=31

N=29 N=23

* Osteopathic applicants only

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores

NRMP Program Director Survey Results, 2014 96

Page 100: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

0%10%20%30%40%50%60%70%80%90%

100%100%

79%

97%

61%

42%

79%

45%

U.S. S

enior

U.S. G

radu

ate

Osteop

athic

Physic

ianCan

adian

Fifth P

athw

ay

U.S. I

MG

Non-U

.S. I

MG

Percentage of Programs that Typically Interview and Rank Each Applicant Type

Figure PMR-5Physical Medicine and RehabilitationProgram's Interview Activities

0

100

200

300

400

500

600

700

800

900

1,000

Number ofpositions in the

Match

Number ofapplications

received

Number ofinterview

invitations sent

Number ofapplicantsinterviewed

Number ofapplicants

ranked

5

349

86 68 54

Average Number of Positions, Applications Received, InterviewInvitations Sent, and Applicants Interviewed and Ranked

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Percentage of applicationsrejected

Percentage of applicantsreceiving an in-depth review

45%51%

Average Percentage of Applicants Rejected andReviewed

N=34N=34N=34* N=34*N=34N=34

N=33

27% of Physical Medicine and Rehabilitation programs consider all applicant groups

* Data from the NRMP database. All Responding programs included

N=34

NRMP Program Director Survey Results, 2014 97

Page 101: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

Plastic Surgery (N=39)

NRMP Program Director Survey Results, 2014 98

Page 102: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

Figure PS-1Plastic SurgeryPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview(N=34)

1 2 3 4 5

4.3

4.8

3.1

4.4

3.6

4.2

3.9

3.6

4.2

4.2

3.6

4.2

4.4

4.4

4.1

4.5

4.5

4.2

4.0

3.8

4.2

3.6

3.6

3.8

4.0

3.9

4.7

4.2

3.1

3.0

3.9

3.0

4.0

Average RatingPercent Citing Factor

¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only

100% 50% 0%

94%

94%

62%

65%

85%

74%

50%

35%

76%

74%

59%

68%

76%

65%

71%

74%

56%

79%

26%

53%

44%

62%

65%

62%

82%

47%

29%

47%

21%

12%

24%

3%

15%

USMLE Step 1/COMLEX Level 1 score

Letters of recommendation in the specialty

Medical Student Performance Evaluation (MSPE/Dean's Letter)

USMLE Step 2 CK/COMLEX Level 2 CE score

Personal Statement

Graduate of U.S. allopathic medical school

Grades in required clerkships

Gaps in medical education

Honors in clinical clerkships

Perceived commitment to specialty

Class ranking/quartile

Evidence of professionalism and ethics

Personal prior knowledge of the applicant

Audition elective/rotation within your department

Leadership qualities

Honors in clerkship in desired specialty

Grades in clerkship in desired specialty

Alpha Omega Alpha (AOA) membership

Pass USMLE Step2 CS/COMLEX Lvl2 PE

Perceived interest in program

Consistency of grades

Other life experience

Volunteer/extracurricular experiences

Graduate of highly regarded U.S. medical school

Demonstrated involvement and interest in research

Visa status*

Applicant was flagged with Match violation by the NRMP

Interest in academic career

Honors in basic sciences

Gold Society membership

Away rotation in your specialty at another institution

Fluency in language spoken by your patient population

USMLE/COMLEX Step 3 score

NRMP Program Director Survey Results, 2014 99

Page 103: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

Plastic SurgeryPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants(N=34)

Figure PS-2

1 2 3 4 5

4.84.74.84.7

4.24.5

4.03.4

4.54.5

4.34.34.5

4.24.1

3.74.7

3.84.2

4.04.6

4.34.7

4.13.7

4.34.04.0

4.34.0

4.34.44.4

3.04.0

3.4

4.33.5

Average RatingPercent Citing Factor

¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only

100% 50% 0%

88%91%

85%68%

56%82%

32%32%

62%56%

35%53%53%

26%44%

29%62%

24%18%

44%47%

9%26%

47%38%

21%29%

62%24%9%

44%21%

15%3%3%

15%0%

18%12%

Interactions with faculty during interview and visit

Interpersonal skills

Interactions with house staff during interview and visit

Feedback from current residents

USMLE Step 1/COMLEX Level 1 score

Letters of recommendation in the specialty

USMLE Step 2 CK/COMLEX Level 2 CE score

Medical Student Performance Evaluation (MSPE/Dean's Letter)

Perceived commitment to specialty

Evidence of professionalism and ethics

Perceived interest in program

Leadership qualities

Personal prior knowledge of the applicant

Class ranking/quartile

Graduate of U.S. allopathic medical school

Personal Statement

Audition elective/rotation within your department

Grades in required clerkships

Passing USMLE Step 2 CS/COMLEX Level 2 PE

Honors in clinical clerkships

Honors in clerkship in desired specialty

Gaps in medical education

Grades in clerkship in desired specialty

Alpha Omega Alpha (AOA) membership

Other life experience

Consistency of grades

Volunteer/extracurricular experiences

Demonstrated involvement and interest in research

Graduate of highly regarded U.S. medical school

Other post‐interview contact

Interest in academic career

Visa status*

Applicant was flagged with Match violation by the NRMP

Fluency in language spoken by your patient population

Gold Society membership

Honors in basic sciences

Second interview/visit

Away rotation in your specialty at another institution

USMLE/COMLEX Step 3 score

NRMP Program Director Survey Results, 2014 100

Page 104: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

170

180

190

200

210

220

230

240

250

260

Plastic SurgeryPrograms That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview

Figure PS-3

Percentage of Programs That Use USMLE Step 2 (CK) Score

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Never Seldom Often

67%

33%

0%

Would your program consider applicants who fail theexam on the first attempt?

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Never Seldom often

65%

35%

0%

Would your program consider applicants who failthe exam on the first attempt?

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

14%

86%

0%

Scores required?

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

23%

57%

20%

Scores required?

N=35

N=30

N=35N=23

N=11N=21 N=14 N=8

Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews

Percentage of Programs That Use USMLE Step 1 Score

170

180

190

200

210

220

230

240

250

260

USMLE Step 2 CKUSMLE Step 1 USMLE Step 1 USMLE Step 2 CK

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.

Scores Above Which Programs Almost Always Grant Interviews

Scores Below Which Programs Generally Do Not Grant Interviews

NRMP Program Director Survey Results, 2014 101

Page 105: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

33%

0%

67%

COMLEX-USA Level 1*

N=34

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes No

71%

29%

USMLE Step 2 CS

Plastic SurgeryPercentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview

Figure PS-4

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

33%

0%

67%

COMLEX-USA Level 2-CE*

N=28

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

21%29%

50%

USMLE Step 3

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

38%

0%

63%

COMLEX-USA Level 3*

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

38%

0%

63%

COMLEX-USA Level 2-PE*

N=34 N=28

N=9 N=9

N=8 N=8

* Osteopathic applicants only

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores

NRMP Program Director Survey Results, 2014 102

Page 106: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100% 97%

39%

27%

45%

18%24% 24%

U.S. Senior U.S. Graduate OsteopathicPhysician

Canadian Fifth Pathway U.S. IMG Non-U.S. IMG

Percentage of Programs that Typically Interview and Rank Each Applicant Type

Figure PS-5Plastic SurgeryProgram's Interview Activities

0

100

200

300

400

500

600

700

800

900

1,000

Number ofpositions in the

Match

Number ofapplications

received

Number ofinterview

invitations sent

Number ofapplicantsinterviewed

Number ofapplicants

ranked

2

192

35 30 25

Average Number of Positions, Applications Received, InterviewInvitations Sent, and Applicants Interviewed and Ranked

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Percentage of applicationsrejected

Percentage of applicantsreceiving an in-depth review

29%

67%

Average Percentage of Applicants Rejected andReviewed

N=38N=36N=39* N=39*N=37N=38

N=33

18% of Plastic Surgery programs consider all applicant groups

* Data from the NRMP database. All Responding programs included

N=37

NRMP Program Director Survey Results, 2014 103

Page 107: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

Psychiatry (N=84)

NRMP Program Director Survey Results, 2014 104

Page 108: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

Figure PSY-1PsychiatryPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview(N=83)

1 2 3 4 5

3.7

4.1

4.2

3.7

4.1

3.9

3.9

4.3

3.7

4.5

3.6

4.6

4.0

4.1

4.1

4.1

4.2

3.4

4.0

4.2

4.0

3.8

3.6

3.6

3.3

3.9

4.8

3.4

2.8

3.4

3.1

4.0

3.4

Average RatingPercent Citing Factor

¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only

100% 50% 0%

87%

84%

94%

84%

92%

84%

70%

89%

66%

88%

58%

71%

70%

65%

65%

67%

71%

51%

82%

60%

51%

65%

57%

58%

45%

43%

54%

30%

22%

40%

24%

51%

29%

USMLE Step 1/COMLEX Level 1 score

Letters of recommendation in the specialty

Medical Student Performance Evaluation (MSPE/Dean's Letter)

USMLE Step 2 CK/COMLEX Level 2 CE score

Personal Statement

Graduate of U.S. allopathic medical school

Grades in required clerkships

Gaps in medical education

Honors in clinical clerkships

Perceived commitment to specialty

Class ranking/quartile

Evidence of professionalism and ethics

Personal prior knowledge of the applicant

Audition elective/rotation within your department

Leadership qualities

Honors in clerkship in desired specialty

Grades in clerkship in desired specialty

Alpha Omega Alpha (AOA) membership

Pass USMLE Step2 CS/COMLEX Lvl2 PE

Perceived interest in program

Consistency of grades

Other life experience

Volunteer/extracurricular experiences

Graduate of highly regarded U.S. medical school

Demonstrated involvement and interest in research

Visa status*

Applicant was flagged with Match violation by the NRMP

Interest in academic career

Honors in basic sciences

Gold Society membership

Away rotation in your specialty at another institution

Fluency in language spoken by your patient population

USMLE/COMLEX Step 3 score

NRMP Program Director Survey Results, 2014 105

Page 109: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

PsychiatryPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants(N=83)

Figure PSY-2

1 2 3 4 5

4.95.04.94.8

3.83.93.9

4.24.4

4.84.24.14.1

3.64.1

3.74.2

3.84.1

3.83.9

4.24.0

3.73.9

4.23.8

3.63.83.83.7

4.14.9

4.23.7

3.33.63.6

3.3

Average RatingPercent Citing Factor

¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only

100% 50% 0%

98%99%95%

89%73%

78%73%71%

84%77%

62%61%61%

51%66%

74%59%

48%61%

44%48%

66%52%

45%54%

40%39%35%

45%39%

32%33%34%

48%29%

17%17%

11%27%

Interactions with faculty during interview and visit

Interpersonal skills

Interactions with house staff during interview and visit

Feedback from current residents

USMLE Step 1/COMLEX Level 1 score

Letters of recommendation in the specialty

USMLE Step 2 CK/COMLEX Level 2 CE score

Medical Student Performance Evaluation (MSPE/Dean's Letter)

Perceived commitment to specialty

Evidence of professionalism and ethics

Perceived interest in program

Leadership qualities

Personal prior knowledge of the applicant

Class ranking/quartile

Graduate of U.S. allopathic medical school

Personal Statement

Audition elective/rotation within your department

Grades in required clerkships

Passing USMLE Step 2 CS/COMLEX Level 2 PE

Honors in clinical clerkships

Honors in clerkship in desired specialty

Gaps in medical education

Grades in clerkship in desired specialty

Alpha Omega Alpha (AOA) membership

Other life experience

Consistency of grades

Volunteer/extracurricular experiences

Demonstrated involvement and interest in research

Graduate of highly regarded U.S. medical school

Other post‐interview contact

Interest in academic career

Visa status*

Applicant was flagged with Match violation by the NRMP

Fluency in language spoken by your patient population

Gold Society membership

Honors in basic sciences

Second interview/visit

Away rotation in your specialty at another institution

USMLE/COMLEX Step 3 score

NRMP Program Director Survey Results, 2014 106

Page 110: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

170

180

190

200

210

220

230

240

250

260

PsychiatryPrograms That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview

Figure PSY-3

Percentage of Programs That Use USMLE Step 2 (CK) Score

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Never Seldom Often

3%

56%

41%

Would your program consider applicants who fail theexam on the first attempt?

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Never Seldom often

6%

64%

30%

Would your program consider applicants who failthe exam on the first attempt?

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

69%

30%

1%

Scores required?

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

60%

24%16%

Scores required?

N=83

N=71

N=83N=70

N=14N=17 N=14 N=12

Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews

Percentage of Programs That Use USMLE Step 1 Score

170

180

190

200

210

220

230

240

250

260

USMLE Step 2 CKUSMLE Step 1 USMLE Step 1 USMLE Step 2 CK

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.

Scores Above Which Programs Almost Always Grant Interviews

Scores Below Which Programs Generally Do Not Grant Interviews

NRMP Program Director Survey Results, 2014 107

Page 111: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

67%

31%

3%

COMLEX-USA Level 1*

N=80

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes No

80%

20%

USMLE Step 2 CS

PsychiatryPercentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview

Figure PSY-4

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

58%

24%18%

COMLEX-USA Level 2-CE*

N=63

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

30%

11%

59%

USMLE Step 3

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

33%

14%

53%

COMLEX-USA Level 3*

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

67%

10%

23%

COMLEX-USA Level 2-PE*

N=80 N=63

N=72 N=71

N=70 N=49

* Osteopathic applicants only

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores

NRMP Program Director Survey Results, 2014 108

Page 112: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100% 98%

86%89%

67%

46%

80%

63%

U.S. Senior U.S. Graduate OsteopathicPhysician

Canadian Fifth Pathway U.S. IMG Non-U.S. IMG

Percentage of Programs that Typically Interview and Rank Each Applicant Type

Figure PSY-5PsychiatryProgram's Interview Activities

0

100

200

300

400

500

600

700

800

900

1,000

Number ofpositions in the

Match

Number ofapplications

received

Number ofinterview

invitations sent

Number ofapplicantsinterviewed

Number ofapplicants

ranked

7

858

100 79 61

Average Number of Positions, Applications Received, InterviewInvitations Sent, and Applicants Interviewed and Ranked

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Percentage of applicationsrejected

Percentage of applicantsreceiving an in-depth review

61%

30%

Average Percentage of Applicants Rejected andReviewed

N=81N=77N=84* N=84*N=83N=81

N=83

40% of Psychiatry programs consider all applicant groups

* Data from the NRMP database. All Responding programs included

N=81

NRMP Program Director Survey Results, 2014 109

Page 113: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

Radiation Oncology (N=44)

NRMP Program Director Survey Results, 2014 110

Page 114: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

Figure RO-1Radiation OncologyPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview(N=43)

1 2 3 4 5

4.3

4.5

4.0

4.1

3.8

4.2

3.9

3.8

4.2

4.5

4.0

4.6

4.3

4.3

4.3

4.3

4.3

3.8

4.3

4.1

4.3

3.7

3.9

4.0

4.4

3.6

4.7

4.0

3.9

3.7

3.8

3.4

4.5

Average RatingPercent Citing Factor

¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only

100% 50% 0%

95%

100%

86%

51%

84%

65%

77%

47%

72%

67%

65%

63%

56%

72%

60%

60%

56%

60%

21%

70%

60%

58%

53%

63%

86%

21%

23%

53%

28%

14%

44%

12%

9%

USMLE Step 1/COMLEX Level 1 score

Letters of recommendation in the specialty

Medical Student Performance Evaluation (MSPE/Dean's Letter)

USMLE Step 2 CK/COMLEX Level 2 CE score

Personal Statement

Graduate of U.S. allopathic medical school

Grades in required clerkships

Gaps in medical education

Honors in clinical clerkships

Perceived commitment to specialty

Class ranking/quartile

Evidence of professionalism and ethics

Personal prior knowledge of the applicant

Audition elective/rotation within your department

Leadership qualities

Honors in clerkship in desired specialty

Grades in clerkship in desired specialty

Alpha Omega Alpha (AOA) membership

Pass USMLE Step2 CS/COMLEX Lvl2 PE

Perceived interest in program

Consistency of grades

Other life experience

Volunteer/extracurricular experiences

Graduate of highly regarded U.S. medical school

Demonstrated involvement and interest in research

Visa status*

Applicant was flagged with Match violation by the NRMP

Interest in academic career

Honors in basic sciences

Gold Society membership

Away rotation in your specialty at another institution

Fluency in language spoken by your patient population

USMLE/COMLEX Step 3 score

NRMP Program Director Survey Results, 2014 111

Page 115: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

Radiation OncologyPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants(N=43)

Figure RO-2

1 2 3 4 5

4.94.94.8

4.63.8

4.44.24.2

4.44.6

4.44.24.4

4.04.04.0

4.43.7

4.03.8

4.33.4

4.04.0

3.64.2

3.74.4

3.84.5

4.24.0

5.03.3

3.54.3

4.04.0

Average RatingPercent Citing Factor

¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only

100% 50% 0%

84%86%

70%70%

57%77%

23%45%

57%39%

61%39%

45%39%

27%45%

39%41%

2%41%

23%11%

25%18%

32%23%20%

61%30%25%

41%2%5%7%

0%14%

7%30%

2%

Interactions with faculty during interview and visit

Interpersonal skills

Interactions with house staff during interview and visit

Feedback from current residents

USMLE Step 1/COMLEX Level 1 score

Letters of recommendation in the specialty

USMLE Step 2 CK/COMLEX Level 2 CE score

Medical Student Performance Evaluation (MSPE/Dean's Letter)

Perceived commitment to specialty

Evidence of professionalism and ethics

Perceived interest in program

Leadership qualities

Personal prior knowledge of the applicant

Class ranking/quartile

Graduate of U.S. allopathic medical school

Personal Statement

Audition elective/rotation within your department

Grades in required clerkships

Passing USMLE Step 2 CS/COMLEX Level 2 PE

Honors in clinical clerkships

Honors in clerkship in desired specialty

Gaps in medical education

Grades in clerkship in desired specialty

Alpha Omega Alpha (AOA) membership

Other life experience

Consistency of grades

Volunteer/extracurricular experiences

Demonstrated involvement and interest in research

Graduate of highly regarded U.S. medical school

Other post‐interview contact

Interest in academic career

Visa status*

Applicant was flagged with Match violation by the NRMP

Fluency in language spoken by your patient population

Gold Society membership

Honors in basic sciences

Second interview/visit

Away rotation in your specialty at another institution

USMLE/COMLEX Step 3 score

NRMP Program Director Survey Results, 2014 112

Page 116: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

170

180

190

200

210

220

230

240

250

260

Radiation OncologyPrograms That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview

Figure RO-3

Percentage of Programs That Use USMLE Step 2 (CK) Score

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Never Seldom Often

44%

54%

3%

Would your program consider applicants who fail theexam on the first attempt?

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Never Seldom often

43%

54%

4%

Would your program consider applicants who failthe exam on the first attempt?

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

27%

73%

0%

Scores required?

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

23%

40% 37%

Scores required?

N=41

N=39

N=35N=28

N=10N=24 N=11 N=6

Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews

Percentage of Programs That Use USMLE Step 1 Score

170

180

190

200

210

220

230

240

250

260

USMLE Step 2 CKUSMLE Step 1 USMLE Step 1 USMLE Step 2 CK

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.

Scores Above Which Programs Almost Always Grant Interviews

Scores Below Which Programs Generally Do Not Grant Interviews

NRMP Program Director Survey Results, 2014 113

Page 117: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

20%

10%

70%

COMLEX-USA Level 1*

N=36

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes No

61%

39%

USMLE Step 2 CS

Radiation OncologyPercentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview

Figure RO-4

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

20%

10%

70%

COMLEX-USA Level 2-CE*

N=23

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

22%

4%

74%

USMLE Step 3

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

22%

0%

78%

COMLEX-USA Level 3*

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

20%

10%

70%

COMLEX-USA Level 2-PE*

N=36 N=23

N=20 N=20

N=20 N=18

* Osteopathic applicants only

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores

NRMP Program Director Survey Results, 2014 114

Page 118: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%100%

55%

45%

19%12%

19%14%

U.S. Senior U.S. Graduate OsteopathicPhysician

Canadian Fifth Pathway U.S. IMG Non-U.S. IMG

Percentage of Programs that Typically Interview and Rank Each Applicant Type

Figure RO-5Radiation OncologyProgram's Interview Activities

0

100

200

300

400

500

600

700

800

900

1,000

Number ofpositions in the

Match

Number ofapplications

received

Number ofinterview

invitations sent

Number ofapplicantsinterviewed

Number ofapplicants

ranked

2

169

32 25 22

Average Number of Positions, Applications Received, InterviewInvitations Sent, and Applicants Interviewed and Ranked

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Percentage of applicationsrejected

Percentage of applicantsreceiving an in-depth review

26%

73%

Average Percentage of Applicants Rejected andReviewed

N=43N=42N=44* N=44*N=44N=43

N=42

12% of Radiation Oncology programs consider all applicant groups

* Data from the NRMP database. All Responding programs included

N=44

NRMP Program Director Survey Results, 2014 115

Page 119: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

Radiology-Diagnostic (N=75)

NRMP Program Director Survey Results, 2014 116

Page 120: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

Figure RD-1Radiology-DiagnosticPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview(N=74)

1 2 3 4 5

4.2

3.9

4.5

3.9

3.3

4.2

4.5

4.1

4.1

3.9

4.3

4.2

4.1

3.9

3.7

4.2

4.2

3.9

4.4

4.0

4.1

3.6

3.3

3.9

3.5

4.1

4.6

3.3

3.8

3.9

3.2

3.0

3.5

Average RatingPercent Citing Factor

¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only

100% 50% 0%

99%

77%

91%

66%

74%

82%

76%

72%

81%

62%

85%

64%

64%

59%

58%

47%

50%

77%

31%

65%

64%

61%

50%

57%

47%

42%

42%

27%

41%

22%

15%

14%

18%

USMLE Step 1/COMLEX Level 1 score

Letters of recommendation in the specialty

Medical Student Performance Evaluation (MSPE/Dean's Letter)

USMLE Step 2 CK/COMLEX Level 2 CE score

Personal Statement

Graduate of U.S. allopathic medical school

Grades in required clerkships

Gaps in medical education

Honors in clinical clerkships

Perceived commitment to specialty

Class ranking/quartile

Evidence of professionalism and ethics

Personal prior knowledge of the applicant

Audition elective/rotation within your department

Leadership qualities

Honors in clerkship in desired specialty

Grades in clerkship in desired specialty

Alpha Omega Alpha (AOA) membership

Pass USMLE Step2 CS/COMLEX Lvl2 PE

Perceived interest in program

Consistency of grades

Other life experience

Volunteer/extracurricular experiences

Graduate of highly regarded U.S. medical school

Demonstrated involvement and interest in research

Visa status*

Applicant was flagged with Match violation by the NRMP

Interest in academic career

Honors in basic sciences

Gold Society membership

Away rotation in your specialty at another institution

Fluency in language spoken by your patient population

USMLE/COMLEX Step 3 score

NRMP Program Director Survey Results, 2014 117

Page 121: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

Radiology-DiagnosticPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants(N=74)

Figure RD-2

1 2 3 4 5

4.74.74.7

4.64.1

3.93.8

4.34.14.4

4.24.14.24.44.3

3.34.34.3

3.94.24.34.34.3

4.03.7

4.23.53.7

4.13.7

3.64.0

4.93.3

4.13.73.8

3.23.9

Average RatingPercent Citing Factor

¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only

100% 50% 0%

95%97%

85%82%

85%65%

53%78%

61%51%

64%57%55%

73%62%

49%50%

59%24%

50%32%

42%27%

53%50%

45%34%

39%42%38%

31%27%

22%8%19%

26%12%

8%11%

Interactions with faculty during interview and visit

Interpersonal skills

Interactions with house staff during interview and visit

Feedback from current residents

USMLE Step 1/COMLEX Level 1 score

Letters of recommendation in the specialty

USMLE Step 2 CK/COMLEX Level 2 CE score

Medical Student Performance Evaluation (MSPE/Dean's Letter)

Perceived commitment to specialty

Evidence of professionalism and ethics

Perceived interest in program

Leadership qualities

Personal prior knowledge of the applicant

Class ranking/quartile

Graduate of U.S. allopathic medical school

Personal Statement

Audition elective/rotation within your department

Grades in required clerkships

Passing USMLE Step 2 CS/COMLEX Level 2 PE

Honors in clinical clerkships

Honors in clerkship in desired specialty

Gaps in medical education

Grades in clerkship in desired specialty

Alpha Omega Alpha (AOA) membership

Other life experience

Consistency of grades

Volunteer/extracurricular experiences

Demonstrated involvement and interest in research

Graduate of highly regarded U.S. medical school

Other post‐interview contact

Interest in academic career

Visa status*

Applicant was flagged with Match violation by the NRMP

Fluency in language spoken by your patient population

Gold Society membership

Honors in basic sciences

Second interview/visit

Away rotation in your specialty at another institution

USMLE/COMLEX Step 3 score

NRMP Program Director Survey Results, 2014 118

Page 122: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

170

180

190

200

210

220

230

240

250

260

Radiology-DiagnosticPrograms That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview

Figure RD-3

Percentage of Programs That Use USMLE Step 2 (CK) Score

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Never Seldom Often

52%45%

3%

Would your program consider applicants who fail theexam on the first attempt?

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Never Seldom often

48% 50%

2%

Would your program consider applicants who failthe exam on the first attempt?

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

14%

86%

0%

Scores required?

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

20%

44%36%

Scores required?

N=71

N=62

N=66N=44

N=26N=53 N=33 N=15

Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews

Percentage of Programs That Use USMLE Step 1 Score

170

180

190

200

210

220

230

240

250

260

USMLE Step 2 CKUSMLE Step 1 USMLE Step 1 USMLE Step 2 CK

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.

Scores Above Which Programs Almost Always Grant Interviews

Scores Below Which Programs Generally Do Not Grant Interviews

NRMP Program Director Survey Results, 2014 119

Page 123: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

24%28%

48%

COMLEX-USA Level 1*

N=62

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes No

60%

40%

USMLE Step 2 CS

Radiology-DiagnosticPercentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview

Figure RD-4

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

19%15%

67%

COMLEX-USA Level 2-CE*

N=39

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

23%

8%

69%

USMLE Step 3

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

16%8%

76%

COMLEX-USA Level 3*

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

21%

11%

68%

COMLEX-USA Level 2-PE*

N=62 N=39

N=29 N=27

N=28 N=25

* Osteopathic applicants only

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores

NRMP Program Director Survey Results, 2014 120

Page 124: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100% 99%

78%

64%

45%

30%

50%

36%

U.S. Senior U.S. Graduate OsteopathicPhysician

Canadian Fifth Pathway U.S. IMG Non-U.S. IMG

Percentage of Programs that Typically Interview and Rank Each Applicant Type

Figure RD-5Radiology-DiagnosticProgram's Interview Activities

0

100

200

300

400

500

600

700

800

900

1,000

Number ofpositions in the

Match

Number ofapplications

received

Number ofinterview

invitations sent

Number ofapplicantsinterviewed

Number ofapplicants

ranked

7

426

106 84 76

Average Number of Positions, Applications Received, InterviewInvitations Sent, and Applicants Interviewed and Ranked

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Percentage of applicationsrejected

Percentage of applicantsreceiving an in-depth review

39%

56%

Average Percentage of Applicants Rejected andReviewed

N=74N=73N=75* N=75*N=73N=74

N=74

28% of Radiology-Diagnostic programs consider all applicant groups

* Data from the NRMP database. All Responding programs included

N=71

NRMP Program Director Survey Results, 2014 121

Page 125: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

Surgery (N=121)

NRMP Program Director Survey Results, 2014 122

Page 126: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

Figure GS-1SurgeryPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview(N=115)

1 2 3 4 5

4.4

4.3

3.8

4.3

3.5

4.3

3.9

4.1

4.0

4.3

4.0

4.5

4.1

4.0

4.2

4.4

4.2

3.9

4.2

3.9

3.9

3.6

3.6

3.9

3.8

3.9

4.8

3.8

3.5

3.9

3.5

3.3

3.9

Average RatingPercent Citing Factor

¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only

100% 50% 0%

97%

92%

79%

87%

72%

76%

70%

69%

78%

65%

70%

58%

62%

53%

68%

73%

69%

70%

47%

55%

39%

52%

50%

43%

47%

45%

27%

33%

21%

29%

21%

10%

10%

USMLE Step 1/COMLEX Level 1 score

Letters of recommendation in the specialty

Medical Student Performance Evaluation (MSPE/Dean's Letter)

USMLE Step 2 CK/COMLEX Level 2 CE score

Personal Statement

Graduate of U.S. allopathic medical school

Grades in required clerkships

Gaps in medical education

Honors in clinical clerkships

Perceived commitment to specialty

Class ranking/quartile

Evidence of professionalism and ethics

Personal prior knowledge of the applicant

Audition elective/rotation within your department

Leadership qualities

Honors in clerkship in desired specialty

Grades in clerkship in desired specialty

Alpha Omega Alpha (AOA) membership

Pass USMLE Step2 CS/COMLEX Lvl2 PE

Perceived interest in program

Consistency of grades

Other life experience

Volunteer/extracurricular experiences

Graduate of highly regarded U.S. medical school

Demonstrated involvement and interest in research

Visa status*

Applicant was flagged with Match violation by the NRMP

Interest in academic career

Honors in basic sciences

Gold Society membership

Away rotation in your specialty at another institution

Fluency in language spoken by your patient population

USMLE/COMLEX Step 3 score

NRMP Program Director Survey Results, 2014 123

Page 127: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

SurgeryPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants(N=115)

Figure GS-2

1 2 3 4 5

4.84.74.8

4.64.4

4.24.2

3.84.34.5

4.14.24.3

4.04.3

3.44.2

4.04.24.14.24.14.24.1

3.63.9

3.53.94.04.1

3.94.14.3

3.73.9

3.64.0

3.73.9

Average RatingPercent Citing Factor

¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only

100% 50% 0%

91%89%86%

76%82%79%78%

58%69%

53%64%59%

53%55%

62%51%48%

41%38%

46%59%

38%44%

48%42%

33%36%34%35%36%

31%24%

14%10%

18%17%

23%12%

8%

Interactions with faculty during interview and visit

Interpersonal skills

Interactions with house staff during interview and visit

Feedback from current residents

USMLE Step 1/COMLEX Level 1 score

Letters of recommendation in the specialty

USMLE Step 2 CK/COMLEX Level 2 CE score

Medical Student Performance Evaluation (MSPE/Dean's Letter)

Perceived commitment to specialty

Evidence of professionalism and ethics

Perceived interest in program

Leadership qualities

Personal prior knowledge of the applicant

Class ranking/quartile

Graduate of U.S. allopathic medical school

Personal Statement

Audition elective/rotation within your department

Grades in required clerkships

Passing USMLE Step 2 CS/COMLEX Level 2 PE

Honors in clinical clerkships

Honors in clerkship in desired specialty

Gaps in medical education

Grades in clerkship in desired specialty

Alpha Omega Alpha (AOA) membership

Other life experience

Consistency of grades

Volunteer/extracurricular experiences

Demonstrated involvement and interest in research

Graduate of highly regarded U.S. medical school

Other post‐interview contact

Interest in academic career

Visa status*

Applicant was flagged with Match violation by the NRMP

Fluency in language spoken by your patient population

Gold Society membership

Honors in basic sciences

Second interview/visit

Away rotation in your specialty at another institution

USMLE/COMLEX Step 3 score

NRMP Program Director Survey Results, 2014 124

Page 128: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

170

180

190

200

210

220

230

240

250

260

SurgeryPrograms That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview

Figure GS-3

Percentage of Programs That Use USMLE Step 2 (CK) Score

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Never Seldom Often

53%45%

2%

Would your program consider applicants who fail theexam on the first attempt?

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Never Seldom often

62%

36%

2%

Would your program consider applicants who failthe exam on the first attempt?

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

9%

91%

0%

Scores required?

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

10%

74%

16%

Scores required?

N=112

N=104

N=107N=92

N=76N=94 N=72 N=58

Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews

Percentage of Programs That Use USMLE Step 1 Score

170

180

190

200

210

220

230

240

250

260

USMLE Step 2 CKUSMLE Step 1 USMLE Step 1 USMLE Step 2 CK

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.

Scores Above Which Programs Almost Always Grant Interviews

Scores Below Which Programs Generally Do Not Grant Interviews

NRMP Program Director Survey Results, 2014 125

Page 129: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

11%

37%

52%

COMLEX-USA Level 1*

N=102

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes No

80%

20%

USMLE Step 2 CS

SurgeryPercentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview

Figure GS-4

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

13%

30%

57%

COMLEX-USA Level 2-CE*

N=62

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

10%16%

74%

USMLE Step 3

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

10% 10%

80%

COMLEX-USA Level 3*

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

26%

10%

64%

COMLEX-USA Level 2-PE*

N=102 N=62

N=54 N=53

N=50 N=40

* Osteopathic applicants only

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores

NRMP Program Director Survey Results, 2014 126

Page 130: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%100%

66%

50%

37%

23%

48%

39%

U.S. Senior U.S. Graduate OsteopathicPhysician

Canadian Fifth Pathway U.S. IMG Non-U.S. IMG

Percentage of Programs that Typically Interview and Rank Each Applicant Type

Figure GS-5SurgeryProgram's Interview Activities

0

100

200

300

400

500

600

700

800

900

1,000

Number ofpositions in the

Match

Number ofapplications

received

Number ofinterview

invitations sent

Number ofapplicantsinterviewed

Number ofapplicants

ranked

5

731

92 74 55

Average Number of Positions, Applications Received, InterviewInvitations Sent, and Applicants Interviewed and Ranked

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Percentage of applicationsrejected

Percentage of applicantsreceiving an in-depth review

62%

33%

Average Percentage of Applicants Rejected andReviewed

N=118N=115N=121* N=121*N=117N=118

N=113

19% of Surgery programs consider all applicant groups

* Data from the NRMP database. All Responding programs included

N=115

NRMP Program Director Survey Results, 2014 127

Page 131: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

Thoracic Surgery (N=12)

NRMP Program Director Survey Results, 2014 128

Page 132: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

Figure TS-1Thoracic SurgeryPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview(N=12)

1 2 3 4 5

4.1

4.7

4.0

4.0

3.6

4.3

4.1

4.0

4.0

4.0

3.5

4.6

3.4

3.6

4.3

4.6

4.4

4.0

3.6

4.0

3.8

4.0

4.5

4.2

4.0

5.0

5.0

3.7

3.7

3.5

5.0

3.5

Average RatingPercent Citing Factor

¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only

100% 50% 0%

92%

92%

83%

83%

83%

33%

83%

50%

83%

50%

33%

58%

42%

42%

50%

58%

67%

58%

42%

33%

42%

25%17%

50%

58%

42%

17%

50%

25%

0%

17%

8%

17%

USMLE Step 1/COMLEX Level 1 score

Letters of recommendation in the specialty

Medical Student Performance Evaluation (MSPE/Dean's Letter)

USMLE Step 2 CK/COMLEX Level 2 CE score

Personal Statement

Graduate of U.S. allopathic medical school

Grades in required clerkships

Gaps in medical education

Honors in clinical clerkships

Perceived commitment to specialty

Class ranking/quartile

Evidence of professionalism and ethics

Personal prior knowledge of the applicant

Audition elective/rotation within your department

Leadership qualities

Honors in clerkship in desired specialty

Grades in clerkship in desired specialty

Alpha Omega Alpha (AOA) membership

Pass USMLE Step2 CS/COMLEX Lvl2 PE

Perceived interest in program

Consistency of grades

Other life experience

Volunteer/extracurricular experiences

Graduate of highly regarded U.S. medical school

Demonstrated involvement and interest in research

Visa status*

Applicant was flagged with Match violation by the NRMP

Interest in academic career

Honors in basic sciences

Gold Society membership

Away rotation in your specialty at another institution

Fluency in language spoken by your patient population

USMLE/COMLEX Step 3 score

NRMP Program Director Survey Results, 2014 129

Page 133: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

Thoracic SurgeryPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants(N=12)

Figure TS-2

1 2 3 4 5

4.84.64.8

4.64.2

4.64.3

3.34.24.34.4

4.14.0

5.04.5

3.44.3

3.94.0

4.34.3

4.04.34.3

3.54.0

3.03.5

4.04.1

3.84.5

4.04.5

3.04.04.0

Average RatingPercent Citing Factor

¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only

100% 50% 0%

92%92%

83%83%

75%92%

67%58%

75%75%

42%67%

50%8%

33%67%

25%67%

33%67%67%

25%67%

50%33%

42%17%

67%58%58%

50%17%

25%17%

0%17%17%

8%0%

Interactions with faculty during interview and visit

Interpersonal skills

Interactions with house staff during interview and visit

Feedback from current residents

USMLE Step 1/COMLEX Level 1 score

Letters of recommendation in the specialty

USMLE Step 2 CK/COMLEX Level 2 CE score

Medical Student Performance Evaluation (MSPE/Dean's Letter)

Perceived commitment to specialty

Evidence of professionalism and ethics

Perceived interest in program

Leadership qualities

Personal prior knowledge of the applicant

Class ranking/quartile

Graduate of U.S. allopathic medical school

Personal Statement

Audition elective/rotation within your department

Grades in required clerkships

Passing USMLE Step 2 CS/COMLEX Level 2 PE

Honors in clinical clerkships

Honors in clerkship in desired specialty

Gaps in medical education

Grades in clerkship in desired specialty

Alpha Omega Alpha (AOA) membership

Other life experience

Consistency of grades

Volunteer/extracurricular experiences

Demonstrated involvement and interest in research

Graduate of highly regarded U.S. medical school

Other post‐interview contact

Interest in academic career

Visa status*

Applicant was flagged with Match violation by the NRMP

Fluency in language spoken by your patient population

Gold Society membership

Honors in basic sciences

Second interview/visit

Away rotation in your specialty at another institution

USMLE/COMLEX Step 3 score

NRMP Program Director Survey Results, 2014 130

Page 134: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

Thoracic SurgeryPrograms That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview

Figure TS-3

Percentage of Programs That Use USMLE Step 2 (CK) Score

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Never Seldom Often

33%

67%

0%

Would your program consider applicants who fail theexam on the first attempt?

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Never Seldom often

20%

80%

0%

Would your program consider applicants who failthe exam on the first attempt?

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

33%

58%

8%

Scores required?

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

42% 42%

17%

Scores required?

N=12

N=6

N=12N=5

N=5

Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews

Percentage of Programs That Use USMLE Step 1 Score

170

180

190

200

210

220

230

240

250

260

USMLE Step 1

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.

Scores Above Which Programs Almost Always Grant Interviews

Scores Below Which Programs Generally Do Not Grant Interviews

USMLE Step 2 CK not reported

because of low response rate

USMLE Step 1 not reported because of low response

rate

USMLE Step 2 CK not reported

because of low response rate

NRMP Program Director Survey Results, 2014 131

Page 135: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

29% 29%

43%

COMLEX-USA Level 1*

N=11

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes No

91%

9%

USMLE Step 2 CS

Thoracic SurgeryPercentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview

Figure TS-4

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

33%

17%

50%

COMLEX-USA Level 2-CE*

N=6

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

33%

0%

67%

USMLE Step 3

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

40%

0%

60%

COMLEX-USA Level 3*

N=11 N=6

N=7 N=6

N=4 N=5

* Osteopathic applicants only

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores

Not reported because of low response rate

NRMP Program Director Survey Results, 2014 132

Page 136: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%100%

58% 58%50%

25%

42%

25%

U.S. Senior U.S. Graduate OsteopathicPhysician

Canadian Fifth Pathway U.S. IMG Non-U.S. IMG

Percentage of Programs that Typically Interview and Rank Each Applicant Type

Figure TS-5Thoracic SurgeryProgram's Interview Activities

0

100

200

300

400

500

600

700

800

900

1,000

Number ofpositions in the

Match

Number ofapplications

received

Number ofinterview

invitations sent

Number ofapplicantsinterviewed

Number ofapplicants

ranked

1

108

33 28 23

Average Number of Positions, Applications Received, InterviewInvitations Sent, and Applicants Interviewed and Ranked

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Percentage of applicationsrejected

Percentage of applicantsreceiving an in-depth review

36%

62%

Average Percentage of Applicants Rejected andReviewed

N=12N=12N=12* N=12*N=12N=12

N=12

17% of Thoracic Surgery programs consider all applicant groups

* Data from the NRMP database. All Responding programs included

N=12

NRMP Program Director Survey Results, 2014 133

Page 137: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

Transitional Year (N=47)

NRMP Program Director Survey Results, 2014 134

Page 138: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

Figure TY-1Transitional YearPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview(N=47)

1 2 3 4 5

4.2

3.9

4.2

4.1

3.9

4.4

4.4

4.4

4.3

4.1

4.3

4.7

4.3

3.9

4.2

4.1

4.2

3.8

4.2

4.4

4.0

3.9

3.8

3.6

3.8

4.3

4.6

3.9

3.9

3.5

4.0

4.4

3.3

Average RatingPercent Citing Factor

¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only

100% 50% 0%

98%

53%

85%

89%

70%

68%

53%

68%

70%

28%

72%

66%

68%

40%

45%

28%

23%

66%

64%

74%

53%

47%

60%

36%

28%

32%

40%

17%

26%

23%

6%

15%

9%

USMLE Step 1/COMLEX Level 1 score

Letters of recommendation in the specialty

Medical Student Performance Evaluation (MSPE/Dean's Letter)

USMLE Step 2 CK/COMLEX Level 2 CE score

Personal Statement

Graduate of U.S. allopathic medical school

Grades in required clerkships

Gaps in medical education

Honors in clinical clerkships

Perceived commitment to specialty

Class ranking/quartile

Evidence of professionalism and ethics

Personal prior knowledge of the applicant

Audition elective/rotation within your department

Leadership qualities

Honors in clerkship in desired specialty

Grades in clerkship in desired specialty

Alpha Omega Alpha (AOA) membership

Pass USMLE Step2 CS/COMLEX Lvl2 PE

Perceived interest in program

Consistency of grades

Other life experience

Volunteer/extracurricular experiences

Graduate of highly regarded U.S. medical school

Demonstrated involvement and interest in research

Visa status*

Applicant was flagged with Match violation by the NRMP

Interest in academic career

Honors in basic sciences

Gold Society membership

Away rotation in your specialty at another institution

Fluency in language spoken by your patient population

USMLE/COMLEX Step 3 score

NRMP Program Director Survey Results, 2014 135

Page 139: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

Transitional YearPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants(N=47)

Figure TY-2

1 2 3 4 5

4.74.8

4.64.3

4.03.9

4.24.3

4.14.6

4.44.2

4.44.24.2

3.94.34.24.24.1

3.94.3

4.14.04.04.3

3.93.84.04.04.0

4.54.8

4.43.94.1

3.73.8

3.7

Average RatingPercent Citing Factor

¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only

100% 50% 0%

89%89%

74%83%

91%40%

79%72%

21%72%

79%53%

57%66%

60%68%

36%60%60%

64%23%

49%19%

57%45%40%

47%28%

34%45%

15%23%26%

19%15%

28%15%13%

15%

Interactions with faculty during interview and visit

Interpersonal skills

Interactions with house staff during interview and visit

Feedback from current residents

USMLE Step 1/COMLEX Level 1 score

Letters of recommendation in the specialty

USMLE Step 2 CK/COMLEX Level 2 CE score

Medical Student Performance Evaluation (MSPE/Dean's Letter)

Perceived commitment to specialty

Evidence of professionalism and ethics

Perceived interest in program

Leadership qualities

Personal prior knowledge of the applicant

Class ranking/quartile

Graduate of U.S. allopathic medical school

Personal Statement

Audition elective/rotation within your department

Grades in required clerkships

Passing USMLE Step 2 CS/COMLEX Level 2 PE

Honors in clinical clerkships

Honors in clerkship in desired specialty

Gaps in medical education

Grades in clerkship in desired specialty

Alpha Omega Alpha (AOA) membership

Other life experience

Consistency of grades

Volunteer/extracurricular experiences

Demonstrated involvement and interest in research

Graduate of highly regarded U.S. medical school

Other post‐interview contact

Interest in academic career

Visa status*

Applicant was flagged with Match violation by the NRMP

Fluency in language spoken by your patient population

Gold Society membership

Honors in basic sciences

Second interview/visit

Away rotation in your specialty at another institution

USMLE/COMLEX Step 3 score

NRMP Program Director Survey Results, 2014 136

Page 140: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

170

180

190

200

210

220

230

240

250

260

Transitional YearPrograms That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview

Figure TY-3

Percentage of Programs That Use USMLE Step 2 (CK) Score

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Never Seldom Often

28%

65%

7%

Would your program consider applicants who fail theexam on the first attempt?

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Never Seldom often

28%

69%

3%

Would your program consider applicants who failthe exam on the first attempt?

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

23%

74%

2%

Scores required?

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

32%

41%

27%

Scores required?

N=47

N=43

N=44N=36

N=16N=26 N=19 N=10

Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews

Percentage of Programs That Use USMLE Step 1 Score

170

180

190

200

210

220

230

240

250

260

USMLE Step 2 CKUSMLE Step 1 USMLE Step 1 USMLE Step 2 CK

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.

Scores Above Which Programs Almost Always Grant Interviews

Scores Below Which Programs Generally Do Not Grant Interviews

NRMP Program Director Survey Results, 2014 137

Page 141: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

33%

48%

19%

COMLEX-USA Level 1*

N=44

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes No

68%

32%

USMLE Step 2 CS

Transitional YearPercentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview

Figure TY-4

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

31% 31%38%

COMLEX-USA Level 2-CE*

N=19

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

16%

0%

84%

USMLE Step 3

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

20%

0%

80%

COMLEX-USA Level 3*

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

52%

8%

40%

COMLEX-USA Level 2-PE*

N=44 N=19

N=27 N=26

N=25 N=15

* Osteopathic applicants only

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores

NRMP Program Director Survey Results, 2014 138

Page 142: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%100%

34%

74%

30%

19%

38%

23%

U.S. Senior U.S. Graduate OsteopathicPhysician

Canadian Fifth Pathway U.S. IMG Non-U.S. IMG

Percentage of Programs that Typically Interview and Rank Each Applicant Type

Figure TY-5Transitional YearProgram's Interview Activities

0

100

200

300

400

500

600

700

800

900

1,000

Number ofpositions in the

Match

Number ofapplications

received

Number ofinterview

invitations sent

Number ofapplicantsinterviewed

Number ofapplicants

ranked

10

541

99 78 78

Average Number of Positions, Applications Received, InterviewInvitations Sent, and Applicants Interviewed and Ranked

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Percentage of applicationsrejected

Percentage of applicantsreceiving an in-depth review

55%

34%

Average Percentage of Applicants Rejected andReviewed

N=46N=45N=47* N=47*N=45N=46

N=47

17% of Transitional Year programs consider all applicant groups

* Data from the NRMP database. All Responding programs included

N=46

NRMP Program Director Survey Results, 2014 139

Page 143: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

Vascular Surgery (N=22)

NRMP Program Director Survey Results, 2014 140

Page 144: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

Figure VS-1Vascular SurgeryPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Selecting Applicants to Interview(N=20)

1 2 3 4 5

3.8

4.7

3.9

3.6

3.9

3.9

4.0

3.5

4.1

4.8

4.0

4.5

3.3

4.0

4.0

4.2

4.2

3.8

3.6

4.5

3.7

3.9

3.7

3.8

4.0

3.7

4.6

3.9

3.5

3.0

3.7

3.3

4.3

Average RatingPercent Citing Factor

¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only

100% 50% 0%

95%

100%

70%

80%

80%

55%

50%

30%

70%

80%

55%

55%

60%

45%

60%

75%

65%

65%

45%

65%

50%

40%

50%

55%

75%

45%

25%

45%

10%

10%

30%

15%

15%

USMLE Step 1/COMLEX Level 1 score

Letters of recommendation in the specialty

Medical Student Performance Evaluation (MSPE/Dean's Letter)

USMLE Step 2 CK/COMLEX Level 2 CE score

Personal Statement

Graduate of U.S. allopathic medical school

Grades in required clerkships

Gaps in medical education

Honors in clinical clerkships

Perceived commitment to specialty

Class ranking/quartile

Evidence of professionalism and ethics

Personal prior knowledge of the applicant

Audition elective/rotation within your department

Leadership qualities

Honors in clerkship in desired specialty

Grades in clerkship in desired specialty

Alpha Omega Alpha (AOA) membership

Pass USMLE Step2 CS/COMLEX Lvl2 PE

Perceived interest in program

Consistency of grades

Other life experience

Volunteer/extracurricular experiences

Graduate of highly regarded U.S. medical school

Demonstrated involvement and interest in research

Visa status*

Applicant was flagged with Match violation by the NRMP

Interest in academic career

Honors in basic sciences

Gold Society membership

Away rotation in your specialty at another institution

Fluency in language spoken by your patient population

USMLE/COMLEX Step 3 score

NRMP Program Director Survey Results, 2014 141

Page 145: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

Vascular SurgeryPercentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each Factor in Ranking Applicants(N=20)

Figure VS-2

1 2 3 4 5

4.94.74.7

4.23.9

4.73.93.8

4.74.54.6

3.93.93.8

4.33.6

4.04.1

3.73.7

4.03.0

4.14.1

3.64.2

2.83.93.9

3.64.2

3.55.0

2.53.4

3.04.04.0

Average RatingPercent Citing Factor

¹ Ratings on a scale from 1 (not at all important) to 5 (very important).* International Medical Graduates only

100% 50% 0%

95%100%

85%60%

75%95%

70%55%

60%55%

60%40%

50%50%

35%40%

30%40%

35%50%

40%10%

45%50%

40%35%

25%60%

40%40%

45%20%5%

0%10%

25%5%

15%20%

Interactions with faculty during interview and visit

Interpersonal skills

Interactions with house staff during interview and visit

Feedback from current residents

USMLE Step 1/COMLEX Level 1 score

Letters of recommendation in the specialty

USMLE Step 2 CK/COMLEX Level 2 CE score

Medical Student Performance Evaluation (MSPE/Dean's Letter)

Perceived commitment to specialty

Evidence of professionalism and ethics

Perceived interest in program

Leadership qualities

Personal prior knowledge of the applicant

Class ranking/quartile

Graduate of U.S. allopathic medical school

Personal Statement

Audition elective/rotation within your department

Grades in required clerkships

Passing USMLE Step 2 CS/COMLEX Level 2 PE

Honors in clinical clerkships

Honors in clerkship in desired specialty

Gaps in medical education

Grades in clerkship in desired specialty

Alpha Omega Alpha (AOA) membership

Other life experience

Consistency of grades

Volunteer/extracurricular experiences

Demonstrated involvement and interest in research

Graduate of highly regarded U.S. medical school

Other post‐interview contact

Interest in academic career

Visa status*

Applicant was flagged with Match violation by the NRMP

Fluency in language spoken by your patient population

Gold Society membership

Honors in basic sciences

Second interview/visit

Away rotation in your specialty at another institution

USMLE/COMLEX Step 3 score

NRMP Program Director Survey Results, 2014 142

Page 146: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

170

180

190

200

210

220

230

240

250

260

Vascular SurgeryPrograms That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview

Figure VS-3

Percentage of Programs That Use USMLE Step 2 (CK) Score

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Never Seldom Often

32%

68%

0%

Would your program consider applicants who fail theexam on the first attempt?

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Never Seldom often

33%

67%

0%

Would your program consider applicants who failthe exam on the first attempt?

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

19%

81%

0%

Scores required?

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

14%

71%

14%

Scores required?

N=21

N=19

N=21N=15

N=8N=11 N=8 N=6

Average USMLE Step 1 and Step 2 CK Scores Programs Consider When Granting Interviews

Percentage of Programs That Use USMLE Step 1 Score

170

180

190

200

210

220

230

240

250

260

USMLE Step 2 CKUSMLE Step 1 USMLE Step 1 USMLE Step 2 CK

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.

Scores Above Which Programs Almost Always Grant Interviews

Scores Below Which Programs Generally Do Not Grant Interviews

NRMP Program Director Survey Results, 2014 143

Page 147: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

23%

38% 38%

COMLEX-USA Level 1*

N=21

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes No

76%

24%

USMLE Step 2 CS

Vascular SurgeryPercentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview

Figure VS-4

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

17%

33%

50%

COMLEX-USA Level 2-CE*

N=15

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

13%

33%

53%

USMLE Step 3

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

20%

30%

50%

COMLEX-USA Level 3*

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Yes, pass only Yes, target score No

27% 27%

45%

COMLEX-USA Level 2-PE*

N=21 N=15

N=13 N=12

N=11 N=10

* Osteopathic applicants only

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores

NRMP Program Director Survey Results, 2014 144

Page 148: Results of the 2014 NRMP Program Director Survey...Introduction NRMP Program Director Survey Results, 2014 1 In March 2014, the National Resident Matching Program (NRMP) conducted

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100% 95%

71%

62%

48%43%

52%

43%

U.S. Senior U.S. Graduate OsteopathicPhysician

Canadian Fifth Pathway U.S. IMG Non-U.S. IMG

Percentage of Programs that Typically Interview and Rank Each Applicant Type

Figure VS-5Vascular SurgeryProgram's Interview Activities

0

100

200

300

400

500

600

700

800

900

1,000

Number ofpositions in the

Match

Number ofapplications

received

Number ofinterview

invitations sent

Number ofapplicantsinterviewed

Number ofapplicants

ranked

154

22 17 14

Average Number of Positions, Applications Received, InterviewInvitations Sent, and Applicants Interviewed and Ranked

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Percentage of applicationsrejected

Percentage of applicantsreceiving an in-depth review

27%

69%

Average Percentage of Applicants Rejected andReviewed

N=21N=21N=22* N=22*N=22N=21

N=21

38% of Vascular Surgery programs consider all applicant groups

* Data from the NRMP database. All Responding programs included

N=22

NRMP Program Director Survey Results, 2014 145