Advertisement

In Regard to Huang et al.

      We read with interest the recent article by Huang et al examining the impact of residency applicants’ research productivity on the Match in radiation oncology (RO). The authors showed that the number of first-author publications was associated with matching into residency programs that were ranked higher in Doximity's reputation and research output rankings. Additionally, the h-index of these applicants was associated with matching into higher ranked residency programs by research output.
      • Huang A
      • Gunther JR
      • Lin LL.
      Analyzing the Role of Research in the Radiation Oncology Match.
      The h-index is a leading measure of research productivity that has been increasingly used in decisions regarding funding and hiring.
      • Hirsch JE.
      An index to quantify an individual's scientific research output.
      ,
      • Koltun V
      • Hafner D.
      The h-index is no longer an effective correlate of scientific reputation.
      Doximity's reputation rankings are widely used by residency applicants in the United States. However, questions have emerged regarding their accuracy and transparency.
      • Peterson WJ
      • Hopson LR
      • Khandelwal S
      • et al.
      Impact of Doximity Residency Rankings on Emergency Medicine Applicant Rank Lists.
      • Feinstein MM
      • Niforatos JD
      • Mosteller L
      • Chelnick D
      • Raza S
      • Otteson T.
      Association of Doximity Ranking and Residency Program Characteristics Across 16 Specialty Training Programs.
      • Smith BB
      • Long TR
      • Tooley AA
      • Doherty JA
      • Billings HA
      • Dozois EJ.
      Impact of Doximity Residency Navigator on Graduate Medical Education Recruitment.
      To further investigate the utility of these rankings in RO, we thus aimed to assess their link to the research productivity of residents at US RO residency programs.
      We utilized the PubMed database to identify the first-author publications of RO residents who graduated between 2015 and 2019 that were published from the start of RO residency until three months after the completion of residency as previously described.
      • Rowley JP
      • Sindhu KK
      • Smith WH
      • et al.
      Radiation Oncology Resident Research Productivity in the United States: 2015 to 2019.
      ,
      • Sindhu KK
      • Rowley JP
      • Smith WH
      • et al.
      The Holman Research Pathway in Radiation Oncology: 2010 to 2019.
      We subsequently obtained the number of citations that these publications received as of October 19, 2020 from Scopus and grouped the publications to develop a first-author h-index for each residency program.

      Elsevier. Scopus API. Accessed October 15, 2020. http://www.scopus.com

      We obtained the 2019-2020 Doximity reputation rankings for US RO residency programs from Doximity's Residency Navigator.

      Doximity. Residency Navigator 2019-2020. Accessed October 19, 2020. Available at residency.doximity.com

      We then assessed for a correlation between the calculated h-index ranking of RO residency programs and their corresponding Doximity reputation ranking.
      Our results are shown in table 1. Among all US RO residency programs, the h-index ranking was correlated to the Doximity reputation ranking (r = 0.65). However, the correlation was considerably stronger among the top 20 programs by h-index (r = 0.73) than those ranked outside of the top 20 (r = 0.49).
      Table 1
      Residency ProgramH-index2020 Doximity Reputation Rank
      Memorial Sloan Kettering Cancer Center Program331
      University of Texas M D Anderson Cancer Center Program282
      University of South Florida Morsani Program2455
      Massachusetts General Hospital/Brigham and Women's Hospital/Harvard Medical School Program223
      University of Nebraska Medical Center College of Medicine Program2280
      Yale-New Haven Medical Center Program2216
      University of Pennsylvania Health System Program205
      University of Colorado Program1928
      UPMC Medical Education Program1927
      Washington University/B-JH/SLCH Consortium Program178
      Johns Hopkins University Program1610
      Temple University Hospital/Fox Chase Cancer Center Program1636
      Cleveland Clinic Foundation Program1512
      Duke University Hospital Program1511
      Emory University School of Medicine Program1522
      Stanford Health Care-Sponsored Stanford University Program154
      University of Michigan Health System Program156
      University of North Carolina Hospitals Program1521
      UCLA David Geffen School of Medicine/UCLA Medical Center Program1425
      Mayo Clinic College of Medicine and Science (Rochester) Program139
      Sidney Kimmel Medical College at Thomas Jefferson University/TJUH Program1349
      University of California (San Francisco) Program137
      University of Texas Southwestern Medical Center Program1323
      University of Virginia Medical Center Program1332
      University of Wisconsin Hospitals and Clinics Program1317
      University of California (San Diego) Medical Center Program1213
      University of Utah Health Program1143
      MedStar Health/Georgetown University Hospital Program1054
      New York University School of Medicine Program1034
      SUNY Health Science Center at Brooklyn Program1091
      Wake Forest University School of Medicine Program1052
      Jackson Memorial Hospital/Jackson Health System Program945
      Ohio State University Hospital Program942
      University of Washington Program918
      Icahn School of Medicine at Mount Sinai Program831
      New York Presbyterian Hospital (Columbia Campus) Program846
      Oregon Health & Science University Program829
      University of Alabama Medical Center Program835
      University of Maryland Program819
      Beaumont Health (Royal Oak) Program756
      New York-Presbyterian Hospital (Cornell Campus) Program762
      University of California Davis Health Program748
      University of Chicago/University of Illinois College of Medicine at Chicago Program715
      University of Florida Program714
      University of Louisville School of Medicine Program773
      University of Texas Medical Branch Hospitals Program771
      Virginia Commonwealth University Health System Program751
      Henry Ford Hospital/Wayne State University Program653
      McGaw Medical Center of Northwestern University Program633
      Rutgers Robert Wood Johnson Medical School Program638
      Tufts Medical Center Program672
      University at Buffalo Program664
      University of Iowa Hospitals and Clinics Program639
      University of Rochester Program660
      Vanderbilt University Medical Center Program640
      Allegheny Health Network Medical Education Consortium (AGH) Program574
      Baylor College of Medicine Program558
      Case Western Reserve University/University Hospitals Cleveland Medical Center Program537
      City of Hope National Medical Center Program557
      Kaiser Permanente Southern California (Los Angeles) Program566
      Loma Linda University Health Education Consortium Program589
      Medical College of Wisconsin Affiliated Hospitals Program541
      Rush University Medical Center Program563
      Texas A&M College of Medicine-Scott and White Medical Center (Temple) Program584
      University of Kansas School of Medicine Program570
      Zucker School of Medicine at Hofstra/Northwell Program524
      Indiana University School of Medicine Program475
      Montefiore Medical Center/Albert Einstein College of Medicine Program459
      University of Arizona College of Medicine-Tucson Program477
      University of California (Irvine) Program465
      University of Kentucky College of Medicine Program467
      University of Southern California/LAC+USC Medical Center Program444
      Cedars-Sinai Medical Center Program369
      Loyola University Medical Center Program330
      Mayo Clinic College of Medicine and Science (Arizona) Program320
      Mayo Clinic College of Medicine and Science (Jacksonville) Program326
      National Capital Consortium Program361
      New York-Presbyterian Brooklyn Methodist Hospital Program388
      University of Mississippi Medical Center Program385
      Detroit Medical Center/Wayne State University Program281
      Medical University of South Carolina Program247
      SUNY Upstate Medical University Program279
      University of Cincinnati Medical Center/College of Medicine Program250
      University of Minnesota Program268
      University of Tennessee College of Medicine Program282
      University of Oklahoma Health Sciences Center Program186
      University of Texas Health Science Center San Antonio Joe and Teresa Lozano Long School of Medicine Program176
      Doximity's residency reputation ranking is calculated by asking board-certified physicians to nominate up to five programs that provide the best clinical training.

      Doximity. Residency Navigator 2020 - 2021. Accessed August 10, 2020. https://residency.doximity.com/

      This methodology thus yields rankings that are inherently subjective and, by limiting nominations to five per physician, may be less suitable for stratifying less highly ranked residency programs. While the strength of a residency program is not necessarily reflected in the research output of its residents, our data hint at this possibility. Applicants to the field of RO inclined to utilize the Doximity reputation rankings should do so with caution.

      References

        • Huang A
        • Gunther JR
        • Lin LL.
        Analyzing the Role of Research in the Radiation Oncology Match.
        Advances in Radiation Oncology. 2022; (In Press)
        • Hirsch JE.
        An index to quantify an individual's scientific research output.
        Proc Natl Acad Sci U S A. 2005; 102: 16569-16572
        • Koltun V
        • Hafner D.
        The h-index is no longer an effective correlate of scientific reputation.
        PLoS One. 2021; 16e0253397
        • Peterson WJ
        • Hopson LR
        • Khandelwal S
        • et al.
        Impact of Doximity Residency Rankings on Emergency Medicine Applicant Rank Lists.
        West J Emerg Med. 2016; 17: 350-354
        • Feinstein MM
        • Niforatos JD
        • Mosteller L
        • Chelnick D
        • Raza S
        • Otteson T.
        Association of Doximity Ranking and Residency Program Characteristics Across 16 Specialty Training Programs.
        J Grad Med Educ. 2019; 11: 580-584
        • Smith BB
        • Long TR
        • Tooley AA
        • Doherty JA
        • Billings HA
        • Dozois EJ.
        Impact of Doximity Residency Navigator on Graduate Medical Education Recruitment.
        Mayo Clin Proc Innov Qual Outcomes. 2018; 2: 113-118
        • Rowley JP
        • Sindhu KK
        • Smith WH
        • et al.
        Radiation Oncology Resident Research Productivity in the United States: 2015 to 2019.
        Int J Radiat Oncol Biol Phys. 2021; 109: 1111-1118
        • Sindhu KK
        • Rowley JP
        • Smith WH
        • et al.
        The Holman Research Pathway in Radiation Oncology: 2010 to 2019.
        Int J Radiat Oncol Biol Phys. 2021; 111: 627-637
      1. Elsevier. Scopus API. Accessed October 15, 2020. http://www.scopus.com

      2. Doximity. Residency Navigator 2019-2020. Accessed October 19, 2020. Available at residency.doximity.com

      3. Doximity. Residency Navigator 2020 - 2021. Accessed August 10, 2020. https://residency.doximity.com/

      Linked Article

      • Analyzing the Role of Research in the Radiation Oncology Match
        Advances in Radiation OncologyVol. 7Issue 3
        • Preview
          Program directors consider scholarly output to be integral in matching applicants with radiation oncology residencies. However, applicants’ research productivity can be quantified in several ways, and the results can be misleading for both applicants and program directors. We conducted a bibliometric analysis to quantify the research productivity of applicants who had successfully matched to radiation oncology residencies and to test for associations between research productivity and residency program rankings.
        • Full-Text
        • PDF
        Open Access