Abstract
Purpose
The Federal Aviation Administration quantifies hazardous attitudes (HA) among pilots using a scale. HA have been linked to aviation risk. We assessed the influence of HA and other factors in treatment decision making in radiation oncology (RO).
Materials/Methods
An anonymous survey was sent to 809 radiation oncologists in cities housing the top 25 cancer centers. The survey included a HA scale adapted for RO and presented nine cases assessing risk-tolerant radiotherapy (RT) prescribing habits and compliance with ASTRO's Choosing Wisely recommendations. Demographic and treatment decision data were dichotomized to identify factors associated with prescribing habits using univariable (UVA) and multivariable (MVA) logistic regression analyses.
Results
139 responses (17.1%) were received and 103 were eligible for analysis. 40% were female; ages were evenly distributed. 83% were in academics. Median scores for all attitudes (macho, anti-authority, worry, resignation, impulsivity) were below aviation thresholds for hazard and data from surgical specialties. On MVA, responders >50 years old with >5-years’ experience were 4.45 times more likely to recommend risk tolerant RT (p=0.016). Macho attitude was negatively associated with Choosing Wisely compliant treatments (Odds Ratio [OR] 0.12, p=0.001). Physicians who reported having previously retreated the supraclavicular fossa without complication were more likely to recommend retreatment in medically unfit patients if they felt the complication was avoided due to careful planning (OR 5.2, p=0.008)
Conclusion
To our knowledge this represents the first study analyzing physician attitudes in RO and their impact on self-reported treatment decisions. This work suggests that attitude may be among the factors which influence risk tolerant prescribing practices and compliance with Choosing Wisely recommendations.
INTRODUCTION
While radiation oncology (RO) is data driven and evidence based, there exists considerable variability in physician decision-making. In fact, a leading RO journal developed a regular feature showcasing nuance and variability in practice, titled “The Gray Zone.”1
Physician decision-making remains overall poorly understood, although likely influenced by many factors. The airline industry has found attitude to be a significant factor in decision making.
2 The Federal Aviation Administration (FAA) tests all pilots for Hazardous Attitudes (HA)—those contributing to poor decision making and risky behavior.
3 Five HA are recognized: anti-authority, impulsivity, invulnerability, macho, and resignation (
Table 1),
4 and they have been implicated in plane crashes.
5 In the modified short HA scale, the single attitude invulnerability is broken down into lack of worry and excess of self-confidence.
Table 1Definitions and antidotes for Hazardous Attitudes officially recognized by the Federal Aviation Administration.4
*Worry and self-confidence are attitudes not officially recognized by the Federal Aviation Administration as hazardous, although are routinely measured.
In recent years, the concept of HA has been applied to medicine among orthopedic surgeons, demonstrating association between HA expression and rates of reoperation and readmission.6-8 This work suggests that the hazardous attitude scale used to determine safe practices in pilots may have merit in medical decision making as well. As radiation oncologists make high impact decisions affecting the lives of cancer patients routinely, the factors associated with good judgment in radiation oncology would be valuable. The baseline expression of HA and their influence on physician decision making in RO is unknown. In this study, we conducted a survey analysis of radiation oncologists to assess the presence and influence of HA in treatment decision making.
METHODS AND MATERIALS
Study design and participants
We developed an anonymous survey including an adapted version of the HA Scale. The institutional Human Investigations Committee deemed this work exempt from review (XXXX). The online survey was distributed to 809 radiation oncologists registered with the American Society of Radiation Oncology (ASTRO) in the U.S. cities housing the top 25 cancer centers (U.S. News and World Report rankings) over a 2-month period via email, ending December 2017. Practicing radiation oncologists were eligible. Consent was obtained and confidentiality was maintained.
Survey development
We pilot-tested our survey with practicing radiation oncologists to assess questions for clarity and meaning. The survey included 70 close-ended, multiple-choice questions. It consisted of four major components: (1) an attitudes survey using the aviation HA Scale adapted for RO, (2) four clinical scenarios to assess willingness to prescribe risk tolerant treatments (towards organs at risk (OARs)), (3) practice scenarios based on five ASTRO Choosing Wisely9-11 recommendations, and (4) demographic data.
Originally an ipsative measurement scale, the instrument assessing HA was modified into a Likert-type scale and validated.12-16 We used an abbreviated 30-item version of the scale consisting of declarative statements adapted for RO.14 This short scale was selected to be consistent with literature examining HA in medicine that measure self-confidence and worry rather than invulnerability. Statements such as “I like to practice unusual aircraft attitudes” were converted to “I like to practice unusual treatment paradigms in radiation oncology.” Like in the aviation scale, five unique questions to assess each attitude (macho, anti-authority, worry, resignation, impulsivity, and self-confidence) were included. Threshold for concerning levels of individual HA expression was consistent with aviation survey grading.14
The survey then assessed two sets of clinical scenarios: prescribing habits and adherence to society guidelines. Four cases aimed to understand nuances in prescribing habits including risk tolerance. These four cases included: 1) RT allocation for an elderly woman with stage I breast cancer eligible for RT omission, 2) prescribing habits for an ultra-central lung tumor, 3) retreatment dose-fractionation of the supraclavicular fossa for a symptomatic breast cancer patient who received prior RT, and 4) balancing risk of RT pneumonitis with adequate PTV coverage in lung cancer. Risk tolerance for the purposes of this study was relative to the organs at risk, such that whole breast RT prescription was considered more risk tolerant than partial breast RT, and stereotactic body RT prescription was considered more risk tolerant than conventionally fractionated RT for an ultracentral lung cancer. In the first three cases, variations of patient health were presented. For the case involving retreatment of the supraclavicular fossa, an additional question (Why do you feel you did not observe a complication with retreatment?) was presented if respondents reported prior experience in retreatment of this area without complications. Respondents were asked if they thought the absence of complications was due to chance, careful planning and delivery, or short patient survival.
ASTRO's Choosing Wisely guidelines are well-known and felt to represent information that general practitioners would be aware of, even outside of their disease site specializations. Respondents were asked about their preferred treatment in patient scenarios representing targets of ASTRO's prior Choosing Wisely campaigns: management of bone metastases, low risk prostate cancer, low risk endometrial cancer, brain metastases, and the use of hypofractionated whole breast RT.10-11 Answer choices were classified as Choosing Wisely compliant or non-compliant.
Non-identifiable physician demographics and practice characteristics were also queried.
Data analysis
Descriptive statistics were used to characterize the cohort and HA expression. Demographic data, practice patterns information, and HA responses were dichotomized for univariable (UVA) and multivariable (MVA) logistic regression analyses. The attitude self-confidence was not analyzed for association as radiation oncologists—unlike surgeons and pilots—do not primarily rely on physical abilities, but rather performance of team members (dosimetry, therapy, physics) for job execution. For MVA, an interaction term including age and years since residency was created. We used UVA to identify demographic factors and HA associated with compliance with Choosing Wisely recommendations and risk tolerant (to OAR) prescriptions. Both UVA and MVA were used to identify demographic factors, practice characteristics, and HA associated with risk tolerant prescriptions. Additional UVA was performed to determine whether prior experience with a particular treatment scenario was associated with increased or decreased likelihood of risk tolerant prescribing. Statistical significance was defined as p ≤0.05. Stata SE 13.1 (Stata, College Station, TX) software was used.
RESULTS
Respondent demographics
Of the 809 surveys sent, 139 were started, yielding a response rate of 17.1%. Additionally, 12 surveys were accessed by anonymous link. Excluding responses submitted as blank (N=2), with significant missing data (N=14), or without consent (N=2), 103 surveys were eligible for analysis. There was a male predominance in responses, and ages were evenly distributed (
Table 2). Most respondents practiced in academic centers or university settings, completed residency within the prior ten years, reported an average of 11-30 patients on treatment during a typical week, and worked regularly with more than six RO colleagues.
Table 2Demographic and practice characteristics of respondents eligible for analysis (N=103). No. (%) of patients.
Hazardous Attitudes in Radiation Oncology
Median scores for all HA were below aviation thresholds for hazard (
Table 3a). Hazardous levels of macho were expressed in 15.6% of respondents and hazardous levels of worry in 12.5% (
Table 3b). Gender was not significantly associated with hazardous levels of any attitude (data not shown).
Table 3aHazardous attitudes levels among respondents.
Table 3bRates of hazardous levels of Hazardous Attitudes among radiation oncology, neurosurgery*From: Muskens IS, van der Burgt SME, Senders JT, Lamba N, Peerdeman SM, Broekman ML. Behavior and attitudes among European neurosurgeons - An international survey. J Clin Neurosci. 2018;55:5-9. doi:10.1016/j.jocn.2018.07.019
, and orthopedic surgery (Hazardous Attitude score>20).6 Factors associated with risk tolerant prescription
On UVA, age >50 (odds ratio [OR] 3.65, 95% confidence interval [CI] 1.39-9.56, p=0.008) and experience >5 years (OR 3.18, CI 1.08-9.37, p=0.036) were significantly associated with risk tolerant prescribing. On MVA, respondents >50 years old with >5 years of experience were 4.45 times more likely to recommend risk tolerant prescriptions (CI 1.32-15.0, p=0.016,
Table 4).
Table 4Univariable and multivariable logistic regression analysis for variables potentially associated with willingness to recommend risk tolerant prescriptions (radiation doses that pose greater risk to the organs at risk) in surveyed scenarios. Variables with empty spaces in multivariate column were not included in the final MVA model.
Previous experience and perceptions surrounding complication avoidance were also associated with prescribing preferences. Physicians who reported prior experience irradiating the supraclavicular fossa without complication were significantly more likely to recommend retreatment in poor health patients if they felt the complication was avoided due to careful planning and delivery rather than chance or patient death (OR 5.2, CI 1.55-17.61, p=0.008).
Compliance with Choosing Wisely Campaign
The macho attitude was negatively associated with compliance with
Choosing Wisely recommendations (OR 0.12, CI 0.03-0.40, p=0.001). There was no association with any other HA or demographic/practice characteristic (
Table 5).
Table 5Univariable logistic regression analysis for variables potentially associated with compliance with Choosing Wisely scenarios among respondents. OR = Odds Ratio. CI = Confidence Interval. RO= Radiation Oncology
DISCUSSION
The role of attitude in decision making has been well-established in the aviation industry. Given the recent application of this concept to surgical specialties,6-8 we sought to determine the influence of HA and other factors on physician decision making among radiation oncologists. Our analysis demonstrated low levels of HA among radiation oncologists. The macho attitude was associated with non-adherence to Choosing Wisely recommendations, while older age and more experience were associated with a propensity to recommend risk tolerant prescriptions. We also found that retreatment was almost five times more likely to be recommended when the physician felt that careful planning was responsible for avoidance of a complication. To our knowledge, this represents the first study examining hazardous attitudes in RO.
It is not clear why older age and more experience are significantly associated with an increased likelihood of recommending risk tolerant (to OAR) prescriptions. This difference could reflect the influence of the three-dimensional era, where more dose volume metrics are available, shifting focus on preventing complications. Alternatively, the threshold of 5 years of practice to observe this effect could indicate having practiced long enough to see recurrences, shifting priorities from avoiding complications to avoiding recurrence.
While our study is thought provoking about the role of attitude and other factors in decision-making in RO, there are limitations. First, there is potential nonresponse bias. Mean response rate for email surveys is ∼36%, with recent data exhibiting lower response rates.17,18 Among oncology surveys, RO surveys may have response rates as low as 5%.19 Our respondents also included a large number of academic physicians and might not be representative of the total population of radiation oncologists. The influence of training site, disease site specialization, local practice culture, peer influence, and era of training cannot be reliably assessed by this data but are likely to contribute to prescribing preferences. Finally, given that prescribing too much or too little RT can both be risky, it would be worthwhile to determine whether HA are correlated with prescriptions that are risk tolerant for recurrence.
CONCLUSIONS
Our study demonstrates low levels of HA in radiation oncologists compared to pilots and orthopedic surgeons. However, the macho attitude was associated with nonadherence to Choosing Wisely recommendations. Other factors, such as increasing age and experience were associated with a propensity to recommend risk tolerant (to OARs) prescriptions. To our knowledge this is the first study examining physician attitudes in the field of RO. This work lays the foundation for further efforts to identify factors associated with physician decision making in this field.
REFERENCES
1. Palma DA, Yom SS, Bennett KE, Corry J, Zietman AL. Introducing: The Red Journal Gray Zone. Int J Radiat Oncol Biol Phys. 2017;97(1):1. doi:10.1016/j.ijrobp.2016.11.052
2. Federal Aviation Administration. Glossary. In:
Aviation Instructor's Handbook (FAA—H-8083-9). 2020:G-1—G-7.
https://www.faa.gov/regulations_policies/handbooks_manuals/aviation/aviation_instructors_handbook/media/aviation_instructors_handbook.pdf. Accessed December, 8, 2020.
3. Federal Aviation Administration. Aeronotical Decision-Making. In: Pilot's Handbook of Aeronautical Knowledge (FAA-H8083-25B). 2016:2-1—2-32. Accessed August 12, 2021.
4. Federal Aviation Administration. Risk Management and Single-Pilot Resource Management. In:
Aviation Instructor's Handbook (FAA—H-8083-9). 2020:1-1—1-29.
https://www.faa.gov/regulations_policies/handbooks_manuals/aviation/aviation_instructors_handbook/media/aviation_instructors_handbook.pdf. Accessed December, 8, 2020.
5. Nuñez B, López C, Velazquez J, Mora OA, Román K. Hazardous Attitudes in US Part 121 Airline Accidents. Presentation at: 20th International Symposium on Aviation Psychology; May, 2019; Dayton, OH.
6. Bruinsma WE, Becker SJ, Guitton TG, Kadzielski J, Ring D. How prevalent are hazardous attitudes among orthopaedic surgeons?. Clin Orthop Relat Res. 2015;473(5):1582-1589. doi:10.1007/s11999-014-3966-2
7. Meunier A, Posadzy K, Tinghög G, Aspenberg P. Risk preferences and attitudes to surgery in decision making. Acta Orthop. 2017;88(5):466-471. doi:10.1080/17453674.2017.1298353
8. Kadzielski J, McCormick F, Herndon JH, Rubash H, Ring D. Surgeons' attitudes are associated with reoperation and readmission rates. Clin Orthop Relat Res. 2015;473(5):1544-1551. doi:10.1007/s11999-014-3687-6
9. Hahn C, Kavanagh B, Bhatnagar A, et al. Choosing wisely: the American Society for Radiation Oncology's top 5 list. Pract Radiat Oncol. 2014;4(6):349-355. doi:10.1016/j.prro.2014.06.003
12. Holt RW, Boehm-Davis DA, Fitzgerald KA, Matyuf MM, Baughman WA, Littman DC. Behavioral validation of a hazardous thought pattern instrument.
Proceedings of the Human Factors Society Annual Meeting. 1991;35(2):77–81.
https://doi.org/10.1518/10711819178675594013. Hunter DR; Office of Aviation Medicine, Federal Aviation Administration. Airman Research Questionnaire: Methodology and Overall Results.
https://www.faa.gov/data_research/research/med_humanfacs/oamtechreports/1990s/media/am95-27.pdf. Published October 1995. Accessed December 8, 2020.
14. Hunter DR. New Hazardous Attitudes Scale. Aviation Human Factors website.
http://www.avhf.com/html/Evaluation/GMasonHazAttitudeScale/GM2.asp. Accessed December 8, 2020.
15. Hunter DR. Measurement of hazardous attitudes among pilots.
International Journal of Aviation Psychology. 2005;15(1):23–43. doi:
10.1207/s15327108ijap1501_216. Hunter DR. Hazardous Attitudes Scale – New Version. Aviation Human Factors website.
http://www.avhf.com/html/Researcher/Haz_Attitude_New.asp. Accessed December 8, 2020.
17. Sheehan KB. E-mail Survey Response Rates: a Review. J Comput-Mediat Comm. 2001;6(2).
18. Phillips AW, Reddy S, Durning SJ. Improving response rates and evaluating nonresponse bias in surveys: AMEE Guide No. 102. Med Teach. 2016;38(3):217-28.
19. Parekh AD, Bates JE, Amdur RJ. Response Rate and Nonresponse Bias in Oncology Survey Studies. Am J Clin Oncol. 2020;43(4):229-30.
Acknowledgements
This research and the resulting manuscript did not receive any specific grant from funding agencies in the public, commercial, or not-for-profit sectors. We would like to acknowledge aviation enthusiast John Caserta, MSFS, ChFC for his contributions to this work, as well as the Yale Department of Therapeutic Radiology for donating two iWatches as raffle prizes for participation in the survey.
Article Info
Publication History
Accepted:
July 13,
2022
Received:
April 18,
2022
Publication stage
In Press Journal Pre-ProofFootnotes
Authors Responsible for Statistical Analysis: Adriana Blakaj MD, PhD ([email protected]); Jacqueline R Kelly, MD, MSc ([email protected]); Nadia A. Saeed, BA ([email protected])
Conflicts of Interest: Nadia A. Saeed: No conflicts of interest to disclose. Adriana Blakaj: No conflicts of interest to disclose. Jacqueline R Kelly: No conflicts of interest to disclose. Roy H. Decker: Grants or contracts from any entity (Merck & Co., Inc [research grants]), consulting fees (AstraZeneca [consultant]; Regeneron [consultant]), payment or honoraria for lectures, presentations, speakers bureaus, manuscript writing or educational events (AstraZeneca [speaker's bureau]; Physician Education Resource [Honoraria]; PeerView [Honoraria]), support for attending meetings and/or travel (AstraZeneca [travel expenses]; Regeneron [travel expenses]; Physician Education Resource [travel expenses]; PeerView [travel expenses]), participation on a Data Safety Monitoring Board or Advisory Board (Merck & Co., Inc [advisory board]; AstraZeneca [advisory board]; Regeneron [advisory board]; Novocure [advisory board]). Eric C. Ford: Leadership or fiduciary role in other board, society, committee or advocacy group, paid or unpaid (ASTRO, Board of Directors – unpaid). Derek W. Brown: Payment or honoraria for lectures, presentations, speakers bureaus, manuscript writing or educational events (Varian Medical Systems – honoraria for speaking engagements). Arie P. Dosoretz: Other financial or non-financial interests (Advocate Radiation Oncology, LLC – owner/manager). Suzanne B. Evans: Payment or honoraria for lectures, presentations, speakers bureaus, manuscript writing or educational events (Clarity Patient Safety Organization, $1500/year, ongoing for work in the radiation oncology health advisory committee – ongoing).
Funding Statement: This research and the resulting manuscript did not receive any specific grant from funding agencies in the public, commercial, or not-for-profit sectors. The Yale Department of Therapeutic Radiology donated two iWatches as raffle prizes for participation in the survey.
Data availability statement: Research data are not available at this time. As part of the Institutional Review Board approval, the data obtained from this survey is kept until publication, then destroyed.
Copyright
© 2022 The Authors. Published by Elsevier Inc. on behalf of American Society for Radiation Oncology.