Advertisement
Scientific Article| Volume 8, ISSUE 4, 101200, July 2023

Download started.

Ok

Assessment of Patients With Prostate Cancer and Their Understanding of the International Prostate Symptom Score Questionnaire

Open AccessPublished:February 22, 2023DOI:https://doi.org/10.1016/j.adro.2023.101200

      Abstract

      Purpose

      The International Prostate Symptom Score (IPSS) is a widely used tool for evaluating patient-reported lower urinary tract symptoms. In this study, we assessed patients with prostate cancer and their understanding of IPSS questions.

      Methods and Materials

      Consecutive patients with prostate cancer (N = 144) self-completed an online IPSS questionnaire within 1 week before their visit at our radiation oncology clinic. At the visit, a nurse reviewed each IPSS question to ensure the patient understood it and then verified the patient's answer. Preverified and nurse-verified scores were recorded and analyzed for discrepancies.

      Results

      Complete concordance between preverified and nurse-verified responses to individual IPSS questions existed for 70 men (49%). In terms of overall IPSS score, 61 men (42%) had a lower or improved IPSS after nurse verification, and 9 men (6%) had a higher or worse IPSS. Before verification, patients overstated their symptoms of frequency, intermittency, and incomplete emptying. As a result of the nurse verification, 4 of 7 patients with IPSS in the severe range (20-35) were recategorized to the moderate range (8-19). Sixteen percent of patients whose preverified IPSS were in the moderate range were recategorized after nurse verification to the mild range (0-7). Treatment option eligibility changed for 10% of patients after nurse verification.

      Conclusions

      Patients frequently misunderstand the IPSS questionnaire, leading them to respond in ways that do not accurately reflect their symptoms. Clinicians should verify patient understanding of the IPSS questions, particularly when using the score to determine eligibility for treatments.

      Introduction

      Urologic oncology clinicians often need to evaluate the degree of lower urinary tract symptoms (LUTS) in patients to select appropriate cancer treatment options, evaluate patients for clinical trial eligibility, and assess patient outcomes. For radiation oncologists, optimizing urinary symptoms before and after cancer treatment requires accurate assessment and classification of symptom severity.
      The International Prostate Symptom Score (IPSS) is widely used to assess LUTS, and it is often obtained both at baseline and at follow-up evaluations. IPSS, an adaptation of the American Urological Association Symptom Index, was validated nearly 30 years ago for the assessment of men with benign prostatic hypertrophy (BPH).
      • Barry MJ
      • Fowler Jr, FJ
      • O'Leary MP
      • et al.
      The American Urological Association symptom index for benign prostatic hyperplasia. The measurement committee of the American Urological Association.
      It has been used in many randomized clinical trials of therapies for LUTS
      • McConnell JD
      • Bruskewitz R
      • Walsh P
      • et al.
      The effect of finasteride on the risk of acute urinary retention and the need for surgical treatment among men with benign prostatic hyperplasia. Finasteride Long-Term Efficacy and Safety Study Group.
      ,
      • Lepor H
      • Williford WO
      • Barry MJ
      • et al.
      The efficacy of terazosin, finasteride, or both in benign prostatic hyperplasia. Veterans Affairs Cooperative Studies Benign Prostatic Hyperplasia Study Group.
      and is recommended by the World Health Organization.
      • Wein AJ
      • Lee DI
      Benign prostatic hyperplasia and related entities.
      Although the IPSS is a validated quality of life (QOL) assessment tool, our clinical experience suggests that many patients lack a clear understanding of the IPSS questions. For example, when asked about the sensation of incomplete bladder emptying, patients often misinterpret this to be a question about urinary frequency. Such misunderstandings can lead to inaccurate scores which do not reflect the patient's true symptoms. This is of particular importance for prostate cancer treatment selection because high IPSS is a relative contraindication for certain radiation treatments. To quantify the magnitude of this problem, we systematically investigated the accuracy of the IPSS, prospectively collecting patient responses to the questionnaire before and after a nurse explained the questions to the patients and analyzed the differences.

      Methods and Materials

      The IPSS questionnaire (Table E1) consists of 7 questions that evaluate the following: (1) sensation of incomplete emptying; (2) frequency of urinating at intervals of ≤2 hours; (3) intermittency of the urinary stream; (4) difficulty postponing urination characterized as urinary urgency; (5) weakness of urinary stream (“weak stream”); (6) the need to push or strain to urinate (“straining”); and (7) the need to awaken at night to urinate (nocturia). The overall IPSS ranges from 0 to 35, with a higher score indicating greater LUTS.
      At our institution, we request patients with prostate cancer complete the IPSS questionnaire before each radiation oncology clinic consultation and follow-up visit. The patient electronically completes the form by logging into an online platform generally within a week before the visit. For the purposes of this study, we analyzed IPSS obtained from consecutive radiation oncology clinic patients during the period from September 2020 through April 2021. To eliminate the issue of language preference, we limited our analysis to patients who indicated English as their primary language. Patients were included in the study regardless of whether they received radiation or the type of radiation therapy intervention. The responses entered electronically by the patient served as the preverified score.
      A total of 3 radiation oncology office nurses working at 2 of our outpatient clinics were trained for this project. The training consisted of instructing the nurses to speak out each question as written and speak out the patient's answer, inquiring whether the patient felt their answer was accurate. In restating the questions to the patients, the nurses were asked to emphasize those parts of the questionnaire that in clinical practice are frequently misunderstood, in particular, what is meant by a sensation of incomplete emptying (vs a frequent need to return to the toilet), and to explain more explicitly that the first 6 questions are looking for a frequency of a particular symptom rather than a symptom severity.
      The nurses recorded the verified scores for use in this study analysis. For patients seen at multiple clinic visits during the study duration, only 1 nurse-verified IPSS (the first obtained during the aforementioned dates) was included in the analysis. A patient's response was considered concordant or discordant based on whether there was agreement or disagreement between the preverified response and the subsequent nurse-verified response.
      At our institution, the IPSS is used as part of our treatment guidelines for determining patient eligibility for various radiotherapeutic interventions. For example, an IPSS less than 18 is preferred for brachytherapy, whereas an IPSS less than 20 is preferred for stereotactic body radiation therapy (SBRT). Patients with an IPSS of 15 or higher are also often recommended to consider a medication for their urinary symptoms (usually either anticholinergic or alpha blocker) to improve their function before initiating SBRT.
      • Gorovets D
      • Hopkins M
      • Goldman DA
      • et al.
      Urinary outcomes for men with high baseline International Prostate Symptom Scores treated with prostate SBRT.
      To illustrate the potential effect that misunderstanding the IPSS questions could have on clinical care, we also analyzed how the change from the preverified overall score to the nurse-verified score would affect the eligibility for treatment per these departmental guidelines, regardless of whether the patient was actually being considered for that intervention.
      We compared the preverified IPSS with the nurse-verified IPSS for each patient, looking for the prevalence of discrepant responses to individual questions as well as for discrepancies in the overall score. We analyzed the data to identify factors that might be associated with discordant IPSS responses. The Wilcoxon rank-sum test was used for continuous variables: age at questionnaire completion and prostate-specific antigen levels before survey completion. The Pearson χ2 test was used for categorical variables: Gleason grade group, tumor stage, nodal stage, metastasis stage, treatment type, and history of hormonal therapy. All analyses were conducted using the statistical software package R 4.1.0.
      This study was performed with institutional review board approval.

      Results

      Nurses verified responses of 144 consecutive patients with prostate cancer who completed the IPSS questionnaire between September 8, 2020, and April 13, 2021. One-third of these patients were assessed before having received any treatment for their prostate cancer. Forty percent had received definitive radiation therapy, and 27% had undergone prior radical prostatectomy; most of the latter had also already undergone salvage radiation. Just over half of the patients (54%) had received some form of hormonal therapy.
      Table 1 presents the characteristics of our participants stratified by whether all preverified responses were in complete concordance with their corresponding nurse-verified responses. Seventy-four patients (51%; 95% confidence interval, 43%-60%) had preverified responses with at least 1 discrepancy compared with nurse-verified responses. A discrepancy of at least 3 points was noted for 31 patients. As shown in Table 2, nurse-verified responses were more likely to be lower (ie, reflecting fewer symptoms) than preverified responses. Because preverified responses from patients without a given symptom (ie, responding “Not at all” and therefore having a score of 0) were expected to have greater concordance with nurse-verified responses, we also analyzed the responses of only those patients reporting the presence of that symptom (ie, score of at least 1). This analysis confirmed the trend for scores based on nurse-verified responses being lower or improved than those based on preverified responses.
      Table 1Patient and disease characteristics stratified by whether all preverification responses were concordant with all corresponding nurse-verified responses
      CharacteristicConcordant

      n = 70
      Discordant

      n = 74
      P value
      Age at patient response to IPSS68 (63, 74)69 (64, 73).9
      Gleason grade group.6
       11 (1.4%)2 (2.7%)
       224 (34%)33 (45%)
       323 (33%)17 (23%)
       49 (13%)7 (9.5%)
       513 (19%)15 (20%)
      PSA (pretreatment)
       Intact prostate (n = 105)7.06 (5.03, 9.16)7.66 (5.61, 13.50).2
       Postoperative (presalvage) (n = 39)0.22 (0.13, 0.52)0.21 (0.15, 0.32)>.9
      T stage.6
       T127 (39%)35 (47%)
       T218 (26%)19 (26%)
       T322 (31%)19 (26%)
       T41 (1.4%)1 (1.4%)
       TX2 (2.9%)0 (0%)
      N stage10 (14%)6 (8.1%).2
      M stage1 (1.4%)1 (1.4%)>.9
      Treatment type.3
       No RP or RT20 (29%)27 (36%)
       RT only26 (37%)32 (43%)
       RP only6 (8.6%)5 (6.8%)
       RP + RT18 (26%)10 (14%)
      History of ADT40 (57%)38 (51%).5
      Abbreviations: ADT = androgen deprivation therapy; IPSS = International Prostate Symptom Score; PSA = prostate-specific antigen level in nanograms per milliliter; RP = radical prostatectomy; RT = radiation therapy.
      Results are presented as median (quartiles) and frequency (%).
      Table 2Direction of change of nurse-verified response compared with preverification response for individual questions and for overall IPSS
      Symptom assessedN = 144Among patients with individual symptom score >0
      Incomplete emptyingn = 65
       Improved25 (17%)25 (38%)
       Worsened10 (6.9%)6 (9.2%)
      Frequencyn = 120
       Improved22 (15%)22 (18%)
       Worsened5 (3.5%)5 (4.2%)
      Intermittencyn = 59
       Improved23 (16%)23 (39%)
       Worsened6 (4.2%)4 (6.8%)
      Urgencyn = 82
       Improved17 (12%)17 (21%)
       Worsened11 (7.6%)7 (8.5%)
      Weak streamn = 73
       Improved17 (12%)17 (23%)
       Worsened5 (3.5%)4 (5.5%)
      Strainingn = 35
       Same133 (92%)24 (69%)
       Improved9 (6.2%)9 (26%)
       Worsened2 (1.4%)2 (5.7%)
      Nocturian = 129
       Improved15 (10%)15 (12%)
       Worsened6 (4.2%)6 (4.7%)
      Overall IPSS
       Same74 (51%)-
       Improved61 (42%)-
       Worsened9 (6.2%)-
      Abbreviation: IPSS = International Prostate Symptom Score.
      Results are presented as frequency (%). The right column excludes patients who responded “Not at all” to the respective questions.
      The prevalence of discordance was highest for incomplete emptying (24%), intermittency (20%), urgency (19%), and frequency (19%), whereas we observed lower discordance rates for weak stream (16%), nocturia (15%), and straining (8%). There was evidence that patients’ preverified reporting gave higher or worse responses compared with nurse-verified reporting for frequency (P = .009), intermittency (P = .004), weak stream (P = .017), incomplete emptying (P = .002), and nocturia (P = .021). For incomplete emptying, nurse-verified responses were lower for 25 men, 16 of whom had responses reduced to 0. For frequency, responses were lower for 22 men, with 12 responses reduced to 0. For intermittency, responses were lower for 23 men, with 20 responses reduced to 0. The question about urgency had the highest proportion of nurse-verified responses being higher or worse than preverified responses (7.6%). The question about straining had the lowest proportion (1.4%). In terms of overall IPSS, 42% of patients had a lower or improved score after nurse verification. Only 6.2% of patients had a higher or worse score.
      Overall IPSS scores are frequently grouped into the severity categories of mild (IPSS 0-7), moderate (IPSS 8-19), and severe (IPSS 20-35). Table 3 summarizes the effect of nurse verification on the severity grouping. Among preverified IPSS in the mild category, nurse verification did not lead to any changes in severity grouping. However, for preverified IPSS corresponding to the moderate (n = 50) or severe categories (n = 7), the probability of regrouping increased, always in the direction of lower severity.
      Table 3Severity grouping based on preverification responses versus nurse-verified responses
      Preverification responses
      Nurse-verified responsesMild (IPSS 0-7)

      n = 87
      Moderate (IPSS 8-19)

      n = 50
      Severe (IPSS 20-35)

      n = 7
      Mild (IPSS 0-7)87 (100%)8 (16%)0 (0%)
      Moderate (IPSS 8-19)0 (0%)42 (84%)4 (57%)
      Severe (IPSS 20-35)0 (0%)0 (0%)3 (43%)
      Abbreviation: IPSS = International Prostate Symptom Score.
      Figure 1 presents a scatterplot of nurse-verified IPSS against preverified IPSS and displays whether the change in score would have resulted in a change in eligibility for treatments per departmental guidelines. Among our cohort, 15 of the patients (10%; 95% confidence interval, 6%-17%) would have had a change in their eligibility status for treatment options. Nine patients would have been considered ineligible for brachytherapy based on their preverified IPSS but would have been eligible based on their nurse-verified IPSS. Similarly, 4 patients would have been converted from ineligible to eligible for SBRT based on their nurse-verified IPSS. We observed the converse—eligible patients rendered ineligible after nurse verification—less frequently: 1 patient for brachytherapy and 0 patients for SBRT. Five men whose preverified IPSS would have met the threshold to consider urinary modifying medications would not have met this threshold after nurse verification; the converse was true for just 2 patients.
      Figure 1
      Figure 1Scatter plot of overall International Prostate Symptom Score (IPSS) responses initially self-reported by patients versus nurse-verified responses. The red dots correspond to patients whose eligibility for treatment options would have changed after nurse verification. Scores were given some random variation (jitter) so that individual points can be seen.

      Discussion

      As a widely used QOL questionnaire in urologic oncology, the IPSS plays a key role in prostate cancer research and patient management. IPSS has been psychometrically validated and is known to correlate with urinary QOL. It has been classically used in the initial assessment of patients with BPH/LUTS and to follow the change in urinary function after treatment of these conditions. Its use has been extended in the radiation oncology community as a screening tool to help select treatment options depending on the degree of BPH/LUTS, and as a way of monitoring toxicity posttreatment. However, the IPSS is almost 30 years old and has not been modified in the light of contemporary understanding of patient communication.
      The findings of this study show that many patients do not understand the IPSS questions. Scores based on such misunderstandings can potentially lead to suboptimal management of urologic symptoms and can cause patients to be ineligible for certain cancer therapies or clinical trials. Approximately half of the patients surveyed changed their IPSS overall score after the nurses explained the questions to them. Of those whose scores changed after nurse verification, the vast majority had a decrease in the reported severity of symptoms. These discrepancies appeared to result largely from patients misunderstanding the intent of the questions and, thus, overstating the severity of their symptoms. This is particularly evident from the large percentage of men who changed their scores to 0 after hearing explanations of the questions regarding incomplete emptying, frequency, and intermittency. The prior literature has consistently found that clinicians underreport symptoms compared with direct patient-reported outcomes.
      • Rammant E
      • Ost P
      • Swimberghe M
      • et al.
      Patient- versus physician-reported outcomes in prostate cancer patients receiving hypofractionated radiotherapy within a randomized controlled trial.
      ,
      • Basch E
      Patient-reported outcomes–Harnessing patients' voices to improve clinical care.
      This raises the possibility that our findings might be explained by clinician underreporting. However, there are several lines of evidence against such an effect. First, prior studies compared patient-reported symptom ratings with those reported independently by clinicians, whereas we analyzed only self-reported symptoms, evaluating the effect of having a trained clinician explain the questions to the patients and verifying their understanding. This means that 2 major mechanisms for underreporting—the clinician not asking the patient about a symptom or not listening carefully to their response—do not apply. Second, differences between original and nurse-verified scores varied by symptom. Critically, the nurses were able to articulate the reasons for that variation in clear terms centering on patient understanding. For instance, the symptom with the highest discordance was incomplete emptying, and it is noted in clinical practice that patients often misunderstood that to be a question about frequency (eg, “If I have to use the bathroom a lot, it must mean that I've not been completely emptying my bladder.”). We conclude that the cause of the discordance is related to patient misunderstanding of questions rather than clinician underreporting.
      One of the findings of this study is that the probability of discordance between the preverified score and the nurse-verified score was significantly higher for those reporting severe symptoms than for those reporting mild symptoms. We hypothesize that this may be because, in our experience, some patients misunderstand the rating scale to be a subjective assessment of severity of each symptom rather than an objective question about the frequency of that symptom. It may be that such a misunderstanding has a greater effect on the degree of discordance as the symptoms worsen. This would be true if the rate of increase in subjective urinary bother caused by a given symptom is of greater magnitude than the rate of increase in the frequency of that symptom. For patients with milder symptoms, this misunderstanding may not result in much change in the score with verification because less overall severity of a given symptom likely also correlates with lower frequency of that symptom. On the other hand, patients with subjectively more irritation may be more likely to inadvertently overreport the frequency of the symptom if they misunderstand the question to be about frequency rather than severity. However, this hypothesis does not really explain why so many self-reported scores were reduced to 0, which suggests a more specific misunderstanding of the individual questions regarding incomplete emptying, frequency, and intermittency.
      How should the results of this study change clinical practice? We are certainly not advocating for the routine administration of the IPSS questionnaire by nurses as this would undermine the validity of the score, which is designed to be self-administered. However, our study underscores the necessity for clinicians to closely review the responses with any patient with an unfavorable IPSS, especially when the initial score would deem a patient ineligible for certain treatment options. While we acknowledge that a small numerical change in individual IPSS scores (ie, 1 or 2 points) may not be clinically significant, we did note that for 31 patients, a discrepancy of at least 3 points was noted. We believe that our findings illustrate the potential for patient misunderstandings to affect treatment selection, especially when relying on threshold IPSS values to guide clinical recommendations.
      A limitation of our study is that the interviews were done by different nurses. When self-reported outcome measures are acquired by interviewers, inter-interviewer reproducibility is critical.
      U.S. Department of Health and Human Services FDA Center for Drug Evaluation and Research; U.S. Department of Health and Human Services FDA Center for Biologics Evaluation and Research; U.S. Department of Health and Human Services FDA Center for Devices and Radiological Health
      Guidance for industry: Patient-reported outcome measures: Use in medical product development to support labeling claims: Draft guidance.
      It is possible that individual nurses taking part in this study may have inadvertently introduced some variability in terms of how they explained the questions to the patients. However, we feel this is unlikely to have affected the results of our study because our nurses were trained to base their explanations on the standard printed IPSS format and to merely check patient understanding while reviewing the patients’ self-recorded answers.

      Conclusion

      IPSS values are inflated in some patients due to their misunderstanding of specific questions. Clinicians should never disqualify a patient from receiving prostate cancer treatments due to a high IPSS without reviewing the IPSS questionnaire with the patient. While the IPSS is useful in screening patients for needing urinary modifiers, the questionnaire results should be similarly verified before making such adjustments to clinical care. Further research should examine the effect of our findings on the evaluation of benign disease.

      Appendix. Supplementary materials

      References

        • Barry MJ
        • Fowler Jr, FJ
        • O'Leary MP
        • et al.
        The American Urological Association symptom index for benign prostatic hyperplasia. The measurement committee of the American Urological Association.
        J Urol. 1992; 148: 1549-1557
        • McConnell JD
        • Bruskewitz R
        • Walsh P
        • et al.
        The effect of finasteride on the risk of acute urinary retention and the need for surgical treatment among men with benign prostatic hyperplasia. Finasteride Long-Term Efficacy and Safety Study Group.
        N Engl J Med. 1998; 338: 557-563
        • Lepor H
        • Williford WO
        • Barry MJ
        • et al.
        The efficacy of terazosin, finasteride, or both in benign prostatic hyperplasia. Veterans Affairs Cooperative Studies Benign Prostatic Hyperplasia Study Group.
        N Engl J Med. 1996; 335: 533-539
        • Wein AJ
        • Lee DI
        Benign prostatic hyperplasia and related entities.
        in: Hanno PM Malkowicz B Wein AJ Penn Clinical Manual of Urology. Saunders, Philadelphia, PA2007: 479-521
        • Gorovets D
        • Hopkins M
        • Goldman DA
        • et al.
        Urinary outcomes for men with high baseline International Prostate Symptom Scores treated with prostate SBRT.
        Adv Radiat Oncol. 2021; 6100582
        • Rammant E
        • Ost P
        • Swimberghe M
        • et al.
        Patient- versus physician-reported outcomes in prostate cancer patients receiving hypofractionated radiotherapy within a randomized controlled trial.
        Strahlenther Onko. 2019; 195: 393-401
        • Basch E
        Patient-reported outcomes–Harnessing patients' voices to improve clinical care.
        N Engl J Med. 2017; 376: 105-108
        • U.S. Department of Health and Human Services FDA Center for Drug Evaluation and Research; U.S. Department of Health and Human Services FDA Center for Biologics Evaluation and Research; U.S. Department of Health and Human Services FDA Center for Devices and Radiological Health
        Guidance for industry: Patient-reported outcome measures: Use in medical product development to support labeling claims: Draft guidance.
        Health Qual Life Outcomes. 2006; 4: 79