Next Article in Journal
Acute Myocardial Infarction Mortality in the Older Population of the United States: An Analysis of Demographic and Regional Trends and Disparities from 1999 to 2022
Previous Article in Journal
The Impact of Weight Categories on the Association Between Atrial Fibrillation/Flutter and Known Risk Factors: A Nationwide Inpatient Data Analysis
Previous Article in Special Issue
Time from Final Oncologist Visit to Death and Palliative Systemic Treatment Use Near the End of Life in Heavily Pretreated Patients with Luminal Breast Cancer
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Validation of the Palliative Care and Rapid Emergency Screening (P-CaRES) Tool in Germany

1
Department of Palliative Medicine, University Hospital Essen, University of Duisburg-Essen, Hufelandstr. 55, 45147 Essen, Germany
2
Center of Emergency Medicine, University Hospital Essen, Hufelandstr. 55, 45147 Essen, Germany
3
Institute for Medical Informatics, Biometry and Epidemiology at the University Hospital Essen, Hufelandstr. 55, 45122 Essen, Germany
*
Author to whom correspondence should be addressed.
J. Clin. Med. 2025, 14(7), 2191; https://doi.org/10.3390/jcm14072191
Submission received: 19 February 2025 / Revised: 18 March 2025 / Accepted: 19 March 2025 / Published: 23 March 2025
(This article belongs to the Special Issue Clinical Management of Palliative Medicine)

Abstract

:
Background/Objectives: The “Palliative Care and Rapid Emergency Screening Tool” (P-CaRES) is used to identify patients with palliative needs in the emergency department. This study aims to translate, adapt, and validate the P-CaRES tool for the German healthcare context. Methods: This is a monocentric, non-interventional, retrospective study conducted in the emergency department of the University Hospital Essen, Germany. After a structured translation process, the tool’s face and content validity were evaluated using questionnaires completed by healthcare workers. Construct validity was established by comparing the results with the German-validated Supportive and Palliative Care Indicators Tool (SPICT). A palliative care physician blinded to the tool, independently assessed the screened patients, and made recommendations on the appropriateness of palliative care referrals. Results: Two hundred eighty-nine emergency department visits were examined. In addition, a total of 26 healthcare professionals were surveyed. 258 screenings were conducted, with P-CaRES identifying 50 positive cases (19.4%). Agreement between SPICT and P-CaRES was 88.4% (kappa: 0.67, 95% confidence interval (CI): [0.56, 0.78]), showing 64.7% sensitivity and 96.8% specificity. Expert comparison yielded 85.5% agreement (kappa: 0.54, 95% CI: [0.41, 0.68]), with 64.0% sensitivity and 90.8% specificity. Face and content validity showed strong agreement regarding the tool’s design, including its comprehensibility, applicability, ease of use, and precision, as well as its usefulness in referring patients to a specialized palliative care team. Conclusions: The study successfully validated a cultural and linguistic equivalent German version of the P-CaRES tool. Further research is necessary to assess the tool’s effectiveness in clinical practice.

1. Introduction

The benefits of an early integration of palliative care by palliative care services are far-reaching, including improvements in quality of life [1,2], mood [2], and symptom management, and [3,4] alleviating spiritual distress [5] while maintaining [1] or even prolonging [2] life expectancy. Furthermore, there is a reduction in hospital admissions [6,7], length of hospital and intensive care stays [8,9,10,11], and costs [3,12,13]. Earlier access to palliative care is associated with increased mortality rates within the home environment and greater utilization of hospice services [14,15].
Nevertheless, a significant number of patients with palliative care needs are either recognized late [16] or not at all [17], with delays often occurring between hospital admission and palliative care consultation [18]. According to the World Health Organization (WHO), only 10% of patients needing palliative care receive it [17].
Additionally, emergency department (ED) visits increase in the final months of life, with 81% of cancer patients visiting the ED in the last six months [19] and 34% in the last two weeks [7]. Of these, 72% are admitted to the hospital, with 77% of patients dying there and only 3% at home [7]. Similarly, and regarding non-cancer populations, Smith et al. [20] analyzed patients over 65 years old visiting the ED and found that approximately 75% visited the ED in the last 6 months and about 50% in the last month of life. Seventy-seven percent of these patients were admitted as inpatients, with 39% of them being admitted to an intensive care unit and 68% of all admitted patients dying while in the hospital.
There is a growing interest in objectifying the need for palliative care through prognostic indicators, patient circumstances, and clinical triggers. For instance, using an automated screening tool in the ED could help identify palliative care needs, provide a more comprehensive understanding of the prevalence of palliative patients in the ED, and highlight the disparity between resources and patient demand [21].
Several tools have been developed to assess palliative care needs in the ED, such as “SPEED” [22] and “PRIM-ER” [23], as highlighted in recent reviews [24,25]. However, there is no screening tool or algorithm for identifying possible palliative care needs in palliative patients in German-speaking countries, suitable for the time-critical ED environment. Existing tools, such as the Supportive and Palliative Care Indicators Tool (SPICT, Supplementary Figures S1 and S2) [26,27,28] or the “IPOS” [29,30] and “MIDOS” [31] questionnaires, are not entirely applicable in the ED, as SPICT is lengthy and lacks cut-off values, while IPOS and MIDOS rely on patient self-assessment, although external assessment might be more appropriate in the ED context.
To ensure accurate assessments, tools must be rigorously validated [32,33]. The P-CaRES tool (Palliative Care and Rapid Emergency Screening Tool), developed and validated by George et al. [34,35] in the USA in 2015, is a validated, simple, and straightforward screening tool designed for the ED to identify patients needing early palliative care [36] (Figure 1).
This study aims to translate, adapt, and validate the P-CaRES tool to the Germanhealthcare context (Figure 2).

2. Methods

2.1. Patients and Study Design

This is a monocentric, non-interventional, retrospective study conducted at the University Hospital Essen’s ED in Germany between 2 March and 31 March 2023. Our goal was to screen all patients presenting to the emergency department. Two hundred eighty-seven patients with acute internal or neurological problems were screened during 289 ED visits (Figure 3). Verbal informed consent was obtained before the study. Inclusion criteria were adult patients with non-infectious conditions (due to their treatment in a separate area of the emergency department). Exclusion criteria included patients with language barriers and those with less severe conditions, such as young adults with a known migraine episode, as these were treated in a separate area considered pre-ED rather than being admitted to the ED itself. Patients with impaired consciousness or severe physical or psychological symptoms were also included; however, their inclusion often resulted in incomplete data due to the inability to obtain a comprehensive medical history, assess symptoms, or obtain informed consent.
Patients were interviewed, and the P-CaRES and SPICT tools were completed simultaneously using information from routine medical interviews and data from the hospital’s computerized medical records. Patient characteristics, including age, sex, diagnosis, symptoms, treatment, status of DNR (Do Not Resuscitate)/DNI (Do Not Intubate), and the presence of advanced directives, were also collected.
Moreover, 26 healthcare workers were surveyed regarding the pre-final German version of the P-CaRES tool in order to assess content and face validity.

2.2. Linguistic and Cultural Adaptation

Linguistic and cultural adaptation of the translation was carried out in accordance with the World Health Organization (WHO) Guidelines [37]. Two bilingual translators with clinical expertise, including one certified English translator, conducted two independent forward translations, blinded to the original tool. The translations were then evaluated and merged by an expert panel, consisting of three palliative care physicians and two palliative care nurses. A backward translation was carried out by another bilingual translator with clinical expertise, also blinded to the original tool. The draft version was reviewed by the expert panel and compared with the original version. Final adjustments were made to the pre-final German version, which was subsequently tested in the ED.

3. Measures

3.1. SPICT

The Supportive and Palliative Care Indicators Tool (SPICT) is designed to identify possible palliative care needs or general health deterioration showing moderate to high sensitivity and specificity across various studies [26,27,28,38,39]. It consists of two sections: the first section gathers subjective information about the patient’s condition and possible deterioration, while the second section inquiries about underlying illnesses. The tool was originally developed at the University of Edinburgh in 2010. We used the validated German version from 2019 [26] (Supplementary Figures S1 and S2).

3.2. P-CaRES Tool

The P-CaRES tool is a short and precise two-part questionnaire designed to assess palliative care needs (Figure 1 and Figure 2). The first section assesses the presence of advanced underlying diseases. If any question is answered affirmatively, the second section is completed; otherwise, the screening is negative. The second section includes patient-specific questions, such as the “surprise question”, allowing the practitioner to make an individualized assessment. If at least two items in this section are positive, a specialized palliative care consultation is recommended. This tool has been tested in the USA [34,35,40,41], Thailand [42], and Switzerland [43]. Although it has been used in two German-speaking countries—Austria [44] and Germany [45]—the tool has not been validated in these contexts prior to these studies. The order in which the tools were used was neither predefined nor randomized.

3.3. Content and Face Validity

We assessed content and face validity using an anonymous multi-page questionnaire completed by healthcare workers in the ED. Content validity ensures the tool’s relevance, sufficiency, and clarity [46], while face validity measures whether the tool appears to cover its intended concept [47].
To assess face validity, various aspects of the tool’s design were evaluated, including comprehensibility, practicability, precision, and relevance. Respondents rated each question on a Likert scale from 1 (strongly disagree) to 5 (strongly agree), with an option to select zero points if no statement applied. The Likert scale evaluation was conducted as follows: a mean rating of ≥4 points indicated strong agreement, a rating between 2.1 and 3.9 points indicated moderate agreement, and a rating of ≤2 points indicated disagreement.
For content validity, each item was evaluated with a yes-or-no response. A cut-off for strong acceptance was set at ≥80% positive responses among all participants, while ≤50% indicated strong disagreement. Open-ended questions allowed for suggestions and feedback regarding superfluous or missing aspects. Personal data, including age, position, further training, job title, and experience were collected. Questionnaires were distributed personally in the ED and palliative care ward or sent via email.

3.4. Construct Validity

At the time of this study, no stablished German gold standard exists for measuring palliative care needs in the ED. Consequently, the German validated tool SPICT was used to assess construct validity by comparing the results of both tools, with SPICT serving as the imperfect gold standard. Both tools evaluate similar aspects. For comparison purposes, the same cut-off values were employed for both SPICT and P-CaRES. These values were created by imitating P-CaRES’s score system: one point was added in the disease-specific section and two points in the “palliative care needs” section. Sensitivity, specificity, and positive and negative predictive values were determined, as well as Cohen’s kappa and 95% confidence intervals (CI). The cut-off for high agreement was set at ≥80%.

3.5. Expert Opinion

A physician with extensive experience in specialized palliative care, blinded to the tool, independently reviewed medical data from the day of the ED visit to evaluate the necessity and appropriateness of a palliative care service consultation, comparing these results with those obtained from the P-CaRES. Sensitivity, specificity, positive predictive value, negative predictive value, as well as Cohen’s kappa and 95% CI were determined. The expert opinion served as the gold standard, with a cut-off for high agreement set at ≥80%.

3.6. Ethics

The study’s procedures involving human participants adhered to the ethical standards set by the institutional and local ethical review board of the University of Duisburg-Essen. The data analysis was approved under ethics vote number 23-11093-BO (30 March 2023).

4. Results

4.1. Cultural and Linguistic Adaptation and Translation of the Tool

The translation proceeded smoothly, with only minor semantic and conceptual differences requiring slight grammatical changes, leading to the pre-final German version tested in the ED. One suggestion was to separate the items “uncertainty about goals of care” and “caregiver distress” due to their differing meanings, but this was rejected to avoid altering the scoring system.

4.2. Recruitment of Patients in the ED

Two hundred eighty-seven patients were screened over four weeks. The mean age of the participants was 60.7 years, with a range of 19–97 years. Most common reasons for referral were “Malaise and Fatigue”, “Dyspnea”, “Abdominal Pain”, and “Chest Pain”. All patients’ characteristics are presented in Table 1. A total of 256 patients were included in the study, with 258 screenings conducted due to duplicate consultations. As screening always focuses on the patient’s current condition, which may change between consultations, a total of 289 consultations were evaluated. Two hundred fifty-six patients and 258 screenings were included in the analysis. The remaining 31 patients were excluded for various reasons, including severe cognitive impairment and intoxication, as this resulted in missing data.
Moreover, 50 patients were identified as having palliative care needs, representing 19.4% of all screened patients (Table 2).

4.3. Characteristics of Healthcare Workers

A total of 26 healthcare workers, actively engaged in the ED or palliative medicine at the time of the study, participated in the survey, with 65.4% completing the questionnaire in its entirety. The mean age of respondents was 40.7 years. Among the participants, 46.2% were nurses and 42.3% were medical doctors. As both emergency and palliative care healthcare workers were surveyed, only 19.2% had experience in both areas (Table 3).

4.4. Face Validity

The surveyed healthcare workers agreed with the tool’s design, including its comprehensibility, applicability, ease of use, precision, and relevance (Table 4). A considerable proportion of respondents strongly agreed that screening for palliative care needs represents a pivotal aspect of patient assessment in the ED, with an average rating of 4.52 points. Moreover, the desire for a palliative care consultation within 24 h was the most strongly endorsed, with an average rating of 4.56 points. In addition, participants reported non-existent use of comparable instruments in the ED, with an average rating of 1.56 points. Considering the favorable evaluations, no additional modifications were implemented in the tool.

4.5. Content Validity

All participants agreed that “advanced cancer” and “end-stage liver disease” are clear indicators for a specialized palliative care consultation (100%). Conversely, there was less consensus on three items: 68.0% supported “advanced renal failure” as an indicator, 66.7% found the “surprise question” relevant, and only 53.9% agreed with “frequent hospitalization” (Table 5).

4.6. Participants’ Suggestions for Improvement

Participants identified several potential omissions in the tool when assessing palliative care needs, such as advanced age, malnutrition, or weight loss. Certain elements, including “septic shock” and “provider discretion”, were considered possibly redundant. Feedback from healthcare workers gathered through informal interviews and comments included suggestions such as replacing “septic shock” with “shock in general” and organizing organ systems into bullet points for clarity. Opinions differed on the appropriate level of detail. Moreover, concerns were raised that goals of care often become discernible only later and not necessarily during emergencies.

4.7. Construct Validity

In the construct validity analysis, the majority of SPICT items showed a strong agreement with corresponding P-CaRES items (Supplementary Table S1). SPICT was employed as the benchmark for comparison in all subsequent calculations. Overall, an agreement was found in 88.4% of cases (Cohen’s kappa: 0.67, 95% CI: [0.56, 0.78]). In addition, the following statistical values were determined: specificity: 96.8%, sensitivity: 64.7%, positive predictive value: 88.0%, negative predictive value: 88.5% (Table 6).

4.8. Comparison with Expert’s Opinion

Overall, an agreement was found in 85.5% of cases (Cohen’s kappa: 0.54, 95% CI: [0.41, 0.68]). In addition, the following statistical values were determined: specificity: 90.8%, sensitivity: 64.0%, positive predictive value: 62.7%, negative predictive value: 91.2% (Table 7).

5. Discussion

In this study, a culturally and linguistically equivalent German version of the P-CaRES tool was validated for identifying patients with palliative care needs in the ED.
The cultural and linguistic adaptation and translation of the tool proceeded unproblematically. The face validity analysis demonstrated strong approval across all aspects (Table 4), particularly regarding the simplicity and acceptance of the tool, which is highly relevant given that the ED requires quick decision-making and rapid responses. These results align with current recommendations that advocate for the integration of palliative care into emergency medicine training [45,48,49].
These findings corroborate those obtained by Bowman et al. [34] during the original implementation of the tool. However, in contrast to our survey, 35% of respondents expressed doubts about the feasibility and applicability of the tool in their final working environment.
Content validity analysis showed a strong consensus regarding all aspects of identifying possible palliative care needs (Table 5). These results are similar to those of George et al. [35]. However, items such as “renal failure”, “septic shock”, and “provider discretion” showed slightly lower agreement levels in our study. Concerns were raised about the relevance of “renal failure” for dialysis patients by one healthcare worker and four healthcare workers considered this aspect to be superfluous, as reflected in the lower approval rate for this item. The lower agreement on “provider discretion” may relate to the separation between internal medicine and surgical emergency departments (see the Section Limitations), as respondents often lack experience with trauma patients, who are mentioned as examples in the tool. One employee noted that the urgent nature of emergencies might complicate subjective assessments, potentially affecting accuracy.
In the second part of the tool, three items were categorized as particularly relevant: “uncontrolled symptoms”, “functional decline”, and “uncertainty about treatment goals”, consistent with findings from the original study [34]. The item “uncertainty about treatment goals”, which was found to be highly relevant by participants in this study, highlights the importance of promoting conversations about care goals and shared decision-making, which in turn enhances well-being for both patients and caregivers [50]. The item “frequent hospitalizations” exhibited a moderate level of agreement (53.9%), aligning with the lowest agreement rate (66.7%) reported in the original study [34], despite studies indicating an increase of ED visits at the end of life [7,19,20]. In our study, this aspect was noted in 88.0% of patients who met the criteria for palliative management as defined by the tool. Additionally, Ouchi et al. [51] found a significant difference in hospital admissions between P-CaRES positive and negative patients (79% vs. 24%). These results emphasize the importance of including this item in the ED evaluation. The item “surprise question” received a moderate agreement (66.7%) in our study. Prior studies demonstrated its effectiveness [42,52,53,54], with Kirkland et al. [55] and Ouchi et al. [51] demonstrating that 80–85% of P-CaRES positive patients responded positively to the surprise question, compared to 25–35% of P-CaRES negative patients. Koyavatin et al. [42] investigated the efficacy of the “surprise question” in predicting mortality among ED patients, demonstrating its effectiveness in this regard at both one- and three-month intervals. In line with these studies, George et al. [34] reported 100% agreement among this aspect in their study.
Participant comments highlighted time constraints in ED settings, a concern also noted by Bowman et al. [35], where 35% of respondents felt their work environment could impede the tool’s usage. Interestingly, Ouchi et al. [51] reported an average screening time of 1.8 min, aligning with the rapid pace required in the ED.
The absence of a gold standard makes the analysis of construct validity challenging. The measurement of construct validity by comparing P-CaRES with the SPICT tool showed an overall agreement of 88.4% (Table 6). The high specificity and moderate sensitivity may be attributed to the fact that SPICT contains more detailed items related to the same aspects, potentially leading to quicker positive results compared to P-CaRES.
The expert agreed with the results in 85.5% of cases (Table 7), which is comparable to Bowman et al.’s [35] findings of 88.7% agreement using case vignettes. The tool’s high specificity of 90.8% and high negative predictive value of 91.2% further support its effectiveness in optimizing the use of palliative care service and avoiding unnecessary consultations. However, its sensitivity (64.0%) and positive predictive value (62.7%) were moderate. A low PPV (Table 7) can be attributed to multiple factors. Statistically, PPV depends on sensitivity, specificity, and the prevalence of the condition of interest. In this study, the tool’s sensitivity was moderate (64%) and the prevalence of unrecognized palliative care needs in the observed patient cohort was relatively low (19.5%), both of which contribute to a lower PPV. Additionally, while the tool effectively identifies patients with potential palliative care needs, it may not fully align with the nuanced clinical judgment of experts, leading to a higher rate of false positives. Another possible explanation is that the tool may detect patients in earlier stages of illness, when palliative care is not yet deemed necessary, resulting in over-identification. The implications of a low PPV should be carefully considered. An increased rate of false positives may lead to unnecessary healthcare utilization, including premature initiation of palliative care services. However, palliative care, when introduced appropriately, has been shown to improve quality of life and symptom management. It is also essential to weigh the risks of false negatives, as delayed initiation of palliative care remains a more frequent issue in clinical practice [16,17,18]. Further studies are needed to refine the tool’s threshold, balancing sensitivity, and specificity to optimize its clinical utility across different settings.
Finally, our study confirmed a high rate of unrecognized palliative care needs in ED patients, with 19.4% of screenings yielding positive results. These findings align with previous studies, which reported positive screening rates of 13.2% [44] and 33% [51]. Boyle et al. [56] also report a 400% increase in palliative care consultations after implementing evidence-based screening in the ED. Further research is needed to investigate the benefits of using P-CaRES as a screening tool in the ED and to explore various models for delivering palliative care in this setting.

Limitations

This study has several limitations. It was conducted in a single ED that does not treat surgical patients, limiting the generalizability of our results. The overrepresentation of hematological and oncological patients from a specialized cancer center may have introduced bias (Table 2). Additionally, the exclusion of less severe cases, unaccompanied patients with cognitive impairments, and those with language barriers may have further skewed the data. The study did not evaluate interrater reliability and lacked a gold standard for tool validation. Additionally, ED physician expertise in palliative care may have influenced patient management without the need to activate palliative care services. Finally, the order in which the tools were used was neither predefined nor randomized. While we do not expect an order effect, the lack of a predefined administration sequence could be considered a minor methodological limitation.

6. Conclusions

A culturally and linguistically equivalent German version of the P-CaRES tool was validated, demonstrating high face- and content validity as well as high construct validity. The broader implementation of this tool in the German healthcare context could significantly benefit patients with potential palliative care needs.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/jcm14072191/s1, Figure S1. SPICT tool (original English version); Figure S2. Validated German SPICT; Table S1. Comparison of the SPICT and P-CaRES tools.

Author Contributions

Conceptualization, M.R.S.C., J.S., C.K, J.R. and M.T.; methodology E.-M.H., B.K., B.M., M.R.S.C., J.S., J.R., M.B. and M.T.; formal Analysis, J.S., M.B., M.T., M.R.S.C., E.-M.H., B.K. and B.M.; resources, J.R., M.T. and C.K.; data curation, B.M., M.R.S.C., M.B., J.S. and M.B.; writing—original draft preparation, J.S. and M.R.S.C.; writing—review and editing, all authors; supervision, M.T. and M.R.S.C. All authors have read and agreed to the published version of the manuscript.

Funding

We acknowledge support by the Open Access Publication Fund of the University Duisburg-Essen.

Institutional Review Board Statement

The study’s procedures involving human participants adhered to the ethical standards set by the institutional and local ethical review board of the University of Duisburg-Essen. The data analysis was approved under ethics vote number 23-11093-BO (30 March 2023).

Informed Consent Statement

Patient consent was waived due to analyzing retrospective data evaluated from existing medical records and routine clinical questionnaires.

Data Availability Statement

The data presented in this study are available on request from the corresponding author. The data are not publicly available due to privacy and ethical considerations.

Acknowledgments

The funder had no role in the design and conduct of the study; management, collection, analysis, and interpretation of data; preparation, review, or approval of the article; and decision to submit the article for publication. We would like to thank the translators, the panel of experts, and the volunteer participants for their indispensable collaboration in this project.

Conflicts of Interest

The authors have no competing financial or non-financial interests to disclose.

References

  1. Grudzen, C.R.; Richardson, L.D.; Johnson, P.N.; Hu, M.; Wang, B.; Ortiz, J.M.; Kistler, E.A.; Chen, A.; Morrison, R.S. Emergency Department-Initiated Palliative Care in Advanced Cancer: A Randomized Clinical Trial. JAMA Oncol. 2016, 2, 591–598. [Google Scholar] [PubMed]
  2. Temel, J.S.; Greer, J.A.; Muzikansky, A.; Gallagher, E.R.; Admane, S.; Jackson, V.A.; Dahlin, C.M.; Blinderman, C.D.; Jacobsen, J.; Pirl, W.F.; et al. Early palliative care for patients with metastatic non-small-cell lung cancer. N. Engl. J. Med. 2010, 363, 733–742. [Google Scholar] [PubMed]
  3. Ciemins, E.L.; Blum, L.; Nunley, M.; Lasher, A.; Newman, J.M. The economic and clinical impact of an inpatient palliative care consultation service: A multifaceted approach. J. Palliat. Med. 2007, 10, 1347–1355. [Google Scholar] [PubMed]
  4. Delgado-Guay, M.O.; Rodriguez-Nunez, A.; Shin, S.H.; Chisholm, G.; Williams, J.; Frisbee-Hume, S.; Bruera, E. Characteristics and outcomes of patients with advanced cancer evaluated by a palliative care team at an emergency center. A retrospective study. Support. Care Cancer Off. J. Multinatl. Assoc. Support. Care Cancer 2016, 24, 2287–2295. [Google Scholar]
  5. Ursoleo, J.D.; Calì, C.; Losiggio, R.; Limone, V.; Mucci, E.; Monaco, F. Spiritual Care in Palliative Medicine and End of Life: A Bibliometric Network Analysis. J. Palliat. Med. 2025, 28, 265–279. [Google Scholar] [CrossRef]
  6. Delgado-Guay, M.O.; Kim, Y.J.; Shin, S.H.; Chisholm, G.; Williams, J.; Allo, J.; Bruera, E. Avoidable and unavoidable visits to the emergency department among patients with advanced cancer receiving outpatient palliative care. J. Pain Symptom Manag. 2015, 49, 497–504. [Google Scholar] [CrossRef]
  7. Barbera, L.; Taylor, C.; Dudgeon, D. Why do patients with cancer visit the emergency department near the end of life? CMAJ Can. Med. Assoc. J. J. Assoc. Medicale Can. 2010, 182, 563–568. [Google Scholar]
  8. Wu, F.M.; Newman, J.M.; Lasher, A.; Brody, A.A. Effects of initiating palliative care consultation in the emergency department on inpatient length of stay. J. Palliat. Med. 2013, 16, 1362–1367. [Google Scholar]
  9. Norton, S.A.; Hogan, L.A.M.; Holloway, R.G.; Temkin-Greener, H.; Buckley, M.J.M.; Quill, T.E. Proactive palliative care in the medical intensive care unit: Effects on length of stay for selected high-risk patients. Crit. Care Med. 2007, 35, 1530–1535. [Google Scholar]
  10. Penrod, J.D.; Deb, P.; Dellenbaugh, C.; Burgess, J.F.; Zhu, C.W.; Christiansen, C.L.; Luhrs, C.A.; Cortez, T.; Livote, E.; Allen, V.; et al. Hospital-based palliative care consultation: Effects on hospital cost. J. Palliat. Med. 2010, 13, 973–979. [Google Scholar]
  11. Khandelwal, N.; Kross, E.K.; Engelberg, R.A.; Coe, N.B.; Long, A.C.; Curtis, J.R. Estimating the effect of palliative care interventions and advance care planning on ICU utilization: A systematic review. Crit. Care Med. 2015, 43, 1102–1111. [Google Scholar] [CrossRef]
  12. May, P.; Garrido, M.M.; Cassel, J.B.; Kelley, A.S.; Meier, D.E.; Normand, C.; Smith, T.J.; Stefanis, L.; Morrison, R.S. Prospective Cohort Study of Hospital Palliative Care Teams for Inpatients with Advanced Cancer: Earlier Consultation Is Associated with Larger Cost-Saving Effect. J. Clin. Oncol. Off. J. Am. Soc. Clin. Oncol. 2015, 33, 2745–2752. [Google Scholar]
  13. Morrison, R.S.; Penrod, J.D.; Cassel, J.B.; Caust-Ellenbogen, M.; Litke, A.; Spragens, L.; Meier, D.E. Cost savings associated with US hospital palliative care consultation programs. Arch. Intern. Med. 2008, 168, 1783–1790. [Google Scholar] [PubMed]
  14. Wang, L.; Piet, L.; Kenworthy, C.M.; Dy, S.M. Association between palliative case management and utilization of inpatient, intensive care unit, emergency department, and hospice in Medicaid beneficiaries. Am. J. Hosp. Palliat. Care 2015, 32, 216–220. [Google Scholar] [PubMed]
  15. Brumley, R.; Enguidanos, S.; Jamison, P.; Seitz, R.; Morgenstern, N.; Saito, S.; McIlwane, J.; Hillary, K.; Gonzalez, J. Increased satisfaction with care and lower costs: Results of a randomized trial of in-home palliative care. J. Am. Geriatr. Soc. 2007, 55, 993–1000. [Google Scholar]
  16. Jordan, R.I.; Allsop, M.J.; ElMokhallalati, Y.; Jackson, C.E.; Edwards, H.L.; Chapman, E.J.; Deliens, L.; Bennett, M.I. Duration of palliative care before death in international routine practice: A systematic review and meta-analysis. BMC Med. 2020, 18, 368. [Google Scholar]
  17. Palliative Care Essential Facts. 2024. Available online: https://www.who.int/news-room/fact-sheets/detail/palliative-care (accessed on 10 June 2024).
  18. El Osta, B.; Palmer, J.L.; Paraskevopoulos, T.; Pei, B.-L.; Roberts, L.E.; Poulter, V.A.; Chacko, R.; Bruera, E. Interval between first palliative care consult and death in patients diagnosed with advanced cancer at a comprehensive cancer center. J. Palliat. Med. 2008, 11, 51–57. [Google Scholar]
  19. Obermeyer, Z.; Clarke, A.C.; Makar, M.; Schuur, J.D.; Cutler, D.M. Emergency Care Use and the Medicare Hospice Benefit for Individuals with Cancer with a Poor Prognosis. J. Am. Geriatr. Soc. 2016, 64, 323–329. [Google Scholar]
  20. Smith, A.K.; McCarthy, E.; Weber, E.; Cenzer, I.S.; Boscardin, J.; Fisher, J.; Covinsky, K. Half of older Americans seen in emergency department in last month of life; most admitted to hospital, and many die there. Health Aff. Proj. Hope 2012, 31, 1277–1285. [Google Scholar]
  21. Goldberg, E.M.; Kwan, B.; Lum, H. Identifying emergency department patients with life-limiting illnesses may be getting a little easier. J. Am. Geriatr. Soc. 2023, 71, 1694–1697. [Google Scholar]
  22. Richards, C.T.; Gisondi, M.A.; Chang, C.-H.; Courtney, D.M.; Engel, K.G.; Emanuel, L.; Quest, T. Palliative Care Symptom Assessment for Patients with Cancer in the Emergency Department: Validation of the Screen for Palliative and End-of-Life Care Needs in the Emergency Department Instrument. J. Palliat. Med. 2011, 14, 757–764. [Google Scholar] [CrossRef] [PubMed]
  23. Tan, A.; Durbin, M.; Chung, F.R.; Rubin, A.L.; Cuthel, A.M.; McQuilkin, J.A.; Modrek, A.S.; Jamin, C.; Gavin, N.; Mann, D.; et al. Design and implementation of a clinical decision support tool for primary palliative Care for Emergency Medicine (PRIM-ER). BMC Med. Inform. Decis. Mak. 2020, 20, 13. [Google Scholar]
  24. George, N.; Phillips, E.; Zaurova, M.; Song, C.; Lamba, S.; Grudzen, C. Palliative Care Screening and Assessment in the Emergency Department: A Systematic Review. J. Pain Symptom Manag. 2016, 51, 108–119.e2. [Google Scholar] [CrossRef] [PubMed]
  25. Kirkland, S.W.; Yang, E.H.; Clua, M.G.; Kruhlak, M.; Campbell, S.; Villa-Roel, C.; Rowe, B.H. Screening tools to identify patients with unmet palliative care needs in the emergency department: A systematic review. Acad. Emerg. Med. Off. J. Soc. Acad. Emerg. Med. 2022, 29, 1229–1246. [Google Scholar] [CrossRef]
  26. SPICT-DETM Germany. SPICT. 2014. Available online: https://www.spict.org.uk/the-spict/spict-de/ (accessed on 5 February 2023).
  27. The SPICTTM. SPICT. 2021. Available online: https://www.spict.org.uk/the-spict/ (accessed on 4 February 2023).
  28. Afshar, K.; Feichtner, A.; Boyd, K.; Murray, S.; Jünger, S.; Wiese, B.; Schneider, N.; Müller-Mundt, G. Systematic development and adjustment of the German version of the Supportive and Palliative Care Indicators Tool (SPICT-DE). BMC Palliat. Care 2018, 17, 27. [Google Scholar] [CrossRef]
  29. Schildmann, E.K.; Groeneveld, E.I.; Denzel, J.; Brown, A.; Bernhardt, F.; Bailey, K.; Guo, P.; Ramsenthaler, C.; Lovell, N.; Higginson, I.J.; et al. Discovering the hidden benefits of cognitive interviewing in two languages: The first phase of a validation study of the Integrated Palliative care Outcome Scale. Palliat. Med. 2016, 30, 599–610. [Google Scholar] [CrossRef]
  30. Murtagh, F.E.; Ramsenthaler, C.; Firth, A.; Groeneveld, E.I.; Lovell, N.; Simon, S.T.; Denzel, J.; Guo, P.; Bernhardt, F.; Schildmann, E.; et al. A brief, patient- and proxy-reported outcome measure in advanced illness: Validity, reliability and responsiveness of the Integrated Palliative care Outcome Scale (IPOS). Palliat. Med. 2019, 33, 1045–1057. [Google Scholar] [CrossRef] [PubMed]
  31. Stiel, S.; Matthes, M.E.; Bertram, L.; Ostgathe, C.; Elsner, F.; Radbruch, L. Validation of the new version of the minimal documentation system (MIDOS) for patients in palliative care: The German version of the edmonton symptom assessment scale (ESAS). Schmerz Berl. Ger. 2010, 24, 596–604. [Google Scholar]
  32. Polit, D.F.; Beck, C.T. Generalization in quantitative and qualitative research: Myths and strategies. Int. J. Nurs. Stud. 2010, 47, 1451–1458. [Google Scholar] [CrossRef]
  33. Streiner, D.L.; Norman, G.; Cairney, J. Health Measurement Scales: A Practical Guide To Their Development and Use; Oxford University Press Inc.: New York, NY, USA, 2015; Volume 117. [Google Scholar]
  34. George, N.; Barrett, N.; McPeake, L.; Goett, R.; Anderson, K.; Baird, J. Content Validation of a Novel Screening Tool to Identify Emergency Department Patients with Significant Palliative Care Needs. Acad. Emerg. Med. Off. J. Soc. Acad. Emerg. Med. 2015, 22, 823–837. [Google Scholar] [CrossRef]
  35. Bowman, J.; George, N.; Barrett, N.; Anderson, K.; Dove-Maguire, K.; Baird, J. Acceptability and Reliability of a Novel Palliative Care Screening Tool Among Emergency Department Providers. Acad. Emerg. Med. Off. J. Soc. Acad. Emerg. Med. 2016, 23, 694–702. [Google Scholar]
  36. Bright, L.; Zink, K.; Klein, E.; Wright, R.; Kelen, G. missed opportunity in the ED: Palliative care consult delays during inpatient admission. Am. J. Emerg. Med. 2022, 51, 325–330. [Google Scholar] [PubMed]
  37. Wild, D.; Grove, A.; Martin, M.; Eremenco, S.; McElroy, S.; Verjee-Lorenz, A.; Erikson, P.; ISPOR Task Force for Translation and Cultural Adaptation. Principles of Good Practice for the Translation and Cultural Adaptation Process for Patient-Reported Outcomes (PRO) Measures: Report of the ISPOR Task Force for Translation and Cultural Adaptation. Value Health J. Int. Soc. Pharmacoecon. Outcomes Res. 2005, 8, 94–104. [Google Scholar] [CrossRef]
  38. Bourmorck, D.; de Saint-Hubert, M.; Desmedt, M.; Piers, R.; Flament, J.; De Brauwer, I. SPICT as a predictive tool for risk of 1-year health degradation and death in older patients admitted to the emergency department: A bicentric cohort study in Belgium. BMC Palliat. Care 2023, 22, 79. [Google Scholar] [CrossRef]
  39. De Bock, R.; Van Den Noortgate, N.; Piers, R. Validation of the Supportive and Palliative Care Indicators Tool in a Geriatric Population. J. Palliat. Med. 2018, 21, 220–224. [Google Scholar] [CrossRef] [PubMed]
  40. Paske, J.R.T.; DeWitt, S.; Hicks, R.; Semmens, S.; Vaughan, L. Palliative Care and Rapid Emergency Screening Tool and the Palliative Performance Scale to Predict Survival of Older Adults Admitted to the Hospital from the Emergency Department. Am. J. Hosp. Palliat. Care 2021, 38, 800–806. [Google Scholar]
  41. Tolia, V.M.; Yourman, L.; Brennan, J.J.; Cronin, A.O.; Castillo, E.M. 182 Initial Evaluation of a Palliative Care Screening Tool in the Emergency Department. Ann. Emerg. Med. 2020, 76, S70. [Google Scholar] [CrossRef]
  42. Koyavatin, S.; Liu, S.W.; Sri-On, J. A comparison of palliative care and rapid emergency screening (P-CaRES) tool, broad and narrow criteria, and surprise questions to predict survival of older emergency department patients. BMC Palliat. Care 2023, 22, 81. [Google Scholar]
  43. Hentsch, L.; Portilho, J.; Matis, C.; Pautex, S. Early Identification in Palliative Care: Translation, Reliability and Acceptability of the French Version of the P-CaRES. In Proceedings of the 13th World Research Congress of the European Association for Palliative Care, Barcelona, Spain, 16–18 May 2024. [Google Scholar]
  44. Köstenberger, M.; Neuwersch, S.; Weixler, D.; Pipam, W.; Zink, M.; Likar, R. Prevalence of palliative care patients in emergency departments. Wien. Klin. Wochenschr. 2019, 131, 404–409. [Google Scholar] [CrossRef]
  45. Michels, G.; John, S.; Janssens, U.; Raake, P.; Schütt, K.A.; Bauersachs, J.; Barchfeld, T.; Schucher, B.; Delis, S.; Karpf-Wissel, R.; et al. Palliative aspects in clinical acute and emergency medicine as well as intensive care medicine: Consensus paper of the DGIIN, DGK, DGP, DGHO, DGfN, DGNI, DGG, DGAI, DGINA and DG Palliativmedizin. Med. Klin. Intensivmed. Notfallmedizin 2023, 118, 14–38. [Google Scholar] [CrossRef]
  46. Roebianto, A.; Savitri, I.; Sriyanto, A.S.; Syaiful, I.A.; Mubarokah, L. Content validity: Definition and procedure of content validation in psychological research. TPM—Test 2023, 30, 5–18. [Google Scholar]
  47. Wikipedia. Face Validity. 2024. Available online: https://en.wikipedia.org/wiki/Face_validity (accessed on 20 September 2024).
  48. Wiese, C.H.R.; Vagts, D.A.; Kampa, U.; Pfeiffer, G.; Grom, I.U.; Gerth, M.A.; Graf, B.M.; Zausig, Y.A. Palliativpatienten und Patienten am Lebensende in Notfallsituationen. Anaesthesist 2011, 60, 161–171. [Google Scholar] [PubMed]
  49. Ethical Issues at the End of Life. Ann. Emerg. Med. 2020, 76, e87. [CrossRef]
  50. Ursoleo, J.D.; Bottussi, A.; Epstein, A.S.; Agosta, V.T.; Monaco, F.; Rosa, W.E. Communicating about the end of life: The path of prognostic awareness. Palliat. Support. Care 2025, 23, e23. [Google Scholar] [CrossRef]
  51. Ouchi, K.; Block, S.D.; Schonberg, M.A.; Jamieson, E.S.; Aaronson, E.L.; Pallin, D.J.; Tulsky, J.A.; Schuur, J.D. Feasibility Testing of an Emergency Department Screening Tool To Identify Older Adults Appropriate for Palliative Care Consultation. J. Palliat. Med. 2017, 20, 69–73. [Google Scholar] [PubMed]
  52. Verhoef, M.-J.; de Nijs, E.J.; Fiocco, M.; Heringhaus, C.; Horeweg, N.; van der Linden, Y.M. Surprise Question and Performance Status Indicate Urgency of Palliative Care Needs in Patients with Advanced Cancer at the Emergency Department: An Observational Cohort Study. J. Palliat. Med. 2020, 23, 801–808. [Google Scholar] [CrossRef]
  53. Ouchi, K.; Jambaulikar, G.; George, N.R.; Xu, W.; Obermeyer, Z.; Aaronson, E.L.; Schuur, J.D.; Schonberg, M.A.; Tulsky, J.A.; Block, S.D. The ‘Surprise Question’ Asked of Emergency Physicians May Predict 12-Month Mortality among Older Emergency Department Patients. J. Palliat. Med. 2018, 21, 236–240. [Google Scholar]
  54. Moroni, M.; Zocchi, D.; Bolognesi, D.; Abernethy, A.; Rondelli, R.; Savorani, G.; Salera, M.; Dall’olio, F.G.; Galli, G.; Biasco, G.; et al. The ‘surprise’ question in advanced cancer patients: A prospective study among general practitioners. Palliat. Med. 2014, 28, 959–964. [Google Scholar] [CrossRef]
  55. Kirkland, S.W.; Clua, M.G.; Kruhlak, M.; Villa-Roel, C.; Couperthwaite, S.; Yang, E.H.; Elwi, A.; O’neill, B.; Duggan, S.; Brisebois, A.; et al. Comparison of characteristics and management of emergency department presentations between patients with met and unmet palliative care needs. PLoS ONE 2021, 16, e0257501. [Google Scholar] [CrossRef]
  56. Integrating Palliative Care in the Emergency Department | Palliative in Practice. 2019. Available online: https://www.capc.org/blog/palliative-pulse-the-palliative-pulse-december-2018-integrating-palliative-care-in-the-emergency-department-a-paradigm-shift/ (accessed on 5 February 2023).
Figure 1. Original version of the P-CaRES tool.
Figure 1. Original version of the P-CaRES tool.
Jcm 14 02191 g001
Figure 2. German translated and validated version of the P-CaRES tool.
Figure 2. German translated and validated version of the P-CaRES tool.
Jcm 14 02191 g002
Figure 3. Flow chart of the methods used in the study.
Figure 3. Flow chart of the methods used in the study.
Jcm 14 02191 g003
Table 1. Patient characteristics. Characteristics of the 258 patients from the emergency department who were screened. The absolute number of patients and the percentage of the total population for each aspect are presented.
Table 1. Patient characteristics. Characteristics of the 258 patients from the emergency department who were screened. The absolute number of patients and the percentage of the total population for each aspect are presented.
VariablePatients/ED-Consultations (258 in Total)
n%
Age
≤6011444.2
>6014455.8
Gender
male13552.3
female12347.7
Existence of a living will
yes7529.1
no18370.9
DNR/DNI status
yes176.6
no24193.4
Reasons for referral (most common)
Malaise and Fatigue5922.9
Dyspnea3112.0
Abdominal Pain2911.2
Chest Pain2710.5
Neurological Disease207.8
Hypertension103.9
No Diagnosis Given103.9
Dizziness and Staggering93.5
Syncope/Collapse83.1
Palpitations72.7
Convulsions72.7
Symptoms of the Urinary Tract System72.7
DNR: “do not resuscitate”, DNI: “do not intubate”.
Table 2. Overview of the completed P-CaRES items. A total of 258 emergency department patients were screened using the P-CaRES tool. A palliative care consultation is recommended if at least one positive aspect is identified in the first section and two positive aspects in the second section. If positive aspects are found in the first section, the screening process concludes and the second section is not completed.
Table 2. Overview of the completed P-CaRES items. A total of 258 emergency department patients were screened using the P-CaRES tool. A palliative care consultation is recommended if at least one positive aspect is identified in the first section and two positive aspects in the second section. If positive aspects are found in the first section, the screening process concludes and the second section is not completed.
Item FulfilledNumber
of Patients
Percentage of
All Patients
(Total: 258)
Percentage of Patients
with Minimum One Cross
in the First Part (Total: 68)
Percentage of
Positive Patients
(Total: 50)
First part of the P-CaRES:
CNS Disease/Advanced Dementia135.0% 26.0%
Advanced Cancer3312.8% 66.0%
End Stage Renal Disease10.4% 2.0%
Advanced COPD93.5% 18.0%
Advanced Heart Failure83.1% 16.0%
End Stage Liver Disease20.8% 4.0%
Septic Shock00.0% 0.0%
Provider Discretion41.6% 8.0%
Second part of the
P-CaRES:
Frequent Visits4417.1%64.7%88.0%
Uncontrolled Symptoms4015.5%58.8%80.0%
Functional Decline3413.2%50%68.0%
Uncertainly about Goals of Care00.0%0.0%0.0%
Caregiver Distress20.8%2.9%4.0%
Surprise Question238.9%33.8%46.0%
CNS: central nervous system, COPD: chronic obstructive pulmonary disease.
Table 3. Characteristics of interviewed healthcare workers. Twenty-six healthcare workers from various professional groups, either employed in the local emergency department or in palliative care, were interviewed.
Table 3. Characteristics of interviewed healthcare workers. Twenty-six healthcare workers from various professional groups, either employed in the local emergency department or in palliative care, were interviewed.
RoleAbsolute Number and Percentage of All ParticipantsAge in Years
(M)
Experience in PM (%)Experience in the ED (Months)
Nurse12 (46.2%)43.558.359.0
Medical Doctor11 (42.3%)42.481.888.9
Student2 (7.7%)22.50.015.0
Physician
Assistant
1 (3.8%)24.00.020.0
Total26-53.857.7
PM: palliative medicine, ED: emergency department, M: mean value of all participants.
Table 4. Face validity assessed by healthcare workers. The face validity was assessed using a five-point Likert scale, where a score of one indicated strong disagreement, five points indicated strong agreement, and 0 indicated abstention from expressing an opinion. Mean scores for each statement on the five-point Likert scale, along with the absolute number of responses, are presented in the table.
Table 4. Face validity assessed by healthcare workers. The face validity was assessed using a five-point Likert scale, where a score of one indicated strong disagreement, five points indicated strong agreement, and 0 indicated abstention from expressing an opinion. Mean scores for each statement on the five-point Likert scale, along with the absolute number of responses, are presented in the table.
Likert-Scale-Punctuation
QuestionsM (SD)123450
The structure of the tool is coherent4.42 (0.95)1027160
The points are clearly stated4.46 (0.86)0135170
The points are precisely formulated4.04 (1.04)0348110
The tool is clearly structured4.35 (1.06)0324170
I consider the tool to be relevant for identifying life-limiting
conditions
4.29 (1.08)1126141
The tool does not capture the most important factors in
identifying the need for PCS
1.91 (1.31)1270223
Screening for PCN is an important part of the assessment of
a patient with advanced disease
4.52 (0.92)1016171
Patients benefit from using the tool4.29 (0.96)0144125
I already use a similar tool1.56 (1.15)12120110
The tool can be used independently by the ED staff4.22 (1.13) 1135133
I think the tool is feasible to use4.04 (1.11)1239110
The tool is useful in my daily work4.06 (1.09)103679
I would use the tool in my daily work4.33 (1.24)1212155
I am in favor of introducing the tool in our ED4.22 (1.09)1127122
If a validated screening tool indicates PCN for my patient, I would like a PCS consultation within 24 h4.56 (1.00)1104191
Scoring system: 1 point: disagreement, 5 points: agreement, 0 points: no statement given. M: mean value of all participants, SD: Standard deviation, PCS: palliative care service, PCN: palliative care needs, ED: emergency department.
Table 5. Content validity assessed by healthcare workers. Participants who independently evaluated the relevance of each item in the P-CaRES tool assessed content validity. Each item was rated with a yes-or-no response. A cut-off of 80% indicated strong acceptance, while a cut-off of 50% indicated strong disagreement.
Table 5. Content validity assessed by healthcare workers. Participants who independently evaluated the relevance of each item in the P-CaRES tool assessed content validity. Each item was rated with a yes-or-no response. A cut-off of 80% indicated strong acceptance, while a cut-off of 50% indicated strong disagreement.
Items of P-CaRESAgreement M (%)
CNS Disease/Advanced Dementia96.2
Advanced Cancer100
End Stage Renal Disease68.0
Advanced COPD95.8
Advanced Heart Failure96.0
End Stage Liver Disease100
Septic Shock84.0
Provider Discretion77.3
Frequent Visits53.9
Uncontrolled Symptoms80.8
Functional Decline92.0
Uncertainly about Goals of Care/Caregiver Distress80.8
Surprise Question 66.7
M: mean value of all participants, CNS: central nervous system, COPD: chronic obstructive pulmonary disease.
Table 6. Construct validity of the P-CaRES tool. The construct validity was determined by comparing the results of the P-CaRES with those of the SPICT tool, including both absolute numbers and percentage of all screened patients.
Table 6. Construct validity of the P-CaRES tool. The construct validity was determined by comparing the results of the P-CaRES with those of the SPICT tool, including both absolute numbers and percentage of all screened patients.
SPICT Result
NegativePositiveTotal
P-CaRES resultNegative184 (71.3%)24 (9.3%)208 (80.6%)NPV: 88.5%
Positive6 (2.3%)44 (17.1%)50 (19.4%)PPV: 88.0%
total190 (73.6%)68 (26.4%)258 (100%)
SP: 96.8% SN: 64.7%
Screening negative: no unmet palliative care needs. Screening positive: possible unmet palliative care needs. SP: specificity, SN: sensitivity, NPV: negative predictive value, PPV: positive predictive value.
Table 7. Comparison with the expert’s opinion. The results of the P-CaRES tool were compared with the opinions of an independent expert. The absolute numbers and percentage of all screened patients are presented in the table.
Table 7. Comparison with the expert’s opinion. The results of the P-CaRES tool were compared with the opinions of an independent expert. The absolute numbers and percentage of all screened patients are presented in the table.
P-CaRES Results
NegativePositiveTotal
Expert´s opinionnegative187 (73.0%)19 (7.4%)206 (80.5%)NPV: 91.2%
positive18 (7.0%)32 (12.5%)50 (19.5%)PPV: 62.7%
total205 (80.1%)51 (19.9%)256 (100%)
SP: 90.8%SN: 64.0%
Screening negative: no unmet palliative care needs. Screening positive: possible unmet palliative care needs. SP: specificity, SN: sensitivity, NPV: negative predictive value, PPV: positive predictive value.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Schmitz, J.; Tewes, M.; Mathew, B.; Bubel, M.; Kill, C.; Risse, J.; Huessler, E.-M.; Kowall, B.; Salvador Comino, M.R. Validation of the Palliative Care and Rapid Emergency Screening (P-CaRES) Tool in Germany. J. Clin. Med. 2025, 14, 2191. https://doi.org/10.3390/jcm14072191

AMA Style

Schmitz J, Tewes M, Mathew B, Bubel M, Kill C, Risse J, Huessler E-M, Kowall B, Salvador Comino MR. Validation of the Palliative Care and Rapid Emergency Screening (P-CaRES) Tool in Germany. Journal of Clinical Medicine. 2025; 14(7):2191. https://doi.org/10.3390/jcm14072191

Chicago/Turabian Style

Schmitz, Julia, Mitra Tewes, Baicy Mathew, Marie Bubel, Clemens Kill, Joachim Risse, Eva-Maria Huessler, Bernd Kowall, and Maria Rosa Salvador Comino. 2025. "Validation of the Palliative Care and Rapid Emergency Screening (P-CaRES) Tool in Germany" Journal of Clinical Medicine 14, no. 7: 2191. https://doi.org/10.3390/jcm14072191

APA Style

Schmitz, J., Tewes, M., Mathew, B., Bubel, M., Kill, C., Risse, J., Huessler, E.-M., Kowall, B., & Salvador Comino, M. R. (2025). Validation of the Palliative Care and Rapid Emergency Screening (P-CaRES) Tool in Germany. Journal of Clinical Medicine, 14(7), 2191. https://doi.org/10.3390/jcm14072191

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop