Next Article in Journal
Health Behavior Changes during the COVID-19 Pandemic: A Longitudinal Analysis among Children
Previous Article in Journal
Hearing Problems in Indonesia: Attention to Hypertensive Adults
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Profiling Police Forces against Stress: Risk and Protective Factors for Post-Traumatic Stress Disorder and Burnout in Police Officers

by
Royce Anders
1,2,*,
Lauriane Willemin-Petignat
3,*,
Cornelia Rolli Salathé
3,4,
Andrea C. Samson
3,5 and
Benjamin Putois
3,6
1
EPSYLON Laboratory, Department of Psychology, University Paul Valéry Montpellier 3, F34000 Montpellier, France
2
EMC Laboratory, Institute of Psychology, University of Lyon 2, F69500 Bron, France
3
Faculty of Psychology, Unidistance Suisse, 3900 Brig, Switzerland
4
Occupational Health Psychology, Faculty of Psychology, University of Fribourg, 1700 Fribourg, Switzerland
5
Institute of Special Education, University of Fribourg, 1700 Fribourg, Switzerland
6
Lyon Neuroscience Research Center, INSERM, CNRS, University of Lyon 1, F69675 Bron, France
*
Authors to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2022, 19(15), 9218; https://doi.org/10.3390/ijerph19159218
Submission received: 10 June 2022 / Revised: 22 July 2022 / Accepted: 25 July 2022 / Published: 28 July 2022
(This article belongs to the Section Occupational Safety and Health)

Abstract

:
Police officers are frequently exposed to highly stressful situations at work and have an increased risk to develop symptoms of post-traumatic stress disorder (PTSD) and burnout (BO). It is currently not well understood which officers are most at risk to develop these disorders. The aim of this study was to determine which coping strategies and personality traits could act as protective or risk factors in relation to PTSD and BO. The second aim, in the interest of designating preventive and therapeutical measures, was to determine whether certain profiles of police officers could be identified as high risk for developing mental disorders. Herein, 1073 French-speaking police officers in Switzerland reported in an online survey about their PTSD and BO symptoms, anxiety, depression, suicide ideation, coping strategies, occupational stress, and personality factors. The cluster analysis highlighted three principal profiles of police officers: those who are not at risk of developing pathologies because they are not exposed or insensitive to these stressors, and those who are, among which personality and coping strategies oriented the risk of developing PTSD or BO. These same protective and risk factors were also corroborated in the linear and logistic regression analyses. These results may suggest that a crucial opportunity for mitigating mental health issues in the force could consist of screening recruits for risk-related personality traits and orienting them towards psychological training programs for the development of functional coping strategies.

1. Introduction

Careers in policing are well known to involve repeated exposure to significantly stressful events and environments [1,2,3]. Police occupational stress, whether it is operational: i.e., linked to the unit and role of the officer (armed threats, motor accidents, civil aggression [4], death, child abuse) or organizational [5] i.e., linked to the management and logistics of the officer’s role (nonstandard working hours, understaffing, work relation abuse, lack of job satisfaction), is known to be maintained chronically throughout a police career. As a result, police careers have been markedly associated with consequential health risks [6,7,8]. Among these, mental disorders especially, such as posttraumatic stress disorder (PTSD), burnout (BO) and suicide ideation (SI) have been linked to police occupational stress [9,10,11,12].
PTSD corresponds to a severe anxiety disorder lasting for numerous years, which is first developed generally one month after having been confronted with a triggering traumatic event in which one’s life, physical integrity, or that of another, was severely threatened [13]. It is well recognised that police officers are exposed to such triggering incidents [14] at much higher rates than in many other careers and consequently are at increased risk for developing PTSD [15]. In support of this idea, previous studies have indeed quantified the degree to which typical police-related events, such as violence, death, or civil disorder, can be highly stressful [16,17]. Compared to the general population at an 8% rate of PTSD [18] and firefighters too [19], PTSD is higher in police officers at a rate of 9–15% [19,20]. This higher PTSD rate in police officers is coherent with the fact that their professional situations frequently entail risking physical and/or psychological harm, in cause promoting onset of the disorder.
BO is formally defined as a prolonged response to chronic stress at work [21], involving significant negative emotional and energy states that make it difficult to collaborate with colleagues and accomplish tasks at work [22]. Three principal dimensions are distinguished in the diagnosis of the syndrome: emotional exhaustion (i.e., frustration, lack of physical and emotional resources), depersonalization (i.e., cynicism, isolation, and loss of idealism) and thirdly, personal accomplishment (i.e., sense of achievement and value of work), which counterbalances the former two. Previous studies have found that as many as one-third of police officers display symptoms of BO [23,24] and nearly one-half display high depersonalization scores [24] and that these outcomes exceeded other emergency responders like firefighters or ambulance staff. This is in line with previous research that has shown PTSD, BO, and especially depersonalization and emotional exhaustion, to be strongly linked [25,26], suggesting that police officers may also have higher BO rates than in other careers. Moreover, within the framework of a multifactorial model, PTSD has been partly explained as the interaction between work-specific circumstances (e.g., confrontation to violence) and personality/psychological preparedness [19,27,28]. More broadly, across other careers, BO has also been partly explained via the interaction between professional situations, personality traits, and/or coping strategies [22,23].
A canonical personality trait model to which PTSD or BO has been linked to is the OCEAN personality model, developed by Costa and McCrae [29] and taken up again by John et al. [30]. OCEAN is comprised of five factors: O for openness, originality, and open-mindedness (i.e., curious personality); C for conscientiousness, control, and coercion (i.e., hardworking and persevering personality); E for extraversion, energy, and enthusiasm (i.e., sociable and dynamic personality); A for agreeableness, altruism, and affection (i.e., courteous, reliable and tolerant personality) and N for negative emotions, neuroticism, and nervousness (i.e., anxious, depressed, and emotionally unstable personality). Notably, previous research in police officers has found PTSD to be positively correlated with the neuroticism trait and negatively with the extraversion and conscientiousness traits [28,31]. Also, the emotional exhaustion and depersonalization dimensions of BO were found to be positively correlated with neuroticism while only depersonalization was negatively correlated with agreeableness, conscientiousness, and extraversion; finally personal fulfillment was negatively correlated with neuroticism and positively with the other four dimensions [23].
However, counting on personality traits alone, which are known to be essentially immutable, leaves little room for interventions and strategies in helping police officers manage serious mental disorders like PTSD and BO or avoid their acquisition. In this regard, encouraging the use of healthy and adaptive coping strategies may be a promising component of officer and career training programs. Coping involves an individual’s mechanisms for managing perceived internal and external stressors [32] and typically distinguishes emotion-focused coping, which allows one to face or reduce unpleasant emotions, from problem-focused coping, which allows one to change the origin of the stress or solve the problem [32,33]. Certain strategies may be characterized as more adaptive (e.g., active coping or positive reinterpretation) and others maladaptive (e.g., substance use or blame). In police officers, maladaptive coping strategies (avoidance, substance use) have been associated with higher levels of stress [27], PTSD symptoms [19], and BO [14,34], while adaptive strategies (problem-focused coping) correlate negatively with PTSD symptoms [15] and BO [14,34]. Although previous research suggests specific personality traits impacting the efficacy and choice of specific coping strategies [27,35,36] this has not been examined in police officers. Moreover, only one small study so far [37] has examined the mediation between PTSD and BO, specifically by mental rumination; but it did not take into account either coping strategies or personality. More broadly, several studies have examined the link between personality traits and the type of coping strategies utilized more versus less frequently as a function of them [27,35]. Notably, the extraversion trait was found positively correlated with positive distraction usage and negatively with denial and blame, while the latter two were positively correlated with the neuroticism trait [27]. However, it is important to note that research has also argued for the possibility that personality could have an interactional effect, that is, it could affect both the selection of the coping strategy and whether it is effective for the person in question [36].
To our knowledge, no study so far has examined altogether the principal stress dimensions (e.g., organizational stress, operational stress, PTSD and BO), in combination with personality traits and coping strategies, in police officers. We herein examine their relative importance via robust statistical and modelling analyses applied to a large sample (n > 1000) of police officers that were evaluated on these variables. The main objective of this study was to determine which stressors, personality traits, and coping strategies are relevant in the context of the development of PTSD and BO symptoms in police officers. Increasing our insight into such mechanisms may facilitate the development of prevention programs in police academies and forces. The second aim of this study was to determine if key officer profiles could be identified, based on observed outcomes tied to specific combinations of these variables. Such profiles could be used to screen and select recruits less prone to stress disorder in the occupation and to determine targeted mental health interventions.

2. Methods

2.1. Participants

All participants were police officers who, at the time of data collection, possessed a Swiss Federal Patent (or equivalent, for the older participants) and were working in the police forces of the French-speaking regions within Switzerland. The officers worked in a variety of suburban or municipal police forces and services.

2.2. Materials and Design

The data of this cross-sectional study were collected digitally by means of a fully anonymised online questionnaire sent by email to approximately 4250 eligible officers originating from 15 different police forces. For each respective police force, the email calling for participation in the study was relayed by the command post or the psychological services unit of the force. Prior to beginning the questionnaire, each participant first needed to sign an electronic consent form. The study received ethical authorization from the Ethics Committee of UniDistance Suisse on 17 April 2019.
The first part of the questionnaire consisted of questions on socio-demographics and occupational stress (see Supplementary data) and the second part the following standardized questionnaires: the Impact of Event Scale—Revised [38,39], the Maslach Burnout Inventory [22,40], the Big Five Inventory [30,41], the Brief COPE [42,43], the Hospital Anxiety and Depression Scale [44,45] and suicide ideation from the Beck Depression Inventory—II (BDI-II, [46]).

2.2.1. Primary Outcomes

The Impact of Event Scale—Revised (IES-R) [38,39] is a 22-item self-report scale measuring symptoms of PTSD, in which herein the French adaptation was used [38,39]. The scale is divided into 3 subscales: intrusion, avoidance and hypervigilance. The participant is asked to identify a specific stressful event by indicating how much difficulty the event has caused in the past 7 days. Responses are given on a 5-point Likert scale ranging from 0 (“not at all”) to 4 (“extremely”). The sum of the three subscale scores determines a composite PTSD score for which the typical clinical threshold for PTSD presence is a score ≥ 33 [47]. Note that scores ≥ 24 indicate a substantial clinical concern [48] and scores ≥ 37 have been associated with immune system suppression, even 10 years after the traumatic event [49]. Herein, the Cronbach’s α values obtained were respectively 0.92, 0.83 and 0.85 for the intrusion, avoidance, and hypervigilance subscales.
The Maslach Burnout Inventory (MBI) [22] is a 22-item self-report scale measuring BO, in which herein the French adaptation was used [40]. The scale is divided into 3 subscales: emotional exhaustion, depersonalisation and personal accomplishment. The participant is asked to determine how often he or she experiences certain situations. Responses are given on a 7-point Likert scale ranging from 0 (“never”) to 6 (“every day”) [22,40,50]. BO positivity is determined by a nonlinear combination of the scores, specifically if either of the following conditions are satisfied: (i) exhaustion and depersonalisation are both ≥ 18 or (ii) exhaustion is ≥ 18 and accomplishment is ≤ 34. Herein, the Cronbach’s α values obtained were respectively 0.87, 0.73, and 0.80 for the exhaustion, depersonalisation and accomplishment subscales.
The Big Five Inventory in French (BFI-Fr) [30,41], herein referred to as B5, is a French adaptation of the classic, 45-item self-report scale assessing each of the Big Five personality dimensions of the OCEAN framework, previously discussed: Openness, Conscientiousness, Extraversion, Agreeableness and Neuroticism. The participant is asked to determine the extent to which he or she agrees with statements. Responses are given on a 5-point Likert scale ranging from 1 (“strongly disagree”) to 5 (“strongly agree”). Higher resultant scores in each subscale reflect stronger presence of the personality trait. Herein, the Cronbach’s α values obtained were respectively 0.78, 0.78, 0.85, 0.75 and 0.84 for the openness, conscientiousness, extraversion, agreeableness, and neuroticism subscales.
The Coping Orientation to Problems Experienced, abbreviated version (Brief-COPE) [42], herein referred to as BCope, is a 28-item self-report scale evaluating the extent to which 14 different coping strategies are utilised: Acceptance, Active Coping, Blame, Behavioral Withdrawal, Denial, Distraction, Emotional Expression, Emotional Support, Humour, Instrumental Support, Planning, Reinterpretation Positive, Religion, Substance Use. Herein the French adaptation was used [43]. Responses are given on a 4-point Likert scale ranging from 0 (“not at all”) to 3 (“always”) and higher scores reflect a higher tendency to implement the corresponding coping strategies. A Cronbach’s α of 0.85 was herein obtained for this scale.
The Police Stress Questionnaire (PSQ) is a short version, 10-item self-report scale, consisting of two subscales that separately measure operational and organizational stress, specifically with regard to the police work environment. The PSQ was developed herein in the scope of addressing the lack of formal questionnaires currently available that measure police operational and organisational stress, as compared to more typical careers. The PSQ herein is not aimed to replace or be preferred over longer or formal, fully-validated alternatives of police job stress that may come to term. Here the PSQ was conceived as a short or abridged, scale in order to encourage overall officer response credibility in an already long questionnaire, due to the high multivariate scope of the study. The PSQ was comprised of items based on a review of directly related published studies and questionnaires that have considered police operational organizational and personal stressors [6,9,51]. Specifically, the principal stressors described in these studies were translated to questions in French. Then a subsample of francophone police officers was surveyed to rate the top five most pertinent stressors operationally and organisationally. After compilation of the results, for each subscale, the top-five stressors were retained in order to compose the final questionnaire, resulting in 10 items total. For each subscale, the resultant items were nonredundant in measurement or orthogonal respectively. Lastly, one additional item that directly asked about their degree of work-life balance was also included. The list of items are provided in the Supplementary Materials. For all items, responses were given on a 5-point Likert scale ranging from 1 (“strongly disagree”) to 5 (“strongly agree”) with the statement provided. The Cronbach’s α values obtained were respectively 0.62 and 0.63 for the operational and organizational stress subscales. Note that these Cronbach’s α values for the PSQ are consistent with the lower scores that are typically found in the literature for such short scales with non-redundant items [52]. For example, in the popularly-used Ten Item Personality Inventory (TIPI) scale, containing only 2 items for each of five personality traits, low-to-moderate Cronbach’s alphas (α = 0.40–0.68) have been established and have been frequently replicated in subsequent studies [53,54,55]. Herein, in a confirmatory factor analysis of the short PSQ questionnaire, the typical indices for goodness-of-fit were satisfied (CFI, IFI GFI and AGFI > 0.90, TLI = 0.89).

2.2.2. Secondary Outcomes

The Hospital Anxiety and Depression Scale (HADS) [44] is a 14-item self-report scale, consisting of two subscales that separately measure anxiety and depression. Herein the French adaptation was used [45]. The participant rates how often he or she experiences different feelings. Responses are given on a 4-point Likert scale ranging from 0 to 3, where the scale description may vary according to the question. The typical clinical threshold for anxiety presence is a score ≥ 8 and likewise for depression and a total score ≥ 11 may reflect an adjustment disorder in general albeit due to anxiety or depression [56]. Herein, the Cronbach’s α values obtained were respectively 0.78 and 0.73 for the anxiety and depression subscales.
The item on Suicidal Ideation (BDI-II) from the Beck Depression Inventory [BDI-II; 46], which has shown to have good predictive validity in previous studies [57], was incorporated into the questionnaire and translated into French. The response to this item is coded on a 4-point Likert scale as follows: 0 (“I don’t have any thoughts of killing myself”), 1 (“I have thoughts of killing myself, but I would not carry this out”), 2 (“I would like to kill myself”) and 3 (“I would kill myself if I had the chance”).
The following demographic variables were collected and included in the analyses: age, gender, relationship status, number of children under 18 in the household, pre-police academy education, number of years of service, current work position and police force.

2.3. Data Pre-Processing and Statistical Analysis Approach

The analytical approach here utilized a similar methodology as used in [58]. First, descriptive statistics and frequency counts (e.g., positivity) were calculated along the relevant variables and questionnaires (see Supplementary Table S1). Then, in preparation to satisfy modelling and statistical criteria (e.g., normality, homoskedasticity, linearity for regression), noncategorical variables were normalized via the Yeo-Johnson transformation [59] and scaled. Two-sample t-tests were then calculated based on pathology presence, for all continuous variables and p-values were Holm-Bonferroni corrected [60] for multiple comparisons.
A backward stepwise linear multiple regression model (statsmodels package in Python, version 0.14) was realized to identify the most pertinent variables that predict the IES-R total score and similarly with a logistic regression approach for predicting BO positivity (MBI scale). For each application, first in the full model with all variables, approximately 5–15% of the data were filtered as outliers based on Cook’s Distance [61] values that exceeded two times the mean value. Note that this percentage is coherent with the regression modelling literature where up to 10–20% of a sample may be acceptably identified, depending also on the characteristics of the data set and the outlier detection statistic used (for exemple, see [62,63,64,65]). Then, predictor variables in the model were eliminated recursively by which removal would most improve the Akaike Information Criterion, AIC [66]. For both resultant models, the necessary assumptions and diagnostics were rigorously evaluated and these are provided in Section 3.
Lastly, a principal components analysis and clustering of the participants was performed (scikit-learn library in Python) to obtain additional insights into the police officer sample and identify potentially insightful officer profiles. The observed Hopkins H = 0.71 for the data, which supports a strong tendency to cluster. Specifically, the principal component decomposition of the data (N = 5 dimensions) was submitted (see [67]) to a spectral clustering algorithm [68]. In contrast to the canonical clustering approaches, such as k-Means, spectral clustering is rooted in graph theory; it makes limited assumptions about the shape/form of the clusters and rather treats cluster identification as a graph neighborhood optimization problem. Using this approach, an optimal clustering result that balanced interpretable parsimony and performance (e.g., cluster separation and compactness) was obtained at K = 3 clusters. The performance diagnostics for this final model are provided in Section 3.

3. Results

3.1. Participants

A total of 1073 police officers fully completed the questionnaire (25% response rate). One participant was removed based on providing an age of 16 years old; otherwise, the youngest officer included in the study was 22 years old. As for age, 12% of officers were between 22 to 29 years old, 37% were 30 to 39 years old, 30% were 40 to 49 years old and 21% were 50 to 65 years old. Most officers completed up to vocational school level 1 (62%), others up to high school (18%) and the remainder either vocational school level 2 (8%), university (9%) or other schooling (3%). Twenty-two percent of officers were female. Professionally, 36% of officers were emergency police, 31% judicial police, 13% community police, 6% administrative, 5% traffic, 5% special forces, and 3% dispatch center. Nearly one half of officers, 49%, had at least one child. The interquartile range for years of service was 7 to 23, with a median of 15 and mean (SD) of 15.6 (10.1).

3.2. Clinical Symptoms

The profile of clinical symptoms of the police officer sample is summarized in Table 1, in which for each scale, the mean (SD), interquartile range (IQR), max value, score ≥ clinical threshold to determine pathology presence and the % of individuals satisfying this threshold is provided. Figure 1 then provides a visualization of this information, showing the distribution for each of the scales and their respective, recommended clinical thresholds (red vertical lines). This visualization helps to demonstrate the degree of continuity in the presence of each of the different pathologies (pre-, partial, full) and that this population presents a consequential profile of pathological symptoms, with a likely risk for exacerbation on the individual level, in light their continued occupational demands. The red shaded area denotes where the upper 50% of police officers are situated (the median of the sample and above).
Starting with PTSD, 16% of officers satisfied the criteria for substantial clinical concern, also known as a state of pre-diagnosis or partial PTSD symptoms (score ≥ 24), 9% for the disorder (score ≥ 33) and 6% for PTSD-induced immune system suppression (score ≥ 37). Proportional to numbers of officers by position occupied, traffic police, dispatch center and community police were highest in PTSD positivity at 17%, 14% and 12% respectively; the lowest were judicial police at 7%.
Next regarding BO, approximately 16% satisfied the criteria for the disorder, which involves several possible combinations of the three MBI subscales. The Emotional Exhaustion dimension is the principal negative dimension used in these combinations. In this respect, 25% of police officers satisfy the criteria (score ≥ 18); in which 23% of these officers may be considered severely exhausted (score ≥ 30). Proportional to numbers of officers by position occupied, dispatch center, special forces, emergency and judicial police were highest in BO positivity at 29%, 19%, 17% and 17% respectively; the lowest were administrative police at 10%.
In respect to the HADS Anxiety and Depression scales, respectively 25% of officers satisfied the criteria for a clinical anxiety disorder (score ≥ 8) and 9% for depression (score ≥ 8). In respect to the total HADS score (Anxiety + Depression), impressively 28% of officers have a score ≥ 11, signaling a major prevalence of strong emotional disturbance.
Finally, as many as 14% of police officers expressed having at least thought of committing suicide (score ≥ 1). However, only 0.3% of police officers admitted a desire to commit suicide (score ≥ 2).

3.3. Variables Associated with a Lower Clinical Symptoms

The previous section demonstrated a real issue of different mental or emotional disturbances being present in the police officer sample. In order to get an idea of the variables linked to pathology presence respective to each of the measures and thresholds in Table 1, two-sample t-tests were performed between the pathological group and non-pathological group for every continuous variable. The t-values are provided in Table 2, for which the p-values (Holm-Bonferroni corrected for multiple comparisons) are reflected by asterisks. The variables in the table are organized based on most significantly negative (less present in the pathological group) in descending magnitude; these are above the first horizontal line and below: most significantly positive (more present in the pathological group) likewise in descending magnitude. For brevity, variables that did not exhibit a significant difference for any pathology are not included in the table.
Based on these results, one can observe that positive reinterpretation and humour are among the strongest coping strategies linked to absence of each pathology; then acceptance and active coping were linked to BO absence but not for most of the other pathologies. Emotional expression was solely linked to depression absence.
In respect to personality traits, agreeableness was linked to absence for all pathologies except for PTSD (but not far from significance, as t = −2.57, did not survive the Holm-Bonferroni correction). Next, conscientiousness and extraversion were linked to the absence of BO and mildly to the absence of anxiety and depression.
Linked to pathology presence, the neuroticism trait was the strongest out of all types of variables and for all pathologies; most markedly, neuroticism was linked to the presence of anxiety disorder (t = 19.66) and then BO (t = 11.11). The next strongest variables were organizational stress and life imbalance, associated with all pathologies. Organizational stress was most strongly linked with the pathological presence of BO and anxiety and most weakly linked with the presence of PTSD. Life imbalance was also most strongly linked with the presence of BO and depression in second. Organisational stress was significant for all pathologies as well, but was much less strong in average magnitude as compared to the former three variables mentioned.
In respect to maladaptive coping strategies, behavioural withdrawal, blame, substance abuse and denial were the most strongly associated with pathology presence for all pathologies and were fairly balanced in magnitude across them. In contrast, the distraction strategy was only significant for the presence of PTSD and anxiety disorder, which was also the case for the religion and emotional support strategies.
In respect to demographic variables, increasing age, more years of service and male police officers were all associated significantly with the presence of suicide ideation, but not any other pathology.

3.4. Predicting Post-Traumatic Stress Disorder (IES-R)

The previous two-sample t-test analyses provided a useful identification of the major variables linked to the presence of each pathology. However, they do not take into account the continuity of the information, that is, how variables may be linked to increases or decreases in the degree of pathology, even if an officer has not necessarily reached clinical levels for example. They also involved independent comparisons and do not take into account how variables may combine or be redundant in predicting a pathology.
This more detailed level of description is possible with a multiple regression analysis, which the results for predicting total PTSD scores (IES-R scale) are provided in Table 3. These results are based on a significant predictive equation F(24,875) = 29.88, p < 0.001 that provided an R2 and adjusted R2 of 0.45 and 0.44 respectively. Also, the diagnostics for appropriate model fit were assessed and satisfied (e.g., see [69,70]). Specifically, residual normality was assessed and satisfied by the Komolgorov-Smirnov Jarque-Bera, Anderson-Darling and Omnibus tests (all p > 0.05); homoskedasticity by the Breusch-Pagan, White and Goldfeld-Quandt tests (all p > 0.05); absence of multicollinearity was verified and satisfied by small observed variance inflation factors for each predictor (maximum = 3.2); multivariate normality was satisfied by the Yeo-Johnson transformation; absence of autocorrelation was verified and satisfied by the Ljung-Box and Lagrange Multiplier tests (both p > 0.05); and linearity verified and satisfied in the Rainbow and Ramsey tests (both p > 0.05).
The results in Table 3 demonstrate that in the context of an integrative model that may eliminate redundancies (recursive elimination), only three main variables predict lower PTSD scores: the openness personality trait, and humour and active coping strategies. In contrast, a number of variables are significantly associated with successfully predicting higher PTSD scores, the most mentionable in ranked (t-value) order are operational stress, substance abuse, behavioral withdrawal, distraction, religion, emotional support, the neuroticism personality trait, and denial.

3.5. Predicting Burnout (MBI)

As clinical BO pathology is determined by several logical comparisons between the MBI subscales and not a threshold of the total sum score, multiple linear regression is not pertinent for identifying the most relevant predictors, rather, a statistical implementation of multiple logistic regression is, for which we provide the results in Table 4.
A significant equation was found F(23,993) = 40.07, p < 0.001 (model deviance compared to intercept-only model) that appropriately satisfied the standard diagnostics (e.g., see [71]), such as the Likelihood Ratio Test and the Lagrange Multiplier Score Tests for overall model fit (χ2(2) = 921.6, p < 0.001 and χ2(23) = 602.5, p < 0.001 respectively); and the Wald Test (χ2(4) = 148.2, p < 0.001), satisfied based on the joint hypothesis of the inclusion of the top-four most significant predictor variables (PSQ Stress Organisational, B5 Neuroticism, PSQ LifeImbalance, BCope Active). In agreement, the AIC (537.7 vs. 1413.3) and BIC (−6394.4 vs. 1418.2) values indicated clear preference over a null model that is intercept-only (see [72]). Pseudo-R2 values were obtained for the model that are considered strong (i.e., values between 0.6 to 1.0): McFadden R2 = 0.65, Nagelkerke R2 = 0.79 (see [73]) and an appropriate AUC score of 0.86 was obtained (see [74]); the true negative detection rate (BO absence) was 87% and for true positives, 74%.
The results in Table 4 demonstrate that the strongest predictors of the absence of BO were the active and positive reinterpretation coping strategies. Following them were the agreeableness and conscientiousness personality traits. Finally, the acceptance coping strategy was the last significant absence predictor. In contrast, the strongest predictors of BO presence were organizational stress, the neuroticism personality trait and life imbalance. Following them were three seemingly dysfunctional coping strategies: behavioral withdrawal, distraction, and substance abuse.

3.6. Psychological Profiles of Police Officers

The clustering analysis revealed three well-defined clusters that balance interpretative parsimony and performance (separation and compactness). The resultant diagnostics were as follows: Davies-Bouldin score = 1.47 ([0, ∞+], lower values preferred), Calinski-Harabasz score = 241.11 ([0, ∞+], larger values preferred), Dunn Index = 1.49 ([0, ∞+], larger values preferred and average Silhouette score = 0.19 ([−1.0, 1.0], larger values preferred). The satisfactory result of within-cluster cohesion and between-cluster separation with respect to the three strongest principal components, as per the total variance they explained (17.9%, 14.1% and 6.0%, respectively) is visualised in Figure 2.
Based on the cluster memberships derived from the algorithm, the cluster means for each of the variables collected (calculated after after normalisation and standardisation) are provided in Figure 3 and they are sorted based on the strongest significant positive differences, then negative significant differences, between the first two clusters (p-values Holm-Bonferroni corrected). For a full table of pairwise significance tests between the clusters, see Table S2 in the Supplementary Materials.
The clustering analysis may also permit one to take a look at the traits and strategies associated with reduced pathologies together, instead of separate analyses of each pathology. For example, based on the clustering analysis in Figure 3, for the majority of police officers who may be faced with stressful situations, the difference between Clusters 1 and 2 show that positive reinterpretation, sense of accomplishment, acceptance, sense of humour, active coping and planning were associated with the absence of clinical levels of the different pathologies and their subscales, such as for PTSD (IES-R), BO (MBI), anxiety (HADS), depression (HADS) and suicide ideation (BDI-2). The personality traits most associated with low levels of these were agreeableness, conscientiousness, and extraversion (B5). These results corroborate or summarise well those found in the previous separate analyses such as in the two-sample positivity t-tests and the separate linear and logistic regressions on PTSD and BO. Cluster 3 concerns a small sample who are insensitive to any variable except that they have a positive personality profile.

4. Discussion

The results of the present study that are based on a robustly large sample of police officers (N > 1000), confirm that police personnel present a clinical profile that is of high risk for various mental disorders, including notably PTSD and BO (see Table 1 and Figure 1). These disorders, PTSD and BO, were the primary focus of this study. The rates of partial (16%) and full PTSD (9%), based on the IES-R, found in the sample of the present study is comparable to that of a systematic review that found a median and mean rate of 9.2% and 14.9% respectively [75], which are each higher than the prevalence in the general population [18]. Regarding the percentage of police officers with BO, our finding is more than half as high as in another large study by De la Fuente Solana et al. [23]. This difference could be explained by the fact that Swiss and Spanish police forces have different scopes of operating (e.g., national vs. county police levels) and organisational means (e.g., number of staff or materials). As for anxiety and depression, the prevalence rates that were herein found were within the range of those previously found within a systematic review including 15 studies on depression and 4 on anxiety [76], with the departure from some studies that here the anxiety rates (25%) were over twice those as depression rates (9%). The prevalence of suicidal ideation in our sample (14%) is half that of Guerrero et al. [77] but well above those (4.6%) in the Soravia et al. [19] study as well as the general population (9.2%) [78]. These differences could be explained by the questionnaires used in these studies as having different constructs.

4.1. Identification of Risk and Protective Factors for PTSD and BO through Integrative Analyses

In the context of an integrative model predicting current PTSD levels, the results marked the importance of neuroticism as a major risk factor and openness as a protective factor. These findings are supported by other correlational studies [28,31]. Our results also demonstrated, as in other studies [15,19], that adaptive strategies (e.g., humor or active coping) tend to predict lower PTSD symptoms and can therefore be seen as protective factors for PTSD, other so-called maladaptive coping strategies (e.g., distraction, denial, or substance abuse) emerge as risk factors for PTSD. The link between PTSD and operational stress is theoretically sound in this population, given that most items in the operational stress scale can be directly linked to stressful event exposure. For example, “I regularly respond to urgent interventions”, “I am regularly faced with physical threats”, etc., many of which said events may involve violent situations (e.g., aggressive behavior, domestic disputes, motor accidents, death), which may be frequently appraised by the officer as an imminent threat to their personal survival/well-being or that of others.
In respect to BO, our research also highlights the importance of the interplay of certain personality traits as a risk or protective factors. Indeed, compatible with the findings of De La Fuente Solana [23], agreeableness and conscientiousness seemed to emerge as protective factors when neuroticism appears as a risk factor for BO. One explanation would be that individuals with salient neuroticism traits would be more prone to negative emotions, preventing them from finding resources to cope with BO, while people showing agreeableness traits would have better social support from their surroundings, allowing them to reduce occupational stress [79]. The results show, in a manner similar to other studies [14,34,80], that coping strategies can be protective or risk factors for BO depending on whether they are adapted or maladaptive. In addition, stress: whether operational, organisational, or related to family/work life balance, also appears as a risk factor, corroborated by other studies [34,81]. In respect to occupational stress, our modelling results revealed that BO is primarily influenced by organisational stress rather than operational stress, conversely to PTSD. Indeed organisational factors, including work recognition and the quality of one’s relationship with supervisors, have been previously identified as significantly influential factors of BO [82]. Also consistent with our finding, is a previous study that showed high operational stress exposure was not significantly linked to increased burnout severity [83].
These results can also be viewed as congruent with Appraisal Theory [84,85], which argues that over the frequency of stress exposure, what is more determinant in pathology development is rather the individual’s interpretation of the stressors and their personal relevance (known as primary appraisal) and in second place, the individual’s evaluation of their available resources and options for coping with the situation (known as secondary appraisal). In this light, coping strategies and organizational factors may be interpreted as part of an individual’s secondary appraisal functioning.
These modelling results were corroborated by the two-sample t-tests herein on the different pathological variables. Rather than taking into account the continuous value of the pathological variable (e.g., IES-R PTSD score) and many predictor variables simultaneously, as in a linear regression model, the two-sample t-tests compared, for each variable separately, the values of the pathological versus non-pathological group. These groups were determined by whether the pathological variable exceeded the recommended clinical threshold (see Table 1 and Table 2). For example, in terms of corroborating results in these tests: positive reinterpretation, which is positively correlated with humour (Pearson r = 0.39, p < 0.001), was found adaptive in respect to the presence/absence for PTSD and BO, as well as for each of the other pathologies. In respect to Anxiety and Depression and in line with other studies, the personality traits of agreeableness and conscientiousness were here identified as protective factors for both [86], while extraversion was specifically protective for Depression. In terms of coping strategies, acceptance was specifically adaptive for Anxiety and for Depression, active coping [87] and emotional expression [88,89]. Similar to other studies [90,91,92], the trait of neuroticism is a major risk factor for both affective pathologies, though more strongly for Anxiety. In respect to suicidal ideation (SI), neuroticism was again identified as a significant risk factor, which is likewise line with other studies [93,94] and agreeableness seemed to act as a protective factor [93]. Furthermore, several maladaptive strategies were identified (i.e., religion or avoidance coping, substance abuse) [94,95], while positive reinterpretation was found as an adaptive strategy. Similar to the other mental disorders previously discussed organizational stress [5,12] and life imbalance [96] were tied to SI. However, unlike PTSD and BO, age (i.e., older) [93,96] and gender (i.e., male) [96] were identified as risks factors for SI.

4.2. Identification of Police Profiles at Risk Versus Resilient to PTSD and Burnout

Similar to the profiling of people at risk of committing murder (e.g., [97]), our study sought to also identify profiles, yet through a positive light and in the service of police officers: specifically, which police officers tend to manage best the notably difficult and stressful conditions of their job? The strength of the present study involved the identification of psychological and coping tendency profiles of officers, which could be used instrumentally to offer innovative mental health disorder prevention and mitigation programs. It is evident that police officers are exposed to significantly higher levels of stress. Fortunately, a large proportion of the force may be identified as psychologically resistant; while select others may be spared by only a weak regular exposure to stressors. In contrast, it is crucial that the remainder of the police force who are at high risk of mental disorders (in our large sample, approximately one-third), benefit from interventions in the interest of career longevity and personal health.
Indeed, our clustering analyses highlighted two clearly distinct psychological profiles in this respect, in which approximately two-thirds of police officers possessed a psychological profile resilient to stress, with low risk of PTSD and BO and one-third vulnerable to stress with high symptoms of PTSD and BO. The resilient officers were more agreeable, conscientious, extroverted, and open to experience on average. They tend to use positive reinterpretation, acceptance and planning as coping strategies. Conversely, the police officers at high risk for stress-related disorders such as PSTD, BO, suicide ideation, anxiety and depression displayed strong traits of neuroticism and used more frequently substance abuse, behavioral withdrawal, blame and denial as coping strategies.
A unique contribution of the clustering approach is its capacity to explain how multiple pathology measures can be associated with different variables, rather than one pathology independently at a time, as in the previous regression or t-test analyses. In consequence, variables that may relate to multiple pathologies may be more strongly identified as significantly different between the clusters. Interestingly, the variables that are decisively different between the stress resilient (Cluster 1) and stress vulnerable (Cluster 2) were strongly corroborated by the previous regression and t-test results. For example in the previous analyses, the openness personality trait was linked with lower PTSD and agreeableness and conscientiousness traits with lower BO, which were also found in the stress resilient Cluster 1. Neuroticism was likewise found in all the previous analyses as strong risk factor for the pathologies and was as the strongest significantly different risk factor between Clusters 1 and 2. Not found in the regression, high extraversion was found in Cluster 1 though coherently in the t-tests it was most strongly linked to lower rates of depression and burn out, which is consistent with the pathological profile of Cluster 2. Similar consistencies between the analyses can also be found with regard to both the adaptive (e.g., positive reinterpretation, humor, active coping) and maladaptive coping strategies (e.g., substance use, blame, denial). The clustering analyses newly highlighted the planning strategy to differentiate Cluster 1 and 2, which may link to multiple pathologies but not strongly enough to one specific pathology to be significant in the previous analyses. Furthermore, the emotional expression strategy was not significant between Clusters 1 and 2, which can be explained by its negative association with lower depression rates (t-tests), while having a positive association with PTSD (regression, also for emotional support). To better disentangle the long-term efficacy of these emotion-centered strategies for PTSD and BO, further data is needed such as from a longitudinal study design.
Finally, the presence of Cluster 3 suggests that subsequent investigation may also be needed to fully understand why some police officers are not touched by such pathologies, despite their lack of implementing different positive coping strategies. The results show that their PSQ occupational stress levels are lower than the other clusters, but these differences are not significant if specifically compared to Cluster 1. The simplest explanation may be that these officers are less-frequently exposed to traumatic or repeated anxiety-producing events and hence are generally not stimulated to call upon them. Including an additional questionnaire with more specific questions regarding regular anxiety-provoking/disturbing events may provide data allowing for further differentiation of these clusters to more refined levels or further improve pathology prediction in modelling analyses in future studies. Nonetheless, importantly Cluster 3 has absent the maladaptive coping strategy of blame, which is potentially a key element that could be used to explain the cluster, as it could be linked to their model of personal responsibility for job outcomes (e.g., failure, civilian or partner death). Alternatively, the cluster could also be explained by a trait of much lower susceptibility to arousal or emotional impact, for which an additional measurement scale may be necessary.

4.3. Relationship of Findings to Non-Police Populations

Our analyses that confirmed the relationship of coping strategy influence on burn-out in police officers is consistent with previous burnout findings in other populations. For example, a systematic review of 85 studies and 261 predictors [98] demonstrated a positive impact of adaptive coping strategies and leisure activity (here PSQ Life Imbalance) and conversely, a negative impact of job demands (here PSQ Stress Organisational). In particular, active coping and acceptance have been highlighted in many studies as adaptive strategies and the use of psychoactive substances as maladaptive [99,100]. Most of the maladaptive coping strategies of PTSD that we have highlighted (behavior withdrawal, distraction, denial) corroborate the cognitive model of posttraumatic stress disorder [101] which identifies such avoidance tendencies as a substantial factor in maintaining traumatic memories [102].
However, other coping strategies, such as religion, emotional support and emotional expression have been described in previous studies as adaptive [103] whereas in our study they are correlated with PTSD presence. Several explanations can be offered to explain this distinction: such as whether specifically the police officer population interacts differently with strategy choices in these domains; whether the questionnaire used to measure these coping strategies (BCope) was not the optimal choice and should be reexamined; and/or whether these three coping strategies should be interpreted rather as a renunciation of an internal locus of control. For example, a said renunciation would correspond to a lack of active coping, which we found as protective for PTSD and BO and can be linked towards an individual’s adoption of a model of external locus of control, which has been identified as a risk factor for PTSD [104,105].
Altogether, as one of the only studies to date to have jointly assessed a vast number of dimensions known as highly-relevant to PTSD and BO (personality, coping strategies organisational and operational stress, demographics) within an integrative model using data-driven approaches and a robustly large sample, our study makes a theoretical contribution towards understanding PTSD and BO through a triangular model comprised of the pathologies’ contextual (Occupational Stress), reactional (Coping Strategies) and psychological (Personality Structure, Affect, Comorbidity, Demography) dimensions.

4.4. Meaning of the Study and Possible Implications

The results of the present study suggest that the screening of personality profiles and coping tendencies could be instrumental in the improved selection of recruitment candidates for the police academy, in order to identify individuals with a lower risk of developing PTSD or BO on the job. Also, targeted interventions for current employees that need them most and would respond positively, could be conceived, based on their personality and coping strategy profiles. Not only the coping literature, but also many publications on emotion regulation suggest that certain strategies may have more positive long-term effects compared to others [106]. Respective to their regular use in a long-term perspective, certain strategies can be considered as adaptive (cognitive reappraisal, acceptance), while others can be seen as maladaptive (avoidance, rumination, expressive suppression). Moreover, coping strategies focused on positive emotions, such as positive reinterpretation and humor, can be used to limit negative emotions by increasing positive emotions [107] and have been associated with better recovery from trauma [108]. The results from the current study shed light on potential key adaptive strategies that could be emphasized during academy training [109,110] or mid-career [111].
Humor: This coping strategy could offer an important medium to reinforce team cohesion and express support to team members [112,113,114] and crucially, mitigate the perception of difficult experienced events [113]. The beneficial effects of humor as a coping strategy have also been confirmed by other different studies. Indeed, women affected by armed conflict in Georgia who used humor as a coping strategy had fewer symptoms of post-traumatic stress [115]. Furthermore, several studies have found that exchanging jokes can create a positive work atmosphere and therefore protect against BO [116,117,118].
Positive reinterpretation: It is well-established that emotional and behavioral responses to an event are based on the individual’s appraisal of that event [84] or alternatively, the level of stress to an event depends on the cognitive evaluation of that stressor [85]. Modifying the cognitive assessment of a stressor (for example, reinterpreting civilian aggression as a product of an unjust society rather than as personally targeting the specific police officer) is the basis of most stress and anxiety management interventions today and is hence closely tied to positive reinterpretation. Cognitive-Behavioral Therapy (CBT) is currently the predominant effective therapy used by clinical psychologists for the treatment of anxiety disorders and stress [119]. These psychotherapies are essentially based on cognitive reappraisal and behavioral activation and for example, have been found effective in the treatment of depression [120]. Cognitive reappraisal has been associated with less post-traumatic stress symptoms [121] and enhanced exposure efficacity in PTSD treatment [122].
Acceptance and Active coping: Both beneficial coping strategies found in our analyses, acceptance and active coping, are directly relevant to one of the latest branches of CBT, known as Acceptance and Commitment Therapy (ACT). For example, ACT has been found effective for treating issues of BO [123], PSTD [124], alcohol use disorders [125] and suicidal ideation [126] in veterans. ACT may be also highly relevant in flagging the dissonance that could arise between values and commitment behaviors established with the officer and cases in which their organization may force them to behave oppositely and hence engendering stress [127,128]. Finally, as ACT is recognized as a transdiagnostic approach, training police officers with ACT may be pertinent both for the prevention and treatment of mental disorders.

4.5. Strengths, Limitations and Future Work

A notable strength of our study concerns its sample size. Indeed, the majority of current studies available on police officers involve only a few hundred participants (except [34,129]). This large sample can allow for a notable level of robustness and reliability. Although the participation rate, which was on a voluntary basis, may seem low, rather the opposite could be argued: collecting so many responses to such a long series of questionnaires constitutes a consequent return. This detailed amount of data collection favorably positioned us to be able to take into account a very large number of relevant factors simultaneously, compared to other studies which may have more blind spots. Nonetheless, it would have been worthwhile to also assess other variables such as traumatic anamnesis with the Trauma History Questionnaire [130] or stressful life events with the Life Event Stress Scale [131]. In the context of increasingly highly multidimensional (multivariate) data, path analyses and more advanced modelling approaches may importantly serve in a future study on this data to better understand the nuances and intermediary relationships between the large number of variables involved.
We utilized validated scales which are the most commonly used in the scientific literature of this domain. For some cases however, it would have been relevant to seek more modern questionnaires. For example, Maslach’s model of BO and MBI scale have been heavily criticized, particularly on its dimension of depersonalisation [132]. Today, the Job Demands-Resources model (JD-R; [133]) is increasingly recognized. Therefore, either the Burnout Assessment Tool (BAT; [134]) or the Oldenburg Burnout Inventory (OLBI; [135]) could replace the MBI in a future study.
While our findings regarding humor are interesting, the choice of the scale assessing humor might also be considered a limitation. For instance, the current scale does not permit any conclusions to be drawn about which types of humor may be more beneficial than others. Newer publications suggested alternative scales that seem to be more sensible to assess differential effects of humor, such as the Humor Styles Questionnaire (HSQ) [136]. The HSQ includes several subscales with potentially more adaptive and maladaptive types of humor, as well as the newly developed Comic Style Markers [137], whose recorded scales offer new possibilities to shed further light into adaptive or maladaptive coping responses to heightened stress. Further research is needed to better understand the effects of different types of humor in the context of police officers coping with high levels of stress.
While the short Police Stress Questionnaire (PSQ) used herein provided for some clear results of an operational stress link with PTSD and organizational stress link with BO, the fact that a standalone study dedicated to the formal psychometric evaluation of said questionnaire is still needed, is a limitation. The initial reliability and validation results of the PSQ herein is comparable in quality to that of other short questionnaires like the TIPI [53,54,55]. Similar to the TIPI as a short version of the Big Five Personality Inventory [30,41], the PSQ herein can be viewed as an abridged version of longer versions of alternative questionnaires aimed to measure similar constructs [6,34,81], from which indeed the PSQ items herein were derived. In our cross-sectional study involving many scales and inventories, our abridged version of a PSQ was utilized in an effort to maintain appropriate response integrity from police officers in the study, through avoiding an excessively long questionnaire (which is also often why the TIPI may be utilized in such contexts of large sample, multifactorial study). Nonetheless, our assessment analyses on our abridged PSQ suggest that in future studies, further refinement of the scale, comparing it to full length alternatives [6,34,81] and considering other related job dimensions, would constitute an important research project in the field. For example, it is likely that operational and organisational stress are composed of subdimensions for which a short questionnaire is not well positioned to disentangle. It is therefore recommended that other studies, especially with fewer variables, utilize full-length alternatives of the PSQ and assess the relationships.
Two other criticisms can also be considered in respect to our study. In fact, they are also valid for all other studies carried out in the field. First, cross-sectional studies do not reveal the causal relationship between factors. We therefore cannot conclude that coping strategies remain strictly functional or dysfunctional since these strategies could arise in response to a pathology and not be the cause. For example, police officers with higher psychological trauma levels may be less likely to use humor than those without PTSD. Only a longitudinal study or a cohort study can objectively establish a list of coping strategies that are protective or determinant in the development of a mental pathology. Secondly, written questionnaires are not a substitute for diagnosis: they only collect indications of possible pathologies. No study on the mental health of police officers has so far been carried out using the diagnoses made by health professionals. In this respect, it would be relevant to combine psychometric evaluations with interview data like the Clinically Administered PTSD Scale (CAPS; [138]).

5. Conclusions

Based on a large sample of police officers, this study demonstrated that personality factors and coping strategies can be strongly associated with the presence or degree of PTSD and BO disorders. Consequently, specific variables within these categories may be instrumentally used to identify police officers at risk of developing mental disorders, versus those who are resilient from them. The father of offender profiling, Alexandre Lacassagne wrote: “Societies get the criminals they deserve” (p. 364, [139]). We can likewise ask ourselves this question in respect to police officers. Do societies get the police officers they deserve? One is not born, but rather becomes a police officer. Accordingly, it is our societal responsibility to recruit, train and protect our police officers. Appropriate preparation, prior training, team spirit and solid, positive professional relationships would guarantee less severe post-traumatic reactions [140], leading to positive work environments and consequently fewer cases of BO [118]. PTSD [141] and BO [142,143] have been associated with increased aggressivity and abusive policing practices. Taken together, it therefore makes utmost sense to take care of our police officers, in order to not only ensure the best police forces and services are provided to the population, but also prevent the use of violence during officer duty. Although some psychological preparedness training is already mandatory in the initial formation program of Swiss police officers, it is probably not sufficient: it should be maintained also throughout a number of years following, combined with improved intervention screenings, in order to better guarantee the mental health of police officers and, consequently, a better service to the population.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/ijerph19159218/s1, Table S1. Summary table and guide for all variables, Table S2. Two sample t-tests between clusters for all variables in Figure 3, Table S3. Short version Police Stress Questionnaire (PSQ) items.

Author Contributions

Conceptualization: B.P.; Methodology: L.W.-P. and B.P.; Statistical Analysis: R.A.; Investigation: L.W.-P.; Data Curation: L.W.-P.; Writing Original Draft Preparation: R.A., L.W.-P. and B.P.; Writing Translation: R.A.; Writing Review and Editing: R.A., L.W.-P., C.R.S. and A.C.S., B.P.; Supervision: B.P.; Project Administration: B.P. All authors have read and agreed to the published version of the manuscript.

Funding

This study received no external funding.

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki and approved by the Ethics Committee of Unidistance Suisse (No. 2021–03–00003).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The data presented in this study are available on request from the corresponding authors.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Collins, P.A.; Gibbs, A.C.C. Stress in Police Officers: A Study of the Origins, Prevalence and Severity of Stress-Related Symptoms within a County Police Force. Occup. Med. 2003, 53, 256–264. [Google Scholar]
  2. Deschamps, F.; Paganon-Badinier, I.; Marchand, A.-C.; Merle, C. Sources and Assessment of Occupational Stress in the Police. J. Occup. Health 2003, 45, 358–364. [Google Scholar] [CrossRef] [Green Version]
  3. Violanti, J.M.; Fekedulegn, D.; Hartley, T.A.; Charles, L.E.; Andrew, M.E.; Ma, C.C.; Burchfiel, C.M. Highly Rated and Most Frequent Stressors among Police Officers: Gender Differences. Am. J. Crim. Justice 2016, 41, 645–662. [Google Scholar] [CrossRef] [Green Version]
  4. Soltes, V.; Kubas, J.; Velas, A.; Michalík, D. Occupational Safety of Municipal Police Officers: Assessing the Vulnerability and Riskiness of Police Officers’ Work. Int. J. Environ. Res. Public Health 2021, 18, 5605. [Google Scholar] [CrossRef]
  5. Acquadro Maran, D.; Magnavita, N.; Garbarino, S. Identifying Organizational Stressors That Could Be a Source of Discomfort in Police Officers: A Thematic Review. Int. J. Environ. Res. Public Health 2022, 19, 3720. [Google Scholar] [CrossRef]
  6. McCreary, D.R.; Thompson, M.M. Development of Two Reliable and Valid Measures of Stressors in Policing: The Operational and Organizational Police Stress Questionnaires. Int. J. Stress Manag. 2006, 13, 494–518. [Google Scholar] [CrossRef]
  7. Anderson, G.S.; Litzenberger, R.; Plecas, D. Physical Evidence of Police Officer Stress. Policing 2002, 25, 399–420. [Google Scholar] [CrossRef] [Green Version]
  8. Deschênes, A.-A.; Desjardins, C.; Dussault, M. Psychosocial Factors Linked to the Occupational Psychological Health of Police Officers: Preliminary Study. Cogent Psychol. 2018, 5, 1426271. [Google Scholar] [CrossRef]
  9. Garbarino, S.; Cuomo, G.; Chiorri, C.; Magnavita, N. Association of Work-Related Stress with Mental Health Problems in a Special Police Force Unit. BMJ Open 2013, 3, e002791. [Google Scholar] [CrossRef] [Green Version]
  10. Lucas, T.; Weidner, N.; Janisse, J. Where Does Work Stress Come from? A Generalizability Analysis of Stress in Police Officers. Psychol. Health 2012, 27, 1426–1447. [Google Scholar] [CrossRef]
  11. Magnavita, N.; Garbarino, S.; Siegrist, J. Evaluation Methods in the Work/Stress Correlations in Law Enforcement. G. Ital. Med. Lav. Ergon. 2014, 36, 400–404. [Google Scholar]
  12. Chopko, B.A.; Palmieri, P.A.; Facemire, V.C. Prevalence and Predictors of Suicidal Ideation among U.S. Law Enforcement Officers. J. Police Crim. Psychol. 2013, 29, 1–9. [Google Scholar] [CrossRef]
  13. American Psychiatric Association. DSM-V: Manuel Diagnostique et Statistique Des Troubles Mentaux, 5th ed.; Guelfi, J.-D.; Crocq, M.-A., Translators; Masson: Paris, France, 2015.
  14. Civilotti, C.; Di Fini, G.; Acquadro Maran, D. Trauma and Coping Strategies in Police Officers: A Quantitative-Qualitative Pilot Study. Int. J. Environ. Res. Public Health 2021, 18, 982. [Google Scholar] [CrossRef]
  15. Habersaat, S.A.; Geiger, A.M.; Abdellaoui, S.; Wolf, J.M. Health in Police Officers: Role of Risk Factor Clusters and Police Divisions. Soc. Sci. Med. 2015, 143, 213–222. [Google Scholar] [CrossRef] [Green Version]
  16. Arial, M.; Gonik, V.; Wild, P.; Danuser, B. Association of Work Related Chronic Stressors and Psychiatric Symptoms in a Swiss Sample of Police Officers; a Cross Sectional Questionnaire Study. Int. Arch. Occup. Environ. Health 2010, 83, 323–331. [Google Scholar] [CrossRef] [Green Version]
  17. Gershon, R.R.M.; Barocas, B.; Canton, A.N.; Xianbin, L.; Vlahov, D. Mental, Physical, and Behavioral Outcomes Associated with Perceived Work Stress in Police Officers. Crim. Justice Behav. 2009, 36, 275–289. [Google Scholar] [CrossRef]
  18. Kilpatrick, D.G.; Resnick, H.S.; Milanak, M.E.; Miller, M.W.; Keyes, K.M.; Friedman, M.J. National Estimates of Exposure to Traumatic Events and PTSD Prevalence Using DSM-IV and DSM-5 Criteria. J. Trauma. Stress 2013, 26, 537–547. [Google Scholar] [CrossRef]
  19. Soravia, L.M.; Schwab, S.; Walther, S.; Müller, T. Rescuers at Risk: Posttraumatic Stress Symptoms Among Police Officers, Fire Fighters, Ambulance Personnel, and Emergency and Psychiatric Nurses. Front. Psychiatry 2021, 11, 602064. [Google Scholar] [CrossRef]
  20. Maia, D.B.; Marmar, C.R.; Metzler, T.J.; Nóbrega, A.; Berger, W.; Mendlowicz, M.V.; Coutinho, E.S.F.; Figueira, I. Post-Traumatic Stress Symptoms in an Elite Unit of Brazilian Police Officers: Prevalence and Impact on Psychosocial Functioning and on Physical and Mental Health. J. Affect. Disord. 2007, 97, 241–245. [Google Scholar] [CrossRef]
  21. Maslach, C.; Leiter, M.P. Understanding the Burnout Experience: Recent Research and Its Implications for Psychiatry. World Psychiatry 2016, 15, 103–111. [Google Scholar] [CrossRef] [Green Version]
  22. Maslach, C.; Leiter, M.P. Early Predictors of Job Burnout and Engagement. J. Appl. Psychol. 2008, 93, 498–512. [Google Scholar] [CrossRef] [Green Version]
  23. De la Fuente Solana, E.I.; Aguayo, R.; Vargas, C.; De la Fuente, G.R. Prevalence and Risk Factors of Burnout Syndrome among Spanish Police Officers. Psicothema 2013, 25, 488–493. [Google Scholar] [CrossRef]
  24. Hawkins, H.C. Police Officer Burnout: A Partial Replication of Maslach’s Burnout Inventory. Police Q. 2001, 4, 343–360. [Google Scholar] [CrossRef]
  25. Boudoukha, A.H.; Altintas, E.; Rusinek, S.; Fantini-Hauwel, C.; Hautekeete, M. Inmates-to-Staff Assaults, PTSD and Burnout: Profiles of Risk and Vulnerability. J. Interpers. Violence 2013, 28, 2332–2350. [Google Scholar] [CrossRef] [Green Version]
  26. Jo, I.; Lee, S.; Sung, G.; Kim, M.; Lee, S.; Park, J.; Lee, K. Relationship between Burnout and PTSD Symptoms in Firefighters: The Moderating Effects of a Sense of Calling to Firefighting. Int. Arch. Occup. Environ. Health 2017, 91, 117–123. [Google Scholar] [CrossRef]
  27. Kaur, R.; Chodagiri, V.K.; Reddi, N.K. A Psychological Study of Stress, Personality and Coping in Police Personnel. Indian J. Psychol. Med. 2013, 35, 141–147. [Google Scholar] [CrossRef] [Green Version]
  28. Madamet, A.; Potard, C.; Huart, I.; El-Hage, W.; Courtois, R. Relationship between the Big Five Personality Traits and PTSD among French Police Officers. Eur. J. Trauma Dissociation 2017, 2, 83–89. [Google Scholar] [CrossRef]
  29. Costa, P.T.; McCrae, R.R. The NEO Personality Inventory Manual; Psychological Assessment Resources: Odessa, FL, USA, 1985. [Google Scholar]
  30. John, O.P.; Donahue, E.M.; Kentle, R.L. The Big Five Inventory—Versions 4a and 54; University of California, Institute of Personality and Social Research: Berkeley, CA, USA, 1991. [Google Scholar]
  31. Caska, C.M.; Renshaw, K.D. Personality Traits as Moderators of the Associations between Deployment Experiences and PTSD Symptoms in OEF/OIF Service Members. Anxiety Stress Coping Int. J. 2013, 26, 36–51. [Google Scholar] [CrossRef]
  32. Folkman, S.; Lazarus, R.S. Coping and Emotion. In Stress and Coping: An Anthology; Monat, A., Lazarus, R.S., Eds.; Columbia University Press: New York, NY, USA, 1991; pp. 207–227. [Google Scholar]
  33. Carver, C.S.; Scheier, M.F. Assessing Coping Strategies: A Theoretically Based Approach. J. Pers. Soc. Psychol. 1989, 56, 267–283. [Google Scholar]
  34. Queirós, C.; Passos, F.; Bártolo, A.; Faria, S.; Fonseca Monteiro, S.; Marques, A.J.; Silva, C.F.; Pereira, A. Job Stress, Burnout and Coping in Police Officers: Relationships and Psychometric Properties of the Organizational Police Stress Questionnaire. Int. J. Environ. Res. Public Health 2020, 17, 6718. [Google Scholar] [CrossRef]
  35. Lau, B.; Hem, E.; Berg, A.M.; Ekeberg, O.; Torgersen, S. Personality Types, Coping, and Stress in the Norwegian Police Service. Pers. Individ. Differ. 2006, 41, 971–982. [Google Scholar] [CrossRef]
  36. Carver, C.S.; Connor-Smith, J. Personality and Coping. Annu. Rev. Psychol. 2010, 61, 679–704. [Google Scholar] [CrossRef] [Green Version]
  37. Ogińska-Bulik, N.; Juczyński, Z. Burnout and Posttraumatic Stress Symptoms in Police Officers Exposed to Traumatic Events: The Mediating Role of Ruminations. Int. Arch. Occup. Environ. Health 2021, 94, 1201–1209. [Google Scholar] [CrossRef]
  38. Weiss, D.S.; Marmar, C.R. The Impact of Event Scale—Revised. In Assessing Psychological Trauma and PTSD; Wilson, J., Keane, T.M., Eds.; Guilford: New York, NY, USA, 1996; pp. 399–411. [Google Scholar]
  39. Brunet, A.; St-Hilaire, A.; Jehel, L.; King, S. Validation of a French Version of the Impact of Event Scale-Revised. Can. J. Psychiatry 2003, 48, 56–61. [Google Scholar]
  40. Dion, G.; Tessier, R. Validation de La Traduction de l’Inventaire d’épuisement Professionnel de Maslach et Jackson. Rev. Can. Sci. Comport. 1994, 26, 210–227. [Google Scholar] [CrossRef] [Green Version]
  41. Plaisant, O.; Courtois, R.; Réveillère, C.; Mendelsohn, G.A.; John, O.P. Validation Par Analyse Factorielle Du Big Five Inventory Français (BFI-Fr): Analyse Convergente Avec Le NEO-PI-R. Ann. Méd. Psychol. Rev. Psychiatr. 2010, 168, 97–106. [Google Scholar] [CrossRef] [Green Version]
  42. Carver, C.S. You Want to Measure Coping but Your Protocol’s Too Long: Consider the Brief COPE. Int. J. Behav. Med. 1997, 4, 92–100. [Google Scholar] [CrossRef]
  43. Muller, L.; Spitz, E. Évaluation Multidimensionnelle Du Coping: Validation Du Brief COPE Sur Une Population Française. Encephale 2003, 29, 507–518. [Google Scholar]
  44. Snaith, R.P.; Zigmond, A.S. The Hospital Anxiety and Depression Scale. Acta Psychiatr. Scand. 1986, 67, 361–370. [Google Scholar] [CrossRef]
  45. Lépine, J.-P.; Godchau, M.; Brun, P.; Lempérière, T. Evaluation de l’anxiété et de La Dépression Chez des Patients Hospitalisés Dans Un Service de Médecine Interne. Ann. Med. Psychol. 1985, 143, 175–189. [Google Scholar]
  46. Beck, A.T.; Steer, R.A.; Brown, G.K. Beck Depression Inventory (BDI-II); Pearson: London, UK, 1996; Volume 10. [Google Scholar]
  47. Creamer, M.; Bell, R.; Failla, S. Psychometric Properties of the Impact of Event Scale—Revised. Behav. Res. Ther. 2003, 41, 1489–1496. [Google Scholar] [CrossRef]
  48. Asukai, N.; Kato, H.; Kawamura, N.; Kim, Y.; Yamamoto, K.; Kishimoto, J.; Miyake, Y.; Nishizono-Maher, A. Reliability and Validity of the Japanese-Language Version of the Impact of Event Scale-Revised (IES-R-J): Four Studies of Different Traumatic Events. J. Nerv. Ment. Dis. 2002, 190, 175–182. [Google Scholar]
  49. Kawamura, N.; Kim, Y.; Asukai, N. Suppression of Cellular Immunity in Men with a Past History of Posttraumatic Stress Disorder. Am. J. Psychiatry 2001, 158, 484–486. [Google Scholar]
  50. Maslach, C.; Schaufeli, W.B.; Leiter, M.P. Job Burnout. Annu. Rev. Psychol. 2001, 52, 397–422. [Google Scholar] [CrossRef] [Green Version]
  51. Violanti, J.M.; Aron, F. Ranking Police Stressors. Psychol. Rep. 1994, 75, 824–826. [Google Scholar] [CrossRef]
  52. Ziegler, M.; Kemper, C.J.; Kruyen, P. Short Scales—Five Misunderstandings and Ways to Overcome Them. J. Individ. Differ. 2014, 35, 185–189. [Google Scholar] [CrossRef]
  53. Brito-Costa, S.; Moisão, A.; De Almeida, H.; Castro, F.V. Psychometric Properties of Ten Item Personality Inventory (TIPI). Int. J. Dev. Educ. Psychol. 2015, 1, 115–121. [Google Scholar]
  54. Gosling, S.D.; Rentfrow, P.J.; Swann, W.B. A Very Brief Measure of the Big Five Personality Domains. Journal of Research in Personality. J. Res. Pers. 2003, 37, 504–528. [Google Scholar]
  55. Nunes, A.; Limpo, T.; Lima, C.F.; Castro, S.L. Short Scales for the Assessment of Personality Traits: Development and Validation of the Portuguese Ten-Item Personality Inventory (TIPI). Front. Psychol. 2018, 9, 461. [Google Scholar]
  56. Bjelland, I.; Dahl, A.A.; Tangen Haug, T.; Neckelmann, D. The Validity of the Hospital Anxiety and Depression Scale an Updated Literature Review. J. Psychosom. Res. 2002, 52, 69–77. [Google Scholar]
  57. Green, K.L.; Brown, G.K.; Jager-Hyman, S.; Cha, J.; Steer, R.A.; Beck, A.T. The Predictive Validity of the Beck Depression Inventory Suicide Item. J. Clin. Psychiatry 2015, 76, 1683–1686. [Google Scholar]
  58. Anders, R.; Lecuelle, F.; Perrin, C.; Ruyter, S.; Franco, P.; Huguelet, S.; Putois, B. The Interaction between Lockdown-Specific Conditions and Family-Specific Variables Explains the Presence of Child Insomnia during Covid-19: A Key Response to the Current Debate. Int. J. Environ. Res. Public Health 2021, 18, 12503. [Google Scholar] [CrossRef]
  59. Yeo, I.; Johnson, A.R. A New Family of Power Transformations to Improve Normality or Symmetry. Biometrika 2000, 87, 954–959. [Google Scholar]
  60. Holm, S. A Simple Sequentially Rejective Multiple Test Procedure. Scand. J. Stat. 1979, 6, 65–70. [Google Scholar]
  61. Pinho, L.G.B.; Nobre, J.S.; Singer, J.M. Cook’s Distance for Generalized Linear Mixed Models. Comput. Stat. Data Anal. 2015, 82, 126–136. [Google Scholar] [CrossRef]
  62. Chatterjee, S.; Hadi, A.S. Influential Observations, High Leverage Points, and Outliers in Linear Regression. Stat. Sci. 1986, 1, 379–393. [Google Scholar]
  63. Kannan, K.S.; Manoj, K. Outlier Detection in Multivariate Data. Appl. Math. Sci. 2015, 47, 2317–2324. [Google Scholar]
  64. Hassani, R.; Mahmoudvand, R.; Yarmohammadi, M. Filtering and Denoising in Linear Regression Analysis. Fluct. Noise Lett. 2010, 9, 343–358. [Google Scholar]
  65. Oyeyemi, G.M.; Bukoye, A.; Akeyede, I. Comparison of Outlier Detection Procedures in Multiple Linear Regressions. Am. J. Math. Stat. 2015, 5, 37–41. [Google Scholar]
  66. Cavanaugh, J.E.; Neath, A.A. The Akaike Information Criterion: Background, Derivation, Properties, Application, Interpretation, and Refinements. Wiley Interdiscip. Rev. Comput. Stat. 2019, 11, e1460. [Google Scholar] [CrossRef]
  67. Chae, S.S.; Warde, W.D. Effect of Using Principal Coordinates and Principal Components on Retrieval of Clusters. Comput. Stat. Data Anal. 2006, 50, 1407–1417. [Google Scholar] [CrossRef]
  68. Von Luxburg, U. A Tutorial on Spectral Clustering. Stat. Comput. 2007, 17, 395–416. [Google Scholar] [CrossRef]
  69. Yan, X.; Su, X.G. Linear Regression Analysis: Theory and Computing; World Scientific: Hackensack, NJ, USA, 2009. [Google Scholar]
  70. Fox, J. Regression Diagnostics: An Introduction, 2nd ed.; SAGE Publications: Thousand Oaks, CA, USA, 2019. [Google Scholar]
  71. Peng, C.Y.J.; Lee, K.L.; Ingersoll, G.M. An Introduction to Logistic Regression Analysis and Reporting. J. Educ. Res. 2002, 96, 3–14. [Google Scholar] [CrossRef]
  72. Burnham, K.; Anderson, D. Model Selection and Multi-Model Inference, 2nd ed.; Springer: New York, NY, USA, 2004. [Google Scholar]
  73. Walker, D.A.; Smith, T.J. Nine Pseudo R2 Indices for Binary Logistic Regression Models. J. Mod. Appl. Stat. Methods 2016, 15, 848–854. [Google Scholar]
  74. Nam, B.-H.; D’Agostino, R.B. Discrimination Index, the Area under the ROC Curve. In Goodness-of-Fit Tests and Model Validity; Huber-Carol, C., Balakrishnan, N., Nikulin, M.S., Mesbah, M., Eds.; Birkhäuser: Basel, Switzerland, 2002; pp. 267–279. ISBN 978-1-4612-0103-8. [Google Scholar]
  75. Wagner, S.L.; White, N.; Fyfe, T.; Matthews, L.R.; Randall, C.; Regehr, C.; Alden, L.E.; Buys, N.; Carey, M.G.; Corneil, W.; et al. Systematic Review of Posttraumatic Stress Disorder in Police Officers Following Routine Work-related Critical Incident Exposure. Am. J. Ind. Med. 2020, 63, 600–615. [Google Scholar]
  76. Wagner, S.; White, N.; Matthews, L.R.; Randall, C.; Regehr, C.; White, M.; Fleischmann, M.H. Depression and Anxiety in Policework: A Systematic Review. Polic. Int. J. 2019, 43, 417–434. [Google Scholar]
  77. Guerrero-Barona, E.; Guerrero-Molina, M.; Chambel, M.J.; Moreno-Manso, J.M.; Bueso-Izquierdo, N.; Barbosa-Torres, C. Suicidal Ideation and Mental Health: The Moderating Effect of Coping Strategies in the Police Force. Int. J. Environ. Res. Public Health 2021, 18, 8149. [Google Scholar]
  78. Nock, M.K.; Borges, G.; Bromet, E.J.; Alonso, J.; Angermeyer, M.; Beautrais, A.; Bruffaerts, R. Cross-National Prevalence and Risk Factors for Suicidal Ideation, Plans, and Attempts. Br. J. Psychiatry 2008, 192, 98–105. [Google Scholar]
  79. Garbarino, S.; Chiorri, C.; Magnavita, N. Personality Traits of the Five-Factor Model Are Associated with Work-Related Stress in Special Force Police Officers. Int. Arch. Occup. Environ. Health 2013, 87, 295–306. [Google Scholar] [CrossRef]
  80. Wirkus, Ł.; Babicka-Wirkus, A.; Opora, R.; Stasiak, K. Burnout among Probation Officers in Poland and the Role of Preferred Styles of Coping with Stress. Int. J. Environ. Res. Public Health 2021, 18, 355. [Google Scholar] [CrossRef]
  81. Queirós, C.; Passos, F.; Bártolo, A.; Marques, A.J.; Fernandes, C.; Pereira, A.; Thornton, A.R. Burnout and Stress Measurement in Police Officers: Literature Review and a Study With the Operational Police Stress Questionnaire. Front. Psychol. 2020, 11, 587. [Google Scholar] [CrossRef]
  82. Finney, C.; Stergiopoulos, E.; Hensel, J.; Bonato, S.; Dewa, C.S. Organizational Stressors Associated with Job Stress and Burnout in Correctional Officers: A Systematic Review. BMC Public Health 2013, 13, 82. [Google Scholar] [CrossRef] [Green Version]
  83. De Carvalho, T.G.S.; Araújo, L.F.; Lima, E.P.; de Andrade, A.L.A.; Bastos, M.L.A.; Lacerda, E.M.; Ferreira, M.J.M. Burden and Protection: Heterogeneous Effects of Occupational and Operational Stressors on Burnout Dimensions Among Firefighters. J. Occup. Environ. Med. 2021, 63, e899–e904. [Google Scholar] [CrossRef]
  84. Scherer, K.R.; Schorr, A.; Johnstone, T. Appraisal Processes in Emotion: Theory, Methods, Research; Oxford University Press: Oxford, UK, 2001. [Google Scholar]
  85. Lazarus, R.S. Progress on a Cognitive-Motivational-Relational Theory of Emotion. Am. Psychol. 1991, 46, 819–834. [Google Scholar] [CrossRef]
  86. Jenkins, E.N.; Allison, P.; Innes, K.; Violanti, J.M.; Andrew, M.E. Depressive Symptoms among Police Officers: Associations with Personality and Psychosocial Factors. J. Police Crim. Psychol. 2019, 34, 67–77. [Google Scholar]
  87. McCanlies, E.C.; Gu, J.K.; Andrew, M.E.; Violanti, J.M. The Effect of Social Support, Gratitude, Resilience and Satisfaction with Life on Depressive Symptoms among Police Officers Following Hurricane Katrina. Int. J. Soc. Psychiatry 2018, 64, 63–72. [Google Scholar]
  88. Papazoglou, K.; Andersen, J.P. A Guide to Utilizing Police Training as a Tool to Promote Resilience and Improve Health Outcomes among Police Officers. Traumatol. Int. J. 2014, 20, 103. [Google Scholar]
  89. Papazoglou, K. Conceptualizing Police Complex Spiral Trauma and Its Applications in the Police Field. Traumatology 2013, 19, 196–209. [Google Scholar]
  90. Kotov, R.; Gamez, W.; Schmidt, F.; Watson, D. Linking “Big” Personality Traits to Anxiety, Depressive, and Substance Use Disorders: A Meta-Analysis. Psychol. Bull. 2010, 136, 768–821. [Google Scholar] [CrossRef]
  91. Bienvenu, O.J.; Samuels, J.F.; Costa, P.T.; Reti, I.M.; Eaton, W.W.; Nestadt, G. Anxiety and Depressive Disorders and the Five-factor Model of Personality: A Higher-and Lower-order Personality Trait Investigation in a Community Sample. Depress. Anxiety 2004, 20, 92–97. [Google Scholar]
  92. Harkness, K.L.; Michael Bagby, R.; Joffe, R.T.; Levitt, A. Major Depression, Chronic Minor Depression, and the Five-factor Model of Personality. Eur. J. Pers. 2002, 16, 271–281. [Google Scholar]
  93. Baertschi, M.; Costanza, A.; Canuto, A.; Weber, K. The Function of Personality in Suicidal Ideation from the Perspective of the Interpersonal-Psychological Theory of Suicide. Int. J. Environ. Res. Public Health 2018, 15, 636. [Google Scholar] [CrossRef] [Green Version]
  94. Pienaar, J.; Rothmann, S.; Van de Vijver, F.J.R. Occupational Stress, Personality Traits, Coping Strategies, and Suicide Ideation in the South African Police Service. Crim. Justice Behav. 2007, 34, 246–258. [Google Scholar] [CrossRef]
  95. Violanti, J.M.; Owens, S.L.; McCanlies, E.; Fekedulegn, D.; Andrew, M.E. Law Enforcement Suicide: A Review. Polic. Int. J. 2019, 42, 141–164. [Google Scholar] [CrossRef]
  96. Kyron, M.J.; Rikkers, W.; Page, A.C.; O’Brien, P.; Bartlett, J.; LaMontagne, A.; Lawrence, D. Prevalence and Predictors of Suicidal Thoughts and Behaviours among Australian Police and Emergency Services Employees. Aust. N. Zeal. J. Psychiatry 2021, 55, 180–195. [Google Scholar] [CrossRef]
  97. Del Mar Pecino-Latorre, M.; del Carmen Pérez-Fuentes, M.; Patró-Hernández, R.M. Homicide Profiles Based on Crime Scene and Victim Characteristics. Int. J. Environ. Res. Public Health 2019, 16, 3629. [Google Scholar]
  98. Shoman, Y.; El May, E.; Marca, S.C.; Wild, P.; Bianchi, R.; Bugge, M.D.; Caglayan, C.; Cheptea, D.; Gnesi, M.; Godderis, L.; et al. Predictors of Occupational Burnout: A Systematic Review. Int. J. Environ. Res. Public Health 2021, 18, 9188. [Google Scholar] [CrossRef]
  99. Kupcewicz, E.; Jozwik, M. Positive Orientation and Strategies for Coping with Stress as Predictors of Professional Burnout among Polish Nurses. Int. J. Environ. Res. Public Health 2019, 16, 4264. [Google Scholar]
  100. Sattar, K.; Yusoff, M.S.B.; Arifin, N.W.; Yasin, M.A.M.; Nor, M.Z.M. Effective Coping Strategies Utilised by Medical Students for Mental Health Disorders during Undergraduate Medical Education-a Scoping Review. BMC Med. Educ. 2022, 22, 164. [Google Scholar] [CrossRef]
  101. Ehlers, A.; Clark, D.M. A Cognitive Model of Posttraumatic Stress Disorder. Behav. Res. Ther. 2000, 38, 319–345. [Google Scholar] [CrossRef]
  102. Littleton, H.; Horsley, S.; John, S.; Nelson, D.V. Trauma Coping Strategies and Psychological Distress: A Meta-Analysis. J. Trauma. Stress 2007, 20, 977–988. [Google Scholar] [CrossRef] [PubMed]
  103. Prati, G.; Pietrantoni, L. Optimism, Social Support, and Coping Strategies as Factors Contributing to Posttraumatic Growth: A Meta-Analysis. J. Loss Trauma 2009, 14, 364–388. [Google Scholar] [CrossRef] [Green Version]
  104. Atilola, O.; Stevanovic, D.; Moreira, P.; Dodig-Ćurković, K.; Franic, T.; Djoric, A.; Davidovic, N.; Avicenna, M.; Multazam Noor, I.; Luis Monteiro, A.; et al. External Locus-of-Control Partially Mediates the Association between Cumulative Trauma Exposure and Posttraumatic Stress Symptoms among Adolescents from Diverse Background. Anxiety Stress Coping 2021, 34, 626–644. [Google Scholar]
  105. Chung, M.C.; Reed, J. Posttraumatic Stress Disorder Following Stillbirth: Trauma Characteristics, Locus of Control, Posttraumatic Cognitions. Psychiatr. Q. 2017, 88, 307–321. [Google Scholar]
  106. Gross, J.J. Emotion Regulation: Current Status and Future Prospects. Psychol. Inq. 2015, 26, 1–26. [Google Scholar] [CrossRef]
  107. Larsen, R.J.; Prizmic, Z. Affect Regulation. In Handbook of Self-Regulation: Research, Theory, and Applications; Baumeister, R.F., Vohs, K.D., Eds.; Guilford Press: New York, NY, USA, 2004; pp. 40–61. [Google Scholar]
  108. Feder, A.; Mota, N.; Salim, R.; Rodriguez, J.; Singh, R.; Schaffer, J.; Schechter, C.B.; Cancelmo, L.M.; Bromet, E.J.; Katz, C.L.; et al. Risk, Coping and PTSD Symptom Trajectories in World Trade Center Responders; Elsevier Ltd.: Amsterdam, The Netherlands, 2016; Volume 82, ISBN 2002011419. [Google Scholar]
  109. Manzella, C.; Papazoglou, K. Training Police Trainees about Ways to Manage Trauma and Loss. Int. J. Ment. Health Promot. 2014, 16, 103–116. [Google Scholar] [CrossRef]
  110. Andersen, J.P.; Papazoglou, K.; Arnetz, B.B.; Collins, P.I. Mental Preparedness as a Pathway to Police Resilience and Optimal Functioning in the Line of Duty. Int. J. Emerg. Ment. Health Hum. Resil. 2015, 17, 624–627. [Google Scholar]
  111. Berking, M.; Meier, C. Enhancing Emotion-Regulation Skills in Police Officers: Results of a Pilot Controlled Study. Behav. Ther. 2010, 41, 329–339. [Google Scholar] [CrossRef]
  112. Charuvastra, A.; Cloitre, M. Social Bonds and Posttraumatic Stress Disorder. Annu. Rev. Psychol. 2008, 59, 301–328. [Google Scholar] [CrossRef] [Green Version]
  113. Evans, R.; Pistrang, N.; Billings, J. Police Officers’ Experiences of Supportive and Unsupportive Social Interactions Following Traumatic Incidents. Eur. J. Psychotraumatol. 2013, 4, 19696. [Google Scholar] [CrossRef]
  114. Olff, M. Bonding after Trauma: On the Role of Social Support and the Oxytocin System in Traumatic Stress. Eur. J. Psychotraumatol. 2012, 3, 18597. [Google Scholar] [CrossRef]
  115. Saxon, L.; Makhashvili, N.; Chikovani, I.; Seguin, M.; McKee, M.; Patel, V.; Bisson, J.; Roberts, B. Coping Strategies and Mental Health Outcomes of Conflict-Affected Persons in the Republic of Georgia. Epidemiol. Psychiatr. Sci. 2017, 26, 276–286. [Google Scholar] [CrossRef] [Green Version]
  116. Gupta, R.; Sood, S.; Bakhshi, A. Relationship between Resilience, Personality and Burnout in Police Personnel. Int. J. Manag. Sci. 2012, 1, 1–5. [Google Scholar]
  117. Lemaire, J.B.; Wallace, J.E. Not All Coping Strategies Are Created Equal: A Mixed Methods Study Exploring Physicians’ Self Reported Coping Strategies. BMC Health Serv. Res. 2010, 10, 208. [Google Scholar] [CrossRef] [Green Version]
  118. Meldrum, H. Exemplary Physicians’ Strategies for Avoiding Burnout. Health Care Manag. 2010, 29, 324–331. [Google Scholar] [CrossRef]
  119. Hofmann, S.G.; Smits, J.A.J. Cognitive-Behavioral Therapy for Adult Anxiety Disorders: A Meta-Analysis of Randomized Placebo-Controlled Trials. J. Clin. Psychiatry 2008, 69, 621–632. [Google Scholar] [CrossRef]
  120. Ciharova, M.; Furukawa, T.A.; Efthimiou, O.; Karyotaki, E.; Miguel, C.; Noma, H.; Cipriani, A.; Riper, H.; Cuijpers, P. Cognitive Restructuring, Behavioral Activation and Cognitive-Behavioral Therapy in the Treatment of Adult Depression: A Network Meta-Analysis. J. Consult. Clin. Psychol. 2021, 89, 563–574. [Google Scholar]
  121. Bryant, R.A.; Moulds, M.; Guthrie, R.M. Cognitive Strategies and the Resolution of Acute Stress Disorder. J. Trauma. Stress 2001, 14, 213–219. [Google Scholar] [CrossRef]
  122. Bryant, R.A.; Moulds, M.L.; Guthrie, R.M.; Dang, S.T.; Mastrodomenico, J.; Nixon, R.D.V.; Felmingham, K.L.; Hopwood, S.; Creamer, M. A Randomized Controlled Trial of Exposure Therapy and Cognitive Restructuring for Posttraumatic Stress Disorder. J. Consult. Clin. Psychol. 2008, 76, 695–703. [Google Scholar] [CrossRef]
  123. Towey-Swift, K.D.; Lauvrud, C.; Whittington, R. Acceptance and Commitment Therapy (ACT) for Professional Staff Burnout: A Systematic Review and Narrative Synthesis of Controlled Trials. J. Ment. Health 2022, 2, 1–13. [Google Scholar] [CrossRef]
  124. Phillips, M.A.; Chase, T.; Bautista, C.; Tang, A.; Teng, E.J. Using Acceptance and Commitment Therapy Techniques to Enhance Treatment Engagement in Veterans with Posttraumatic Stress Disorder. Bull. Menn. Clin. 2020, 84, 264–277. [Google Scholar] [CrossRef]
  125. Meyer, E.C.; Walser, R.; Hermann, B.; La Bash, H.; DeBeer, B.B.; Morissette, S.B.; Kimbrel, N.A.; Kwok, O.-M.; Batten, S.V.; Schnurr, P.P. Acceptance and Commitment Therapy for Co-Occurring Posttraumatic Stress Disorder and Alcohol Use Disorders in Veterans: Pilot Treatment Outcomes. J. Trauma. Stress 2018, 31, 781–789. [Google Scholar] [CrossRef]
  126. Walser, R.D.; Garvert, D.W.; Karlin, B.E.; Trockel, M.; Ryu, D.M.; Taylor, C.B. Effectiveness of Acceptance and Commitment Therapy in Treating Depression and Suicidal Ideation in Veterans. Behav. Res. Ther. 2015, 74, 25–31. [Google Scholar] [CrossRef]
  127. Schaible, L.M.; Gecas, V. The Impact of Emotional Labor and Value Dissonance on Burnout Among Police Officers. Police Q. 2010, 13, 316–341. [Google Scholar] [CrossRef]
  128. Kenworthy, J.; Fay, C.; Frame, M.; Petree, R. A Meta-Analytic Review of the Relationship between Emotional Dissonance and Emotional Exhaustion. J. Appl. Soc. Psychol. 2014, 44, 94–105. [Google Scholar] [CrossRef]
  129. Lu, L.; Liu, L.; Sui, G.; Wang, L. The Associations of Job Stress and Organizational Identification with Job Satisfaction among Chinese Police Officers: The Mediating Role of Psychological Capital. Int. J. Environ. Res. Public Health 2015, 12, 15088–15099. [Google Scholar] [CrossRef] [Green Version]
  130. Hooper, L.M.; Stockton, P.; Krupnick, J.L.; Green, B.L. Development, Use, and Psychometric Properties of the Trauma History Questionnaire. J. Loss Trauma 2011, 16, 258–283. [Google Scholar] [CrossRef] [Green Version]
  131. Holmes, T.H.; Rahe, R.H. The Social Readjustment Rating Scale. J. Psychosom. Res. 1967, 11, 213–218. [Google Scholar]
  132. Aguayo, R.; Vargas, C.; De la Fuente Solana, E.I.; Lozano, L.M. A Meta-Analytic Reliability Generalization Study of the Maslach Burnout Inventory. Int. J. Clin. Health Psychol. 2011, 11, 343–361. [Google Scholar]
  133. Bakker, A.B.; Demerouti, E. Job Demands-Resources Theory: Taking Stock and Looking Forward. J. Occup. Health Psychol. 2016, 22, 273–285. [Google Scholar]
  134. Schaufeli, W.B.; Desart, S.; De Witte, H. Burnout Assessment Tool (Bat)—Development, Validity, and Reliability. Int. J. Environ. Res. Public Health 2020, 17, 9495. [Google Scholar] [CrossRef]
  135. Bakker, A.B.; Demerouti, E.; Verbeke, W. Using the Job Demands-Resources Model to Predict Burnout and Performance. Hum. Resour. Manag. 2004, 43, 83–104. [Google Scholar] [CrossRef] [Green Version]
  136. Martin, R.A.; Puhlik-Doris, P.; Larsen, G.; Gray, J.; Weir, K. Individual Differences in Uses of Humor and Their Relation to Psychological Well-Being: Development of the Humor Styles Questionnaire. J. Res. Pers. 2003, 37, 48–75. [Google Scholar] [CrossRef]
  137. Ruch, W.; Heintz, S.; Platt, T.; Wagner, L.; Proyer, R.T. Broadening Humor: Comic Styles Differentially Tap into Temperament, Character, and Ability. Front. Psychol. 2018, 9, 6. [Google Scholar] [CrossRef] [Green Version]
  138. Blake, D.D.; Weathers, F.W.; Nagy, L.M.; Kaloupek, D.G.; Gusman, F.D.; Charney, D.S.; Keane, T.M. The Development of a Clinician-Administered PTSD Scale. J. Trauma. Stress 1995, 8, 75–90. [Google Scholar]
  139. Lacassagne, A. Des Transformations Du Droit Pénal et Les Progrès de La Médecine Légale de 1810 à 1912. In Archives D’anthropologie Criminelle de Médecine Légale et de Psychologie Normale et Pathologique; Rey, A., Ed.; Masson & Cie: Lyon, France, 1913; p. 364. [Google Scholar]
  140. Blumberg, D.M.; Schlosser, M.D.; Papazoglou, K.; Creighton, S.; Kaye, C.C. New Directions in Police Academy Training: A Call to Action. Int. J. Environ. Res. Public Health 2019, 16, 4941. [Google Scholar] [CrossRef] [Green Version]
  141. DeVylder, J.; Lalane, M.; Fedina, L. The Association Between Abusive Policing and PTSD Symptoms Among U.S. Police Officers. J. Soc. Soc. Work Res. 2019, 10, 261–273. [Google Scholar] [CrossRef]
  142. Queirós, C.; Kaiseler, M.; Da Silva, A.L. Burnout as Predictor of Aggressivity among Police Officers. Eur. J. Polic. Stud. 2013, 1, 110–134. [Google Scholar]
  143. Kop, N.; Euwema, M.; Schaufeli, W.B. Burnout, Job Stress and Violent Behaviour among Dutch Police Officers. Work Stress Int. J. Work Health Organ. 1999, 13, 326–340. [Google Scholar] [CrossRef]
Figure 1. Distributions of pathological scores and cutoffs (vertical lines) for each of the scales (left to right) IES-R PTSD (clinical concern ≥ 24 in orange; 16% and positivity ≥ 33 in red; 9%), MBI Emotional Exhaustion (≥18), HADS Anxiety (≥8), HADS Depression (≥8) Scales. The red shaded area denotes where the upper 50% of police officers are situated (the median and above). The area to the right of the vertical lines designates pathology presence (e.g., ≥threshold).
Figure 1. Distributions of pathological scores and cutoffs (vertical lines) for each of the scales (left to right) IES-R PTSD (clinical concern ≥ 24 in orange; 16% and positivity ≥ 33 in red; 9%), MBI Emotional Exhaustion (≥18), HADS Anxiety (≥8), HADS Depression (≥8) Scales. The red shaded area denotes where the upper 50% of police officers are situated (the median and above). The area to the right of the vertical lines designates pathology presence (e.g., ≥threshold).
Ijerph 19 09218 g001
Figure 2. Clusters of the police officers obtained from an optimized spectral clustering algorithm. Each point represents an individual officer’s values on the first (x-axis), second (y-axis) and third (z-axis) principal components of the data (Dim 1, Dim 2, Dim 3). The cluster centroids are calculated as the mean value of the cluster for each of the three dimensions. This diagnostic demonstrates the satisfactory result of within-cluster cohesion and between-cluster separation with respect to the three strongest principal components, as per the total variance they explained (17.9%, 14.1% and 6.0%, respectively).
Figure 2. Clusters of the police officers obtained from an optimized spectral clustering algorithm. Each point represents an individual officer’s values on the first (x-axis), second (y-axis) and third (z-axis) principal components of the data (Dim 1, Dim 2, Dim 3). The cluster centroids are calculated as the mean value of the cluster for each of the three dimensions. This diagnostic demonstrates the satisfactory result of within-cluster cohesion and between-cluster separation with respect to the three strongest principal components, as per the total variance they explained (17.9%, 14.1% and 6.0%, respectively).
Ijerph 19 09218 g002
Figure 3. Hierarchical clustering analysis: Mean values of each variable (after Yeo-Johnson transformation and standardization) for each cluster. Variables are sorted based on the most significant positive differences between cluster 1 and 2, most significant negative differences, then non-significant differences. All pairwise significance tests between the clusters are provided in Table S2 in the Supplementary Materials. Note: Bcope = The Coping Orientation to Problems Experienced Inventory, B5 = Big Five Inventory in French, IES-R = Impact of Event Scale–Revised, MBI = Maslach Burnout Inventory, HADS = Hospital Anxiety and Depression Scale, BDI-II = Beck Depression Inventory, PSQ = Police Stress Questionnaire; see Section 2 for a detailed explanation.
Figure 3. Hierarchical clustering analysis: Mean values of each variable (after Yeo-Johnson transformation and standardization) for each cluster. Variables are sorted based on the most significant positive differences between cluster 1 and 2, most significant negative differences, then non-significant differences. All pairwise significance tests between the clusters are provided in Table S2 in the Supplementary Materials. Note: Bcope = The Coping Orientation to Problems Experienced Inventory, B5 = Big Five Inventory in French, IES-R = Impact of Event Scale–Revised, MBI = Maslach Burnout Inventory, HADS = Hospital Anxiety and Depression Scale, BDI-II = Beck Depression Inventory, PSQ = Police Stress Questionnaire; see Section 2 for a detailed explanation.
Ijerph 19 09218 g003
Table 1. Descriptive Statistics, Positivity Thresholds and Counts for IES-R PTSD, MBI Burnout, MBI Emotional Exhaustion, HADS Anxiety, HADS Depression Scales and Suicidal Ideation.
Table 1. Descriptive Statistics, Positivity Thresholds and Counts for IES-R PTSD, MBI Burnout, MBI Emotional Exhaustion, HADS Anxiety, HADS Depression Scales and Suicidal Ideation.
IES-R PTSDMBI BurnoutMBI Emotional ExhaustionHADS AnxietyHADS DepressionBDI-II
Suicidal Ideation
Mean (SD)12.0 (13.4)Multi-scale12.9 (9.0)5.6 (3.3)3.2 (3.0)0.14 (0.37)
IQR2–17-17–503–71–50–0
Max76-5021183
Threshold≥24|33Multi-scale18881
% Positive16|9162525914
Note: IES-R = Impact of Event Scale–Revised, MBI = Maslach Burnout Inventory, HADS = Hospital Anxiety and Depression Scale, BDI-II = Beck Depression Inventory; see Section 2 for a detailed explanation.
Table 2. Two-sample t-tests (presence vs. absence) for pathologies PTSD, Burnout, Suicidal Ideation, Anxiety and Depression (test statistic values and * p < 0.05; ** p < 0.01; *** p < 0.001 after Holm-Bonferroni correction). Above the first horizontal line, the pathological group had weaker values for these variables.
Table 2. Two-sample t-tests (presence vs. absence) for pathologies PTSD, Burnout, Suicidal Ideation, Anxiety and Depression (test statistic values and * p < 0.05; ** p < 0.01; *** p < 0.001 after Holm-Bonferroni correction). Above the first horizontal line, the pathological group had weaker values for these variables.
IES-R PTSDMBI
Burnout
HADS AnxietyHADS DepressionBDI-II
Suicidal Ideation
% Positive9%16%25%9%14%
BCope Reinterpretation Positive−3.04 *−7.34 ***−7.44 ***−6.57 ***−4.63 ***
B5 Agreableness−2.57−7.76 ***−4.52 ***−4.37 ***−4.17 ***
BCope Humour−3.68 **−3.08 *−6.18 ***−4.88 ***−1.25
B5 Conscientiousness−1.10−4.88 ***−3.05 *−3.26 *−1.49
B5 Extraversion−0.85−3.86 **−2.43−4.38 ***−1.72
BCope Acceptance−0.56−4.82 ***−3.57 **−2.28−1.57
BCope Active Coping0.88−4.21 ***−0.70−3.36 *0.08
BCope Emotional Expression1.09−2.300.29−3.00 *−0.46
B5 Neuroticism6.74 ***11.11 ***19.66 ***8.30 ***7.34 ***
PSQ Stress Organisational4.98 ***13.62 ***10.09 ***8.58 ***5.14 ***
PSQ Life Imbalance6.22 ***8.72 ***6.63 ***8.67 ***4.08 **
BCope Behavior Withdrawal6.66 ***7.08 ***7.96 ***7.07 ***5.03 ***
BCope Blame5.51 ***5.23 ***8.55 ***6.50 ***6.56 ***
BCope Substance Use4.08 **5.60 ***6.14 ***4.12 **4.40 ***
BCope Denial6.09 ***3.93 **5.70 ***3.88 **4.44 ***
PSQ Stress Operational5.36 ***5.94 ***4.60 ***4.16* *2.24
BCope Distraction7.91 ***1.934.25 ***0.071.89
BCope Religion3.78 **1.283.82 **1.394.17 ***
Years of Service1.590.792.572.506.24 ***
Age1.820.481.981.395.36 ***
BCope Emotional Support4.23 ***−0.743.18 *−1.020.76
Gender0.110.33−3.15 *1.075.05 ***
Note: BCope = The Coping Orientation to Problems Experienced Inventory, B5 = Big Five Inventory in French, IES-R = Impact of Event Scale–Revised, MBI = Maslach Burnout Inventory, HADS = Hospital Anxiety and Depression Scale, BDI-II = Beck Depression Inventory, PSQ = Police Stress Questionnaire; see Section 2 for a detailed explanation.
Table 3. Linear multiple regression results for the prediction of total IES-R PTSD scores.
Table 3. Linear multiple regression results for the prediction of total IES-R PTSD scores.
VariableBCItp
B5 Openness−0.12[−0.17, −0.07]−4.9<0.001
BCope Humour−0.09[−0.14, −0.04]−3.360.001
BCope Active Coping−0.08[−0.15, −0.01]−2.330.02
PSQ Stress Operational0.17[0.12, 0.22]6.38<0.001
BCope Substance Use0.14[0.09, 0.19]5.74<0.001
BCope Behavior Withdrawal0.14[0.09, 0.19]5.32<0.001
BCope Distraction0.14[0.09, 0.19]5.23<0.001
BCope Religion0.11[0.06, 0.16]4.47<0.001
BCope Emotional Support0.17[0.10, 0.25]4.44<0.001
B5 Neuroticism0.12[0.07, 0.18]4.38<0.001
BCope Denial0.10[0.05, 0.15]3.9<0.001
BCope Emotional Expression0.12[0.05, 0.18]3.52<0.001
BCope Acceptance0.08[0.02, 0.13]2.850.004
Note: BCope = The Coping Orientation to Problems Experienced Inventory, B5 = Big Five Inventory in French, IES-R = Impact of PSQ = Police Stress Questionnaire; see Section 2 for a detailed explanation.
Table 4. Logistic regression results for the prediction of BO pathology presence (as determined by the MBI subscales).
Table 4. Logistic regression results for the prediction of BO pathology presence (as determined by the MBI subscales).
VariableBCItp
BCope Active Coping−0.88[−1.31, −0.45]−4.03<0.001
B5 Agreableness−0.51[−0.79, −0.24]−3.72<0.001
B5 Conscientiousness−0.48[−0.76, −0.2]−3.40.001
Bcope Reinterpretation Positive−0.6[−1.0, −0.2]−2.960.003
Bcope Acceptance−0.38[−0.69, −0.08]−2.440.02
PSQ Stress Organizational2.15[1.74, 2.55]10.3<0.001
B5 Neuroticism1.55[1.2, 1.91]8.57<0.001
PSQ Life Imbalance0.82[0.5, 1.13]5.08<0.001
Bcope Behavior Withdrawal0.46[0.23, 0.68]3.9<0.001
Bcope Distraction0.42[0.07, 0.77]2.360.02
Bcope Substance Use0.23[0.0, 0.46]20.04
Note: Bcope = The Coping Orientation to Problems Experienced Inventory, B5 = Big Five Inventory in French, MBI = Maslach Burnout Inventory, PSQ = Police Stress Questionnaire; see Section 2 for a detailed explanation.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Anders, R.; Willemin-Petignat, L.; Rolli Salathé, C.; Samson, A.C.; Putois, B. Profiling Police Forces against Stress: Risk and Protective Factors for Post-Traumatic Stress Disorder and Burnout in Police Officers. Int. J. Environ. Res. Public Health 2022, 19, 9218. https://doi.org/10.3390/ijerph19159218

AMA Style

Anders R, Willemin-Petignat L, Rolli Salathé C, Samson AC, Putois B. Profiling Police Forces against Stress: Risk and Protective Factors for Post-Traumatic Stress Disorder and Burnout in Police Officers. International Journal of Environmental Research and Public Health. 2022; 19(15):9218. https://doi.org/10.3390/ijerph19159218

Chicago/Turabian Style

Anders, Royce, Lauriane Willemin-Petignat, Cornelia Rolli Salathé, Andrea C. Samson, and Benjamin Putois. 2022. "Profiling Police Forces against Stress: Risk and Protective Factors for Post-Traumatic Stress Disorder and Burnout in Police Officers" International Journal of Environmental Research and Public Health 19, no. 15: 9218. https://doi.org/10.3390/ijerph19159218

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop