1. Introduction
People with systemic disorders (such as diabetes, cardiovascular disease, or kidney disease) or connective tissue diseases (such as rheumatoid arthritis or lupus erythematosus) often suffer from a deteriorated psychological state. Anxiety, stress or depressive disorders resulting from poor physical health also impact oral health, which, in this context, is often neglected, thus it rapidly deteriorates due to a lack of self-care or regular dental visits [
1].
Similarly, people with severe mental illnesses, such as schizophrenia, often exhibit both health and lifestyle behaviors that lead to poor oral health and dental disease [
2]. In addition to the oral health side effects of antipsychotics, people with schizophrenia (PWS) neglect their own care [
3,
4]. This seems to be mainly influenced by the negative symptoms of schizophrenia, such as the lack of initiative, lack of interest in personal health, social withdrawal, and lack of motivation [
5,
6].
Conversely, poor oral health impacts self-esteem and the ability of PWS to engage in recovery [
6].
From a public health perspective, it is important to develop effective oral health promotion or support programs for these people, and to evaluate them using reliable and valid tools. One difficulty in measuring perceived health in those with mental disorders is dissociation from the reality of the illness, intensity of the response, and adequacy of their perception [
7]. PWS tend to have generalized cognitive impairment, affecting communication and social skills [
8]. Cognitive impairment may be associated with stereotypical behavior, a symptom characterized by repetitive and functionless motor behavior [
9]. These factors put PWS at risk of social dysfunction or loss of self-esteem, leading to isolation and victimization [
10].
In this context, new strategies working towards improved oral health and managing the underlying psychological mechanisms, promoting adherence to these strategies, remain underexplored.
Folkman and Moskowitz [
11] define coping as the thoughts and behaviors used to deal with stressful situations. Coping must be understood as an explanatory concept for the variability in the response to a stressor. Coping strategies to stressors are, therefore, specific to each situation and to each person. In other words, beyond measuring perceived health, it is important to know how these people concretely organize themselves in terms of, for example, handling dental pain or organizing themselves to be regularly followed up by a dentist. It is also important to know the emotional impact an oral disorder can have. The challenge for carers is to better understand the coping strategies used according to the experiences, perceptions, and representations of each PWS.
As such, a specific tool was developed to evaluate oral health coping strategies in PWS. This scale was named the Schizophrenia Coping Oral Health Profile (SCOOHP) [
12]. The provisional, self-administered scale consists of 23 items and two dimensions, with positive coping of 15 items and negative coping of eight items. The SCOOHP aims to identify coping strategies used by PWS for oral health problems and blockages,—while caring for one’s health (negative coping) or facilitating “good” behaviors to optimize oral health (positive coping)—for target care and protocols that improve their oral health. Although this draft scale has good acceptability and consistent reliability (α = 0.59), the dimensional and external structure of this scale must be validated from a psychometric point of view.
Subjective measurement scales must provide accurate, valid, interpretable and scientifically robust data for population health assessment before they are considered suitable. The performance of the results of these measures is mainly due to the reliability and validity of these scales [
13]. Reliability is the ability to reproduce a consistent result over time and space, or across different observers, and is one of the main quality criteria of an instrument [
14,
15]; it mainly refers to the validation of the dimensional structure of the scale [
14,
15]. Validity, or the study of external constructs, refers to whether a tool measures exactly what it is supposed to measure [
16]; for example, criterion validity is the relationship between the scale score to be validated and an external criterion [
17]. This criterion should be a widely accepted measure, with the same characteristics as the assessment tool, and should be considered the ‘gold standard’ where it exists [
17]. This study aims to validate the dimensional structure of the provisional SCOOHP scale, and to explore its external structure.
2. Materials and Methods
2.1. Research Design
The SCOOHP questionnaire was developed between June 2016 and November 2018 in a monocentric qualitative study carried out at the Hospital Centre la Chartreuse in Dijon (France). This study involved 34 people (24 PWS and 10 health professionals) [
12]. The PWS questionnaire was developed and structured with data collected during semi-structured interviews with 20 PWS and six health professionals, and two focus groups with eight different people (1 FG with 4 people with PWS and 1 FG with health professionals). Only items related to the concept of oral health adaptation were retained for the construction of this questionnaire [
12]. A psychometric validation study of this scale has been underway since 2018, with a large sample of PWS recruited from five French hospitals (Dijon, Tours, Reims, Millau and Paris). The study was registered with
www.ClinicalTrials.gov (accessed on 1 October 2021) under the number NCT03699501.
Patients were referred to the study investigator through the health professional designated as responsible for the patient’s mental health care. They were informed by the investigator of the nature of the research, its objectives, methodology, duration, expected benefits, constraints and foreseeable risks, in accordance with Article L1122-1 of the Public Health Code. PWS were informed that their data would be computerized, confidential and processed anonymously, and that they could access and rectify it at any time.
Below,
Figure 1 summarizes the research design.
2.2. Analysis of the Dimensional Structure
To explore the dimensional structure of the provisional SCOOHP questionnaire and validate its final version, we used (1) inter-item correlation analysis and Cronbach’s α coefficient, (2) Rasch model analysis, (3) exploratory factor analysis (EFA), and (4) confirmatory factor analysis (CFA).
2.2.1. Inter-Item Correlation and Cronbach’s α Coefficient
Internal consistency was assessed with an inter-item correlation of global scores and Cronbach’s α coefficient values. Such correlations examine the extent to which scores on one item on a scale are related to scores on all other items on that scale. Ideally, the average inter-item correlation for a set of items is between 0.20 and 0.40. When the values are less than 0.20, the items may not represent the same content domain. Cronbach’s α values greater than 0.75 indicate excellent reliability, while values between 0.40 and 0.75 indicate fair to good reliability, and values less than 0.40 indicate poor reliability [
18,
19]
2.2.2. Rasch Model Analysis
The Rasch model was used to examine the extent to which the interim SCOOHP scale functioned as a measure of oral health coping strategies in individuals with schizophrenia. Given that the goal was to refine the draft instrument, the analysis was primarily used to highlight items or scoring categories that had a substantial “mismatch” with the model, suggesting that they might not usefully contribute to, or may even degrade, the instrument’s performance as a measurement system, which could be removed [
20].
2.2.3. Exploratory Factor Analysis (EFA)
EFA is often used in addition to Rasch analysis to explore characteristics of an instrument, guide its development, and verify that the items measure the same trait [
21]. If this is not the case (Kaiser–Meyer–Olkin, KMO, value > 0.6 and Bartlett test results show significant sphericity), it may be necessary to divide the scale into subscales or delete items [
21,
22].
2.2.4. Analysis of the Confirmatory Factor Analysis (CFA)
A CFA was performed to test stability of factor structure of the final version of the SCOOHP scale, accomplished by investigating the goodness of fit using chi-square/DF; root mean square error of approximation (RMSEA), comparative fit index (CFI), and IFI (incremental fit index) [
23].
2.3. Preliminary Result of the SCOOHP Validity
To study the validity of the SCOOHP scale, it is first assumed that there are correlations between scores of the Brief-COPE scale and the SCOOHP scale. The Brief-COPE scale, the French version of which was validated by Muller and Siptz [
24], is designed to assess the usual way of coping with stressors in daily life. The Brief-COPE scale is also used to assess the particular ways in which individuals cope with a specific stressful situation.
2.4. Ethical Considerations
This study, named “Quality bis”, was approved by the Committee for the Protection of Persons of the Ile de France region (registration number: 2018-A02043-52). After participants had a complete description of the study, informed consent was obtained from each participant, or from the legal guardians of individuals under guardianship. In the latter case, the patient’s legal guardian(s) signed the informed consent.
2.5. Data Analysis
The analysis was conducted using software package R® (Bell Laboratories, New Providence, NJ, USA).
4. Discussion
The SCOOHPI scale was developed to assess oral health coping strategies in PWS. We show that the discrimination indices of each of the 18 items are acceptable, as per the Rasch model, as are the inter-item (0.25) and inter-score correlations (α = 0.85). This scale can be considered an index, with a global score between 0 and 72, and a Likert scale with five response modalities from 0 to 4. It is also a profile of the following three dimensions of coping related to oral health, which emerged independently of each other: physical well-being strategies (α = 0.72); moral well-being strategies (α = 0.60); access strategies towards oral well-being (α = 0.79). The three sub-scores, ranging from 0 to 24, make it possible to specify the populations observed to the coping strategies that may be most affected, depending on the characteristics of the subjects and their clinical health status. With six items per dimension, it is possible to obtain comparable scores of patients’ coping “levels” according to each of the three “physical”, “moral” and “oral” dimensions, and also according to sex, age, disease grade, and type of treatment.
We also observed a discrepancy between presupposed coping strategies (positive or negative) and the final number of dimensions of the SCOOHPI scale after internal structure validation. Three different dimensions allow for a dynamic assessment of coping processes, by assessing the ability to engage in different types of coping responses over time, in response to environmental. This approach is consistent with the “perceived capacity” model of Kato et al. [
26]. This work allowed us to challenge our original assumptions from a biomedical model regarding the consequences of oral health problems, rather than the person affected by those problems [
27]. These results confirm a need to go beyond linear conceptions involving biological, psychological or social causes and “effects” that may improve or worsen health, which are simplistic in accounting for the multifactorial etiology of health [
28]. We find that each issue influences perceived health status in isolation, which is only weakly predictive of perceived health status. This is the case, for example, for major life events, which explain only about 9% of variance in the subsequent development of a cancerous disease [
29].
Comorbidity of psychiatric and somatic disorders is generally associated with many social harms, such as stigmatization and, due to mental disorders, with low autonomy. Conversely, self-determination, or the power to decide for oneself (empowerment), may be a protective factor against the development of various psychiatric and somatic disorders [
30]. The items of the SCOOHPI scale that evaluate the physical or oral well-being dimensions are part of a search for information on the empowerment capacity and desire to control the situation with a physical problem, e.g., “I have a balanced diet”, “I think about washing myself (shower, bath, cleaning)”, “I eat healthy food” or “alcohol, tobacco, drugs have negative effects on my oral health”, or a potential oral problem, e.g., “I brush my teeth and/or my dentures”, “I neglect my oral health”, etc. Coping strategies affect healthy or risky behavior. Generally, emotion-based (or trying to avoid it like stress situation for example) coping is accompanied by risk-taking behavior, such as failure to recognize symptoms, poor adherence to therapy, lack of preventive behavior, and substance abuse. Conversely, problem-focused coping is expressed through active participation in care or compliance with care. However, if the illness is too long-lasting or uncontrollable, such as schizophrenia, the beneficial effects of problem-focused coping strategies may be ineffective [
31].
With regard to moral well-being strategies, studies have shown that perceived stress and its control have an impact on the improvement of coping strategies and on the adoption of healthy or risky behavior [
32,
33]. The SCOOHPI provides information about the control of perceived stress, e.g., “I am looking for simple pleasures (walk, drink coffee, listen to music, watch TV, etc.)”, or, conversely, “I’m afraid to go to the dentist”, – as well as coping strategies used for health (“I manage to visit my dentist”), and risky behavior, e.g., “I forget to brush my teeth”.
Determining the external validity of the scale is an essential step by which we validate whether the studied scale is correlated with other scales assessing the same concept. No SCOOHPI item is well correlated (r > 0.55) with any Brief-COPE item. The Brief-COPE scale is a generic coping scale [
24]. However, the SCOOHP scale, which explores coping strategies, is both specific to oral health and to schizophrenia. These scales address different concepts, and, therefore, we cannot establish correlations. This demonstrates the complexity of constructing tools to assess global health, which refer to measures that give a broad view of health, not referring to specific problems, such as cancer, diabetes, dental problems, or mental disorders; this tool focused on global measures of perceived physical and mental health [
34]. Further studies are needed to clarify these points.
5. Limitations
One of the difficulties in measuring perceived health lies in the dissociation between the reality of the disease, the intensity of the response, and the adequacy of the perception. This difficulty is all the more marked in people suffering from schizophrenia, in which the presence of psychotic elements or cognitive disorders calls into question the ability of these people to document their own health status [
5]. Moreover, the concept of global health, as defined over the last 10 years, includes physical, mental and oral health, and takes into account the environment in which people live, confounding the complexity of the construction of tools that measure perceived health.
The social isolation measures imposed by the COVID-19 pandemic, with disruptions in the care of PWS, generated stress and anxiety. This factor impacted questionnaire responses through this period.
Although we established the internal structure validation of the SCOOHPI scale, as well as the reproducibility of its results, the sensitivity to change (test–retest) and reliability in other PWS populations must continue to be studied.