Next Article in Journal
Infratubercle Anterior Closing Wedge Osteotomy Corrects Sagittal Alignment without Affecting Coronal Alignment or Patellar Height
Previous Article in Journal
Malnutrition and Allergies: Tipping the Immune Balance towards Health
Previous Article in Special Issue
Hyperactivity and Risk for Dysregulation of Mood, Energy, and Social Rhythms Syndrome (DYMERS): Standardization of a Simple One-Item Screener versus the Mood Disorder Questionnaire (MDQ)
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Virtual Reality Cognitive Stimulation Program as an Effective Tool Against Residual/Prodromal Depressive Symptoms in Bipolar Disorders

by
Mauro Giovanni Carta
1,
Peter K. Kurotschka
2,
Sergio Machado
3,4,
Andreas Erfurth
5,
Federica Sancassiani
1,
Alessandra Perra
1,
Massimo Tusconi
6,
Giulia Cossu
1,
Cesar Ivan Aviles Gonzalez
1 and
Diego Primavera
1,*
1
Department of Medical Sciences and Public Health, University of Cagliari, 09042 Cagliari, Italy
2
Department of General Practice, University Hospital Würzburg, 97070 Würzburg, Germany
3
Center of Neuroscience, Neurodiversity Institute, Queimados 26325-010, Brazil
4
Institute of Psychiatry-IPUB, Federal University of Rio de Janeiro, Rio de Janeiro 22290-140, Brazil
5
6th Psychiatric Department, Otto-Wagner-Spital, 1140 Vienna, Austria
6
Azienda Ospedaliero Universitaria di Cagliari, 09042 Cagliari, Italy
*
Author to whom correspondence should be addressed.
J. Clin. Med. 2024, 13(16), 4714; https://doi.org/10.3390/jcm13164714
Submission received: 26 June 2024 / Revised: 8 August 2024 / Accepted: 10 August 2024 / Published: 11 August 2024
(This article belongs to the Special Issue Stress, Rhythms Dysregulation and Bipolar Spectrum)

Abstract

:
Background: Bipolar disorder (BD) is a severe psychiatric illness characterized by a chronic course and recurrent episodes, including residual depressive symptoms even during euthymic phases. These symptoms, although not meeting criteria for a depressive episode, are linked to relapse risk and impaired social functioning. This study aims to assess whether Virtual Reality Cognitive Remediation Training reduces depressive symptoms below the clinical threshold in individuals with BD. Methods: This post hoc analysis focuses on the secondary outcome (PHQ9) of a randomized–controlled trial. Participants were recruited from the Center of Liaison Psychiatry and Psychosomatics in Italy. The experimental group received Virtual Reality Cognitive Remediation, while the control group received standard treatment Results: Data from 39 individuals in the experimental group and 25 in the control group were analyzed. A greater reduction in PHQ-9 scores (>9) was observed in the experimental group (71.8% to 48.7%) compared to the control group. Significant improvements in total PHQ-9 scores and specific symptoms were noted in the experimental group compared to the control group. Conclusions: The study highlights the significant impact of virtual reality intervention on reducing depressive symptoms in bipolar disorder. This promising outcome underscores the potential preventive role of cognitive stimulation in relapse prevention. The intervention could offer valuable benefits for both treatment and prevention strategies in bipolar disorder.

1. Introduction

Bipolar disorder (BD) is a serious psychiatric disorder and one of the leading causes of disability, making it a globally relevant health issue [1,2,3,4]. BD impacts the life of people suffering from it due the higher rate of comorbidity and the associated risk of suicide [5,6]. The prevalence in the community is around 2–4% according to different surveys conducted worldwide [3,7,8]. The onset of the disorder is frequently in adolescence or early adulthood, but BD has a chronic course often lasting over a lifetime, with possible recurrences, each of which worsens the course and residual functionality [9,10]. In bipolar disorder, even during the so-called euthymic phases, residual depressive symptoms have been found with a frequency of approximately 50–70% [11,12]. These subsyndromal manifestations, which do not meet the required criteria for defining a depressive episode, are closely associated with the risk of relapse and low social functioning [13]. Indeed, it has been observed that the presence of residual depressive symptoms primarily influences adherence to pharmacological treatment, a critical element in bipolar disorder. The outcome of this treatment is strongly affected by the regularity of therapy adherence [14,15]. Subthreshold depressive symptoms are also typical during stress phases when individuals with traits of hyperthymia and novelty-seeking may experience the onset of bipolar disorders [16,17,18]. These considerations highlight the importance of therapeutic tools that can impact subsyndromal depressive symptoms in individuals with bipolar disorder or at risk of developing it. The results of a recently conducted randomized–controlled clinical trial on the efficacy of Virtual Reality Cognitive Remediation Training (NCT05070065), aimed at improving the cognitive performance of individuals with bipolar disorder in the euthymic phase, demonstrated a greater reduction in depressive symptoms (measured by the PHQ-9 score [19,20]) in the experimental group compared to the control group [21]. Virtual reality (VR) offers several advantages over traditional paper-and-pencil tasks when designing effective cognitive training programs. To highlight a few, VR boasts enhanced ecological validity, meaning there is a greater resemblance between the training environment and the real world, which is believed to add value in predicting improvements in daily functioning. Secondly, a VR environment—like any digital test—provides the opportunity to offer immediate feedback on performance, which is widely acknowledged as essential for most learning processes and successful rehabilitation. Lastly, VR allows for the customization of environments and activities, making them more engaging [22].

Aims

The aim of this study was to measure if the improvement, namely in decreasing by time the number of people with the number of symptoms, is over the threshold level for a depressive episode. It is in fact known that the threshold defined by PHQ9 can be as reliable as a screener if associated with functional impairment; that is, it is not enough to be positive and have a certain number of symptoms, but to have a diagnosis of depression, a low level of functionality is necessary. In our sample, there are people with acceptable functionality and therefore not in a critical phase; however, there is such a large number of symptoms (as often happens in the stability phases of bipolar disorder) that the screener would identify them as “positive” (i.e., >9). We wanted to see, through a secondary analysis on an outcome defined as secondary in the research project, namely the PHQ9 score, to what extent the reduction was in order to bring people back even below the screener threshold, i.e., clinical significance. It was also our goal to understand the specific symptoms on which virtual reality has a greater effect.

2. Materials and Methods

2.1. Design of the Study

This survey is a post hoc analysis focused on a secondary outcome (PHQ9) of a randomized–controlled trial, registered in ClinicalTrials.gov (NCT05070065, 2021). The project was carried out in agreement with the CONSORT extension guidelines [23].

2.2. Sample, Setting, and Randomization

The sample included people with a diagnosis of bipolar disorder at time of recruitment, in absence of current manic/depressive episode, and receiving treatment at the Care Unit of the Center of Liaison Psychiatry and Psychosomatics of the “Ospedale Civile San Giovanni di Dio” in Cagliari, Italy (University Hospital of Cagliari). Users could be included in the study if they were aged between 18 and 75 years and had received a diagnosis of bipolar disorder according to DSM-IV criteria [24] from a clinical psychiatrist. There was no exclusion based on gender or ethnicity. In addition to people presenting with a current manic/depressive episode, people with serious eye diseases or epilepsy were also excluded because for these disorders, risks were detected in the administration of virtual reality [25,26]. Each selected participant had to sign an informed consent before the beginning of the survey. The researchers that conducted evaluations at T0 and T1 were blinded of the intervention the proband under evaluation underwent (experimental or control).

2.3. Experimental and Control Intervention

A fully immersive Virtual Reality Cognitive Remediation program was administered to the experimental group. A description of the adopted software “CEREBRUM” was presented in a previously published paper [21]. The software was implemented by “PRoMIND” and “IDEGO”, two small/medium-sized Italian high-tech enterprises. The rehabilitation strategy was designed in such a way as to subject the users to tasks of gradually increasing difficulty. The supervising clinician was given the opportunity to adapt the difficulty of the intervention in relation to the participants’ performance and to adapt the task to the user’s specific abilities or potentially improvable gaps. This strategy also had the aim of making the route stimulating and less boring. The experimental group was subjected to 24 sessions with virtual reality of approximately 45 min each, with a frequency of two sessions per week; the duration of the overall intervention was three months. The package was conceived through a human-centered approach [27] that was recovery- and social inclusion-oriented [28,29]. The two compared groups (experimental and control) received treatment as usual (i.e., psychiatric treatment with clinical interviews or pharmacotherapy with the possibility of receiving, if deemed by the psychiatric specialist, psychoeducational interventions or psychotherapy). Therefore, the study compared the experimental group that underwent virtual reality plus treatment as usual to the control group, which underwent only treatment as usual.

2.4. Outcome and Measures

This paper is focused on the measure of depressive symptoms that was planned as a secondary outcome in the deposited protocol [21]. The outcome measure is the score obtained on the Patient Health Questionnaire—9-item version (PHQ9) [20,30], adopted in the Italian validated version [21]. The total score of PHQ scale is obtained by the sum of the score of each item. The nine items each inquire about one of the core symptoms of the depressive episode according to the DSM-5 (Diagnostic and Statistical Manual of Mental Disorders) [31]. According to Kroenke’s work [19], a score lower than 5 almost always identifies the absence of a depressive disorder; scores of 5 to 9 identify people without depression and with subthreshold symptoms, while the important clinical threshold was 10 because having an equal or higher score was frequently associated with clinically relevant depression. Our sample is a sample of people diagnosed with bipolar disorder but without current crises. It therefore seemed important to us to verify whether the treatment resulted in an improvement below 10 in a significant number of people compared to the control group.
The improvement in each item (core symptom of the DSM diagnosis) was calculated as a comparison in the difference of improvement of the average scores on that single PHQ9 item (T0 vs. T1) in the experimental group and in the control group.

2.5. Statistical Analysis

The comparison in the change in number of persons with more than 9 points in the over score of PHQ9 in the two groups by time (T0 vs. T1) was calculated by means of analysis of variance by nominal data by Castella [32], which uses chi-square statistics.
The difference within groups at each timepoint (T1 vs. T0) for the PHQ total and for each PHQ item score was calculated as the difference in the mean score ± standard deviation by means ANOVA 1-way statistics, and a p-value < 0.05 was considered statistically significant.

3. Results

As described in the previous survey on the main outcome, the experimental sample consisted of 39 individuals. Of the 50 recruited, 11 did not complete the intervention and dropped out at follow-up. The control group comprised 25 individuals with no dropouts. No statistically significant differences were found between the experimental and control groups in terms of mean age (47.51 ± 13.52 in the experimental group vs. 46.28 ± 13.40 in the control group; F (1,63) = 0.127; p = 0.723) or in the frequency of sex (females 78.9% in the experimental group vs. 80% in the control group; chi-square (1) = 0.43; p = 0.51).
In the experimental group, individuals with a PHQ9 score greater than 9 decreased from 28 (71.8%) at T0 to 19 (48.7%) at T1 (chi-square = 4.33, p = 0.03). In the control group, individuals with a PHQ9 score greater than 9 remained steady at 10 (40%) from T0 to T1 (chi-square with Yates correction = 0, p = 1). Table 1 shows the change over time in individuals with a PHQ9 score greater than 9 in both groups, where the experimental group saw a 23.1% improvement compared to 0% in the control group (Castellan chi-square = 6.713, p = 0.01).
Table 2 presents the changes over time in the overall PHQ9 score and each item score in the two groups. In the experimental group compared to the control group, there was a significant improvement in the total PHQ9 score (mean improvement score −2.97 ± 0.58 vs. −0.28 ± 1.06, F = 171.9; p < 0.00001) and in the scores of items such as the following:
N°2: Feeling down, depressed, or hopeless (mean improvement score −0.23 ± 0.12 vs. +0.08 ± 0.20, F = 60.22; p < 0.00001);
N°3: Trouble falling or staying asleep or sleeping too much (mean improvement score −0.48 ± 0.18 vs. –0.07 ± 0.20, F = 72.461; p < 0.00001);
N°5: Poor appetite or overeating (mean improvement score −0.26 ± 0.14 vs. +0.08 ± 0.17, F = 79.90; p < 0.00001);
N°6: Feeling bad about oneself, feeling like a failure, or feeling that one has let oneself or one’s family down (mean improvement score −0.46 ± 0.15 vs. −0.08 ± 0.25, F = 57.91; p < 0.00001);
N°7: Trouble concentrating on things such as reading the newspaper or watching television (mean improvement score −0.41 ± 0.15 vs. −0.04 ± 0.24, F = 57.79; p < 0.00001);
N°8: Being so fidgety or restless that one has been moving around a lot more than usual or moving or speaking so slowly that others might have noticed (mean improvement score −0.26 ± 0.12 vs. −0.04 ± 0.18, F = 44.92; p < 0.00001);
N°9: Thoughts that one would be better off dead or thoughts of hurting oneself in some way (mean improvement score −0.08 ± 0.09 vs. +0.12 ± 0.13, F = 52.959; p < 0.00001).
There were no statistically significant differences in the change by time in the two groups in the mean responses of the items N°1—Little interest or pleasure in doing things and N°4—Feeling tired or having little energy.

4. Discussion

Our study showed that the preliminary result emerging from the first article on the randomized–controlled study NCT05070065, i.e., that the virtual reality intervention lowered the depressive symptoms [21], is of such magnitude that it can have an impact on the clinical and preventive field. In fact, the data of this study showed a decrease from T0 to T1 in the experimental group (which underwent the virtual reality training) in the number of those who had a score on PHQ9 (measure of depressive state) that would be considered positive in a screening survey for a depressive episode (i.e., overall score greater than 9). The decrease was greater in comparison to the control group. As explained in the methodology, the sample of this study is characterized by people with a diagnosis of bipolar disorder in a current condition of stability without crises. However (as is typical of people who access a specialized tertiary care center), most of them show several residual depressive symptoms despite an acceptable level of social functioning. This condition is at high risk of relapse [13,33,34] and can compromise the course of treatment because it is associated with low adherence to therapy [14]; thus, having a tool that, perhaps through future improvements, can be capable of lowering the number of depressive symptoms to the point that approximately one-quarter of patients descend the risk threshold could be an important element in the field of prevention of relapses of bipolar disorder [35].
Although interesting research is ongoing about the potential use of virtual reality in major depressive disorder, with encouraging findings, most of them are pilot studies [36,37,38,39], and there is no similar literature relating to bipolar disorder. The application in the field of bipolar disorder has so far been highly experimental and suggestive of further developments, such as creating virtual environments that indicate induced excitement and tension “inducing relevant state aspects of hypomania … suitable as a paradigm for future experimental studies” [40]. The same applies to the development of experimental interventions to work on the emotional dysregulation of people with bipolar disorder and their relatives, a field that seems very promising but of which there is still a lack of data regarding the repercussions in terms of outcome because it is in early development [41,42,43].
From this perspective, our study serves as a significant starting point despite its primary focus on cognitive performance enhancement rather than directly targeting depressive symptoms. To comprehend the intervention’s mechanism, insights from studies investigating social cognition deficits among euthymic individuals with BD can be useful [44,45]. Social cognition encompasses both cognitive and affective aspects, with impairments in these domains correlating with residual BD symptoms [46,47]. Exploring the relationship between cognitive remediation interventions and social cognition deficits in BD individuals may shed light on the underlying mechanisms of our intervention’s efficacy [48,49]. Virtual reality (VR) technology facilitates the examination of these relationships, providing a platform to assess cognitive and emotional processing in controlled environments [27]. Understanding how cognitive stimulation interventions impact social cognition in BD individuals is crucial for optimizing treatment strategies [50]. By addressing deficits in social cognition, interventions may indirectly alleviate depressive symptoms and reduce the risk of relapse in BD patients. Furthermore, elucidating the neural correlates of social cognition deficits in BD using VR technology can inform the development of targeted interventions [51]. By targeting specific brain regions associated with social cognition impairments, such interventions may yield more significant improvements in depressive symptomatology and overall functional outcomes. Our study lays the groundwork for future research aimed at elucidating the interplay between cognitive enhancement interventions, social cognition deficits, and depressive symptoms in BD. Leveraging VR technology and insights from the existing literature can guide the development of more effective therapeutic approaches tailored to the unique needs of individuals with BD. To understand how the intervention may have worked, it may be useful to recall some recent studies that have shown (again, thanks to the use of virtual reality) that people suffering from bipolar disorder in euthymia have a serious deficit in social cognition activities [52,53,54]. Social skill involves both cognitive and affective processing, impairments of which have been found linked to residual symptoms of bipolar disorder because the implications in the impairments in processing do not change from a cognitive perspective when appropriate [53,55,56,57,58]. This impairment compromises the ability to understand the emotions and intentions of others but also may limit the understanding of their own symptoms [52,55,59,60]. The combination of virtual reality and imaging has made it possible to verify that when faced with emotional conditions that require cognitive responses, while controls without bipolar disorders activated the right anterior cingulate cortex, the insular cortex, and the inferior frontal cortex, people with bipolar disorder had reduced activations in the “mirror neuron system” (i.e., the right inferior frontal cortex, the insula, and the premotor cortex) [52,61]. This may explain why undergoing cognitive remediation training (although it would be more correct at this point to call it “cognitive stimulation”) can improve depressive symptoms. Above all, this is because the environment does not involve high-stress stimuli (because in virtual reality, the person is alone, and the clinician calibrates the tasks) and was built in such a way that the skills learned can be easily generalizable in daily life, the process of which was fun and not boring (which is essential for people with the basic characteristics of bipolar disorder). In fact, the depressive symptoms that improved the most in the experimental versus control group comparison were precisely those linked to self-esteem (N°6—“Feeling bad about yourself or that you are a failure or have disappointed yourself or your family”) and those linked to dysregulation of sleep (N°3—Difficulty falling or staying asleep or sleeping too much). This may support the hypothesis that virtual reality affects self-esteem by improving skills in emotional cognition and consequently improves stress symptoms (such as sleep and appetite dysregulation), known as important elements linking residual symptoms with triggering relapses [12,62,63] and suicidal ideation in bipolar disorders [64,65].
The intervention seems to act on key elements of functioning (social cognition, frustration, and stress with dysregulation of rhythms) that seem to be typical of “DYMERS”, i.e., a recently described stress syndrome [17,66] that, in people with a profile of hyper-energy, hyperactivity, and novelty-seeking [17,67], can represent an antecedent of bipolar disorder [67,68] and/or other disorders [18].
From this point of view, cognitive stimulation intervention could be useful not only in the field of prevention of relapses in bipolar disorder (where the positive effects could be immense if the result were reconfirmed) but also in the reduction in risk for at-risk people.

5. Conclusions

The findings seem to suggest that cognitive stimulation utilizing virtual reality may offer utility in the field of preventing relapses in bipolar disorder. Prevention of the relapse of depressive symptoms could indeed serve as an essential factor in enhancing the course of bipolar disorder. Cognitive stimulation seems to target the decline in social cognition and subsequent symptoms of low self-esteem and stress-related rhythm dysregulation. Moreover, the intervention holds promise for preempting relapses in individuals at risk. Further validation of our study outcomes is warranted through phase-three trials conducted in a multicenter manner. This robust approach will help solidify the reliability and generalizability of our findings, bolstering their applicability in clinical settings. Additionally, examining the long-term effects and scalability of cognitive stimulation interventions through multicenter studies can provide valuable insights into their sustained efficacy and potential integration into routine care protocols for bipolar disorder management.

Author Contributions

Conceptualization, M.G.C. and D.P.; methodology, P.K.K., S.M. and A.E.; software, A.P. and M.T.; validation, F.S., A.P., M.T., G.C. and C.I.A.G.; formal analysis, M.G.C. and P.K.K.; investigation, F.S. and D.P.; resources, M.G.C.; data curation, A.P. and D.P.; writing—original draft preparation, D.P. and M.G.C.; writing—review and editing, S.M. and M.T.; visualization, A.P.; supervision, F.S. and D.P.; project administration, D.P. and G.C.; funding acquisition, M.G.C. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported by Fondazione di Sardegna 2023 prot. U809.2024/AI.789.PL Pratica 2024.0459.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki and approved by the Ethics Committee of Cagliari under the designation Prot. PG/2020/21681 in 2020. Additionally, this study is registered on ClinicalTrials.gov (NCT05070065, September 2021). Prior to enrollment, all patients provided written informed consent either personally or through their legal guardians.

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

Data is contained within the article.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Angst, J. Bipolar disorder—A seriously underestimated health burden. Eur. Arch. Psychiatry Clin. Neurosci. 2004, 254, 59–60. [Google Scholar] [CrossRef] [PubMed]
  2. Wittchen, H.U.; Jacobi, F.; Rehm, J.; Gustavsson, A.; Svensson, M.; Jönsson, B.; Olesen, J.; Allgulander, C.; Alonso, J.; Faravelli, C.; et al. The size and burden of mental disorders and other disorders of the brain in Europe 2010. Eur. Neuropsychopharmacol. 2011, 21, 655–679. [Google Scholar] [CrossRef] [PubMed]
  3. Carta, M.G.; Angst, J. Screening for bipolar disorders: A public health issue. J. Affect. Disord. 2016, 205, 139–143. [Google Scholar] [CrossRef]
  4. Chumakov, E.; Ashenbrenner, Y.; Gvozdetskii, A.; Limankin, O.; Petrova, N. Individual Burden of Illness Index in Bipolar Disorder Remission: A Cross-Sectional Study. Consort Psychiatr. 2024, 5, 17–30. [Google Scholar] [CrossRef] [PubMed]
  5. Fajutrao, L.; Locklear, J.; Priaulx, J.; Heyes, A. A systematic review of the evidence of the burden of bipolar disorder in Europe. Clin. Pract. Epidemiol. Ment. Health 2009, 5, 3. [Google Scholar] [CrossRef] [PubMed]
  6. Dev, D.A.; Le, G.H.; Kwan, A.T.H.; Wong, S.; Arulmozhi, A.; Ceban, F.; Teopiz, K.M.; Meshkat, S.; Rosenblat, J.D.; Guillen-Burgos, H.F.; et al. Comparing suicide completion rates in bipolar I versus bipolar II disorder: A systematic review and meta-analysis. J. Affect. Disord. 2024, 361, 480–488. [Google Scholar] [CrossRef] [PubMed]
  7. Merikangas, K.R.; Cui, L.; Kattan, G.; Carlson, G.; Youngstrom, E.A.; Angst, J. Mania with and without depression in a community sample of U.S. adolescents. Arch. Gen. Psychiatry 2012, 69, 943–951. [Google Scholar] [CrossRef] [PubMed]
  8. Esan, O.; Esan, A. Epidemiology and burden of bipolar disorder in Africa: A systematic review of data from Africa. Soc. Psychiatry Psychiatr. Epidemiol. 2016, 51, 93–100. [Google Scholar] [CrossRef] [PubMed]
  9. Vázquez, G.H.; Holtzman, J.N.; Lolich, M.; Ketter, T.A.; Baldessarini, R.J. Recurrence rates in bipolar disorder: Systematic comparison of long-term prospective, naturalistic studies versus randomized controlled trials. Eur. Neuropsychopharmacol. 2015, 25, 1501–1512. [Google Scholar] [CrossRef]
  10. Keck, P.E., Jr.; McElroy, S.L.; Arnold, L.M. Bipolar disorder. Med. Clin. N. Am. 2001, 85, 645–661. [Google Scholar] [CrossRef] [PubMed]
  11. Dupouy, M.; Roux, P.; Munuera, C.; Weil, F.; Passerieux, C.; M’Bailara, K. The purpose of early maladaptive schemas (EMS) in the relationship dysfunction among people with bipolar disorder in the euthymic phase. Encephale 2024, 50, 265–274. [Google Scholar] [CrossRef] [PubMed]
  12. Caruso, D.; Meyrel, M.; Krane-Gartiser, K.; Benard, V.; Benizri, C.; Brochard, H.; Geoffroy, P.A.; Gross, G.; Maruani, J.; Prunas, C.; et al. Eveningness and poor sleep quality contribute to depressive residual symptoms and behavioral inhibition in patients with bipolar disorder. Chronobiol. Int. 2020, 37, 101–110. [Google Scholar] [CrossRef] [PubMed]
  13. Serafini, G.; Vazquez, G.H.; Gonda, X.; Pompili, M.; Rihmer, Z.; Amore, M. Depressive residual symptoms are associated with illness course characteristics in a sample of outpatients with bipolar disorder. Eur. Arch. Psychiatry Clin. Neurosci. 2018, 268, 757–768. [Google Scholar] [CrossRef] [PubMed]
  14. Belzeaux, R.; Correard, N.; Boyer, L.; Etain, B.; Loftus, J.; Bellivier, F.; Bougerol, T.; Courtet, P.; Gard, S.; Kahn, J.P.; et al. Depressive residual symptoms are associated with lower adherence to medication in bipolar patients without substance use disorder: Results from the FACE-BD cohort. J. Affect. Disord. 2013, 151, 1009–1015. [Google Scholar] [CrossRef] [PubMed]
  15. Pereira, C.S.; Padoan, C.S.; Silva, M.M.; Magalhães, P.V.S. A grounded theory on acceptance of diagnosis as a pathway to recovery in bipolar disorder. Sci. Rep. 2024, 14, 13434. [Google Scholar] [CrossRef] [PubMed]
  16. Kalcev, G.; Scano, A.; Orrù, G.; Primavera, D.; Cossu, G.; Nardi, A.E.; Carta, M.G. Is a Genetic Variant associated with Bipolar Disorder Frequent in People without Bipolar Disorder but with Characteristics of Hyperactivity and Novelty Seeking? Clin. Pract. Epidemiol. Ment. Health 2023, 19, e174501792303280. [Google Scholar] [CrossRef] [PubMed]
  17. Carta, M.G.; Kalcev, G.; Fornaro, M.; Pinna, S.; Gonzalez, C.I.A.; Nardi, A.E.; Primavera, D. Does Screening for Bipolar Disorders Identify a Dysregulation of Mood, Energy, and Social Rhythms Syndrome DYMERS: A Heuristic Working Hypothesis. J. Clin. Med. 2023, 12, 5162. [Google Scholar] [CrossRef] [PubMed]
  18. Primavera, D.; Cossu, G.; Marchegiani, S.; Preti, A.; Nardi, A.E. Does the Dysregulation of Social Rhythms Syndrome (DYMERS) be Considered an Essential Component of Panic Disorders? Clin. Pract. Epidemiol. Ment. Health 2024, 20, e17450179293272. [Google Scholar] [CrossRef] [PubMed]
  19. Kroenke, K.; Spitzer, R.L.; Williams, J.B. The PHQ-9: Validity of a brief depression severity measure. J. Gen. Intern. Med. 2001, 16, 606–613. [Google Scholar] [CrossRef] [PubMed]
  20. Mazzotti, E.; Fassone, G.; Picardi, A.; Sagoni, E.; Ramieri, L.; Lega, I.; Camaioni, D.; Abeni, D.; Pasquini, P. Il Patient health questionnaire (PHQ) per lo screening dei disturbi psichiatrici: Uno studio di validazione nei confronti della intervista clinica strutturata per il DSM-IV asse I (SCID-I). Ital. J. Psychopathol. 2003, 9, 235–242. [Google Scholar]
  21. Perra, A.; Galetti, A.; Zaccheddu, R.; Locci, A.; Piludu, F.; Preti, A.; Primavera, D.; Di Natale, L.; Nardi, A.E.; Kurotshka, P.K.; et al. A Recovery-Oriented Program for People with Bipolar Disorder through Virtual Reality-Based Cognitive Remediation: Results of a Feasibility Randomized Clinical Trial. J. Clin. Med. 2023, 12, 2142. [Google Scholar] [CrossRef] [PubMed]
  22. Manera, V.; Chapoulie, E.; Bourgeois, J.; Guerchouche, R.; David, R.; Ondrej, J.; Drettakis, G.; Robert, P. A Feasibility Study with Image-Based Rendered Virtual Reality in Patients with Mild Cognitive Impairment and Dementia. PLoS ONE 2016, 11, e0151487. [Google Scholar] [CrossRef] [PubMed] [PubMed Central]
  23. Eldridge, S.M.; Chan, C.L.; Campbell, M.J.; Bond, C.M.; Hopewell, S.; Thabane, L.; Lancaster GA PAFS Consensus Group. CONSORT 2010 statement: Extension to randomised pilot and feasibility trials. BMJ 2016, 355, i5239. [Google Scholar] [CrossRef] [PubMed]
  24. American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders; American Psychiatric Association: Washington, DC, USA, 2000. [Google Scholar]
  25. Fisher, R.S.; Acharya, J.N.; Baumer, F.M.; French, J.A.; Parisi, P.; Solodar, J.H.; Szaflarski, J.P.; Thio, L.L.; Tolchin, B.; Wilkins, A.J.; et al. Visually sensitive seizures: An updated review by the Epilepsy Foundation. Epilepsia 2022, 63, 739–768. [Google Scholar] [CrossRef] [PubMed]
  26. Wilson, E.; Ibragimov, A.; Proulx, M.J.; Tetali, S.D.; Butler, K.; Jain, E. Privacy-Preserving Gaze Data Streaming in Immersive Interactive Virtual Reality: Robustness and User Experience. IEEE Trans. Vis. Comput. Graph. 2024, 30, 2257–2268. [Google Scholar] [CrossRef] [PubMed]
  27. Skivington, K.; Matthews, L.; Simpson, S.A.; Craig, P.; Baird, J.; Blazeby, J.M.; Boyd, K.A.; Craig, N.; French, D.P.; McIntosh, E.; et al. A new framework for developing and evaluating complex interventions: Update of Medical Research Council guidance. BMJ 2021, 374, n2061. [Google Scholar] [CrossRef] [PubMed]
  28. Shaigetz, V.G.; Proulx, C.; Cabral, A.; Choudhury, N.; Hewko, M.; Kohlenberg, E.; Segado, M.; Smith, M.S.D.; Debergue, P. An Immersive and Interactive Platform for Cognitive Assessment and Rehabilitation (bWell): Design and Iterative Development Process. JMIR Rehabil. Assist. Technol. 2021, 8, e26629. [Google Scholar] [CrossRef] [PubMed]
  29. Saxena, S.; Funk, M.; Chisholm, D. World Health Assembly adopts Comprehensive Mental Health Action Plan 2013–2020. Lancet 2013, 381, 1970–1971. [Google Scholar] [CrossRef] [PubMed]
  30. Spitzer, R.L.; Kroenke, K.; Williams, J.B. Validation and utility of a self-report version of PRIME-MD: The PHQ primary care study. Primary care evaluation of mental disorders. Patient health questionnaire. JAMA 1999, 282, 1737–1744. [Google Scholar] [CrossRef] [PubMed]
  31. APA (American Psychiatric Association). Diagnostic and Statistical Manual of Mental Disorders: DSM-5, 5th ed.; American Psychiatric Association: Arlington, TX, USA, 2013. [Google Scholar]
  32. Siegel, S.; Castellan, N.J. Nonparametric Statistics for the Behavioral Sciences; McGraw Hill: New York, NY, USA, 1988. [Google Scholar]
  33. Judd, L.L.; Schettler, P.J.; Akiskal, H.S.; Coryell, W.; Leon, A.C.; Maser, J.D.; Solomon, D.A. Residual symptom recovery from major affective episodes in bipolar disorders and rapid episode relapse/recurrence. Arch. Gen. Psychiatry 2008, 65, 386–394. [Google Scholar] [CrossRef] [PubMed]
  34. Belete, H.; Ali, T.; Legas, G. Relapse and Clinical Characteristics of Patients with Bipolar Disorders in Central Ethiopia: A Cross-Sectional Study. Psychiatry J. 2020, 2020, 8986014. [Google Scholar] [CrossRef] [PubMed]
  35. Rybakowski, J. Sixty years of recurrence prevention in mood disorders. Psychiatr. Pol. 2024, 58, 223–236. [Google Scholar] [CrossRef] [PubMed]
  36. Reategui-Rivera, C.M.; Villarreal-Zegarra, D.; De La Cruz-Torralva, K.; Díaz-Sánchez, P.; Finkelstein, J. Immersive Technologies for Depression Care: Scoping Review. JMIR Ment. Health 2024, 11, e56056. [Google Scholar] [CrossRef]
  37. Restout, J.; Bernache-Assollant, I.; Morizio, C.; Boujut, A.; Angelini, L.; Tchalla, A.; Perrochon, A. Fully Immersive Virtual Reality Using 360 Videos to Manage Well-Being in Older Adults: A Scoping Review. J. Am. Med. Dir. Assoc. 2023, 24, 564–572. [Google Scholar] [CrossRef] [PubMed]
  38. Peng, Y.; Wang, Y.; Zhang, L.; Zhang, Y.; Sha, L.; Dong, J.; He, Y. Virtual reality exergames for improving physical function, cognition and depression among older nursing home residents: A systematic review and meta-analysis. Geriatr. Nurs. 2024, 57, 31–44. [Google Scholar] [CrossRef]
  39. Paul, M.; Bullock, K.; Bailenson, J.; Burns, D. Examining the Efficacy of Extended Reality-Enhanced Behavioral Activation for Adults with Major Depressive Disorder: Randomized Controlled Trial. JMIR Ment. Health 2024, 11, e52326. [Google Scholar] [CrossRef] [PubMed]
  40. Glas, R.V.F.J.; de Kleijn, R.E.; Regeer, E.J.; Kupka, R.W.; Koenders, M.A. Do you feel up when you go up? A pilot study of a virtual reality manic-like mood induction paradigm. Br. J. Clin. Psychol. 2024, 63, 105–117. [Google Scholar] [CrossRef] [PubMed]
  41. Kjærstad, H.L.; Hellum, K.S.; Haslum, N.H.; Lopes, M.N.; Noer, T.S.; Kessing, L.V.; Miskowiak, K.W. Assessment of the validity and feasibility of a novel virtual reality test of emotion regulation in patients with bipolar disorder and their unaffected relatives. J. Affect. Disord. 2022, 318, 217–223. [Google Scholar] [CrossRef] [PubMed]
  42. Kjærstad, H.L.; Vinberg, M.; Goldin, P.R.; Køster, N.; Støttrup, M.M.D.; Knorr, U.; Kessing, L.V.; Miskowiak, K.W. Impaired down-regulation of negative emotion in self-referent social situations in bipolar disorder: A pilot study of a novel experimental paradigm. Psychiatry Res. 2016, 238, 318–325. [Google Scholar] [CrossRef] [PubMed]
  43. Kjærstad, H.L.; Søhol, K.; Vinberg, M.; Kessing, L.V.; Miskowiak, K.W. The trajectory of emotional and non-emotional cognitive function in newly diagnosed patients with bipolar disorder and their unaffected relatives: A 16-month follow-up study. Eur. Neuropsychopharmacol. 2023, 67, 4–21. [Google Scholar] [CrossRef] [PubMed]
  44. Kjærstad, H.L.; de Siqueira Rotenberg, L.; Macoveanu, J.; Coello, K.; Faurholt-Jepsen, M.; Bjertrup, A.J.; Knudsen, G.M.; Fisher, P.M.; Vinberg, M.; Kessing, L.V.; et al. Stable neural underpinnings of emotional cognition subgroups in patients newly diagnosed with bipolar disorder: A prospective fMRI study. Bipolar. Disord. 2024. ahead of print. [Google Scholar] [CrossRef]
  45. Camprodon-Boadas, P.; De Prisco, M.; Rabelo-da-Ponte, F.D.; Sugranyes, G.; Clougher, D.; Baeza, I.; Torrent, C.; Castro-Fornieles, J.; Tosetti, Y.; Vieta, E.; et al. Cognitive reserve and cognition in mood disorders: A systematic review and meta-analysis. Psychiatry Res. 2024, 339, 116083. [Google Scholar] [CrossRef] [PubMed]
  46. Ogden, J. Some problems with social cognition models: A pragmatic and conceptual analysis. Health Psychol. 2003, 22, 424–428. [Google Scholar] [CrossRef] [PubMed]
  47. Green, M.F.; Penn, D.L.; Bentall, R.; Carpenter, W.T.; Gaebel, W.; Gur, R.C.; Kring, A.M.; Park, S.; Silverstein, S.M.; Heinssen, R. Social cognition in schizophrenia: An NIMH workshop on definitions, assessment, and research opportunities. Schizophr. Bull. 2008, 34, 1211–1220. [Google Scholar] [CrossRef] [PubMed]
  48. Marañes, C.; Gutierrez, D.; Serrano, A. Revisiting the Heider and Simmel experiment for social meaning attribution in virtual reality. Sci. Rep. 2024, 14, 17103. [Google Scholar] [CrossRef] [PubMed]
  49. Bernal-Berdun, E.; Vallejo, M.; Sun, Q.; Serrano, A.; Gutierrez, D. Modeling the Impact of Head-Body Rotations on Audio-Visual Spatial Perception for Virtual Reality Applications. IEEE Trans. Vis. Comput. Graph. 2024, 30, 2624–2632. [Google Scholar] [CrossRef] [PubMed]
  50. Primavera, D.; Migliaccio, G.M.; Garau, V.; Orrù, G.; Scano, A.; Perra, A.; Pinna, S.; Tusconi, M.; Carta, M.G.; Sancassiani, F. Improving Quality of Life in Bipolar Disorders with an Immersive Virtual Reality Remediation Training Randomized Controlled Trial (RCT). J. Clin. Med. 2024, 13, 3886. [Google Scholar] [CrossRef] [PubMed] [PubMed Central]
  51. Sancassiani, F.; Perra, A.; Kurotschka, P.K.; Kalcev, G.; Galetti, A.; Zaccheddu, R.; Locci, A.; Piludu, F.; Di Natale, L.; De Lorenzo, V.; et al. Improving Social and Personal Rhythm Dysregulation in Young and Old Adults with Bipolar Disorder: Post-Hoc Analysis of a Feasibility Randomized Controlled Trial Using Virtual Reality-Based Intervention. J. Clin. Med. 2024, 13, 3786. [Google Scholar] [CrossRef] [PubMed] [PubMed Central]
  52. Kim, E.; Jung, Y.C.; Ku, J.; Kim, J.J.; Lee, H.; Kim, S.Y.; Kim, S.I.; Cho, H.S. Reduced activation in the mirror neuron system during a virtual social cognition task in euthymic bipolar disorder. Prog. Neuropsychopharmacol. Biol. Psychiatry 2009, 33, 1409–1416. [Google Scholar] [CrossRef] [PubMed]
  53. Rosen, H.R.; Rich, B.A. Neurocognitive correlates of emotional stimulus processing in pediatric bipolar disorder: A review. Postgrad. Med. 2010, 122, 94–104. [Google Scholar] [CrossRef] [PubMed]
  54. Liang, Y.S.; Zhou, S.Z.; Zhang, Y.J.; Cai, X.L.; Wang, Y.; Cheung, E.F.C.; Lui, S.S.Y.; Yu, X.; Madsen, K.H.; Ma, Y.T.; et al. Altered empathy-related resting-state functional connectivity in patients with bipolar disorder. Eur. Arch. Psychiatry Clin. Neurosci. 2022, 272, 839–848. [Google Scholar] [CrossRef] [PubMed]
  55. Malhi, G.S.; Lagopoulos, J.; Das, P.; Moss, K.; Berk, M.; Coulston, C.M. A functional MRI study of Theory of Mind in euthymic bipolar disorder patients. Bipolar. Disord. 2008, 10, 943–956. [Google Scholar] [CrossRef] [PubMed]
  56. Green, M.J.; Cahill, C.M.; Malhi, G.S. The cognitive and neurophysiological basis of emotion dysregulation in bipolar disorder. J. Affect. Disord. 2007, 103, 29–42. [Google Scholar] [CrossRef] [PubMed]
  57. Choudhary, S.; Subodh, B.N.; Grover, S. Social cognition in siblings of patients with bipolar disorders. Ind. Psychiatry J. 2021, 30, 157–164. [Google Scholar] [CrossRef] [PubMed]
  58. McPhilemy, G.; Nabulsi, L.; Kilmartin, L.; Whittaker, J.R.; Martyn, F.M.; Hallahan, B.; McDonald, C.; Murphy, K.; Cannon, D.M. Resting-State Network Patterns Underlying Cognitive Function in Bipolar Disorder: A Graph Theoretical Analysis. Brain Connect. 2020, 10, 355–367. [Google Scholar] [CrossRef] [PubMed]
  59. Torres, I.J.; Mackala, S.A.; Kozicky, J.M.; Yatham, L.N. Metacognitive knowledge and experience in recently diagnosed patients with bipolar disorder. J. Clin. Exp. Neuropsychol. 2016, 38, 730–744. [Google Scholar] [CrossRef] [PubMed]
  60. Konstantakopoulos, G. Insight across mental disorders: A multifaceted metacognitive phenomenon. Psychiatriki 2019, 30, 13–16. [Google Scholar] [CrossRef] [PubMed]
  61. Kim, S.; Kim, Y.W.; Shim, M.; Jin, M.J.; Im, C.H.; Lee, S.H. Altered Cortical Functional Networks in Patients with Schizophrenia and Bipolar Disorder: A Resting-State Electroencephalographic Study. Front. Psychiatry 2020, 11, 661. [Google Scholar] [CrossRef] [PubMed]
  62. Seo, J.Y.; Yeom, J.W.; Cho, C.H.; Son, S.; Ahn, Y.M.; Kim, S.J.; Ha, T.H.; Cha, B.; Moon, E.; Park, D.Y.; et al. The relationship between morningness-eveningness and mood symptoms and quality of life in euthymic state of mood disorders: Results from a prospective observational cohort study. J. Affect. Disord. 2022, 316, 10–16. [Google Scholar] [CrossRef] [PubMed]
  63. Cretu, J.B.; Culver, J.L.; Goffin, K.C.; Shah, S.; Ketter, T.A. Sleep, residual mood symptoms, and time to relapse in recovered patients with bipolar disorder. J. Affect. Disord. 2016, 190, 162–166. [Google Scholar] [CrossRef] [PubMed]
  64. Caruso, D.; Palagini, L.; Miniati, M.; Massa, L.; Marazziti, D.; Geoffroy, P.A.; Etain, B. Early Life Stress and Chronobiological Rhythms Desynchronization: Possible Impact on Mood Symptoms and Suicidal Ideation in Bipolar Disorder. J. Nerv. Ment. Dis. 2021, 209, 518–524. [Google Scholar] [CrossRef]
  65. Palagini, L.; Miniati, M.; Marazziti, D.; Sharma, V.; Riemann, D. Association among early life stress, mood features, hopelessness and suicidal risk in bipolar disorder: The potential contribution of insomnia symptoms. J. Psychiatr. Res. 2021, 135, 52–59. [Google Scholar] [CrossRef]
  66. Primavera, D.; Aviles Gonzalez, C.I.; Romano, F.; Kalcev, G.; Pinna, S.; Minerba, L.; Scano, A.; Orrù, G.; Cossu, G. Does the Response to a Stressful Condition in Older Adults with Life Rhythm Dysregulations Provide Evidence of the Existence of the “Dysregulation of Mood, Energy, and Social Rhythms Syndrom”. Healthcare 2023, 12, 87. [Google Scholar] [CrossRef]
  67. Carta, M.G.; Kalcev, G.; Scano, A.; Pinna, S.; Gonzalez, C.I.A.; Nardi, A.E.; Orrù, G.; Primavera, D. Screening, Genetic Variants, and Bipolar Disorders: Can Useful Hypotheses Arise from the Sum of Partial Failures? Clin. Pract. 2023, 13, 853–862. [Google Scholar] [CrossRef]
  68. Kalcev, G.; Cossu, G.; Preti, A.; Littera, M.T.; Frau, S.; Primavera, D.; Zaccheddu, R.; Matza, V.; Ermellino, M.; Pintus, E.; et al. Development and Validation of the Questionnaire for Adaptive Hyperactivity and Goal Achievement (AHGA). Clin. Pract. Epidemiol. Ment. Health 2023, 19, e174501792303281. [Google Scholar] [CrossRef]
Table 1. Change by time in people with PHQ9 > 9 in the two groups.
Table 1. Change by time in people with PHQ9 > 9 in the two groups.
T0T1NCastellan Chi-Square
PHQ9 > 9 EX28 (71.8%)19 (48.7%)396.71
PHQ9 > 9 CC10 (40%)10 (40%)25p = 0.01
EX: experimental group; CC: control group.
Table 2. Change by time of the overall score and of each item of PHQ9 in the two groups.
Table 2. Change by time of the overall score and of each item of PHQ9 in the two groups.
PHQ9 T0PHQ9 T1Mean Score
T0 PHQ9 Total (n = 39) EX13.72 ± 6.1210.82 ± 6.45−2.90 ± 0.58
T0 PHQ9 Total (n = 25) CC12.20 ± 6.2611.92 ± 7.45−0.28 ± 1.06
F = 163.11; p < 0.00001
T0 PHQ9 Item1 (n = 39) EX1.56 ± 0.921.20 ± 0.85−0.36 ± 0.16
T0 PHQ9 Item1 (n = 25) CC1.56 ± 0.981.24 ± 0.94−0.32 ± 0.24
Little interest or pleasure in doing things F = 0.64; p = 0.42
T0 PHQ9 Item 2 (n = 39) EX1.56 ± 0.891.30 ± 0.96−0.23 ± 0.12
T0 PHQ9 Item 2 (n = 25) CC1.36 ± 0.931.44 ± 1.02+0.08 ± 0.20
Feeling down, depressed, or hopeless F = 60.22; p < 0.00001
T0 PHQ9 Item 3 (n = 39) EX1.84 ± 1.181.38 ± 1.16−0.48 ± 0.18
T0 PHQ9 Item 3 (n = 25) CC1.88 ± 1.031.75 ± 1.19−0.07 ± 0.20
Trouble falling or staying asleep or sleeping too much F = 72.46; p < 0.00001
T0 PHQ9 Item 4 (n = 39) EX1.64 ± 1.041.66 ± 0.910.02 ± 0.12
T0 PHQ9 Item 4 (n = 25) CC1.56 ± 0.891.68 ± 1.040.08 ± 0.17
Feeling tired or having little energy F = 2.74; p = 10.3
T0 PHQ9 Item 5 (n = 39) EX1.60 ± 1.031.34 ± 1.00−0.26 ± 0.14
T0 PHQ9 Item 5 (n = 25) CC1.40 ± 1.131.48 ± 1.13+0.08 ± 0.17
Poor appetite or overeating F = 79.90; p < 0.0001
T0 PHQ9 Item 6 (n = 39) EX1.56 ± 1.071.10 ± 0.98−0.46 ± 0.15
T0 PHQ9 Item 6 (n = 25) CC1.36 ± 1.051.28 ± 1.04−0.08 ± 0.25
Feeling bad about yourself or that you are a failure or have let yourself or your family down F = 57.91; p < 0.0001
T0 PHQ9 Item 7 (n = 39) EX1.76 ± 1.041.35 ± 0.89−0.41 ± 0.15
T0 PHQ9 Item 7 (n = 25) CC1.40 ± 1.091.36 ± 0.97−0.04 ± 0.24
Trouble concentrating on things such as reading the newspaper or watching television F = 57.79; p < 0.0001
T0 PHQ9 Item 8 (n = 39) EX1.10 ± 1.080.84 ± 1.07−0.26 ± 0.12
T0 PHQ9 Item 8 (n = 25) CC1.08 ± 0.891.04 ± 1.11−0.04 ± 0.18
Moving or speaking so slowly that other people could have noticed or the opposite—being so fidgety or restless that you have been moving around a lot more than usual F = 44.92; p < 0.0001
T0 PHQ9 Item 9 (n = 39) EX0.64 ± 0.940.56 ± 0.81−0.08 ± 0.09
T0 PHQ9 Item 9 (n = 25) CC0.60 ± 0.890.72 ± 1.07+0.12 ± 0.13
Thoughts that you would be better off dead or thoughts of hurting yourself in some way F = 52.95; p < 0.0001
EX: experimental group; CC: control group.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Carta, M.G.; Kurotschka, P.K.; Machado, S.; Erfurth, A.; Sancassiani, F.; Perra, A.; Tusconi, M.; Cossu, G.; Aviles Gonzalez, C.I.; Primavera, D. A Virtual Reality Cognitive Stimulation Program as an Effective Tool Against Residual/Prodromal Depressive Symptoms in Bipolar Disorders. J. Clin. Med. 2024, 13, 4714. https://doi.org/10.3390/jcm13164714

AMA Style

Carta MG, Kurotschka PK, Machado S, Erfurth A, Sancassiani F, Perra A, Tusconi M, Cossu G, Aviles Gonzalez CI, Primavera D. A Virtual Reality Cognitive Stimulation Program as an Effective Tool Against Residual/Prodromal Depressive Symptoms in Bipolar Disorders. Journal of Clinical Medicine. 2024; 13(16):4714. https://doi.org/10.3390/jcm13164714

Chicago/Turabian Style

Carta, Mauro Giovanni, Peter K. Kurotschka, Sergio Machado, Andreas Erfurth, Federica Sancassiani, Alessandra Perra, Massimo Tusconi, Giulia Cossu, Cesar Ivan Aviles Gonzalez, and Diego Primavera. 2024. "A Virtual Reality Cognitive Stimulation Program as an Effective Tool Against Residual/Prodromal Depressive Symptoms in Bipolar Disorders" Journal of Clinical Medicine 13, no. 16: 4714. https://doi.org/10.3390/jcm13164714

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop