Next Article in Journal
Pre-Hospital Pain Management in Children with Injuries: A Retrospective Cohort Study
Next Article in Special Issue
Medically Serious Suicide Attempts in Personality Disorders
Previous Article in Journal
Early Bronchoscopy Improves Extubation Rates after Out-of-Hospital Cardiac Arrest: A Retrospective Cohort Analysis
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
JCM
Volume 10
Issue 14
10.3390/jcm10143057
jcm-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Aggression, Impulsivity and Suicidal Behavior in Depressive Disorders: A Comparison Study between New York City (US), Madrid (Spain) and Florence (Italy)

by
Javier-David Lopez-Morinigo
1,2,3,4,*,
Maura Boldrini
5,
Valdo Ricca
6,
Maria A. Oquendo
7 and
Enrique Baca-García
1,2,3,8,9,10,11,12
1
Department of Psychiatry, Universidad Autónoma de Madrid, 28049 Madrid, Spain
2
Department of Psychiatry, IIS-Fundación Jiménez Díaz, 28040 Madrid, Spain
3
Centro de Investigación Biomédica en Red Salud Mental (CIBERSAM), 28029 Madrid, Spain
4
Department of Child and Adolescent Psychiatry, Institute of Psychiatry and Mental Health, Hospital General Universitario Gregorio Marañón, IiSGM, CIBERSAM, School of Medicine, Universidad Complutense, 28009 Madrid, Spain
5
Department of Psychiatry, New York State Psychiatric Institute, Columbia University Irvin Medical Center, New York, NY 10032, USA
6
Department of Health Sciences, University of Florence, 50121 Florence, Italy
7
Department of Psychiatry, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA 19104, USA
8
Department of Psychiatry, University Hospital Rey Juan Carlos, 28933 Mostoles, Spain
9
Department of Psychiatry, General Hospital of Villalba, 28400 Madrid, Spain
10
Department of Psychiatry, University Hospital Infanta Elena, 28342 Valdemoro, Spain
11
Universidad Católica del Maule, Talca 3466706, Chile
12
Department of Psychiatry, Centre Hospitalier Universitaire de Nîmes, 30900 Nîmes, France
 
add Show full affiliation list
 
remove Hide full affiliation list
*
Author to whom correspondence should be addressed.
J. Clin. Med. 2021, 10(14), 3057; https://doi.org/10.3390/jcm10143057
Submission received: 7 May 2021 / Revised: 7 June 2021 / Accepted: 26 June 2021 / Published: 9 July 2021
(This article belongs to the Special Issue Dissecting the Relationship between Personality Disorders and Suicide)
Browse Figures
Review Reports Versions Notes

Abstract

:
The association of aggression and impulsivity with suicidal behavior (SB) in depression may vary across countries. This study aimed (i) to compare aggression and impulsivity levels, measured with the Brown-Goodwin Scale (BGS) and the Barratt Impulsivity Scale (BIS), respectively, between New York City (NYC) (US), Madrid (Spain) and Florence (Italy) (ANOVA); and (ii) to investigate between-site differences in the association of aggression and impulsivity with previous SB (binary logistic regression). Aggression scores were higher in NYC, followed by Florence and Madrid. Impulsivity levels were higher in Florence than in Madrid or NYC. Aggression and impulsivity scores were higher in suicide attempters than in non-attempters in NYC and in Madrid. SB was associated with aggression in NYC (OR 1.12, 95% CI 1.07–1.16; p < 0.001) and in Florence (OR 1.11, 95% CI 1.01–1.22; p = 0.032). Impulsivity was linked with SB in NYC (OR 1.01, 95% CI 1.00–1.02; p < 0.001) and in Madrid (OR 1.03, 95% CI 1.02–1.05; p < 0.001). The higher suicide rates in NYC, compared to Madrid or Florence, may be, in part, explained by these cross-cultural differences in the contribution of aggression-impulsivity to SB, which should be considered by future research on SB prevention.

1. Introduction

Suicide has undoubtedly become a major public health issue, with almost one million deaths every year across the world [1]. Of concern, is the fact that suicide rates are likely to significantly increase worldwide due to the COVID-19-related economic turndown [2,3,4,5], consistent with previous economic recessions [6]. In the US over 48,000 people took their lives in 2018, which represents an overall increase in approximately 35% in comparison with 1999 [7]. According to psychological autopsy studies, up to 74% of those who ended their lives met criteria for depression [8]. Consistent with the stress-diathesis model of suicide, aggression and impulsivity have been established as risk factors for suicidal behavior (SB) [9,10,11], particularly in unipolar [12] and bipolar depression [13]. Interestingly, aggression and impulsivity were reported to share neurobiological mechanisms with SB, particularly decreased serotonergic activity [9,14,15,16], which may therefore become a potential pharmacological target for the prevention and management of SB. However, a large cohort of depressed patients from France (n = 4041) found suicidal ideation and previous SB to predict poor response to antidepressants in terms of achieving depression remission independently of the type of antidepressant and other comorbidities [17].
Two previous studies from our group, which compared two samples of suicide attempters with non-attempters’ major depressive disorder (MDD) patients and healthy controls from New York City (NYC) and Madrid (Spain) [18,19], showed that the greater lethality of SB in NYC subjects was related to their higher aggression levels in comparison with Madrid participants, while no differences in impulsivity scores between suicide attempters and healthy controls were revealed by the analyses. This said, it is worth noting that these studies tested different hypotheses. First, the role of the promoter area of the serotonin transporter (17q11.1-q12) was investigated in relation to history of aggression and impulsivity in two samples of suicide attempters and healthy controls from NYC and Madrid, which partially overlapped with the samples used in the present study [19]. The second study aimed to compare the association between lethality of suicide attempts and aggression levels in Madrid and in NYC with the aforementioned two samples [18]. However, the present study aimed to compare aggression and impulsivity levels across three sites, namely NYC, Madrid and Florence, and the relationship between both variables and SB in three samples of “depressive disorders patients”, that is, we did not include healthy controls. Hence, the present study is not a partial or full re-analysis of previously published data. More specifically, unlike the aforementioned two reports [18,19], not only new data were collected in NYC and in Madrid, but also we included a third cohort of depressive disorders patients from Florence in order to test this study’s hypotheses. However, as acknowledged in the methods and limitations sections, these three samples were not originally recruited for this study. Rather, based on an international collaboration research network, the three groups decided to share data, thus allowing this comparison study (also, see recruitment dates below).
By building on this work, we have conducted the present study aimed: (i) to compare aggression and impulsivity levels across three major cities in different countries, namely New York City (NYC), Madrid (Spain) and Florence (Italy) and (ii) to investigate between-site differences in the association of aggression and impulsivity with previous SB. In particular, the following hypotheses were to be tested: (i) that NYC subjects will show higher aggression and impulsivity levels than those from Madrid and Florence; (ii) that suicide attempters will have higher aggression and impulsivity levels than non-attempters across sites, (iii) that while both aggression and impulsivity will be significantly associated with previous SB in NYC, these associations will not reach significance in Madrid or in Florence. In particular, hypothesis i and iii were based on our aforementioned previous studies [18,19], which are supported further by previous epidemiological research on suicide rates differences across countries [20]. The association of aggression-impulsivity with SB (hypothesis ii) has been previously reported [9,10,11].

2. Materials and Methods

2.1. Participants

Three samples of depressed patients from New-York City (NYC) (n = 647), Madrid (Spain) (n = 658) and Florence (Italy) (n = 93) were included in this study.
In NYC, suicide attempters were recruited from a population of depressed patients at a university psychiatric hospital from 1998 to 2001.
In Madrid, depressed suicide attempters from the emergency department (ED) of a publicly-funded university hospital (Ramón y Cajal University Hospital), which provides care to a population of approximately 500,000 inhabitants residing in North-Madrid, were recruited over one year (1999). This hospital covers all medical emergencies in this catchment area with the only exception for those presenting to local private hospitals, which are likely to be a tinny proportion of ED users. Since there are no psychiatric hospitals in this area, the vast majority of suicide attempters are referred to this hospital so they can be admitted to the psychiatric ward as appropriate.
In Florence participants were recruited from Careggi University Hospital, which is the main hospital of the city of Florence, with 1322 beds and approximately 50,000 admissions per year, over 2000–2005. Depressed suicide attempters were hospitalized in the Inpatient Unit of the Department of Psychiatry.
We applied the same inclusion/exclusion criteria across sites. In particular, those adults—age 18–64, both inclusive—who made a suicide attempt (suicide attempters) as defined by O’Carroll and colleagues, i.e., “any act the patient deliberately performed to kill himself or herself” [21] were administered either the Structured Clinical Interview (SCID) [22] (NYC) or the Mini-International Neuropsychiatric Interview [23] (Madrid and Florence samples), that is, a brief structured interview which made the major Axis I DSM-IV diagnosis. Those who were found to meet criteria for Major Depressive Disorder (MDD) or Bipolar Depression (BD) were invited to participate in this study and those who agreed provided written informed consent. Those with a primary diagnosis of schizophrenia, eating disorder, alcohol or substance use disorders, Obsessive-Compulsive Disorder (OCD) and/or suffering a neurological condition were excluded. Of note, we considered “Bipolar” depression an inclusion criterion given its well-recognized association with SB, aggression and impulsivity [13]. Suicide non-attempters were recruited from these sites following the same procedure. Thus, non-matched adults (age 18–64 years, both inclusive) who presented with MDD or BD according to the SCID [22] (NYC) or MINI [23] (Madrid and Florence) to these three hospitals over the aforementioned periods and met no exclusion criteria were invited to participate in the study.
Participants provided written informed consent as approved by the local institutional review boards.

2.2. Measures

Aggression and impulsivity were the co-primary outcome measures and assessed using the same instruments across sites. Aggression history was rated using the Brown-Goodwin Scale (BGS) [24], which measures lifetime aggressive acts with 10 items, each of which ranges from 1 to 4, hence total scores range from 10 to 40. An 11th item measures suicidal behavior and, therefore, is excluded. The original version of the scale was used since no language-related issues were raised to rate lifetime aggressive acts [24]. Impulsivity was measured with the Barratt Impulsiveness Scale (BIS) [25], which assesses impulsivity traits. The 30-item version of the scale, which provides total scores ranging from 0 to 120, was used. The Spanish [26] and Italian [27] versions of the BIS were used in Madrid and Florence, respectively. We considered BGS and BIS total scores for the analyses.
Additional variables included: age at study enrolment, gender, ethnicity, marital status, education level, as well as alcohol and substances use disorders, based on the Structured Clinical Interview (SCID) [22] for DSM-IV in NYC, and on the Mini-International Neuropsychiatric Interview [23] in Madrid and Florence. We decided to consider comorbid alcohol and substance use disorders given their well-recognized association with SB, aggression and impulsivity [28].
With regard to SB, as alluded to above, we used the same O’Carroll et al.’s SB consensus definition across sites, that is, “any act the patient deliberately performed to kill himself or herself” [21].

2.3. Statistics

First, in order to test hypothesis i, i.e., between-site differences in aggression and impulsivity levels, BGS and BIS total scores were compared across sites through an analysis of variance model (ANOVA). We further adjusted the ANOVA models for age and gender as co-variables (ANCOVA), which did not alter the results below. Second, regarding hypotheses ii, that is, differences in aggression and impulsivity levels between suicide attempters and non-attempters, BGS and BIS total scores means were compared between groups (suicide attempters vs. non-attempters), respectively, for each site since distributions were sufficiently normal. Finally, binary logistic regression analyses provided univariate Odds Ratios (OR), including 95% confidence intervals (CI), measuring the strength of the association of aggression and impulsivity (as continuous independent variables) with previous SB (as binary outcome measure), whilst adjusting for alcohol and drugs abuse, none of which were significantly associated with previous SB, thus testing hypothesis iii. As noted above (see hypothesis iii), we did not intend to statistically compare the strength of these associations across sites, which requires a different methodology [29]. Rather, we explored whether or not these associations were statistically significant for each site.
A significance level of 5% (two-tailed) was set for all the above analyses, performed using the Statistical Package for Social Science version 25.0 (SPSS, Inc., Chicago, IL, USA).

3. Results

3.1. Characteristics of the Samples

The demographic and clinical characteristics of the samples are shown in Table 1, including between-site differences.

3.2. Differences in Aggression and Impulsivity Levels across Sites

As detailed in Table 2 there were relevant between-site differences in aggression and impulsivity levels. In terms of aggression, NYC subjects (20.2 ± 5.6) had significantly (p < 0.001) higher mean BGS total scores than participants from Florence (16.1 ± 4.9) who had significantly (p = 0.022) greater BGS scores than those from Madrid (14.4 ± 5.3).
With regard to impulsivity, the mean BIS score was higher in the Florence sample (55.0 ± 9.7) than in Madrid (53.2 ± 20.1) or NYC (52.0 ± 16.6), although these differences were non-significant.

3.3. Differences in Aggression and Impulsivity Levels between Suicide Attempters and Non-Attempters

Suicide attempters showed higher BGS scores than non-attempters across sites (NYC: 22.0 ± 5.8 vs. 18.6 ± 4.9, t = 6.45, p < 0.001; Madrid: 14.9 ± 5.6 vs. 13.2 ± 4.3, t = 3.17, p = 0.002), while in Florence these differences showed a trend p (17.3 ± 5.3 vs. 15.3 ± 4.5, t = 1.86, p = 0.067), which is shown in Table 3.
Suicide attempters also had significantly higher BIS impulsivity scores than non-attempters in NYC (54.2 ± 16.6 vs. 50.1 ± 16.3, t = 2.72, p = 0.007) and in Madrid (56.3 ± 18.4 vs. 41.4 ± 21.6, t = 5.71, p < 0.001), although these differences were not observed in the Florence sample, as detailed in Table 3.
In keeping with the above, we have more graphically illustrated the above results in two figures. Thus, Figure 1 below, presents the BGS differences between suicide attempters and non-attempters across sites, and Figure 2 below, shows the BIS differences between suicide attempters and non-attempters across sites.

3.4. Association of Previous Suicidal Behaviour with Aggression and Impulsivity across Sites

Previous SB was significantly associated with aggression in NYC and in Florence as follows: NYC (OR 1.12, 95% CI 1.07–1.16; p < 0.001) and Florence (OR 1.11, 95% CI 1.01–1.22; p = 0.032). In Madrid, this association was nonsignificant (OR 1.05, 95% CI 0.99–1.11; p = 0.055).
The relationship between impulsivity and SB reached statistical significance in NYC (OR 1.01, 95% CI 1.00–1.02; p < 0.001) and in Madrid (OR 1.03, 95% CI 1.02–1.05; p < 0.001), while in Florence it was non-significant (OR 1.07, 95% CI 0.98–1.17; p = 0.12).
Table 4, below, presents the binary logistic regression models on previous SB. In bold, see the significant results.

4. Discussion

4.1. Main Findings

We compared three samples of convenience of patients with depressive disorders from NYC (US), Madrid (Spain) and Florence (Italy) to investigate between-site differences both in aggression and impulsivity levels and in the association of these two variables with SB.
In keeping with our first hypothesis based on our previous studies [18,19], NYC patients were found to have the highest levels of aggression, although these results were not replicated for impulsivity, with Florence subjects having higher impulsivity levels than those from NYC or Madrid, which partially conflicted with our hypothesis. As expected (hypothesis ii), suicide attempters had higher aggression levels than non-attempters in NYC and in Florence, although data from the Madrid sample did not support this. Consistent with hypothesis ii, impulsivity levels also distinguished suicide attempters from non-attempters in NYC and in Madrid, although the Florence sample did not replicate this. Hence, results supported hypothesis iii since only in the NYC sample both aggression and impulsivity were significantly associated with previous SB in the multivariable regression model, which was not replicated by the Madrid and Florence samples, in which only impulsivity (in Madrid) or aggression (in Florence) remained significantly linked with SB. These differences in the contribution of aggression and impulsivity to SB may explain, in part, the higher suicide rates in NYC in comparison with Madrid and Florence, which is discussed further below.

4.2. Aggression, Impulsivity and Suicidal Behaviour: Differences across Sites

Previous literature considered aggression to be a personality trait [30]. Consistent with this, there seems to be a link between Cluster B personality disorders, alcohol/substances-related problems and aggression [31,32] and we found some evidence of this. In particular, a very busy inner-city area, such as NYC, was linked with increased aggression levels and a significant association of previous SB with aggression. Of note, the highest proportion of people with alcohol/drugs use disorder was found in NYC (compared with Madrid and Florence). On the other hand, being religious is a well-documented protective factor for SB [33], although some studies failed to replicate this (e.g., [34]). Religion may have, therefore, mitigated the association between aggression or impulsivity and SB in the Florence cohort, in which 80% of participants reported to have a religion (which was significantly higher than in Madrid and NYC cohorts), despite the higher impulsivity levels of Florence subjects.
Impulsivity has been established as a risk factor for SB both in adults and in children [35], and we showed impulsivity levels to distinguish suicide attempters from non-attempters in NYC and in Madrid. Impulsivity is a common feature of several psychiatric disorders [36], such as bipolar disorder (BD) [37] and Cluster B personality disorders [38], particularly borderline personality disorder [39,40]. Moreover, motor impulsivity was reported to differentiate multiple- from single suicide attempters [41]. However, our study did not assess early life and recent stressful life events, which appear to mediate the relationship between impulsivity and SB [42,43], in line with the so-called Interpersonal Theory of Suicide (IPTS) [44]. Indeed, childhood abuse contributes to impulsivity and SB [45], hence acting as a potential mediator/confounder in this relationship. Further studies assessing these other factors interacting with impulsivity in leading to SB are needed.
Of relevance is the fact that we have replicated the association of SB with aggression and impulsivity in the NYC sample [46], while in Florence SB was only linked with aggression and in Madrid only impulsivity was related to SB, which may have been due to insufficient statistical power. However, relatively, in contrast to our results, one study revealed impulsivity to play a more relevant role in distinguishing suicide attempters from non-attempters than aggression in both bipolar depression and major depressive disorder [47]. This study therefore adds to previous literature since our results showed that only in NYC both aggression and impulsivity remained associated with SB, that is, that there seem to be relevant between-site differences in the association between aggression, impulsivity and SB, which should be taken into account when investigating a diathesis of SB across different cultural settings.
In summary, the findings from this study suggest that the association of aggression and impulsivity with SB appear to vary across countries. This may also explain between-site suicide rates differences. In fact, in 2016 NYC suicide rates were 8.40/100,000 [7], which was much higher than suicide rates for the same year in Madrid (4.72/100,000) [48]. In keeping with this, according to the World Health Organization [49] national suicide rates in 2016 were as follows: the US: 13.9/100,000 persons-year, Spain: 7.46/100,000 persons-year and Italy: 8.2/100,000 persons-year. It could, therefore, be envisioned that tackling aggression may successfully reduce the risk of suicide in those high aggression levels sites such as NYC, while aggression reducing measures in low aggression levels countries such as Spain or Italy may have less impact as a suicide prevention approach. On the other hand, our findings suggest that suicide prevention strategies in Madrid should focus on the management of impulsivity.
Specifically, both anti-convulsivants and selective-serotonin reuptake inhibitors (SSRIs) have shown to reduce both aggression and impulsivity levels [50], although further randomized controlled trials (RCT) looking at suicide-related outcomes are needed. In this regard, it is worth noting that SB is a common exclusion criterion in RCTs [51], which hampers this research area. Indeed, while there is strong evidence to support the efficacy of antidepressants for unipolar MDD [52], destabilizing risks appear to be unfavorable in bipolar depression [53]. Although RCTs tend to favor the use of antidepressants to prevent SB in unipolar depression, this effect may reflect a selection bias since participants in RCTs tend not to have a suicidal history [51]. Moreover, suicidal ideation appears to predict poor response to antidepressants [17].
In addition, patients with personality disorders frequently develop comorbid depressive episodes in their lifetime and antidepressants were postulated to reduce aggression, impulsivity and SB risk. Although there is limited evidence to recommend the use of antidepressants for the management of impulsivity and depressed mood in personality disorders [54], PD patients with high risk of SB are more likely to get excluded from RCTs. Results also suggest that religiosity and other social support structures may mitigate effects of aggression and impulsivity in other countries, such as Italy, and social interventions may have a role in suicide prevention.

4.3. Strengths and Limitations

We compared three large samples of patients with depressive disorders from major cities in different countries, namely NYC (US), Madrid (Spain) and Florence (Italy), to investigate differences in the relationship between aggression, impulsivity and SB. The same instruments for assessing aggression and impulsivity, which were the co-primary outcome measures of the study, were used across the board. This approach is, therefore, likely to increase the validity of the study findings.
However, the study has several limitations. First, the recruitment methods, which were naturalistic and not initially designed to test this study’s hypotheses, differed across sites. Second, the Florence sample size (n = 93) was significantly smaller than the other two cohorts (NYC: n = 647; Madrid: n = 658), although this did not prevent us from finding the aforementioned between-sample differences. Third, the same scales were used to measure aggression and impulsivity, BGS and BIS, which is a self-report scale, respectively, although no inter-rater reliability measures were calculated for BGS. Fourth, the cross-sectional design of the study did not permit us to reach causality conclusions [55]. Finally, we acknowledge that the methodology used for testing hypothesis iii may be subject to criticism given relevant between-sample differences. This said, it is worth noting that we aimed to cross-compare whether or not aggression and impulsivity remained significantly associated with SB across sites. In other words, we did not intend to statistically compare the strength of these associations across samples, which would require a different approach [29]. Truly, this is a different research question which remains to be addressed by future studies specifically designed for this.

4.4. Implications on Suicide Prevention and Future Research

Our results provide further support for incorporating aggression and impulsivity measure into routine clinical suicide risk assessments, although the association of these variables to SB appears to vary across different cultural settings, which is the main contribution of this work. In addition, it is worth noting that both aggression and impulsivity could be modified through intervention, including antidepressants, thus reducing the risk of SB [56]. Moreover, not only may early detection and intervention of aggression and impulsivity reduce the risk of SB, but so may the medical lethality of SBs when they occur.
Nevertheless, further replication cross-cultural studies comparing aggression and impulsivity levels in suicide attempters and non-attempters in other countries, including different settings (for instance, rural and urban areas, in- and outpatient settings), are warranted. Some methodological issues, such as the use of the same instruments, similar recruitment procedures and some reliability measures, need to be considered. In addition, bilingual assessors receiving common training at the different sites may increase the inter-rater reliability, which should be reported. Finally, it should be noted that funding of national healthcare systems differs across countries, from fully-publicly-funded healthcare systems, such as Spain and Italy, to private medical insurance-based countries such as the US. In addition, this study’s findings are unlikely to generalize to low- and middle-income countries, in which not only up to 79% of worldwide suicides occur, but also suicide research tends to be underfunded [57].
From a neurobiological research perspective, these cross-cultural differences should be considered by future studies looking at the biological underpinnings of aggression, impulsivity and SB. In particular, two previous neuroimaging studies from the US revealed some neuroanatomical correlations of impulsivity, aggression and SB. First, by using structural magnetic resonance imaging (MRI) in a sample of (n = 51) BPD suicide attempters from Pittsburgh (US), medical lethality of previous suicide acts was found to inversely correlate with grey matter volumes across multiple fronto-temporal-limbic regions [58]. Second, a recent small study of BD patients using diffusion tensor imaging revealed white matter changes in the anterior limb of the internal capsule and anterior corona radiate to play a role in impulsivity in suicide attempters in comparison with non-attempters [59]. Therefore, it seems that, irrespective of diagnosis, impulsivity-aggression may represent an endophenotype which significantly increases the risk of SB. The combination of machine-learning techniques [60] with cutting-edge neurobiological research methods may contribute to a better understanding of these complex associations. Furthermore, a deeper knowledge of the neurobiological underpinnings of aggression, impulsivity and SB, and their exacerbation in relationship with recent and remote trauma exposure, and different cultural contexts, may pave the way towards more targeted pharmacological treatments for the prevention and management of SB.

5. Conclusions

To sum up, this investigation revealed relevant cross-cultural differences in the contribution of aggression and impulsivity to SB, which are likely to have implications on the prevention and management of suicide, undoubtedly a pending global challenge, particularly in the post-COVID-19 years to come.

Author Contributions

Conceptualization, M.A.O. and E.B.-G.; data curation, J.-D.L.-M. and E.B.-G.; funding acquisition, J.-D.L.-M.; investigation, J.-D.L.-M.; methodology, M.B., V.R., M.A.O. and E.B.-G.; project administration, E.B.-G.; resources, E.B.-G.; software, E.B.-G.; supervision, M.A.O. and E.B.-G.; validation, M.B. and M.A.O.; visualization, M.B. and V.R.; writing—original draft, J.-D.L.-M.; writing—review and editing, M.B., V.R., M.A.O. and E.B.-G. All authors have read and agreed to the published version of the manuscript.

Funding

This study was supported by the Universidad Autónoma de Madrid (Spain) and European Union via the Intertalentum Project Grant-Marie Skłodowska Curie Actions (GA 713366) to JDLM, which also funded the APC. The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript, or in the decision to publish the results.

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki, and approved by the local Institutional Review Boards.

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

Datasets are available upon request, provided data policy access is complied with.

Acknowledgments

We are very grateful to all the study participants. Furthermore, we acknowledge departmental support from our institutions mentioned above.

Conflicts of Interest

M.B. owns stock in Pfizer, Moderna and BioNTech SE. M.A.O. receives royalties for the commercial use of the Columbia-Suicide Severity Rating Scale. M.A.O. owns equity in Mantra, Inc. M.A.O.’s family owns stock in Bristol Myers Squibb.

References

  1. World Health Organization Suicide in the World. Global Health Estimates 2019. Available online: https://apps.who.int/iris/handle/10665/326948 (accessed on 28 April 2021).
  2. Gunnell, D.; Appleby, L.; Arensman, E.; Hawton, K.; John, A.; Kapur, N.; Khan, M.; O’Connor, R.C.; Pirkis, J. COVID-19 Suicide Prevention Research Collaboration. Suicide risk and prevention during the COVID-19 pandemic. Lancet Psychiatry 2020, 7, 468–471. [Google Scholar] [CrossRef]
  3. Courtet, P.; Olié, E.; Debien, C.; Vaiva, G. Keep Socially (but Not Physically) Connected and Carry on. J. Clin. Psychiatry 2020, 81, 81. [Google Scholar] [CrossRef] [Green Version]
  4. Sher, L. The impact of the COVID-19 pandemic on suicide rates. Qjm Int. J. Med. 2020, 113, 707–712. [Google Scholar] [CrossRef]
  5. Kawohl, W.; Nordt, C. COVID-19, unemployment, and suicide. Lancet Psychiatry 2020, 7, 389–390. [Google Scholar] [CrossRef]
  6. Oyesanya, M.; Lopez-Morinigo, J.-D.; Dutta, R. Systematic review of suicide in economic recession. World J. Psychiatry 2015, 5, 243–254. [Google Scholar] [CrossRef] [Green Version]
  7. Centers for Disease Control and Prevention (CDC). The 2019 AR Threats Report. Available online: www.cdc.gov/DrugResistance/Biggest-Threats.html (accessed on 24 April 2021).
  8. Cavanagh, J.T.O.; Carson, A.J.; Sharpe, M.; Lawrie, S.M. Psychological autopsy studies of suicide: A systematic review. Psychol. Med. 2003, 33, 395–405. [Google Scholar] [CrossRef] [PubMed]
  9. Mann, J.J. Neurobiology of suicidal behaviour. Nat. Rev. Neurosci. 2003, 4, 819–828. [Google Scholar] [CrossRef]
  10. Mann, J.J.; Waternaux, C.; Haas, G.L.; Malone, K.M. Toward a clinical model of suicidal behavior in psychiatric patients. Am. J. Psychiatry 1999, 156, 181–189. [Google Scholar] [CrossRef] [PubMed]
  11. Gvion, Y.; Apter, A. Aggression, Impulsivity, and Suicide Behavior: A Review of the Literature. Arch. Suicide Res. 2011, 15, 93–112. [Google Scholar] [CrossRef] [PubMed]
  12. Malone, K.M.; Haas, G.L.; Sweeney, J.A.; Mann, J. Major depression and the risk of attempted suicide. J. Affect. Disord. 1995, 34, 173–185. [Google Scholar] [CrossRef]
  13. Oquendo, M.A.; Waternaux, C.; Brodsky, B.; Parsons, B.; Haas, G.L.; Malone, K.M.; Mann, J. Suicidal behavior in bipolar mood disorder: Clinical characteristics of attempters and nonattempters. J. Affect. Disord. 2000, 59, 107–117. [Google Scholar] [CrossRef]
  14. Mann, J.; Currier, D. Stress, genetics and epigenetic effects on the neurobiology of suicidal behavior and depression. Eur. Psychiatry 2010, 25, 268–271. [Google Scholar] [CrossRef]
  15. Oquendo, M.A.; Sullivan, G.M.; Sudol, K.; Baca-García, E.; Stanley, B.H.; Sublette, M.E.; Mann, J.J. Toward a Biosignature for Suicide. Am. J. Psychiatry 2014, 171, 1259–1277. [Google Scholar] [CrossRef]
  16. van Heeringen, K.; Mann, J.J. The neurobiology of suicide. Lancet Psychiatry 2014, 1, 63–72. [Google Scholar] [CrossRef]
  17. Lopez-Castroman, J.; Jaussent, I.; Gorwood, P.; Courtet, P. Suicidal Depressed Patients Respond Less Well to Antidepressants in the Short Term. Depress. Anxiety 2016, 33, 483–494. [Google Scholar] [CrossRef] [PubMed]
  18. Baca-García, E.; Oquendo, M.A.; Saiz-Ruiz, J.; Mann, J.J.; De Leon, J. A Pilot Study on Differences in Aggression in New York City and Madrid, Spain, and Their Possible Impact on Suicidal Behavior. J. Clin. Psychiatry 2006, 67, 375–380. [Google Scholar] [CrossRef]
  19. Baca-García, E.; Vaquero, C.; Diaz-Sastre, C.; García-Resa, E.; Saiz-Ruiz, J.; Fernández-Piqueras, J.; de Leon, J. Lack of association between the serotonin transporter promoter gene polymorphism and impulsivity or aggressive behavior among suicide attempters and healthy volunteers. Psychiatry Res. 2004, 126, 99–106. [Google Scholar] [CrossRef] [PubMed]
  20. O’Connor, R.C.; Platt, S.; Gordon, J. (Eds.) International Handbook of Suicide Prevention Research, Policy and Practice; John Wiley & Sons: Chichester, UK; Malden, MA, USA, 2011; ISBN 978-0-470-68384-2. [Google Scholar]
  21. O’Carroll, P.W.; Berman, A.L.; Maris, R.W.; Moscicki, E.K.; Tanney, B.L.; Silverman, M.M. Beyond the Tower of Babel: A Nomenclature for Suicidology. Suicide Life Threat. Behav. 1996, 26, 237–252. [Google Scholar] [CrossRef] [PubMed]
  22. First, M.B. Structured Clinical Interview for DSM-IV Axis I Disorders SCID-I: Clinician Version, Scoresheet; American Psychiatric Press: Washington, DC, USA, 1997; ISBN 978-0-88048-933-1. [Google Scholar]
  23. Sheehan, D.V.; Lecrubier, Y.; Sheehan, K.H.; Amorim, P.; Janavs, J.; Weiller, E.; Hergueta, T.; Baker, R.; Dunbar, G.C. The Mini-International Neuropsychiatric Interview (M.I.N.I.): The development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. J. Clin. Psychiatry 1998, 59, 22–33. [Google Scholar] [PubMed]
  24. Brown, G.L.; Goodwin, F.K.; Ballenger, J.C.; Goyer, P.F.; Major, L.F. Aggression in humans correlates with cerebrospinal fluid amine metabolites. Psychiatry Res. 1979, 1, 131–139. [Google Scholar] [CrossRef]
  25. Barratt, E.S. Factor Analysis of Some Psychometric Measures of Impulsiveness and Anxiety. Psychol. Rep. 1965, 16, 547–554. [Google Scholar] [CrossRef]
  26. Oquendo, M.A.; Baca-Garcia, E.; Graver, R. Spanish Adaptation of the Barratt Impulsiveness Scale (BIS-11). Eur. J. Psychiatry 2001, 15, 147–155. [Google Scholar]
  27. Fossati, A.; Di Ceglie, A.; Acquarini, E.; Barratt, E.S. Psychometric properties of an Italian version of the Barratt Impulsiveness Scale-11 (BIS-11) in nonclinical subjects. J. Clin. Psychol. 2001, 57, 815–828. [Google Scholar] [CrossRef]
  28. Franklin, J.C.; Ribeiro, J.D.; Fox, K.R.; Bentley, K.H.; Kleiman, E.M.; Huang, X.; Musacchio, K.M.; Jaroszewski, A.C.; Chang, B.P.; Nock, M.K. Risk factors for suicidal thoughts and behaviors: A meta-analysis of 50 years of research. Psychol. Bull. 2017, 143, 187–232. [Google Scholar] [CrossRef]
  29. Huang, F.L. Alternatives to logistic regression models in experimental studies. J. Exp. Educ. 2019, 1–16. [Google Scholar] [CrossRef]
  30. McGirr, A.; Renaud, J.; Bureau, A.; Seguin, M.; Lesage, A.; Turecki, G. Impulsive-aggressive behaviours and completed suicide across the life cycle: A predisposition for younger age of suicide. Psychol. Med. 2007, 38, 407–417. [Google Scholar] [CrossRef] [PubMed]
  31. Carpiniello, B.; Lai, L.; Pirarba, S.; Sardu, C.; Pinna, F. Impulsivity and aggressiveness in bipolar disorder with co-morbid borderline personality disorder. Psychiatry Res. 2011, 188, 40–44. [Google Scholar] [CrossRef]
  32. Fossati, A.; Barratt, E.S.; Borroni, S.; Villa, D.; Grazioli, F.; Maffei, C. Impulsivity, aggressiveness, and DSM-IV personality disorders. Psychiatry Res. 2007, 149, 157–167. [Google Scholar] [CrossRef]
  33. Lawrence, R.E.; Oquendo, M.A.; Stanley, B. Religion and Suicide Risk: A Systematic Review. Arch. Suicide Res. 2015, 20, 1–21. [Google Scholar] [CrossRef]
  34. Lawrence, R.E.; Brent, D.; Mann, J.J.; Burke, A.K.; Grunebaum, M.F.; Galfalvy, H.; Oquendo, M.A. Religion as a Risk Factor for Suicide Attempt and Suicide Ideation Among Depressed Patients. J. Nerv. Ment. Dis. 2016, 204, 845–850. [Google Scholar] [CrossRef] [Green Version]
  35. Carballo, J.J.; The Stop Consortium; Llorente, C.; Kehrmann, L.; Flamarique, I.; Zuddas, A.; Purper-Ouakil, D.; Hoekstra, P.J.; Coghill, D.; Schulze, U.M.E.; et al. Psychosocial risk factors for suicidality in children and adolescents. Eur. Child. Adolesc. Psychiatry 2020, 29, 759–776. [Google Scholar] [CrossRef] [Green Version]
  36. Bellino, S.; Patria, L.; Paradiso, E.; Di Lorenzo, R.; Zanon, C.; Zizza, M.; Bogetto, F. Major Depression in Patients with Borderline Personality Disorder: A Clinical Investigation. Can. J. Psychiatry 2005, 50, 234–238. [Google Scholar] [CrossRef]
  37. Saddichha, S.; Schuetz, C. Impulsivity in remitted depression: A meta-analytical review. Asian J. Psychiatry 2014, 9, 13–16. [Google Scholar] [CrossRef]
  38. Looper, K.J.; Paris, J. What dimensions underlie cluster B personality disorders? Compr. Psychiatry 2000, 41, 432–437. [Google Scholar] [CrossRef]
  39. Mehlum, L.; Friis, S.; Vaglum, P.; Karterud, S. The longitudinal pattern of suicidal behaviour in borderline personality disorder: A prospective follow-up study. Acta Psychiatr. Scand. 1994, 90, 124–130. [Google Scholar] [CrossRef] [PubMed]
  40. Links, P.S.; Heslegrave, R.; Van Reekum, R. Impulsivity: Core Aspect of Borderline Personality Disorder. J. Pers. Disord. 1999, 13, 1–9. [Google Scholar] [CrossRef]
  41. Colborn, V.A.; Lacroix, J.M.; Neely, L.L.; Tucker, J.; Perera, K.; Daruwala, S.E.; Grammer, G.; Weaver, J.; Ghahramanlou-Holloway, M. Motor impulsivity differentiates between psychiatric inpatients with multiple versus single lifetime suicide attempts. Psychiatry Res. 2017, 253, 18–21. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  42. Bender, T.W.; Gordon, K.H.; Bresin, K.; Joiner, T.E. Impulsivity and suicidality: The mediating role of painful and provocative experiences. J. Affect. Disord. 2011, 129, 301–307. [Google Scholar] [CrossRef]
  43. Jordan, J.T.; Samuelson, K.W.; Tiet, Q.Q. Impulsivity, Painful and Provocative Events, and Suicide Intent: Testing the Interpersonal Theory of Suicide. Suicide Life Threat. Behav. 2018, 49, 1187–1195. [Google Scholar] [CrossRef] [PubMed]
  44. Joiner, T.E.; Brown, J.S.; Wingate, L.R. The Psychology and Neurobiology of Suicidal Behavior. Annu. Rev. Psychol. 2005, 56, 287–314. [Google Scholar] [CrossRef]
  45. Braquehais, M.D.; Oquendo, M.A.; Baca-García, E.; Sher, L. Is impulsivity a link between childhood abuse and suicide? Compr. Psychiatry 2010, 51, 121–129. [Google Scholar] [CrossRef]
  46. Gvion, Y.; Levi-Belz, Y. Serious Suicide Attempts: Systematic Review of Psychological Risk Factors. Front. Psychiatry 2018, 9, 56. [Google Scholar] [CrossRef]
  47. Perroud, N.; Baud, P.; Mouthon, D.; Courtet, P.; Malafosse, A. Impulsivity, aggression and suicidal behavior in unipolar and bipolar disorders. J. Affect. Disord. 2011, 134, 112–118. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  48. Instituto Nacional de Estadística. 2015. Available online: https://www.ines.es/ (accessed on 7 July 2019).
  49. World Health Organisation. Suicide. Available online: https://www.who.int/news-room/fact-sheets/detail/suicide (accessed on 7 May 2021).
  50. Felthous, A.R.; Lake, S.L.; Rundle, B.K.; Stanford, M.S. Pharmacotherapy of impulsive aggression: A quality comparison of controlled studies. Int. J. Law Psychiatry 2013, 36, 258–263. [Google Scholar] [CrossRef] [PubMed]
  51. Tondo, L.; Baldessarini, R.J. Suicidal Behavior in Mood Disorders: Response to Pharmacological Treatment. Curr. Psychiatry Rep. 2016, 18, 88. [Google Scholar] [CrossRef] [PubMed]
  52. Sim, K.; Lau, W.K.; Sim, J.; Sum, M.Y.; Baldessarini, R.J. Prevention of Relapse and Recurrence in Adults with Major Depressive Disorder: Systematic Review and Meta-Analyses of Controlled Trials. Int. J. Neuropsychopharmacol. 2016, 19, pyv076. [Google Scholar] [CrossRef] [PubMed]
  53. Pacchiarotti, I.; Bond, D.; Baldessarini, R.J.; Nolen, W.A.; Grunze, H.; Licht, R.W.; Post, R.M.; Berk, M.; Goodwin, G.M.; Sachs, G.S.; et al. The International Society for Bipolar Disorders (ISBD) Task Force Report on Antidepressant Use in Bipolar Disorders. Am. J. Psychiatry 2013, 170, 1249–1262. [Google Scholar] [CrossRef] [PubMed]
  54. Ingenhoven, T.; Lafay, P.; Rinne, T.; Passchier, J.; Duivenvoorden, H. Effectiveness of Pharmacotherapy for Severe Personality Disorders. J. Clin. Psychiatry 2009, 71, 14–25. [Google Scholar] [CrossRef]
  55. Hill, A.B. The Environment and Disease: Association or Causation? Proc. R. Soc. Med. 1965, 58, 295–300. [Google Scholar] [CrossRef] [Green Version]
  56. Pompili, M.; Innamorati, M.; Raja, M.; Falcone, I.; Ducci, G.; Angeletti, G.; Lester, D.; Girardi, P.; Tatarelli, R.; De Pisa, E. Suicide risk in depression and bipolar disorder: Do impulsiveness-aggressiveness and pharmacotherapy predict suicidal intent? Neuropsychiatr. Dis. Treat. 2008, 4, 247–255. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  57. Lopez-Castroman, J.; Blasco-Fontecilla, H.; Courtet, P.; Baca-García, E.; Oquendo, M.A. Are we studying the right populations to understand suicide? World Psychiatry 2015, 14, 368–369. [Google Scholar] [CrossRef]
  58. Soloff, P.; White, R.; Diwadkar, V.A. Impulsivity, aggression and brain structure in high and low lethality suicide attempters with borderline personality disorder. Psychiatry Res. Neuroimaging 2014, 222, 131–139. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  59. Reich, R.; Gilbert, A.; Clari, R.; Burdick, K.E.; Szeszko, P.R. A preliminary investigation of impulsivity, aggression and white matter in patients with bipolar disorder and a suicide attempt history. J. Affect. Disord. 2019, 247, 88–96. [Google Scholar] [CrossRef] [PubMed]
  60. Insel, T.R. Digital Phenotyping. JAMA 2017, 318, 1215–1216. [Google Scholar] [CrossRef] [PubMed]
Jcm 10 03057 g001 550
Figure 1. Aggression levels differences between suicide attempters and non-attempters across sites. NYC: New York City. SA: Suicide-attempters. NSA: non-suicide attempters.
Figure 1. Aggression levels differences between suicide attempters and non-attempters across sites. NYC: New York City. SA: Suicide-attempters. NSA: non-suicide attempters.
Jcm 10 03057 g001
Jcm 10 03057 g002 550
Figure 2. Impulsivity levels differences between suicide attempters and non-attempters across sites. NYC: New York City. SA: Suicide attempters. NSA: non-suicide attempter.
Figure 2. Impulsivity levels differences between suicide attempters and non-attempters across sites. NYC: New York City. SA: Suicide attempters. NSA: non-suicide attempter.
Jcm 10 03057 g002
Table
Table 1. Characteristics of the samples.
Table 1. Characteristics of the samples.
NYC
(n = 647)		MADRID
(n = 658)		FLORENCE
(n = 93)		p-Value
Mean ± SD
n (%)		Mean ± SD
n (%)		Mean ± SD
n (%)
Age37.8 ± 13.041.1 ± 15.147.3 ± 14.1<0.001
Gender (males)266 (41.1)229 (34.8)33 (35.5)0.57
Education (high)301 (48.2)162 (27.2)5 (14.3)<0.001
Unmarried491 (76.2)400 (65.1)50 (53.8)<0.001
Unemployed388 (60.7)411 (62.5)32 (43.2)0.006
Children245 (40.0)274 (50.4)44 (47.3)0.002
Religion (vs. none)485 (77.6)187 (66.8)52 (80.0)<0.001
MDD482 (74.5)516 (78.4)45 (48.4)<0.001
BD165 (25.5)149 (22.6)48 (51.6)<0.001
Alcohol abuse210 (32.5)126 (23.8)1 (1.0)<0.001
Drugs abuse160 (24.8)93 (17.5)7 (7.6)<0.001
Childhood abuse191 (34.3)117 (23.5)5 (5.4)<0.001
Abuse lifetime242 (43.9)173 (34.8)6 (6.4)<0.001
Suicide attempters303 (46.8)465 (74.9)39 (41.9)<0.001
MDD: Major Depressive Disorder. BD: Bipolar Disorder.
Table
Table 2. Differences in aggression and impulsivity scores across sites.
Table 2. Differences in aggression and impulsivity scores across sites.
NYCMADRIDFLORENCEStatisticp-Value
BGS score n = 441n = 465n = 87
Mean ± SD, 95% CI20.2 ± 5.6, 19.6–20.714.4 ± 5.3, 13.9–14.916.1 ± 4.9, 15.1–17.2F = 12.62NYC > M, p < 0.001
NYC > F, p < 0.001
F > M, p = 0.022
BIS score n = 494n = 251n = 50
Mean ± SD, 95% CI52.0 ± 16.6, 50.5–53.553.2 ± 20.1, 51.2–55.155.0 ± 9.7, 52.3–57.8F = 0.932F > M, p = 0.766
F > NYC, p = 0.490
M > NYC, p = 0.598
BGS: Brown-Goodwin Scale [24]. BIS: Barratt Impulsiveness Scale [25]. NYC: New York City. M: Madrid. F: Florence.
Table
Table 3. Differences in BGS and BIS total scores between suicide attempters and non-attempters across sites.
Table 3. Differences in BGS and BIS total scores between suicide attempters and non-attempters across sites.
NYCMADRIDFLORENCE
AttemptersNon-Attempterstp-ValueAttemptersNon-Attempterstp-ValueAttemptersNon-Attempterstp-Value
BGSn (%)n (%) n (%)n (%) n (%)n (%)
193 (45.2)234 (54.8) 343 (75.7)110 (24.3) 36 (41.4)51 (58.6)
Mean ± SDMean ± SD Mean ± SDMean ± SD Mean ± SDMean ± SD
22.0 ± 5.818.6 ± 4.96.45<0.00114.9 ± 5.613.2 ± 4.33.170.00217.3 ± 5.315.3 ± 4.51.860.067
95% CI Mean95% CI Mean 95% CI Mean95% CI Mean 95% CI Mean95% CI Mean
21.2–22.918.0–19.3 14.3–15.512.4–14.1 15.5–19.114.0–16.6
BISn (%)n (%) n (%)n (%) n (%)n (%)
231 (46.6)265 (53.4) 321 (79.6)82 (20.3) 26 (52.0)24 (48.0)
Mean ± SDMean ± SD Mean ± SDMean ± SD Mean ± SDMean ± SD
54.2 ± 16.650.1 ± 16.32.720.00756.3 ± 18.441.4 ± 21.65.71<0.00157.1 ± 11.052.8 ± 7.51.600.116
95% CI Mean95% CI Mean 95% CI Mean95% CI Mean 95% CI Mean95% CI Mean
52.0–56.348.1–52.1 54.3–58.336.8–46.2 52.6–61.649.6–56.0
BGS: Brown-Goodwin Scale [24]. BIS: Barratt Impulsiveness Scale [25].
Table
Table 4. Binary logistic regression on previous SB.
Table 4. Binary logistic regression on previous SB.
NYCMADRIDFLORENCE
OR95% CIp-ValueOR95% CIp-ValueOR95% CIp-Value
n = 427n = 453n = 87
Alcohol1.260.78–2.040.3431.460.79–2.670.222
Drugs1.370.80–2.340.2481.250.61–2.530.5430.190.02–2.221.86
BGS1.121.07–1.16<0.0011.050.99–1.110.0551.111.01–1.220.032
n = 496n = 251n = 50
Alcohol1.410.93–2.130.1041.490.72–3.070.280
Drugs1.260.67–2.810.1241.410.57–3.500.4610.170.02–1.810.343
BIS1.011.00–1.020.0441.031.02–1.05<0.0011.070.98–1.170.12
BGS: Brown-Goodwin Scale [24]. BIS: Barratt Impulsiveness Scale [25].
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Lopez-Morinigo, J.-D.; Boldrini, M.; Ricca, V.; Oquendo, M.A.; Baca-García, E. Aggression, Impulsivity and Suicidal Behavior in Depressive Disorders: A Comparison Study between New York City (US), Madrid (Spain) and Florence (Italy). J. Clin. Med. 2021, 10, 3057. https://doi.org/10.3390/jcm10143057

AMA Style

Lopez-Morinigo J-D, Boldrini M, Ricca V, Oquendo MA, Baca-García E. Aggression, Impulsivity and Suicidal Behavior in Depressive Disorders: A Comparison Study between New York City (US), Madrid (Spain) and Florence (Italy). Journal of Clinical Medicine. 2021; 10(14):3057. https://doi.org/10.3390/jcm10143057

Chicago/Turabian Style

Lopez-Morinigo, Javier-David, Maura Boldrini, Valdo Ricca, Maria A. Oquendo, and Enrique Baca-García. 2021. "Aggression, Impulsivity and Suicidal Behavior in Depressive Disorders: A Comparison Study between New York City (US), Madrid (Spain) and Florence (Italy)" Journal of Clinical Medicine 10, no. 14: 3057. https://doi.org/10.3390/jcm10143057

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop