Next Article in Journal
Mechanisms of Drug Resistance in the Pathogenesis of Epilepsy: Role of Neuroinflammation. A Literature Review
Next Article in Special Issue
Comparative Study of a Continuous Train of Theta-Burst Stimulation for a Duration of 20 s (cTBS 300) versus a Duration of 40 s (cTBS 600) in a Pre-Stimulation Relaxed Condition in Healthy Volunteers
Previous Article in Journal
Physical Activity and Inhibitory Control: The Mediating Role of Sleep Quality and Sleep Efficiency
Previous Article in Special Issue
TMS-Induced Central Motor Conduction Time at the Non-Infarcted Hemisphere Is Associated with Spontaneous Motor Recovery of the Paretic Upper Limb after Severe Stroke
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
Brain Sciences
Volume 11
Issue 5
10.3390/brainsci11050662
brainsci-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Frontotemporal Transcranial Direct Current Stimulation Decreases Serum Mature Brain-Derived Neurotrophic Factor in Schizophrenia

by
Ondine Adam
1,2,†,
Marion Psomiades
2,†,
Romain Rey
1,2,
Nathalie Mandairon
1,3,
Marie-Francoise Suaud-Chagny
2,
Marine Mondino
1,2 and
Jerome Brunelin
1,2,*
1
Centre Hospitalier Le Vinatier, F-69500 Bron, France
2
INSERM U1028, CNRS UMR5292, PSYR2 Team, Lyon Neuroscience Research Center, Université Claude Bernard Lyon 1, Université Jean Monnet, F-69500 Bron, France
3
INSERM U1028, CNRS UMR5292, NEUROPOP Team, Lyon Neuroscience Research Center, Université Claude Bernard Lyon 1, Université Jean Monnet, F-69500 Bron, France
*
Author to whom correspondence should be addressed.
†
Share first authorship.
Brain Sci. 2021, 11(5), 662; https://doi.org/10.3390/brainsci11050662
Submission received: 8 April 2021 / Revised: 12 May 2021 / Accepted: 15 May 2021 / Published: 19 May 2021
(This article belongs to the Special Issue Brain Stimulation and Neuroplasticity)
Browse Figures
Versions Notes

Abstract

:
Although transcranial direct current stimulation (tDCS) shows promise as a treatment for auditory verbal hallucinations in patients with schizophrenia, mechanisms through which tDCS may induce beneficial effects remain unclear. Evidence points to the involvement of neuronal plasticity mechanisms that are underpinned, amongst others, by brain-derived neurotrophic factor (BDNF) in its two main forms: pro and mature peptides. Here, we aimed to investigate whether tDCS modulates neural plasticity by measuring the acute effects of tDCS on peripheral mature BDNF levels in patients with schizophrenia. Blood samples were collected in 24 patients with schizophrenia before and after they received a single session of either active (20 min, 2 mA, n = 13) or sham (n = 11) frontotemporal tDCS with the anode over the left prefrontal cortex and the cathode over the left temporoparietal junction. We compared the tDCS-induced changes in serum mature BDNF (mBDNF) levels adjusted for baseline values between the two groups. The results showed that active tDCS was associated with a significantly larger decrease in mBDNF levels (mean −20% ± standard deviation 14) than sham tDCS (−8% ± 21) (F = 5.387; p = 0.030; η2 = 0.205). Thus, mature BDNF may be involved in the beneficial effects of frontotemporal tDCS observed in patients with schizophrenia.

1. Introduction

Auditory verbal hallucinations (AVH) are disabling and frequent symptoms in patients with schizophrenia. Among the available therapeutic strategies, some evidence suggests that transcranial direct current stimulation (tDCS) with the anode placed over the left prefrontal cortex and the cathode placed over the left temporoparietal junction may alleviate treatment-resistant AVH [1] up to three months after tDCS treatment [2]. However, although tDCS has shown encouraging clinical results [3], the brain mechanisms through which tDCS may have sustainable beneficial effects on AVH remain unclear. During tDCS, a weak direct current is circulating between two electrodes placed over the scalp of the subject. Physiological effects of tDCS are thought to be mediated by a modulation of the cortical excitability of brain regions situated under the location of electrodes [4]. The effects do not seem limited to the targeted cortical area and the modulatory effect may also spread to a large network of inter-connected brain regions [5,6]. These local and regional effects can outlast the stimulation period, suggesting long-term potentiation (LTP)/long-term depression (LTD)-like mechanisms [7], which require activity-dependent brain-derived neurotrophic factor (BDNF) secretion [8,9].
BDNF is a neurotrophic factor involved in neuronal plasticity including neuronal growth, cortical excitability, and neuronal regeneration mechanisms [10]. Several lines of evidence from animal research have suggested that the effects of tDCS depend on endogenous BDNF levels [11], and that tDCS promotes LTP mechanisms by increasing the expression of BDNF [12]. However, clinical studies investigating the effects of tDCS on BDNF levels in patients with neuropsychiatric conditions have produced controversial results. Although some studies showed that tDCS can induce an increase in serum BDNF levels in opioid-addicted patients [13] or in patients with Parkinson’s disease [14], others did not detect any effects of tDCS on BDNF levels in patients with major depressive disorder [15,16] and bipolar disorder [17]. To the best of our knowledge, no studies have investigated the effect of tDCS on peripheral BDNF levels in patients with schizophrenia. Although some methodological issues regarding the tDCS electrode montage or the diagnosis of included patients should be taken into account to explain the observed discrepancies between studies, the methods used to measure BDNF levels also varied between studies. The classical peripheral measure of BDNF (whether in plasma or serum) includes a combination of the three BDNF isoforms that co-exist in the blood: the BDNF precursor protein (proBDNF) and the results of its proteolytic cleavage: the mature BDNF (mBDNF) and the BDNF prodomain [18]. Although the role of BDNF prodomain remains unclear [19], mBDNF and proBDNF exhibit opposite effects on neural plasticity through their binding to specific receptors. ProBDNF preferentially binds to p75 receptors and is involved in LTD mechanisms, pruning of dendritic arborization, cone retractation, and negatively regulates cell survival [20,21,22,23]. Conversely, mBDNF preferentially binds to tropomyosin receptor kinase B (TrkB) receptors and mBDNF-TrkB signaling is involved in LTP mechanisms, survival of neuronal networks, development of dendritic arborization, and neuronal cone growth [24,25,26,27]. The proportion of each isoform may vary depending on internal (such as age, sex, or drugs [28,29,30]) and external factors [24], and on neuronal activity-dependent mechanisms. For instance, low frequency stimulation of cultured hippocampal neurons preferentially induces proBDNF secretion, whereas high-frequency stimulation increases extracellular mBDNF leading to LTP [31]. Despite the opposing implications of the different isoforms on neural plasticity, a large majority of studies in humans measured only total BDNF, whereas one may hypothesize that the lasting beneficial effects observed after tDCS would be supported by a modulation of mBDNF-TrkB signaling involved in LTP mechanisms rather than pathways of other BDNF isoforms.
The aim of this study was therefore to investigate the effects of tDCS on mBDNF levels in patients with schizophrenia. To achieve our goal, we compared mean changes in serum mBDNF levels before and after a single session of either active or sham frontotemporal tDCS in patients with schizophrenia and AVH.

2. Materials and Methods

2.1. Study Design

This study occurred from 2011 to 2015 at the Centre Hospitalier le Vinatier, psychiatric hospital, Bron, France. In a randomized sham-controlled double-blind trial, participants were randomized to receive either a single session of active or sham tDCS. The study consisted of collecting blood samples once before and once after a single session of tDCS to measure the acute changes in serum mBDNF levels evoked by tDCS. The study was approved by a local ethics committee (Comité de Protection des Personnes Sud-Est VI, France, AU872, 02/02/2011) and complied with international standards for testing with human participants (Declaration of Helsinki). The study was pre-registered in a public database (http://clinicaltrials.gov, registration number NCT02652832, on 12 January 2016). The current study was an ancillary study to a clinical trial previously published elsewhere (NCT00870909; on 27 March 2009) [2]. All participants provided written informed consent before participation.

2.2. Participants

Twenty-seven patients with a DSM-IV-TR diagnosis of schizophrenia agreed to participate in the study. Patients presented with refractory auditory hallucinations, defined as the persistence of daily AVH without remission despite antipsychotic medication at an adequate dosage for at least 3 months and after the failure of at least one other previous treatment with an antipsychotic of different class at adequate dose and duration for the current episode. Exclusion criteria included significant neurological illness; head trauma, history of a seizure not induced by drug withdrawal, current alcohol or drug abuse, or inability to provide informed consent. Since one post-tDCS blood sample was missing, the final sample consisted of data from 26 participants and the analyzed sample from 24 (see Figure 1). Current antipsychotic medication was calculated as chlorpromazine clinically equivalent dose in mg/day following the instructions of Gardner et al. [32].

2.3. tDCS Treatment

Stimulation was administered using a DC Plus Stimulator (NeuroConn, GmBH) with an intensity set at 2 mA. The stimulation was delivered during 20 min (ramp-up/ramp-down of 30 s). Two 7 × 5 cm surface electrodes (35 cm2) placed in saline-soaked sponges were positioned over the scalp according to the 10/20 placement system for electroencephalogram. The anode was placed over the left prefrontal cortex (midway between F3 and FP1) and the cathode was placed over the left temporo-parietal junction (midway between T3 and P3). Rationale for this montage is justified in a previously published article [2].
The sham stimulation consisted of delivering active stimulation with the same electrode montage but only during the first 40 s of the 20 min period (2 mA, 30 s ramp-up/down). For double-blinding, the study mode of the DC-stimulator was used. It consisted of entering a predefined individual 5-digit code into the tDCS stimulator corresponding to active or sham stimulation, so that both the patient and the tDCS operator were blind to the tDCS condition.
To assess the blinding of participants, four participants were randomly chosen to complete a questionnaire that required them to guess whether they received either active or sham stimulation.

2.4. Measures of Serum BDNF

Two blood samples were collected, one before the tDCS session (between 8:00 a.m. and 9:00 a.m.) and one other after the end of the tDCS session (at 11:30 a.m.) on a Monday morning. Since sport practice, tobacco smoking, and alcohol consumption may modulate BDNF levels, participants were asked to avoid physical exercise and alcohol consumption during the 24 h prior to the experiment (Table 1). Tobacco smoking, which is also known to interfere with tDCS-induced aftereffects in patients with schizophrenia [33], was not allowed on the morning of the experiment. Blood samples of 5 mL were collected in fasting participants in a Vacutainer SST™ II Advance tube. After 20 min of clotting time, the whole blood sample was centrifuged at 3500× g for 20 min at 4 °C to isolate the serum. The serum was then collected, aliquoted (200 mL), and stored at −24 °C until analysis.
mBDNF levels were quantified by enzyme-linked immunosorbent assay (ELISA), according to the manufacturers’ instructions (mature BDNF Immunoassay, Aviscera Bioscience, Santa-Clara, CA, USA). Serum samples were applied on precoated 96-well plates and allowed to incubate for two hours at room temperature. Plates were successively incubated with anti-human BDNF antibodies, streptavidin-HRP conjugate, and substrate. The reaction was shut down by stop solutions provided by the manufacturer. The absorbance was read at 450 nm with a micro-plate reader (Perkin Elmer Wallac 1420 Victor2, Winpact Scientific Inc, Saratoga, CA, USA). According to a reference curve, mBDNF levels are expressed in pg·mL−1. Intertrial reproducibility was controlled with an external standard.

2.5. Statistical Analysis

All statistical analyses were performed in Jasp version 0.14. Statistical significance was defined as p < 0.05. Baseline demographic and clinical data were compared between groups (active vs. sham) using independent sample t-tests for continuous variables and Fischer’s exact tests for categorical variables. The primary outcome was the change in mBDNF levels induced by tDCS (ΔBDNF), calculated as mBDNF level after the tDCS session minus mBDNF level before the tDCS session. Potential outliers were identified with Grubb’s test based on the value of the changes in mBDNF levels (https://www.graphpad.com, accessed on 19 May 2021). To compare the effect of active versus sham tDCS on mBDNF level changes, a one-way ANCOVA was performed with tDCS condition (active vs. sham) as a between-subjects factor and baseline mBDNF levels as a covariate. The choice of introducing baseline mBDNF levels as a covariate was made to reduce possible effects of baseline levels on tDCS-induced changes since the two groups showed a trend toward a significant difference in baseline mBDNF levels (see Section 3). Effect size was estimated using eta squared (η2). To investigate the potential influence of other clinical and demographic variables known to have an impact on baseline serum BDNF levels such as age [28], sex [29], illness duration, or medication [30], exploratory Pearson’s correlations were undertaken.

3. Results

Two participants were identified as significant outliers regarding our primary outcome, one in each group, and were thus excluded from the analysis. The final analyzed sample consisted of 24 patients: 13 in the active group and 11 in the sham group.
There were no significant differences between the two groups regarding sociodemographic and clinical characteristics (Table 1). However, since baseline mBDNF levels tended to differ between the two groups (p = 0.054), we added baseline mBDNF level as a covariate in the analysis to control for this factor. The distribution of the different treatments in terms of dose and molecules between the two groups was relatively balanced and no significant differences were observed (Table 1).

3.1. Effect of tDCS on mBDNF Levels

A mean 20% (±14) decrease in mBDNF levels was observed after active tDCS (ΔBDNF = −3181.221 ± 1862 pg·mL−1), whereas a mean 8% (±21) decrease was observed after sham tDCS (ΔBDNF = −912.988 ± 2643 pg·mL−1) (Figure 2). The ANCOVA revealed a significant main effect of tDCS condition on changes in serum mBDNF levels (F = 5.387; p = 0.030; η2 = 0.205). In other words, the decrease in serum mBDNF levels was significantly greater after active than after sham tDCS when adjusted for baseline mBDNF levels. There was no significant effect of the covariate baseline mBDNF level on mBDNF changes (F = 0.080, p = 0.780, η2 = 0.003).
Exploratory Pearson’s correlation analyses undertaken to investigate the influence of clinical and demographic variables on baseline serum mBDNF levels revealed no significant effect of age (r = 0.238; p = 0.262), dose of antipsychotic medication measured as chlorpromazine equivalent in mg/day (r = 0.093; p = 0. 666), or illness duration (r = 0.178; p = 0.404). No significant differences were observed for sex proportion or type of treatments between the two groups at baseline. No difference was observed at baseline between men and women regarding mBDNF levels (men 15,400.287 ± 5126.064 versus women 14569.925 ± 2786.04; p = 0.636).

3.2. Tolerability and Blinding

All participants tolerated the tDCS session well and no serious adverse events were observed. Only two participants from the sham group reported medium adverse effects after the tDCS session (neck suffering, headache, and concentration difficulties).
Regarding the blinding, all four of the participants who were evaluated belonged to the sham group. Among them, two thought they had received active stimulation, one thought he had received the sham stimulation, and one was not able to guess the condition he received. These results suggest that participants were unable to identify which stimulation they were receiving and that the blinding of participants was well respected.

4. Discussion

The aim of the current study was to investigate the effects of a single session of frontotemporal tDCS on serum mBDNF levels in patients with schizophrenia and AVH. Active stimulation led to a significantly greater reduction in mBDNF levels compared with sham stimulation, with a small to medium effect size.
Our findings are consistent with previous studies using other forms of noninvasive brain stimulation (NIBS) techniques that reported a significant decrease in peripheral BDNF levels after stimulation of the prefrontal cortex [34,35,36]. Along this line, it was reported that a single session of repetitive transcranial magnetic stimulation (rTMS) applied over the left prefrontal cortex can decrease BDNF levels in healthy volunteers [34], and that multiple sessions of either low- or high-frequency rTMS applied over the prefrontal cortex can also decrease peripheral BDNF levels in both healthy volunteers [35] and in patients with amyotrophic lateral sclerosis [36]. However, our current findings do not support results from other studies reporting that NIBS did not modulate BDNF levels in patients with depression receiving high frequency rTMS [37], and in patients with uni- or bipolar depression receiving repeated sessions of frontal tDCS with the anode placed over the left prefrontal cortex [15,16,17]. Moreover, the present results are opposite to those from studies reporting that NIBS may induce an increase in BDNF levels in patients with depression receiving high-frequency rTMS over the left prefrontal cortex [38] or in patients with opioid addiction receiving tDCS over the dorsolateral prefrontal cortex [13]. Although all these studies targeted the PFC, the discrepancies between observed results may be related to variations in other NIBS parameters such as the total number of sessions delivered (which varies from 1 to 22 between studies), the type of the NIBS itself (rTMS or tDCS), and the number of sessions delivered by day, all of which are important to take into account [39,40,41,42].
The effects of NIBS on BDNF levels may also be influenced by participant diagnosis, further explaining the heterogeneous results observed in the literature. In line with this hypothesis, low frequency rTMS applied to the prefrontal cortex may induce a decrease in BDNF levels in healthy volunteers but not in patients with amyotrophic lateral sclerosis, who showed a decrease in BDNF levels only after high-frequency rTMS [36]. Thus, NIBS may either increase, decrease, or have no effect on peripheral BDNF levels depending on NIBS parameters and on the diagnosis of participants. To the best of our knowledge, no previous study has investigated the effects of tDCS on BDNF levels in patients with schizophrenia, although some evidence suggests abnormal BDNF regulation in this illness [43,44]. The present findings suggest that a single session of frontotemporal tDCS may decrease mBDNF in patients with schizophrenia and treatment-resistant AVH. Our results cannot be extended to patients with schizophrenia with other types of prominent symptoms (such as those with prominent negative symptoms or those with non-treatment-resistant schizophrenia) or to patients with another psychiatric condition that may have another baseline BDNF status.
The methods used to measure BDNF levels may also contribute to the heterogeneous results observed in the NIBS literature. Firstly, BDNF can be collected from either serum or plasma, while there is no consensus on their relative interpretations. Secondly, to date, the majority of studies have measured the effects of NIBS on total BDNF levels. To the best of our knowledge, the present study is one of the first to specifically explore tDCS effects on mBDNF rather than on total BDNF. Such methodological differences prevent any direct comparison between the current results and the literature. However, one may hypothesize that measuring the effects of one NIBS session on each of the BDNF isoforms is a particularly relevant approach to better understand NIBS-induced neuroplasticity, since proBDNF and mBDNF exhibit opposite effects on plasticity [27]. Due to its beneficial effects on LTP via the BDNF-TrkB signaling pathway, the mBDNF isoform may better reflect the beneficial effects of tDCS on neural plasticity. Nevertheless, BDNF is first synthesized as proBDNF, stored in dense core vesicles in neurons, and thereafter can be cleaved in mBDNF, either in the intracellular or extracellular compartment [45]. Thus, the observed increase, decrease, or null effect of tDCS on total BDNF after tDCS in the literature may be partly explained by compensation phenomena between the isoform concentrations. In this regard, one potential explanation for our results is that reduction in serum mBDNF may reflect an increased use of mBDNF in the central nervous system (CNS) after one tDCS session, resulting in the enhancement in neuronal plasticity induced by the stimulation [11,46].
Additionally, it was reported that BDNF-Val66Met-polymorphism interacts with tDCS dose to predict neurocognitive outcomes in patients with depression [47]. Similarly, BDNF-Val66Met-polymorphism may interact with tDCS to predict cortical plasticity in patients with schizophrenia [48]. Such gene–environment interactions support the hypothesis of a close relationship between tDCS-induced neural plasticity and BDNF, even in patients with schizophrenia.
Finally, we observed a trend toward a statistically significant difference in baseline mBDNF levels between the active and sham groups that may have influenced the present results. To rule out this potentially confounding effect, we introduced baseline mBDNF levels as a covariate in the primary analysis and we undertook exploratory analyses to control for the role of different moderators that may have influenced baseline mBDNF levels in patients with schizophrenia. It was reported that: (i) age negatively correlates with total BDNF levels [28], (ii) men exhibit higher levels of BDNF compared with women in a sample including patients with depression and healthy controls [29], and (iii) antipsychotics may increase BDNF levels in patients with schizophrenia [30] in a dose-dependent manner with clozapine but not with first generation antipsychotics [49]. No differences have been identified between active and sham groups regarding these parameters, and there was no correlation between these parameters and mBDNF levels at baseline. Further analyses did not reveal significant associations between baseline mBDNF and the variables identified above, and no differences were observed between the active and sham groups, suggesting that baseline mBDNF did not influence current results. Another important interaction that may have influenced the results observed in patients with schizophrenia under antipsychotic medication is the close relationship between BDNF synthesis and central dopamine release. It was observed in heterozygous BDNF (BDNF+/−) mice that endogenous BDNF may influence central dopamine neurotransmission by regulating the release and uptake dynamics of pre-synaptic dopamine transmission [50]. The interaction between antipsychotics binding on dopamine receptors, tDCS-induced dopamine release [6], and endogenous levels of BDNF needs further investigation in patients with schizophrenia.
The current study has some limitations that should be acknowledged. Firstly, the present results were obtained from an ancillary study to an RCT investigating the clinical effects of 10 sessions of tDCS on hallucinations in patients with schizophrenia [2]. The current study therefore has a relatively low statistical power, and no a priori sample size calculation was performed regarding the current outcome. Secondly, we investigated here the acute effect of a single session of tDCS on mBDNF, but it would have been interesting to examine the effect of repeated sessions of tDCS on BDNF levels since repeated sessions are usually needed to obtain a sustainable clinical effect. Thirdly, we only measured serum mBDNF levels, which prevented us from investigating the effects of tDCS on other isoforms of BDNF or on total BDNF. Fourthly, we only investigated acute changes after a single session of tDCS, thus no delayed effects of tDCS on mBDNF were investigated. Notably, in animal models, tDCS could either increase or decrease both serum and central BDNF levels depending on the delay between the tDCS sessions and the BDNF measure [51], suggesting that this parameter can be of major interest. Fifthly, while serum BDNF may be a good indicator of BDNF regulation in the central nervous system [52], it may not directly reflect brain fluctuations. However, it was shown that BDNF can cross the blood–brain barrier [53] and that BDNF blood levels correlate with BDNF levels in brain tissues [54]. Finally, we did not investigate the effect of BDNF single nucleotide polymorphism on the response to tDCS, although it was shown that BDNF-Val66Met-polymorphism interacts with tDCS aftereffects [48]. This specific polymorphism possibly interferes with the secretory pathway, resulting in a decreased secretion of BDNF [55,56]. More studies are needed to investigate the effect of this polymorphism on tDCS-induced mBDNF level variation.

5. Conclusions

In patients with schizophrenia and AVH, the current study highlighted that one session of active frontotemporal tDCS induces a significantly larger decrease in serum mBDNF levels compared with the sham. Beneficial effects of tDCS observed in patients with schizophrenia may be underpinned by a regulation of the mBDNF-TrkB signaling-related pathway that modulates neural plasticity. This study is a first step toward a better understanding of the mechanisms through which tDCS modulates brain plasticity in patients with schizophrenia. Further studies are needed to explore the effects of tDCS on each BDNF isoform and to investigate the respective roles of BDNF polymorphisms in the mechanisms underlying the physiological effects of tDCS in the CNS.

Author Contributions

J.B., M.M., and M.-F.S.-C. conceived and designed the study. N.M. and M.P. designed and performed the ELISA analysis. O.A., J.B., M.-F.S.-C., and M.M. contributed to the analysis and interpretation of the results. O.A. wrote the first draft of the manuscript. M.-F.S.-C., N.M., R.R., and M.P. critically revised the manuscript. O.A. and M.P. share first authorship. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the scientific council of Le Vinatier Hospital Center, grant number CSR B04; and the Fondation de l’Avenir #RMA 2015 (MFSC).

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki, and approved by the Ethics Committee of Comité de Protection des Personnes Sud-Est VI, France AU872 (2 February 2011), AFSSAPS protocol code ID RCB 2010-A01249-30 (24 October 2008).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

Data will be available upon reasonable request by contacting the corresponding author.

Acknowledgments

The authors are very grateful to Caroline Damasceno who carried out the stimulation sessions and collected the blood samples.

Conflicts of Interest

The authors declare no conflict of interest. The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript, or in the decision to publish the results.

References

  1. Mondino, M.; Sauvanaud, F.; Brunelin, J. A Review of the Effects of Transcranial Direct Current Stimulation for the Treatment of Hallucinations in Patients with Schizophrenia. J. ECT 2018, 34, 164–171. [Google Scholar] [CrossRef] [PubMed]
  2. Brunelin, J.; Mondino, M.; Gassab, L.; Haesebaert, F.; Gaha, L.; Suaud-Chagny, M.-F.; Saoud, M.; Mechri, A.; Poulet, E. Examining Transcranial Direct-Current Stimulation (TDCS) as a Treatment for Hallucinations in Schizophrenia. Am. J. Psychiatry 2012, 169, 719–724. [Google Scholar] [CrossRef] [PubMed]
  3. Fregni, F.; El-Hagrassy, M.M.; Pacheco-Barrios, K.; Carvalho, S.; Leite, J.; Simis, M.; Brunelin, J.; Nakamura-Palacios, E.M.; Marangolo, P.; Venkatasubramanian, G.; et al. Evidence-Based Guidelines and Secondary Meta-Analysis for the Use of Transcranial Direct Current Stimulation (TDCS) in Neurological and Psychiatric Disorders. Int. J. Neuropsychopharmacol. 2021, 24, 256–313. [Google Scholar] [CrossRef] [PubMed]
  4. Nitsche, M.A.; Paulus, W. Sustained Excitability Elevations Induced by Transcranial DC Motor Cortex Stimulation in Humans. Neurology 2001, 57, 1899–1901. [Google Scholar] [CrossRef]
  5. Keeser, D.; Meindl, T.; Bor, J.; Palm, U.; Pogarell, O.; Mulert, C.; Brunelin, J.; Möller, H.-J.; Reiser, M.; Padberg, F. Prefrontal Transcranial Direct Current Stimulation Changes Connectivity of Resting-State Networks during FMRI. J. Neurosci. 2011, 31, 15284–15293. [Google Scholar] [CrossRef]
  6. Fonteneau, C.; Redoute, J.; Haesebaert, F.; Le Bars, D.; Costes, N.; Suaud-Chagny, M.-F.; Brunelin, J. Frontal Transcranial Direct Current Stimulation Induces Dopamine Release in the Ventral Striatum in Human. Cereb. Cortex 2018, 28, 2636–2646. [Google Scholar] [CrossRef]
  7. Stagg, C.J.; Nitsche, M.A. Physiological Basis of Transcranial Direct Current Stimulation. Neuroscientist 2011, 17, 37–53. [Google Scholar] [CrossRef]
  8. Lu, B. BDNF and Activity-Dependent Synaptic Modulation. Learn. Mem. 2003, 10, 86–98. [Google Scholar] [CrossRef] [Green Version]
  9. Mowla, S.J.; Pareek, S.; Farhadi, H.F.; Petrecca, K.; Fawcett, J.P.; Seidah, N.G.; Morris, S.J.; Sossin, W.S.; Murphy, R.A. Differential Sorting of Nerve Growth Factor and Brain-Derived Neurotrophic Factor in Hippocampal Neurons. J. Neurosci. 1999, 19, 2069–2080. [Google Scholar] [CrossRef] [Green Version]
  10. Sasi, M.; Vignoli, B.; Canossa, M.; Blum, R. Neurobiology of Local and Intercellular BDNF Signaling. Pflug. Arch. Eur. J. Physiol. 2017, 469, 593–610. [Google Scholar] [CrossRef] [Green Version]
  11. Fritsch, B.; Reis, J.; Martinowich, K.; Schambra, H.M.; Ji, Y.; Cohen, L.G.; Lu, B. Direct Current Stimulation Promotes BDNF-Dependent Synaptic Plasticity: Potential Implications for Motor Learning. Neuron 2010, 66, 198–204. [Google Scholar] [CrossRef] [Green Version]
  12. Podda, M.V.; Cocco, S.; Mastrodonato, A.; Fusco, S.; Leone, L.; Barbati, S.A.; Colussi, C.; Ripoli, C.; Grassi, C. Anodal Transcranial Direct Current Stimulation Boosts Synaptic Plasticity and Memory in Mice via Epigenetic Regulation of Bdnf Expression. Sci. Rep. 2016, 6, 1–19. [Google Scholar] [CrossRef]
  13. Eskandari, Z.; Dadashi, M.; Mostafavi, H.; Armani Kia, A.; Pirzeh, R. Comparing the Efficacy of Anodal, Cathodal, and Sham Transcranial Direct Current Stimulation on Brain-Derived Neurotrophic Factor and Psychological Symptoms in Opioid-Addicted Patients. Basic Clin. Neurosci. 2019, 10, 641–650. [Google Scholar] [CrossRef]
  14. Hadoush, H.; Banihani, S.A.; Khalil, H.; Al-Qaisi, Y.; Al-Sharman, A.; Al-Jarrah, M. Dopamine, BDNF and Motor Function Postbilateral Anodal Transcranial Direct Current Stimulation in Parkinson’s Disease. Neurodegener. Dis. Manag. 2018, 8, 171–179. [Google Scholar] [CrossRef]
  15. Palm, U.; Fintescu, Z.; Obermeier, M.; Schiller, C.; Reisinger, E.; Keeser, D.; Pogarell, O.; Bondy, B.; Zill, P.; Padberg, F. Serum Levels of Brain-Derived Neurotrophic Factor Are Unchanged after Transcranial Direct Current Stimulation in Treatment-Resistant Depression. J. Affect. Disord. 2013, 150, 659–663. [Google Scholar] [CrossRef]
  16. Brunoni, A.R.; Padberg, F.; Vieira, E.L.M.; Teixeira, A.L.; Carvalho, A.F.; Lotufo, P.A.; Gattaz, W.F.; Benseñor, I.M. Plasma Biomarkers in a Placebo-Controlled Trial Comparing TDCS and Escitalopram Efficacy in Major Depression. Prog. Neuro-Psychopharmacol. Biol. Psychiatry 2018, 86, 211–217. [Google Scholar] [CrossRef]
  17. Goerigk, S.; Cretaz, E.; Sampaio-Junior, B.; Vieira, É.L.M.; Gattaz, W.; Klein, I.; Lafer, B.; Teixeira, A.L.; Carvalho, A.F.; Lotufo, P.A.; et al. Effects of TDCS on Neuroplasticity and Inflammatory Biomarkers in Bipolar Depression: Results from a Sham-Controlled Study. Prog. Neuro-Psychopharmacol. Biol. Psychiatry 2021, 105, 110119. [Google Scholar] [CrossRef]
  18. Wang, M.; Xie, Y.; Qin, D. Proteolytic Cleavage of ProBDNF to MBDNF in Neuropsychiatric and Neurodegenerative Diseases. Brain Res. Bull. 2020, 172–184. [Google Scholar] [CrossRef]
  19. Ambigapathy, G.; Zheng, Z.; Li, W.; Keifer, J. Identification of a Functionally Distinct Truncated BDNF MRNA Splice Variant and Protein in Trachemys scripta elegans. PLoS ONE 2013, 8, e67141. [Google Scholar] [CrossRef]
  20. Woo, N.H.; Teng, H.K.; Siao, C.-J.; Chiaruttini, C.; Pang, P.T.; Milner, T.A.; Hempstead, B.L.; Lu, B. Activation of P75 NTR by ProBDNF Facilitates Hippocampal Long-Term Depression. Nat. Neurosci. 2005, 8, 1069–1077. [Google Scholar] [CrossRef]
  21. Koshimizu, H.; Kiyosue, K.; Hara, T.; Hazama, S.; Suzuki, S.; Uegaki, K.; Nagappan, G.; Zaitsev, E.; Hirokawa, T.; Tatsu, Y.; et al. Multiple Functions of Precursor BDNF to CNS Neurons: Negative Regulation of Neurite Growth, Spine Formation and Cell Survival. Mol. Brain 2009, 2, 27. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  22. Teng, H.K.; Teng, K.K.; Lee, R.; Wright, S.; Tevar, S.; Almeida, R.D.; Kermani, P.; Torkin, R.; Chen, Z.-Y.; Lee, F.S.; et al. ProBDNF Induces Neuronal Apoptosis via Activation of a Receptor Complex of P75NTR and Sortilin. J. Neurosci. 2005, 25, 5455–5463. [Google Scholar] [CrossRef] [PubMed]
  23. Rösch, H.; Schweigreiter, R.; Bonhoeffer, T.; Barde, Y.-A.; Korte, M. The Neurotrophin Receptor P75NTR Modulates Long-Term Depression and Regulates the Expression of AMPA Receptor Subunits in the Hippocampus. Proc. Natl. Acad. Sci. USA 2005, 102, 7362–7367. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  24. Kowiański, P.; Lietzau, G.; Czuba, E.; Waśkow, M.; Steliga, A.; Moryś, J. BDNF: A Key Factor with Multipotent Impact on Brain Signaling and Synaptic Plasticity. Cell Mol. Neurobiol. 2018, 38, 579–593. [Google Scholar] [CrossRef] [PubMed]
  25. Pang, P.T.; Teng, H.K.; Zaitsev, E.; Woo, N.T.; Sakata, K.; Zhen, S.; Teng, K.K.; Yung, W.-H.; Hempstead, B.L.; Lu, B. Cleavage of ProBDNF by TPA/Plasmin Is Essential for Long-Term Hippocampal Plasticity. Science 2004, 306, 487–491. [Google Scholar] [CrossRef] [PubMed]
  26. Patterson, S.L.; Abel, T.; Deuel, T.A.S.; Martin, K.C.; Rose, J.C.; Kandel, E.R. Recombinant BDNF Rescues Deficits in Basal Synaptic Transmission and Hippocampal LTP in BDNF Knockout Mice. Neuron 1996, 16, 1137–1145. [Google Scholar] [CrossRef] [Green Version]
  27. Deinhardt, K.; Chao, M.V. Shaping Neurons: Long and Short Range Effects of Mature and ProBDNF Signalling upon Neuronal Structure. Neuropharmacology 2014, 76, 603–609. [Google Scholar] [CrossRef] [Green Version]
  28. Lommatzsch, M.; Zingler, D.; Schuhbaeck, K.; Schloetcke, K.; Zingler, C.; Schuff-Werner, P.; Virchow, J.C. The Impact of Age, Weight and Gender on BDNF Levels in Human Platelets and Plasma. Neurobiol. Aging 2005, 26, 115–123. [Google Scholar] [CrossRef]
  29. Ozan, E.; Okur, H.; Eker, C.; Eker, Ö.; Gönül, A.S.; Akarsu, N. The Effect of Depression, BDNF Gene Val66met Polymorphism and Gender on Serum BDNF Levels. Brain Res. Bull. 2010, 81, 61–65. [Google Scholar] [CrossRef]
  30. Fernandes, B.S.; Steiner, J.; Berk, M.; Molendijk, M.L.; Gonzalez-Pinto, A.; Turck, C.W.; Nardin, P.; Gonçalves, C.-A. Peripheral Brain-Derived Neurotrophic Factor in Schizophrenia and the Role of Antipsychotics: Meta-Analysis and Implications. Mol. Psychiatry 2015, 20, 1108–1119. [Google Scholar] [CrossRef]
  31. Nagappan, G.; Zaitsev, E.; Senatorov, V.V.; Yang, J.; Hempstead, B.L.; Lu, B. Control of Extracellular Cleavage of ProBDNF by High Frequency Neuronal Activity. Proc. Natl. Acad. Sci. USA 2009, 106, 1267–1272. [Google Scholar] [CrossRef] [Green Version]
  32. Gardner, D.M.; Murphy, A.L.; O’Donnell, H.; Centorrino, F.; Baldessarini, R.J. International Consensus Study of Antipsychotic Dosing. Am. J. Psychiatry 2010, 167, 686–693. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  33. Brunelin, J.; Hasan, A.; Haesebaert, F.; Nitsche, M.A.; Poulet, E. Nicotine Smoking Prevents the Effects of Frontotemporal Transcranial Direct Current Stimulation (TDCS) in Hallucinating Patients with Schizophrenia. Brain Stimul. 2015, 8, 1225–1227. [Google Scholar] [CrossRef] [PubMed]
  34. Gaede, G.; Hellweg, R.; Zimmermann, H.; Brandt, A.U.; Dörr, J.; Bellmann-Strobl, J.; Zangen, A.; Paul, F.; Pfueller, C.F. Effects of Deep Repetitive Transcranial Magnetic Stimulation on Brain-Derived Neurotrophic Factor Serum Concentration in Healthy Volunteers. Neuropsychobiology 2014, 69, 112–119. [Google Scholar] [CrossRef]
  35. Schaller, G.; Sperling, W.; Richter-Schmidinger, T.; Mühle, C.; Heberlein, A.; Maihöfner, C.; Kornhuber, J.; Lenz, B. Serial Repetitive Transcranial Magnetic Stimulation (RTMS) Decreases BDNF Serum Levels in Healthy Male Volunteers. J. Neural. Transm. 2014, 121, 307–313. [Google Scholar] [CrossRef]
  36. Angelucci, F.; Oliviero, A.; Pilato, F.; Saturno, E.; Dileone, M.; Versace, V.; Musumeci, G.; Batocchi, A.P.; Tonali, P.A.; Lazzaro, V.D. Transcranial Magnetic Stimulation and BDNF Plasma Levels in Amyotrophic Lateral Sclerosis. NeuroReport 2004, 15, 717–720. [Google Scholar] [CrossRef]
  37. Lang, U.E.; Bajbouj, M.; Gallinat, J.; Hellweg, R. Brain-Derived Neurotrophic Factor Serum Concentrations in Depressive Patients during Vagus Nerve Stimulation and Repetitive Transcranial Magnetic Stimulation. Psychopharmacology 2006, 187, 56–59. [Google Scholar] [CrossRef]
  38. Zhao, X.; Li, Y.; Tian, Q.; Zhu, B.; Zhao, Z. Repetitive Transcranial Magnetic Stimulation Increases Serum Brain-Derived Neurotrophic Factor and Decreases Interleukin-1β and Tumor Necrosis Factor-α in Elderly Patients with Refractory Depression. J. Int. Med. Res. 2019, 47, 1848–1855. [Google Scholar] [CrossRef]
  39. Monte-Silva, K.; Kuo, M.-F.; Liebetanz, D.; Paulus, W.; Nitsche, M.A. Shaping the Optimal Repetition Interval for Cathodal Transcranial Direct Current Stimulation (TDCS). J. Neurophysiol. 2010, 103, 1735–1740. [Google Scholar] [CrossRef] [Green Version]
  40. Alonzo, A.; Brassil, J.; Taylor, J.L.; Martin, D.; Loo, C.K. Daily Transcranial Direct Current Stimulation (TDCS) Leads to Greater Increases in Cortical Excitability than Second Daily Transcranial Direct Current Stimulation. Brain Stimul. 2012, 5, 208–213. [Google Scholar] [CrossRef]
  41. Paulus, W. Transcranial Electric and Magnetic Stimulation. Brain Stimul. 2013, 116, 329–342. [Google Scholar]
  42. Stagg, C.J.; Antal, A.; Nitsche, M.A. Physiology of Transcranial Direct Current Stimulation. J. ECT 2018, 34, 144–152. [Google Scholar] [CrossRef] [PubMed]
  43. Green, M.J.; Matheson, S.L.; Shepherd, A.; Weickert, C.S.; Carr, V.J. Brain-Derived Neurotrophic Factor Levels in Schizophrenia: A Systematic Review with Meta-Analysis. Mol. Psychiatry 2011, 16, 960–972. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  44. Ahmed, A.O.; Kramer, S.; Hofman, N.; Flynn, J.; Hansen, M.; Martin, V.; Pillai, A.; Buckley, P.F. A Meta-Analysis of Brain-Derived Neurotrophic Factor Effects on Brain Volume in Schizophrenia: Genotype and Serum Levels. Neuropsychobiology 2021, 11, 1–14. [Google Scholar] [CrossRef] [PubMed]
  45. Leßmann, V.; Brigadski, T. Mechanisms, Locations, and Kinetics of Synaptic BDNF Secretion: An Update. Neurosci. Res. 2009, 65, 11–22. [Google Scholar] [CrossRef]
  46. Vallence, A.M.; Ridding, M.C. Non-Invasive Induction of Plasticity in the Human Cortex: Uses and Limitations. Cortex 2014, 58, 261–271. [Google Scholar] [CrossRef] [Green Version]
  47. McClintock, S.M.; Martin, D.M.; Lisanby, S.H.; Alonzo, A.; McDonald, W.M.; Aaronson, S.T.; Husain, M.M.; O’Reardon, J.P.; Weickert, C.S.; Mohan, A.; et al. Neurocognitive Effects of Transcranial Direct Current Stimulation (TDCS) in Unipolar and Bipolar Depression: Findings from an International Randomized Controlled Trial. Depress. Anxiety 2020, 37, 261–272. [Google Scholar] [CrossRef]
  48. Strube, W.; Nitsche, M.A.; Wobrock, T.; Bunse, T.; Rein, B.; Herrmann, M.; Schmitt, A.; Nieratschker, V.; Witt, S.H.; Rietschel, M.; et al. BDNF-Val66Met-Polymorphism Impact on Cortical Plasticity in Schizophrenia Patients: A Proof-of-Concept Study. Int. J. Neuropsychopharmacol. 2015, 18, pyu040. [Google Scholar] [CrossRef]
  49. Grillo, R.W.; Ottoni, G.L.; Leke, R.; Souza, D.O.; Portela, L.V.; Lara, D.R. Reduced Serum BDNF Levels in Schizophrenic Patients on Clozapine or Typical Antipsychotics. J. Psychiatr. Res. 2007, 41, 31–35. [Google Scholar] [CrossRef]
  50. Bosse, K.E.; Maina, F.K.; Birbeck, J.A.; France, M.M.; Roberts, J.J.P.; Colombo, M.L.; Mathews, T.A. Aberrant Striatal Dopamine Transmitter Dynamics in Brain-Derived Neurotrophic Factor-Deficient Mice. J. Neurochem. 2012, 120, 385–395. [Google Scholar] [CrossRef] [Green Version]
  51. Filho, P.R.M.; Vercelino, R.; Cioato, S.G.; Medeiros, L.F.; de Oliveira, C.; Scarabelot, V.L.; Souza, A.; Rozisky, J.R.; Quevedo, A.d.S.; Adachi, L.N.S.; et al. Transcranial Direct Current Stimulation (TDCS) Reverts Behavioral Alterations and Brainstem BDNF Level Increase Induced by Neuropathic Pain Model: Long-Lasting Effect. Prog. Neuro-Psychopharmacol. Biol. Psychiatry 2016, 64, 44–51. [Google Scholar] [CrossRef] [Green Version]
  52. Klein, A.B.; Williamson, R.; Santini, M.A.; Clemmensen, C.; Ettrup, A.; Rios, M.; Knudsen, G.M.; Aznar, S. Blood BDNF Concentrations Reflect Brain-Tissue BDNF Levels across Species. Int. J. Neuropsychopharmacol. 2011, 14, 347–353. [Google Scholar] [CrossRef] [Green Version]
  53. Pan, W.; Banks, W.A.; Fasold, M.B.; Bluth, J.; Kastin, A.J. Transport of Brain-Derived Neurotrophic Factor across the Blood–Brain Barrier. Neuropharmacology 1998, 37, 1553–1561. [Google Scholar] [CrossRef]
  54. Sartorius, A.; Hellweg, R.; Litzke, J.; Vogt, M.; Dormannn, C.; Vollmayr, B.; Danker-Hopfe, H.; Gass, P. Correlations and Discrepancies between Serum and Brain Tissue Levels of Neurotrophins after Electroconvulsive Treatment in Rats. Pharmacopsychiatry 2009, 270–276. [Google Scholar] [CrossRef]
  55. Egan, M.F.; Kojima, M.; Callicott, J.H.; Goldberg, T.E.; Kolachana, B.S.; Bertolino, A.; Zaitsev, E.; Gold, B.; Goldman, D.; Dean, M.; et al. The BDNF Val66met Polymorphism Affects Activity-Dependent Secretion of BDNF and Human Memory and Hippocampal Function. Cell 2003, 112, 257–269. [Google Scholar] [CrossRef] [Green Version]
  56. Chen, Z.-Y.; Patel, P.D.; Sant, G.; Meng, C.-X.; Teng, K.K.; Hempstead, B.L.; Lee, F.S. Variant Brain-Derived Neurotrophic Factor (BDNF) (Met66) Alters the Intracellular Trafficking and Activity-Dependent Secretion of Wild-Type BDNF in Neuro-secretory Cells and Cortical Neurons. J. Neurosci. 2004, 24, 4401–4411. [Google Scholar] [CrossRef]
Brainsci 11 00662 g001 550
Figure 1. CONSORT flow diagram of the study.
Figure 1. CONSORT flow diagram of the study.
Brainsci 11 00662 g001
Brainsci 11 00662 g002 550
Figure 2. Changes in mBDNF levels (ΔBDNF) after active or sham tDCS. The decrease in serum mBDNF levels was significantly greater after active than after sham tDCS when adjusted for baseline mBDNF levels (F = 5.387; p = 0.030; η2 = 0.205).
Figure 2. Changes in mBDNF levels (ΔBDNF) after active or sham tDCS. The decrease in serum mBDNF levels was significantly greater after active than after sham tDCS when adjusted for baseline mBDNF levels (F = 5.387; p = 0.030; η2 = 0.205).
Brainsci 11 00662 g002
Table
Table 1. Baseline sociodemographic and clinical data of participants in active and sham groups.
Table 1. Baseline sociodemographic and clinical data of participants in active and sham groups.
Active Group
(Mean ± SD)		Sham Group
(Mean ± SD)		p-Value
n total1311
Age (years)33.08 ± 8.9637.18 ± 9.380.285
Illness duration (years)10.38 ± 9.5114.73 ± 7.790.132
Sex (n)6F/7M5F/6M0.973
(%)46%/54%45%/55%
Handedness (n)11R/1L/1 both9R/2L0.484
Smokers (%)58%40%0.392
Alcohol intake 1 (%)0%9%0.267
Physical exercise 1 (%)8%9%0.902
PANSS Total66.00 ± 14.8969.78 ± 14.890.565
PANSS Positive18.00 ± 4.8119.44 ± 3.470.450
PANSS Negative19.00 ± 5.6317.33 ± 5.310.493
PANSS General29.00 ± 5.3133.00 ± 7.620.262
mBDNF (pg·mL−1)16,510.80 ± 4346.9813,257.50 ± 3274.580.054
Antipsychotic dose (CPZeq)930.41 ± 415.131192.91 ± 449.450.151
Molecule
Typical antipsychotics420.649
Atypical antipsychotics12111.000
Clozapine441.000
Antidepressants340.659
Benzodiazepines520.386
Anxiolytics360.206
CPZeq, chlorpromazine clinically equivalent dose in mg/day [32]; F, female; M, male; mBDNF, mature brain-derived neurotrophic factor; L, left-hander; PANSS, positive and negative syndrome scale; R, right-hander; SD, standard deviation. 1 Alcohol consumption and physical exercise were controlled for the 24 h prior to the experiment. p-values were obtained using independent samples t-tests for age, PANSS scores, CPZeq and mBDNF levels, and Fischer’s exact test tests for other variables.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Adam, O.; Psomiades, M.; Rey, R.; Mandairon, N.; Suaud-Chagny, M.-F.; Mondino, M.; Brunelin, J. Frontotemporal Transcranial Direct Current Stimulation Decreases Serum Mature Brain-Derived Neurotrophic Factor in Schizophrenia. Brain Sci. 2021, 11, 662. https://doi.org/10.3390/brainsci11050662

AMA Style

Adam O, Psomiades M, Rey R, Mandairon N, Suaud-Chagny M-F, Mondino M, Brunelin J. Frontotemporal Transcranial Direct Current Stimulation Decreases Serum Mature Brain-Derived Neurotrophic Factor in Schizophrenia. Brain Sciences. 2021; 11(5):662. https://doi.org/10.3390/brainsci11050662

Chicago/Turabian Style

Adam, Ondine, Marion Psomiades, Romain Rey, Nathalie Mandairon, Marie-Francoise Suaud-Chagny, Marine Mondino, and Jerome Brunelin. 2021. "Frontotemporal Transcranial Direct Current Stimulation Decreases Serum Mature Brain-Derived Neurotrophic Factor in Schizophrenia" Brain Sciences 11, no. 5: 662. https://doi.org/10.3390/brainsci11050662

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop