Next Article in Journal
Delayed Intracerebral Hematoma after Ventriculoperitoneal Shunt in the Context of Ruptured Brain Arteriovenous Malformation: A Literature Review
Previous Article in Journal
A Study of Brain Function Characteristics of Service Members at High Risk for Accidents in the Military
Previous Article in Special Issue
Task Cortical Connectivity Reveals Different Network Reorganizations between Mild Stroke Patients with Cortical and Subcortical Lesions
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Effects of Repetitive Transcranial Magnetic Stimulation at the Cerebellum on Working Memory

1
Nanjing Research Institute of Electronic Technology, Nanjing 210019, China
2
Department of Neurology, The Affiliated Brain Hospital of Nanjing Medical University, Nanjing 210029, China
*
Authors to whom correspondence should be addressed.
Brain Sci. 2023, 13(8), 1158; https://doi.org/10.3390/brainsci13081158
Submission received: 6 July 2023 / Revised: 30 July 2023 / Accepted: 31 July 2023 / Published: 3 August 2023

Abstract

:
Transcranial magnetic stimulation is a widely used brain intervention technique in clinical settings. In recent years, the role of the cerebellum in learning and memory has become one of the hotspots in the field of cognitive neuroscience. In this study, we recruited 36 healthy college or graduate students as subjects and divided them into groups, with 10 to 14 subjects in each group. We performed 5 Hz and 20 Hz repeated transcranial magnetic stimulation and sham stimulation on the Crus II subregion of the cerebellum in different groups, then let them complete the 2-back working memory task before and after the stimulation. We simultaneously recorded the electroencephalogram in the experiment and analyzed the data. We found that after repeated transcranial magnetic stimulation of the cerebellum at 5 Hz and 20 Hz, the N170 and P300 event-related potential components in the prefrontal cortex showed significant differences compared to those in the sham stimulation group. Using phase-locked values to construct brain networks and conduct further analysis, we discovered that stimulation frequencies of 5 Hz and 20 Hz had significant effects on the local and global efficiency of brain networks in comparison to the sham stimulation group. The results showed that repeated transcranial magnetic stimulation on cerebellar targets can effectively affect the subjects’ working memory tasks. Repeated transcranial magnetic stimulation at 5 Hz and 20 Hz could enhance the excitatory responses of the frontal lobes. After stimulation at 5 Hz and 20 Hz, the efficiency of the brain network significantly improved.

1. Introduction

Working memory (WM) is a cognitive ability that involves the temporary retention and utilization of information in the mind [1]. WM is extensively involved in the execution of complex tasks such as learning, decision-making, and reasoning. Crucially, the decline in WM is a major factor in the cognitive impairments that accompany aging. Therefore, different stimulation methods are currently being explored as potential interventions to enhance these capabilities, including non-invasive stimulation methods such as transcranial magnetic stimulation (TMS) and ultrasound stimulation. It also includes invasive stimulation such as deep brain electrical stimulation, which usually requires specialized surgical assistance. The two types of stimulation are used in different occasions, and the level of intensity varies. In preventive intervention, invasive stimulation is generally not acceptable due to the level of difficulty and pain involved. On the other hand, non-invasive stimulation is less painful, carries a lower risk, and can be performed without surgery. Therefore, it is more commonly used in intervention treatments.
Transcranial magnetic stimulation (TMS) is a non-invasive intervention technique used to stimulate the human brain and investigate its physiological mechanisms. At present, TMS technology has been used in the treatment of Alzheimer’s disease, stroke, depression, and other neuropsychiatric diseases [2,3]. The brain regions selected for stimulation have a crucial influence on the effects of stimulation [4]. Target regions are typically selected based on the target function and the brain circuit mechanism of cognitive processing [4,5]. The target regions of TMS intervention in the past have mainly been in the cerebral hemisphere. The most commonly studied sites in research on cognition and memory include the left dorsolateral prefrontal cortex, the right inferior frontal gyrus, the right superior temporal gyrus, and the precuneus cortex [6,7]. The stimulation frequency affects the neuromodulation effect of TMS [8]. At present, repetitive transcranial magnetic stimulation (rTMS) is widely used in clinical practice. High-frequency (frequency > 1 Hz) rTMS can increase cortical excitability, induce long-term potentiation, and enhance synaptic plasticity. Low-frequency (frequency ≤ 1 Hz) rTMS can inhibit cortical excitability, reduce synaptic activity, and induce long-term depression. In general, the higher the frequency of rTMS, the stronger the excitatory effect. However, frequencies higher than 20 Hz are rarely used due to safety concerns and subject tolerance. In addition, different intensities of stimuli also have varying effects [9]. Studies have found that different brain wave oscillation frequencies are involved in various brain activities, and theta oscillation waves may serve as an indicator of memory and attention processing [10]. However, there is no uniform standard for the frequency of TMS stimulation used to improve cognitive function.
The role of the cerebellum in learning and memory has become a prominent topic in the field of cognitive neuroscience. The surface of the human cerebellar cortex is folded much more tightly than that of the cerebral cortex. Martin I et al. found that the surface area of the cerebellum is significantly larger than previously documented, accounting for approximately 78% of the total surface area of the human neocortex [11]. In previous studies, the conclusions about the cerebellum were mostly related to motor function [12], but did not establish a connection between the cerebellum and cognitive memory. However, recent studies have shown that the function of the cerebellum is not simply involved in the coordination of body movements, but it also plays a role in regulating cognitive activities such as working memory, cognitive control, and reward expectation through cerebrum-cerebellar circuits. Many functions of the cerebellum have been gradually explored. Studies have found that the possible regulatory mechanism of cerebellar involvement in cognitive function is through a wide range of neural circuits in the brain, particularly those in the frontoparietal temporal lobe and limbic system, which affect the brain’s higher-level cognitive processes [13,14,15,16,17]. In studies of cerebellar activation with n-back tasks in healthy adults, researchers found significant activation in the Crus I/II regions of the cerebellum. Furthermore, the activation in this lobe increased with higher task load [18]. A functional map of the cerebellum published in 2019 in the journal Nature Neuroscience revealed that different regions of the posterior lobe of the cerebellum are associated with various cognitive functions [19]. The Crus II region of the cerebellum is associated with episodic memory and semantic prediction, while the Crus I/II region of the cerebellum is involved in prefrontal cortex function and regulation of the default mode network [19].
TMS in the cerebellum has been shown to modulate the default mode network [20], the attention network [20,21], and the functional connectivity between the cerebellum and the frontal lobe and other regions [14]. It is known that the application of right lateral cerebellar continuous theta-burst stimulation (cTBS) can reduce the amplitude of motor evoked potential (MEP) [22,23,24,25,26,27,28], and lateral cerebellar cTBS has been used in the treatment of various nervous system diseases, such as improving the motor symptoms of dystonia [29,30] and essential tremor [31]. Currently, there are well-established studies and clinical applications of the regulation of cerebellar activity by theta-burst stimulation (TBS). However, there are few studies on the various modes of rTMS protocols, and research on cerebellar cognitive memory function is even more scarce. [32,33,34].
Our research group has previously utilized a deterministic fiber-tracking algorithm and graph theory analysis to discover that various cognitive functions are impaired after posterior cerebellar infarction. We found that both the global and local efficiency attributes of the brain network are decreased [35]. Specifically, the efficiency of key nodes such as the bilateral precuneus, frontotemporal lobe, and cingulate gyrus, which are associated with cognition, are significantly changed. The results show that the posterior cerebellum plays an important role in integrating and regulating the global and cognitive networks of the brain. After 4 weeks of 5 Hz rTMS intervention in the bilateral cerebellar Crus Ⅱ, Alzheimer Disease (AD) patients showed significant improvement in overall cognitive function, memory, attention, visuospatial ability, and executive function [36]. However, it is not clear which stimulation frequency of cerebellar intervention can most effectively improve cognitive levels. In this regard, intervention studies with different frequencies of cerebellar stimulation are needed.
Based on previous findings, this study aimed to determine the effects of rTMS at different frequencies on working memory. The objective was to identify the frequency that is most effective in enhancing working memory. At the current stage of research, we believe that it is necessary to collect not only experimental data from patients, but also certain data from individuals who are considered normal. Therefore, in this study, we selected normal subjects and performed rTMS stimulation on the Crus II subregion of their cerebellum. EEG was collected and analyzed during the 2-back task before and after the stimulation. We aim to investigate the effect of cerebellar rTMS at different frequencies on working memory function in healthy individuals. Our goal is to establish reference samples for the treatment of cognitive impairment-related diseases and explore the potential for pre-disease intervention to delay the onset of disease in susceptible individuals.

2. Materials and Methods

2.1. Design of Experiments

The aim of this study was to examine the effects of rTMS at different frequencies on EEG components related to working memory (WM) and brain network connectivity. The commonly used paradigms are “go-nogo” and “n-back.” The go-nogo paradigm primarily evaluates executive function, while the n-back paradigm primarily evaluates memory function [37,38]. The ERP generated by the n-back paradigm is relatively simple, while the go-nogo paradigm is more complex. In this experiment, the use of a simple 2-back paradigm can eliminate interference from executive function and allow for a focus on WM. In order to observe the effects of stimulation on EEG, a before and after comparison is essential. Therefore, it is important for the same subject to conduct two sets of experiments within a short time frame, rather than at longer intervals. This ensures that the experimental conditions and the subject’s state remain consistent. Additionally, to account for the learning effect, it is important to establish a control group in which subjects receive a sham stimulus. The results from this group can serve as a benchmark for comparison.

2.2. Screening of Subjects

The study was conducted according to the guidelines of the Declaration of Helsinki and approved by the Ethics Committee of the Affiliated Brain Hospital of Nanjing Medical University (2022-KY026-01, approved date: 24 February 2022).
Subject recruitment was conducted from January to June 2022, with plans to recruit younger, healthy subjects.
Inclusion criteria: 36 healthy college students and graduate students aged 18–30 years old were selected. Their Mini-Mental State Examination (MMSE) and Montreal Cognitive Assessment (MOCA) scores were within the normal range. Hamilton Anxiety (HAMA), Hamilton Depression (HAMD) < 7 points. They were right-handed (left hemisphere dominant). Magnetic resonance imaging (MRI) of the head was performed, and no organic disease was found.
Exclusion criteria: patients with a history of neurological diseases that affect cognitive function, such as brain trauma, stroke, epilepsy, and others; patients with a history of mental illness and a related family history or other factors; patients with severe primary diseases of the cardiovascular, hepatic, renal, and hematopoietic systems; patients with an implanted medical device; patients who are unable to cooperate in completing examinations or follow-up visits.
The specific conditions of the subjects are shown in Table 1, and the full names of the subjects have been concealed.

2.3. Process of Experiment

Before participating in the experiment, the subjects needed to understand the 2-back task in order to achieve a basic level of proficiency. We put the EEG cap on the subject correctly, set the acquisition device, and then let the subject perform the 2-back task approximately 30 times. This task required the subject to use a computer screen and keyboard. The screen was used to display the characters, while the keyboard was used for input. There are two buttons on the keyboard, J and F, which correspond to the judgments of right and wrong. When the subjects indicated that they understood the 2-back procedure, the experiment officially began. The experimenter then explained the complete procedure to the participants, excluding key factors such as stimulus grouping and the purpose of the experiment, before commencing the experiment.
We used an EEG cap with 69 + 2 channels (Neuracle Technology (Changzhou) Co., Ltd., Changzhou, Changzhou, China), and the EEG signal acquisition device is also from the same company [39].
When the subjects formally started the 2-back task, each subject needed to complete two sets of experiments, as shown in Figure 1. In the four processes depicted in the figure, the EEG acquisition equipment is in the normal acquisition state, and it is synchronized with the 2-back experimental procedure to facilitate the segmentation of the experimental task.
During the stimulation phase, all subjects received rTMS at a consistent frequency, position, and power on the Crus II region of the cerebellum, as shown in Figure 2. The choice of position depended on the localization of MRI data. The stimulus intensity was 80% RMT. In the experiment, all the subjects exhibited a high tolerance to stimulation, and none of them experienced any adverse reactions such as headaches, dizziness, or nausea.
There were three types of stimuli: 5 Hz, 20 Hz, and sham. Each subject might receive one of the stimuli, but they would not learn which stimulus they received until after the experiment was complete. The stimulation methods were grouped randomly, without considering the age, education, or other factors of the subjects. No matter which group, a simple 2-back task was conducted. Due to its simplicity and lack of a threshold, it can ensure that the ERP components of each individual are roughly similar. This helps to partially mitigate the memory differences among the subjects.
The 2-back task used random characters A and B. After the characters appeared on the screen, the subjects had two seconds to react and press a key, followed by one second of rest time. This process repeated for each event, resulting in a total of 148 events. If we include the number before and after the stimulus, the total number of events would be 296, as shown in Figure 3.

2.4. EEG Analysis Method

We used a general process for EEG analysis, based on the MATLAB and EEGLAB toolbox. The following steps were used for preprocessing.
First, channel location. Channels and their number are shown in Figure 4.
Second, we filtered the data twice. A 48 to 52 Hz band-stop filter was designed to filter out 50 Hz frequency wave interference in the power supply system, and a 0.5 to 80 Hz band-pass filter was designed to remove high-frequency non-EEG components.
Third, we segmented the entire data. All original time points were retained. Then, we removed bad channels, and they were interpolated in adjacent channels.
Fourth, we performed whole-brain mean weight reference and removed the baseline.
Finally, an independent component analysis was performed on the data. Then, EEGLAB was used to draw the component map, and the electroophthalmic, electromyographic, electrocardiographic, and other clutter components were manually removed, as shown in Figure 5.
Afterwards, we analyzed the ERP in the hope of identifying differences between the real stimulus group and the sham stimulus group. We selected 10 channels, which were more centrally located in each brain region, including Fp1, Fp2, F3, F4, C3, C4, P3, P4, O1, and O2, as shown in Figure 4. First, we calculated the average ERP before and after stimulation for each group and compared the differences in N170 and P300 between the real stimulus group and the sham stimulus group. Then, we conducted a statistical analysis on the N170 and P300 of brain regions that exhibited significant differences. Due to the significant variations in brain activity among individuals, we did not directly utilize the ERP amplitude as the test parameter. Instead, we employed the relative index of X = (amplitude after stimulation/amplitude before stimulation) for analysis.
X = | P e a k   o r   t r o u g h   v a l u e s   a f t e r   s t i m u l a t i o n | | P e a k   o r   t r o u g h   v a l u e s   b e f o r e   s t i m u l a t i o n |
We recorded the N170 and P300 before and after stimulation for each subject and calculated the (amplitude after stimulation/amplitude before stimulation) for these two indices. We used the rank-sum test in non-parametric statistics to compare the real stimulus group and the sham stimulus group and obtained the relevant results.
Theoretically, after the cerebellar target received TMS, observable changes should occur in the whole brain network. We used phase-locked values (PLV) to construct brain networks in different frequency bands, with the goal of identifying changes in brain networks before and after stimulation. First, we filtered the EEG signals according to the conventional frequency bands. Then, we used the task-related EEG signals to construct the PLV brain network. After obtaining the brain network, we used the top 30% of connection strengths as the threshold to generate a sparse matrix of the brain network. Then, we focused on studying the brain networks in the Theta (4–8 Hz), Alpha (9–12 Hz), and Beta (13–30 Hz) frequency bands. We utilized the BCT toolbox to compute the parameters associated with brain network efficiency and conducted a comparison. The global efficiency was compared within each group before and after stimulation, while the local efficiency was compared based on the division of brain regions. The test method was the rank-sum test.

3. Analysis and Results

3.1. ERP Results

In the data obtained from this experiment, there are clear peaks and troughs observed at approximately 100 ms, 170 ms, and 300 ms. Therefore, these points of interest will be the focus of our analysis. Among them, the prefrontal and parietal lobes showed significant differences between pre- and post-stimulation contrasts and sham stimulation contrasts, as shown in Figure 6, Figure 7, Figure 8, Figure 9, Figure 10 and Figure 11.
We defined the trough between 150 ms and 200 ms in the ERP as N170 and the peak between 250 ms and 350 ms as P300. By comparison, we can see that both 5 Hz and 20 Hz stimulation have some effects on the ERPs. In the parietal lobe, both stimuli increased the amplitude of the N170, and the amplitude of the P300 was increased by the 20 Hz stimulus. In the prefrontal cortex, 5 Hz stimulation increased the amplitude of N170, while 20 Hz stimulation increased the amplitude of P300. Sham stimulation did not cause any significant changes.
We averaged the ERP of Fp1 and Fp2 in the prefrontal lobe to obtain the average ERP of the left and right prefrontal lobes. Similarly, we averaged the ERP of P3 and P4 in the parietal lobe to obtain the average ERP of the left and right parietal lobes. We manually extracted the P300 and N170 for each subject to prepare for statistical analysis.
The test statistic X is shown in Table 2 and Table 3, and we obtained the p-values using the rank-sum test as shown in the tables.
It can be observed that stimulation at 5 Hz resulted in alterations in the N170 component of the prefrontal lobe, while stimulation at 20 Hz led to changes in the P300 component of the prefrontal lobe. In addition, the p-value between the 20 Hz stimulation group and the sham stimulation group in the P300 of the parietal lobe was 0.058, which is very close to the 0.05 threshold. Therefore, we can tentatively assume that the 20 Hz stimulation has caused changes in the P300 of the parietal lobe, although the changes are not very significant. All of these changes represent absolute increases in amplitude because, for the components with significant changes, the mean value of the true stimulus was larger than that of the sham stimulus.

3.2. Brain Network Results

The metrics we observe are global efficiency and local efficiency. After 5 Hz and 20 Hz stimulation, the global efficiency significantly improved, while sham stimulation showed no significant change. After 5 Hz stimulation, the local efficiency of the central area significantly decreased, while 20 Hz stimulation and sham stimulation showed no significant change. The changes brought about by 5 Hz were concentrated in the Theta band, and there was no significant change in the Alpha and Beta bands. However, the changes brought about by 20 Hz were concentrated in the Alpha band, and there was no significant change in the Theta and Beta bands.
First, is the global efficiency contrast in the Theta band, as shown in Table 4.
It can be seen that the 5 Hz stimulation significantly improved the global efficiency of the Theta band.
Then, the same method was used to analyze the global efficiency of the Alpha band and Beta band. No significant difference was found before and after stimulation in the Beta band. However, in the Alpha band, a significant increase in global efficiency was found after 20 Hz stimulation, while no difference was observed in the other groups. The results of the Alpha band are shown in Table 5.
Next, we compared the local efficiency. The local efficiency of the central region was significantly lower than that of other brain regions, and this difference was not influenced by rTMS. Then, after 5 Hz stimulation, there was a significant additional decrease in local efficiency of the central region, whereas 20 Hz stimulation and false stimulation did not produce this effect, as shown in Figure 12, Figure 13 and Figure 14.
In order to obtain a statistically significant conclusion, the local efficiency before and after the stimulation of each subject in the 5 Hz group was analyzed separately. The average local efficiency of the central region (C1-C6, CP1-CP6) was used as an indicator to calculate a value for each subject before and after stimulation, as shown in Table 6.
It can be observed that there is a significant difference before and after 5 Hz stimulation. The local efficiency of the central area was significantly lower after stimulation compared to before stimulation.
In terms of the local efficiency of the Alpha and Beta bands, we did not observe any significant changes before and after stimulation.

4. Discussion

P300 is considered to be an electrophysiological indicator of working memory. It is generally believed that its amplitude is positively correlated with the allocation, updating, and execution processes of working memory resources. Some studies also suggest that its amplitude is related to the difficulty of working memory tasks [40,41]. N170 is a component elicited by words or face images. It is commonly believed that this component only reflects the behavior of the participants “seeing” the images. However, some studies also suggest that the amplitude and latency of this component are influenced by past memories [42]. The 5 Hz stimulation increased N170 amplitude in the prefrontal lobes, while 20 Hz increased P300 amplitude in the prefrontal and parietal lobes. The results showed that 5 Hz stimulation promoted the brain activity of seeing characters more, while 20 Hz stimulation promoted thinking. Collectively, both cerebellar target stimulations enhanced ERP responses in the 2-back task relative to the sham-stimulation group, demonstrating the effectiveness of rTMS of the cerebellar target on a working memory task.
The results of brain network analysis showed that the sham stimulation had no significant effect on the local and global efficiency of the brain network. The 5 Hz stimulation increased the global efficiency in the Theta band and decreased the local efficiency in the central region, and the 20 Hz stimulation increased the global efficiency in the Alpha band. In either group, the local efficiency in the central region was lower than that in the other brain regions. We believe that this is due to the fact that the function of the central region is not much related to working memory, and this brain region has low participation in the 2-back task, so there is low local efficiency. The decrease in local efficiency of 5 Hz stimulation in the central area means that the brain resources are better allocated, which means the brain resources are more efficient to participate in the task. The effect of 5 Hz and 20 Hz stimulation on global efficiency is reflected in different frequency bands. We suspect that this is due to a certain resonance effect between the frequency of rTMS and the EEG frequency, but the specific relationship and mechanism of action may need further research to explain.
Our research aims to find the stimulation parameters suitable for improving working memory through rTMS. It is known that TMS has been widely used to treat various diseases, such as Parkinson’s disease, stroke, neuralgia, depression, and schizophrenia [43]. Some studies have reported that TMS can improve cognitive abilities in patients with schizophrenia, but there is a lack of evidence from evidence-based medicine [44]. For cognitive impairments such as Alzheimer’s disease, single-target brain interventions are not highly effective, and there are differences in the evaluation of effects, which limits the application of interventions targeting a single area of the brain [45]. In summary, further evidence is needed to determine the efficacy of classical brain target stimulation for diseases with impaired cognitive function. In recent years, there have been increasing studies on TMS of the cerebellum. In a study on subjects applying theta-burst stimulation (TBS) to the cerebellar Crus I, researchers evaluated the behavioral performance of completing a contextual task before and after stimulation. It was found that cerebellar theta stimulation improved the encoding of contextual memory [46]. Mark A et al. [21] found that intermittent theta-burst stimulation (iTBS) of the lateral Crus I/II of the human cerebellum enhances the connectivity of the default mode network in the cerebral cortex. Our study also found that 5 Hz and 20 Hz rTMS can enhance ERP activity and improve the working memory of subjects. Although John E. Desmond et al. [47] conducted a Sternberg working memory task on 17 healthy subjects, where single-pulse TMS stimulation was immediately given after letter cues, the results showed a significant increase in reaction time after TMS stimulation. Although John E et al. also intervened in the cerebellum, our TMS protocol was completely different from theirs. First, we did not provide stimulation during the task state. Second, we used rTMS. Additionally, our study focuses on changes in ERP and brain networks, which sets it apart from their study. We believe that different TMS protocols have distinct effects.
Two limitations of this study are that the subjects were exclusively healthy young adults and that the behavioral data before and after stimulation were not analyzed in a systematic manner. Therefore, this conclusion cannot be directly applied to the treatment of cognitive and memory impairment-related diseases. However, it does offer new ideas for early screening and prevention of such diseases. For example, rTMS may be used to delay the decline of cognitive and memory function in healthy individuals during the aging process. Of course, this needs to be further studied, such as including a group of elderly individuals without any pre-existing conditions who are susceptible to disease. In addition, we also collected behavioral data simultaneously during the experiment, which will be included in the scope of subsequent data analysis.

5. Conclusions

In conclusion, from the perspective of EEG, rTMS targeting the cerebellar Crus II subregion can improve the performance of the 2-back task. The cerebellum does participate in or regulate the execution of the 2-back task. The 5 Hz stimulation and 20 Hz stimulation have obvious effects, but the effects are different.

Author Contributions

Conceptualization, J.Y., B.S., J.S., K.Y. and W.D.; Data curation, J.Y. and B.S.; Formal analysis, J.Y. and B.S.; Funding acquisition, J.S. and K.Y.; Investigation, B.S.; Methodology, J.Y., B.S., J.S., K.Y. and W.D.; Project administration, J.S., K.Y. and W.D.; Software, J.Y.; Supervision, J.S., K.Y. and W.D.; Validation, J.Y. and B.S.; Writing—original draft, J.Y.; Writing—review and editing, J.Y., J.S., K.Y. and W.D. All authors will be informed about each step of manuscript processing including submission, revision, revision reminder, etc. via emails from our system or assigned Assistant Editor. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the National Natural Science Foundation of China, grant number U19B2018.

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki, and approved by the Ethics Committee of the Affiliated Brain Hospital of Nanjing Medical University (2022-KY026-01, approved date: 24 February 2022).

Informed Consent Statement

Informed consent was obtained from subjects involved in the study.

Data Availability Statement

The data are available upon reasonable request.

Acknowledgments

We would like to thank Xixi Wang for their help in collecting data, Liangcheng Qu, Rumei Li and Chao Yu for their suggestions on data processing.

Conflicts of Interest

The authors declare that there are no conflict of interest regarding the publication of this paper.

References

  1. Baddeley, A. Working memory: Theories, models, and controversies. Annu. Rev. Psychol. 2012, 63, 1–29. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  2. Bagattini, C.; Zanni, M.; Barocco, F.; Caffarra, P.; Brignani, D.; Miniussi, C.; Defanti, C.A. Enhancing cognitive training effects in Alzheimer’s disease: rTMS as an add-on treatment. Brain Stimul. 2020, 13, 1655–1664. [Google Scholar] [CrossRef]
  3. Wu, X.; Ji, G.J.; Geng, Z.; Zhou, S.; Yan, Y.; Wei, L.; Wang, K. Strengthened theta-burst transcranial magnetic stimulation as an adjunctive treatment for Alzheimer’s disease: An open-label pilot study. Brain Stimul. 2020, 13, 484–486. [Google Scholar] [CrossRef] [Green Version]
  4. Parkin, B.L.; Ekhtiari, H.; Walsh, V.F. Non-invasive Human Brain Stimulation in Cognitive Neuroscience: A Primer. Neuron 2015, 87, 932–945. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  5. Marron, E.M.; Viejo-Sobera, R.; Quintana, M.; Redolar-Ripoll, D.; Rodríguez, D.; Garolera, M. Transcranial magnetic stimulation intervention in Alzheimer’s disease: A research proposal for a randomized controlled trial. BMC Res. Notes 2018, 11, 648. [Google Scholar] [CrossRef] [PubMed]
  6. Chung, S.W.; Rogasch, N.C.; Hoy, K.E.; Fitzgerald, P.B. The effect of single and repeated prefrontal intermittent theta burst stimulation on cortical reactivity and working memory. Brain Stimul. 2018, 11, 566–574. [Google Scholar] [CrossRef]
  7. Mangano, G.R.; Oliveri, M.; Smirni, D.; Tarantino, V.; Turriziani, P. Transcranial Magnetic Stimulation Trains at 1 Hz Frequency of the Right Posterior Parietal Cortex Facilitate Recognition Memory. Front. Hum. Neurosci. 2021, 15, 696793. [Google Scholar] [CrossRef]
  8. Koch, G.; Bonnì, S.; Pellicciari, M.C.; Casula, E.P.; Mancini, M.; Esposito, R.; Bozzali, M. Transcranial magnetic stimulation of the precuneus enhances memory and neural activity in prodromal Alzheimer’s disease. NeuroImage 2018, 169, 302–311. [Google Scholar] [CrossRef] [Green Version]
  9. Chung, S.W.; Rogasch, N.C.; Hoy, K.E.; Sullivan, C.M.; Cash, R.F.; Fitzgerald, P.B. Impact of different intensities of intermittent theta burst stimulation on the cortical properties during TMS-EEG and working memory performance. Hum. Brain Mapp. 2018, 39, 783–802. [Google Scholar] [CrossRef] [Green Version]
  10. Hanslmayr, S.; Axmacher, N.; Inman, C.S. Modulating Human Memory via Entrainment of Brain Oscillations. Trends Neurosci. 2019, 42, 485–499. [Google Scholar] [CrossRef]
  11. Sereno, M.I.; Diedrichsen, J.; Tachrount, M.; Testa-Silva, G.; D’arceuil, H.; De Zeeuw, C. The human cerebellum has almost 80% of the surface area of the neocortex. Proc. Natl. Acad. Sci. USA 2020, 117, 19538–19543. [Google Scholar] [CrossRef]
  12. Oliveri, M.; Koch, G.; Torriero, S.; Caltagirone, C. Increased facilitation of the primary motor cortex following 1 Hz repetitive transcranial magnetic stimulation of the contralateral cerebellum in normal humans. Neurosci. Lett. 2005, 376, 188–193. [Google Scholar] [CrossRef]
  13. Dayan, M.; Olivito, G.; Molinari, M.; Cercignani, M.; Bozzali, M.; Leggio, M. Impact of cerebellar atrophy on cortical gray matter and cerebellar peduncles as assessed by voxel-based morphometry and high angular resolution diffusion imaging. Funct. Neurol. 2016, 31, 239–248. [Google Scholar] [CrossRef] [PubMed]
  14. Rastogi, A.; Cash, R.; Dunlop, K.; Vesia, M.; Kucyi, A.; Ghahremani, A.; Chen, R. Modulation of cognitive cerebello-cerebral functional connectivity by lateral cerebellar continuous theta burst stimulation. NeuroImage 2017, 158, 48–57. [Google Scholar] [CrossRef]
  15. Van Overwalle, F.; Mariën, P. Functional connectivity between the cerebrum and cerebellum in social cognition: A multi-study analysis. NeuroImage 2016, 124, 248–255. [Google Scholar] [CrossRef] [PubMed]
  16. Onuki, Y.; Van Someren, E.J.; De Zeeuw, C.I.; Van der Werf, Y.D. Hippocampal-cerebellar interaction during spatio-temporal prediction. Cereb. Cortex 2015, 25, 313–321. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  17. Dickson, P.E.; Cairns, J.; Goldowitz, D.; Mittleman, G. Cerebellar contribution to higher and lower order rule learning and cognitive flexibility in mice. Neuroscience 2017, 345, 99–109. [Google Scholar] [CrossRef] [Green Version]
  18. Küper, M.; Kaschani, P.; Thürling, M.; Stefanescu, M.R.; Burciu, R.G.; Göricke, S.; Maderwald, S.; Ladd, M.E.; Hautzel, H.; Timmann, D. Cerebellar fMRI Activation Increases with Increasing Working Memory Demands. Cerebellum 2015, 15, 322–335. [Google Scholar] [CrossRef]
  19. King, M.; Hernandez-Castillo, C.R.; Poldrack, R.A.; Ivry, R.B.; Diedrichsen, J. Functional boundaries in the human cerebellum revealed by a multi-domain task battery. Nat. Neurosci. 2019, 22, 1371–1378. [Google Scholar] [CrossRef]
  20. EEsterman, M.; Thai, M.; Okabe, H.; DeGutis, J.; Saad, E.; Laganiere, S.E.; Halko, M.A. Network-targeted cerebellar transcranial magnetic stimulation improves attentional control. NeuroImage 2017, 156, 190–198. [Google Scholar] [CrossRef]
  21. Halko, M.A.; Farzan, F.; Eldaief, M.C.; Schmahmann, J.D.; Pascual Leone, A. Intermittent theta-burst stimulation of the lateral cerebellum increases functional connectivity of the default network. J. Neurosci. 2014, 34, 12049–12056. [Google Scholar] [CrossRef] [Green Version]
  22. Koch, G.; Brusa, L.; Carrillo, F.; Gerfo, E.L.; Torriero, S.; Oliveri, M.; Mir, P.; Caltagirone, C.; Stanzione, P. Cerebellar magnetic stimulation decreases levodopa-induced dyskinesias in Parkinson’s disease. Neurology 2009, 73, 113–119. [Google Scholar] [CrossRef] [PubMed]
  23. Koch, G.; Mori, F.; Marconi, B.; Codecà, C.; Pecchioli, C.; Salerno, S.; Torriero, S.; Gerfo, E.L.; Mir, P.; Oliveri, M.; et al. Changes in intracortical circuits of the human motor cortex following theta burst stimulation of the lateral cerebellum. Clin. Neurophysiol. 2008, 119, 2559–2569. [Google Scholar] [CrossRef] [PubMed]
  24. Carrillo, F.; Palomar, F.J.; Conde, V.; Diaz-Corrales, F.J.; Porcacchia, P.; Del-Olmo, M.; Koch, G.; Mir, P. Study of cerebello-thalamocortical pathway by transcranial magnetic stimulation in Parkinson’s disease. Brain Stimul. 2013, 6, 582–589. [Google Scholar] [CrossRef]
  25. Brusa, L.; Ceravolo, R.; Kiferle, L.; Monteleone, F.; Iani, C.; Schillaci, O.; Stanzione, P.; Koch, G. Metabolic changes induced by theta burst stimulation of the cerebellum in dyskinetic Parkinson’s disease patients. Park. Relat. Disord. 2012, 18, 59–62. [Google Scholar] [CrossRef]
  26. Brusa, L.; Ponzo, V.; Mastropasqua, C.; Picazio, S.; Bonnì, S.; Di Lorenzo, F.; Iani, C.; Stefani, A.; Stanzione, P.; Caltagirone, C.; et al. Theta Burst Stimulation Modulates Cerebellar-Cortical Connectivity in Patients with Progressive Supranuclear Palsy. Brain Stimul. 2014, 7, 29–35. [Google Scholar] [CrossRef]
  27. Kishore, A.; Popa, T.; Balachandran, A.; Backer, F.; Chandran, S.; Meunier, S. Cerebellar sensory processing alterations impact motor cortical plasticity in Parkinson’s disease: Clues from dyskinetic patients. Clin. Neurophysiol. 2013, 124, e101. [Google Scholar] [CrossRef]
  28. Strzalkowski, N.D.J.; Chau, A.D.; Gan, L.S.; Kiss, Z.H.T. Both 50 and 30 Hz continuous theta burst transcranial magnetic stimulation depresses the cerebellum. Cerebellum 2018, 18, 157–165. [Google Scholar] [CrossRef] [PubMed]
  29. Hoffland, B.S.; Kassavetis, P.; Bologna, M.; Teo, J.T.H.; Bhatia, K.P.; Rothwell, J.C.; Edwards, M.J.; van de Warrenburg, B.P. Cerebellum-dependent associative learning deficits in primary dystonia are normalized by rTMS and practice. Eur. J. Neurosci. 2013, 38, 2166–2171. [Google Scholar] [CrossRef]
  30. Koch, G.; Porcacchia, P.; Ponzo, V.; Carrillo, F.; Cáceres-redondo, M.T.; Brusa, L.; Desiato, M.T.; Arciprete, F.; Di Lorenzo, F.; Pisani, A.; et al. Brain stimulation effects of two weeks of cerebellar theta burst stimulation in cervical dystonia patients. Brain Stimul. 2014, 7, 564–572. [Google Scholar] [CrossRef]
  31. Popa, T.; Russo, M.; Vidailhet, M.; Roze, E.; Lehéricy, S.; Bonnet, C.; Apartis, E.; Legrand, A.; Marais, L.; Meunier, S.; et al. Cerebellar rTMS stimulation may induce prolonged clinical benefits in essential tremor, and subjacent changes in functional connectivity: An open label trial. Brain Stimul. 2013, 6, 175–179. [Google Scholar] [CrossRef] [PubMed]
  32. Viñas-Guasch, N.; Ng, T.H.B.; Heng, J.G.; Chan, Y.C.; Chew, E.; Desmond, J.E.; Chen, S.A. Cerebellar Transcranial Magnetic Stimulation (TMS) Impairs Visual Working Memory. Cerebellum 2022, 22, 332–347. [Google Scholar] [CrossRef] [PubMed]
  33. Oldrati, V.; Schutter, D.J.L.G. Targeting the Human Cerebellum with Transcranial Direct Current Stimulation to Modulate Behavior: A Meta-Analysis. Cerebellum 2018, 17, 228–236. [Google Scholar] [CrossRef] [Green Version]
  34. Ferrari, C.; Fiori, F.; Suchan, B.; Plow, E.B.; Cattaneo, Z. TMS over the posterior cerebellum modulates motor cortical excitability in response to facial emotional expressions. Eur. J. Neurosci. 2021, 53, 1029–1039. [Google Scholar] [CrossRef]
  35. Yao, Q.; Tang, F.; Wang, Y.; Yan, Y.; Dong, L.; Wang, T.; Shi, J. Effect of cerebellum stimulation on cognitive recovery in patients with Alzheimer disease: A randomized clinical trial. Brain Stimul. 2022, 15, 910–920. [Google Scholar] [CrossRef] [PubMed]
  36. Wang, D.; Yao, Q.; Yu, M.; Xiao, C.; Fan, L.; Lin, X.; Shi, J. Topological Disruption of Structural Brain Networks in Patients with Cognitive Impairment Following Cerebellar Infarction. Front Neurol. 2019, 10, 759. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  37. Falkenstein, M.; Hoormann, J.; Hohnsbein, J. ERP components in Go/Nogo tasks and their relation to inhibition. Acta Psychol. 1999, 101, 267–291. [Google Scholar] [CrossRef]
  38. Jaeggi, S.M.; Buschkuehl, M.; Perrig, W.J.; Meier, B. The concurrent validity of the N-back task as a working memory measure. Memory 2010, 18, 394–412. [Google Scholar] [CrossRef]
  39. Shi, J.; Yin, K.; Ye, X.; Du, W.; Zhao, J. A Whole-Brain Electroencephalogram Cap for Transcranial Magnetic Stimulator Therapy. CN Patent Application 114,366,127, 19 April 2022. [Google Scholar]
  40. Guerrero, L.; Bouazzaoui, B.; Isingrini, M.; Angel, L. Impact of working memory capacity on predominance of parietal over frontal P300 amplitude. Brain Cogn. 2023, 170, 106056. [Google Scholar] [CrossRef]
  41. Brush, C.J.; Kallen, A.M.; Meynadasy, M.A.; King, T.; Hajcak, G.; Sheffler, J.L. The P300, loneliness, and depression in older adults. Biol. Psychol. 2022, 171, 108339. [Google Scholar] [CrossRef] [PubMed]
  42. González-Garrido, A.A.; López-Franco, A.L.; Gómez-Velázquez, F.R.; Ramos-Loyo, J.; Sequeira, H. Emotional content of stimuli improves visuospatial working memory. Neurosci. Lett. 2015, 585, 43–47. [Google Scholar] [CrossRef]
  43. Lefaucheur, J.P.; Aleman, A.; Baeken, C.; Benninger, D.H.; Brunelin, J.; Di Lazzaro, V.; Filipović, S.R.; Grefkes, C.; Hasan, A.; Hummel, F.C.; et al. Evidence-based guidelines on the therapeutic use of repetitive transcranial magnetic stimulation (rTMS): An update (2014–2018). Clin. Neurophysiol. 2020, 131, 474–528. [Google Scholar] [CrossRef]
  44. Vita, A.; Gaebel, W.; Mucci, A.; Sachs, G.; Barlati, S.; Giordano, G.M.; Nibbio, G.; Nordentoft, M.; Wykes, T.; Galderisi, S. European Psychiatric Association guidance on treatment of cognitive impairment in schizophrenia. Eur. Psychiatry 2022, 65, e57. [Google Scholar] [CrossRef] [PubMed]
  45. Ma, W.Y.; Tian, M.J.; Yao, Q.; Li, Q.; Tang, F.Y.; Xiao, C.Y.; Chen, J. Neuroimaging alterations in dementia with Lewy bodies and neuroimaging differences be-tween dementia with Lewy bodies and Alzheimer’s disease: An activation likelihood estimation meta-analysis. CNS Neurosci. Ther. 2022, 28, 183–205. [Google Scholar] [CrossRef] [PubMed]
  46. Dave, S.; Vanhaerents, S.; Voss, J.L. Cerebellar Theta and Beta Noninvasive Stimulation Rhythms Differentially Influence Episodic Memory versus Semantic Prediction. J. Neurosci. Off. J. Soc. Neurosci. 2020, 40, 7300–7310. [Google Scholar] [CrossRef] [PubMed]
  47. Desmond, J.E.; Chen, S.H.A.; Shieh, P.B. Cerebellar transcranial magnetic stimulation impairs verbal working memory. Ann. Neurol. 2005, 58, 553–560. [Google Scholar] [CrossRef]
Figure 1. Flow chart of the experiment.
Figure 1. Flow chart of the experiment.
Brainsci 13 01158 g001
Figure 2. Use rTMS to stimulate Crus II of cerebellum.
Figure 2. Use rTMS to stimulate Crus II of cerebellum.
Brainsci 13 01158 g002
Figure 3. Flow of the 2-back task.
Figure 3. Flow of the 2-back task.
Brainsci 13 01158 g003
Figure 4. Channel location. The channels circled in the picture were used for ERP analysis. (a) Channels’ name; (b) Channels’ number.
Figure 4. Channel location. The channels circled in the picture were used for ERP analysis. (a) Channels’ name; (b) Channels’ number.
Brainsci 13 01158 g004
Figure 5. Removal of non-electroencephalogram components. Only the first 35 components are shown in the figure. The components marked in red have been removed.
Figure 5. Removal of non-electroencephalogram components. Only the first 35 components are shown in the figure. The components marked in red have been removed.
Brainsci 13 01158 g005
Figure 6. ERPs in the prefrontal lobe in the Group 5 Hz. There were statistically significant differences in the data in the encircled circles. (a) Fp1; (b) Fp2.
Figure 6. ERPs in the prefrontal lobe in the Group 5 Hz. There were statistically significant differences in the data in the encircled circles. (a) Fp1; (b) Fp2.
Brainsci 13 01158 g006
Figure 7. ERPs in the parietal lobe in the Group 5 Hz. (a) P3; (b) P4.
Figure 7. ERPs in the parietal lobe in the Group 5 Hz. (a) P3; (b) P4.
Brainsci 13 01158 g007
Figure 8. ERPs in the prefrontal lobe in the Group 20 Hz. There were statistically significant differences in the data in the encircled circles. (a) Fp1; (b) Fp2.
Figure 8. ERPs in the prefrontal lobe in the Group 20 Hz. There were statistically significant differences in the data in the encircled circles. (a) Fp1; (b) Fp2.
Brainsci 13 01158 g008
Figure 9. ERPs in the parietal lobe in the Group 20 Hz. There were statistically significant differences in the data in the encircled circles. (a) P3; (b) P4.
Figure 9. ERPs in the parietal lobe in the Group 20 Hz. There were statistically significant differences in the data in the encircled circles. (a) P3; (b) P4.
Brainsci 13 01158 g009
Figure 10. ERPs in the prefrontal lobe in the Group Sham. (a) Fp1; (b) Fp2.
Figure 10. ERPs in the prefrontal lobe in the Group Sham. (a) Fp1; (b) Fp2.
Brainsci 13 01158 g010
Figure 11. ERPs in the parietal lobe in the Group Sham. (a) P3; (b) P4.
Figure 11. ERPs in the parietal lobe in the Group Sham. (a) P3; (b) P4.
Brainsci 13 01158 g011
Figure 12. Mean local efficiency of Group 5 Hz in the Theta band. We can see a reduction between pre and post in CP5-CP2.
Figure 12. Mean local efficiency of Group 5 Hz in the Theta band. We can see a reduction between pre and post in CP5-CP2.
Brainsci 13 01158 g012
Figure 13. Mean local efficiency of Group 20 Hz in the Theta band.
Figure 13. Mean local efficiency of Group 20 Hz in the Theta band.
Brainsci 13 01158 g013
Figure 14. Mean local efficiency of Group Sham in the Theta band.
Figure 14. Mean local efficiency of Group Sham in the Theta band.
Brainsci 13 01158 g014
Table 1. Subjects and their basic information.
Table 1. Subjects and their basic information.
5 Hz20 HzSham
No.GenderAgeNo.GenderAgeNo.GenderAge
1female241male241female24
2female272female242female23
3female283male233female27
4male234female244male27
5female245male275male26
6female246male236female24
7female267male257male24
8female248female248female24
9female249female259female26
10female2410male2510female24
11female2511male23
12male2512male25
13male27
14female24
Table 2. ERP analysis of the prefrontal lobe.
Table 2. ERP analysis of the prefrontal lobe.
Number of Subjects *123456789101112
N 170   p o s t N 170   p r e Group 5 Hz1.6603.7890.7191.8072.4751.7921.9231.4002.0781.6711.2014.948
Group 20 Hz1.9282.4121.3500.6400.4772.1610.8200.8430.3941.219
Group Sham0.4811.6850.6501.3291.0070.9070.9991.173
P (5 Hz and Sham)0.005
P (20 Hz and Sham)0.897
P 300   p o s t P 300   p r e Group 5 Hz2.5210.9891.3200.1126.3611.0090.2242.8710.6700.3472.613
Group 20 Hz2.6991.4291.4641.3511.4812.0559.1022.2432.1281.801
Group Sham0.6151.4750.2431.1100.5661.1020.7351.350
P (5 Hz and Sham)0.657
P (20 Hz and Sham)0.0003
* Some subjects whose ERP was not evident have been eliminated.
Table 3. ERP analysis of the parietal lobe.
Table 3. ERP analysis of the parietal lobe.
Number of Subjects *1234567891011
N 170   p o s t N 170   p r e Group 5 Hz0.9491.1581.5331.5510.9691.1891.5680.8111.1701.0771.473
Group 20 Hz1.0731.1040.8951.1751.6401.0261.1531.1281.3821.0530.930
Group Sham0.7271.2460.8361.0051.4740.9501.0421.4541.085
P (5 Hz and Sham)0.288
P (20 Hz and Sham)0.543
P 300   p o s t P 300   p r e Group 5 Hz1.1581.0711.1451.1552.0841.8331.0091.0571.2161.1720.677
Group 20 Hz1.3541.5352.7331.1891.0041.2220.9733.4571.3161.2131.011
Group Sham0.8980.8811.4750.9050.6050.9181.1042.2711.192
P (5 Hz and Sham)0.323
P (20 Hz and Sham)0.058
* Some subjects whose ERP was not evident have been eliminated.
Table 4. Global efficiency comparison in the Theta band.
Table 4. Global efficiency comparison in the Theta band.
No.Group 5 HzGroup 20 HzGroup Sham
PrePostPrePostPrePost
10.5940.6190.4800.5390.7130.605
20.4980.6000.6990.5000.5490.521
30.5380.5030.5050.6230.5090.478
40.5520.6490.5440.5070.4780.484
50.4870.4900.5520.5260.5730.636
60.5730.6830.6170.6400.5270.757
70.4920.5180.5560.5320.5040.512
80.5080.5060.4770.5160.4580.503
90.4820.6120.5200.5070.5080.505
100.4950.4810.4870.7380.4690.471
110.5040.5760.5520.551
120.4960.6610.4750.470
130.4780.545
140.5660.510
Ave = 0.519Ave = 0.568Ave = 0.646Ave = 0.665Ave = 0.529Ave = 0.547
P = 0.0366P = 0.1939P = 0.7337
Table 5. Global efficiency comparison in the Alpha band.
Table 5. Global efficiency comparison in the Alpha band.
No.Group 5 HzGroup 20 HzGroup Sham
PrePostPrePostPrePost
10.5740.6600.4980.5960.6630.587
20.4880.4980.5180.6250.5060.522
30.6110.5530.4730.5350.6220.537
40.6080.6720.5690.5860.5160.478
50.5390.5380.5300.7020.5760.573
60.6840.5350.5140.5400.5770.527
70.6200.7160.5370.5080.6030.582
80.5990.5810.4780.5070.4860.546
90.6050.6180.5410.5590.5540.540
100.6200.5380.5190.6350.6260.627
110.4680.4980.5000.584
120.5660.6050.5450.506
130.4860.551
140.5110.509
Ave = 0.570Ave = 0.577Ave = 0.622Ave = 0.688Ave = 0.573Ave = 0.552
P = 0.9817P = 0.0226P = 0.4727
Table 6. Mean local efficiency of central region of Group 5 Hz.
Table 6. Mean local efficiency of central region of Group 5 Hz.
No. 1234567891011121314
pre0.7670.6990.6430.5880.5590.5170.6780.6380.6690.6290.7310.5650.6860.558
post0.4570.4240.4620.3750.6110.3910.6820.5070.5160.6010.5570.1490.6960.749
sumpre8.715P = 0.0159
post7.388
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Yao, J.; Song, B.; Shi, J.; Yin, K.; Du, W. Effects of Repetitive Transcranial Magnetic Stimulation at the Cerebellum on Working Memory. Brain Sci. 2023, 13, 1158. https://doi.org/10.3390/brainsci13081158

AMA Style

Yao J, Song B, Shi J, Yin K, Du W. Effects of Repetitive Transcranial Magnetic Stimulation at the Cerebellum on Working Memory. Brain Sciences. 2023; 13(8):1158. https://doi.org/10.3390/brainsci13081158

Chicago/Turabian Style

Yao, Jiangnan, Bo Song, Jingping Shi, Kuiying Yin, and Wentao Du. 2023. "Effects of Repetitive Transcranial Magnetic Stimulation at the Cerebellum on Working Memory" Brain Sciences 13, no. 8: 1158. https://doi.org/10.3390/brainsci13081158

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop