Next Article in Journal
Influence of Cilioretinal Arteries on Flow Density in Glaucoma Patients Measured Using Optical Coherence Tomography Angiography
Previous Article in Journal
Repeated Measurements Are Necessary for Evaluating Accurate Diurnal Rhythm Using a Self-Intraocular Pressure Measurement Device
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
JCM
Volume 12
Issue 7
10.3390/jcm12072459
jcm-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

The Effect of Peripheral Nerve Block on Postoperative Delirium in Older Adults Undergoing Hip Surgery: A Systematic Review and Meta-Analysis of Randomized Controlled Trials

by
Su Yeon Kim
,
Ha Young Jo
,
Hyo-Seok Na
,
Sung-Hee Han
,
Sang-Hwan Do
and
Hyun-Jung Shin
*
Department of Anesthesiology and Pain Medicine, Seoul National University Bundang Hospital, Seongnam 13620, Republic of Korea
*
Author to whom correspondence should be addressed.
J. Clin. Med. 2023, 12(7), 2459; https://doi.org/10.3390/jcm12072459
Submission received: 16 February 2023 / Revised: 20 March 2023 / Accepted: 20 March 2023 / Published: 23 March 2023
(This article belongs to the Section Clinical Neurology)
Browse Figures
Versions Notes

Abstract

:
This meta-analysis aimed to determine whether peripheral nerve blocks (PNB) reduce postoperative delirium (POD) in elderly patients undergoing hip surgery. This study was registered in the International Prospective Register of Systematic Reviews (PROSPERO; CRD42022328320). The PubMed, EMBASE, Web of Science, and Cochrane Library databases were searched for randomized controlled trials (RCTs) on 26 April 2022. A total of 19 RCTs with 1977 participants were included. Perioperative PNB lowered the POD incidence on the third postoperative day (OR: 0.59, 95% CI [0.40 to 0.87], p = 0.007, I2 = 35%), in patients without underlying cognitive impairment (OR: 0.47, 95% CI [0.30 to 0.74], p = 0.001, I2 = 30%), and when a fascia iliaca compartment block (OR: 0.58, 95% CI [0.37 to 0.91], p = 0.02, I2 = 0%) or a femoral nerve block (OR: 0.33, 95% CI [0.11 to 0.99], p = 0.05, I2 = 66%) were performed. The pain score was also reduced (SMD: −0.83, 95% CI [−1.36 to −0.30], p = 0.002, I2 = 95%) after PNB. Perioperative PNB can lower the POD incidence and pain scores up to the third postoperative day. However, considering the wide variety of PNBs performed, more trials are needed to identify the effects of each PNB on POD.

1. Introduction

The Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition of the American Psychiatric Association, describes delirium as a disturbance in attention or cognition [1]. Delirium can occur newly, or is exacerbated in patients with pre-existing cognitive impairment, after surgery [2]. The incidence of postoperative delirium (POD) varies from 11–40%, depending on the surgery type [3,4]. POD increases the length of hospital or intensive care unit stay, the likelihood of reoperation or readmission to the intensive care unit, medical costs, and in-hospital mortality [5]. POD can last from 10 min after anesthesia to 7 days or until discharge [6]. Delirium can be classified into hyperactive, hypoactive, and mixed forms, according to motor activity [7]. There are several tools for diagnosing delirium, including the Confusion Assessment Method (CAM) or the Richmond Agitation-Sedation Scale (RASS). The Memorial Delirium Assessment Scale (MDAS) and the Delirium Rating Scale-Revised-98 (DRS-R98) are also useful for assessing the severity of delirium [7].
Many factors are known to cause POD, including old age, underlying diseases such as diabetes mellitus and hypertension, prior cognitive impairment, drinking history, drug abuse, the perioperative lactic acid level, low albumin, intra-operative blood transfusion, fluid and electrolyte imbalances, and anemia [8,9,10,11]. Pain is thought to be a major risk factor for POD based on research showing that patients with inadequately controlled pain are more likely to develop delirium [12]. Therefore, sufficient pain relief may contribute to a reduction in the incidence of POD. In terms of enhanced recovery after surgery (ERAS), a nerve block is frequently performed as a method of reducing pain [13].
Hip surgery is a high-risk procedure with a POD incidence of up to 17%, and this risk increases in older patients [14]. Currently, for patients with hip fractures, various nerve blocks, such as the psoas compartment block, fascia iliaca block, femoral nerve block, lateral femoral cutaneous nerve block, or obturator nerve block, are used for pain control. Among these, the fascia iliaca compartment and femoral nerve blocks are effective in reducing postoperative pain [15]. Since pain is one of the strongest risk factors for POD, a peripheral nerve block (PNB) may contribute to lowering the occurrence of POD by providing effective analgesia after surgery. Based on this hypothesis, clinical studies have shown conflicting results [16,17,18,19].
This study aimed to investigate whether PNB reduces the incidence of POD in older adults undergoing hip fracture surgery, according to the type of PNB and underlying cognitive disorder, in particular.

2. Materials and Methods

2.1. Study Design

This study was conducted according to the Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) statement [20] and registered in the International Prospective Register of Systematic Reviews (PROSPERO; identifier: CRD42022328320). Ethical review and approval were waived for this study because data from published resources were used for analyses.

2.2. Information Sources and Literature Search

We searched PubMed, EMBASE, Web of Science, and Cochrane Library databases on April 26 2022. The search terms included those related to hip fracture, peripheral nerve block, and delirium, such as “intertrochanter”, “trochanter”, “surgery”, “nerve block”, and “cognitive impairment”, along with Medical Subject Heading or EMBASE Subject Heading terms. The search strategy used in this study is described in Supplementary File S1. There were no restrictions on the year of publication or language.

2.3. Study Selection

After searching the databases mentioned above, two authors (S.K. and H.S.) selected the final studies by independently reviewing the titles, abstracts, and full texts of the remaining articles in sequence. In cases of disagreement, a decision was made through discussion.
The inclusion criteria were as follows: (1) randomized controlled trials, (2) patients who underwent hip fracture surgery, (3) cases of peripheral nerve block performed perioperatively, (4) evaluation of the incidence of POD, and (5) literature with a control group.
The exclusion criteria were as follows: (1) case reports, (2) observational studies, (3) retrospective cohort studies, (4) review articles, (5) trial protocols, (6) editorials, and (7) animal studies. We did not exclude gray literature to reduce the possibility of publication bias [21].

2.4. Data Extraction

We reviewed the articles and extracted the following data: age, the total number of participants, study design, type of surgery, type of nerve block, the local anesthetic used, POD incidence, and postoperative pain scores. When data were presented in graphs, they were extracted using the online tool WebPlotDigitizer (version 4.6; WebPlotDigitizer, A. Rohatgi, Pacifica, CA, USA). If the data were described as median (interquartile range), we estimated the mean and standard deviation using the equation presented by Wan et al. [22]. To determine the frequency of POD occurrence, when the cognitive state was described by continuous variables, we contacted the authors [23,24,25], requesting data on the number of patients with POD occurrence; however, none of them replied.

2.5. Assessment of Risk of Bias

Two authors (S.K. and H.S.) independently evaluated the quality of the articles and discussed them to reach an agreement in case of discordance. The risk of bias was assessed in six domains: randomization process, deviations from intended interventions, missing outcome data, measurement of the outcome, selection of the reported result, and overall bias covering the above categories. The risk of bias of each article was graded as “low”, “some concerns”, or “high”, using the Risk of Bias 2 tool supplied by the Cochrane Collaboration [26].

2.6. Grading the Quality of Evidence

The quality of evidence for each outcome was assessed based on the grading of recommendations, assessment, development, and evaluation (GRADE) [27]. The quality of the evidence was assessed as very low, low, moderate, or high. GRADE was assessed using GRADEpro (McMaster University, Hamilton, ON, USA, 2021) (Supplementary File S2).

2.7. Outcome Measures

The primary outcome was the incidence of POD on postoperative days three and seven. The secondary outcome was the postoperative pain scores measured at postoperative days one through three during the resting state. When pain scores were measured at multiple time points, the closest value to 72 h postoperatively was recorded.

2.8. Statistical Analysis

We calculated the standardized mean differences (SMDs) and 95% confidence intervals (CI) for continuous outcomes. Odds ratios (OR) and the 95% CI were calculated for the dichotomous data. We performed the analyses with the random-effects models using inverse variance for both continuous and dichotomous outcome analyses due to different effect sizes and interventions across the included studies. A sensitivity analysis using the leave-one-out method was performed for each meta-analysis. Higgins’ I2, the heterogeneity statistic Cochrane’s Q, and the corresponding p-values were calculated for the heterogeneity tests. Heterogeneity was considered high when I2 was >50%. A funnel plot was presented with OR against the associated SEs to evaluate publication bias. Publication bias was considered if p-value < 0.1, using Egger’s linear regression test.
Review Manager (RevMan, version 5.4.1, the Cochrane Collaboration) and R software (version 4.1.3, R Foundation for Statistical Computing, Austria) were used for all analyses.

3. Result

3.1. Study Selection and Characteristics

Two authors extracted 723 articles after an initial search from the PubMed (n = 159), EMBASE (n = 154), Cochrane Library (n = 348), and Web of Science (n = 62) databases, and 197 duplicate articles were removed. Two authors screened the remaining articles independently and excluded 336 and 124 articles based on the title and abstract, respectively. A full-text review was conducted of the remaining 66 articles, and 47 articles were excluded. The specific reasons for excluding each article are shown in Figure 1.
The characteristics of the 19 included studies are presented in Table 1. A fascia iliaca compartment block and femoral nerve block were performed in seven studies [16,17,18,19,28,29,30] and five studies [31,32,33,34,35], respectively. The following types of nerve blocks were performed in the remaining studies: lumbosacral plexus block [36,37], lumbar plexus block [38], a combination of psoas compartment block and sciatic nerve block [39], femoral and lateral cutaneous block [40], a combination of fascia iliaca compartment block and sciatic nerve block [41], and a combination of fascia iliaca compartment block, sacral plexus block, and superior cluneal nerve block [42]. In six studies, the local anesthetic was continuously administered through a catheter [17,19,31,32,38,39]. The details of the demographics and interventions for each study are described in Table 1.

3.2. Risk of Bias Assessment

Three studies [32,36,37] were classified as “low risk”, twelve studies [16,18,19,28,29,30,31,35,38,39,41,42] as “some concerns”, and four studies [17,33,34,40] as “high risk” in the overall bias (Figure 2). For bias arising from the randomization process, 12 studies [17,18,19,28,30,31,32,33,36,37,39,42] were rated as “low risk”, while 7 studies [16,29,34,35,38,40,41] were classified as “some concerns.” For bias due to deviations from the intended interventions, all but one study [40] with “high risk” due to lack of information, and another study [38], with “some concerns”, were assessed as “low risk.” For the bias caused by missing outcome data, two studies [31,42] were classified as “some concerns”, and four studies [17,33,34,40] were rated as “high risk” for the following reasons: insufficient information [17,40], and large population of exclusion after enrollment [33,34]. Two studies [28,41] were assessed as “some concerns”, while all other studies were assessed as “low risk” for bias in the measurement of the outcome. Meanwhile, all but four studies [32,36,37,42] evaluated as “low risk” were assessed as “some concerns” for bias in the selection of the reported result.

3.3. Meta-Analysis

In a study by Bielka et al. [39], three groups were included: (1) PNB group, (2) no-block group under spinal anesthesia, and (3) no-block group under general anesthesia. Among the groups, the comparison between the nerve block and no block groups under spinal anesthesia was included in the present data synthesis. One study [33] was only included in the meta-analysis of POD on postoperative day seven, not on postoperative day three, because this study presented POD incidence only on postoperative day seven. In another study [37], POD incidence was measured primarily on postoperative day seven; however, in case of early discharge prior to postoperative day seven, POD was measured at the time of discharge. Therefore, this study was excluded from the analysis of POD incidence on postoperative day three, but was only included in the analysis on postoperative day seven. One study [38] measured POD on postoperative day one, three, and seven; therefore, we used data from postoperative days three and seven for the analysis. Seven studies [16,18,19,31,32,39,41] did not describe the timing of POD assessment, while two studies [29,30] investigated POD one day after surgery. We categorized these randomized controlled trials (RCTs) as eligible for the analysis of POD three days after surgery.
Two tools were used to assess pain scores in the included studies: the visual analog scale (VAS) [16,18,28,30,33,34,36,37,38] and the numerical rating scale (NRS) [19,31,32,39]. We calculated the SMDs due to the conversion of data with median and interquartile ranges to mean and standard deviations.

3.3.1. Postoperative Delirium at Postoperative Day Three

A total of 17 studies [16,17,18,19,28,29,30,31,32,34,35,36,38,39,40,41,42] (n = 1631; 793 in the PNB group and 838 in the control group) were included in this meta-analysis. The incidence of POD was lower in the PNB group than in the control group on postoperative day three (OR: 0.59, 95% CI [0.40 to 0.87], p = 0.007, I2 = 35%) (Figure 3). In a subgroup analysis regarding the type of nerve block, both the fascia iliaca compartment block (OR: 0.58, 95% CI [0.37 to 0.91], p = 0.02, I2 = 0%) and the femoral nerve block (OR: 0.33, 95% CI [0.11 to 0.99], p = 0.05, I2 = 66%) lowered the occurrence of POD, while other types of blocks or combinations of blocks did not show any significant effect on the development of POD compared with no block (Figure 3). In the subgroup analysis according to pre-existing cognitive impairment, the incidence of POD was lower when PNB was performed in patients without pre-existing cognitive impairment (OR: 0.47, 95% CI [0.30 to 0.74], p = 0.001, I2 = 30%) (Figure 3). In contrast, PNB did not affect the occurrence of POD in patients with pre-existing cognitive impairment (OR: 1.04, 95% CI [0.63 to 1.72], p = 0.88, I2 = 0%) (Figure 3).
In the sensitivity analysis, the effect size of delirium measured at postoperative day three decreased (OR: 0.72, 95% CI [0.53 to 0.96], p = 0.03, I2 = 0%) compared to the pooled effect after excluding one study, which was an outlier [35].
Most of the included studies were rated as having “some concerns” regarding the risk of bias assessment.

3.3.2. Postoperative Delirium at Postoperative Day Seven

A meta-analysis of three studies [33,37,38] (n = 406; 201 in the PNB group and 205 in the control group) showed no significant differences in POD incidence between the two groups (OR: 1.26, 95% CI [0.76 to 2.09], p = 0.37, I2 = 0%) (Figure 4).
In the sensitivity analysis, there was no significant difference in POD incidence (OR: 1.16, 95% CI [0.41 to 3.23], p = 0.78, I2 = 0%) after excluding an outlier [33].
Regarding the risk of bias assessment, one study [37] was rated as “low”, one [38] as “some concerns”, and the other [33] as “high.”

3.3.3. Postoperative Pain Score

A meta-analysis of 13 studies [16,18,19,28,30,31,32,33,34,36,37,38,39] (n = 1462; 721 in the PNB group and 741 in the control group) showed a significant reduction in the postoperative pain score (SMD: −0.83, 95% CI [−1.36, −0.30], p = 0.002, I2 = 95%) (Figure 4).
In the sensitivity analysis, performing a peripheral nerve block was significantly more effective in reducing pain (SMD: −0.50, 95% CI [−0.87, −0.14], p = 0.007, I2 = 89%) after excluding an outlier [19]. However, this interpretation requires caution because the heterogeneity remains high.
Regarding the risk of bias assessment, most included studies [16,18,19,28,30,31,38,39] were rated as “some concerns”, while three studies [32,36,37] were rated as “low”, and two studies [33,34] as “high.”

3.3.4. Publication Bias

Funnel plots and Egger’s tests were performed for POD (p = 0.1378) and postoperative pain scores (p = 0.2153) at postoperative day three, and no evidence of publication bias was identified (Figure 5). Studies regarding POD on postoperative day seven were not tested for publication bias due to the small number of included studies.

4. Discussion

This systematic review and meta-analysis showed that PNB, especially the fascia iliaca compartment and femoral nerve blocks, lowered the incidence of POD on postoperative day three. In participants without preexisting cognitive impairment, PNB lowered the occurrence of POD. However, a comparison between the nerve block and no-block groups revealed no effect of PNB on POD on postoperative day seven. The severity of the postoperative pain was attenuated when PNBs were performed. This study is meaningful in that it included a relatively large number of studies compared to previous meta-analyses, and analyzed the effect of different types of peripheral nerve blocks on the incidence of postoperative delirium in elderly patients undergoing hip surgery.
According to our meta-analysis, the implementation of PNB had a lowering effect on POD on postoperative day three, and this effect was particularly pronounced when a fascia iliaca compartment block or a femoral nerve block were performed. These results are consistent with those of previous studies showing that fascia iliaca compartment blocks and femoral nerve blocks relieve pain in patients with hip fracture, given that pain is a crucial risk factor for POD [43,44]. According to Hilton’s law, pain from hip fractures is mainly carried by the obturator, sciatic, and femoral nerves [45]. The femoral nerve covers the anterolateral region [45], where the main incision is made during a hip surgery. Moreover, the anterior capsule, predominantly supplied by the femoral and obturator nerves, has a high density of nociceptors and mechanoreceptors, making it a major source of pain in the hip joint [46]. Therefore, it is speculated that the fascia iliaca compartment block and femoral nerve block, which mainly target the femoral nerve, have a remarkable effect in reducing POD after a hip surgery.
In our study, a peripheral nerve block significantly reduced POD on postoperative day three, but not on postoperative day seven. Although these results may suggest that the PNB implementation only has a short-term impact on the occurrence of POD, it is difficult to draw firm conclusions from our meta-analysis alone because of the small number of studies that measured the incidence of delirium at postoperative day seven. In addition, among the studies included in the meta-analysis of POD on postoperative day seven, only one study performed a femoral nerve block, which reduced POD on postoperative day three, while two other studies performing a lumbar plexus block or lumbosacral plexus block showed no effect in reducing POD on postoperative day three. The impact of mid- to long-term cognitive impairment should be reexamined after further research.
In a previous study [47], PNB was effective in reducing POD in patients without underlying cognitive impairment. In this study, the performance of PNB did not differ regarding POD when patients with underlying cognitive impairment were included. However, in our study, PNB was effective in lowering the occurrence of POD, not only in the subgroup without baseline cognitive impairment, but also in general cases, including studies targeting patients with cognitive impairment. Conversely, when a subgroup analysis was conducted only on the studies that included patients with previous cognitive impairment, PNB showed no effects on POD occurrence. Nonetheless, because of the very small number of studies in this subgroup analysis, it is necessary to investigate more RCTs in the future to determine the effect of PNB on the incidence of POD in patients with cognitive impairment.
Li et al. [48] also examined the effects of nerve blocks on postoperative neurological changes via a meta-analysis. The authors of this meta-analysis placed no restrictions on the type of surgery or age of participants, and included not only peripheral nerve blocks, but also neuraxial blocks, such as spinal anesthesia or caudal blocks, which were excluded in our study. In this study, regional anesthesia did not reduce the incidence of POD in older adults or patients who underwent orthopedic surgery. In contrast, our study demonstrated that the POD incidence can be significantly reduced when PNB is performed in older patients undergoing hip surgery.
According to our meta-analysis, PNB significantly lowered the postoperative pain scores. Given that pain is a major risk factor for POD [12], this result correlates with the finding that POD was reduced in patients who underwent PNB. However, as heterogeneity was high in this analysis, caution should be exercised when interpreting the results.
Our study had several limitations. First, the method of measuring delirium occurrence was different in each included study. In many studies [18,31,36,37,38,40], delirium was measured using the Confusion Assessment Method (CAM) or MMSE scores; however, some studies used tools such as the Organic Brain Syndrome Scale [33], Delirium index [42], Delirium Rating Scale-R-98 [34], Short Portable Mental Status Questionnaire [29], and internal criteria of the study [28]; many studies did not record specific measurement methods [16,17,19,30,32,35,39,41]. Second, the timing of the PNB was different. Some studies [28,32,33,34] performed nerve blocks as soon as a femoral fracture was diagnosed or in the emergency room, and some studies [17,18,30,36,37,38,39,41,42] performed nerve blocks in the operating room before surgery. One study [19] conducted a nerve block immediately after skin closure, while another study [31] performed a nerve block twice by injecting a bolus shot and inserting a catheter. Third, the dose, volume, and concentration of local anesthetics used in peripheral nerve blocks were different between the studies. Even with the same type of PNB, the dose, volume, and concentration of injected local anesthetics were different. The dose and concentration of the local anesthetic affect the depth of the PNB [49], which can affect the degree of pain relief and ultimately, the development of postoperative delirium, where the pain is a risk factor. These different interventions may have affected the meta-analysis results. Fourth, reports on safety related to local anesthetics and PNB were insufficient in most studies. Local anesthetic systemic toxicity (LAST) is important, in particular, because it can be confused with POD, as it can cause central nervous system symptoms such as agitation or confusion [50]. Only one study [38] mentioned the absence of neurologic complications, while most of the other studies did not mention specific complications or investigated opioid-related complications, such as PONV. Lastly, some degree of heterogeneity was found in the subgroup analysis of the femoral nerve block effect on POD at postoperative day three and the meta-analysis of the pain score on postoperative day three.
In conclusion, perioperative PNB can reduce the incidence of POD in older adults undergoing hip fracture surgery. However, further investigation is required to verify these results. We believe that well-planned large clinical trials using standardized tools to assess POD, while reducing as many confounders as possible, may clarify the effect of perioperative PNB on cognitive status after a hip fracture surgery in older adults.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/jcm12072459/s1, File S1: Search strategy for each database; File S2: GRADE.

Author Contributions

Conceptualization, H.-J.S.; methodology, S.Y.K.; software, S.Y.K.; validation, S.Y.K., H.-S.N. and H.-J.S.; formal analysis, S.Y.K.; investigation, S.Y.K. and H.-J.S.; resources, S.Y.K. and H.-J.S.; data curation, H.-J.S.; writing—original draft preparation, S.Y.K.; writing—review and editing, H.Y.J., H.-S.N., S.-H.H., S.-H.D. and H.-J.S.; visualization, S.Y.K.; supervision, H.-J.S.; project administration, H.-J.S. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Ethical review and approval was waived because this research used published study data.

Informed Consent Statement

Not applicable.

Data Availability Statement

No new data were created or analyzed in this study.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Association, A.P. DSM-5. 2022. Available online: https://www.psychiatry.org/psychiatrists/practice/dsm (accessed on 3 January 2023).
  2. Brodier, E.; Cibelli, M. Postoperative cognitive dysfunction in clinical practice. BJA Educ. 2021, 21, 75. [Google Scholar] [CrossRef] [PubMed]
  3. Schubert, M.; Schürch, R.; Boettger, S.; Garcia Nuñez, D.; Schwarz, U.; Bettex, D.; Jenewein, J.; Bogdanovic, J.; Staehli, M.L.; Spirig, R. A hospital-wide evaluation of delirium prevalence and outcomes in acute care patients-a cohort study. BMC Health Serv. Res. 2018, 18, 1–12. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  4. Iamaroon, A.; Wongviriyawong, T.; Sura-Arunsumrit, P.; Wiwatnodom, N.; Rewuri, N.; Chaiwat, O. Incidence of and risk factors for postoperative delirium in older adult patients undergoing noncardiac surgery: A prospective study. BMC Geriatr. 2020, 20, 1–8. [Google Scholar] [CrossRef]
  5. Park, E.A.; Kim, M.Y. Postoperative Delirium is Associated with Negative Outcomes and Long-Term Mortality in Elderly Koreans: A Retrospective Observational Study. Medicina 2019, 55, 618. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  6. Chen, F. Postoperative Delirium in Orthopedic Surgery: Etiology and Risk Factors. J. Evol. Med. 2022, 10. [Google Scholar] [CrossRef]
  7. Oh, S.-T.; Park, J.Y. Postoperative delirium. Korean J. Anesthesiol. 2019, 72, 4–12. [Google Scholar] [CrossRef]
  8. Chen, H.; Mo, L.; Hu, H.; Ou, Y.; Luo, J. Risk factors of postoperative delirium after cardiac surgery: A meta-analysis. J. Cardiothorac. Surg. 2021, 16, 113. [Google Scholar] [CrossRef]
  9. Wang, Y.; Zhao, L.; Zhang, C.; An, Q.; Guo, Q.; Geng, J.; Guo, Z.; Guan, Z. Identification of risk factors for postoperative delirium in elderly patients with hip fractures by a risk stratification index model: A retrospective study. Brain Behav. 2021, 11, e32420. [Google Scholar] [CrossRef]
  10. Bramley, P.; McArthur, K.; Blayney, A.; McCullagh, I. Risk factors for postoperative delirium: An umbrella review of systematic reviews. Int. J. Surg. 2021, 93, 106063. [Google Scholar] [CrossRef]
  11. Yang, Q.; Wang, J.; Huang, X.; Xu, Y.; Zhang, Y. Incidence and risk factors associated with postoperative delirium following primary elective total hip arthroplasty: A retrospective nationwide inpatient sample database study. BMC Psychiatry 2020, 20, 1–9. [Google Scholar] [CrossRef]
  12. Ding, X.; Gao, X.; Chen, Q.; Jiang, X.; Li, Y.; Xu, J.; Qin, G.; Lu, S.; Huang, D. Preoperative Acute Pain Is Associated with Postoperative Delirium. Pain Med. 2020, 22, 15–21. [Google Scholar] [CrossRef]
  13. Mancel, L.; Van Loon, K.; Lopez, A.M. Role of regional anesthesia in Enhanced Recovery After Surgery (ERAS) protocols. Curr. Opin. Anesthesiol. 2021, 34, 616–625. [Google Scholar] [CrossRef] [PubMed]
  14. Rong, X.; Ding, Z.-C.; Yu, H.-D.; Yao, S.-Y.; Zhou, Z.-K. Risk factors of postoperative delirium in the knee and hip replacement patients: A systematic review and meta-analysis. J. Orthop. Surg. Res. 2021, 16, 1–18. [Google Scholar] [CrossRef] [PubMed]
  15. Guay, J.; Kopp, S. Peripheral nerve blocks for hip fractures in adults. Cochrane Database Syst. Rev. 2020, 11, CD001159. [Google Scholar] [CrossRef] [PubMed]
  16. Hua, X.; Hu, Y.; Chen, D.; Xiao, Y.; Luo, L. Efficacy and safety of ultrasound-guided fascia iliaca compartment block using dexmedetomidine combined with ropivacaine in aged patients undergoing hip replacement. Int. J. Clin. Exp. Med. 2017, 10, 16484–16491. [Google Scholar]
  17. Loessin, V.; ElZahabi, A.; Brownbridge, B.; Bajwa, J.S. Continuous fascia iliaca block for acute hip fractures: A randomized-controlled pilot study. Can. J. Anesth. J. Can. D’anesthésie 2019, 66, 1265–1267. [Google Scholar] [CrossRef] [PubMed]
  18. Mouzopoulos, G.; Vasiliadis, G.; Lasanianos, N.; Nikolaras, G.; Morakis, E.; Kaminaris, M. Fascia iliaca block prophylaxis for hip fracture patients at risk for delirium: A randomized placebo-controlled study. J. Orthop. Traumatol. 2009, 10, 127–133. [Google Scholar] [CrossRef] [Green Version]
  19. Nie, H.; Yang, Y.-X.; Wang, Y.; Liu, Y.; Zhao, B.; Luan, B. Effects of continuous fascia iliaca compartment blocks for postoperative analgesia in patients with hip fracture. Pain Res. Manag. 2015, 20, 210–212. [Google Scholar] [CrossRef] [Green Version]
  20. Page, M.J.; McKenzie, J.E.; Bossuyt, P.M.; Boutron, I.; Hoffmann, T.C.; Mulrow, C.D.; Shamseer, L.; Tetzlaff, J.M.; Akl, E.A.; Brennan, S.E.; et al. The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. BMJ 2021, 372, n71. [Google Scholar] [CrossRef]
  21. Paez, A. Gray literature: An important resource in systematic reviews. J. Evid.-Based Med. 2017, 10, 233–240. [Google Scholar] [CrossRef]
  22. Wan, X.; Wang, W.; Liu, J.; Tong, T. Estimating the sample mean and standard deviation from the sample size, median, range and/or interquartile range. BMC Med. Res. Methodol. 2014, 14, 135. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  23. Guo, Y.-h.; Liang-de, A.; Jia, Z. Effects of lumbar plexus-sciatic nerve block combined with sevoflurane on cognitive function in elderly patients after hip arthroplasty: Study protocol for a prospective, single-center, open-label, randomized, controlled clinical trial. Clin. Trials Orthop. Disord. 2017, 2, 71. [Google Scholar]
  24. Perrier, V.; Julliac, B.; Lelias, A.; Morel, N.; Dabadie, P.; Sztark, F. Influence of the fascia iliaca compartment block on postoperative cognitive status in the elderly. Ann. Fr. D’anesthesie Reanim. 2010, 33, 283–288. [Google Scholar] [CrossRef] [PubMed]
  25. Xu, L.; Luo, F.; Lei, E.; Zhu, X.; Huang, H.; Li, Q.; Wan, H. The effect of the fascia iliaca compartment block combined with laryngeal mask general anesthesia on the internal fixation of senile femoral neck fracture. Int. J. Clin. Exp. Med. 2020, 13, 634–643. [Google Scholar]
  26. Sterne, J.A.; Savović, J.; Page, M.J.; Elbers, R.G.; Blencowe, N.S.; Boutron, I.; Cates, C.J.; Cheng, H.-Y.; Corbett, M.S.; Eldridge, S.M. RoB 2: A revised tool for assessing risk of bias in randomised trials. BMJ 2019, 366, l4898. [Google Scholar] [CrossRef] [Green Version]
  27. Schünemann, H.J.; Oxman, A.D.; Brozek, J.; Glasziou, P.; Jaeschke, R.; Vist, G.E.; Williams, J.W.; Kunz, R.; Craig, J.; Montori, V.M. Grading quality of evidence and strength of recommendations for diagnostic tests and strategies. BMJ 2008, 336, 1106–1110. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  28. Hao, J.; Dong, B.; Zhang, J.; Luo, Z. Pre-emptive analgesia with continuous fascia iliaca compartment block reduces postoperative delirium in elderly patients with hip fracture. A randomized controlled trial. Saudi Med. J. 2019, 40, 901–906. [Google Scholar] [CrossRef]
  29. Wennberg, P.; Möller, M.; Herlitz, J.; Kenne Sarenmalm, E. Fascia iliaca compartment block as a preoperative analgesic in elderly patients with hip fractures–effects on cognition. BMC Geriatr. 2019, 19, 1–8. [Google Scholar] [CrossRef]
  30. Yamamoto, N.; Sakura, S.; Noda, T.; Nishiyama, A.; Dan’ura, T.; Matsui, Y.; Ozaki, T. Comparison of the postoperative analgesic efficacies of intravenous acetaminophen and fascia iliaca compartment block in hip fracture surgery: A randomised controlled trial. Injury 2019, 50, 1689–1693. [Google Scholar] [CrossRef]
  31. Morrison, R.S.; Dickman, E.; Hwang, U.; Akhtar, S.; Ferguson, T.; Huang, J.; Todd, K.H. Regional Nerve Blocks Improve Pain and Functional Outcomes in Hip Fracture: A Randomized Controlled Trial. J. Am. Geriatr. Soc. 2016, 64, 2433–2439. [Google Scholar] [CrossRef] [Green Version]
  32. Rowlands, M.; van de Walt, G.; Bradley, J.; Mannings, A.; Armstrong, S.; Bedforth, N.; Moppett, I.K.; Sahota, O. Femoral nerve block intervention in neck of femur fracture (FINOF): A randomised controlled trial. BMJ Open 2018, 8, e019650. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  33. Unneby, A.; Svensson, O.; Gustafson, Y.; Lindgren, B.-M.; Bergström, U.; Olofsson, B. Complications with focus on delirium during hospital stay related to femoral nerve block compared to conventional pain management among patients with hip fracture—A randomised controlled trial. Injury 2020, 51, 1634–1641. [Google Scholar] [CrossRef] [PubMed]
  34. Uysal, A.İ.; Altıparmak, B.; Yaşar, E.; Turan, M.; Canbek, U.; Yılmaz, N.; Demirbilek, S.G. The effects of early femoral nerve block intervention on preoperative pain management and incidence of postoperative delirium geriatric patients undergoing trochanteric femur fracture surgery: A randomized controlled trial. Ulus. Travma Acil Cerrahi Derg. 2020, 26, 109–114. [Google Scholar] [CrossRef] [PubMed]
  35. Kullenberg, B.; Ysberg, B.; Heilman, M.; Resch, S. Femoral nerve block as pain relief in hip fracture. A good alternative in perioperative treatment proved by a prospective study. Lakartidningen 2004, 101, 2104–2107. [Google Scholar]
  36. Mei, B.; Zha, H.; Lu, X.; Cheng, X.; Chen, S.; Liu, X.; Gu, E. Peripheral Nerve Block as a Supplement to Light or Deep General Anesthesia in Elderly Patients Receiving Total Hip Arthroplasty: A Prospective Randomized Study. Clin. J. Pain 2017, 33, 1053–1059. [Google Scholar] [CrossRef] [PubMed]
  37. Tang, L.; Fang, P.; Fang, Y.; Lu, Y.; Xu, G.; Liu, X. Comparison of effects between combined lumbar-sacral plexus block plus general anesthesia and unilateral spinal anesthesia in elderly patients undergoing hip fracture surgery: A pilot randomized controlled trial. Evid.-Based Complement. Altern. Med. 2021, 2021, 6685497. [Google Scholar] [CrossRef]
  38. Li, J.; Dong, B.; Cai, W.; Wang, G. Continuous lumbar plexus block reduces the incidence of early postoperative cognitive dysfunction in elderly patients undergoing hip arthroplasty. Zhong Nan Da Xue Xue Bao. Yi Xue Ban. Cent. South Univ. Med. Sci. 2018, 43, 858–863. [Google Scholar] [CrossRef]
  39. Bielka, K.; Kuchyn, I.; Tokar, I.; Artemenko, V.; Kashchii, U. Psoas compartment block efficacy and safety for perioperative analgesia in the elderly with proximal femur fractures: A randomized controlled study. BMC Anesth. 2021, 21, 252. [Google Scholar] [CrossRef]
  40. Carvalho, R.; Carvalho, M.; Ribeiro, A.P.; Vasconcelos, L. Proximal femur fracture anesthesia thechnique—Does it really matter? Reg. Anesth. Pain Med. 2021, 70, A47. [Google Scholar] [CrossRef]
  41. Chen, P.; Yang, J.; Hu, D.; Jing, X.; Liu, D. Safety of Different Anesthesia Methods Combined with Intravenous Fast Channel Anesthesia in Lower Extremity Orthopedic Surgery of the Elderly. Evid.-Based Complement. Altern. Med. 2021, 2021, 9787879. [Google Scholar] [CrossRef]
  42. Gu, J.; Wang, E.; Dai, S.; Dong, R.; Xu, F.; Shen, Z.; Wang, Z.; He, X. Ultrasound-guided Multiple Nerve Blocks: A Safe and Effective Anesthetic Modality in Geriatric Hip Fracture Patients. Clin. J. Pain 2021, 37, 881–886. [Google Scholar] [CrossRef] [PubMed]
  43. Hong, H.-k.; Ma, Y. The efficacy of fascia iliaca compartment block for pain control after hip fracture: A meta-analysis. Medicine 2019, 98, e16157. [Google Scholar] [CrossRef] [PubMed]
  44. Riddell, M.; Ospina, M.; Holroyd-Leduc, J.M. Use of femoral nerve blocks to manage hip fracture pain among older adults in the emergency department: A systematic review. Can. J. Emerg. Med. 2016, 18, 245–252. [Google Scholar] [CrossRef] [Green Version]
  45. HÉbert-Blouin, M.N.; Shane Tubbs, R.; Carmichael, S.W.; Spinner, R.J. Hilton’s law revisited. Clin. Anat. 2014, 27, 548–555. [Google Scholar] [CrossRef]
  46. Laumonerie, P.; Dalmas, Y.; Tibbo, M.E.; Robert, S.; Durant, T.; Caste, T.; Vialla, T.; Tiercelin, J.; Gracia, G.; Chaynes, P. Sensory Innervation of the Hip Joint and Referred Pain: A Systematic Review of the Literature. Pain Med. 2021, 22, 1149–1157. [Google Scholar] [CrossRef]
  47. Kim, C.-H.; Yang, J.Y.; Min, C.H.; Shon, H.-C.; Kim, J.W.; Lim, E.J. The effect of regional nerve block on perioperative delirium in hip fracture surgery for the elderly: A systematic review and meta-analysis of randomized controlled trials. Orthop. Traumatol. Surg. Res. 2021, 108, 103151. [Google Scholar] [CrossRef]
  48. Li, T.; Dong, T.; Cui, Y.; Meng, X.; Dai, Z. Effect of regional anesthesia on the postoperative delirium: A systematic review and meta-analysis of randomized controlled trials. Front. Surg. 2022, 9, 937293. [Google Scholar] [CrossRef] [PubMed]
  49. Fredrickson, M.J.; Abeysekera, A.; White, R. Randomized study of the effect of local anesthetic volume and concentration on the duration of peripheral nerve blockade. Reg. Anesth. Pain Med. 2012, 37, 495–501. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  50. Gitman, M.; Fettiplace, M.R.; Weinberg, G.L.; Neal, J.M.; Barrington, M.J. Local anesthetic systemic toxicity: A narrative literature review and clinical update on prevention, diagnosis, and management. Plast. Reconstr. Surg. 2019, 144, 783–795. [Google Scholar] [CrossRef]
Jcm 12 02459 g001 550
Figure 1. Flow diagram of study selection.
Figure 1. Flow diagram of study selection.
Jcm 12 02459 g001
Jcm 12 02459 g002 550
Figure 2. Risk of bias summary [16,17,18,19,28,29,30,31,32,33,34,35,36,37,38,39,40,41,42]. D1, randomization process; D2, deviations from the intended interventions; D3, missing outcome data; D4, measurement of the outcome; D5, selection of the reported result; Jcm 12 02459 i001, low risk; Jcm 12 02459 i002, some concerns; Jcm 12 02459 i003, high risk.
Figure 2. Risk of bias summary [16,17,18,19,28,29,30,31,32,33,34,35,36,37,38,39,40,41,42]. D1, randomization process; D2, deviations from the intended interventions; D3, missing outcome data; D4, measurement of the outcome; D5, selection of the reported result; Jcm 12 02459 i001, low risk; Jcm 12 02459 i002, some concerns; Jcm 12 02459 i003, high risk.
Jcm 12 02459 g002
Jcm 12 02459 g003 550
Figure 3. Forest plot: the effect of a peripheral nerve block on postoperative delirium at postoperative day three [16,17,18,19,28,29,30,31,32,34,35,36,38,39,40,41,42]. (A) Forest plot with subgroup analysis regarding the type of block. (B) Forest plot with subgroup analysis regarding underlying cognitive impairment. IV: inverse variance.
Figure 3. Forest plot: the effect of a peripheral nerve block on postoperative delirium at postoperative day three [16,17,18,19,28,29,30,31,32,34,35,36,38,39,40,41,42]. (A) Forest plot with subgroup analysis regarding the type of block. (B) Forest plot with subgroup analysis regarding underlying cognitive impairment. IV: inverse variance.
Jcm 12 02459 g003
Jcm 12 02459 g004 550
Figure 4. Forest plot [16,18,19,28,30,31,32,33,34,36,37,38,39]. (A) Effect of a peripheral nerve block on postoperative delirium at postoperative day seven. (B) Effect of a peripheral nerve block on postoperative pain. IV: inverse variance.
Figure 4. Forest plot [16,18,19,28,30,31,32,33,34,36,37,38,39]. (A) Effect of a peripheral nerve block on postoperative delirium at postoperative day seven. (B) Effect of a peripheral nerve block on postoperative pain. IV: inverse variance.
Jcm 12 02459 g004
Jcm 12 02459 g005 550
Figure 5. Funnel plot for publication bias. (A) Postoperative delirium at postoperative day three. (B) Postoperative pain scores. SE, standard error; OR, odds ratio.
Figure 5. Funnel plot for publication bias. (A) Postoperative delirium at postoperative day three. (B) Postoperative pain scores. SE, standard error; OR, odds ratio.
Jcm 12 02459 g005
Table
Table 1. Study design and characteristics of included studies.
Table 1. Study design and characteristics of included studies.
SourceAge (Number of Patients)Type of SurgeryType of Nerve BlockMeasurement of Postoperative DeliriumType of Local Anesthetics (Dose)
ControlNerve BlockBolusContinuous Catheter
Gu 2021 [42]73.4 ± 22.9 (45)74.2 ± 20.7 (42)femoral neck fracture, femoral intertrochanteric fracture, and femoral subtrochanteric fractureFascia iliaca compartment block, sacral plexus block, and superior cluneal nerve blockDelirium indexFascia iliaca compartment block: 0.3% ropivacaine (30–35 mL)
Sacral plexus block: 0.3% ropivacaine (5–10 mL)
Superior cluneal nerve block: 0.3% ropivacaine (3–4 mL)		None
Hao 2019 [28]72.5 ± 4.3 (42)72.3 ± 3.8 (43)Hip surgery (not specified)Fascia iliaca compartment blockInternal criteria *0.45% ropivacaine (30 mL)None
Hua 2017 [16]69.2 ± 4.0 (30)68.7 ± 4.4 (30)Hip replacement surgeryFascia iliaca compartment blockNI0.4% ropivacaine (35 mL)None
Mouzopoulos 2009 [18]73.1 ± 3.8 (105)72.3 ± 4.1 (102)Hemiarthroplasty, intramedullary nailingFascia iliaca compartment blockCAM0.25% bupivacaine (0.3 mL/kg)None
Loessin 2019 [17]NINIHip surgery (not specified)Fascia iliaca compartment blockNI0.125% ropivacaine (40 mL)0.2% ropivacaine (10 mL/h)
Nie 2015 [19]68.2 ± 2.1 (53)73.6 ± 2.1 (51)Open reduction and internal fixationFascia iliaca compartment blockNI0.5% ropivacaine (20 mL if BW < 50 kg, 25 mL if BW 50–70 kg, 30 mL if BW > 70 kg)0.25% ropivacaine
(0.1 mL/kg/h)
Wennberg 2019 [29]84.9 ± 7.7 (60)84.6 ± 6.7 (65)Cervical, trochanteric, and subtrochanteric
femur fracture surgery		Fascia iliaca compartment blockShort Portable Mental Status Questionnaire0.2% ropivacaine (30 mL)None
Yamamoto 2019 [30]84.6 ± 7.8 (28)84.7 ± 6.5 (25)Internal fixation and bipolar hemiarthroplastyFascia iliaca compartment blockNI0.25% levobupivacaine (40 mL)None
Kullenberg 2004 [35]82.7 ± 7.5 (40)81.3 ± 6.5 (40)Nail osteosynthesis and hemiendoplastyFemoral nerve blockNI0.75% ropivacaine (30 mL)None
Morrison 2016 [31]79.6 ± 27.4 (81)81.1 ± 26.7 (72)Femoral neck fracture, intertrochanteric fracture, and pericapsular fracture surgeryFemoral nerve blockCAM0.5% bupivacaine (20 mL)0.2% ropivacaine (15 mL bolus, then 5 mL/h)
Rowlands 2018 [32]83.9 ± 6.2 (56)83.0 ± 5.8 (55)Hip surgery (not specified)Femoral nerve blockNI0.25% ropivacaine (0.5 mL/kg)0.2% ropivacaine (5 mL/h)
Unneby 2020 [33]84.4 ± 6.4 (120)83.7 ± 7.1 (116)Hip surgery (not specified)Femoral nerve blockOrganic Brain Syndrome Scale0.25% ropivacaine (40 mL)None
Uysal 2020 [34]82.0 ± 6.8 (45)81.4 ± 8.0 (46)Trochanteric femur fracture surgeryFemoral nerve blockDelirium Rating Scale-R-980.25% bupivacaine (10 mL)None
Bielka 2021 [39]71.7 ± 2.2 (30)
73.0 ± 1.5 (30)		71 ± 3.7 (30)Osteosynthesis of proximal femurPsoas compartment block and sciatic nerve blockNIPsoas compartment block: 0.5% bupivacaine (40 mL)
Sciatic nerve block: 1.5% lidocaine (30 mL)		0.125% bupivacaine (6–8 mL/h)
Carvalho 2021 [40]83.8 (29)80.8 (28)Hip prosthesis, dynamic screw, and femoral nailFemoral and lateral cutaneous nerve blockCAMNot specifiedNot specified
Chen 2021 [41]72.8 ± 5.9 (53)73.9 ± 6.2 (53)Lower limb internal fixation, total hip
arthroplasty, replacement, and artificial femoral head replacement		Iliac fascial space block and sciatic nerve blockNI0.5% ropivacaine (0.2 mL/kg)None
Li 2018 [38]68.3 ± 8.5 (30)71.6 ± 7.2 (30)Hip replacement surgeryLumbar plexus nerve blockMMSE0.375% ropivacaine (5 mL)0.2% ropivacaine (basal 4 mL/h, bolus 2 mL, lockout time 30 min)
Mei 2017 [36]74 ± 7 (66)75 ± 6 (66)Total hip arthroplastyLumbosacral plexus blockCAM, MMSE0.5% ropivacaine (15 mL)None
Tang 2021 [37]78.0 ± 6.5 (55)76.6 ± 7.0 (55)Osteosynthesis, artificial femoral head
replacement, and total hip replacement		Lumbosacral plexus blockCAM0.25% ropivacaine (20 mL each)None
Age is presented as mean ± standard deviation. Age of control group in study by Bielka et al. [39] is presented separately, according to the type of anesthesia. The first row is the group under spinal anesthesia, and the second row is the group under general anesthesia. BW: body weight; NI: no information; CAM: Confusion Assessment Method; MMSE: Mini-Mental State Examination. * Internal criteria; 1. Acute onset of mental changes and fluctuating course, 2. Inattention, 3. Disorganized thinking, 4. Altered levels of consciousness, needs to meet all four criteria.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Kim, S.Y.; Jo, H.Y.; Na, H.-S.; Han, S.-H.; Do, S.-H.; Shin, H.-J. The Effect of Peripheral Nerve Block on Postoperative Delirium in Older Adults Undergoing Hip Surgery: A Systematic Review and Meta-Analysis of Randomized Controlled Trials. J. Clin. Med. 2023, 12, 2459. https://doi.org/10.3390/jcm12072459

AMA Style

Kim SY, Jo HY, Na H-S, Han S-H, Do S-H, Shin H-J. The Effect of Peripheral Nerve Block on Postoperative Delirium in Older Adults Undergoing Hip Surgery: A Systematic Review and Meta-Analysis of Randomized Controlled Trials. Journal of Clinical Medicine. 2023; 12(7):2459. https://doi.org/10.3390/jcm12072459

Chicago/Turabian Style

Kim, Su Yeon, Ha Young Jo, Hyo-Seok Na, Sung-Hee Han, Sang-Hwan Do, and Hyun-Jung Shin. 2023. "The Effect of Peripheral Nerve Block on Postoperative Delirium in Older Adults Undergoing Hip Surgery: A Systematic Review and Meta-Analysis of Randomized Controlled Trials" Journal of Clinical Medicine 12, no. 7: 2459. https://doi.org/10.3390/jcm12072459

APA Style

Kim, S. Y., Jo, H. Y., Na, H.-S., Han, S.-H., Do, S.-H., & Shin, H.-J. (2023). The Effect of Peripheral Nerve Block on Postoperative Delirium in Older Adults Undergoing Hip Surgery: A Systematic Review and Meta-Analysis of Randomized Controlled Trials. Journal of Clinical Medicine, 12(7), 2459. https://doi.org/10.3390/jcm12072459

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop