Effects of Surgically Assisted Rapid Palatal Expansion on Facial Soft Tissues: A Systematic Review
Abstract
:1. Introduction
2. Materials and Methods
2.1. Search Strategy
2.2. Study Selection and Eligibility Criteria
2.3. Data Extraction
2.4. Assessment of Risk of Bias (RoB)
2.5. Heterogeneity Assessment
3. Results
3.1. Flow Diagram
3.2. Study Characteristics
3.3. Risk of Bias
3.4. Heterogeneity Assessment
4. Discussion
5. Conclusions
- Detailed prediction of soft tissue outcomes remains unreliable after surgically assisted rapid palatal expansion.
- High heterogeneity and risk of bias was observed among the available studies.
- As an overall assessment, only the measurement of alar base width is common in methodologically similar studies.
- A postoperative increase of the alar base was reported by most studies.
- High-quality prospective studies with respect to the clinical outcomes of SARPE on facial soft tissues need to be carried out in the future.
Supplementary Materials
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
References
- Wertz, R.A. Skeletal and dental changes accompanying rapid midpalatal suture opening. Am. J. Orthod. 1970, 58, 41–66. [Google Scholar] [CrossRef]
- Bell, W.H.; Epker, B.N. Surgical-orthodontic expansion of the maxilla. Am. J. Orthod. 1976, 70, 517–528. [Google Scholar] [CrossRef]
- Shetty, P.; Hegde, A.M.; Rai, K. Study of stress distribution and displacement of the maxillary complex following application of forces using jackscrew and titanium palatal expander 2—A finite element study. J. Clin. Pediatr. Dent. 2009, 34, 87. [Google Scholar] [CrossRef]
- Catteneo, P.M.; Dalstra, M.; Melsen, B. Strains in periodontal ligament and alveolar bone associated with orthodontic tooth movement analysed by finite element. Orthod. Craniofacial Res. 2009, 12, 120. [Google Scholar] [CrossRef]
- De Assis, D.S.; Xavier, T.A.; Noritomi, P.Y.; Goncales, E.S. Finite element analysis of bone stress after SARPE. J. Oral Maxillofac. Surg. 2014, 72, 167.e1–167.e7. [Google Scholar] [CrossRef]
- Bailey, L.J.; White, R.P.; Proffit, W.R.; Turvey, T.A. Segmental LeFort I osteotomy for management of transverse maxillary deficiency. J. Oral Maxillofac. Surg. 1997, 55, 728–731. [Google Scholar] [CrossRef]
- Brown, J.B. Elongation of the partially cleft palate. AM. J. Orthod. Oral Surg. 1938, 24, 875–877. [Google Scholar] [CrossRef]
- Camps-Pereperez, I.; Guijarro-Martinez, R.; Peiro-Guijarro, M.A.; Hernandez-Alfaro, F. The value of cone beam computed tomography imaging in surgically assisted rapid palatal expansion: A systematic review of the literature. Int. J. Oral Maxillofac. Surg. 2017, 46, 827–838. [Google Scholar] [CrossRef]
- Ilizarov, G.A. The principles of the Ilizarov method. Bull. Hosp. Joint Dis. 1997, 56, 49–53. [Google Scholar]
- Vilani, G.N.; Mattos, C.T.; de Oliveira Ruellas, A.C.; Maia, L.C. Long-term dental and skeletal changes in patients submitted to surgically assisted rapid maxillary expansion: A meta-analysis. Oral Surg. Oral Med. Oral Pathol. Oral Radiol. 2012, 114, 689–697. [Google Scholar] [CrossRef]
- Kilic, E.; Kilic, B.; Kurt, G.; Sakin, C.; Alkan, A. Effects of surgically assisted rapid palatal expansion with and without pterygomaxillary disjunction on dental and skeletal structures: A retrospective review. Oral Surg. Oral Med. Oral Pathol. Oral Radiol. 2013, 115, 167–174. [Google Scholar] [CrossRef]
- Koudstaal, M.J.; Poort, L.J.; van der Wal, K.G.; Wolvious, E.B.; Prahl-Andersen, B.; Schulten, A.J. Surgically assisted rapid maxillary expansion (SARME): A review of the literature. Int. J. Oral Maxillofac. Surg. 2005, 34, 709–714. [Google Scholar] [CrossRef]
- Hamedi Sangsari, A.; Sadr-Eshkevari, P.; Al-Dam, A.; Friedrich, R.E.; Freymiller, E.; Rashad, A. Surgically assisted rapid palatomaxillary expansion with or without pterygomaxillary disjunction. A systematic review and meta-analysis. J. Oral Maxillofac. Surg. 2016, 74, 338–348. [Google Scholar] [CrossRef]
- Buck, L.M.; Dalci, O.; Darendeliler, M.A.; Papadopoulou, A.K. Effect of surgically assisted rapid maxillary expansion on upper airway volume: A systematic review. J. Oral Maxillofac. Surg. 2016, 74, 1025–1043. [Google Scholar] [CrossRef]
- Boutron, I.; Page, M.J.; Higgins, J.P.T.; Altman, D.G.; Lundh, A.; Hróbjartsson, A. Chapter 7: Considering bias and conflicts of interest among the included studies. In Cochrane Handbook for Systematic Reviews of Interventions, version 6.1 (updated September 2020); Higgins, J.P.T., Thomas, J., Chandler, J., Cumpston, M., Li, T., Page, M.J., Welch, V.A., Eds.; Cochrane: London, UK, 2020. [Google Scholar]
- Sterne, J.A.C.; Hernán, M.A.; Reeves, B.C.; Savović, J.; Berkman, N.D.; Viswanathan, M.; Henry, D.; Altman, D.G.; Ansari, M.T.; Boutron, I.; et al. ROBINS-I: A tool for assessing risk of bias in non-randomised studies of interventions. BMJ 2016, 355, i4919. [Google Scholar] [CrossRef] [Green Version]
- Antonini, F.; da Costa, D.J.; de Moares, R.S.; Rebellato, N.L.; Kluppel, L.E.; Parente, E.V. Analysis of the incision effects on upper lip height and thickness after maxillary surgically assisted expansion: A randomized Clinical Trial. J. Oral Maxillofac. Surg. 2013, 71, 1757.e1–1757.e7. [Google Scholar] [CrossRef]
- Nada, R.M.; van Loon, B.; Maal, T.J.; Berge, S.J.; Mostafa, Y.A.; Kuijpers-Jagtman, A.M. Three-dimensional evaluation of the soft tissue changes in the orofacial region after tooth-borne surgically assisted rapid maxillary expansion. Clin. Oral Investig. 2013, 17, 2017–2024. [Google Scholar] [CrossRef]
- Nada, R.M.; van Loon, B.; Schols, J.G.J.H.; Maal, T.J.J.; de Koning, M.J.; Mostafa, Y.A.; Kuijpers-Jagtman, A.M. Volumetric changes of the nose and the nasal airway 2 years after tooth-borne and bone-borne surgically assisted rapid maxillary expansion. Eur. J. Oral Sci. 2013, 121, 450–456. [Google Scholar] [CrossRef]
- Filho, H.N.; Goncales, E.S.; Berrentin-Felix, G.; de Souza Cesar, U.; Achja, G.L. Evaluation of the facial soft tissues following surgically assisted maxillary expansion associated with the simple V-Y suture. Int. J. Adult Orthodon. Orthognath. Surg. 2002, 17, 89–97. [Google Scholar]
- Gungor, A.Y.; Türkkahraman, H.; Baykul, T.; Alkis, H. Comparison of the effects of rapid maxillary expansion and surgically assisted rapid maxillary expansion in the sagittal, vertical and transverse planes. Med. Oral Patol. Oral Cir. Bucal 2012, 17, e311–e319. [Google Scholar] [CrossRef] [Green Version]
- Berger, J.L.; Pangrazio-Kulbersh, V.; Thomas, B.W.; Kaczynski, R. Photographic analysis of the facial changes associated with maxillary expansion. Am. J. Orthod. Dentofac. Orthop. 1999, 116, 563–571. [Google Scholar] [CrossRef]
- Metzler, P.; Geiger, E.J.; Chang, C.C.; Steinbacher, D.M. Surgically assisted maxillary expansion imparts three-dimensional nasal change. J. Oral Maxillofac. Surg. 2014, 72, 2005–2014. [Google Scholar] [CrossRef]
- Magnusson, A.; Bjerklin, K.; Kim, H.; Nilsson, P.; Marcusson, A. Three-dimensional computed tomographic analysis of the changes to the external features of the nose after surgically assisted rapid maxillary expansion and orthodontic treatment: A prospective longitudinal study. Am. J. Orthod. Dentofac. Orthop. 2013, 144, 404–413. [Google Scholar] [CrossRef]
- Ramieri, G.A.; Nasi, A.; Dell’acqua, A.; Verze, L. Facial soft tissue changes after transverse palatal distraction in adult patients. Int. J. Oral Maxillofac. Surg. 2008, 37, 810–818. [Google Scholar] [CrossRef]
- Bita, R.; Urtila, F.; Brad, S.; Crisan, R.; Crisan, A.; Balan, R.; Ogodescu, A.; Rivis, M.; Talpos, S. Evaluation of the alar base width of patients submitted to surgically assisted maxillary expansion. Med. Evol. 2011, 17, 458–462. [Google Scholar]
- De Assis, D.S.; Duarte, M.A.; Goncales, E.S. Clinical evaluation of the alar base width of patients submitted to surgically assisted maxillary expansion. Oral Maxillofac. Surg. 2010, 14, 149–154. [Google Scholar] [CrossRef]
- Zupan, J.; Ihan Hren, N.; Verdenik, M. An evaluation of three-dimensional facial changes after surgically assisted rapid maxillary expansion (SARME): An observational study. BMC Oral Health 2022, 22, 155. [Google Scholar] [CrossRef]
- Karabiber, G.; Yılmaz, H.N. Does unilateral surgically assisted rapid maxillary expansion (SARME) lead to perinasal asymmetry? J. Orofac. Orthop. 2021. [Google Scholar] [CrossRef]
- Dias, R.R.; Takeshita, W.M.; Sverzut, A.T.; Trivellato, A.E.; Sverzut, C.E. Linear analysis of the nasal septum in patients treated with surgically assisted rapid maxillary expansion. Am. J. Orthod. Dentofac. Orthop. 2021, 159, 71–80. [Google Scholar] [CrossRef]
- Jesus, A.S.; Oliveira, C.B.; Murata, W.H.; Gonçales, E.S.; Pereira-Filho, V.A.; Santos-Pinto, A. Nasomaxillary effects of miniscrew-assisted rapid palatal expansion and two surgically assisted rapid palatal expansion approaches. Int. J. Oral Maxillofac. Surg. 2021, 50, 1059–1068. [Google Scholar] [CrossRef]
- Jayrante, Y.S.; Zwahlen, R.A.; Lo, J.; Cheung, L.K. Facial soft tissue response to anterior segmental osteotomies: A systematic review. Int. J. Oral Maxillofac. 2010, 39, 1050–1058. [Google Scholar]
- Joss, C.U.; Joss-Vassalli, I.M.; Kiliaridis, S.; Kujipers-Jagtman, A.M. Soft tissue profile changes after bilateral sagittal split osteotomy for mandibular advancement: A systematic review. J. Oral Maxillofac. Surg. 2010, 68, 1260–1269. [Google Scholar] [CrossRef]
- San Miguel Moragas, J.; Van Cauteren, W.; Mommaerts, M.Y. A systematic review on the soft-to-hard tissue ratios in orthognathic surgery part I: Maxillary repositioning osteotomy. J. Cranio-Maxillofac. Surg. 2014, 42, 1341–1351. [Google Scholar] [CrossRef]
Database | MESH Terms | Limits | |
---|---|---|---|
MEDLINE via PubMed | 1 | orthodont * | No Limits |
2 | SARPE | ||
3 | SARME | ||
4 | “surgically assisted rapid palatal expansion” | ||
5 | “surgically assisted rapid maxillary expansion” | ||
6 | “surgically assisted palatal suture expansion” | ||
7 | “surgical palatal suture expansion” | ||
8 | ‘’transpalatal AND distract *’’ | ||
9 | 2 OR 3 OR 4 OR 5 OR 6 OR 7 OR 8 | ||
10 | 1 AND 9 | ||
Scopus | 9 | No Limits | |
Google Scholar | 10 | English | |
Cochrane library | 9 | No Limits | |
ProQuest | 10 | No Limits |
Category | Inclusion Criteria | Exclusion Criteria |
---|---|---|
Participants | Human studies on healthy participants of any age, gender, angle classification, and skeletal pattern | Craniofacial syndromes, cleft lip and palate |
Systematic disease | ||
Intervention | SARPE as a surgical method | Combination of surgical procedures |
Comparison | Any other type of treatment as a control group (e.g., orthodontics without SARPE) | No exclusion criteria concerning the “comparisons” |
Untreated control groups | ||
No control groups (before–after studies, repeated measures designs) | ||
Outcome | Facial soft tissue evaluation on any plane of space | Only hard tissue evaluation |
Principal Outcome Measure | Measurements concerning soft tissue changes via photographs, cephalometrics, CBCTs, etc. | Lack of records prior to or post SARPE |
Study design | Randomized clinical trials | Congress material |
Non-randomized clinical trials | Expert opinions | |
Retrospective cohorts | Comments | |
Case-control studies | Letters to the editors | |
Prospective before–after studies | In vitro studies | |
Retrospective before–after studies | Animal studies | |
Case reports | ||
Narrative reviews * | ||
Systematic reviews * | ||
Meta-analyses * |
Study | Outcomes | Outcome Measures | Time of Measuring | Main Findings |
---|---|---|---|---|
Bita et al., 2011 [26] | Transversal nasal measurements | Alar width measured directly with a caliper | T0: preoperative T1: at 2 months T2: at 6 months T3: at 12 months postoperatively | Postoperative growth of the alar base ranging from 3.12 to 3.48 mm for females and from 3.43 to 3.65 mm for males. The nasolabial angle grew by about 2 degrees. |
Ramieri et al., 2008 [25] | Facial soft tissue measurements on all 3 planes of space | Various linear and angular measures via 3D facial laser scanning | T0: before transverse palatal distraction (TPD) T1: 6 months T2: 1 year after TPD | TPD produces mean facial changes (1–2 mm) in the cheek and paranasal areas as well as in the nasal base in the transverse plane only. Changes are more evident at 6 months and remain stable at 1 year postoperatively. |
Metzler et al., 2014 [23] | Nasolabial measurements on all 3 planes of space | Various liner and angular measurements via 3D photogrammetry | T0: preoperative T1: at least 6 months postoperatively | 1. Significant decrease in nasofrontal angle and upward rotation of nasal tip. 2. Significant increase in alar width, alar base width and nasal sill width. 3. Stable lip dimensions. |
Rubim de Assis et al., 2010 [27] | Transversal nasal measurements | Alar width measured directly with a caliper | T0: preoperative T1: 2 months T2: 6 months T3: 24 months T4: 36 months postoperatively | No statistically significant differences. |
Gungor et al., 2012 [21] | Sagittal nasolabial measurements | Measurements on lateral cephalometric radiographs | T0: before expansion T1: after expansion (unspecified) | Significant postoperative decrease in soft tissue convexity angle; significant increases in upper and lower nasal width as well as in the anterior face height. |
Filho et al., 2002 [20] | Nasolabial measurements on all 3 planes of space | Various lateral vertical or sagittal cephalometric measurements; clinical transversal measurements (caliper): alar base | T0: immediately preoperative T1: minimum 6 months postoperatively | 1. SARPE tends to position the upper lip posteriorly, without important vertical alterations. 2. The V-Y suture seems to minimize this effect. 3. Absence of alar base suture widens the nasal base, regardless of the type of suture applied over the mucosa. |
Berger et al., 1999 [22] | Vertical and transverse facial soft tissue measurements | All measurements made on calibrated photographs | T0: before any treatment was rendered T1: bonding; immediately after the appliance was bonded and before any expansion T2: end of expansion; on the day of completion of orthopedic or surgical expansion T3: debonding; immediately after removal of the appliance T4: retention; 1 year after appliance removal | 1. Soft tissue nasal width increased by 2.0 mm during treatment. Both the orthopedic and surgical groups maintained this increase throughout the whole length of the observation period. 2. Overall face height, intercanthal distance, average eye width, and nose length did not change over time. |
Magnusson et al., 2013 [24] | Nasolabial measurements on all 3 planes of space | Measurements from various nasolabial landmarks on CBCT | T0: 1 week before surgery T1: at the end of the active orthodontic treatment phase (on average, 18 months postoperatively) | 1. Significant widening and overall anterior and inferior displacement of all nasomaxillary soft tissues. 2. Various displacements that rounded the shape of the nose in the frontal view. 3. Significant widening of the nostrils and an increase in nostril area. |
Nada et al., 2013 [18] | 3D evaluation of maxillary soft tissue measurements | Measurements from various nasolabial landmarks on CBCT | T0: before treatment T1: after the 1st and before the 2nd surgical procedure (22 ± 7 months after T0) | 1. SARME with tooth-borne or bone-borne expansion appliances induced comparable orofacial soft tissue changes. 2. Slight postoperative retro-positioning of the upper lip and increased projection of the cheeks. |
Nada et al., 2013 [19] | Transversal nasal measurements | Alar width measured on 3-D photographs | T0: before treatment T1: after the 1st and before the 2nd surgical procedure (21.7 ± 6.6 months for the Hyrax group and 22.6 ± 6.9 months for the TPD group) | No statistically significant differences. |
Antonini et al., 2013 [17] | Sagittal and vertical labial measurements | Measurement on lateral cephalometric radiographs and clinically via a caliper | T0: preoperative T1: 6 months postoperatively | 1. Upper lip shortening. 2. Thinning of the upper portion. |
Zupan et al., 2022 [28] | 3D evaluation of maxillary soft tissue measurements | Measurements from various anatomical landmarks (cephalometric points) and regional best-fit method (forehead, supraorbital, and nasal root regions were selected for the superimposition) from 3D scans | T0: preoperative T1: postoperative | 1. Increase in the paranasal and cheek areas. 2. Increased nasal width. 3. Decreased upper-face height with an unchanged lower height. 4. Increased vertical philtrum height. 5. Increased nasolabial angle. 6. Increase in the facial profile angle, resulting in an increased facial convexity and anterior displacement of the upper-lip area. |
Karabiber and Yilmaz, 2021 [29] | Soft tissue assessment; Anterior nasal airway | Linear soft tissue measurements on tereophotogrammetric images for soft tissue assessment; measurements using cone beam computed tomography (CBCT) to evaluate the anterior nasal airway. | T0: before treatment T1: 6 months after expansion | 1. Soft tissue distances of the alar base and alar to midsagittal plane (MSP) were increased on the cross bite (C) side. 2. A significant decrease in the distance from the lower nostril point to the midsagittal plane (MSP) on the non-cross bite (NC) side compared to a significant increase on the C side. 3. Significantly higher changes on the C side for all parameters except the upper nostril point to the MSP distance. Cheek volume was significantly higher on the C side. 4. Volume changes of the anterior nasal airway were significantly increased on the C side. |
Dias et al., 2021 [30] | Nasal septum measurements | Various linear nasal septum measurements | T0: preoperative T1: immediately postoperative T2: late postoperative | No statistically significant differences. |
Jesus et al., 2021 [31] | Soft tissue nasomaxillary measurements | Various nasal soft tissue measurements using CBCT | T0: before expansion T1: 1 to 2 months after stopping the active expansion of MARPE | 1. MARPE uniformly increased the anterior and posterior widths of the nasal cavity. 2. Nasal width did not differ significantly between the groups. |
Studies | Bita et al., 2011 [26] | Ramieri et al., 2008 [25] | Metzler et al., 2014 [23] | Rubim de Assis et al., 2010 [27] | Magnusson et al., 2013 [24] |
---|---|---|---|---|---|
Criteria | |||||
1. Was the study question or objective clearly stated? | Yes | Yes | Yes | Yes | Yes |
2. Were eligibility/selection criteria for the study population pre-specified and clearly described? | No | Yes | Yes | Yes | Yes |
3. Were the participants in the study representative of those who would be eligible for the test/service/intervention in the general or clinical population of interest? | Yes | Yes | Yes | Yes | Yes |
4. Were all eligible participants that met the pre-specified entry criteria enrolled? | CD | CD | CD | CD | CD |
5. Was the sample size sufficiently large to provide confidence in the findings? | CD | CD | CD | CD | CD |
6. Was the test/service/intervention clearly described and delivered consistently across the study population? | Yes | Yes | Yes | Yes | Yes |
7. Were the outcome measures pre-specified, clearly defined, valid, reliable, and assessed consistently across all study participants? | Yes | Yes | Yes | Yes | Yes |
8. Were the people assessing the outcomes blinded to the participants’ exposures/interventions? | No | No | No | No | No |
9. Was the loss to follow-up after baseline 20% or less? Were those lost to follow-up accounted for in the analysis? | CD | CD | CD | CD | CD |
10. Did the statistical methods examine changes in outcome measures from before to after the intervention? Were statistical tests conducted that provided p values for the pre-to-post changes? | No | Yes | Yes | Yes | No |
11. Were outcome measures of interest taken multiple times before the intervention and multiple times after the intervention (i.e., did they use an interrupted time-series design)? | No | No | No | No | No |
12. If the intervention was conducted at a group level (e.g., a whole hospital, a community, etc.), did the statistical analysis take into account the use of individual-level data to determine effects at the group level? | NA | NA | NA | NA | NA |
Yes/No/Other (CD, NR, NA) * |
Studies | Gungor et al., 2012 [21] | Filho et al., 2002 [20] | Berger et al., 1999 [22] | Nada et al., 2013 [18] | Nada et al., 2013 [19] | Zupan et al., 2022 [28] | Karabiber et Yilmaz 2021 [29] | Dias et al., 2021 [30] | Jesus et al., 2021 [31] |
---|---|---|---|---|---|---|---|---|---|
Bias due to confounding | Serious | Serious | Serious | Moderate | Serious | Serious | Serious | Serious | Serious |
Bias in selection of participants for the study | Low | Low | Low | Low | Low | Low | Low | Low | Low |
Bias in classification of interventions | Low | Low | Low | Low | Low | Low | Low | Low | Low |
Bias due to departures from intended interventions | Low | Low | Low | Low | Low | Low | Low | Low | Low |
Bias due to missing data | Low | Low | Low | Low | Low | Low | Low | Low | Low |
Bias in measurement of outcomes | Low | Low | Low | Low | Low | Low | Low | Low | Low |
Bias in selection of the reported result | Low | Low | Low | Low | Low | Low | Low | Low | Low |
Overall RoB | Serious | Serious | Serious | Moderate | Serious | Serious | Serious | Serious | Serious |
Study | Antonini et al., 2013 [17] |
---|---|
Random sequence generation (selection bias) | Low |
Allocation concealment (selection bias) | Unclear |
Blinding of participants and personnel (performance bias) | Unclear |
Blinding of outcome assessment (detection bias) | Unclear |
Incomplete outcome data addressed (attrition bias) | Low |
Selective reporting (reporting bias) | Low |
Summary | Unclear |
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. |
© 2022 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Vogiatzis, F.; Roussos, P.; Doulis, I.; Palikaraki, G.; Christopoulos, P.; Sifakakis, I. Effects of Surgically Assisted Rapid Palatal Expansion on Facial Soft Tissues: A Systematic Review. Appl. Sci. 2022, 12, 11859. https://doi.org/10.3390/app122211859
Vogiatzis F, Roussos P, Doulis I, Palikaraki G, Christopoulos P, Sifakakis I. Effects of Surgically Assisted Rapid Palatal Expansion on Facial Soft Tissues: A Systematic Review. Applied Sciences. 2022; 12(22):11859. https://doi.org/10.3390/app122211859
Chicago/Turabian StyleVogiatzis, Fotis, Petros Roussos, Ioannis Doulis, Georgia Palikaraki, Panagiotis Christopoulos, and Iosif Sifakakis. 2022. "Effects of Surgically Assisted Rapid Palatal Expansion on Facial Soft Tissues: A Systematic Review" Applied Sciences 12, no. 22: 11859. https://doi.org/10.3390/app122211859
APA StyleVogiatzis, F., Roussos, P., Doulis, I., Palikaraki, G., Christopoulos, P., & Sifakakis, I. (2022). Effects of Surgically Assisted Rapid Palatal Expansion on Facial Soft Tissues: A Systematic Review. Applied Sciences, 12(22), 11859. https://doi.org/10.3390/app122211859