Next Article in Journal
A Proposed Method to Evaluate the Effect of Changing the Kerfing Parameters upon the Static Bending Behavior of Flexible Plywood Panels Cut by Laser
Next Article in Special Issue
Three-Dimensional Analysis of Bone Volume Change at Donor Sites in Mandibular Body Bone Block Grafts by a Computer-Assisted Automatic Registration Method: A Retrospective Study
Previous Article in Journal
Understanding Safety Performance of Prefabricated Construction Based on Complex Network Theory
Previous Article in Special Issue
Evaluating the Checklist for Artificial Intelligence in Medical Imaging (CLAIM)-Based Quality of Reports Using Convolutional Neural Network for Odontogenic Cyst and Tumor Detection
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Evaluation of the Predictability and Accuracy of Orthognathic Surgery in the Era of Virtual Surgical Planning

by
Marta María Pampín Martínez
1,*,
Alessandro Gutiérrez Venturini
2,
Jorge Guiñales Díaz de Cevallos
1,
María Barajas Blanco
1,
Iñigo Aragón Niño
1,
Alvaro Moreiras Sánchez
1,
José Luis del Castillo Pardo de Vera
1 and
José Luis Cebrián Carretero
1,3
1
Oral and Maxillofacial Surgery Department, Hospital Universitario La Paz, Paseo de la Castellana 261, 28046 Madrid, Spain
2
Fundación Para la Investigación Biomédica del Hospital Universitario La Paz, Calle de Pedro Rico 6, 28029 Madrid, Spain
3
Hospital La Luz, Calle del Maestro Ángel Llorca 8, 28003 Madrid, Spain
*
Author to whom correspondence should be addressed.
Appl. Sci. 2022, 12(9), 4305; https://doi.org/10.3390/app12094305
Submission received: 18 March 2022 / Revised: 10 April 2022 / Accepted: 13 April 2022 / Published: 24 April 2022
(This article belongs to the Special Issue Computer Technologies in Oral and Maxillofacial Surgery)

Abstract

:
Virtual surgical planning allows orthognathic surgeons to design a surgical plan preoperatively and establish a personalized surgical protocol. This study aims to validate the predictability and accuracy of orthognathic surgery through a comparison of the three-dimensional (3D) models of the virtual planning and postoperative CBCT using free software (3D Slicer) on 40 patients who underwent bimaxillary orthognathic surgery. The distances of point A, point B, pogonion (Pog), and the first upper and lower molars, both in each axis (x, y, and z) and in the 3D space, were analyzed. The median of the distances in the mediolateral direction was the lowest, while the highest differences were found at point A and Pog in the anteroposterior direction (0.83 mm and 0.78 mm, respectively). Vertical differences were higher in the maxilla than in the mandible. In conclusion, we found that orthognathic bimaxillary surgery using virtual surgical planning was more accurate when positioning the bone segments in the mediolateral direction, using the information provided by the splint, as well as when positioning the mandible compared to the maxilla.

1. Introduction

Success in orthognathic surgery depends not only on the technical aspects of the operation but to a larger extent on the formulation of a precise surgical plan, consistency, and capability of achieving predictable and stable results [1]. Technological advances have been developed in the last few decades to improve surgery: intraoperative navigation, imaging software, CAD-CAM technologies, three-dimensional (3D) printing, augmented reality, etc. These technologies help shorten preoperative surgical planning, and then this information is transferred to the operative setting through CAD/CAM splints, navigation, or surgical guides, reducing overall surgical time.
Virtual surgical planning has facilitated accurate diagnoses and detailed treatment planning through better visualization of 3D phenotypic changes [2], allowing for a precise preoperative surgical plan using a computerized 3D environment. In addition, over the past 10 years, the development of 3D printed models and patient-specific guides has improved surgical planning as well as the transfer of the surgical plan into the operating room for better surgical results [3].
Conventional planning of orthognathic surgery was conducted based on a radiographic cephalometric analysis and mock surgery on plaster-cast dental models mounted in a semi-adjustable articulator [4]. Data were obtained from different studies (radiographs, models and articulators, face bow, etc.) and were interpreted before being able to develop a treatment plan [5]. This cast model-based surgery is complex and arduous, and difficulties may be encountered when correcting occlusal cant and facial asymmetries.
The development of computer-aided surgical simulation represented a paradigm shift in surgical planning for patients with cranio-maxillofacial deformities. When using 3D planning, all the necessary information is provided in images that can be manipulated on a computer. Three-dimensional imaging-based planning systems enable the surgeon to establish necessary osteotomy planes preoperatively and assess different surgical scenarios [1]. Since this is done virtually, surgery is performed in a more predictable way.
The surgical occlusion set-up is a vital step in virtual planning for orthognathic surgery [2] using intraoral scanning and a full digital set-up. With 3D printing, this information is transferred to the operating room. The clinical applications of 3D printers in orthognathic surgery include the production of occlusal splints, osteotomy/cutting guides, repositioning guides, spacers, fixation plates/implants, and 3D printed models [3]. Most studies have agreed that CAD/CAM occlusal splints with no modifications compared to traditionally manufactured occlusal splints provided a reliable substitute in orthognathic surgery [3]
There are many commercially available software programs for virtual surgical planning and simulation [6]. However, surgical planning may not necessarily reflect the actual surgical outcomes, and its accuracy and predictability must be established.
Most of the methods that have been proposed to assess the accuracy of the postoperative outcome versus the 3D surgical planning in the literature are based on the identification of cephalometric landmarks and computation of the differences between the planning model and the actual result [7].
The purpose of this study was to evaluate predictability in orthognathic surgery and the accuracy of surgical outcomes using virtual surgical planning. The postoperative results of bimaxillary orthognathic patients were compared to the preoperative virtual surgical plan using different commercially available software.

2. Materials and Methods

2.1. Patient Data Collection

A retrospective study was designed to analyze the predictability of orthognathic surgery in the era of virtual surgical planning, comparing the postoperative results to the preoperative virtual planning. Inclusion criteria included the following: patients who underwent bimaxillary orthognathic surgery at the Maxillofacial Surgery Department of Hospital Universitario La Paz (Madrid, Spain) between October 2017 and December 2019; Le Fort I osteotomy and bilateral sagittal split osteotomy (BSSO) were performed; virtual planning models and a postoperative CBCT within 1-month post-surgery were available. Therefore, patients with unavailable 3D models of the virtual planning, patients without postoperative CBCT, patients who received a TMJ total prosthesis, and patients who had osteotomy different from a Le Fort I and BSSO were excluded. The main outcome variable was the distance (in mm) between the virtual plan and the actual surgical results obtained in selected cephalometric points in the three axes (x, y, z) at point A, point B, pogonion (Pog), both upper first molars, and both lower first molars.
A total of 40 patients (29 women and 11 men) that satisfied the inclusion criteria were selected. The mean age was 29 years, ranging from 17 to 55 years. Informed consent was obtained from all subjects involved in the study, and no conflicts of interest are reported by the authors.

2.2. Surgical Protocol

The patients received a standard orthognathic workup, including alginate impressions, facial analysis, preoperative CBCT in centric relation, and photographs. A virtual meeting was held by the surgeons to discuss the surgical plan with the prosthodontist. The surgical virtual planning was then created using Dolphin Imaging (v 11.9, Dolphin Imaging & Management Solutions, Chatsworth, CA, USA) and surgical splints were designed and printed.
Surgery was always performed in a mandible-first sequence. It has been stated that a mandible-first sequence allows the surgeon to achieve a more predictable position due to the elimination of errors related to an incorrect centric relation. Special attention to properly seating the condyles in the fossa should be paid during the stabilization of the proximal segment of the mandible and fixation. The authors’ preference is not to use the final splint when possible, and the maxilla is positioned according to correct dental interdigitation and occlusion, therefore eliminating interferences from the splint. However, a palatal splint is used in cases of segmental maxillary surgery.
The vertical position was controlled by the surgeon using a reference screw at the nasion. Osteosynthesis in the mandible was performed with a four-screw linear plate and a bicortical screw and four L-type plates on the maxilla. Postoperative antibiotics were administered, and a postoperative X-ray was performed to check for adequate condyle and plate and screw positions. Finally, a postoperative CBCT was taken within 1-month post-surgery. The preoperative CBCT, virtual planning, and postoperative CBCT models can be seen in Figure 1.

2.3. Distance Measurement

For this retrospective study, first, a group of relevant cephalometric points to calculate the differences between the planning and postoperative results were selected, similarly to previous publications [4,8,9]. These included: point A, point B, pogonion, both maxilla first molars, and both mandibular first molars (all molar landmarks were selected at the bone margin).
Then, the DICOM files of the postoperative CBCT were imported into 3D Slicer (v 4.10.2, https//www.slicer.org/, accessed on 19 October 2021) [10] and segmented using a threshold algorithm.
A 3D virtual model of the bone was generated in STL format, which was further refined and trimmed using Meshmixer (v 3.5, Autodesk Inc., Mill Valley, CA, USA) for an improved comparison to the virtual planning model. Then, both planning and postoperative STL models were loaded into 3D Slicer for superimposition.
Several articles have reported the use of 3D Slicer in different studies, with good results and satisfactory performance for both the segmentation and superimposition of 3D models, and its validity has been established [11,12,13].
First, a gross approximation was done using the “Transforms” tool (Figure 2), to initialize the algorithm. Then, the “Surface registration” tool was used for the superimposition of both models. For this registration, the program uses an iterative closest point (ICP) algorithm, using the planning model as a reference. This superimposition was performed based on a subvolume that comprised the anterior cranial base to compare only those structures affected by the surgery.
Once the superimposition was complete, the “Model to model distance” tool was used to calculate the distance between both models. In the data input, the postoperative model is defined as the “source” and the virtual planning as the “target”, i.e., the reference. This method measures the Hausdorff distance of the postoperative model to the planning model and generates a color-coded distance map, similar to other publications [14,15,16].
The “Shape Population Viewer” tool displays a color-coded map. Here, the generated color-coded map shows the corresponding signed distances in different colors attending to the sign and magnitude of this value. In particular, a continuous color scale was defined ranging from blue (−4 mm) to red (+4 mm), where green stays for 0 mm. Positive colors (yellow–red) depict regions of the model that are in front of the reference surface (indicating outward movements), while negative colors (blue) indicate areas that are behind the reference surface (meaning backward movements). In Figure 3, an example of a color map is presented, showing the distances from the postoperative model to the virtual planning model. The cranial base appearing green (i.e., a 0 mm distance) indicates that the quality of the superimposition is good.
The VTK file of the postoperative model containing the information of the computed distances was exported to the open-source visualization software Paraview (v 5.8.1, Kitware, Inc., New York, NY, USA) [17]. Then, the “Hover points on” tool was used to display the information of the distances of the cephalometric points selected in the three axes: “x” (mediolateral), “y” (anteroposterior), and “z” (inferosuperior) (Figure 4). The 3D distances for the following cephalometric points were also calculated: point A, point B, and Pog. For both the upper and lower first molars, only the mediolateral distances (x axis) were computed.
A workflow schematic figure is displayed in Figure 5.

2.4. Statistical Analysis

First, we analyzed if our population followed a normal distribution using the Kolmogorov–Smirnov test. A non-normal distribution was followed for most data, so non-parametric tests were decided. The distances in the three axes were collected for all patients at points A, B, and pogonion, and then the median and 25th and 75th percentiles of these values for all cephalometric points were computed. The median absolute 3D vector distance between the postoperative result and the virtual planning model was calculated. Again, the Kolmogorov–Smirnov test was performed, and only point A followed a normal distribution; thus, we calculated the mean and 25th and 75th percentiles of these data. In the multivariate analysis, the weight of each axis on the overall 3D absolute distance was calculated, and the Wilcoxon signed rank test was performed to see if the differences in the 3D values for each landmark were statistically significant with respect to the others.

2.5. Ethics Committee

This study was approved by the Ethics in Investigation Committee of Hospital La Paz (CEIm) on 25 March 2021. The approval code is 1296046516634121300594.

3. Results

Table 1 shows the median and the 25th and 75th percentiles of the differences between the virtual planning and postoperative results for each cephalometric point in the three axes for all patients. The median distances are also displayed in Figure 6.
The overall analysis showed good accuracy, with all median differences below 1 mm. The highest median differences were seen at point A and Pog in the anteroposterior direction, which were 0.835 mm and 0.780 mm, respectively.
The highest accuracy was observed at point B and Pog in the mediolateral direction (0.070 mm and 0.079 mm, respectively), followed by point B in the vertical direction (0.150 mm). The overall accuracy in the mediolateral direction was very good for all cephalometric points. The differences in the bone margin over the upper first molars were slightly higher compared to the mandibular first molars: 0.770 mm and 0.665 mm for the right and left upper first molars, and 0.310 mm and 0.580 mm for the right and left lower molars, respectively.
Then, we computed the absolute 3D distance for point A, point B, and Pog. The median and 25th and 75th percentiles for such values were calculated and are presented in Table 2. The median 3D values for point A, point B, and Pog were 0.934 mm, 0.613 mm, and 1.034 mm, with the highest differences found at Pog.
Furthermore, we calculated the weight of each axis to the overall 3D distance using multivariate analysis for point A, point B, and Pog (Figure 7). For point A, the axis that weighed the most was the y axis (anteroposterior), with a coefficient of 0.885 (meaning that for each unit that the distance increased in the y axis, the 3D distance increased by 0.885 mm), which was statistically significant (p < 0.001). For point B, it was the z axis (vertical) that had the most influence on the 3D distance, with a coefficient of 0.813, which was also statistically significant (p < 0.001). In the case of Pog, the highest input was given by the y axis as well (anteroposterior), with a coefficient of 0.726, which was statistically significant (p < 0.001).

4. Discussion

Virtual surgical planning enables the precise analysis of a 3D model that represents the clinical situation and facilitates diagnosis and treatment planning [18,19]. Since Swennen [19] initiated 3D cephalometric analysis and treatment planning, 3D virtual planning has replaced 2D cephalometric analysis.
Recent trends in orthognathic surgery have evolved to minimize the period of preoperative orthodontic treatment and to combine 3D technology in the process of surgical planning to improve accuracy [2]. Several technological advances are being used widely to reduce preoperative planning and surgical operating time, including CAD/CAM technologies, 3D printing, intraoperative navigation, and augmented reality. Using 3D virtual models, all the procedures for diagnosis and surgical splint production can be simulated, intermediate assessment can be conducted, and the intermediate and final surgical splints can be produced. Therefore, errors encountered during laboratory procedures are minimal [20].
Virtual surgical planning has facilitated accurate diagnoses and detailed treatment planning through better visualization of 3D phenotypic changes [2]. In addition, virtual surgical planning allows for soft tissue evaluation and prediction. Available virtual planning software, such as Dolphin (Dolphin Imaging & Management Solutions, Chatsworth, CA, USA) or Maxilim (Medicim NV, Mechelen, Belgium), allow for an approximate prediction of the soft tissue response after maxillomandibular repositioning as a simple geometric transformation, not considering accurate mechanical modeling and tissue properties.
Multiple studies have analyzed computational models of soft tissue prediction in orthognathic surgery, using complex finite element analyses and algorithms.
Alcañiz et al. [21] studied 10 patients who underwent orthognathic surgery and presented a simulation methodology for the planning of orthognathic surgical interventions, paying special attention to soft tissue simulation. The handling of several tissue couplings, i.e., soft tissue and bone, demonstrated a high complexity, which requires high-resolution meshes and long computation times to ensure accurate results. Furthermore, they found a tendency toward negative/cold errors, which was slightly higher on coarse meshes.
Furthermore, the use of 3D printed surgical guides and pre-bended fixation plates on 3D printed models based on virtual surgical planning increases the accuracy of the performed osteotomies and repositioning of the bone segments, shortening surgical time and improving the overall surgical results [2,3]. The use of 3D printers in orthognathic surgery is widely extended and includes the production of splints, surgical guides, pre-bend plates, patient-specific implants and plates, and 3D models. Compared to the traditional method, the digital-based occlusal splint provides high accuracy, reliability, and consistency, as well as improved quantitative control and efficiency [3].
Numerous studies have demonstrated that 3D printing technologies help the clinician shorten the operative time, increase surgical safety, and improve the predictability of surgical outcomes [3]. Hernandez-Alfaro et al. [22] used an intraoral digital scanner to obtain surface images of the dental arches. After fusing the scans with the CBCT images of the patients for CAD/CAM intermediate splint generation, the accuracy and reliability of the protocol were assessed, showing an error below 1.5 mm between the virtual intermaxillary position and the intraoperative intermaxillary relationship and revealing a high overall accuracy.
Lin et al. [3] performed a systematic review regarding applications of 3D printed technology in orthognathic surgery. They identified 78 articles where different applications were described. They found that most articles described the use of occlusal splints, osteotomy/cutting guides, positioning guides, spacers, fixations plates/implants, and 3D printed models. This technology was demonstrated to be beneficial to both the clinician and the patient, reducing the preoperative planning time and overall surgical time.
A surgical plan and surgical splint generated by a computer have the advantage that they can be shared with engineers from a Computer-Aided Design/Computer-Aided Manufacturing (CAD/CAM) center through the internet. Surgical splints can be fabricated by an additive manufacturing or milling technique and applied during surgery to transfer the virtual surgical planning to the operating field. For occlusal splints, previous studies have proposed the use of CAD/CAM occlusal splints as a reliable substitution to address the flaws of laboratory-based methods, including non-controllable errors, inter-laboratory differences, high costs, and time inefficiency [3].
Nevertheless, differences still exist between the virtual planning and surgical execution due to the complexity of movements and transfer of data throughout splints from the virtual planning to the surgery. The reliability and predictability of virtual surgical planning must be tested.
In the literature, many studies have tried to evaluate the accuracy of virtual planning in orthognathic surgery using different protocols. These protocols and methodologies vary from linear/angular measurements, surface-to-surface differences, or virtual triangles. The most frequently used approach is linear and angular measurements, which rely on accurately identifying cephalometric landmarks and are prone to human error, especially when it must be done both on the preoperative and postoperative model [23]. Color-coded distances maps are visual analytical tools that display the distance between two 3D surface meshes and are generally included in most software.
Tucker et al. [16] evaluated the accuracy of virtual planning based on the surface distance differences between the plan and the actual outcome on 11 different regions of the maxilla and mandible. The method was done using a surface-to-surface best fit of the two virtual models, aligning the base of the skull and measuring the distance between the planned and actual outcome post-operatively. They found no statistically significant difference between the simulated and the actual surgical models in all 11 regions of interest, with distances of less than 0.5 mm except for the left lateral maxilla (0.536 mm).
In 2016, Zhang et al. [24] analyzed the accuracy of virtual surgical planning and 3D printed surgical templates in orthognathic bimaxillary surgery in 30 patients. They studied the linear and angular differences in different cephalometric points. The mean linear difference was 0.81 mm and the overall mean angular difference was 0.95 degrees. Furthermore, they found that 3D printed surgical templates worked better on the maxilla than on the mandible (0.71 mm vs. 0.91 mm for the mean linear difference) and showed better control of the deviation from the midfacial plane (0.55 mm) than the FHP (0.92 mm) and the coronal plane (0.97 mm).
Stokbro et al. [4] studied 30 patients who had undergone bimaxillary orthognathic surgery with and without segmentation and genioplasty, and found all mean linear differences for the maxilla, mandible, and chin segment to be within 0.5 mm. They also found that the mean precision, measured as the standard deviation, was smallest in the superoinferior direction, followed by the mediolateral deviation, and finally, anteroposterior. Precision was also the most accurate in the mandible, slightly less in the maxilla, and least in the chin segment, probably due to the mandible-first sequence.
Cevidanes et al. [25] and Hajeer et al. [26,27] quantified 3D displacement using the X, Y, and Z vectors of landmark displacement, similarly to our study. Kawamata et al. [27] described methods referring to both linear and angular measures. However, these measures do not reflect what happens along the whole surface [28]. For this reason, color-coded maps are needed to display information on what is happening along the whole surface model.
In their systematic review, Alkhayer et al. [29] analyzed 12 papers regarding the accuracy analysis of virtual surgical planning. The accuracy values for the pitch, yaw, and roll (°) were (<2.75, <1.7, <1.1) for the maxilla, respectively, and (<2.75, <1.8, <1.1) for the mandible. They observed that the calculation of the linear and angular differences between the virtual plans and postoperative outcomes was the most frequented method used for accuracy assessment, and a difference of less than 2 mm/° was considered acceptable. They concluded that virtual planning appears to be more accurate, especially in terms of frontal symmetry, similar to our results.
On the other hand, Baan et al. [7] used a different method for validation and accuracy of results in bimaxillary orthognathic surgery. They used a tool called “OrthoGnathicAnalyser” to analyze the postoperative outcomes with regard to the virtual planning. The main difference lies in the fact that no landmark identification is needed because the relevant translational and rotational movements of each jaw segment could be computed from the rotation matrices of the jaw segments during the registration process using the OrthoGnathicAnalyser tool. They found that the left/right translation showed the lowest absolute mean difference between the 3D planning and the surgical result for both the maxilla and mandible, at 0.49 mm, and 0.71 mm, respectively, whilst the vertical positioning of the maxilla and mandible suggested the lowest accuracy. In line with previous studies, the interocclusal wafer provided less intra-operative control in the vertical dimension.
The method we applied in this study can express more 3D shape information in comparison to those that were based solely on the calculations of linear and angular distances, offering valuable information in the three axes and three dimensions for the cephalometric points selected and visual data in the color-coded maps.
In the literature, differences of less than 2 mm between the virtual surgical planning and the actual postoperative results have been considered clinically acceptable by many authors [4,16,30]. However, we believe that this statement must be taken cautiously since it highly depends on the quantity of movement (an advancement of 4 mm is not as clinically irrelevant as 8 mm).
In this study, overall good accuracy was found, with all differences for point A, point B, Pog, and both the upper and lower first molars being below 1 mm. The greatest values for the rest of the landmarks were found in the y (anteroposterior) axis at point A (0.835 mm), point B (0.480 mm), and Pogonion (0.780 mm), with overall worse accuracy in the anteroposterior direction for all the landmarks studied. On the contrary, distances found in the mediolateral direction were low (0.239 mm for point A, 0.070 mm for point B, and 0.079 mm in Pog). This means that the accuracy provided by intraoperative interocclusal splints is good in the mediolateral direction but poorer in the anteroposterior direction. The authors believe this can be explained because the thickness of the splint is considerable, and the segments may slide and be minimally displaced in the anteroposterior direction. Higher differences in the anteroposterior direction may also be explained because the magnitude of movement in this plane is usually the greatest when performing orthognathic bimaxillary surgery.
Vertical distances were also low (<0.3 mm), with the lowest at point B (0.150 mm) and slightly higher at point A (0.280 mm). The latter is manually controlled by the surgeon by measuring the distance from a bone-fixed point (a screw at the nasion in this series) and not by the splint, which may explain the higher difference.
The differences in the bone located over the upper first molars were found to be higher compared to those of the mandibular first molars. Again, the authors believe this difference may be explained by the fact that surgery is performed in a mandible-first sequence, and a final splint to position the maxilla is not used and it is positioned manually instead.
Regarding the 3D distances, the highest difference was found at Pog, with the lowest at point B, where the highest accuracy was found. When performing the multivariate analysis to examine the influence of each axis on the overall 3D distance, it was observed that for point A and Pog, it was the y axis (anteroposterior) that showed the greatest coefficient, meaning that for point A and Pog, the anteroposterior direction had the strongest influence on the overall 3D distance. Thus, it was in the anteroposterior direction that accuracy was the lowest. On the other hand, for point B, it was the vertical axis that had the highest effect on the 3D distance.
In conclusion, we found that in this study, the positioning of the mandible compared to the maxilla was more accurate. In addition, the lowest accuracy was found in the anteroposterior direction, whilst the highest accuracy was observed in the mediolateral direction. Further studies are needed to determine if future refinements of interocclusal splints may improve these results. Furthermore, in the vertical direction, all median differences were very accurate, especially in point B, where the distances were the lowest. Vertical distances were the highest at point A, which is intraoperatively controlled by the surgeon by osseous references and may explain these results. Differences in the mediolateral direction were also low for point A, point B, and Pog, reflecting a high accuracy when positioning both the maxilla and mandible in the midline, especially the mandible.
The authors believe that a mandible-first sequence allows the surgeon to overcome and correct problems of the centric relation and achieve a more predictable position. It is less prone to errors caused by the incorrect position of the mandible during CBCT examination. Special attention is paid to properly seat the condyles in the fossa during the stabilization of the proximal segment of the mandible and fixation since maxillary position can be inaccurate if the mandible is not correctly positioned. The authors’ preference is also not to use the final splint, and the maxilla is positioned according to correct dental interdigitation and occlusion, therefore eliminating interferences from the splint. However, a palatal splint is used in cases of segmental maxillary surgery. It is important to consider this when discussing these results.
Regarding the limitations of this study, it is a retrospective study and, as stated by many authors, the need for a manual selection of the cephalometric landmarks for analysis, which need to be identified multiple times on the models, is prone to human error and may be a source of inaccuracy in this study. Two solutions can be provided to overcome the landmark identification bias—either the fully automated identification of landmarks or the elimination of cephalometric landmark identification, as proposed by Baan et al. [7]. Another source of limitation may be correlated to erroneous data on the surface mesh (for example, streak artifacts or surface roughness), which would have a marked effect on the measurements [31]. In addition, postoperative CBCT was acquired without the use of the final splint. This may lead to a different occlusion than planned due to occlusal interferences, showing higher differences between the 3D planned and surgically achieved mandibular position.
As improvements to this study, measurements in more cephalometric and dental landmarks could be taken to conduct a more exhaustive and detailed analysis. Different assessment methods could also be used to overcome observer-dependent landmark identification errors. It would also be interesting to analyze these results considering the quantity of movement performed and display these results as percentages.

5. Conclusions

Virtual planning allows orthognathic surgeons to predict possible complications and potential difficulties, and to accurately design a precise and adequate surgical plan preoperatively.
The differences found in this study between the surgical simulation and the actual postoperative results were less than 1 mm for most cephalometric landmarks, indicating overall acceptable predictability of the virtual surgery. The highest differences were found in the anteroposterior direction, where splints may be less accurate. Overall, differences in the mediolateral direction were the lowest and could be interpreted as very good accuracy when positioning the midline for the mandible and maxilla. In general, distances in the mandible were lower compared to the maxilla, meaning higher accuracy. It should be considered that the maxilla is positioned manually and that a mandible-first sequence was used.
In conclusion, virtual surgical planning in orthognathic surgery offers predictable results. All distances were lower than 1 mm. Accuracy was greater when positioning the maxillomandibular complex in the mediolateral direction, whilst accuracy in the sagittal plane and vertical direction was lower, especially in the maxilla, similar to other studies.

Author Contributions

Conceptualization, M.M.P.M., A.G.V., M.B.B. and I.A.N.; Data curation, M.M.P.M., A.G.V., I.A.N. and A.M.S.; Methodology, M.M.P.M., A.G.V., J.G.D.d.C., M.B.B. and A.M.S.; Resources, J.G.D.d.C. and J.L.d.C.P.d.V.; Software, M.M.P.M., A.G.V., M.B.B. and A.M.S.; Supervision, A.G.V., J.G.D.d.C. and J.L.d.C.P.d.V.; Validation, J.L.d.C.P.d.V.; Writing—original draft, M.M.P.M. and I.A.N.; Writing—review & editing, A.G.V., J.G.D.d.C. and J.L.C.C. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki, and approved by the Institutional Review Board (or Ethics Committee) of Hospital La Paz (CEI/CEIm).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

Data available on request due to ethical restrictions.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Quereshy, F.A.; Baur, D.A.; Levintov, N.; Altay, M.A.; Bazina, M. Role of Virtual Surgical Planning in Increased Predictability of Orthognathic Surgery. J. Oral Maxillofac. Surg. 2015, 73, e63–e64. [Google Scholar] [CrossRef]
  2. Seo, H.J.; Choi, H.J.Y.K. Current trends in orthognathic surgery. Curr. Trends Orthognath. Surg. 2021, 22, 287–295. [Google Scholar] [CrossRef] [PubMed]
  3. Lin, H.H.; Lonic, D.; Lo, L.J. 3D printing in orthognathic surgery—A literature review. J. Formos. Med. Assoc. 2018, 117, 547–558. [Google Scholar] [CrossRef] [PubMed]
  4. Stokbro, K.; Aagaard, E.; Torkov, P.; Bell, R.B.; Thygesen, T. Surgical accuracy of three-dimensional virtual planning: A pilot study of bimaxillary orthognathic procedures including maxillary segmentation. J. Oral Maxillofac. Surg. 2016, 45, 8–18. [Google Scholar] [CrossRef]
  5. Aboul-Hosn Centenero, S.; Hernández-Alfaro, F. 3D planning in orthognathic surgery: CAD/CAM surgical splints and prediction of the soft and hard tissues results—Our experience in 16 cases. J. Cranio-Maxillofac. Surg. 2012, 40, 162–168. [Google Scholar] [CrossRef]
  6. De Riu, G.; Virdis, P.I.; Meloni, S.M.; Lumbau, A.; Vaira, L.A. Accuracy of computer-assisted orthognathic surgery. J. Cranio-Maxillofac. Surg. 2018, 46, 293–298. [Google Scholar] [CrossRef]
  7. Baan, F.; Liebregts, J.; Xi, T.; Schreurs, R.; de Koning, M.; Bergé, S.; Maal, T. A new 3D tool for assessing the accuracy of bimaxillary surgery: The Ortho Gnathican Alyser. PLoS ONE 2016, 11, e0149625. [Google Scholar] [CrossRef] [Green Version]
  8. Hsu, S.S.-P.; Gateno, J.; Bell, R.B.; Hirsch, D.L.; Markiewicz, M.R.; Teichgraeber, J.F.; Zhou, X.; Xia, J.J. Accuracy of a Computer-Aided Surgical Simulation Protocol for Orthognathic Surgery: A Prospective Multicenter Study. J. Oral Maxillofac. Surg. 2013, 71, 128–142. [Google Scholar] [CrossRef] [Green Version]
  9. Xia, J.J.; Gateno, J.; Teichgraeber, J.F.; Christensen, A.M.; Lasky, R.E.; Lemoine, J.J.; Liebschner, M.A. Accuracy of the Computer-Aided Surgical Simulation (CASS) System in the Treatment of Patients with Complex Craniomaxillofacial Deformity: A Pilot Study. J. Oral Maxillofac. Surg. 2007, 65, 248–254. [Google Scholar] [CrossRef]
  10. Fedorov, A.; Beichel, R.; Kalpathy-Cramer, J.; Finet, J.; Fillion-Robin, J.-C.; Pujol, S.; Bauer, C.; Jennings, D.; Fennessy, F.; Sonka, M.; et al. 3D Slicer as an image computing platform for the Quantitative Imaging Network. Magn. Reson. Imaging 2012, 30, 1323–1341. [Google Scholar] [CrossRef] [Green Version]
  11. Wang, L.C.; Lee, Y.H.; Tsai, C.Y.; Wu, T.J.; Teng, Y.Y.; Lai, J.P.; Lin, S.S.; Chang, Y.J. Postsurgical Stability of Temporomandibular Joint of Skeletal Class III Patients Treated with 2-Jaw Orthognathic Surgery via Computer-Aided Three-Dimensional Simulation and Navigation in Orthognathic Surgery (CASNOS). BioMed Res. Int. 2021, 2021, 1563551. [Google Scholar] [CrossRef] [PubMed]
  12. Sendyk, M.; Cevidanes, L.; Ruellas, A.; Fattori, L.; Mendes, F.M.; Paiva, J.B.; Rino Neto, J. Three-dimensional evaluation of dental decompensation and mandibular symphysis remodeling on orthodontic-surgical treatment of Class III malocclusion. Am. J. Orthod. Dentofac. Orthop. 2021, 159, 175–183.e3. [Google Scholar] [CrossRef] [PubMed]
  13. McAllister, P.; Watson, M.; Burke, E. A Cost-Effective, In-House, Positioning and Cutting Guide System for Orthognathic Surgery. J. Maxillofac. Oral Surg. 2018, 17, 112–114. [Google Scholar] [CrossRef] [PubMed]
  14. Cevidanes, L.H.C.; Oliveira, A.E.F.; Grauer, D.; Styner, M.; Proffit, W.R. Clinical Application of 3D Imaging for Assessment of Treatment Outcomes. Semin. Orthod. 2011, 17, 72–80. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  15. Marlière, D.A.A.; Demétrio, M.S.; Verner, F.S.; Asprino, L.; Netto, H.D.D.M.C. Feasibility of iterative closest point algorithm for accuracy between virtual surgical planning and orthognathic surgery outcomes. J. Cranio-Maxillofac. Surg. 2019, 47, 1031–1040. [Google Scholar] [CrossRef]
  16. Tucker, S.; Cevidanes, L.H.S.; Styner, M.; Kim, H.; Reyes, M.; Proffit, W.; Turvey, T. Comparison of actual surgical outcomes and 3-dimensional surgical simulations. J. Oral Maxillofac. Surg. 2010, 68, 2412–2421. [Google Scholar] [CrossRef] [Green Version]
  17. Ahrens, J.P.; Geveci, B.; Law, C.C. Paraview: An End-User Tool for Large Data Visualization; The Visualization Handbook; Hansen, C.D., Johnson, C.R., Eds.; Butterworth-Heinemann: Oxford, UK, 2005; pp. 717–731. Available online: https://www.sciencedirect.com/science/article/pii/B9780123875822500381?via%3Dihub (accessed on 17 March 2022).
  18. Baker, S.B.; Goldstein, J.A.; Seruya, M. Outcomes in Computer-Assisted Surgical Simulation for Orthognathic Surgery. J. Craniofac. Surg. 2012, 23, 509–513. [Google Scholar] [CrossRef]
  19. Swennen, G.R.J.; Mollemans, W.; Schutyser, F. Three-Dimensional Treatment Planning of Orthognathic Surgery in the Era of Virtual Imaging. J. Oral Maxillofac. Surg. 2009, 67, 2080–2092. [Google Scholar] [CrossRef]
  20. Tran, N.H.; Tantidhnazet, S.; Raocharernporn, S.; Kiattavornchareon, S.; Pairuchvej, V.; Wongsirichat, N. Accuracy of Three-Dimensional Planning in Surgery-First Orthognathic Surgery: Planning Versus Outcome. J. Clin. Med. Res. 2018, 10, 429–436. [Google Scholar] [CrossRef] [Green Version]
  21. Alcañiz, P.; Pérez, J.; Gutiérrez, A.; Barreiro, H.; Villalobos, Á.; Miraut, D.; Illana, C.; Guiñales, J.; Otaduy, M.A. Soft-Tissue Simulation for Computational Planning of Orthognathic Surgery. J. Pers. Med. 2021, 11, 982. [Google Scholar] [CrossRef] [PubMed]
  22. Hernandez-Alfaro, F.; Guijarro-Martinez, R. New protocol for threedimensional surgical planning and CAD/CAM splint generation in orthognathic surgery: An in vitro and in vivo study. Int. J. Oral Maxillofac. Surg. 2013, 42, 1547–1556. [Google Scholar] [CrossRef] [PubMed]
  23. Makram, M.; Kamel, H. Reeb graph for automatic 3D cephalometry. IJIP 2014, 8, 17–29. [Google Scholar]
  24. Zhang, N.; Liu, S.; Hu, Z.; Hu, J.; Zhu, S.; Li, Y. Accuracy of virtual surgical planning in two-jaw orthognathic surgery: Comparison of planned and actual results. Oral Surg. Oral Med. Oral Pathol. Oral Radiol. 2016, 122, 143–151. [Google Scholar] [CrossRef]
  25. Cevidanes, L.H.S.; Bailey, L.J.; Tucker, G.R.; Styner, M.A.; Mol, A.; Phillips, C.L.; Proffit, W.R.; Turvey, T. Superimposition of 3D cone-beam CT models of orthognathic surgery patients. Dentomaxillofac. Radiol. 2005, 34, 369–375. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  26. Hajeer, M.Y.; Ayoub, A.F.; Millett, D.T.; Bock, M.; Siebert, J.P. Three-dimensional imaging in orthognathic surgery: The clinical application of a new method. Int. J. Adult Orthod. Orthognath. Surg. 2002, 17, 318–330. [Google Scholar]
  27. Kawamata, A.; Fujishita, M.; Nagahara, K.; Kanematu, N.; Niwa, K.; Langlais, R.P. Three-dimensional computed tomography evaluation of postsurgical condylar displacement after mandibular osteotomy. Oral Surg. Oral Med. Oral Pathol. Oral Radiol. Endodontol. 1998, 85, 371–376. [Google Scholar] [CrossRef]
  28. Lee, C.-Y.; Jang, C.-S.; Kim, J.-W.; Kim, J.-Y.; Yang, B.-E. Condylar repositioning using centric relation bite in bimaxillary surgery. Korean J. Orthod. 2013, 43, 74–82. [Google Scholar] [CrossRef] [Green Version]
  29. Alkhayer, A.; Piffkó, J.; Lippold, C.; Segatto, E. Accuracy of virtual planning in orthognathic surgery: A systematic review. Head Face Med. 2020, 16, 1–9. [Google Scholar] [CrossRef]
  30. Chin, S.J.; Wilde, F.; Neuhaus, M.; Schramm, A.; Gellrich, N.C.; Rana, M. Accuracy of virtual surgical planning of orthognathic surgery with aid of CAD/CAM fabricated surgical splint—A novel 3D analyzing algorithm. J. Cranio-Maxillofac. Surg. 2017, 45, 1962–1970. [Google Scholar] [CrossRef]
  31. Jabar, N.; Robinson, W.; Goto, T.K.; Khambay, B.S. The validity of using surface meshes for evaluation of three-dimensional maxillary and mandibular surgical changes. Int. J. Oral Maxillofac. Surg. 2015, 44, 914–920. [Google Scholar] [CrossRef]
Figure 1. Preoperative (left), virtual surgical planning (center), and postoperative (right) models for an example patient.
Figure 1. Preoperative (left), virtual surgical planning (center), and postoperative (right) models for an example patient.
Applsci 12 04305 g001
Figure 2. Approximation of the postoperative model (beige) to the virtual planning model (white) using the “Transforms” tool, in the frontal (left) and lateral (right) views.
Figure 2. Approximation of the postoperative model (beige) to the virtual planning model (white) using the “Transforms” tool, in the frontal (left) and lateral (right) views.
Applsci 12 04305 g002
Figure 3. Color-coded maps of the distances (mm) in Paraview. A continuous color-coded scale was designed, where blue indicates negative distance differences and red positive distance differences.
Figure 3. Color-coded maps of the distances (mm) in Paraview. A continuous color-coded scale was designed, where blue indicates negative distance differences and red positive distance differences.
Applsci 12 04305 g003
Figure 4. Values (mm) of the different components of the distance for an example point (in purple) are displayed on the postoperative model.
Figure 4. Values (mm) of the different components of the distance for an example point (in purple) are displayed on the postoperative model.
Applsci 12 04305 g004
Figure 5. Workflow schematic.
Figure 5. Workflow schematic.
Applsci 12 04305 g005
Figure 6. Median distance (mm) for all cephalometric points in the x, y, and z axes. The x axis represents the mediolateral (or horizontal) direction, the y axis, the anteroposterior direction, and the z axis, the inferosuperior (or vertical) direction.
Figure 6. Median distance (mm) for all cephalometric points in the x, y, and z axes. The x axis represents the mediolateral (or horizontal) direction, the y axis, the anteroposterior direction, and the z axis, the inferosuperior (or vertical) direction.
Applsci 12 04305 g006
Figure 7. Multivariate analysis to investigate the influence of each axis on the overall 3D distance for the selected cephalometric landmarks.
Figure 7. Multivariate analysis to investigate the influence of each axis on the overall 3D distance for the selected cephalometric landmarks.
Applsci 12 04305 g007
Table 1. Median and 25th and 75th percentiles for all differences between surgical planning and actual postoperative results at the selected landmarks for the 40 patients. The x axis represents the mediolateral (or horizontal) direction, the y axis, the anteroposterior direction, and the z axis, the inferosuperior (or vertical) direction.
Table 1. Median and 25th and 75th percentiles for all differences between surgical planning and actual postoperative results at the selected landmarks for the 40 patients. The x axis represents the mediolateral (or horizontal) direction, the y axis, the anteroposterior direction, and the z axis, the inferosuperior (or vertical) direction.
Landmark
(Measured Axis)
Percentile 25 (mm)Median (mm)Percentile 75 (mm)
A point (X)0.0770.2390.360
A point (Y)0.2970.8350.400
A point (Z)0.0750.2800.600
B point (X)0.0200.0700.330
B point (Y)0,1620.4800.885
B point (Z)0.0360.1500.292
Pogonion (X)0.0130.0790.190
Pogonion (Y)0.1750.7801.160
Pogonion (Z)0.0700.2000.625
Right upper first molar (X)0.2570.7701.445
Left upper first molar (X)0.1860.6651.222
Right lower first molar (X)0.1000.3100.370
Left lower first molar (X)0.1500.5800.850
Table 2. Median and 25th and 75th percentiles of 3D absolute differences at landmarks point A, point B, and Pog.
Table 2. Median and 25th and 75th percentiles of 3D absolute differences at landmarks point A, point B, and Pog.
Landmark
(3D Absolute Measure)
Percentile 25 (mm)Median (mm)Percentile 75 (mm)
A point0.3440.9341.719
B point0.3670.6131.107
Pog0.4051.0341.513
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Pampín Martínez, M.M.; Gutiérrez Venturini, A.; Guiñales Díaz de Cevallos, J.; Barajas Blanco, M.; Aragón Niño, I.; Moreiras Sánchez, A.; del Castillo Pardo de Vera, J.L.; Cebrián Carretero, J.L. Evaluation of the Predictability and Accuracy of Orthognathic Surgery in the Era of Virtual Surgical Planning. Appl. Sci. 2022, 12, 4305. https://doi.org/10.3390/app12094305

AMA Style

Pampín Martínez MM, Gutiérrez Venturini A, Guiñales Díaz de Cevallos J, Barajas Blanco M, Aragón Niño I, Moreiras Sánchez A, del Castillo Pardo de Vera JL, Cebrián Carretero JL. Evaluation of the Predictability and Accuracy of Orthognathic Surgery in the Era of Virtual Surgical Planning. Applied Sciences. 2022; 12(9):4305. https://doi.org/10.3390/app12094305

Chicago/Turabian Style

Pampín Martínez, Marta María, Alessandro Gutiérrez Venturini, Jorge Guiñales Díaz de Cevallos, María Barajas Blanco, Iñigo Aragón Niño, Alvaro Moreiras Sánchez, José Luis del Castillo Pardo de Vera, and José Luis Cebrián Carretero. 2022. "Evaluation of the Predictability and Accuracy of Orthognathic Surgery in the Era of Virtual Surgical Planning" Applied Sciences 12, no. 9: 4305. https://doi.org/10.3390/app12094305

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop