Next Article in Journal
The Role of Oral Supplementation for the Management of Age-Related Macular Degeneration: A Narrative Review
Previous Article in Journal
The Role of the Gut Microbiome in Inflammatory Bowel Disease: The Middle East Perspective
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Mobile App for Enhanced Anterior Cruciate Ligament (ACL) Assessment in Conscious Subjects: “Pivot-Shift Meter”

by
Edmundo Berumen-Nafarrate
1,2,*,
Ivan Rene Ramos-Moctezuma
2,
Luis Raúl Sigala-González
2,
Fatima Norely Quintana-Trejo
2,
Jesus Javier Tonche-Ramos
2,
Nadia Karina Portillo-Ortiz
2,
Carlos Eduardo Cañedo-Figueroa
2 and
Arturo Aguirre-Madrid
3
1
Star Medica Chihuahua Hospital, Perif. de la Juventud 6103, Fracc. El Saucito, Chihuahua 31110, Mexico
2
Faculty of Medicine and Biomedical Sciences, University Autonomous of Chihuahua (UACH), Chihuahua 31110, Mexico
3
Department of Orthopedic Surgery, Star Medica Chihuahua Hospital, Perif. de la Juventud 6103, Fracc. El Saucito, Chihuahua 31110, Mexico
*
Author to whom correspondence should be addressed.
J. Pers. Med. 2024, 14(6), 651; https://doi.org/10.3390/jpm14060651
Submission received: 15 May 2024 / Revised: 31 May 2024 / Accepted: 14 June 2024 / Published: 18 June 2024

Abstract

:
Anterior cruciate ligament (ACL) instability poses a considerable challenge in traumatology and orthopedic medicine, demanding precise diagnostics for optimal treatment. The pivot-shift test, a pivotal assessment tool, relies on subjective interpretation, emphasizing the need for supplementary imaging. This study addresses this limitation by introducing a machine learning classification algorithm integrated into a mobile application, leveraging smartphones’ built-in inertial sensors for dynamic rotational stability assessment during knee examinations. Orthopedic specialists conducted knee evaluations on a cohort of 52 subjects, yielding valuable insights. Quantitative analyses, employing the Intraclass Correlation Coefficient (ICC), demonstrated robust agreement in both intraobserver and interobserver assessments. Specifically, ICC values of 0.94 reflected strong concordance in the timing between maneuvers, while signal amplitude exhibited consistency, with the ICC ranging from 0.71 to 0.66. The introduced machine learning algorithms proved effective, accurately classifying 90% of cases exhibiting joint hypermobility. These quantifiable results underscore the algorithm’s reliability in assessing knee stability. This study emphasizes the practicality and effectiveness of implementing machine learning algorithms within a mobile application, showcasing its potential as a valuable tool for categorizing signals captured by smartphone inertial sensors during the pivot-shift test.

1. Introduction

The knee is the largest and most complex joint in the human skeleton, essential for walking, supporting body weight, taking off, and receiving jumps, considered one of the joints most subjected to constant stress, for which it has a set of ligaments that give it its biomechanical skill: the anterior cruciate ligament (ACL), posterior cruciate ligament (PCL), medial collateral ligament (MCL), and lateral collateral ligament (LCL), as well as secondary or accessory stabilizers. The anatomy of the ACL is made up of two bundles: the anteromedial (AM) bundle mainly prevents anterior to posterior displacement, while the posterolateral (PL) bundle stretches in extension and prevents rotational instability of the knee. These bundles work synergistically during knee movement, presenting tension during extension and laxity during knee flexion, providing a role as the main stabilizer of the joint. Knee ligament injuries can occur due to a sudden axial load on the knee, combined with valgus stress and rotational force around the tibia. An injury to the ligament complex results in a loss of stability; therefore, an early clinical diagnosis of instability is imperative [1,2,3,4,5].
To assess the integrity of this structure, imaging techniques and even arthroscopy itself are used. Clinical evaluation includes tests such as the Lachman test, anterior drawer test, and pivot-shift (PS) test, considered the “gold standard” for assessing knee rotational function after an injury. There are also scales based on questionnaires from the International Knee Documentation Committee (IKDC) and the Tegner Activity Scale (TAS). However, these are subjective measurements [4,5].
On the other hand, to quantify knee laxity, various systems, such as the KT1000 and KT2000 arthrometers (MED metric Corp., San Diego, CA, USA), have been developed to measure sagittal laxity. However, methods for evaluating rotational laxity involve a range of techniques, including ambulatory devices, instrumented boots, magnetic resonance imaging (MRI), electromagnetic sensors, robotic technology, and navigation systems. While these technological advancements are impressive, it is crucial to consider their practicality, affordability, and comfort when implementing them in a clinical setting. The use of technologies to quantify the pivot maneuver is currently being studied; infrared markers are one of them, as well as the use of sensors like accelerometers to detect the signal generated by the pivot maneuver, with the disadvantage of high cost of the hardware [6,7,8,9,10,11,12,13,14,15,16,17].
In a study by Tanaka et al. [18] comparing the diagnostic reliability of the quantitative evaluation of the pivot-shift test, using an electromagnetic measurement system for anterior cruciate ligament deficiency against an accelerometer system (KiRA), an application of Image analysis using external devices, no significant differences were found between these measurements; both measurement methods were able to detect ACL laxity; however, it is important to highlight the need to use additional devices, generating extra costs for the patient [19].
Among the available tests, the PS test stands as the sole clinical evaluation that effectively correlates with knee joint hypermobility. The PS test subjectively assesses pivot change and has been the focus of efforts to quantify bone movements and correlate them with laxity grading. However, it is important to acknowledge that the unrestricted and dynamic nature of the PS maneuver introduces significant kinematic variability, and a need for careful consideration during the evaluation process.
The use of built-in sensors in smartphones for diagnostic applications has been increasing in recent years [20,21,22,23,24], as well as the development of machine learning algorithms to solve problems regarding pattern recognition [25,26,27,28,29]. To address the limitations of subjective evaluations, Pivot-Shift Meter (PSM) has been developed: a novel mobile application capable of recording signals acquired by the integrated inertial sensors of the mobile device during the pivot-shift maneuver. This study aims to process the information gathered through the PS maneuver by the development of filtering algorithms and machine learning, to determine the reproducibility of the pivot-shift maneuver between testers based on the acquired signals. Furthermore, this study further aims to establish an ACL instability/laxity grade by utilizing the KT-1000 arthrometer as the gold standard tool.

2. Objectives

  • Evaluate the efficacy of AI for analyzing and categorizing signals obtained from inertial sensors during pivot-shift tests to identify the most effective approach for integration into mobile software.
  • Evaluate the reliability and effectiveness of the developed software in assessing knee joint stability through intraobserver and interobserver analyses.
  • Compare the results obtained from the developed application with those from the KT-1000 arthrometer, a gold standard tool for assessing knee laxity.
  • Investigate the potential of the developed software to enhance the precision and objectivity of clinical evaluations of ACL injuries and other joint conditions.

3. Materials and Methods

3.1. Population

The study sample size for the trial was obtained from 66 volunteer students who participated in a control event held at the School of Medicine and Biomedical Sciences of the Universidad Autónoma de Chihuahua. Delving into the demographics, considering a total population of 156 4th-year medicine alumni, the study sample size was selected with a confidence level of 95% and a margin of error of 10%.
Inclusivity was paramount in our participant selection process, encompassing individuals aged between 18 and 37 to construct a well-rounded representation of both young and middle-aged adults. Striving for gender balance, our cohort comprised 34 women and 32 men, acknowledging potential gender-related nuances in the study’s outcomes. Before enrollment, all participants underwent a thorough informed consent process, affirming their comprehension of the study’s objectives, methodologies, and associated risks. As the study focused on healthy subjects, individuals with pre-existing orthopedic conditions, injuries, or any other known health issues were excluded from participation. The study protocol had been approved by the ethics committee of “Christus Muguerza del Parque” hospital.
The evaluation phase was orchestrated by a proficient team of six evaluators, boasting a diverse range of expertise and experience in orthopedic surgery. Comprising two orthopedic surgeons with over 25 years of seasoned practice, complemented by a practitioner with 3 years of experience, and further enhanced by the contribution of three budding orthopedic surgeons with less than 3 years of practice. This diverse panel was entrusted with conducting a meticulous examination, which included the rigorous administration of the pivot-shift (PS) test, capturing and documenting pertinent data.
Among the initial 66 participants, only the data from 52 participants were deemed usable for analysis due to technical errors in data saving or mislabeling of the samples. The excluded data were not included in the subsequent analysis to ensure the accuracy and reliability of the results.

3.2. Measurements

The development of the Pivot-Shift Meter (PSM) application stemmed from a dual focus: firstly, to capture and record the signal generated by the gyroscope in the mobile device; and secondly, to seamlessly store and organize this information in an online database. The initial version of the application was developed using the program MIT App Inventor 2.
The application successfully achieved two key goals:
  • Signal capture: The PSM application recorded angular velocity (rad/s) data corresponding to the three axes of movement on the mobile device at a sampling rate of 100 Hz, resulting in 500 data points captured in 5 s—this high-frequency data acquisition aimed to capture precise and detailed measurements of the pivot-shift maneuver. X-axis data was used because it corresponds best to the movement of the leg when executing the maneuver concerning the position of the cell phone (Figure 1A).
  • Data storage: The recorded data was securely saved in a database, which was configured to provide a user-friendly experience for the physicians involved in the study. This database facilitated the physician’s ability to review and follow up on each case (Figure 2). During the study, the pivot-shift maneuver was performed three consecutive times on each test subject. The mobile device was placed on the anteromedial aspect of the tibia, approximately two fingers away from the tibial tuberosity. To ensure secure placement, the mobile device was connected to a sports-type cellular armband with the PSM application pre-installed, allowing for accurate recording of the maneuver.

3.3. Data Recording in the PSM Application by the Evaluator

  • Patient Data Recording: patient initials, age, gender, height, and weight (Figure 2).
  • Placement of the Cell Phone: the cell phone with the PSM application installed is placed on the tibial tuberosity of the patient, securing it approximately two fingers below the patella with an elastic band, ensuring that the device is slightly tilted towards the medial aspect of the tibia (Figure 1B).
  • Execution of the Pivot Maneuver: the evaluator holds the ankle on the medial side with the hand corresponding to the patient’s leg, and with the opposite hand, the posterior part of the leg is held at the level of the tibial head, rotating slightly medially. Subsequently, the leg is flexed until reaching a 90° angle.
  • Results Recording: the evaluators are instructed to perform two maneuvers and save the results obtained with the PSM application. Additionally, the application allows for adding observations, clinical classification according to IKDC criteria, results of digital arthrometry (KT-1000), results of imaging studies, arthroscopic images, and notes with relevant clinical information (Table 1).
Table 1. Input data acquired in the study.
Table 1. Input data acquired in the study.
Input DataDescription
Patient DemographicsInitials, age, gender, height, weight
Gyroscope SignalsAngular velocity (rad/s) recorded at 100 Hz (500 data points over 5 s)
Clinical ClassificationResults of the IKDC criteria, digital arthrometry (KT-1000), and other relevant clinical information.
In addition to the PSM data, the KT-1000 arthrometer was used to measure the anteroposterior displacement of the knee joint in millimeters. This measurement provided an assessment of the laxity in the anteromedial (AM) bundle of the ACL. Measurements were performed on both legs of each participant, and the results were compared to determine the degree of injury. The development of the laxity grade table was inspired by the need to provide a comprehensive assessment tool for the resulting data. The objective measurements were obtained through the KT-1000 arthrometer, which indicates the millimeter displacement of the knee joint, and a grading system, “Del Parque” Classification (CDP), which categorizes laxity into grades 1, 2, and 3. In recognizing the importance of identifying cases without significant knee laxity, an additional grade was added to the classification table, grade 0. This grade signifies a stable knee with minimal or no laxity.
With this scale, a knee laxity grade is obtained by measuring both legs of a patient and determining the difference between these results (Table 2). The table ensures consistency in grading PSM data by providing clear criteria for each grade.

3.4. Statistical Analysis

The Intraclass Correlation Coefficient (ICC) was used to compare repeatability among the evaluators of the data acquired by the PSM when performing a pivot-shift test. MatLab (version 2023) was the software used for this purpose.
The ICC is used to find correlations within a single class of data rather than two different classes of data. Is a value that goes from 0 to 1 and acts as a measure of the reliability of the ratings for data that exist in groups of quantitative variables.
From each X signal of each evaluator, features of the signal that agree with the amplitude in radians per second (rad/s) and location in time of each positive peak in centiseconds (cs) were obtained, as seen in marks PI-III in Figure 1C and summarized in Table 3.
Characteristic vectors (CV) were formed by data provided by each peak of each signal:
Subject 45: [137.54, 179.86, 156.83]; [111.00, 267.00, 448.00]
Once this set of samples was arranged, two types of comparisons were made: an intraobserver and an interobserver.

3.5. Classification Algorithm

The main objective was to find which features of the signal could help us to determine a degree of laxity. For this analysis, 35 of the 52 samples were used to maintain similar groups in the number of samples of each grade, composed of maneuvers classified with the KT-1000 in the different grades, from 0 to 3 according to the CDP grading system (Table 2). To test the classification algorithms (CA), a test group of 9 cases were separated, 3 for each degree of injury, except for grade 3 cases, since in our entire sample there were only 2 occurrences of this grade of injury, thus leaving 23 samples as our training group.
Different methods were tested, including support vector machine (SVM), decision tree, random forest, and logistic regression, using first raw signals and then pre-processed signals.
The first step of the signal processing was to normalize every signal to values between 0 and 1 to be further analyzed only by its morphological features.
Next, the area indicated as the “pivot” in Figure 1C was extracted from each sample in its normalized values (NVs) and its original values (OVs). Features considered for the CA were obtained from the NVs and the OVs of the “pivot” region of the signal as follows: the standard deviation (SD) from the NV, the maximum value (Max), the range plus average of the signal values (R + X ¯ ), and the sum of squares divided by the amount of data in the signal ( x 2 N ) from the OV. These values were taken to test the AI.

4. Results

4.1. Signal Interpretation

From the samples obtained, it was identified that the X-axis corresponds best to the movement of the leg when executing the maneuver with regard to the position of the cell phone. Thus, it was possible to relate portions of the graph to leg movements. Three sectors were identified and related: flexion, extension, and “pivot” (Figure 1C).

4.2. ICC Analysis

The intraobserver ICC analysis showed a global average of 0.95 and 0.71 in terms of the time between maneuvers and the maximum amplitude of each one, respectively. On the other hand, the interobserver analysis yielded 0.94 and 0.66, allusive to the time and maximum amplitude between each maneuver, respectively. From these correlation results, the samples were grouped into classes determined by the speed of the maneuver reached, and then each sample was analyzed to determine the degree of laxity. Initially, 28 participants were classified according to the potential degree of laxity, which was distributed as in Table 4.

4.3. Classification Algorithm

The raw signals corresponding only to the X-axis were classified with AI; the test accuracy is reported in Table 5. The highest result, 40%, is above the chance level (25%) in three of the four methods.
Searching for better results, the signals were processed to isolate the “Pivot” segment following the process shown in Figure 3A–F. Then, the processed signals were used to create CAs based on AI, first by classifying each maneuver in a class, then classifying each signal grade of laxity according to their class; results of performance metrics can be seen in Table 6. The performance metrics were obtained with the test group using the machine learning methods to classify the three degrees of laxity proposed by the CDP grading system; these are summarized in Table 7. Confusion matrices were generated out of these results and are reported in Figure 4.

4.4. Highlights

Through comprehensive intraobserver and interobserver analyses, this study aimed to evaluate the reliability and effectiveness of the developed software. The results revealed strong agreement among evaluators, underscoring the software’s reliability in assessing knee joint stability. Furthermore, a comparative analysis was conducted between the results obtained from the developed application and those from the KT-1000 arthrometer, a gold standard tool in the field. This comparison highlighted the potential clinical utility of the software in providing quantitative assessments of knee laxity.
Overall, the study demonstrates the successful development of a mobile application for assessing knee joint stability. The observed agreement among evaluators and the promising comparison with the KT-1000 arthrometer underscore the potential of the software to enhance the precision and objectivity of clinical evaluations for ACL injuries.

5. Discussion

Technological advancements have played a critical role in the development of new medical techniques and treatments, particularly in the field of orthopedics, allowing for less invasive procedures and more effective clinical analysis methods during joint physical examinations. While the pivot-shift test is considered a cornerstone in assessing knee laxity, its clinical application comes with several significant limitations. Performing the test and evaluating the results are subjective tasks prone to errors. This subjectivity is a relevant factor contributing to uncertainty among observers and intraobservers, limiting the reliability of the obtained data. Additionally, the development of tools and the use of technology in clinical settings to optimize diagnosis, prognosis, and medical treatment have revolutionized the concept of healthcare. Inertial sensors like accelerometers and gyroscopes in smartphones offer a novel, convenient, accessible, and comparatively affordable option for diagnosing and quantitatively evaluating ACL injuries in knees. The KT-1000 arthrometer cannot be compared with the PS maneuver due to the nature of the biomechanics of each maneuver. Nevertheless, in the present study, the Pivot-Shift Meter app was able to accurately classify acquired signals, providing quantitative dynamic diagnostic information of rotational instability that the gold standard arthrometer cannot offer.
According to the Landis and Kotch criteria, the time in which the maneuvers were performed reached an almost perfect value (>0.8) both in the intraobserver analysis and in the interobserver analysis, which may be because the evaluators adapted test after test to achieve three maneuvers in a row within five seconds [30]. Meanwhile, the substantial correlation obtained between the intraobserver analyses, regarding the amplitude in which the peaks were detected, may be because each evaluator has a unique way of executing the maneuver; anatomical factors may influence both the evaluator and the examination subjects, such as height and physical condition. This suggests that a stricter standardization of the pivot maneuver is necessary, ideally given by the same application. As Nicola Lopomo et al. mention in their systematic review, a generalized pivot change maneuver is still desirable, which was demonstrated with the ICC analysis of the maximum amplitude of each maneuver [30,31,32,33,34]. Also, Hoshino et al. describe how a standardized technique improves measurement accuracy; thus, once this standardization is applied, it is possible to obtain a higher correlation [31].
None of the AI methods were successful in the classification of the raw signal. Thus, preprocessing the signal to obtain only the “pivot” segment was necessary, which can be explained as the hysteresis of the inertial sensor after the knee joint reduction; hence, the higher the SD of the data in this portion of the signal, the higher the movement detected in the knee joint reduction. This approach proved to be successful, as three out of four of the AI methods were able to classify the signals correctly according to the performance metrics. Moreover, the performance metrics suggested that two different AI methods were successful for each classification algorithm, SVM for the “Pivot” portion classification and decision tree for the laxity grading classification.
Regarding the comparison against the KT-1000, a relationship of 27/38 classifiable cases was determined, equaling 71.05%. This ratio was low since eight cases could not be correctly determined by PSM, belonging to classes 0 and 1. Therefore, there remains a ratio of 27/30 (≈90%) cases. These three maneuvers were part of our training group, improving our AI generalization capabilities.
Compared to other ways to quantify pivot-shift tests, the approach proposed in the present work has some advantages, such as the fact that it is very simple to use, as the only other requirement besides the device itself is a proper way to fix the phone in position; as mentioned before, a simple armband was used for this purpose. Also, this software has no trouble being installed in both commercial operative systems [6,32,33,34,35].
Some other authors have approached pivot-shift quantification by the use of inertial sensors, especially accelerometers. Vaidya et al. [9] also conducted a study with mobile devices using these sensors. Even when they had satisfactory results, it was noted that these sensors tend to add more noise to the signal; this is because what they measure (acceleration) depends on more variables of a higher order compared to the speed measured by gyroscopes [8,36,37,38,39].
Most authors that approach the quantification of the pivot test through accelerometers seem to agree on a method to interpret a signal acquired by the pivot test with only one morphological characteristic in the graph, which allows them to detect subluxation and reduction of the joint, equivalent to the “pivot” segment of the signals acquired in this study. Nevertheless, this method could be enhanced by the use of machine learning algorithms [40,41,42,43,44,45]. Labbe et al., and more recently Yañez-Diaz et al., implemented SVM algorithms to signals acquired with accelerometers in order to grade the PS phenomenon objectively, reporting acceptable results, which can be compared to the results of the algorithm to organize the signals by class. Notwithstanding, the SVM was not the best method to sort the signals by grade [44,45].
Results of initial studies showed a low correlation between intraobserver analysis regarding the amplitude of the pivot-shift effect graphed in the application due to the variables presented by each evaluator during the maneuver. This led to the initiation of another current multicenter and international case study aiming to analyze, classify, and follow more than 400 tests performed by specialist physicians from five different countries, including Bolivia, Chile, Colombia, Ecuador, and Mexico, using the mobile application PSM on patients with ACL injuries.

6. Limitations

While the PSM demonstrated promise, acknowledging certain limitations is crucial for a comprehensive interpretation of the findings. The study’s reliance on a cohort of 52 healthy subjects may raise questions about the general applicability of the results to broader populations. The subjective nature of the pivot-shift maneuver, despite attempts at standardization, highlights the ongoing challenge of achieving consistent execution among evaluators.
Furthermore, the comparison with the KT-1000 arthrometer revealed limitations in the PSM’s ability to classify certain cases accurately. The 71.05% relationship in classifiable cases indicates room for improvement, particularly in accurately determining cases belonging to classes 0 and 1. These discrepancies emphasize the need for further refinement and standardization of the PSM application. Despite these limitations, this study underscores the advantages of the PSM approach, highlighting its simplicity, accessibility, and cost-effectiveness. The ongoing multicenter international case study involving specialists from various countries aims to address the limitations identified in the initial study as well as the implementation of more sophisticated methods of classification, such as the “Dual-branch collaborative learning network” or the “Generate Adversarial-Driven Cross-Aware Network” used by Zhang W. et al. [46,47]. The observed variability in intraobserver analysis, particularly about the amplitude of the pivot-shift effect, underscores the need for thorough investigation and software adaptation to accommodate diverse users.
Our purpose is to optimize the software’s adaptability for each user, and the motivation behind conducting this study lies in the importance of diagnosis and postoperative monitoring of ACL injuries due to the potential repercussions, such as early joint degeneration and knee instability. Therefore, digital arthrometry appears to be the path toward developing precise and numerical evaluation methods for rotational instability, with all the advantages that early diagnosis and classification can provide before any surgical treatment.

7. Conclusions

The development of this innovative software marks a significant stride forward for orthopedists, ushering in a future where only a mobile device is needed, eliminating additional expenses for examiners and patients. This advancement not only introduces new technologies but also enhances the scope of comprehensive care, facilitating timelier diagnoses and more effective treatments tailored to each case. By integrating injury degree classification with specific surgical recommendations for each grade, we aim to furnish clinicians with a practical tool to discern the most appropriate approach for individual patients. Furthermore, the successful integration of machine learning methods as CAs into a mobile application for assessing and classifying signals from inertial sensors within a cellphone during a pivot-shift test underscores the potential of technology in clinical evaluations. A decision tree turned out to be the best machine learning method to implement as a CA with the data analyzed in the present work.
In general, the application of technology such as inertial sensors in smartphones and neural networks can serve as a valuable tool to enhance the precision and objectivity of clinical evaluations of ACL injuries and other joint conditions. Continued research and refinement of these tools are imperative to ensure their accuracy and utility in clinical practice.
It is crucial to acknowledge that no measurement system is flawless, and there are inherent limitations in their clinical application. One such limitation is the necessity of adhering to standardized pivot maneuver techniques, as variability in technique may impact the accuracy of the measurements obtained.
Further studies are warranted to validate the measurement accuracy of the pivot, using the application across different patient populations and clinical scenarios. This will ascertain the application’s ability to identify ACL injuries at various stages of the injury and evaluate the utility of inertial sensors in clinical practice.

Author Contributions

Conceptualization, E.B.-N.; methodology, I.R.R.-M.; software, L.R.S.-G.; validation, I.R.R.-M., L.R.S.-G. and F.N.Q.-T.; formal analysis, J.J.T.-R.; investigation, N.K.P.-O.; resources, A.A.-M.; data curation, C.E.C.-F.; writing—original draft preparation, I.R.R.-M. and L.R.S.-G.; writing—review and editing, N.K.P.-O.; visualization, J.J.T.-R.; supervision, E.B.-N.; project administration, L.R.S.-G.; funding acquisition, A.A.-M. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

This study was conducted in accordance with the Declaration of Helsinki, and approved by the Institutional Review Board of Autonomous University of Chihuahua (UACH) protocol code CI-020-22, date of approval: 7 December 23.

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

Derived data supporting the findings of this study are available from the corresponding author on request: [email protected].

Acknowledgments

Special thanks to Irene Leal-Berumen (Leal-Solis) of the Universidad Autónoma de Chihuahua, for her invaluable support in reviewing this work during its edition, and to B.E. Gabriela Sámano, coordinator of the Biomedical Engineering career at the Universidad Autónoma de Chihuahua, for her invaluable contribution in arranging the preparations to make use of the faculty’s facilities to capture the data for this work.

Conflicts of Interest

The authors declare no conflicts of interest.

Abbreviations List

ACLAnterior Cruciate Ligament
PCLPosterior Cruciate Ligament
MCLMedial Collateral Ligament
LCLLateral Collateral Ligament
AMAnteromedial
PLPosterolateral
PSPivot-Shift
PSMPivot-Shift Meter
ICCIntraclass Correlation Coefficient
SDStandard Deviation
MaxMaximum
R + X ¯ Range plus average
NVNormalized Value
OVOriginal Value
SVMSupport Vector Machine

References

  1. Hassebrock, J.D.; Gulbrandsen, M.T.B.; Asprey, W.L.B.; Makovicka, J.L.; Chhabra, A. Knee Ligament Anatomy and Biomechanics. Sports Med. Arthrosc. Rev. 2020, 28, 80–86. [Google Scholar] [CrossRef]
  2. Moore Keith, L. Clinically Oriented Anatomy, 9th ed.; Editorial Medica Panamericana; Williams & Wilkins: Barcelona, Spain, 2022. [Google Scholar]
  3. Latarjet, M.; Liard, A.R. Human Anatomy, 5th ed.; Panamericana. 2019. Available online: https://www.medicapanamericana.com/mx/libro/coleccion-latarjet-anatomia-humana-incluye-version-digital-2-tomos (accessed on 10 January 2023).
  4. Kumar, P.J.; Kumar, A.M.; Professor, A. Healthy Gait: Review of Anatomy and Physiology of Knee Joint. Int. J. Curr. Res. Rev. 2020, 12, 1–8. [Google Scholar] [CrossRef]
  5. Ayala-Mejías, J.; García-Estrada, G.; Pérez-España, L.A. Anterior Cruciate Ligament Injuries. Ortop. Act. Mex. 2014, 28, 57–67. Available online: http://www.scielo.org.mx/scielo.php/script=sci_arttext&pid=S2306-41022014000100012&lng=es&nrm=iso&tlng=es (accessed on 28 February 2023).
  6. Hoshino, Y.; Araujo, P.; Ahldén, M.; Samuelsson, K.; Muller, B.; Hofbauer, M.; Wolf, M.R.; Irrgang, J.J.; Fu, F.H.; Musahl, V. Quantitative evaluation of the pivot shift by image analysis using the iPad. Knee Surg. Sports Traumatol. Arthrosc. 2013, 21, 975–980. [Google Scholar] [CrossRef] [PubMed]
  7. Roessler, P.P.; Schüttler, K.F.; Heyse, T.J.; Wirtz, D.C.; Efe, T. The anterolateral ligament (ALL) and its role in rotational extra-articular stability of the knee joint: A review of anatomy and surgical concepts. Arch. Orthop. Trauma Surg. 2015, 136, 305–313. [Google Scholar] [CrossRef] [PubMed]
  8. Helfer, L.; Vieira, T.D.; Praz, C.; Fayard, J.M.; Thaunat, M.; Saithna, A.; Sonnery-Cottet, B. Triaxial accelerometer evaluation is correlated with IKDC grade of pivot shift. Knee Surg. Sports Traumatol. Arthrosc. 2020, 28, 381–388. [Google Scholar] [CrossRef] [PubMed]
  9. Vaidya, R.K.; Yoo, C.W.; Lee, J.; Han, H.-S.; Lee, M.C.; Ro, D.H. Quantitative assessment of the pivot shift test with smartphone accelerometer. Knee Surg. Sports Traumatol. Arthrosc. 2019, 28, 2494–2501. [Google Scholar] [CrossRef]
  10. Napier, R.J.; Feller, J.A.; Devitt, B.M.; McClelland, J.A.; Webster, K.E.; Thrush, C.S.; Whitehead, T.S. Is the KiRA Device Useful in Quantifying the Pivot Shift in Anterior Cruciate Ligament–Deficient Knees? Orthop. J. Sports Med. 2021, 9, 2325967120977869. [Google Scholar] [CrossRef] [PubMed]
  11. Lopomo, N.; Zaffagnini, S.; Bignozzi, S.; Visani, A.; Marcacci, M. Pivot-shift test: Analysis and quantification of knee laxity parameters using a navigation system. J. Orthop. Res. 2009, 28, 164–169. [Google Scholar] [CrossRef]
  12. Kuroda, R.; Hoshino, Y.; Araki, D.; Nishizawa, Y.; Nagamune, K.; Matsumoto, T.; Kubo, S.; Matsushita, T.; Kurosaka, M. Quantitative measurement of the pivot shift, reliability, and clinical applications. Knee Surg. Sports Traumatol. Arthrosc. 2011, 20, 686–691. [Google Scholar] [CrossRef]
  13. Zaffagnini, S.; Lopomo, N.; Signorelli, C.; Muccioli, G.M.M.; Bonanzinga, T.; Grassi, A.; Raggi, F.; Visani, A.; Marcacci, M. Inertial sensors to quantify the pivot shift test in the treatment of anterior cruciate ligament injury. Joints 2014, 2, 124–129. [Google Scholar] [CrossRef] [PubMed]
  14. Lopomo, N.; Signorelli, C.; Bonanzinga, T.; Muccioli, G.M.M.; Visani, A.; Zaffagnini, S. Quantitative assessment of pivot-shift using inertial sensors. Knee Surg. Sports Traumatol. Arthrosc. 2012, 20, 713–717. [Google Scholar] [CrossRef] [PubMed]
  15. Berumen-Nafarrate, E.; Carmona-González, J.; Tonche-Ramos, J.J.; Carmona-Máynez, O.; Aguirre-Madrid, A.; Reyes-Conn, R.A.; Ramos-Moctezuma, I.R.; Sigala-González, L.R.; Quintana-Trejo, F.N.; Moreno-Brito, V.; et al. Quantitative classification of the pivot-shift maneuver. Mex. Orthop. Act 2021, 35, 153–157. [Google Scholar] [CrossRef] [PubMed]
  16. Murase, A.; Nozaki, M.; Kobayashi, M.; Goto, H.; Yoshida, M.; Yasuma, S.; Takenaga, T.; Nagaya, Y.; Mizutani, J.; Okamoto, H.; et al. Comparison of quantitative evaluation between cutaneous and transosseous inertial sensors in anterior cruciate ligament deficient knee: A cadaveric study. J. Orthop. Sci. 2017, 22, 874–879. [Google Scholar] [CrossRef] [PubMed]
  17. Banik, S.; Melanthota, S.K.; Arbaaz; Vaz, J.M.; Kadambalithaya, V.M.; Hussain, I.; Dutta, S.; Mazumder, N. Recent trends in smartphone-based detection for biomedical applications: A review. Anal. Bioanal. Chem. 2021, 413, 2389–2406. [Google Scholar] [CrossRef] [PubMed]
  18. Tanaka, T.; Hoshino, Y.; Miyaji, N.; Ibaragi, K.; Nishida, K.; Nishizawa, Y.; Araki, D.; Kanzaki, N.; Matsushita, T.; Kuroda, R. The diagnostic reliability of the quantitative pivot-shift evaluation using an electromagnetic measurement system for anterior cruciate ligament deficiency was superior to those of the accelerometer and iPad image analysis. Knee Surg. Sports Traumatol. Arthrosc. 2018, 26, 2835–2840. [Google Scholar] [CrossRef]
  19. Majumder, S.; Deen, M.J. Smartphone Sensors for Health Monitoring and Diagnosis. Sensors 2019, 19, 2164. [Google Scholar] [CrossRef] [PubMed]
  20. Hunt, B.; Ruiz, A.J.; Pogue, B.W. Smartphone-based imaging systems for medical applications: A critical review. J. Biomed. Opt. 2021, 26, 040902. [Google Scholar] [CrossRef]
  21. Alafeef, M.; Fraiwan, M. Smartphone-based respiratory rate estimation using photoplethysmographic imaging and discrete wavelet transform. J. Ambient. Intell. Humaniz. Comput. 2019, 11, 693–703. [Google Scholar] [CrossRef]
  22. Tack, C. Artificial intelligence and machine learning|applications in musculoskeletal physiotherapy. Musculoskelet. Sci. Pract. 2018, 39, 164–169. [Google Scholar] [CrossRef]
  23. Hamed, M.G.; Akbari, A. Hierarchical Bayesian Classifier Combination. In Machine Learning and Data Mining in Pattern Recognition, Proceedings of the 14th International Conference, MLDM 2018, New York, NY, USA, 15–19 July 2018; Springer International Publishing: Berlin/Heidelberg, Germany, 2018; pp. 113–125. [Google Scholar] [CrossRef]
  24. Raschka, S.; Mirjalili, V. Python Machine Learning: Machine Learning and Deep Learning with Python, Scikit-Learn, and Tensorflow 2, 3rd ed.; Packt Publishing: Birmingham, UK, 2019. [Google Scholar]
  25. Calin, O. Deep Learning Architectures; Springer Series in the Data Sciences; Springer: Cham, Switzerland, 2021. [Google Scholar] [CrossRef]
  26. Nielsen, M.A. Neural Networks and Deep Learning; Determination Press: San Francisco, CA, USA, 2019; Available online: http://neuralnetworksanddeeplearning.com (accessed on 7 May 2023).
  27. Paluszek, M.; Thomas, S. Practical Matlab Deep Learning: A Project-Based Approach; Springer: Berlin/Heidelberg, Germany, 2020; pp. 1–252. [Google Scholar] [CrossRef]
  28. Vaudreuil, N.J.; Rothrauff, B.B.; de Sa, D.; Musahl, V. The Pivot Shift: Current Experimental Methodology and Clinical Utility for Anterior Cruciate Ligament Rupture and Associated Injury. Curr. Rev. Musculoskelet. Med. 2019, 12, 41–49. [Google Scholar] [CrossRef] [PubMed]
  29. Landis, J.R.; Koch, G.G. The Measurement of Observer Agreement for Categorical Data. Biometrics 1977, 33, 159–174. [Google Scholar] [CrossRef] [PubMed]
  30. Lopomo, N.; Zaffagnini, S.; Amis, A.A. Quantifying the pivot shift test: A systematic review. Knee Surg. Sports Traumatol. Arthrosc. 2013, 21, 767–783. [Google Scholar] [CrossRef] [PubMed]
  31. Hoshino, Y.; Araujo, P.; Ahlden, M.; Moore, C.G.; Kuroda, R.; Zaffagnini, S.; Karlsson, J.; Fu, F.H.; Musahl, V. Standardized pivot shift test improves measurement accuracy. Knee Surg. Sports Traumatol. Arthrosc. 2011, 20, 732–736. [Google Scholar] [CrossRef] [PubMed]
  32. Soudé, G.; Bargemon, J.-B.D.V.; Khakha, R.; Pithioux, M.; Argenson, J.-N.; Ollivier, M.; Jacquet, C. Pivot shift intraoperative quantitative assessment using a smartphone accelerometer in ACL deficient knees. J. Exp. Orthop. 2023, 10, 6. [Google Scholar] [CrossRef] [PubMed]
  33. Arilla, F.V.; Yeung, M.; Bell, K.; Rahnemai-Azar, A.A.; Rothrauff, B.B.; Fu, F.H.; Debski, R.E.; Ayeni, O.R.; Musahl, V. Experimental execution of the simulated pivot-shift test: A systematic review of techniques. Arthrosc. J. Arthrosc. Relat. Surg. 2015, 31, 2445–2454.e2. [Google Scholar] [CrossRef]
  34. Muller, B.; Hofbauer, M.; Rahnemai-Azar, A.A.; Wolf, M.; Araki, D.; Hoshino, Y.; Araujo, P.; Debski, R.E.; Irrgang, J.J.; Fu, F.H.; et al. Development of computer tablet software for clinical quantification of lateral knee compartment translation during the pivot shift test. Comput. Methods Biomech. Biomed. Eng. 2015, 19, 217–228. [Google Scholar] [CrossRef] [PubMed]
  35. Zaffagnini, S.; Signorelli, C.; Grassi, A.; Hoshino, Y.; Kuroda, R.; de Sa, D.; Sundemo, D.; Samuelsson, K.; Musahl, V.; Karlsson, J.; et al. Anatomic Anterior Cruciate Ligament Reconstruction Using Hamstring Tendons Restores Quantitative Pivot Shift. Orthop. J. Sports Med. 2018, 6, 2325967118812364. [Google Scholar] [CrossRef] [PubMed]
  36. Tisherman, R.T.; Patel, N.K.; Murphy, C.I.; Debski, R.E.; Musahl, V. Mobile application for quantification of the pivot shift examination: Intraoperative usability and utility during real-world deployment. J. ISAKOS Jt. Disord. Orthop. Sports Med. 2020, 5, 345–350. [Google Scholar] [CrossRef]
  37. Nakamura, K.; Koga, H.; Sekiya, I.; Watanabe, T.; Mochizuki, T.; Horie, M.; Nakamura, T.; Otabe, K.; Muneta, T. Evaluation of pivot shift phenomenon while awake and under anaesthesia by different manoeuvres using triaxial accelerometer. Knee Surg. Sports Traumatol. Arthrosc. 2015, 25, 2377–2383. [Google Scholar] [CrossRef]
  38. Berumen-Nafarrate, E.; Tonche-Ramos, J.; Carmona-González, J.; Leal-Berumen, I.; Vega-Nájera, C.A.; Díaz-Arriaga, J.M.; Espinoza-Sánchez, M.A.; Aguirre-Madrid, A. Interpretation of the Pivot Maneuver through the Use of Accelerometers in Patients Who Come to Orthopedic Consultation. Mexican Orthopedic Act. Available online: https://www.medigraphic.com/cgi-bin/new/resumen.cgi?IDARTICULO=62801 (accessed on 2 August 2023).
  39. Lerat, J.L.; Moyen, B.; Jenny, J.Y.; Perrier, J.P. A comparison of pre-operative evaluation of anterior knee laxity by dynamic X-rays and by the arthrometer KT 1000. Knee Surg. Sports Traumatol. Arthrosc. 1993, 1, 54–59. [Google Scholar] [CrossRef]
  40. Kunze, K.N.; Polce, E.M.; Ranawat, A.S.; Randsborg, P.-H.; Williams, R.J.; Allen, A.A.; Nwachukwu, B.U.; Pearle, A.; Stein, B.S.; Dines, D.; et al. Application of Machine Learning Algorithms to Predict Clinically Meaningful Improvement after Arthroscopic Anterior Cruciate Ligament Reconstruction. Orthop. J. Sports Med. 2021, 9, 23259671211046575. [Google Scholar] [CrossRef] [PubMed]
  41. Goebel, R.; Wahlster, W.; Siekmann, J. Lecture Notes in Artificial Intelligence Subseries of Lecture Notes in Computer Science LNAI Series Editors LNAI Founding Series Editor. Available online: http://www.springer.com/series/1244 (accessed on 15 May 2024).
  42. Rabb, E.; Steckenrider, J.J. Walking Trajectory Estimation Using Multi-Sensor Fusion and a Probabilistic Step Model. Sensors 2023, 23, 6494. [Google Scholar] [CrossRef]
  43. Kim, H.; Ghahramani, Z. Bayesian Classifier Combination: Proceedings of the Fifteenth International Conference on Artificial Intelligence and Statistics. Proc. Mach. Learn. Res. 2012, 22, 619–627. Available online: https://proceedings.mlr.press/v22/kim12.html (accessed on 15 May 2024).
  44. Labbe, D.R.; de Guise, J.A.; Mezghani, N.; Godbout, V.; Grimard, G.; Baillargeon, D.; Lavigne, P.; Fernandes, J.; Ranger, P.; Hagemeister, N. Objective grading of the pivot shift phenomenon using a support vector machine approach. J. Biomech. 2011, 44, 1–5. [Google Scholar] [CrossRef] [PubMed]
  45. Yanez-Diaz, R.; Roby, M.; Silvestre, R.; Zamorano, H.; Vergara, F.; Sandoval, C.; Neira, A.; Yanez-Rojo, C.; De la Fuente, C. Multiclass Support Vector Machine improves the Pivot-shift grading from Gerdy’s acceleration resultant prior to the acute Anterior Cruciate Ligament surgery. Injury 2023, 54, 1770–1774. [Google Scholar] [CrossRef] [PubMed]
  46. Zhang, W.; Sun, X.; Zhou, L.; Xie, X.; Zhao, W.; Liang, Z.; Zhuang, P. Dual-branch collaborative learning network for crop disease identification. Front. Plant Sci. 2023, 14, 1117478. [Google Scholar] [CrossRef]
  47. Zhang, W.; Li, Z.; Li, G.; Zhuang, P.; Hou, G.; Zhang, Q.; Li, C. GACNet: Generate Adversarial-Driven Cross-Aware Network for Hyperspectral Wheat Variety Identification. IEEE Trans. Geosci. Remote Sens. 2023, 62, 5503314. [Google Scholar] [CrossRef]
Figure 1. (A) X, Y, and Z axis of movement of gyroscopes integrated in a mobile device. (B) Placement of the mobile device on the anteromedial face of the tibia, two finger widths from the tibial tuberosity and attached with a sports-type cell phone bracelet. (C) X-axis signal can highlight the sequence of the pivot-shift maneuver: (a) flexion movement, (b) extension movement, and (c) joint reduction or “pivot”. It is also noticeable that this pattern repeats, giving a clue to the start of the next maneuver due to the peaks (PI–III).
Figure 1. (A) X, Y, and Z axis of movement of gyroscopes integrated in a mobile device. (B) Placement of the mobile device on the anteromedial face of the tibia, two finger widths from the tibial tuberosity and attached with a sports-type cell phone bracelet. (C) X-axis signal can highlight the sequence of the pivot-shift maneuver: (a) flexion movement, (b) extension movement, and (c) joint reduction or “pivot”. It is also noticeable that this pattern repeats, giving a clue to the start of the next maneuver due to the peaks (PI–III).
Jpm 14 00651 g001
Figure 2. Data Recording PSM App and signal processing flowchart.
Figure 2. Data Recording PSM App and signal processing flowchart.
Jpm 14 00651 g002
Figure 3. (AF) Signal processing. After normalizing the signal, it was segmented to obtain the important portion of data, which corresponds to the “pivot” (F). (G) Graphic difference between classes: 1, 2, 3, and 4 have a sinusoidal-based waveform, while class 0 has a plateau shape.
Figure 3. (AF) Signal processing. After normalizing the signal, it was segmented to obtain the important portion of data, which corresponds to the “pivot” (F). (G) Graphic difference between classes: 1, 2, 3, and 4 have a sinusoidal-based waveform, while class 0 has a plateau shape.
Jpm 14 00651 g003
Figure 4. Confusion matrices of AI tested for class 2 (A), class 3 (B), and class 4 (C).
Figure 4. Confusion matrices of AI tested for class 2 (A), class 3 (B), and class 4 (C).
Jpm 14 00651 g004
Table 2. CDP: grading system for knee laxity based on difference in millimeters measured by KT-1000 [15].
Table 2. CDP: grading system for knee laxity based on difference in millimeters measured by KT-1000 [15].
GradeDifference in mmMeaning
00–2Almost null laxity
13Low laxity
24–5Considerable laxity
3>6High laxity
Table 3. Summary of signal features arrangement for the ICC analysis.
Table 3. Summary of signal features arrangement for the ICC analysis.
Evaluator AEvaluator N
Peak IPeak IIPeak IIIPeaks I, II, III
Subject n − 1
Subject 45Time of detection (cs)
111.00267.00448.00
Amplitude (rad/s)
137.54179.86156.83
Subject n + 1
Table 4. Classification of participants according to their potential degree of laxity.
Table 4. Classification of participants according to their potential degree of laxity.
Grade of LaxityNumber of Subjects
010
19
29
32
Table 5. Accuracy of ML used to classify by grade of laxity with raw signals.
Table 5. Accuracy of ML used to classify by grade of laxity with raw signals.
Machine Learning MethodAccuracy (%)
Logistic Regression40
Support Vector Machine20
Decision Tree40
Random Forest40
Table 6. Performance metrics of every ML method used to classify “Pivot” signals by class.
Table 6. Performance metrics of every ML method used to classify “Pivot” signals by class.
Machine Learning MethodAccuracy (%)Recall (%)Precision (%)F1-Score
Logistic Regression28.5728.5728.570.2857
Support Vector Machine1001001001.0
Decision Tree85.7185.7185.710.8571
Random Forest85.7185.7185.710.8571
Table 7. Performance metrics of ML methods used to classify by grade of laxity per class.
Table 7. Performance metrics of ML methods used to classify by grade of laxity per class.
Class 2Accuracy (%)Recall (%)Precision (%)F1-Score
Logistic Regression100100100100
Support Vector Machine33333333
Decision Tree100100100100
Random Forest100100100100
Class 3Accuracy (%)Recall (%)Precision (%)F1-Score
Logistic Regression0000
Support Vector Machine33333333
Decision Tree100100100100
Random Forest66666666
Class 4Accuracy (%)Recall (%)Precision (%)F1-Score
Logistic Regression66666666
Support Vector Machine66666666
Decision Tree100100100100
Random Forest100100100100
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Berumen-Nafarrate, E.; Ramos-Moctezuma, I.R.; Sigala-González, L.R.; Quintana-Trejo, F.N.; Tonche-Ramos, J.J.; Portillo-Ortiz, N.K.; Cañedo-Figueroa, C.E.; Aguirre-Madrid, A. Mobile App for Enhanced Anterior Cruciate Ligament (ACL) Assessment in Conscious Subjects: “Pivot-Shift Meter”. J. Pers. Med. 2024, 14, 651. https://doi.org/10.3390/jpm14060651

AMA Style

Berumen-Nafarrate E, Ramos-Moctezuma IR, Sigala-González LR, Quintana-Trejo FN, Tonche-Ramos JJ, Portillo-Ortiz NK, Cañedo-Figueroa CE, Aguirre-Madrid A. Mobile App for Enhanced Anterior Cruciate Ligament (ACL) Assessment in Conscious Subjects: “Pivot-Shift Meter”. Journal of Personalized Medicine. 2024; 14(6):651. https://doi.org/10.3390/jpm14060651

Chicago/Turabian Style

Berumen-Nafarrate, Edmundo, Ivan Rene Ramos-Moctezuma, Luis Raúl Sigala-González, Fatima Norely Quintana-Trejo, Jesus Javier Tonche-Ramos, Nadia Karina Portillo-Ortiz, Carlos Eduardo Cañedo-Figueroa, and Arturo Aguirre-Madrid. 2024. "Mobile App for Enhanced Anterior Cruciate Ligament (ACL) Assessment in Conscious Subjects: “Pivot-Shift Meter”" Journal of Personalized Medicine 14, no. 6: 651. https://doi.org/10.3390/jpm14060651

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop