Next Article in Journal
NMGrad: Advancing Histopathological Bladder Cancer Grading with Weakly Supervised Deep Learning
Next Article in Special Issue
Musculoskeletal Disorder Risk Assessment during the Tennis Serve: Performance and Prevention
Previous Article in Journal
Meibomian Gland Dysfunction and Dropout in Diabetic Patients with Non-Proliferative Diabetic Retinopathy
Previous Article in Special Issue
The Efficacy of Body-Weight Supported Treadmill Training and Neurotrophin-Releasing Scaffold in Minimizing Bone Loss Following Spinal Cord Injury
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Optimizing Fall Risk Diagnosis in Older Adults Using a Bayesian Classifier and Simulated Annealing

by
Enrique Hernandez-Laredo
1,
Ángel Gabriel Estévez-Pedraza
1,*,
Laura Mercedes Santiago-Fuentes
2 and
Lorena Parra-Rodríguez
3
1
Tianguistenco Professional Academic Unit, Autonomous University of the State of Mexico, Tianguistenco 52640, Mexico
2
Health Science Department, Metropolitan Autonomous University, Mexico City 09310, Mexico
3
Research Department, National Institute of Geriatrics, Mexico City 10200, Mexico
*
Author to whom correspondence should be addressed.
Bioengineering 2024, 11(9), 908; https://doi.org/10.3390/bioengineering11090908
Submission received: 7 August 2024 / Revised: 6 September 2024 / Accepted: 6 September 2024 / Published: 11 September 2024

Abstract

:
The aim of this study was to improve the diagnostic ability of fall risk classifiers using a Bayesian approach and the Simulated Annealing (SA) algorithm. A total of 47 features from 181 records (40 Center of Pressure (CoP) indices and 7 patient descriptive variables) were analyzed. The wrapper method of feature selection using the SA algorithm was applied to optimize the cost function based on the difference of the mean minus the standard deviation of the Area Under the Curve (AUC) of the fall risk classifiers across multiple dimensions. A stratified 60–20–20% hold-out method was used for train, test, and validation sets, respectively. The results showed that although the highest performance was observed with 31 features (0.815 ± 0.110), lower variability and higher explainability were achieved with only 15 features (0.780 ± 0.055). These findings suggest that the SA algorithm is a valuable tool for feature selection for acceptable fall risk diagnosis. This method offers an alternative or complementary resource in situations where clinical tools are difficult to apply.

1. Introduction

Globally, the World Health Organization (WHO) estimates that 684,000 fatal falls and 37.7 million falls serious enough to require medical attention occur annually, which involves various health problems and considerable economic costs at the public health, family, and personal levels [1]. About 35% of older adults have at least one fall per year [2,3], and this percentage increases to 32–42% for those over 70 years, making this population group one of the most vulnerable to injury or even death from a fall [1,3].
Given the relevance and implications of this public health problem in the adult population, it is important to make a correct and timely diagnosis. Balance assessment has been used to identify a possible fall risk, either through the use of technological systems [4] or by applying clinical tools based on questionnaires and standardized physical tests, such as Short Physical Performance Battery (SPPB), Timed Up and Go (TUG), Berg Balance Scale (BBS), Short Falls Efficacy Scale-International, Mini-Balance Evaluation Systems Test (Mini-BESTest), etc. [5]. However, the questionnaires have questionable accuracy and are not generalizable since they are susceptible to bias, as the evaluations are partially subjective and depend on the experience and ability of the evaluator [6]. Likewise, asking the fallers questions about the accidents they have had causes anxiety and stress due to the negative memories that are triggered, and at other times, they do not remember the fall or the number of falls [7,8]. These limitations can be reduced by using affordable technologies such as force platforms [9] and its low-cost alternatives [10,11]. These platforms allow for a quantitative study called stabilometry [12], from which Center of Pressure (CoP) indices can be obtained that allow for the characterization of the body sway by metrics and graphs [13,14].
The use of artificial intelligence techniques has made it possible to generate predictive or diagnostic models for balance alterations and/or fall risk based on sociodemographic, anthropometric, and CoP indices [15,16,17,18,19,20,21,22]. Specifically, it has been observed that Machine Learning algorithms based on Bayesian [22] and Decision Tree [15,23,24] classifiers, and Multi-Layer Perceptron [20] perform better in assessing fall risk compared with other techniques. On the other hand, Deep Learning techniques, particularly Neural Networks, are innovative methods that offer superior accuracy compared to traditional approaches [25]. However, these techniques often present challenges in interpretability, making it difficult to explain the studied phenomenon based on the input features. Furthermore, their performance may be compromised when trained on limited datasets [26,27]. This limitation is particularly relevant in the field of static stabilometry, where available data sources are often scarce [28].
Predicting an infrequent future event like falls is inherently challenging [28], so it is necessary to optimize feature selection to improve the performance of Machine Learning models [20] and provide a better explanation of which CoP indices best describe fall risk, as even with numerous research, it has been impossible to reach a consensus [29,30]. As such, this paper presents the Bayesian classification technique in combination with the heuristic approach of Simulated Annealing (SA) for feature selection to increase the diagnostic prediction of fall risk classifiers using human balance data from a sample of older adults. The current work could contribute to the production of an optimal computational model capable of predicting fall risk from quick stabilometric assessment.

2. Materials and Methods

2.1. Subjects and Preprocessing

For this study, a “public data set of human balance evaluations” database was used [31]. This includes information on 116 females and 47 males, aged 18 to 85 years. The participants were assessed repeatedly three times to obtain their stabilometric data using a force platform (OPT400600-1000; AMTI, Watertown, MA, USA), and their Short Falls Efficacy Scale-International (Short FES-I) scores were registered. Additionally, the dataset includes details such as sex, age, height, weight, body mass index (BMI), fall history, foot length, and polypharmacy.
Only information from older adults aged 60 years or older were used, who were labeled as Fall Risk if they recorded ≥1 fall in the previous 12 months and/or were rated as being of high concern in the Short FES-I. From each subject, 40 CoP indices were calculated according to Prieto [14]. To balance the dataset concerning the number of records per class, only the first set of repeated tests was selected for the Non-Fall Risk class, while for the Fall Risk class, 3 repeated tests were selected.
The CoP indices, age (years), weight (kilograms), height (centimeters), BMI (kilograms/meters2), and foot length (centimeters) were also used as continuous variables, polypharmacy as a discrete variable, while sex was used as a dichotomic variable (man or woman).

2.2. Bayesian Classifier

2.2.1. Statistical Analysis

A descriptive analysis was performed. Continuous and discrete variables are presented as means and standard deviations, and sex as a number and percentage. The normality of the continuous variables was assessed using Kolmogorov–Smirnov test. Comparisons of Fall Risk versus Non-Fall Risk individuals were estimated through a T-test for parametric variables, a Mann–Whitney test for non-parametric variables, and a χ2 test for categorical variables. The predictive validity of a Fall Risk for all continuous and discrete variables was assessed using the Hosmer–Lemeshow Goodness of Fit test and the Area Under the Curve (AUC).

2.2.2. Model Architecture

A Bayesian classifier was used to generate a fall risk model. According to Bayes’ theorem, the probability of belonging to the Fall Risk class ( P F R ) is given by Equation (1):
P F R = P × 1 2 π k 2 × S 1 2 × e 1 2 X ¯ μ × X ¯ μ S
where P denotes the a priori probability of the classes (equiprobability between classes), μ is the mean value of the class in the feature space, S is the covariance matrix of the features, X ¯ is the feature vector, and k is the number of features. On the other hand, the probability of the class Non-Fall Risk ( P N F R ) is given by the complementary probability of P F R , which is P N F R = 1 P F R . Therefore, the classifier prediction rule is given by Equation (2):
    i f   P F R >   P N F R                                                               F a l l   R i s k                 e l s e                                                                                     Non- F a l l   R i s k
All features’ values were standardized to a zero mean and unit variance so that they are dimensionless and have the same scale. The Bayesian classifier was coded and executed in a script of MATLAB® version 2024A. For more details about the scripts, please refer to the link for the public repository on GitHub.

2.3. Feature Selection by the Simulated Annealing Algorithm

For the feature selection task, the SA algorithm was used to optimize the performance of the Bayesian classifier. In that sense, the problem was represented through an array with n available elements ( n = Bayesian classifier number dimensions); to assign n , random indices of m features are available ( m = total numbers of features). The initial solution was composed by 4 patient descriptive variables (sex, BMI, age, polypharmacy) [3,16] and 7 CoP indices (total length ML, total length AP, 95% conf. ellipse area, mean velocity, mean velocity-AP, mean frequency, and RMS distance), which have been shown to be associated with the fall risk in older adults [16,32,33,34,35]. For dimensions greater than 11 features, the initial solution was represented by the optimal feature combination from the SA optimization of the previous dimension and the addition of a random feature.
The cost function was integrated as the difference of the mean and standard deviation of the AUC of the train, test, and validation sets. On the other hand, for initial parameters, an initial temperature (T) of 0.5979 was calculated using an initial acceptance probability of 0.9 according to [36]. A stop temperature (Tmin) of 0.0232 [37], geometric cooling with an additive constant of 0.82 [36,38], and an adaptive steady state (Lk) with 30 iterations were used.
The original SA algorithm [39] was modified by adding two improvements. First, the cost function was penalized with a value equal to 0 when the sensitivity or specificity of the train, test, or validation set was less than 0.6. Second, the result of the cost function of each SA iteration was stored in a vector, with the purpose of finding the maximum value of the cost function at the end of all SA iterations. Algorithm 1 shows the pseudocode used.
Algorithm 1: Feature selection algorithm based on simulated annealing
Input: Training dataset
Output: Optimal Feature Combination = best_features
1. T = 0.5979
2. Tmin = 0.0232
3. Lk = 30
4. Initial solution is declared
5. C0 = the function cost value of initial solution
6. i = 1                %% number of iterations
7. n = 11                %% n = dimensions
8. Cp = 0                %% function cost value of current solution
9. do while (T > Tmin):
10.    Generate a n-dimension random solution array
11.    Training Bayesian classifier
12.    Calculate the Bayesian classifier’s AUC for the train, test and validation sets.
13.     if ((sensibility or specificity) < 0.6):
14.         Cost_function [i] = 0
15.     else:
16.         Cost_function [i] = mean (AUC_train, AUC_test, AUC_validation) −
                  std (AUC_train, AUC_test, AUC_validation)
17.     Cp = max (Cost_function)
18.     DeltaE = Cp − C0
19.     if (DeltaE >= 0):
20.          C0 = Cp
21.          features [i] = last n-dimension random solution array
22.     elseif exp(DeltaE/(T)) > rand(1,1):
23.          C0 = Cp
24.          features [i] = last n-dimension random solution array
25.     k = k + 1
26.     T = T *× 0.82
27.     Lk = Lk + Lk × (1 − exp(−1))
28. best_features [n] = features (find (max (Cost_function))
29. n = n + 1
30. Restart pseudocode

2.4. Validation Strategies and Evaluation Metrics

The most used validation method with stabilometric datasets has been the 80–20% hold-out method [15,20,23], and to ensure a better comparison, this method was selected. However, to decrease the probability of bias, the data were divided into the train, test, and validation sets, corresponding to 60%, 20%, and 20%, respectively [40], using the stratified hold-out method based on the fall risk label. The sensitivity, specificity, and AUC metrics were used to evaluate the performance of the Bayesian classifier’s optimal feature combination.
To assess the robustness of the top five feature combinations with the highest AUC, 150 new training sets were generated using the bootstrap aggregation technique from the original set. This approach enabled the construction of an ensemble learning model composed of 150 Bayesian classifiers, with the objective of analyzing in detail the impact of the optimal features through the performance of the mean AUC for fall risk diagnosis.
In addition, a univariate logistic regression model was generated for each CoP index, and its AUC was compared with the performance of the Bayesian classifier. These models were also made in MATLAB® version 2024A.

3. Results

Information from 76 individuals was included in the study. The mean age of these participants was 71.31 ± 6.47 years, 78.94% of the sample was women, and 38.15% presented fall risk conditions. Due to the balance of the data described in Section 2.1, a total of 181 stabilometric assessments were included, of which 94 records corresponded to the Non-Fall Risk class and 87 to the Fall Risk class. Features such as sex, foot length, 50% power frequency-RD, 95% power frequency-RD, 50% power frequency-AP, total power-ML, 95% power frequency-ML, centroidal frequency-RD, frequency dispersion-AP, and frequency dispersion-AP showed significant differences between the Non-Fall Risk and Fall Risk groups. The description of general participant characteristics and statistical analysis of the CoP indices are shown in Table 1 and Table A1, respectively.
The CoP index with the best level of predictive validity according to its AUC is frequency dispersion-AP (AUC = 0.591). Table 2 shows the Top 5 CoP indices with the highest AUC and the full results are shown in Table A1.
The SA algorithm was executed to identify the optimal feature combination, beginning with n = 11 (refer to Section 2.3). The process continued until adding more features no longer resulted in a decrease in the cost function for at least three consecutive dimensions. It was observed that after incorporating n = 32 features, the performance of the classifier began to decline (see the full content in Table A2 and the dictionary features in Table A3). Through all the iterations, sex, BMI, total length-AP, covariance-ML, and 95% power frequency-AP were the most frequent in feature selection, as shown in Figure 1.
Table 3 shows the optimal Bayesian classification models obtained using feature combinations selected by the SA algorithm. The 31-feature model (Top 1) demonstrated the highest mean AUC of 0.815 ± 0.110 for hold-out validation, though this value decreased by 8% under bootstrap aggregation validation. Conversely, the 15-feature model (Top 4) exhibited the lowest variability between sets at 0.780 ± 0.055. These features maintained their robustness more effectively, showing only a 0.7% decrease. Figure 2 illustrates the selected features comprising these top-performing classifiers.
Features such as standard deviation RD, total power AP, and sex consistently appear in all selected optimal combinations. Regarding the sex variable, it was necessary to study its possible influence given the difference in the proportion of women with respect to men in the study sample. Therefore, a mean difference analysis was performed (see results in Table 4) showing that 8 of the 14 predictor variables show a statistically significant difference between sexes.
This finding suggests that the disproportionality in the sample could introduce a bias in the generalization of the classifier’s results. However, it is pertinent to note that it has previously been suggested [41] that sex could be a relevant predictor to characterize the fall risk. In the context of the Bayesian paradigm, the conditional and marginal probabilities associated with sex could significantly contribute to the precise discrimination of fall risk classes. Nevertheless, to study the true influence of sex, it is necessary to increase the dataset heterogeneously, which underscores the importance of generating new public stabilometric datasets in biomedical research.
On the other hand, Figure 3 shows the performance of the SA algorithm of the AUC mean value concerning the size of the dimensions, where no general trend is observed. This is confirmed by a correlation coefficient value of −0.083. However, the performance of the classifier was inversely correlated with the solution space, with a value of −0.303.
Moreover, the univariate logistic regression models generated for each feature presented a maximum performance for the centroidal frequency-RD CoP index, with AUC’s mean and standard deviation of 0.623 ± 0.107 for train, test, and validation sets. The complete results of the logistic regressions are available in Table A4.

4. Discussion

There are clinical tools that are able to predict the fall risk with the help of expert evaluators’ judgments based on extensive questionnaires to which elderly patients often do not know how to respond with certainty, and may also involve the execution of physical tests that may generate stress or fear, so previous factors alter the reliability of the results [42,43,44,45,46]. On the other hand, the use of stabilometry allows for a CoP index calculation that provides quantitative data to obtain more objective results, which, in combination with patient descriptive variables and heuristic search methods, can be useful for fall risk prediction based on computational classifier models.
The predictive capacity of classifiers based on Machine Learning benefits from feature selection, which aims at extracting the most explanatory data of the phenomenon to be predicted, and eliminating irrelevant and redundant data to reduce the dimensionality (number of features to be used) of the classifiers [47]. SA is a metaheuristic search algorithm analogously inspired by the statistical physics of heating and cooling annealing processes in metals, which can find an optimal cost function value in a large solution space. Its performance and relative ease of application have made it one of the most popular techniques for solving combinatorial problems, including feature selection [39,48,49].
Feature selection methods can be divided into filter, wrapper, and embedded methods. Filter methods perform the selection based on statistical tests such as correlations, goodness of fit, significance of coefficients, etc. On the other hand, wrapper methods select the best features by optimizing the performance of a previously chosen classification algorithm, as in the case of the Bayesian classifier optimized by SA. On the contrary, in embedded methods, feature selection is integrated in the classifier algorithm, since during the training step, its parameters are adjusted by determining the importance of each feature to produce the best diagnostic capacity [47]. Previous findings suggest that wrapper methods perform best in identifying fall risk using Machine Learning and/or statistical models [20].
This study used 47 features, of which 7 were related to participant information and 40 CoP indices, including time, frequency, and hybrid domain metrics. These were used to generate classification models based on Bayesian techniques optimized by SA, which were subsequently compared with feature selection techniques based on filter methods and univariate logistic regression models.
The best performance of the univariate logistic regression models was the centroidal frequency-RD index, which matched the selection of the Hosmer–Lemeshow goodness-of-fit methods and the mean difference test; however, its performance was poor (maximum mean AUC and standard deviation of 0.623 ± 0.107 for the training, test, and validation sets). Comparatively, the SA algorithm showed the ability to automatically identify the set of descriptor characteristics for fall risk, maximizing the diagnostic capability. Although the highest performance was presented when the algorithm selected 31 characteristics (Top 1), the results that presented less variability in the phenomenon to be predicted were given when the algorithm selected 15 characteristics (Top 4). Among these selection proposals, there was a difference of 0.035 between the diagnostic capabilities given by their AUC means.
Compared to previous studies, the predictive model proposed in Top 1 demonstrates an AUC performance improvement of at least 6.5%. Table 5 provides a detailed comparison with other works that have used static stabilometry to classify fall risk through computational or statistical methods.
Features such as sex, weight, BMI, mean distance, total length AP, standard deviation of RD, mean frequency-ML, range, total power-AP, 95% power frequency-AP, 50% power frequency-ML, centroidal frequency-RD, centroidal frequency-AP, frequency dispersion-AP, and centroidal frequency-ML compose the optimal combination (Top 4). Of these, only the features sex, weight, BMI, and total length-AP were included in the initial proposed solution based on the state of the art. This demonstrates the ability of the SA algorithm to overcome local optima by selecting features that maximize the cost function.
On the other hand, in our previous findings [51], the range, total power-AP, and standard deviation of RD indices were included among the 10 CoP indices with the highest AUC for identifying balance alterations in older adults with a high prevalence of poor physical performance identifying the optimal cut-off point, while the total power-AP, 95% power frequency-AP, and centroidal frequency-AP indices were associated with the prediction of balance alterations in healthy older adults [16]. This supports 9 of the 15 characteristics selected by the SA algorithm, and with the inclusion of the 6 complementary ones, new evidence is provided for the understanding of the fall risk phenomenon in older adults. Furthermore, the current research suggests that frequency and hybrid CoP indices have equal or better descriptive power than time domain indices. However, their use is not as widespread in the state of the art, since due to the computational power, they need to be calculated, and most commercial systems are limited to providing CoP indicators in the time domain.
In other findings, an inverse correlation was observed between the size of the search space and the ability to select an optimal combination of the SA algorithm. In the present problem, the maximum search space was given by 5.38258 × 1011 of possible combinations corresponding to 21 dimensions, but as shown in Figure 3, as the SA algorithm approached this maximum and the number of dimensions increased, its performance decreased. This trend continued only up to 24 dimensions (Top 3), where the solution space was reduced to 3.53697 × 1011. The performance of the cost function continued to improve as features were added to the classifier, from 24 up to 31. However, although the solution space kept decreasing for higher dimensions, the performance of the Bayesian classifier was affected. This suggests the occurrence of the so-called “curse of dimensionality” starting from 31 or more features in this dataset.
A limitation of the present study was the use of CoP indices derived only from stabilometric tests under conditions of a firm surface and open eyes; however, this dataset was analyzed because it comes from a test that is simpler and faster to perform and may be generalizable not only to people of different ages, but also with different cognitive and physical abilities. In this context, to avoid a disproportionate increase in the solution space affecting the performance of the SA algorithm, the number of features was limited to the 47 commonly analyzed in the stabilometric domain. Based on the performance observed in the Top 4, it would be important to highlight that future studies could incorporate new nonlinear-type experimental features and apply advanced feature extraction techniques, such as Deep Learning, Genetic Programming, and Codebook-based approaches, which have been shown to perform well in other biomedical areas, such as gait analysis [27] and heart rate variability [54], among others. Another limitation of the study lies in the data sample analyzed, since it is relatively small and has a bias influenced by the predominance of the female ratio in the sample under study, with only 21.06% corresponding to information from men.
The observation of statistically significant sex differences in Top 4 predictor variables underscores the need to apply sex-stratified analyses in future research, provided that a more complete dataset is available. Such stratification could reveal sex-specific patterns that would otherwise be hidden in general analyses. Furthermore, these potential approaches could substantially improve both the predictive accuracy and clinical utility of fall risk assessment tools.

5. Conclusions

The results suggest that the SA algorithm is a useful tool to perform feature selection in Bayesian classifiers for the diagnosis of fall risk from CoP indices and patient descriptive variables. This is advantageous because it provides an alternative or complementary and generalized resource with an acceptable level of fall risk assessment for people for whom the physical activities involved in clinical tools may be challenging.

Supplementary Materials

Supporting information about the database, result tables, and source code can be downloaded from the public repository (https://github.com/enriquehdez98/Fall-Risk-Diagnosis-) on GitHub.

Author Contributions

Conceptualization, E.H.-L., Á.G.E.-P., L.M.S.-F. and L.P.-R.; methodology, E.H.-L., Á.G.E.-P., L.M.S.-F. and L.P.-R.; software, E.H.-L., Á.G.E.-P. and L.M.S.-F.; validation, L.M.S.-F. and L.P.-R.; formal analysis, E.H.-L., Á.G.E.-P. and L.M.S.-F.; investigation, E.H.-L. and Á.G.E.-P.; resources, E.H.-L., Á.G.E.-P. and L.P.-R.; data curation, E.H.-L. and L.M.S.-F.; writing—original draft preparation, E.H.-L., Á.G.E.-P., L.M.S.-F. and L.P.-R.; writing—review and editing, E.H.-L., Á.G.E.-P., L.M.S.-F. and L.P.-R.; visualization, E.H.-L. and Á.G.E.-P.; supervision, L.M.S.-F. and L.P.-R.; project administration, E.H.-L. and Á.G.E.-P.; funding acquisition, Á.G.E.-P. All authors have read and agreed to the published version of the manuscript.

Funding

The publication of this paper was supported by Universidad Autónoma del Estado de México, Mexico.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Databases are anonymized and available as Supplementary Material.

Acknowledgments

We would like to extend our sincere gratitude to Lilyam Lizette Olmos García-Rojas for her invaluable support in the initial stage of the algorithm’s programming. Her commitment and dedication were instrumental in the development of this research. In addition, we thank the “Sistemas Mecatrónicos y Computacionales Aplicados, UAEMéx-UAPT” academic team and its leader M.C.V.E., for providing the infrastructure to carry out this research.

Conflicts of Interest

The authors declare no conflicts of interest.

Appendix A

Table A1. Statistical analysis of the CoP indices.
Table A1. Statistical analysis of the CoP indices.
CoP IndexTotalNon-Fall RiskFall
Risk
KS
Test
MD
Test
HL
Test
AUC (95% CI)
n = 181n = 94n = 87p-Valuep-Valuep-Value
Mean distance [mm]5.16 ± 2.454.95 ± 2.025.39 ± 2.830.000 *0.3220.8280.542 (0.457–0.627)
Mean distance-ML [mm]4.00 ± 2.153.84 ± 1.834.17 ± 2.440.000 *0.3390.5150.541 (0.456–0.625)
Mean distance-AP [mm]2.46 ± 1.182.35 ± 0.982.57 ± 1.360.000 *0.4300.8240.534 (0.449–0.618)
RMS distance [mm]5.96 ± 2.835.71 ± 2.296.23 ± 3.310.000 *0.3180.5030.543 (0.458–0.627)
RMS distance-ML mm]5.00 ± 2.654.78 ± 2.165.24 ± 3.090.000 *0.3030.430.544 (0.459–0.628)
RMS distance-AP
[mm]
3.08 ± 1.422.97 ± 1.243.2 ± 1.590.000 *0.4480.4480.532 (0.447–0.617)
Total Length [mm]713.92 ± 333.48694.21 ± 269.03735.22 ± 391.930.000 *0.6070.1160.477 (0.391–0.564)
Total length ML [mm]563.81 ± 272.52536.17 ± 217.65593.67 ± 320.130.000 *0.9430.015 *0.503 (0.414–0.591)
Total length AP [mm]324.71 ± 158.24330.34 ± 141.11318.62 ± 175.510.000 *0.1610.026 *0.439 (0.355–0.524)
Mean velocity [mm/s]11.89 ± 5.5511.57 ± 4.4812.25 ± 6.530.000 *0.6070.1160.477 (0.391–0.564)
Mean velocity-ML [mm/s]9.39 ± 4.548.93 ± 3.629.89 ± 5.330.000 *0.9430.015 *0.503 (0.414–0.591)
Mean velocity-AP [mm/s]5.41 ± 2.635.5 ± 2.355.31 ± 2.920.000 *0.1610.026 *0.439 (0.355–0.524)
Standard deviation of RD [mm]2.94 ± 1.472.82 ± 1.133.08 ± 1.770.000 *0.2670.4650.547 (0.463–0.632)
95% conf. Circle area [mm2]38.79 ± 55.9533.49 ± 31.0544.52 ± 73.80.000 *0.2760.5860.547 (0.462–0.631)
Covariance ML
[mm2]
0.01 ± 0.870.11 ± 0.84-0.09 ± 0.90.000 *0.2140.8480.446 (0.362–0.53)
95% conf. Ellipse area [mm2]31.48 ± 37.6227.33 ± 23.5735.97 ± 48.190.000 *0.2140.150.553 (0.468–0.638)
Sway area [mm2/s]2.01 ± 2.351.78 ± 1.462.26 ± 3.020.000 *0.6190.460.521 (0.435–0.607)
Mean frequency [Hz]3.90 ± 1.433.97 ± 1.373.82 ± 1.510.000 *0.1810.2990.442 (0.357–0.527)
Mean frequency-ML [Hz]4.54 ± 1.814.55 ± 1.754.53 ± 1.890.000 *0.7180.5970.484 (0.399–0.569)
Mean frequency-AP [Hz]4.19 ± 1.704.39 ± 1.723.96 ± 1.670.000 *0.0790.4270.424 (0.34–0.508)
Fractal dimension-CC [-]17.04 ± 1.1817.12 ± 1.1516.95 ± 1.220.027 *0.2050.028 *0.445 (0.36–0.53)
Fractal dimension-CE [-]17.29 ± 1.1317.38 ± 1.0517.2 ± 1.210.025 *0.0920.2170.427 (0.342–0.512)
Range [mm]28.50 ± 13.3926.97 ± 9.7530.15 ± 16.340.000 *0.1460.2760.562 (0.478–0.647)
Range-ML [mm]27.29 ± 13.2825.66 ± 9.3529.06 ± 16.390.000 *0.1190.029 *0.567 (0.482–0.651)
Range-AP [mm]16.82 ± 7.2316.51 ± 6.8917.15 ± 7.610.000 *0.7230.2480.515 (0.43–0.6)
Total power-RD [mm2/Hz]32.63 ± 56.5325.7 ± 18.2540.12 ± 78.860.000 *0.0970.9080.571 (0.487–0.655)
50% power frequency-RD [Hz]3.21 ± 1.863.45 ± 1.882.94 ± 1.80.000 *0.023 *0.780.402 (0.319–0.485)
95% power frequency-RD [Hz]14.10 ± 4.0514.61 ± 3.7513.54 ± 4.290.002 *0.032 *0.044 *0.407 (0.323–0.492)
Total power-AP [mm2/Hz]22.42 ± 19.4921.6 ± 18.8923.31 ± 20.190.000 *0.7270.4520.515 (0.43–0.599)
50% power frequency-AP [Hz]2.65 ± 1.962.91 ± 2.092.38 ± 1.770.000 *0.039 *0.0770.411 (0.328–0.494)
95% power frequency-AP [Hz]9.82 ± 2.509.91 ± 2.449.73 ± 2.570.2000.6390.1910.48 (0.395–0.565)
Total power-ML [mm2/Hz]63.14 ± 114.6345.52 ± 32.6482.17 ± 160.140.000 *0.048 *0.9960.585 (0.501–0.668)
50% power frequency-ML [Hz]2.61 ± 1.802.8 ± 1.842.41 ± 1.740.000 *0.0560.4250.417 (0.334–0.501)
95% power frequency-ML [Hz]10.99 ± 2.7611.38 ± 2.5710.57 ± 2.90.2000.048 *0.240.442 (0.357–0.526)
Centroidal frequency-RD [Hz]7.08 ± 2.047.37 ± 1.946.75 ± 2.110.028 *0.017 *0.1720.396 (0.313–0.48)
Frequency dispersion-RD [-]7.32 ± 0.617.27 ± 0.657.38 ± 0.560.005 *0.1880.6280.556 (0.472–0.64)
Centroidal frequency-AP [Hz]5.41 ± 1.575.61 ± 1.65.2 ± 1.510.013 *0.0900.0540.427 (0.343–0.51)
Frequency dispersion-AP [-]7.27 ± 1.067.13 ± 1.097.42 ± 1.010.000 *0.034 *0.4000.591 (0.508–0.674)
Centroidal frequency-ML [Hz]5.87 ± 1.546.12 ± 1.455.6 ± 1.60.2000.022 *0.0810.418 (0.334–0.502)
Frequency dispersion-ML [-]7.39 ± 0.897.35 ± 0.897.44 ± 0.890.000 *0.3710.0880.538 (0.453–0.623)
n = sample size, KS = Kolmogorov–Smirnov, MD = mean difference, HL = Hosmer–Lemeshow, CI = confidence interval, * p-value < 0.05
Table A2. Bayesian classifier performance results using Simulated Annealing.
Table A2. Bayesian classifier performance results using Simulated Annealing.
nCombination of Optimal FeaturesTrainTestValidation
SESPAUCSESPAUCSESPAUC
111, 2, 15, 19, 20, 21, 36, 37, 43, 44, 450.7690.750.7590.8880.7360.8120.7640.6840.724
121, 2, 4, 10, 16, 17, 23, 30, 34, 37, 42, 470.750.8210.7850.7770.6310.7040.7050.7360.721
131, 4, 5, 16, 17, 18, 22, 29, 30, 37, 42, 44, 470.8650.750.8070.8330.6310.7320.8230.7360.78
141, 3, 4, 8, 12, 16, 18, 22, 35, 36, 37, 42, 44, 470.7880.8030.7960.8880.6840.7860.7640.7360.75
151, 3, 4, 8, 16, 20, 26, 30, 36, 38, 40, 42, 44, 45, 460.8070.8570.8320.9440.6310.7880.7050.7360.721
161, 2, 4, 6, 7, 12, 13, 16, 17, 20, 22, 27, 32, 38, 42, 430.8460.8030.8240.7220.7360.7290.7050.7890.747
171, 2, 4, 5, 7, 9, 13, 17, 22, 27, 30, 35, 37, 38, 40, 43, 470.8840.8210.8530.6660.7360.7010.7050.8420.773
181, 3, 4, 6, 7, 8, 11, 19, 20, 24, 27, 28, 30, 34, 36, 38, 40, 420.7110.8570.7840.7770.7360.7570.7640.7360.75
192, 4, 5, 6, 7, 9, 10, 11, 13, 14, 16, 20, 32, 33, 34, 36, 40, 42, 470.7880.8920.840.6660.6840.6750.7640.7890.777
201, 3, 4, 6, 7, 10, 11, 14, 15, 18, 20, 22, 24, 31, 34, 35, 37, 42, 44, 4710.6960.8480.7220.6310.6760.9410.6310.786
211, 2, 4, 5, 6, 11, 14, 15, 16, 20, 21, 22, 23, 24, 35, 36, 37, 39, 40, 41, 450.8260.750.7880.7770.6310.7040.6470.7360.691
221, 2, 3, 5, 12, 16, 20, 21, 22, 25, 26, 27, 28, 30, 31, 34, 38, 40, 44, 45, 46, 470.9030.7140.8090.7220.6840.7030.7050.7360.721
231, 2, 6, 9, 10, 11, 13, 14, 15, 16, 18, 23, 26, 29, 32, 34, 38, 39, 40, 41, 42, 45, 470.6340.7140.6740.6660.6840.6750.6470.6840.665
241, 2, 4, 5, 6, 7, 12, 14, 15, 16, 20, 21, 22, 23, 28, 31, 35, 36, 37, 38, 42, 43, 44, 460.8840.910.8970.6660.7360.7010.7050.7890.747
251, 3, 5, 10, 12, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 28, 32, 35, 36, 38, 41, 42, 44, 450.8260.8390.8330.7220.7890.7550.6470.7360.691
261, 2, 3, 5, 7, 9, 10, 12, 15, 18, 20, 21, 22, 24, 25, 26, 27, 31, 32, 34, 37, 38, 40, 44, 46, 470.980.750.8650.7770.6310.7040.7640.7360.75
272, 3, 5, 6, 12, 13, 15, 16, 17, 20, 21, 22, 23, 24, 25, 26, 27, 30, 33, 35, 36, 37, 38, 40, 42, 43, 470.8460.8390.8420.6660.7360.7010.8230.7360.78
281, 2, 4, 5, 6, 7, 10, 12, 13, 14, 15, 16, 17, 22, 25, 26, 27, 28, 31, 32, 33, 35, 37, 38, 40, 41, 42, 430.9610.7850.8730.7770.6310.7040.6470.8420.744
291, 3, 4, 5, 6, 7, 9, 13, 14, 15, 16, 20, 23, 24, 25, 26, 27, 30, 33, 35, 36, 37, 38, 39, 40, 41, 42, 43, 450.9230.910.9160.7220.6840.7030.6470.8940.77
301, 3, 5, 8, 12, 14, 15, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 31, 32, 35, 36, 37, 38, 41, 42, 43, 46, 470.9230.8030.8630.8330.6310.7320.6470.8420.744
311, 3, 4, 5, 6, 7, 9, 13, 14, 15, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 31, 32, 33, 34, 35, 36, 37, 38, 40, 45, 460.9230.9640.9430.7220.7890.7550.7050.7890.747
322, 4, 5, 6, 7, 8, 11, 13, 15, 16, 17, 18, 19, 21, 22, 23, 24, 25, 26, 28, 32, 36, 37, 38, 40, 41, 42, 43, 44, 45, 46, 4710.7850.8920.7220.6840.7030.7050.6840.695
331, 3, 4, 5, 6, 7, 10, 12, 14, 15, 16, 17, 18, 19, 21, 22, 23, 24, 25, 26, 27, 30, 34, 35, 36, 37, 38, 39, 40, 41, 44, 45, 470.7690.7850.7770.7770.6310.7040.7050.6840.695
341, 4, 5, 6, 10, 11, 12, 14, 15, 16, 17, 19, 20, 21, 22, 23, 24, 25, 26, 28, 30, 31, 32, 34, 36, 37, 38, 39, 40, 42, 43, 44, 45, 470.8070.8570.8320.6110.6840.6470.6470.7360.691
351, 3, 4, 5, 6, 7, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 26, 28, 29, 30, 31, 32, 34, 35, 36, 38, 39, 40, 41, 43, 44, 46, 470.8650.8210.8430.7220.6840.7030.6470.7360.691
n = features dimension, SE = sensitivity, SP = specificity, AUC = Area Under the Curve.
Table A3. Dictionary Bayesian classifier performance results using Simulated Annealing.
Table A3. Dictionary Bayesian classifier performance results using Simulated Annealing.
FeatureLabel Meaning
1Sex
2Height [cm]
3Weight [kg]
4BMI [kg/m2]
5Age [years]
6Foot length [cm]
7Polypharmacy
8Mean distance [mm]
9Mean distance-ML [mm]
10Mean distance-AP [mm]
11RMS distance [mm]
12RMS distance-ML [mm]
13RMS distance-AP [mm]
14Total Length [mm]
15Total length ML [mm]
16Total length AP [mm]
17Mean velocity [mm/s]
18Mean velocity-ML [mm/s]
19Mean velocity-AP [mm/s]
20Standard deviation of RD [mm]
2195% conf. circle area [mm2]
22Covariance ML [mm2]
2395% conf. ellipse area [mm2]
24Sway area [mm2/s]
25Mean frequency [Hz]
26Mean frequency-ML [Hz]
27Mean frequency-AP [Hz]
28Fractal dimension-CC [-]
29Fractal dimension-CE [-]
30Range [mm]
31Range-ML [mm]
32Range-AP [mm]
33Total power-RD [mm2/Hz]
3450% power frequency-RD [Hz]
3595% power frequency-RD [Hz]
36Total power-AP [mm2/Hz]
3750% power frequency-AP [Hz]
3895% power frequency-AP [Hz]
39Total power-ML [mm2/Hz]
4050% power frequency-ML [Hz]
4195% power frequency-ML [Hz]
42Centroidal frequency-RD [Hz]
43Frequency dispersion-RD [-]
44Centroidal frequency-AP [Hz]
45Frequency dispersion-AP [-]
46Centroidal frequency-ML [Hz]
47Frequency dispersion-ML [-]
Table A4. Logistic regression performance.
Table A4. Logistic regression performance.
FeatureTrainTestValidation
SESPAUCSESPAUCSESPAUC
Sex0.9030.3030.6031.0000.2100.6050.9410.3680.654
Height [cm]0.5380.5530.5460.3330.4730.4030.2940.5260.410
Weight [kg]0.4800.6420.5610.2220.3680.2950.4110.6840.547
BMI [kg/m2]010.5010.5010.5
Age [years]0.2500.8210.5350.3880.7890.5890.2350.8940.565
Foot length [cm]0.5570.660.6090.4440.5260.4850.4700.7890.630
Polypharmacy0.4230.750.5860.3330.6840.5080.4700.5780.524
Mean distance [mm]0.2300.8210.5260.2220.8420.5320.0580.7890.424
Mean distance-ML [mm]0.2500.8390.5440.1110.7890.4500.2940.7890.541
Mean distance-AP [mm]0.1920.8570.5240.2770.8940.5860.0580.7890.424
RMS distance [mm]0.2500.8390.5440.2220.8420.5320.0580.7890.424
RMS distance-ML [mm]0.2500.8210.5350.1110.7890.4500.2350.7890.512
RMS distance-AP [mm]0.1920.8750.5330.2220.9470.5840.0580.8420.450
Total length [mm]0.3070.8390.5730.1660.7360.4510.1170.7890.453
Total length ML [mm]0.4230.8390.6310.1660.7360.4510.1760.8420.509
Total length AP [mm]010.5010.5010.5
Mean velocity [mm/s]0.3070.8390.5730.1660.7360.4510.1170.7890.453
Mean velocity-ML [mm/s]0.4230.8390.6310.1660.7360.4510.1760.8420.509
Mean velocity-AP [mm/s]010.5010.5010.5
Standard deviation of RD [mm]0.1340.8210.4780.2220.8420.5320.1760.8420.509
95% conf. circle area [mm2]0.0960.8570.4760.1660.8420.5040.0580.8420.45
Covariance ML [mm2]0.2690.8030.5360.2220.7890.5050.2940.7890.541
95% conf. ellipse area [mm2]0.1340.8920.5130.2220.9470.5840.0580.8420.450
Sway area [mm2/s]0.2300.8570.5430.1110.9470.5290.1760.8940.535
Mean frequency [Hz]0.2500.8390.5440.1660.6840.4250.1760.7890.482
Mean frequency-ML [Hz]0.3260.7670.5470.3330.4730.4030.1760.7360.456
Mean frequency-AP [Hz]0.3650.6600.5130.3880.7890.5890.5290.6310.58
Fractal dimension-CC [-]0.0570.9820.51900.9470.47300.9470.473
Fractal dimension-CE [-]0.0760.9820.52900.9470.47300.8940.447
Range [mm]0.2300.8210.5260.1660.7890.4780.2940.8420.568
Range-ML [mm]0.3260.8030.5650.2220.7890.5050.2350.8420.538
Range-AP [mm]0.0190.9820.5010.5010.5
Total power-RD [mm2/Hz]0.2110.8570.5340.1110.8940.5020.1760.8940.535
50% power frequency-RD [Hz]0.4800.6780.5790.4440.6310.5380.6470.4730.560
95% power frequency-RD [Hz]0.2500.8920.5710.3330.8940.6140.4700.8420.656
Total power-AP [mm2/Hz]0.2500.8570.5530.0550.9470.5010.0580.9470.503
50% power frequency-AP [Hz]0.5760.5530.5650.6110.3150.4630.7640.5260.645
95% power frequency-AP [Hz]0.01910.509010.500.9470.473
Total power-ML [mm2/Hz]0.2690.8920.5810.1660.8940.530.1760.7890.482
50% power frequency-ML [Hz]0.4800.6420.5610.4440.7360.590.5880.5260.557
95% power frequency-ML [Hz]0.3650.7140.5390.3330.6310.4820.4110.6840.547
Centroidal frequency-RD [Hz]0.3840.7320.5580.4440.6840.5640.7050.7890.747
Frequency dispersion-RD [-]0.2500.7320.4910.4440.7890.6160.5290.6310.58
Centroidal frequency-AP [Hz]0.4230.7140.5680.4440.5780.5110.5880.6840.636
Frequency dispersion-AP [-]0.5380.5530.5460.5550.4730.5140.6470.4210.534
Centroidal frequency-ML [Hz]0.4030.6780.5410.3880.6840.5360.5290.5780.554
Frequency dispersion-ML [-]0.1920.8750.5330.2220.9470.5840.2940.7890.541
SE = sensitivity, SP = specificity, AUC = Area Under the Curve.

References

  1. World Health Organization: Falls. Available online: https://www.who.int/news-room/fact-sheets/detail/falls (accessed on 24 March 2024).
  2. Talbot, L.A.; Musiol, R.J.; Witham, E.K.; Metter, E.J. Falls in Young, Middle-Aged and Older Community Dwelling Adults: Perceived Cause, Environmental Factors and Injury. BMC Public Health 2005, 5, 86. [Google Scholar] [CrossRef] [PubMed]
  3. WHO. WHO Global Report on Falls Prevention in Older Age; WHO Library Cataloguing-in-Publication Data: Geneva, Switzerland, 2008; ISBN 978 92 4 156353 6. [Google Scholar]
  4. Sun, R.; Sosnoff, J.J. Novel Sensing Technology in Fall Risk Assessment in Older Adults: A Systematic Review. BMC Geriatr. 2018, 18, 14. [Google Scholar] [CrossRef] [PubMed]
  5. Fabre, J.M.; Ellis, R.; Kosma, M.; Wood, R.H. Falls Risk Factors and a Compendium of Falls Risk Screening Instruments. J. Geriatr. Phys. Ther. 2010, 33, 184–197. [Google Scholar] [CrossRef] [PubMed]
  6. Mancini, M.; Horak, F.B. The Relevance of Clinical Balance Assessment Tools to Differentiate Balance Deficits. Eur. J. Phys. Rehabil. Med. 2010, 46, 239. [Google Scholar] [PubMed]
  7. Cho, H.Y.; Heijnen, M.J.H.; Craig, B.A.; Rietdyk, S. Falls in Young Adults: The Effect of Sex, Physical Activity, and Prescription Medications. PLoS ONE 2021, 16, e0250360. [Google Scholar] [CrossRef]
  8. Gallouj, K.; Altintas, E.; El Haj, M. “I Remember the Fall”: Memory of Falls in Older Adults. Clin. Gerontol. 2023, 46, 695–703. [Google Scholar] [CrossRef]
  9. Paillard, T.; Noé, F. Techniques and Methods for Testing the Postural Function in Healthy and Pathological Subjects. BioMed Res. Int. 2015, 2015, 891390. [Google Scholar] [CrossRef]
  10. Clark, R.A.; Mentiplay, B.F.; Pua, Y.H.; Bower, K.J. Reliability and Validity of the Wii Balance Board for Assessment of Standing Balance: A Systematic Review. Gait Posture 2018, 61, 40–54. [Google Scholar] [CrossRef]
  11. Hernandez-Laredo, E.; Parra-Rodríguez, L.; Estévez-Pedraza, Á.G.; Martínez-Méndez, R. A Low-Cost, IoT-Connected Force Platform for Fall Risk Assessment in Older Adults. In Proceedings of the XLVI Mexican Conference on Biomedical Engineering; Flores Cuautle, J.D.J.A., Benítez-Mata, B., Salido-Ruiz, R.A., Alonso-Silverio, G.A., Dorantes-Méndez, G., Zúñiga-Aguilar, E., Vélez-Pérez, H.A., et al., Eds.; Springer Nature: Cham, Switzerland, 2024; pp. 374–385. [Google Scholar]
  12. Terekhov, Y. Stabilometry as a Diagnostic Tool in Clinical Medicine. Can. Med. Assoc. J. 1976, 115, 631–633. [Google Scholar]
  13. Palmieri, R.M.; Ingersoll, C.D.; Stone, M.B.; Krause, B.A. Center-of-Pressure Parameters Used in the Assessment of Postural Control. J. Sport Rehabil. 2002, 11, 51–66. [Google Scholar] [CrossRef]
  14. Prieto, T.E.; Myklebust, J.B.; Hoffmann, R.G.; Lovett, E.G.; Myklebust, B.M. Measures of Postural Steadiness: Differences between Healthy Young and Elderly Adults. IEEE Trans. Biomed. Eng. 1996, 43, 956–966. [Google Scholar] [CrossRef] [PubMed]
  15. Audiffren, J.; Bargiotas, I.; Vayatis, N.; Vidal, P.P.; Ricard, D. A Non Linear Scoring Approach for Evaluating Balance: Classification of Elderly as Fallers and Non-Fallers. PLoS ONE 2016, 11, e0167456. [Google Scholar] [CrossRef] [PubMed]
  16. Estévez-Pedraza, Á.G.; Parra-Rodríguez, L.; Martínez-Méndez, R.; Portillo-Rodríguez, O.; Ronzón-Hernández, Z. A Novel Model to Quantify Balance Alterations in Older Adults Based on the Center of Pressure (CoP) Measurements with a Cross-Sectional Study. PLoS ONE 2021, 16, e0256129. [Google Scholar] [CrossRef] [PubMed]
  17. Fino, P.C.; Mojdehi, A.R.; Adjerid, K.; Habibi, M.; Lockhart, T.E.; Ross, S.D. Comparing Postural Stability Entropy Analyses to Differentiate Fallers and Non-Fallers. Ann. Biomed. Eng. 2016, 44, 1636. [Google Scholar] [CrossRef]
  18. Howcroft, J.; Lemaire, E.D.; Kofman, J.; McIlroy, W.E. Elderly Fall Risk Prediction Using Static Posturography. PLoS ONE 2017, 12, e0172398. [Google Scholar] [CrossRef]
  19. Kwok, B.C.; Clark, R.A.; Pua, Y.H. Novel Use of the Wii Balance Board to Prospectively Predict Falls in Community-Dwelling Older Adults. Clin. Biomech. Bristol Avon 2015, 30, 481–484. [Google Scholar] [CrossRef]
  20. Reilly, D.Ó. Feature Selection for the Classification of Fall-Risk in Older Subjects: A Combinational Approach Using Static Force-Plate Measures. bioRxiv 2019. bioRxiv:807818. [Google Scholar] [CrossRef]
  21. Oliveira, M.R.; Vieira, E.R.; Gil, A.W.O.; Fernandes, K.B.P.; Teixeira, D.C.; Amorim, C.F.; Silva, R.A.D. One-Legged Stance Sway of Older Adults with and without Falls. PLoS ONE 2018, 13, e0203887. [Google Scholar] [CrossRef]
  22. Silva, J.; Madureira, J.; Tonelo, C.; Baltazar, D.; Silva, C.; Martins, A.; Alcobia, C.; Sousa, I. Comparing Machine Learning Approaches for Fall Risk Assessment. In Proceedings of the 10th International Conference on Bio-Inspired Systems and Signal Processing, Porto, Portugal, 26 July 2024; pp. 223–230. [Google Scholar]
  23. Liao, F.-Y.; Wu, C.-C.; Wei, Y.-C.; Chou, L.-W.; Chang, K.-M. Analysis of Center of Pressure Signals by Using Decision Tree and Empirical Mode Decomposition to Predict Falls among Older Adults. J. Healthc. Eng. 2021, 2021, 6252445. [Google Scholar] [CrossRef]
  24. Cuaya-Simbro, G.; Perez-Sanpablo, A.-I.; Morales, E.-F.; Quiñones Uriostegui, I.; Nuñez-Carrera, L. Comparing Machine Learning Methods to Improve Fall Risk Detection in Elderly with Osteoporosis from Balance Data. J. Healthc. Eng. 2021, 2021, 8697805. [Google Scholar] [CrossRef]
  25. Sahoo, A.K.; Pradhan, C.; Das, H. Performance Evaluation of Different Machine Learning Methods and Deep-Learning Based Convolutional Neural Network for Health Decision Making. In Nature Inspired Computing for Data Science; Rout, M., Rout, J.K., Das, H., Eds.; Springer International Publishing: Cham, Switzerland, 2020; pp. 201–212. ISBN 978-3-030-33820-6. [Google Scholar]
  26. Bailly, A.; Blanc, C.; Francis, É.; Guillotin, T.; Jamal, F.; Wakim, B.; Roy, P. Effects of Dataset Size and Interactions on the Prediction Performance of Logistic Regression and Deep Learning Models. Comput. Methods Programs Biomed. 2022, 213, 106504. [Google Scholar] [CrossRef] [PubMed]
  27. Fatima, R.; Khan, M.H.; Nisar, M.A.; Doniec, R.; Farid, M.S.; Grzegorzek, M. A Systematic Evaluation of Feature Encoding Techniques for Gait Analysis Using Multimodal Sensory Data. Sensors 2024, 24, 75. [Google Scholar] [CrossRef] [PubMed]
  28. Ruchinskas, R. Clinical Prediction of Falls in the Elderly. Am. J. Phys. Med. Rehabil. 2003, 82, 273–278. [Google Scholar] [CrossRef] [PubMed]
  29. Piirtola, M.; Era, P. Force Platform Measurements as Predictors of Falls among Older People–A Review. Gerontology 2006, 52, 1–16. [Google Scholar] [CrossRef]
  30. Quijoux, F.; Vienne-Jumeau, A.; Bertin-Hugault, F.; Zawieja, P.; Lefèvre, M.; Vidal, P.P.; Ricard, D. Center of Pressure Displacement Characteristics Differentiate Fall Risk in Older People: A Systematic Review with Meta-Analysis. Ageing Res. Rev. 2020, 62, 101117. [Google Scholar] [CrossRef]
  31. Santos, D.A.; Duarte, M. A Public Data Set of Human Balance Evaluations. PeerJ 2016, 4, e2648. [Google Scholar] [CrossRef]
  32. Stel, V.S.; Smit, J.H.; Pluijm, S.M.F.; Lips, P. Balance and Mobility Performance as Treatable Risk Factors for Recurrent Falling in Older Persons. J. Clin. Epidemiol. 2003, 56, 659–668. [Google Scholar] [CrossRef]
  33. Pajala, S.; Era, P.; Koskenvuo, M.; Kaprio, J.; Törmäkangas, T.; Rantanen, T. Force Platform Balance Measures as Predictors of Indoor and Outdoor Falls in Community-Dwelling Women Aged 63-76 Years. J. Gerontol. A Biol. Sci. Med. Sci. 2008, 63, 171–178. [Google Scholar] [CrossRef]
  34. Thapa, P.B.; Gideon, P.; Brockman, K.G.; Fought, R.L.; Ray, W.A. Clinical and Biomechanical Measures of Balance as Fall Predictors in Ambulatory Nursing Home Residents. J. Gerontol. A. Biol. Sci. Med. Sci. 1996, 51, M239–M246. [Google Scholar] [CrossRef]
  35. Berg, K.O.; Maki, B.E.; Williams, J.I.; Holliday, P.J.; Wood-Dauphinee, S.L. Clinical and Laboratory Measures of Postural Balance in an Elderly Population. Arch. Phys. Med. Rehabil. 1992, 73, 1073–1080. [Google Scholar]
  36. Park, M.W.; Kim, Y.D. A Systematic Procedure for Setting Parameters in Simulated Annealing Algorithms. Comput. Oper. Res. 1998, 25, 207–217. [Google Scholar] [CrossRef]
  37. Parthasarathy, S.; Rajendran, C. An Experimental Evaluation of Heuristics for Scheduling in a Real-Life Flowshop with Sequence-Dependent Setup Times of Jobs. Int. J. Prod. Econ. 1997, 49, 255–263. [Google Scholar] [CrossRef]
  38. Duda, R.O.; Hart, P.E.; Stork, D.G. Pattern Classification; John Wiley & Sons: Hoboken, NJ, USA, 2012; ISBN 978-1-118-58600-6. [Google Scholar]
  39. Kirkpatrick, S.; Gelatt, C.D.; Vecchi, M.P. Optimization by Simulated Annealing. Science 1983, 220, 671–680. [Google Scholar] [CrossRef] [PubMed]
  40. Knox, S.W. Machine Learning: A Concise Introduction; John Wiley & Sons: Hoboken, NJ, USA, 2018; ISBN 978-1-119-43919-6. [Google Scholar]
  41. Kubo, Y.; Fujii, K.; Hayashi, T.; Tomiyama, N.; Ochi, A.; Hayashi, H. Sex Differences in Modifiable Fall Risk Factors. J. Nurse Pract. 2021, 17, 1098–1102. [Google Scholar] [CrossRef]
  42. Ambrose, A.F.; Paul, G.; Hausdorff, J.M. Risk Factors for Falls among Older Adults: A Review of the Literature. Maturitas 2013, 75, 51–61. [Google Scholar] [CrossRef]
  43. Moylan, K.C.; Binder, E.F. Falls in Older Adults: Risk Assessment, Management and Prevention. Am. J. Med. 2007, 120, 493.e1–493.e6. [Google Scholar] [CrossRef]
  44. Oliver, D.; Daly, F.; Martin, F.C.; McMurdo, M.E.T. Risk Factors and Risk Assessment Tools for Falls in Hospital In-Patients: A Systematic Review. Age Ageing 2004, 33, 122–130. [Google Scholar] [CrossRef]
  45. Oliver, D. Falls Risk-Prediction Tools for Hospital Inpatients. Time to Put Them to Bed? Age Ageing 2008, 37, 248–250. [Google Scholar] [CrossRef]
  46. Vassallo, M.; Poynter, L.; Sharma, J.C.; Kwan, J.; Allen, S.C. Fall Risk-Assessment Tools Compared with Clinical Judgment: An Evaluation in a Rehabilitation Ward. Age Ageing 2008, 37, 277–281. [Google Scholar] [CrossRef]
  47. Pudjihartono, N.; Fadason, T.; Kempa-Liehr, A.W.; O’Sullivan, J.M. A Review of Feature Selection Methods for Machine Learning-Based Disease Risk Prediction. Front. Bioinforma. 2022, 2, 72. [Google Scholar] [CrossRef]
  48. Debuse, J.C.W.; Rayward-Smith, V.J. Feature Subset Selection within a Simulated Annealing Data Mining Algorithm. J. Intell. Inf. Syst. 1997, 9, 57–81. [Google Scholar] [CrossRef]
  49. Nikolaev, A.G.; Jacobson, S.H. Simulated Annealing. In Handbook of Metaheuristics; Gendreau, M., Potvin, J.-Y., Eds.; International Series in Operations Research & Management Science; Springer: Boston, MA, USA, 2010; pp. 1–39. ISBN 978-1-4419-1665-5. [Google Scholar]
  50. Giovanini, L.H.F.; Manffra, E.F.; Nievola, J.C. Discriminating Postural Control Behaviors from Posturography with Statistical Tests and Machine Learning Models: Does Time Series Length Matter? In Proceedings of the Computational Science–ICCS 2018; Shi, Y., Fu, H., Tian, Y., Krzhizhanovskaya, V.V., Lees, M.H., Dongarra, J., Sloot, P.M.A., Eds.; Springer International Publishing: Cham, Switzerland, 2018; pp. 350–357. [Google Scholar]
  51. Estévez-Pedraza, Á.G.; Hernandez-Laredo, E.; Millan-Guadarrama, M.E.; Martínez-Méndez, R.; Carrillo-Vega, M.F.; Parra-Rodríguez, L. Reliability and Usability Analysis of an Embedded System Capable of Evaluating Balance in Elderly Populations Based on a Modified Wii Balance Board. Int. J. Environ. Res. Public. Health 2022, 19, 11026. [Google Scholar] [CrossRef] [PubMed]
  52. Prosperini, L.; Fortuna, D.; Giannì, C.; Leonardi, L.; Pozzilli, C. The Diagnostic Accuracy of Static Posturography in Predicting Accidental Falls in People with Multiple Sclerosis. Neurorehabil. Neural Repair 2013, 27, 45–52. [Google Scholar] [CrossRef] [PubMed]
  53. Forth, K.E.; Wirfel, K.L.; Adams, S.D.; Rianon, N.J.; Lieberman Aiden, E.; Madansingh, S.I. A Postural Assessment Utilizing Machine Learning Prospectively Identifies Older Adults at a High Risk of Falling. Front. Med. 2020, 7, 591517. [Google Scholar] [CrossRef]
  54. Montalvo-Jaramillo, C.I.; Pliego-Carrillo, A.C.; Peña-Castillo, M.Á.; Echeverría, J.C.; Becerril-Villanueva, E.; Pavón, L.; Ayala-Yáñez, R.; González-Camarena, R.; Berg, K.; Wessel, N.; et al. Comparison of Fetal Heart Rate Variability by Symbolic Dynamics at the Third Trimester of Pregnancy and Low-Risk Parturition. Heliyon 2020, 6, e03485. [Google Scholar] [CrossRef]
Figure 1. Absolute frequencies of the features selected by SA through all dimensions ( n = 11 to 35). The colors refer to a gradient bar associated with the frequency of use of the features.
Figure 1. Absolute frequencies of the features selected by SA through all dimensions ( n = 11 to 35). The colors refer to a gradient bar associated with the frequency of use of the features.
Bioengineering 11 00908 g001
Figure 2. Set of features that integrate the best-performance results in feature selection.
Figure 2. Set of features that integrate the best-performance results in feature selection.
Bioengineering 11 00908 g002
Figure 3. Performance of the SA algorithm based on the AUC value with respect to the dimension size.
Figure 3. Performance of the SA algorithm based on the AUC value with respect to the dimension size.
Bioengineering 11 00908 g003
Table 1. Description of general participant characteristics by the fall risk group.
Table 1. Description of general participant characteristics by the fall risk group.
TotalNon-Fall RiskFall Riskp-Value Means Difference Test
n = 76n = 47n = 29
Sex [women] n (%)60 (78.94)33 (70.21)27 (93.10)0.017 *
Age [years]71.3 ± 6.471.7 ± 6.570.6 ± 6.30.486
Height [cm]157.2 ± 8.1158.2 ± 9.1155.5 ± 5.90.124
Weight [kg]63.1 ± 8.463.6 ± 8.262.2 ± 8.60.477
BMI [kg/m2]25.5 ± 2.925.4 ± 2.925.6 ± 2.90.760
Foot length [cm]22.6 ± 1.322.9 ± 1.222.0 ± 1.30.006 *
Polypharmacy2.3 ± 1.62.3 ± 1.42.3 ± 1.80.707
Fall in the last year0.9 ± 5.9-2.4 ± 9.5-
* p-value < 0.05.
Table 2. Statistical analysis of the CoP indices with the best level of predictive validity according to their AUC.
Table 2. Statistical analysis of the CoP indices with the best level of predictive validity according to their AUC.
CoP IndexTotalNon-Fall RiskFall
Risk
KS
Test
MD
Test
HL
Test
AUC (95% CI)
n = 181n = 94n = 87p-Valuep-Valuep-Value
Frequency dispersion-AP [-]7.27 ± 1.067.13 ± 1.097.42 ± 1.010.000 *0.034 *0.4000.591 (0.508–0.674)
Total power-ML [mm2/Hz]63.14 ± 114.6345.52 ± 32.6482.17 ± 160.140.000 *0.048 *0.9960.585 (0.501–0.668)
Total power-RD [mm2/Hz]32.63 ± 56.5325.7 ± 18.2540.12 ± 78.860.000 *0.0970.9080.571 (0.487–0.655)
Range-ML [mm]27.29 ± 13.2825.66 ± 9.3529.06 ± 16.390.000 *0.1190.029 *0.567 (0.482–0.651)
Range [mm]28.50 ± 13.3926.97 ± 9.7530.15 ± 16.340.000 *0.1460.2760.562 (0.478–0.647)
n = sample size, KS = Kolmogorov–Smirnov, MD = mean difference, HL = Hosmer–Lemeshow, CI = confidence interval, * p-value < 0.05.
Table 3. List of best-performance results in feature selection.
Table 3. List of best-performance results in feature selection.
TopnTrainTestValidationTrain–Test–Validation
SESPAUCSESPAUCSESPAUCAUC (Mean ± Std)
Hold-out1310.920.960.940.720.780.750.700.780.740.815 ± 0.110
2290.920.910.910.720.680.700.640.890.770.797 ± 0.109
3240.880.910.890.660.730.700.700.780.740.782 ± 0.102
4150.800.850.830.940.630.780.700.730.720.780 ± 0.055
5300.920.800.860.830.630.730.640.840.740.780 ± 0.072
Bootstrap1310.940.980.960.330.840.580.330.840.650.734 ± 0.200
2290.901.000.950.160.890.530.160.890.580.690 ± 0.228
3240.940.960.950.380.840.610.380.840.530.702 ± 0.220
4150.820.850.840.770.680.730.770.820.850.773 ± 0.059
5300.920.890.900.500.730.610.500.730.560.698 ± 0.183
n = features dimension, SE = sensitivity, SP = specificity, AUC = Area Under the Curve.
Table 4. Descriptive analysis of the Top 4 predictor variables by sex.
Table 4. Descriptive analysis of the Top 4 predictor variables by sex.
TotalMaleFemalep-Value Means Difference Test
n = 181n = 34n = 147
Weight [kg]62.99 ± 8.467.89 ± 7.0561.86 ± 8.30.000 *
BMI [kg/m2]25.55 ± 2.924.3 ± 1.8925.83 ± 3.020.000 *
Mean distance [mm]5.17 ± 2.456.87 ± 3.874.78 ± 1.790.004 *
Total length AP [mm]324.71 ± 158.25411.47 ± 215.79304.64 ± 134.880.009 *
Standard deviation of RD [mm]2.95 ± 1.483.93 ± 2.492.72 ± 1.010.009 *
Mean frequency-ML [Hz]4.55 ± 1.814.1 ± 1.224.65 ± 1.920.040 *
Range [mm]28.5 ± 13.3937.35 ± 23.0126.45 ± 8.890.010 *
Total power-AP [mm2/Hz]22.43 ± 19.4935.03 ± 24.2519.51 ± 17.030.001 *
95% power frequency-AP [Hz]9.83 ± 2.59.47 ± 2.989.91 ± 2.380.418
50% power frequency-AP [Hz]2.66 ± 1.962.51 ± 2.082.69 ± 1.940.458
Centroidal frequency-RD [Hz]7.08 ± 2.056.56 ± 1.557.2 ± 2.130.101
Centroidal frequency-AP [Hz]5.42 ± 1.575.21 ± 1.835.47 ± 1.510.390
Frequency dispersion-ML [-]5.88 ± 1.555.4 ± 1.75.98 ± 1.50.847
Centroidal frequency-ML [Hz]7.4 ± 0.897.43 ± 0.917.39 ± 0.890.074
* p-value < 0.05.
Table 5. State-of-the-art performance of classifiers for fall risk detection, balance alteration, and fall history.
Table 5. State-of-the-art performance of classifiers for fall risk detection, balance alteration, and fall history.
Work (Year)TechnologyStabilometric TestDatasetSample SizePre-ProcessingAlgorithmLabelValidation MethodPerformance
Top 1 (This work)Force platform (OPT400600-1000) 100 HzStatic test
with open eyes
[26]76 older adultsCompute CoP indicesBC and SAFall risk
(FH + FES score)
60–20–20 hold-outAUC: 0.815
SE: 0.783
SP: 0.847
Top 4 (This work)Force platform (OPT400600-1000) 100 HzStatic test
with open eyes
[26]76 older adultsCompute CoP indicesBC and SAFall risk
(FH + Short FES-I)
60–20–20 hold-outAUC: 0.780
SE: 0.818
SP: 0.741
[23] (2021)Force platform (OPT400600-1000) 100 HzStatic test
with open and close eyes on soft and hard surface
[26]76 older adultsEmpirical Mode DeComposition, and compute CoP indicesRFFall risk
(FH + Short FES-I e)
80–20 hold-outSE: 0.760
SP: 0.860
ACC: 0.820
[15] (2016)Wii Balance Board 25 HzStatic test
with open and close eyes
Own80 older adultsCompute CoP indicesRaking ForestFH70–30 hold-outAUC: 0.750
[20] (2019)Force platform (OPT400600-1000) 100 HzStatic test
with open and close eyes on soft and hard surface
[26]76 older adultsCompute CoP indicesMLP
SVM
NB
K-NN and
Feature selection
Fall risk
(FH + Short FES-I)
80–20 hold-outAUC: 0.710
ACC: 0.800
[50] (2018)Force platform (OPT400600-1000) 100 HzStatic test
with open and close eyes on soft and hard surface
[26]163 people between 18 and 85 years oldCompute CoP indicesK-NN
DTs
MLP
NB
RF
SVM
Fall risk
(HF + MiniBEST)
10-FoldACC: 0.649
[24] (2021)Force platform (AccuSway) 120 HzStatic test
with open and close eyes
Own126 older women with osteoporosisCompute CoP indices, and data balancingNB
SVM
AdaBoost
K-NN
FH10-FoldSE: 0.810
SP: 0.190
[17] (2016)Force platform (Advenced Mechanical Technology) 100 HzStatic test
with open and close eyes
Own76 older adultsCompute CoP indicesLRFHNoneAUC: 0.900
[51] (2022)Wii Balance Board 50 HzStatic test
with open and close eyes
Own46 older adultsCompute CoP indicesLRBalance deficit (4-stage balance)NoneAUC: 0.770
SE: 0.930
SP: 0.620
[52] (2013)Force platform (Tecnobody) 20 HzStatic test
with open and close eyes
Own100 older adultsCompute CoP indicesLRFHNoneSE: 0.880
SP: 0.670
[21] (2018)Force platform (EMG system do Brasil) 100 HzUnipodal static testOwn170 older adultsCompute CoP indicesROCFHNoneAUC: 0.720
SE: 0.660
SP: 0.680
[16] (2021)Wii Balance Board 50 HzStatic test
with open and close eyes
Own497 older adultsCompute CoP indicesLRBalance alteration (4-stage balance)NoneAUC: 0.710
SE: 0.490
SP: 0.830
[19] (2015)Wii Balance BoardStatic test
with open eyes
Own73 older adultsCompute CoP indicesLRFHNoneAUC: 0.71
[18] (2017)Wii Balance Board 100 HzStatic test
with open and close eyes
Own100 older adultsCompute CoP indicesDiscriminant analysisFHNoneSE: 0.710
SP: 0.570
[53] (2020)Force platform (SmartScale-Zibro) 60 HzStatic test
with open eyes
Own412 older adultsCompute CoP indicesROCFHNoneAUC: 0.640
SE: 0.640
SP: 0.590
For algorithm: BC = Bayesian classifier, SA = Simulated Annealing, RF = Random Forest, MLP = Multi-Layer Perceptron, SVM = Support Vector Machine, NB = Naïve Bayes, KNN = K-Nearest Neighbor, DTs = Decision Trees, LR = Logistic Regression, ROC = Receiver Operating Characteristic analysis. For labels: FH = fall history, Short FES-I = Short Falls Efficacy Scale-International, MiniBEST = Mini-Balance Evaluation Systems Test. For performance: SE = sensitivity, SP = specificity, AUC = Area Under the Curve, ACC = accuracy.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Hernandez-Laredo, E.; Estévez-Pedraza, Á.G.; Santiago-Fuentes, L.M.; Parra-Rodríguez, L. Optimizing Fall Risk Diagnosis in Older Adults Using a Bayesian Classifier and Simulated Annealing. Bioengineering 2024, 11, 908. https://doi.org/10.3390/bioengineering11090908

AMA Style

Hernandez-Laredo E, Estévez-Pedraza ÁG, Santiago-Fuentes LM, Parra-Rodríguez L. Optimizing Fall Risk Diagnosis in Older Adults Using a Bayesian Classifier and Simulated Annealing. Bioengineering. 2024; 11(9):908. https://doi.org/10.3390/bioengineering11090908

Chicago/Turabian Style

Hernandez-Laredo, Enrique, Ángel Gabriel Estévez-Pedraza, Laura Mercedes Santiago-Fuentes, and Lorena Parra-Rodríguez. 2024. "Optimizing Fall Risk Diagnosis in Older Adults Using a Bayesian Classifier and Simulated Annealing" Bioengineering 11, no. 9: 908. https://doi.org/10.3390/bioengineering11090908

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop