Next Article in Journal
Adaptive Grouping Distributed Compressive Sensing Reconstruction of Plant Hyperspectral Data
Next Article in Special Issue
Multiport Circular Polarized RFID-Tag Antenna for UHF Sensor Applications
Previous Article in Journal
Design and Fabrication of a Ratiometric Planar Optode for Simultaneous Imaging of pH and Oxygen
Previous Article in Special Issue
Scalability Issues for Remote Sensing Infrastructure: A Case Study
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Faller Classification in Older Adults Using Wearable Sensors Based on Turn and Straight-Walking Accelerometer-Based Features

1
Department of Systems Design Engineering, University of Waterloo, Waterloo, ON N2L 3G1, Canada
2
Centre for Rehabilitation Research and Development, Ottawa Hospital Research Institute, Ottawa, ON K1H 8M2, Canada
3
Faculty of Medicine, University of Ottawa, Ottawa, ON K1H 8M5, Canada
*
Author to whom correspondence should be addressed.
Sensors 2017, 17(6), 1321; https://doi.org/10.3390/s17061321
Submission received: 10 March 2017 / Revised: 31 May 2017 / Accepted: 2 June 2017 / Published: 7 June 2017
(This article belongs to the Special Issue State-of-the-Art Sensors Technology in Canada 2017)

Abstract

:
Faller classification in elderly populations can facilitate preventative care before a fall occurs. A novel wearable-sensor based faller classification method for the elderly was developed using accelerometer-based features from straight walking and turns. Seventy-six older individuals (74.15 ± 7.0 years), categorized as prospective fallers and non-fallers, completed a six-minute walk test with accelerometers attached to their lower legs and pelvis. After segmenting straight and turn sections, cross validation tests were conducted on straight and turn walking features to assess classification performance. The best “classifier model—feature selector” combination used turn data, random forest classifier, and select-5-best feature selector (73.4% accuracy, 60.5% sensitivity, 82.0% specificity, and 0.44 Matthew’s Correlation Coefficient (MCC)). Using only the most frequently occurring features, a feature subset (minimum of anterior-posterior ratio of even/odd harmonics for right shank, standard deviation (SD) of anterior left shank acceleration SD, SD of mean anterior left shank acceleration, maximum of medial-lateral first quartile of Fourier transform (FQFFT) for lower back, maximum of anterior-posterior FQFFT for lower back) achieved better classification results, with 77.3% accuracy, 66.1% sensitivity, 84.7% specificity, and 0.52 MCC score. All classification performance metrics improved when turn data was used for faller classification, compared to straight walking data. Combining turn and straight walking features decreased performance metrics compared to turn features for similar classifier model—feature selector combinations.

1. Introduction

Falls within elderly populations are a growing public health concern, with fatal and non-fatal fall injuries costing an estimated $23.3 billion in the United States, with a projected cost of $52 billion by 2020 [1,2]. Early fall risk detection and subsequent treatment are needed to mitigate fall incidence and improve quality of life for elderly individuals [3,4,5]. Wearable sensors that can be easily applied at the point-of-care [6] can facilitate quantitative assessments in clinical or older-adult care environments. Reviews of inertial-sensor applications for fall-risk classification in older-adults have recommended further research to determine if wearable sensors can be used to improve fall-risk prediction as a stand-alone assessment tool or supplement to clinical tests [7,8]. Combining appropriate wearable-sensor based features with machine learning techniques could advance fall-risk prediction tools and ultimately improve services for elderly people at risk of falling [6,9].
Fall risk prediction using clinical tests and wearable sensors has had variable success, with accuracy between 62 and 100%, specificity between 35 and 100%, and sensitivity between 55 and 99% [7]. While the top results are encouraging, the lower rates indicate a need for alternative methods to achieve consistently high outcomes. Fall risk assessment research has primarily focused on clinical tests, composed mainly of straight level walking, multiple tasks (e.g., sit-stand, walk-turn), and balance challenging tasks (e.g., stand on one leg, reach). Few quantitative studies involve more than straight walking, such as turns, to predict fall risk [10].
Turn-based features have been found to be important because of the decreased stability and increased energy expenditure when elderly individuals navigate turns [11,12,13,14]. Subtle fall-risk gait-based measures that may not be sensitive enough to reveal fall risk in straight walking may become highly effective fall-risk indicators when applied to walking turns. Elderly individuals at high risk of falling often perform a distinct turn (spin turn) compared to those at low risk of falling [15], suggesting a distinction between fallers and non-fallers for turn walking. A longer turn duration from the Timed Up and Go Test (TUG) [16] discriminated elderly fallers from non-fallers [17]. A study examining combinations of nine specific movements, turn time, and number of steps per turn discriminated between multiple fallers, non-multiple fallers, and able bodied individuals [18]. These clinical examinations of turns suggest that wearable-sensor based methods of assessing walking turns have good potential for classifying fallers.
Existing literature supports the hypothesis that turn data may contain information that can discriminate between fallers and non-fallers better than straight walking data. However, previous research using turns has focused on clinical assessment tools, temporal variables (completion time), or video analysis for fall risk prediction [18,19,20,21]. Faller classification research using wearable-sensor-based features from walking-turns is lacking. Furthermore, no comparison of straight and turn walking features for faller classification has been reported. Such a comparison would be useful for developing a better fall-risk assessment tool. Acceleration data acquired during the Six-Minute Walk Test (6MWT) [22] could provide both turn and straight walking information suitable for such an investigation. This paper presents a novel wearable-sensor based faller classification method, using walking-turn accelerometer-based features, and compares older-adult faller classification using straight and turn walking features. It is hypothesized that turn-walking based accelerometer features will provide better discriminating ability between prospective fallers and non-fallers, and thus provide better faller classification performance than corresponding straight-walking based features.

2. Materials and Methods

2.1. Participants

A convenience sample of 76 individuals, 65 years or older, (mean = 74.15 ± 7.0 years) were recruited from the community. Inclusion criteria were the ability to walk continuously and unaided for six minutes, no existing self-reported cognitive disorders, and not having experienced a fall during the six months prior to the study. Participants had a mean weight of 73.35 ± 13.4 kg and a mean height of 167.25 ± 10.0 cm. The study was approved by the University of Waterloo Research Ethics Committee on 1 August 2013, ORE #: 19106 and 30 June 2016, ORE #: 21599. All participants gave informed written consent.

2.2. Protocol

Participants reported their age and sex. Accelerometers (X16-1C, Gulf Coast Data Concepts, Waveland, MS, USA) were fitted to the posterior pelvis and left and right lateral shanks. Accelerometers were aligned with the vertical (upward: positive), medial-lateral (ML) (right: positive), and anterior-posterior (AP) axes (anterior: positive). Accelerometer data were collected with a nominal sampling rate of 50 Hz, (i.e., sampling rates varied slightly from 50 Hz for all accelerometers, as manufactured).
The six-minute walk test (6MWT) was conducted under standard conditions. Participants walked along a hallway, making consecutive left and right turns around two cones spaced 100 ft (30.34 m) apart [22]. Participants were instructed to alternate left and right turns around the cones until the end of the test and thus could not introduce bias into the turning direction.
A six-month follow-up fall-occurrence survey identified participants who fell at least once as prospective fallers (PF). All other participants were classified as non-fallers (NF). A fall was defined as an event that results in a person coming to rest unintentionally on the ground or other lower level, excluding falls from a stroke or overwhelming hazard [23].
Five participants were excluded because of accelerometer failure (two participants), unreliable data synchronization (one participant), incomplete prospective survey (one participant), and poor turn segmentation due to excessive noise between straight walking and turning sections (one participant). Therefore, 71 participants were included in the study, with 43 non-fallers and 28 prospective fallers.

2.3. Data Pre-Processing

Data for each accelerometer were imported into MATLAB 2014b (MathWorks, Natick, MA, USA) [24]. The sampling rates for each accelerometer differed slightly; therefore, all accelerometer signals were resampled to 50 Hz and then synchronized. This synchronization was performed using the first peak in vertical acceleration of each accelerometer.
6MWT data were segmented into turn and straight sections. Turns were identified from a reduced magnitude in vertical accelerometer signal, defining the start of a turn (Figure 1). This periodic drop in vertical acceleration magnitude (Figure 2) was consistent with a turn occurring at the end of the 100 ft pathway that participants were instructed to walk on. The drop in vertical acceleration magnitude indicated a departure from the periodic straight section gait pattern; therefore, these sections were determined to be turns. In this paper, a turn was standardized as having five steps: a centre step and two adjacent steps on each side of the centre step. A 0.2 s buffer was added before and after the first and last steps. Multiple straight and turn sections were extracted from each 6MWT dataset. In all sections that follow, turn and straight walking data were treated independently, except during Test IV, described in Section 2.6.3.

2.4. Feature Extraction

A review of 40 inertial-sensor based fall risk studies found the dominant Fast Fourier Transform peak parameters (from lower-back accelerometers) and the ratio of even to odd harmonic (REOH) magnitudes (from head, upper back and lower back accelerometers) to both be recurring significant (p < 0.05) features when used to assess fall risk [7]. These features were carried forward in further research demonstrating their effectiveness for faller classification [25,26]. Temporal and acceleration descriptive statistics provided direct measures of body motion related to gait.
Accelerometer based features were calculated for each stride and then averaged across all strides, for each turn or straight section. Steps were identified by peak detection in the vertical acceleration signals. These peaks corresponded with foot strikes and were used in calculating the following accelerometer based features:
  • Temporal: Cadence, stride time (time (s) from foot strike to the following foot strike of the same foot).
  • Acceleration descriptive statistics: Acceleration maximum, mean, standard deviation for each direction for each of three axes (positive and negative of vertical, ML, and AP axes).
  • Acceleration frequency: First quartile of Fourier transform (FQFFT) of each axis (vertical, medial-lateral, anterior-posterior). FQFFT is a percentage of acceleration frequencies within the first quartile (i.e., frequencies below 12.5 Hz) of an FFT frequency plot. A lower FQFFT value indicates the occurrence of more high frequency acceleration components during walking, which has been linked to instability [25,27,28].
  • Ratio of even/odd harmonics (REOH): Ratio of acceleration signal in phase with stride frequency (inverse of stride time) [29,30,31]. Lower REOH values are associated with fall risk [29,30,32,33,34]. REOH was calculated for each axis (vertical, medial-lateral, anterior-posterior).
Twenty-four features were extracted for accelerometers: three descriptive statistics for each of three axes in both the positive and negative directions (3 × 3 × 2 = 18 features), FQFFT for three axes, and REOH for three axes. Cadence and stride time were calculated from acceleration measured by the lower-back accelerometer, for a total of 26 features for the lower back. Each straight and turn section had a total of 74 features (24 for left and right shanks, 26 for lower back: 24 + 24 + 26 = 74 features).
A single feature set was created for each participant using the maximum, minimum, standard deviation, and mean of the 74 features across all of a participant’s straight or turn sections. This produced a single feature set with 4 (maximum, minimum, mean, SD) × 74 (accelerometer derived features) = 296 features for each participant’s turn or straight data. Variation between steps and gait variability have been associated with fall risk [10,35]. Therefore, the standard deviation of repeated measurements of features across a test may be useful for faller classification. Extreme values of features (maxima or minima) have provided more useful information than mean values [36] and were therefore included with the mean and standard deviations.

2.5. Feature Selection

Classification difficulty may arise if many features are non-informative or redundant. These features can lead to poor model generalizability since the model may be modelling noise in the features, leading to poor classification results [37]. Feature selection was performed to eliminate redundant and non-informative features before classification [38]. Three feature selection methods (feature selectors) were used for each respective classifier to assess performance. The first feature selector, Select-k-Best, based on ANOVA F-statistics, selected features that accounted for the most variance between classes [39,40]. The variable k was set to 5 based on a heuristic search (select-5-best, S5B). The second feature selector (SEL) was based on Select False Positive Rate (SFPR) and Select False Discovery Rate (SFDR) methods, which chose features that minimized false positive and false discovery rates, respectively. The resulting list of SFPR and SFDR selected features were concatenated into a single non-redundant list. The number of features selected with SEL was not restricted. The third feature selector, recursive feature elimination (RFE), performed multiple data classifications using a random forest classifier, kept features that provided better classification results, and eliminated features with poorer results [41,42]. This process was repeated until the five best features were selected. Feature selection was performed only on training data for the classifier models. The selected features were then applied to the testing data for classification. Division and use of training and testing datasets are described in Section 2.6.2.

2.6. Classification

2.6.1. Machine Learning Models

Six classifier models were trained to classify participants as faller or non-faller: two k-nearest neighbor (kNN) classifiers with k = 3 (3NN) and k = 5 (5NN); three support vector machines (SVM) with linear, third, and fifth order polynomial kernels; and one random forest (RF) model. RF and kNN are non-parametric models that allow irregular class boundaries. All SVMs used a method where overlapping classes may become separable by using the “kernel trick” by projecting the data into higher dimensions [43,44]. RF is an ensemble method that creates a strong classifier based on many decision trees, thereby accommodating individual tree weaknesses. One hundred decision trees were trained for each RF classifier. Models were generated with the Scikit-Learn library [41].

2.6.2. Cross Validation

A subset of the full dataset was used for model training, and the remaining data subset (testing dataset) was used to evaluate model performance for all faller-classification tests. Two cross validation (CV) methods were used (the sequence of tests is described in Section 2.6.3): five-fold cross validation (5FCV) and 2500-iteration random-shuffle-split cross validation (2500-RSS). Both methods used stratified data splits, which ensured that the ratio of fallers to non-fallers from the whole dataset was preserved in both the training and testing data.
5FCV divided the data into five stratified subsets (20% data in each subset), with one subset chosen for model testing and the remaining four subsets combined for model training. The three feature selectors (Select-k-Best, SEL and RFE) were applied to the training subset, thereby providing three best feature sets for classification. Classifier training (on four subsets combined) and testing (on the fifth subset) were then performed five times such that every subset was used as the testing set. The five sets of results were averaged to obtain final results for each classification model—feature-selector combination. With six classifier methods and three feature selection methods, a total of 18 classification-model—feature-selector (CM-FS) combinations were generated from 5FCV. The best CM-FS combinations were used in the 2500-RSS for both straight and turn-based data.
For 2500-RSS, a single stratified-random-shuffle split was configured to select a stratified random subset of 80% of the data for training the model with the remaining 20% of the data as a stratified random subset for model testing. This process was repeated for 2500 iterations. For each iteration, feature selection was performed on the training data and a new classification model was trained and tested. Feature selection was based solely on cross validation iteration training data. Mean, standard deviation, and confidence interval were calculated based on results from the 2500 iterations. Unlike 5FCV, this method does not guarantee that all testing subsets will be disjoint. However, because of the large number of iterations, many unique data splits will determine if the models generalize well. The chosen number of iterations was based on convergence of the classifier mean accuracy.
Within each cross-validation described above, normalization of features was performed before feature selection and classifier training. Normalization of features allows faster model training [38,45]. Each feature value in a participant’s feature set was normalized to the range [0, 1] as follows:
y n o r m a l i z e d = y y m i n y m a x y m i n ,
where y is a feature value from one participant, and ymin and ymax are the minimum and maximum values of that feature, respectively, across all participants within a training set for each cross-validation fold. These normalization parameters, ymin and ymax from the training set, were used to normalize the testing data features. This normalization prevents testing data from biasing classifier training.

2.6.3. Performance Evaluation

Performance for each CM-FS combination was evaluated using accuracy (ACC), specificity (SPEC), sensitivity (SENS), negative predictive value (NPV), positive predictive value (PPV), F1 score, and Matthews Correlation Coefficient (MCC) [46,47]. For 5FCV, means for these metrics were calculated over the five cross-validation folds. For 2500-RSS, mean, standard deviation and confidence interval of these metrics were calculated over the 2500 iterations.
To determine the best performing CM-FS combination, classifier performance metrics were sorted in descending order with the largest result (best) given a value of 1, the second a 2, etc. Ties were given the same rank, with the next non-tied classifier being ranked by their position after accounting for the tied classifiers (e.g., a three-way tie at position three results in: 1, 2, 3, 3, 3, 6, 7, …) [48]. Rankings were summed across performance measures, with the lowest sum indicating the best classifier. This generated one score for each CM-FS combination.
Three tests were performed in sequence for both straight and turn data separately (Figure 3), Test I performed first, then Test II, followed by Test III. A final test, Test IV, was performed using all turn and straight features together to determine if including all features would further improve or worsen performance. An overview of the flow of data and classification methods is shown in Figure 4. Test I used 5FCV for all 18 CM-FS combinations (six classifiers, three feature selectors). The top-nine combinations were evaluated and one classifier and one feature selector that appeared the least were discarded, for both straight and turn results, which expedited training. The 10 remaining CM-FS combinations were then used in Test II. Test II used 2500 RSS cross validation to evaluate performance of the remaining five classifiers and two feature selectors combinations (10 CM-FS combinations). Welch’s t-tests compared straight and turn performance metrics for the best straight and turn based CM-FS combinations from Test II.
For Test III, the most frequently occurring (MFO) features from the feature selections of Test II, selected for 250 or more iterations (selected for 10% of the iterations from 2500-RSS cross validation), were combined into multiple sets. The entire set of most frequent features was ordered from most frequent (f0) to least frequent (fn), X0 = [f0fn]. The first set was composed of all of the most frequent features, X0 = f0fn], the second set was composed of the n − 1 most frequent features, X1 = [f0fn − 1], the third set was composed of the n − 2 most frequent features, X2 = [f0 … fn − 2], and so on until the final subset had only the most frequent feature Xn = [f0]. Starting with a set of all the most frequent features to a final set having one feature, 2500-RSS cross validation was performed for each new generated feature set Xi, i = [0, n] (Figure 5), using the best classifier model from Test II. This analysis was performed for straight and turn data. Test III determined the best subsets of features for faller classification.
For Test IV, a combined feature set, composed of all straight and turn based features, was used with the top four best performing classifier-models from Test II and the best two feature selectors from Test I, to provide a set of CM-FS combinations. Before feature selection, the feature set of each participant had a concatenation of all straight and turn features, a total of 592 features (2 × 296). A 2500 RSS cross validation was performed to evaluate the classification performance of the combined straight and turn feature set with the selected CM-FS combinations.
To promote classification generalizability and reliability, and to avoid methodological problems associated with validation and training-testing protocols seen in the fall-risk assessment literature [49], two stratified cross-validation methods were used. The top classifiers and feature selectors were chosen in Test I using 5FCV and then used for Test II, which used 2500-RSS cross validation.

3. Results

3.1. Test I

Test I results for straight-walking using 5FCV are presented in Table 1. The RF and S5B combination was the best with 62.0% accuracy, 46.4% sensitivity, 72.1% specificity and 0.19 MCC. The second-best model also used S5B feature selection, and had greater sensitivity (78.6%) but lower specificity and accuracy.
Compared to straight walking, turn data had better faller classification (Table 2). The best turn-based combination was RF S5B, with 77.5% accuracy, 67.9% sensitivity, 83.7% specificity, and 0.52 MCC score. The second best results, obtained using RF SEL, were similar to RF S5B.
RF, 3NN, and 5NN, and linear and third order polynomial SVM classifiers performed best in Test I. The worst performing classifier was the fifth degree polynomial SVM, which appeared only once in the top-nine combinations for the straight data and not at all for the turn data. S5B and SEL feature selectors performed better than RFE using the same classifier models. The worst feature selector was the RFE, which appeared four times, compared to seven times for S5B and SEL methods. Based on these results, the fifth order polynomial SVM classifier and RFE selector were eliminated from further tests. Therefore, RF, 3NN, 5NN, and linear and third order polynomial SVM classifiers, and S5B and SEL feature selectors were used for Test II, for both turn and straight datasets.

3.2. Test II

3.2.1. Classification

Faller classification results for Test II (Table 3 and Table 4) were similar to Test I. Faller classification with turn data (Table 4) outperformed straight walking data (Table 3). The best turn-based combination (RF S5B) had 73.4% accuracy, 60.5% sensitivity, 82.0% specificity, and 0.44 MCC score. The best straight-walking-based combination (3NN S5B) had 55.5% accuracy, 46.1% sensitivity, 61.8% specificity and 0.08 MCC score. All performance metrics (accuracy, sensitivity, specificity, PPV, NPV, F1-score, and MCC) of the best turn-feature based CM-FS combination (RF S5B) were significantly greater (p < 0.001) than the corresponding metrics of the best straight-feature based CM-FS combination (3NN S5B).

3.2.2. Selected Features

As described in Section 2.4, a single feature set was created for each participant using the maximum, minimum, standard deviation (SD), and mean of the 74 features across all of a participant’s straight sections, and similarly a single feature set was created based on all turn sections.
Histograms of 2500-RSS selected features with selection frequencies above 8% (200 out of 2500 iterations) for straight walking, using SEL and S5B, are shown in Figure 6 and Figure 7, respectively (note that “MFO features” include only features with selection frequency above 250). The most frequently occurring S5B features, in descending order of frequency, were: maximum of SD of anterior RS acceleration, SD of maximum posterior LS acceleration, minimum of SD of anterior RS acceleration, mean of SD anterior RS acceleration, SD of mean inferior LB acceleration, mean of mean anterior RS acceleration, maximum of SD anterior LB acceleration, maximum of mean anterior RS acceleration, maximum of maximum anterior LB acceleration, maximum of mean anterior LB acceleration, mean of maximum anterior LB acceleration, SD of SD inferior LB acceleration, SD of mean anterior LB acceleration, SD of mean posterior LS acceleration. For the SEL method, the top features were similar; however, SEL frequencies were lower overall and frequency ordering was not the same.
Histograms of 2500-RSS selected features with selection frequencies above 8% (200 out of 2500 iterations) for turns, using SEL and S5B, are shown in Figure 8 and Figure 9, respectively (note that “MFO features” include only features with selection frequency above 250). The most frequently occurring turn based features for the S5B method, in descending order of frequency, were: minimum of anterior-posterior REOH for RS, SD of SD anterior LS acceleration, SD of mean anterior LS acceleration, maximum of medial-lateral FQFFT for LB, maximum of anterior-posterior FQFFT for LB, SD of maximum anterior LS acceleration, SD of vertical FQFFT for RS, maximum of vertical FQFFT for LS, and maximum of anterior-posterior FQFFT for LS. For the SEL method, the top features were similar; however, frequency ordering was slightly different.

3.3. Test III

The best results for straight walking (Table 5) were for the 5 MFO feature subset (maximum of SD of anterior RS acceleration, SD of maximum posterior LS acceleration, minimum of SD of anterior RS acceleration, mean of SD anterior RS acceleration, SD of mean inferior LB acceleration), with 64.1% accuracy, 59.9% sensitivity, 66.9% specificity, and 0.26 MCC score. For turn walking (Table 6), the best results were for the 5 MFO feature subset (minimum of anterior-posterior REOH for RS, SD of SD anterior LS acceleration, SD of mean anterior LS acceleration, maximum of medial-lateral FQFFT for LB, maximum of anterior-posterior FQFFT for LB), with 77.3% accuracy, 66.1% sensitivity, 84.7% specificity, and 0.52 MCC score. The Test III results were generally superior to those of Test II, where all accuracies of Test III were greater than those for Test II.

3.4 Test IV

3.4.1. Classification

The best classification results for the combined set of straight and turn based features (Table 7) were attained using a RF S5B combination, with 71.6% accuracy, 57.5% sensitivity, 81.1% specificity and 0.4 MCC score. The best three CM-FS combinations for Test IV were the same as the best turn-based feature CM-FS combinations in Test II. The CM-FS combinations from Test IV (combined straight and turn based feature sets) provided better performance metrics than the corresponding straight-based feature CM-FS combinations in Test II, and were similar or slightly worse performance metrics than for the corresponding turn-based feature CM-FS combinations in Test II.

3.4.2. Selected Features from Combined Straight and Turn Feature Set

The S5B and SEL methods selected similar MFO features. For both methods, nine of the ten MFO features selected from the combined straight and turn feature set were turn-based features. These nine features were the same as the turn-based MFO features from Test II. These included: the minimum of anterior-posterior REOH for RS, SD of SD anterior LS acceleration, SD of mean anterior LS acceleration, maximum of medial-lateral FQFFT for LB, maximum of anterior-posterior FQFFT for LB, SD of maximum anterior LS acceleration, SD of vertical FQFFT for RS, maximum of vertical FQFFT for LS, and maximum of anterior-posterior FQFFT for LS. The only straight walking feature among the 10 MFO features was the SD of maximum posterior LS acceleration using the S5B algorithm, and the maximum of SD of anterior RS acceleration for the SEL algorithm.

4. Discussion

A new method for faller classification in older adults was developed using walking-turn accelerometer-based features extracted from wearable sensor data. This research confirmed that turn features performed better than straight walking features for prospective faller classification, and the best overall classification method used a random forest classifier and five turn-based features, obtained from the S5B feature selection process.
Test I determined that turn features performed better than straight walking features for prospective faller classification since turn-based models had greater accuracy, sensitivity, specificity, F1-score, and MCC than straight-walking models. Test II reinforced the conclusions from Test I, since turn features also outperformed straight walking features for faller classification. The best turn-based classifier-feature selector combination (RF-S5B) had results that were at least 24% greater than corresponding best straight-walking results, with the worst turn-based classifier outperforming the best straight-walking-based classifier. All performance metrics of the best turn-feature based CM-FS combination were significantly greater than the corresponding metrics of the best straight-feature based CM-FS combination. The narrow confidence intervals, which were less than ±1% for turn classification performance metrics and ±1.32% for straight walking, support the generalizability of these results for population-based applications. Based on the law of large numbers [50] and narrow 95% confidence intervals, the 2500-RSS, used for Tests II and III, generated viable mean results, indicating that the mean values were likely similar to population values.
Test III, using 2500-RSS cross validation, again confirmed the findings that turn features produced a better performing classifier than straight-walking based features. Test III also determined that, for turns, the best feature subset included minimum of anterior-posterior REOH for right shank, SD of SD anterior left shank acceleration, SD of mean anterior left shank acceleration, maximum of medial-lateral FQFFT for lower back, and maximum of anterior-posterior FQFFT for lower back. Feature maxima, minima, and SD appeared more often in the best feature subset than mean-based features. This suggested that extreme values (maximum and minimum) and variability (SD) provide better discriminative information for turns, as found in previous research [36].
Test IV was performed to determine if all available features from both straight and turn sections would further improve performance over turn-only-based features. Poorer performance was observed for the CM-FS combinations of Test IV (straight and turn features) compared to their corresponding turn-only-based feature CM-FS combinations from Test II. This suggests that adding straight-walking-based features does not aid in faller classification when turn-based features are used. Furthermore, it was found that during the 2500 iterations of feature selection for both S5B and SEL methods, nine of the ten MFO features were turn-based features, showing that the information in the turn-based features was more useful for classification.
The most frequently occurring turn feature in the feature selection process (Test II and Test IV) was minimum anterior-posterior REOH for the right shank, which composed the 1 MFO feature subset. Interestingly, only modest differences occurred between the 1 MFO feature subset and the best feature subset (5 MFO Feature). The strong performance using only the minimum-AP-REOH-right-shank feature indicates the importance of this feature for faller classification. This result is supported by [25,29,30,32,33,34,51], where a small REOH indicated step-to-step asymmetry within strides and possibly gait instability. Two features in the 5 MFO feature subset involved the lower back sensor maximum FQFFT, across all turn sections for the anterior-posterior and medial-lateral axes. A low FQFFT value indicates more high frequency than low frequency components. Walking can be associated with activities linked to decreased stability [52] and higher frequency components indicate less steady movements [27,28] and possibly sudden movements to recover balance; therefore, frequency components at the lower back may be useful for faller classification. The remaining two features of the 5 MFO feature subset were the SD of the mean anterior left shank acceleration and SD of anterior left shank acceleration SD. These features were related to variation across different sections, suggesting that acceleration variation over time can be a good indicator for faller classification. More gait variability has been linked to fall risk [10,35]. To enable further interpretation of the discriminative ability of the 5 MFO feature subset, a statistical comparison of faller and non-faller group feature values should be undertaken in a future study.
Previous approaches that used turn-walking to discriminate fallers and non-fallers mainly used the TUG test [18,19,20,21,27]. However, a meta-analysis of 53 studies suggested that TUG was ineffective for determining fall risk for healthy older individuals [53]. This was primarily due to variations in the thresholds across studies used to classify fallers and non-fallers. Since this study included multiple turn sections and found that classification using turn-based features performed better than using straight-walking features, the methods of this study may be a more suitable alternative than the TUG for prospectively classifying fallers.
Other faller classification studies have found better and worse classification results compared to this paper, with accuracies between 62 and 100%, specificities between 35 and 100%, and sensitivities between 55 and 99% [7] based on straight walking data. The types of populations (retrospective or prospective fallers; single-fall or multiple-fall fallers) and methodologies vary, and differ from the current paper. The prospective fall prediction study in [26] permits comparison based on the identical older-adult population. The turn-feature based classification results in this paper (73.4% accuracy, 60.5% sensitivity, 82.0% specificity, and 0.44 MCC score) were better than the best straight-walking classification results in [26] (56.5% accuracy, 42.5% sensitivity, 65.4% specificity and 0.083 MCC score), based on similar accelerometer derived features for 25 ft walk single-task and dual-task tests, and similar cross validation with 10,000 random stratified splits. Those results for straight walking were similar to the straight-walking-based classification results in Test II of this paper (55.5% accuracy, 46.1% sensitivity, 61.8% specificity and 0.08 MCC). Since the straight-walking classifier performances for [26] and this paper were similar, it is likely that the use of turn-based features was the main contributing factor to improved classification results (turn compared to straight), rather than the inclusion of more walking sections (6MWT in this paper compared to 25 ft walk test in [26]). This strongly suggests that turn-based features provide better information for prospective faller classification and thus faller prediction.
In this study, a turn was defined using a fixed number of steps. While this standardized the analysis, this method may have led to one or two extra or missed steps for a participant’s turn. The effect on the REOH feature from fixing the number of steps in a turn to five is unknown and would be of interest for further study. Turn segmentation could be improved using gyroscope data or video capture of the walking trial.
Existing elderly fall screening assessments could benefit by better prospective faller classification. The results of this research suggest that integrating wearable-sensor turn-based features and machine learning in elderly screening assessments may improve faller identification. Since a shorter test might be easier to administer in a clinical setting, future research could study whether a shorter distance with fewer turns could also be effective. This study has demonstrated that turn-based features permit better prospective faller classification than using straight-walking features. Future studies employing improved turn segmentation or turning tasks (e.g., figure-eight patterns) without need for segmentation, and additional features (e.g., entropy [54], frequency based) could lead to more reliable classification suitable for clinical implementation.

5. Conclusions

A novel wearable-sensor based faller classification method using walking-turns was developed. This work is the first to directly compare prospective classification results using straight and turn walking data, based on wearable-accelerometer measures. A marked improvement in all classification performance metrics occurred when turn data was used for faller classification, compared to straight walking data. Turn data acquired from accelerometers contains useful biomechanical information that can improve prospective fall risk classification for healthy older adults. A random forest classifier paired with a select-5-best (S5B) feature selector provided the best classification results for both turn and straight walking data. The most frequently occurring turn feature in the feature selection process was the minimum anterior-posterior REOH for the right shank, which formed the 1 MFO feature subset and produced comparable results to the 5 MFO feature subset, indicating the importance of this feature for faller classification. Future work could examine the effectiveness of the most frequently selected, best performing turn features on faller classification in other populations. Combining straight and turn-based features for prospective faller classification did not improve classification models that used only turn-based features.

Acknowledgments

This work was supported by the Natural Sciences and Engineering Research Council of Canada (NSERC). The authors thank Deep Shah for assistance with data collection, the United Church of Canada and the University of Waterloo Retirees Association for assistance with recruitment, and the Chartwell Bankside Terrace Retirement Residence for assistance with recruitment and providing space for data collection at their facility.

Author Contributions

D.D., J.H., J.K. and E.D.L. conceived and designed the experiments; D.D. and J.H. performed the experiments; D.D. analyzed the data; D.D., J.H., J.K. and E.D.L. wrote the paper; and J.K. and E.D.L. supervised the research.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Davis, J.C.; Robertson, M.C.; Ashe, M.C.; Liu-Ambrose, T.; Khan, K.M.; Marra, C.A. International comparison of cost of falls in older adults living in the community: A systematic review. Osteoporos. Int. 2010, 21, 1295–1306. [Google Scholar] [CrossRef] [PubMed]
  2. Englander, F.; Terregrossa, R.A.; Hodson, T.J. Economic dimensions of slip and fall injuries. J. Forensic Sci. 1996, 41, 733–746. [Google Scholar] [CrossRef] [PubMed]
  3. El-Khoury, F.; Cassou, B.; Charles, M.-A.; Dargent-Molina, P. The effect of fall prevention exercise programmes on fall induced injuries in community dwelling older adults: Systematic review and meta-analysis of randomised controlled trials. BMJ 2013, 347, f6234. [Google Scholar] [CrossRef] [PubMed]
  4. Tinetti, M.E. Preventing falls in elderly persons. N. Engl. J. Med. 2003, 348, 42–49. [Google Scholar] [CrossRef] [PubMed]
  5. Rao, S.S. Prevention of falls in older patients. Am. Fam. Physician 2005, 72, 81–88. [Google Scholar] [PubMed]
  6. Özdemir, A.T.; Barshan, B. Detecting Falls with Wearable Sensors Using Machine Learning Techniques. Sensors 2014, 14, 10691–10708. [Google Scholar] [CrossRef] [PubMed]
  7. Howcroft, J.; Kofman, J.; Lemaire, E.D. Review of fall risk assessment in geriatric populations using inertial sensors. J. Neuroeng. Rehabil. 2013, 10, 1. [Google Scholar] [CrossRef] [PubMed]
  8. Ejupi, A.; Lord, S.R.; Delbaere, K. New methods for fall risk prediction. Curr. Opin. Clin. Nutr. Metab. Care 2014, 17, 407–411. [Google Scholar] [CrossRef] [PubMed]
  9. Tax, D.M.; Duin, R.P. Feature scaling in support vector data descriptions. Learn. Imbalanced Datasets 2000, 25–30. [Google Scholar]
  10. Mancini, M.; Schlueter, H.; El-Gohary, M.; Mattek, N.; Duncan, C.; Kaye, J.; Horak, F.B. Continuous monitoring of turning mobility and its association to falls and cognitive function: A pilot study. J. Gerontol. A Biol. Sci. Med. Sci. 2016, 71, 1102–1108. [Google Scholar] [CrossRef] [PubMed]
  11. Segal, A.D.; Orendurff, M.S.; Czerniecki, J.M.; Shofer, J.B.; Klute, G.K. Local dynamic stability in turning and straight-line gait. J. Biomech. 2008, 41, 1486–1493. [Google Scholar] [CrossRef] [PubMed]
  12. Fino, P.C.; Frames, C.W.; Lockhart, T.E. Classifying step and spin turns using wireless gyroscopes and implications for fall risk assessments. Sensors 2015, 15, 10676–10685. [Google Scholar] [CrossRef] [PubMed]
  13. Justine, M.; Manaf, H.; Sulaiman, A.; Razi, S.; Alias, H.A. Sharp turning and corner turning: Comparison of energy expenditure, gait parameters, and level of fatigue among community-dwelling elderly. BioMed Res. Int. 2014, 2014. [Google Scholar] [CrossRef] [PubMed]
  14. Glaister, B.C.; Bernatz, G.C.; Klute, G.K.; Orendurff, M.S. Video task analysis of turning during activities of daily living. Gait Posture 2007, 25, 289–294. [Google Scholar] [CrossRef] [PubMed]
  15. Yamada, M.; Higuchi, T.; Mori, S.; Uemura, K.; Nagai, K.; Aoyama, T.; Ichihashi, N. Maladaptive turning and gaze behavior induces impaired stepping on multiple footfall targets during gait in older individuals who are at high risk of falling. Arch. Gerontol. Geriatr. 2012, 54, e102–e108. [Google Scholar] [CrossRef] [PubMed]
  16. Yorozu, A.; Moriguchi, T.; Takahashi, M. Improved leg tracking considering gait phase and spline-based interpolation during turning motion in walk tests. Sensors 2015, 15, 22451–22472. [Google Scholar] [CrossRef] [PubMed]
  17. Greene, B.R.; O’Donovan, A.; Romero-Ortuno, R.; Cogan, L.; Scanaill, C.N.; Kenny, R.A. Quantitative falls risk assessment using the Timed Up and Go Test. IEEE Trans. Biomed. Eng. 2010, 57, 2918–2926. [Google Scholar] [CrossRef] [PubMed]
  18. Dite, W.; Temple, V.A. A clinical test of stepping and change of direction to identify multiple falling older adults. Arch. Phys. Med. Rehabil. 2002, 83, 1566–1571. [Google Scholar] [CrossRef] [PubMed]
  19. Dite, W.; Temple, V.A. Development of a clinical measure of turning for older adults. Am. J. Phys. Med. Rehabil. 2002, 81, 857–866. [Google Scholar] [CrossRef] [PubMed]
  20. Thigpen, M.T.; Light, K.E.; Creel, G.L.; Flynn, S.M. Turning difficulty characteristics of adults aged 65 years or older. Phys. Ther. 2000, 80, 1174–1187. [Google Scholar] [PubMed]
  21. Skrba, Z.; O’Mullane, B.; Greene, B.R.; Scanaill, C.N.; Fan, C.W.; Quigley, A.; Nixon, P. Objective real-time assessment of walking and turning in elderly adults. In Proceedings of the 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Minneapolis, MN, USA, 3–6 September 2009; pp. 807–810. [Google Scholar]
  22. Guyatt, G.H.; Sullivan, M.J.; Thompson, P.J.; Fallen, E.L.; Pugsley, S.O.; Taylor, D.W.; Berman, L.B. The 6-minute walk: A new measure of exercise capacity in patients with chronic heart failure. Can. Med. Assoc. J. 1985, 132, 919–923. [Google Scholar] [PubMed]
  23. World Health Organization Falls. Available online: http://www.who.int/mediacentre/factsheets/fs344/en/ (accessed on 29 October 2016).
  24. The MathWorks, Inc. MATLAB and Statistics Toolbox Release 2012b, The MathWorks, Inc.: Natick, MA, USA, 2012.
  25. Howcroft, J.; Lemaire, E.D.; Kofman, J. Wearable-sensor-based classification models of faller status in older adults. PLoS ONE 2016, 11, e0153240. [Google Scholar] [CrossRef] [PubMed]
  26. Howcroft, J.; Kofman, J.; Lemaire, E. Prospective fall-risk prediction models for older adults based on wearable sensors. IEEE Trans. Neural Syst. Rehabil. Eng. 2017. [Google Scholar] [CrossRef] [PubMed]
  27. Doheny, E.P.; Walsh, C.; Foran, T.; Greene, B.R.; Fan, C.W.; Cunningham, C.; Kenny, R.A. Falls classification using tri-axial accelerometers during the five-times-sit-to-stand test. Gait Posture 2013, 38, 1021–1025. [Google Scholar] [CrossRef] [PubMed]
  28. Prieto, T.E.; Myklebust, J.B.; Hoffmann, R.G.; Lovett, E.G.; Myklebust, B.M. Measures of postural steadiness: Differences between healthy young and elderly adults. IEEE Trans. Biomed. Eng. 1996, 43, 956–966. [Google Scholar] [CrossRef] [PubMed]
  29. Menz, H.B.; Lord, S.R.; Fitzpatrick, R.C. Acceleration patterns of the head and pelvis when walking are associated with risk of falling in community-dwelling older people. J. Gerontol. A Biol. Sci. Med. Sci. 2003, 58, M446–M452. [Google Scholar] [CrossRef] [PubMed]
  30. Yack, H.J.; Berger, R.C. Dynamic stability in the elderly: Identifying a possible measure. J. Gerontol. 1993, 48, M225–M230. [Google Scholar] [CrossRef] [PubMed]
  31. Smidt, G.L.; Arora, J.S.; Johnston, R.C. Accelerographic analysis of several types of walking. Am. J. Phys. Med. Rehabil. 1971, 50, 285–300. [Google Scholar]
  32. Bellanca, J.L.; Lowry, K.A.; VanSwearingen, J.M.; Brach, J.S.; Redfern, M.S. Harmonic ratios: A quantification of step to step symmetry. J. Biomech. 2013, 46, 828–831. [Google Scholar] [CrossRef] [PubMed]
  33. Doi, T.; Hirata, S.; Ono, R.; Tsutsumimoto, K.; Misu, S.; Ando, H. The harmonic ratio of trunk acceleration predicts falling among older people: Results of a 1-year prospective study. J. Neuroeng. Rehabil. 2013, 10, 1. [Google Scholar] [CrossRef] [PubMed]
  34. Punt, M.; Bruijn, S.M.; van Schooten, K.S.; Pijnappels, M.; van de Port, I.G.; Wittink, H.; van Dieën, J.H. Characteristics of daily life gait in fall and non fall-prone stroke survivors and controls. J. Neuroeng. Rehabil. 2016, 13, 67. [Google Scholar] [CrossRef] [PubMed]
  35. Weiss, A.; Brozgol, M.; Dorfman, M.; Herman, T.; Shema, S.; Giladi, N.; Hausdorff, J.M. Does the evaluation of gait quality during daily life provide insight into fall risk? A novel approach using 3-day accelerometer recordings. Neurorehabil. Neural Repair 2013, 27, 742–752. [Google Scholar] [CrossRef] [PubMed]
  36. Rispens, S.M.; van Schooten, K.S.; Pijnappels, M.; Daffertshofer, A.; Beek, P.J.; van Dieën, J.H. Do extreme values of daily-life gait characteristics provide more information about fall risk than median values? JMIR Res. Protoc. 2015, 4, e4. [Google Scholar] [CrossRef] [PubMed]
  37. Friedman, J.; Hastie, T.; Tibshirani, R. The Elements of Statistical Learning, Springer Series in Statistics; Springer: Berlin, Germany, 2011; Volume 1. [Google Scholar]
  38. Liang, S.; Ning, Y.; Li, H.; Wang, L.; Mei, Z.; Ma, Y.; Zhao, G. Feature selection and predictors of falls with foot force sensors using kNN-based algorithms. Sensors 2015, 15, 29393–29407. [Google Scholar] [CrossRef] [PubMed]
  39. Guyon, I.; Elisseeff, A. An Introduction to Variable and Feature Selection. J. Mach. Learn. Res. 2003, 3, 1157–1182. [Google Scholar]
  40. Ding, C.; Peng, H. Minimum redundancy feature selection from microarray gene expression data. J. Bioinform. Comput. Biol. 2005, 3, 185–205. [Google Scholar] [CrossRef] [PubMed]
  41. Pedregosa, F.; Varoquaux, G.; Gramfort, A.; Michel, V.; Thirion, B.; Grisel, O.; Blondel, M.; Prettenhofer, P.; Weiss, R.; Dubourg, V.; Vanderplas, J. Scikit-learn: Machine learning in Python. J. Mach. Learn. Res. 2011, 12, 2825–2830. [Google Scholar]
  42. Guyon, I.; Weston, J.; Barnhill, S.; Vapnik, V. Gene selection for cancer classification using support vector machines. Mach. Learn. 2002, 46, 389–422. [Google Scholar] [CrossRef]
  43. Cortes, C.; Vapnik, V. Support-vector networks. Mach. Learn. 1995, 20, 273–297. [Google Scholar] [CrossRef]
  44. Boser, B.E.; Guyon, I.M.; Vapnik, V.N. A training algorithm for optimal margin classifiers. In Proceedings of the Fifth Annual Workshop on Computational Learning Theory (ACM), Pittsburgh, PA, USA, 27–29 July 1992; pp. 144–152. [Google Scholar]
  45. Grus, J. Data Science from Scratch: First Principles with Python; O’Reilly Media, Inc.: Sebastopol, CA, USA, 2015. [Google Scholar]
  46. Matthews, B.W. Comparison of the predicted and observed secondary structure of T4 phage lysozyme. Biochim. Biophys. Acta BBA Protein Struct. 1975, 405, 442–451. [Google Scholar] [CrossRef]
  47. Van Rijsbergen, C.J. A theoretical basis for the use of co-occurrence data in information retrieval. J. Doc. 1977, 33, 106–119. [Google Scholar] [CrossRef]
  48. Kendell, C.; Lemaire, E.D.; Losier, Y.; Wilson, A.; Chan, A.; Hudgins, B. A novel approach to surface electromyography: An exploratory study of electrode-pair selection based on signal characteristics. J. Neuroeng. Rehabil. 2012, 9, 1. [Google Scholar] [CrossRef] [PubMed]
  49. Shany, T.; Wang, K.; Liu, Y.; Lovell, N.H.; Redmond, S.J. Review: Are we stumbling in our quest to find the best predictor? Over-optimism in sensor-based models for predicting falls in older adults. Healthc. Technol. Lett. 2015, 2, 79–88. [Google Scholar] [CrossRef] [PubMed]
  50. Hsu, P.-L.; Robbins, H. Complete convergence and the law of large numbers. Proc. Natl. Acad. Sci. USA 1947, 33, 25–31. [Google Scholar] [CrossRef] [PubMed]
  51. Latt, M.D.; Menz, H.B.; Fung, V.S.; Lord, S.R. Acceleration patterns of the head and pelvis during gait in older people with Parkinson’s disease: A comparison of fallers and nonfallers. J. Gerontol. A Biol. Sci. Med. Sci. 2009, 64, 700–706. [Google Scholar] [CrossRef] [PubMed]
  52. Howcroft, J.; Kofman, J.; Lemaire, E.D.; McIlroy, W.E. Analysis of dual-task elderly gait in fallers and non-fallers using wearable sensors. J. Biomech. 2016, 49, 992–1001. [Google Scholar] [CrossRef] [PubMed]
  53. Schoene, D.; Wu, S.M.-S.; Mikolaizak, A.S.; Menant, J.C.; Smith, S.T.; Delbaere, K.; Lord, S.R. Discriminative ability and predictive validity of the Timed Up and Go test in identifying older people who fall: Systematic review and meta-analysis. J. Am. Geriatr. Soc. 2013, 61, 202–208. [Google Scholar] [CrossRef] [PubMed]
  54. Lee, C.-H.; Sun, T.-L.; Jiang, B.C.; Choi, V.H. Using wearable accelerometers in a community service context to categorize falling behavior. Entropy 2016, 18, 257. [Google Scholar] [CrossRef]
Figure 1. Vertical accelerometer signals from right shank (RS) and left shank (LS) with segmented turn.
Figure 1. Vertical accelerometer signals from right shank (RS) and left shank (LS) with segmented turn.
Sensors 17 01321 g001
Figure 2. Section of left and right vertical accelerometer signals. Periodic drops in vertical acceleration magnitude locate turns in the 6MWT.
Figure 2. Section of left and right vertical accelerometer signals. Periodic drops in vertical acceleration magnitude locate turns in the 6MWT.
Sensors 17 01321 g002
Figure 3. Model performance evaluations.
Figure 3. Model performance evaluations.
Sensors 17 01321 g003
Figure 4. Overview of data processing and classification process.
Figure 4. Overview of data processing and classification process.
Sensors 17 01321 g004
Figure 5. Test III procedure for testing most frequently occurring feature subsets.
Figure 5. Test III procedure for testing most frequently occurring feature subsets.
Sensors 17 01321 g005
Figure 6. Histogram of selected straight-walking feature frequency above 8% (200) of 2500 total selections using the combination of Select False Positive Rate and Select False Discovery Rate methods (SEL) for 2500 random-shuffle-split iterations.
Figure 6. Histogram of selected straight-walking feature frequency above 8% (200) of 2500 total selections using the combination of Select False Positive Rate and Select False Discovery Rate methods (SEL) for 2500 random-shuffle-split iterations.
Sensors 17 01321 g006
Figure 7. Histogram of selected straight-walking feature frequency above 8% (200) of 2500 total selections using the select-5-best (S5B) method for 2500 random-shuffle-split iterations.
Figure 7. Histogram of selected straight-walking feature frequency above 8% (200) of 2500 total selections using the select-5-best (S5B) method for 2500 random-shuffle-split iterations.
Sensors 17 01321 g007
Figure 8. Histogram of selected turn-based feature frequency above 8% (200) of 2500 total selections using the combination of Select False Positive Rate and Select False Discovery Rate methods (SEL) for 2500 random-shuffle-split iterations.
Figure 8. Histogram of selected turn-based feature frequency above 8% (200) of 2500 total selections using the combination of Select False Positive Rate and Select False Discovery Rate methods (SEL) for 2500 random-shuffle-split iterations.
Sensors 17 01321 g008
Figure 9. Histogram of selected turn-based feature frequency above 8% (200) of 2500 total selections using the select-5-best (S5B) method for 2500 random-shuffle-split iterations.
Figure 9. Histogram of selected turn-based feature frequency above 8% (200) of 2500 total selections using the select-5-best (S5B) method for 2500 random-shuffle-split iterations.
Sensors 17 01321 g009
Table 1. Straight-walking section five-fold cross validation (5FCV) results. PPV: positive predictive value, NPV: negative predictive value, MCC: Matthews correlation coefficient, S5B: select-5-best, SEL: false positive and discovery rate method, RFE: recursive feature eliminator, RF: random forest, kNN: k-nearest neighbour, SVM: support vector machine, linear: linear kernel, poly: polynomial kernel.
Table 1. Straight-walking section five-fold cross validation (5FCV) results. PPV: positive predictive value, NPV: negative predictive value, MCC: Matthews correlation coefficient, S5B: select-5-best, SEL: false positive and discovery rate method, RFE: recursive feature eliminator, RF: random forest, kNN: k-nearest neighbour, SVM: support vector machine, linear: linear kernel, poly: polynomial kernel.
Classifier, Feature SelectorAccuracy (%)Sensitivity (%)Specificity (%)PPV (%)NPV (%)F1 ScoreMCCRank Sum
RF S5B62.046.472.152.067.40.490.1924
SVM (poly = 3) S5B56.378.641.946.875.00.590.2126
RF SEL57.746.465.146.465.10.460.1236
RF RFE62.032.181.452.964.80.400.1644
SVM (poly = 5) SEL54.957.153.544.465.70.500.1046
SVM (poly = 3) RFE52.171.439.543.568.00.540.1147
SVM (poly = 3) SEL52.171.439.543.568.00.540.1147
kNN (k = 5) SEL56.342.965.144.463.60.440.0851
kNN (k = 3) S5B54.950.058.143.864.10.470.0851
kNN (k = 3) SEL56.339.367.444.063.00.420.0760
SVM (linear) S5B53.550.055.842.463.20.460.0663
SVM (linear) SEL53.550.055.842.463.20.460.0664
SVM (poly = 5) RFE52.146.455.840.661.50.430.0278
SVM (linear) RFE52.139.360.539.360.50.390.0085
kNN (k = 3) RFE50.735.760.537.059.10.36−0.0497
SVM (poly = 5) S5B49.339.355.836.758.50.38−0.05100
kNN (k = 5) S5B47.935.755.834.557.10.35−0.08109
kNN (k = 5) RFE46.535.753.533.356.10.34−0.11119
Table 2. Turn section five-fold cross validation (5FCV) results. PPV: positive predictive value, NPV: negative predictive value, MCC: Matthews correlation coefficient, S5B: select-5-best method, SEL: false positive and discovery rate method, RFE: recursive feature eliminator, RF: random forest, kNN: k-nearest neighbour, SVM: support vector machine, linear: linear kernel, poly: polynomial kernel.
Table 2. Turn section five-fold cross validation (5FCV) results. PPV: positive predictive value, NPV: negative predictive value, MCC: Matthews correlation coefficient, S5B: select-5-best method, SEL: false positive and discovery rate method, RFE: recursive feature eliminator, RF: random forest, kNN: k-nearest neighbour, SVM: support vector machine, linear: linear kernel, poly: polynomial kernel.
Classifier, Feature SelectorAccuracy (%)Sensitivity (%)Specificity (%)PPV (%)NPV (%)F1 ScoreMCCRank Sum
RF S5B77.567.983.773.180.00.700.5212
RF SEL77.564.386.075.078.70.690.5214
RF RFE69.053.679.162.572.30.580.3438
kNN (k = 5) SEL69.050.081.463.671.40.560.3345
kNN (k = 5) S5B71.842.990.775.070.90.550.3946
SVM (linear) S5B67.653.676.760.071.70.570.3150
SVM (linear) SEL66.257.172.157.172.10.570.2955
kNN (k = 3) S5B67.650.079.160.970.80.550.3057
SVM (poly = 3) RFE62.067.958.151.473.50.580.2558
kNN (k = 3) SEL66.250.076.758.370.20.540.2870
SVM (poly = 3) SEL60.664.358.150.071.40.560.2273
SVM (poly = 5) SEL54.978.639.545.873.90.580.1976
SVM (poly = 5) S5B60.660.760.550.070.30.550.2181
kNN (k = 5) RFE63.435.781.455.666.00.430.1989
SVM (linear) RFE60.650.067.450.067.40.500.1794
SVM (poly = 3) S5B59.257.160.548.568.40.520.1797
kNN (k = 3) RFE62.039.376.752.466.00.450.1798
SVM (poly = 5) RFE57.746.465.146.465.10.460.12114
Table 3. Straight-walking section results for 2500-iteration random-shuffle-split cross validation (2500-RSS), ordered by ranked performance. PPV: positive predictive value, NPV: negative predictive value, MCC: Matthews correlation coefficient, S5B: select-5-best method, SEL: false positive and discovery rate method, RFE: recursive feature eliminator, RF: random forest, kNN: k-nearest neighbour, SVM: support vector machine, linear: linear kernel, poly: polynomial kernel, x ¯ : mean, SD: standard deviation, CI: 95% confidence interval.
Table 3. Straight-walking section results for 2500-iteration random-shuffle-split cross validation (2500-RSS), ordered by ranked performance. PPV: positive predictive value, NPV: negative predictive value, MCC: Matthews correlation coefficient, S5B: select-5-best method, SEL: false positive and discovery rate method, RFE: recursive feature eliminator, RF: random forest, kNN: k-nearest neighbour, SVM: support vector machine, linear: linear kernel, poly: polynomial kernel, x ¯ : mean, SD: standard deviation, CI: 95% confidence interval.
Classifier, Feature SelectionAccuracy (%)Sensitivity (%)Specificity (%)PPV (%)NPV (%)F1MCC
x ¯ SDCI x ¯ SDCI x ¯ SDCI x ¯ SDCI x ¯ SDCI x ¯ SDCI x ¯ SDCI
kNN (k = 3) S5B55.512.00.4746.121.20.8361.816.20.6444.616.90.6663.211.50.450.450.170.0070.080.260.010
RF S5B56.211.40.4539.820.30.8067.215.90.6244.719.60.7762.69.90.390.420.180.0070.070.260.010
RF SEL56.911.20.4434.520.30.7971.918.30.7245.025.20.9962.28.70.340.390.180.0070.070.300.012
SVM (poly = 3) SEL51.711.10.4359.733.61.3246.430.31.1942.618.80.7463.325.61.000.500.200.0080.060.390.015
kNN (k = 5) S5B55.011.80.4643.621.80.8562.717.00.6743.818.30.7262.511.20.440.440.180.0070.060.260.010
SVM (linear) SEL53.412.10.4850.323.70.9355.523.70.9343.017.30.6862.615.90.620.460.160.0060.060.300.012
SVM (linear) S5B50.911.90.4753.625.40.9949.119.30.7641.315.00.5961.416.40.640.470.170.0070.030.270.011
kNN (k = 3) SEL54.011.40.4537.519.90.7865.117.30.6841.719.60.7761.09.70.380.390.170.0070.030.250.010
SVM (poly = 3) S5B48.710.40.4161.633.61.3240.126.21.0340.716.10.6361.026.41.030.490.200.0080.020.350.014
kNN (k = 5) SEL53.810.80.4234.619.90.7866.617.70.6940.820.50.8060.49.20.360.370.170.0070.010.260.010
Table 4. Turn section results for 2500-iteration random-shuffle-split cross validation (2500-RSS), ordered by ranked performance. PPV: positive predictive value, NPV: negative predictive value, MCC: Matthews correlation coefficient, S5B: select-5-best method, SEL: false positive and discovery rate method, RFE: recursive feature eliminator, RF: random forest, kNN: k-nearest neighbour, SVM: support vector machine, linear: linear kernel, poly: polynomial kernel, x ¯ : mean, SD: standard deviation, CI: 95% confidence interval.
Table 4. Turn section results for 2500-iteration random-shuffle-split cross validation (2500-RSS), ordered by ranked performance. PPV: positive predictive value, NPV: negative predictive value, MCC: Matthews correlation coefficient, S5B: select-5-best method, SEL: false positive and discovery rate method, RFE: recursive feature eliminator, RF: random forest, kNN: k-nearest neighbour, SVM: support vector machine, linear: linear kernel, poly: polynomial kernel, x ¯ : mean, SD: standard deviation, CI: 95% confidence interval.
Classifier, Feature SelectorAccuracy (%)Sensitivity (%)Specificity (%)PPV (%)NPV (%)F1MCC
x ¯ SDCI x ¯ SDCI x ¯ SDCI x ¯ SDCI x ¯ SDCI x ¯ SDCI x ¯ SDCI
RF S5B73.410.60.4260.520.50.8182.012.80.5069.118.20.7175.710.20.400.650.170.0070.440.240.009
RF SEL71.610.90.4358.320.70.8180.413.30.5266.518.50.7274.310.30.410.620.170.0070.400.240.010
kNN (k = 5) S5B69.211.20.4449.021.40.8482.713.30.5265.322.50.8870.89.70.380.560.190.0080.340.270.011
kNN (k = 3) S5B68.011.20.4450.820.70.8179.613.90.5562.420.90.8270.89.80.390.560.180.0070.320.260.010
SVM (linear) S5B66.711.70.4657.620.80.8272.816.00.6358.517.70.6972.011.70.460.580.160.0060.300.250.010
SVM (linear) SEL64.713.00.5157.624.20.9569.517.90.7055.719.30.7671.114.40.560.570.190.0070.270.310.012
kNN (k = 5) SEL67.212.50.4948.721.60.8579.514.90.5861.323.20.9169.910.50.410.540.200.0080.300.290.012
kNN (k = 3) SEL66.812.70.5050.021.30.8378.015.20.6060.322.20.8770.110.80.420.550.190.0080.290.290.011
SVM (poly = 3) SEL61.813.10.5150.725.30.9969.224.80.9752.325.10.9867.815.40.610.510.180.0070.200.330.013
SVM (poly = 3) S5B60.713.80.5455.723.60.9364.122.30.8750.820.00.7868.415.80.620.530.170.0070.200.300.012
Table 5. Most frequently occurring (MFO) feature subsets for straight-walking section results and 3NN classifier using 2500-iteration random-shuffle-split cross validation (2500-RSS), ordered by ranked performance. PPV: positive predictive value, NPV: negative predictive value, MCC: Matthews correlation coefficient, x ¯ : mean, SD: standard deviation, CI: 95% confidence interval.
Table 5. Most frequently occurring (MFO) feature subsets for straight-walking section results and 3NN classifier using 2500-iteration random-shuffle-split cross validation (2500-RSS), ordered by ranked performance. PPV: positive predictive value, NPV: negative predictive value, MCC: Matthews correlation coefficient, x ¯ : mean, SD: standard deviation, CI: 95% confidence interval.
# FeaturesAccuracy (%)Sensitivity (%)Specificity (%)PPV (%)NPV (%)F1MCC
x ¯ SDCI x ¯ SDCI x ¯ SDCI x ¯ SDCI x ¯ SDCI x ¯ SDCI x ¯ SDCI
564.110.80.4259.919.20.7566.914.50.5754.714.30.5671.411.00.430.570.140.0060.260.230.009
363.111.30.4461.220.00.7864.414.90.5953.414.00.5571.311.90.470.570.150.0060.250.240.009
462.210.80.4257.718.90.7465.215.00.5952.514.60.5769.810.70.420.550.140.0060.230.230.009
961.510.40.4142.118.80.7474.514.00.5552.420.00.7965.98.50.330.470.170.0070.170.240.009
1060.711.10.4344.719.90.7871.414.60.5751.119.10.7566.09.50.370.480.170.0070.170.250.010
660.612.30.4856.120.10.7963.616.70.6650.716.00.6368.512.20.480.530.160.0060.200.260.010
260.011.50.4557.219.30.7661.815.90.6250.014.50.5768.411.70.460.530.150.0060.190.240.009
860.610.30.4038.518.70.7375.413.80.5451.121.60.8564.88.20.320.440.170.0070.150.250.010
1159.611.10.4341.919.40.7671.414.90.5949.419.70.7764.89.30.370.450.170.0070.140.250.010
759.211.20.4444.018.80.7469.315.10.5948.918.60.7365.09.40.370.460.160.0060.140.240.010
157.011.00.4350.220.10.7961.515.70.6246.514.80.5864.910.90.430.480.150.0060.120.240.009
1357.810.90.4337.419.10.7571.414.50.5746.620.40.8063.18.90.350.410.170.0070.090.250.010
1457.610.50.4137.618.90.7470.914.50.5746.319.70.7763.08.50.330.420.170.0070.090.240.010
1257.010.50.4136.519.10.7570.614.00.5545.320.20.7962.58.50.330.400.170.0070.070.250.010
Table 6. Most frequently occurring (MFO) feature subsets for turn section results and random forest classifier using 2500-iteration random-shuffle-split cross validation (2500-RSS), ordered by ranked performance. PPV: positive predictive value, NPV: negative predictive value, MCC: Matthews correlation coefficient, x ¯ : mean, SD: standard deviation, CI: 95% confidence interval.
Table 6. Most frequently occurring (MFO) feature subsets for turn section results and random forest classifier using 2500-iteration random-shuffle-split cross validation (2500-RSS), ordered by ranked performance. PPV: positive predictive value, NPV: negative predictive value, MCC: Matthews correlation coefficient, x ¯ : mean, SD: standard deviation, CI: 95% confidence interval.
# FeaturesAccuracy (%)Sensitivity (%)Specificity (%)PPV (%)NPV (%)F1MCC
x ¯ SDCI x ¯ SDCI x ¯ SDCI x ¯ SDCI x ¯ SDCI x ¯ SDCI x ¯ SDCI
577.39.10.3666.119.60.7784.711.40.4574.315.50.6179.09.70.380.700.150.0060.520.200.008
677.19.40.3766.219.50.7684.411.70.4673.915.90.6278.99.70.380.700.150.0060.520.210.008
377.09.60.3867.718.90.7483.212.20.4872.915.70.6279.59.70.380.700.140.0060.520.210.008
976.39.60.3863.319.80.7884.911.60.4673.616.70.6677.69.60.380.680.150.0060.500.220.009
276.49.40.3765.918.90.7483.412.00.4772.615.80.6278.69.60.380.690.140.0060.500.200.008
775.89.60.3862.419.50.7684.712.00.4773.216.70.6677.29.50.370.670.150.0060.490.210.008
875.79.70.3862.419.70.7784.512.00.4772.916.90.6677.19.60.380.670.150.0060.480.220.009
475.59.50.3763.319.50.7683.711.90.4772.216.50.6577.49.60.380.670.150.0060.480.210.008
175.39.40.3761.519.50.7684.611.70.4672.716.80.6676.79.30.360.670.150.0060.480.210.008
Table 7. Combined straight and turn-walking feature results for 2500-iteration random-shuffle-split cross validation (2500-RSS), ordered by ranked performance. PPV: positive predictive value, NPV: negative predictive value, MCC: Matthews correlation coefficient, S5B: select-5-best method, SEL: false positive and discovery rate method, RFE: recursive feature eliminator, RF: random forest, kNN: k-nearest neighbour, SVM: support vector machine, linear: linear kernel, x ¯ : mean, SD: standard deviation, CI: 95% confidence interval.
Table 7. Combined straight and turn-walking feature results for 2500-iteration random-shuffle-split cross validation (2500-RSS), ordered by ranked performance. PPV: positive predictive value, NPV: negative predictive value, MCC: Matthews correlation coefficient, S5B: select-5-best method, SEL: false positive and discovery rate method, RFE: recursive feature eliminator, RF: random forest, kNN: k-nearest neighbour, SVM: support vector machine, linear: linear kernel, x ¯ : mean, SD: standard deviation, CI: 95% confidence interval.
Classifier, Feature SelectionAccuracy (%)Sensitivity (%)Specificity (%)PPV (%)NPV (%)F1MCC
x ¯ SDCI x ¯ SDCI x ¯ SDCI x ¯ SDCI x ¯ SDCI x ¯ SDCI x ¯ SDCI
RF S5B71.610.80.4257.520.80.8281.113.20.5266.918.90.7474.110.20.400.620.170.0070.400.250.010
RF SEL69.511.70.4654.321.10.8379.714.50.5764.120.70.8172.310.40.410.590.180.0070.350.270.010
kNN (k = 5) S5B67.411.20.4448.621.30.8480.013.90.5561.821.60.8570.09.90.390.540.190.0070.300.270.011
SVM (linear) S5B65.711.60.4556.121.00.8372.115.90.6257.317.70.7071.111.50.450.570.160.0060.280.250.010
kNN (k = 3) S5B65.911.40.4549.320.60.8177.014.40.5658.820.60.8169.510.00.390.540.180.0070.270.260.010
SVM (linear) SEL63.712.50.4954.923.80.9469.617.90.7054.619.90.7869.813.50.530.550.190.0070.240.300.012
kNN (k = 3) SEL65.312.70.5049.021.10.8376.215.30.6057.921.80.8569.210.80.420.530.190.0070.260.290.011
kNN (k = 5) SEL65.412.50.4947.222.00.8677.515.10.5958.323.30.9168.810.70.420.520.200.0080.260.290.012

Share and Cite

MDPI and ACS Style

Drover, D.; Howcroft, J.; Kofman, J.; Lemaire, E.D. Faller Classification in Older Adults Using Wearable Sensors Based on Turn and Straight-Walking Accelerometer-Based Features. Sensors 2017, 17, 1321. https://doi.org/10.3390/s17061321

AMA Style

Drover D, Howcroft J, Kofman J, Lemaire ED. Faller Classification in Older Adults Using Wearable Sensors Based on Turn and Straight-Walking Accelerometer-Based Features. Sensors. 2017; 17(6):1321. https://doi.org/10.3390/s17061321

Chicago/Turabian Style

Drover, Dylan, Jennifer Howcroft, Jonathan Kofman, and Edward D. Lemaire. 2017. "Faller Classification in Older Adults Using Wearable Sensors Based on Turn and Straight-Walking Accelerometer-Based Features" Sensors 17, no. 6: 1321. https://doi.org/10.3390/s17061321

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop