Next Article in Journal
Impact of Safety Message Generation Rules on the Awareness of Vulnerable Road Users
Previous Article in Journal
Piston Error Measurement for Segmented Telescopes with an Artificial Neural Network
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Applicability of Fuzzy Logic and Artificial Neural Network for Unpaved Airfield Surface Bearing Strength Prediction

Department of Air Force, Faculty of Military Technology, University of Defence in Brno, 66210 Brno, Czech Republic
Sensors 2021, 21(10), 3373; https://doi.org/10.3390/s21103373
Submission received: 23 March 2021 / Revised: 28 April 2021 / Accepted: 6 May 2021 / Published: 12 May 2021
(This article belongs to the Section Intelligent Sensors)

Abstract

:
The main objective of this paper is to describe a building process of a model predicting the soil strength at unpaved airport surfaces (unpaved runways, safety areas in runway proximity, runway strips, and runway end safety areas). The reason for building this model is to partially substitute frequent and meticulous inspections of an airport movement area comprising the bearing strength evaluation and provide an efficient tool to organize surface maintenance. Since the process of building such a model is complex for a physical model, it is anticipated that it might be addressed by a statistical model instead. Therefore, fuzzy logic (FL) and artificial neural network (ANN) capabilities are investigated and compared with linear regression function (LRF). Large data sets comprising the bearing strength and meteorological characteristics are applied to train the likely model variations to be subsequently compared with the application of standard statistical quantitative parameters. All the models prove that the inclusion of antecedent soil strength as an additional model input has an immense impact on the increase in model accuracy. Although the M7 model out of the ANN group displays the best performance, the M3 model is considered for practical implications being less complicated and having fewer inputs. In general, both the ANN and FL models outperform the LRF models well in all the categories. The FL models perform almost equally as well as the ANN but with slightly decreased accuracy.

1. Introduction

Aviation may be one of the most constrained spheres of human activities that are pushed to their limits. Engineers are forever improving technologies covering aircraft designs and material properties. It is expected that not only an extended range of flight, greater load capacity, and reduced fuel consumption but also the safety standards are pushed to new levels. The technologies applied at airports are not the exception. As some airport constructions have reached into the adoption of building information modeling (BIM) [1], the digitalization and integration of the airport movement area design might be considered as well. Basically, the airport design has an immense effect on incidents and accidents occurring at airports. While investigating the aviation safety databases, it was figured out that a large proportion of aircraft accidents occur at airports and particularly nearby runways. The majority of them are associated with runway excursions, accidental aircraft run-off, and over- and under-shooting a runway [2]. Therefore, as to address this, Ranieri et al. proposes a gradual bearing strength decrease (17, 16, and 15 CBR) in three areas along a runway, 30–50, 50–65, and 65–105 m distant from the runway centerline [3]. The aviation authorities regularly amend safety standards focusing on the design of the close vicinity of runways. Apart from obstacle-free zones, they issue standards in the quality of unpaved areas adjacent to runways [4,5]. The bearing strength is supposed to be evaluated regularly, being exceedingly dependent on actual meteorological conditions. The daily bearing strength measurements are expected to be maintained over the entire airport vicinity to retain an airport operational [6]. Due to airport operation restrictions imposed mainly by extensive time constraints in daily operations, it is vital to conduct the bearing strength evaluations as a time reference at two locations at a minimum every day [6]. Despite being seemingly highly time-efficient, these measurements are exceedingly obstructive and time-consuming for airport operation staff. As a consequence, a kind of prediction model giving, to some extent, prospect of the unpaved surface condition seems to be essential. This should not entirely substitute the daily measurements because these values should be officially reported. It should work as an aid for airport operation staff to plan and organize the surface maintenance.
Firstly, soil strength is remarkably vital in geotechnical engineering and building practice. It is one of the paramount properties which highway and airport foundations are designed to. A great deal of research targeting mechanical properties, consolidation, and strength has been conducted. The investigation of soil behavior and its application as construction materials was launched by Whitlow [7]. It was figured out that the problem is rather complex due to a fair amount of diversity in physical properties in soils [8]. Currently, as a common practice, soil strength tests, namely the California bearing ratio (CBR) tests are conducted in a laboratory or in situ to target field applications [9,10]. However, credible as these tests are, they are rather prolonged, elaborate, and costly. Despite being tested at airports, as shown by Detsky et al. [11], the applicability is feasible for the surface layer only. This was proven to be unacceptable for daily airport operations since the strength profile is needed for a deeper soil layer [12]. As a consequence, penetrometer applications, which can freely assess the soil profile down to 1 m, have been utilized not only in building practice but also in airport operations to report the actual bearing capacity of unpaved surfaces. The Dynamic Cone Penetrometer (DCP), having been altered for airfield applications, is an example. The field test incorporating the DCP is accomplished to ensure the required property of various surfaces consisting of unpaved, unprepared runways, runway strips, and runway safety areas (RESAs). Being fairly time- and labor-intensive, the daily measurements might be supplemented by a soil strength prediction model. Such a model should provide essential information over the particular surface condition, serving to organize surface maintenance.
A great deal of studies have been dedicated to soil conditions, specifically to the bearing strength. From the outset, it was known that development and changes in bearing strength in time are highly non-linear, time-varying, spatially distributed, and therefore not easily formalized. Both analytical and empirical approaches have been tested with more or less success.
The analytical approach is knowledge-based. Generally, it focuses on describing systems with physical laws. That is to say, it uses a mathematical framework based on mass, momentum, and energy conservation spatially distributed equations to formalize soil parameters associated with the strength. An example of such a model was implicated in predicting the cohesion and friction angle at the penetrometer cone [12]. Then, a soil moisture prediction strength model (SMSP) has been imposed and refined several times by implying coefficients to predict the cone index (CI) and rating cone index (RCI). It applies real-time meteorological data to up-to-date forecasts. Regarding the model accuracy, the relations were considered non-smooth, which may cause some disparity in the estimation of the required physical parameters [13,14,15].
As the physical models have difficulties formalizing complex and variable systems, an empirical approach (clearly statistical) is essential to be implicated. The prediction of wave velocities for the cone penetration test with the linear regression is currently considered state-of-the-art [16]. Following this, a relationship between the RCI, moisture, and clay content was well established by a statistical approach and machine learning [17]. More recently, a relation between the terrain and the vehicle track was ascertained by Baladi and Rohani [18]. On top of this, NATO utilizes its NATO reference mobility model (NRMM) that predicts the bearing capacity based upon rainfall and terrain. The data set comprising location, precipitation, and evaporation is matched against traction and the vehicle cone index (VCI) [19].
Thirdly, a soil strength prediction model might be based on soil moisture forecast, as these models are broadly available with considerable accuracy [20]. The only obstacle is the moisture–strength correlation. Regarding practicability and high reliability, plenty of observations in a full soil moisture range are needed [21].
Fourthly, machine learning should also be considered, as it has been successfully implemented in many spheres of human activities. For instance, neural network and fuzzy logic (FL) models predict material mechanical properties in engineering [22,23]. On the other hand, in geotechnics, these models predict soil properties based upon meteorological characteristics. The surface temperature is given by the application of brightness [24,25] or low-level atmospheric parameters such as relative humidity and temperature to predict soil moisture using an artificial neural network (ANN) [26]. Particularly here, backpropagation learning was successfully tested [26]. It is also worth considering the support vector machines since they displayed better performance than the ANN while comparing the performance forecasting soil moisture [27]. Having directly sought bearing strength models, the ANN and FL were used to predict a peak shear angle of soil [28], the bearing strength, and behavior of shallow foundations [29]. Rather interesting is the idea of predicting the soil strength directly from soil properties, such as water content, plasticity index, dry density, and soil composition [30]. Specific soft soils were tested in an ANN model predicting a compression coefficient [31].
The hydrology models are rather significant in rainfall and flood prediction. Generally, they can be characterized by a great deal of complexity and time variability. Many successful implications were mounted with the ANN and FL support. The majority of these applications proved to be highly practical, facilitating better accuracy in comparison to traditional models such as linear regression models [32,33,34,35].
In short, while seeking the optimal solution for bearing strength prediction, the problem is complex and has too much time variance for a physical model. However, the statistical models, represented primarily by ANN and FL models, were anticipated to provide sufficient accuracy. In order to tackle the soil prediction at airfields, ANN and FL approaches were supposed to be mounted and tested upon a linear regression function (LRF). The results should work as a base for an intelligent model predicting the unpaved airport surface bearing capacity.

2. Materials and Methods

In general, the idea was to set up sets of models with varying input data based on LRF, an ANN, and FL to predict the bearing strength of both unpaved runways and unpaved surfaces adjacent to paved runways. The performance was considered to evaluate with validation indicators such as a correlation coefficient (R), mean square error (MSE), and root mean square error (RMSE).

2.1. Subjects

Experimental data were determined from a single airport for the past four years (2016–2020). That is to say, 1400 sample sets of both meteorological and soil strength values were selected for the study. The data sample is reasonably representative as it covers periods with extremes, including intense heat and excessive precipitation. This particular airport was assigned due to the high intensity of traffic with varying aircraft weight categories. The traffic is executed on both the paved and unpaved runways with dimensions 2500 times 45 m and 1000 times 40 m. As the traffic involving heavy aircraft is conducted over the unpaved runway, the airport operation requires frequent inspections comprising bearing strength measurements and monitoring. On the other hand, concerning the paved areas, runways, and taxiways, a likelihood of accidental excursions always exists. Therefore, the bearing strength is measured and monitored at predefined reference locations along the paved runways.
The airport geographical location with elevation varying from 450 to 475 m above sea level is rated as low or medium altitude locations in the Bohemia-Moravia Highland. The soil profile in the vicinity of the runway is characterized by white gneiss bedrock, whereas the surface, which is approximately 2 m thick, is covered by eroded gneiss. Closer to the surface, it turns into silty sands and into silts in some separate locations. At the reference points at the airfield, the soil profile consists of the top 40 cm layer with well-graded silty sand and a 60 cm sublayer with well-graded gravel with sand. With regard to hydrological conditions, the place is weak in underground water. Being notably eroded, the silty surface does not create sufficient conditions for larger water amount catchments.
While seeking the most suitable inputs into the statistical model, the meteorological data were considered. Predominantly, attention was dedicated to a daily precipitation rate and daily mean air temperature. The surface synoptic observation (SYNOP) data were chosen as the most suitable and reliable source. The records being recorded by either automated weather stations or manually every six hours incorporate a numerical code for regular observation reporting. They describe general weather information comprising temperature, barometric pressure, and visibility at the station.
Coming to the model output, as mentioned, it should represent the unpaved surface properties, particularly the bearing capacity. As the operational requirement for a field application at the particular airport is to report the strength value in MPa, the traditional methodology for bearing strength evaluation applied at Czech military airfields was maintained. The daily operation measurements conducted regularly every morning at two reference points were considered appropriate for the study. A device that is required by this methodology is the aerodrome dynamic penetrometer (ADP) (see Figure 1). As a matter of fact, the actual measured values are estimates of the surface bearing capacity in pressure units (MPa). The pressure is a measure of aircraft undercarriage characteristics and weight, which is correlated with a number of blows into specific soil depths [36]. Having already discussed the aviation authority requirements, which generally accept the California bearing ratio (CBR) for reporting in aviation applications, the device is correlated with the CBR, issuing CBR estimates [6].
In short, a specific airport in the vicinity of the Czech Republic was chosen for the study. Specifically, daily measurements of the bearing strength utilizing the ADP were decided, whereas the basic meteorological data were considered to be obtained from the SYNOP reports. The four-year data set collection was then divided into two. The first was dedicated to model calibration whilst the second to validation.

2.2. Procedure

Firstly, considering the model design concept, a selection of input and output variables is the first step in model development. In this particular case, the bearing strength is the function of meteorological, topographical, soil, and vegetation conditions. Theoretically, a non-linear, time-varying function may be suitable to express the soil conditions. Nevertheless, insufficient data to execute this were available. The whole prediction relied on the rainfall data and mean air temperature. For input consideration, the potential candidate models were expected to be constructed and compared with quantitative statistical tools.
Based on expert analysis, the models with the following inputs were considered for further examination:
  • Precipitation rate and mean air temperature.
      σ t = f ( P t , T t ) ,
      σ t = f ( P t , P t 7 , T t , T t 7 ) ,
  • Precipitation rate and antecedent soil strength.
    σ t = f ( P t , σ t 1 ) ,
      σ t = f ( P t ,   P t 1 , σ t 1 ) ,
    σ t = f ( P t ,   P t 7 , σ t 1 ) ,
  • Precipitation rate, mean air temperature, and antecedent soil strength.
    σ t = f ( P t ,   T t , σ t 1 ) ,
      σ t = f ( P t , P t 1 , T t , σ t 1 ) ,
      σ t = f ( P t , P t 1 , T t , T t 1 , σ t 1 ) ,
      σ t = f ( P t , P t 7 , T t , T t 7 , σ t 1 ) ,
      σ t = f ( P t , P t 7 , T t , T t 7 , σ t 1 , σ t 2 ) ,
    where Pt refers to a daily precipitation rate (Pt−1 to a daily precipitation rate minus one day), Tt depicts daily mean air temperature (Tt−1 is mean air temperature minus one day) whereas σt−1 is antecedent soil strength minus one day (σt−2 is antecedent soil strength minus two days).
Out of the potential meteorological information, a daily precipitation rate (Pt) and daily mean air temperature (Tt) were selected as the primary inputs which should address the prospect of future conditions. On top of these two, an additional one representing the actual surface state and the initial conditions was considered. During the initial thoughts, the soil moisture content was anticipated as the antecedent soil condition. However, by the time at least half of the experiment had been executed, the measured soil moisture was realized to be applicable for a limited surface layer. As a consequence, the soil moisture data set was figured out as insufficient. Instead, the soil strength representing the preceding conditions (antecedent soil strength σt−1) was considered. The soil moisture issue and the idea of refining the entire model are reiterated in the discussion part of the paper.
To sum up, as mentioned in the previous text, the first important step in building any model is input variables selection. Aiming at the soil strength prediction, the soil strength is considered a function of previous rainfall, run-off, meteorological, topographical, and soil conditions. Theoretically, a water storage function could possibly be applied to express water flow through the location. However, no sufficient data are present in doing so, but for rainfall data. Therefore, a combination of basic meteorological characteristics and the introduction of antecedent soil strength were selected to create input to build the bearing strength prediction model.

2.3. Linear Regression Function

Generally, in statistics, the main objectives are to build statistical models that resemble real objects in some respect. Such a process is carried out through regression analysis that explains likely relations between variables. LRF can be expressed as [37,38]:
  y i = β 0 + k = 1 k β k × f k ( x i 1 , x i 2 , , x ip ) + ε i ,
where yi represents i-th response or prediction, whereas xi i-th observation. Then, bk, εi and fk depict k-th coefficient, random error, and scalar-valued function of the xij predictor variable.

2.4. Fuzzy Logic Model

Since FL has become increasingly popular in commercial applications ranging from washing machines, cameras, industrial control, medical controls, etc., the second base model concept targeting soil strength predictions was dedicated to fuzzy logic.
The basic structure of fuzzy interference systems is a model that copies input variables to membership functions, and copies these into rules which model an output value throughout output characteristics and membership functions. The membership functions are chosen randomly, whereas the rules are user interpretations. Since it possesses a broad series of input and output data, the model structure does not necessarily have to be predetermined. Therefore, these membership functions may change throughout the learning process. Backpropagation or a combination of least squares estimation and backpropagation for membership function estimation is applicable. That is to say, this modeling, providing fully representative data, is suitable to present the expected model. However, in practice, noisy data should be anticipated as well. On account of mitigating their effects, usually, the validation is implemented. The whole validation idea is to expose the model to additional input/output data, which the model is not trained to. The outcomes subsequently quantify how well the model performs [39,40,41,42].
While creating the bearing strength prediction model based on FL, the adaptive neuro-fuzzy interference system (ANFIS) was applied to train a Sugeno-type fuzzy model in the MATLAB environment. The hybrid learning algorithm uses a combination of least-squares and backpropagation for training. A checking data set helps to validate the model for overfilling the training data [39]. This approach has gained a fair amount of popularity due to uncomplicated construction, which can deal remarkably well with imprecision and uncertainty. FL classifies objects with vague input and output variable margins. These are linked with the aid of membership functions to create a logical system [39].

2.5. Artificial Neural Network Model

The third approach is dedicated to the ANN, since it has earned the most popularity in control of rather complex problems such as pattern recognition, system identification and classification, speech and vision recognition, and in general, it is efficient in function fitting. The whole idea anticipates a system inspired by a nervous system that is composed of elements and connections. The connections, sometimes referred to as weights, determine the network functions. While controlling the large data sets to cover all inputs and outputs, the weight can be adjusted by specific training, leading the inputs well to the precise target outputs. As a result, a reasonably simplistic neural network can fit any practical function. By and large, the network is separated into layers. The weights are imposed only between elements in different layers. A standard network is a two-layer feed-forward neural network with hidden neurons (transfer function) and linear output neurons [43,44]. In all the algorithms, usually, 70% of the data are dedicated to training. During this time, the network is adjusted to its error. The rest is assigned to validation and testing. The validation is applied to measure neural network generalization, and it will stop the training when generalization stops improving. The testing does not affect the training. The entire performance may be enhanced by an increase in the number of hidden neurons. Nevertheless, the recommended 10 hidden neurons were sufficient to acquire suitable training for all input/output combinations.
To summarize, as shown in the previous text, the availability of a comprehensive data set of the bearing strength measurements of unpaved airport surfaces enables an assembly of a statistical model. A total 10 input combinations based upon meteorological characteristics, predominantly by a precipitation rate and daily mean air temperature, were suggested. LRF, FL, and ANN models were decided to take into consideration. The conception of all three model types was briefly described.

2.6. Statistical Analysis

A comparison of all the designated models was based on performance evaluation through the quantification of three efficiency terms containing a mean square error (MSE), correlation coefficient (R), and root mean square error (RMSE). The MSE measures the average of the squares of the errors. It is considered as a measure of the quality of an estimator. It is always non-negative, and with regard to the rating, the values closer to zero are better [45]. The R is a measure of the strength and direction of the linear relationship between two variables. It tests the goodness of fit by executing a linear regression between predicted and measured values [46]. Finally, the RMSE was applied to match the difference with reality. It represents the quadratic mean between predicted and observed values [47]. The MSE, R, RMSE can be obtained using Equations (12)–(14). All were calculated by a custom script written in the programming environment.
MSE = 1 n i = 1 n ( X i Y i ) 2 ,  
  R = i = 1 n X i Y i i = 1 n X i 2 i = 1 n Y i 2 ,
RMSE = 1 n i = 1 n ( X i Y i ) 2 ,
where Xi represents a vector of observed values of the variable being predicted, whereas Yi depicts a vector of predicted values.

3. Results

Models for the unpaved airport surface bearing strength prediction were developed, utilizing LRF, FL, and ANN models with different input data vector combinations. The statistical evaluation criteria such as the MSE, R, and RMSE were compared to test the model performance.

3.1. Linear Regression Function Model

The LRF models were developed for the prediction of soil strength. The LRF models were designed with the same input and output data set as the FL and ANN models to support the relevant comparison. Concerning various input vector combinations (Equations (1)–(10)), 10 model arrangements were developed and quantified (Equations (15)–(24)).
  • Precipitation rate and mean air temperature.
    σ t = 0.896 0.024 × P t + 0.016 ×   T t ,
    σ t = 0.893 6.96 × 10 5 × P t 0.001 × P t 7 + 0.11 × T t + 0.0018 × T t 7 ,
  • Precipitation rate and antecedent soil strength.
    σ t = 0.098 0.005 × P t + 0.919 × σ t 1 ,
    σ t = 0.1 0.005 ×   P t 0.001 × P t 1 + 0.918 × σ t 1 ,
    σ t = 0.089 0.006 × P t + 7.267 × 10 4 × P t 7 + 0.921 ×   σ t 1 ,
  • Precipitation rate, mean air temperature, and antecedent soil strength.
    σ t = 0.12 0.005 × P t + 0.002 × T t + 0.871 × σ t 1 ,
      σ t = 0.123 0.005 × P t 0.001 ×   P t 1 + 0.002 × T t + 0.869 × σ t 1 ,
      σ t = 0.125 0.005 × P t 0.002 × P t 1 + 0.001 × T t + 0.002 × T t 1 + 0.866 × σ t 1 ,
      σ t = 0.122 0.006 ×   P t + 3.001 ×   10 4 ×   P t 7 + 1.067 ×   10 4 × T t + 0.003 × T t 7 + 0.864 ×   σ t 1 ,
      σ t = 0.106 0.006 ×   P t + 2.531 × 10 4 × P t 7 + 3.964 × 10 4 × T t + 0.002 ×   T t 7 0.729 × σ t 1 + 0.155 × σ t 2 ,
The performance of the LRF presented in Equations (15)–(24) is displayed in Table 1.
Model comparisons were conducted with the aid of the MSE, R, and RMSE. The LRF models displayed the MSE in the range of 0.027 and 0.005, whereas the R was in the interval of 0.34 and 0.88. The values of the RMSE varied from 0.166 to 0.072, while having added antecedent soil strength, significant performance improvements were achieved. The M2 model showed the best performance with the MSE, R, and RMSE reaching only 0.024, 0.418, and 0.155, respectively, in the first model group, where a precipitation rate and mean air temperature were only inputs. On the other hand, the following two groups seemed to be more progressive. In the second group with a precipitation rate and antecedent soil strength as inputs, the M6 model surpassed the others as the MSE, R, RMSE reached up to 0.005, 0.88, and 0.070. Finally, the models considering a precipitation rate, mean air temperature, and antecedent soil strength as inputs displayed further slight improvement. The M10 model beat the others with the MSE, R, and RMSE as 0.005, 0.881, and 0.069, although the high resolution was achieved by the other two models, the M7 and M8 having almost identical values. Figure 2, Figure 3, Figure 4 and Figure 5 display the time series of the observed and predicted soil strength with the LRF models for the entire validation period.
To summarize, in the entire LRF arrangement, the best performance was achieved by the M8 and M9 models, which, however, do not significantly differ from the M3 model. In contrast, this particular model is characterized by its simplicity earned by fewer inputs, and therefore unnecessary complications. As a consequence, the M3 model seems to be optimal for practical application.

3.2. Fuzzy Logic Model

FL models were developed with the structure outlined in Equations (1)–(10). The outcomes of these specific models were compared among themselves and with the other FL and ANN models. As quantitative parameters, the MSR, R, and RMSE were applied. Table 2 displays the model performances from both calibration and validation data sets.
Firstly, the fuzzy logic bearing strength prediction models displayed the MSE ranging from 0.004 to 0.026 in the calibration and 0.006 to 0.03 in the validation period. The R was from 0.618 to 0.959 in the calibration phase, and from 0.405 to 0.943 in the validation. The RMSE ranged from 0.173 to 0.057 for the calibration and from 0.173 to 0.058 for the validation phase.
Secondly, the quantitative statistical characteristics varied slightly within each model group. In the first group with a precipitation rate and mean air temperature as the only inputs, the M2 model performed much better than the M1 since the MSE equaled 0.02 in the calibration and validation phase. The R reached 0.712 and 0.638 in the calibration and validation periods. The RMSE was 0.142 for both calibration and validation. In the second model group, where the antecedent soil strength was considered along with a precipitation rate input, the M5 model outperformed the other models, although the difference, particularly from the M3 model, was pretty insignificant. Here, the MSE was 0.004 for both calibration and validation. The R was between 0.953 and 0.934, and the RMSE reached the margin of 0.061 for both calibration and validation. In the third group with a precipitation rate, mean air temperature, and antecedent soil strength, the M6, and M7 models outnumbered the other models within the group. The MSE reached up to 0.003 for both calibration and validation. The R displayed a great deal of accuracy with 0.96 and 0.94 for the calibration and validation periods. The RMSE equaled 0.058 and 0.057.
Finally, while comparing the overall results with the other model groups, both the groups with antecedent soil strength with the MSE, R, and RMSE equaling roughly 0.04, 0.95, and 0.06, were much superior to the first group with the MSE, R, and RMSE which were about 0.022, 0.62 and 0.15. Out of the two model groups with antecedent soil strength as inputs, the models with a precipitation rate and mean air temperature displayed slight performance improvement. Figure 6, Figure 7 and Figure 8 display the time series of observed and predicted soil strength for three FL models for the entire validation period.
Out of all FL models, the M7 and M6 models gained the best outcomes. The M5 and M3 models performed almost equally well, however, with fewer inputs.

3.3. Artificial Neural Network Bearing Strength Prediction Model

As in the previous models, the artificial neural network models were constructed to predict unpaved airport surface bearing capacity considering Equations (1)–(10). In order to formulate performances, statistical characteristics such as the MSE, R, and RMSE were proposed for each one, using 70% of data for calibration and the remaining 30% of data for validation. The most important results are presented in Table 3 for both periods. Not only were the model comparisons conducted within the entire ANN model group, but also, they were compared with the other two principally different models.
In general, the ANN models displayed the MSE in the 0.003 and 0.026 margins. The R was from 0.456 to 0.962, and the RMSE in the range of 0.055 and 0.16.
In the models being compared within the three main groups, the M2 model outperformed the M1 model. The MSE, R, and RMSE were 0.021, 0.71, and 0.143 (0.017, 0.699, and 0.13 for validation) in the first group with a precipitation rate and mean air temperature as only inputs. In the second group concerning a precipitation rate and antecedent soil strength input combination, the M5 model displayed the best resolution. The MSE, R and RMSE were 0.003, 0.961 and 0.056 (0.005, 0.945 and 0.056 for validation). However, the difference in performance from the M3 and M6 models was minuscular. Out of the last group with a precipitation rate, mean air temperature, and antecedent soil strength inputs comprising the M7, M9, and M10 models showed nearly equivalent performances. The M8 model displayed the MSE, R, and RMSE as 0.003, 0.962, and 0.056 (0.005, 0.922 and 0.069 for validation).
Regarding comparisons in the entire ANN group, the outcomes of adding antecedent soil strength as additional model input had an enormous impact on the accuracy. The example is a development of the R reaching 0.67 in the first group without antecedent soil strength whereas 0.96 on average in the second and third groups with antecedent soil strength. Although the M7, M9, and M10 third group models displayed the best resolution, the second group performed with sufficient accuracy but fewer inputs. Figure 9, Figure 10, Figure 11 and Figure 12 show the time series of observed and predicted soil strength from the ANN models for the entire validation period.

3.4. General Comparison of Tested Methods

Concerning the main study objectives, which was to investigate the capacity of FL and ANN models to carry out the soil strength prediction, the models based on FL and ANN were compared with LRF. The same data sets were applied for both model calibration and validation. So as to provide appropriate comparisons, statistical tools such as the MSE, R, and RMSE were employed. The results were graphically displayed in the MSE (Figure 13a,b), R (Figure 14a,b), and RMSE charts (Figure 15a,b) for the FL, ANN, and LRF models.
In all the models, it is visible that the inclusion of antecedent soil strength as an additional model input had an immense impact on increasing model accuracy. Specifically, the best MSE, R, and RMSE were 0.02, 0.71, and 0.14 for the model without antecedent soil strength input, whereas they were 0.005, 0.96, 0.06 with. Having the models tested within groups, the M10 model displayed the best resolution for the LTF with the MSE, R, and RMSE as 0.005, 0.881, and 0.069, whereas the M7 model, whether the ANN or FL, displayed the MSE, R, and RMSE as 0.003, 0.96, and 0.056. In total, the M7 model set up with the ANN is reported as the most precise model for bearing strength prediction of soils. However, considering practicability, the M3 model is essential due to the lower input presence than in the M7 model, despite displaying slightly worse accuracy. The FL and ANN models outperformed the LRF models well in all the classes. The ANN and FL models performed similarly during training and validation, even though the ANN models displayed slight superiority over the FL models in most cases.

4. Discussion

A range of different models were developed to investigate the impacts of likely inputs on the model performance. The application of FL and ANN displays prospects for statistical training theory utilization in predicting complex processes. The idea has a rigid mathematical base. Therefore, it can clearly address other applications. Although the model is considered a success from a practical point of view, from a theoretical view, it can hardly be generalized since it is still a local statistical model. Looking at the current bearing strength prediction models, they do not predict the strength directly. They are based on hydrological, run-off, water catchment models predicting the soil moisture. The bearing strength is then evaluated upon soil strength and moisture correlations. As mentioned, the original idea was to mount a model with the aid of moisture measurements. However, the moisture data collection relied entirely on the soil measurements in the top layer. This was later found insufficient for a correlation with the strength measured and recorded with greater accuracy in layers down to 60 cm. As a consequence, the moisture measurement concept was due to be refined. The original measurement in a reference depth was exchanged with soil measurements in the same pattern as the soil strength is to support comprehensive information over the entire soil profile.
The future work should concentrate on a model incorporating the soil moisture as an additional input and output representing antecedent soil conditions (see Figure 16).
With the soil moisture and data being collected in layers, the prediction should address the same layers too. The current ongoing project has been working in a specific airport condition distinguished by an overall silty sand soil condition. The future project should also cover a broader range of soils. An apparent interest is supposed to be taken into soils with higher silt content. It is aiming to generalize the experience into a more complex model permitting different soil layers.

5. Conclusions

The availability of a detailed and immense data set containing the bearing strength measurements of unpaved airport surfaces enabled one to build a statistical model for strength prediction. The ANN and FL were selected as powerful tools to produce the series of models to be subsequently compared with the LRF models. Ten input combinations based upon meteorological characteristics (a precipitation rate and daily mean air temperature) were considered. Having assessed the model performance with the aid of statistical characteristics (MSE, R, RMSE), all the models proved that the incorporation of antecedent soil strength as an additional model input had an immense impact on the increase in model accuracy. Generally, the M7 model set up with the ANN displayed the best performance (MSE, R, and RMSE as 0.003, 0.96, and 0.056). However, the M3 model showing a slightly decreased performance was anticipated for practical implications due to fewer inputs. The ANN and FL models performed almost equally well, although the ANN was a little superior. Both the ANN and FL outnumbered the LRF models well in all categories.

Funding

This research was funded by the Czech Republic Ministry of Defense—University of Defense development program “Support of the Czech Air Force in local conflicts”.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

The data sets used and analyzed during the current study are available from the corresponding author on reasonable request.

Conflicts of Interest

The author declare no conflict of interest. The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript, or in the decision to publish the results.

References

  1. Biancardo, S.A.; Viscione, N.; Oreto, C.; Veropalumbo, R.; Abbondati, F. BIM approach for modeling airports terminal expansion. Infrastructures 2020, 5, 41. [Google Scholar] [CrossRef]
  2. Cicmanec, L.; Marek, V. Bearing strength of unpaved airport surfaces: Optimization of number of measurements. In Proceedings of the ICMT 2019—7th International Conference on Military Technologies, Brno, Czech Republic, 30–31 May 2019; pp. 1–6. [Google Scholar] [CrossRef]
  3. Ranieri, V.; Berloco, N.; D’Auria, D.; Disalvo, V.; Fedele, V.; Intini, P.; Colonna, P. Determination of Bearing Capacity of Cleared and Graded Areas at Airports. J. Transp. Eng. Part B Pavements 2021, 147. [Google Scholar] [CrossRef]
  4. International Civil Aviation Organisation. Annex 14 Aerodromes, Volume I: Aerodrome Design and Operations; International Civil Aviation Organization: Montreal, QC, Canada, 2004; pp. 235–237. [Google Scholar]
  5. International Civil Aviation Organisation. DOC 9157 Aerodrome Design Manual. Part 1 Runways, 3rd ed.; International Civil Aviation Organization: Montreal, QC, Canada, 2006; pp. 5–13. [Google Scholar]
  6. Cicmanec, L.; Petrasek, D. Runway excursions: Bearing strength measurement concerns. In Proceedings of the 2019 IEEE/AIAA 38th Digital Avionics Systems Conference (DASC), San Diego, CA, USA, 8–12 September 2019; pp. 1–6. [Google Scholar] [CrossRef]
  7. Whitlow, R. Basic Soil Mechanics; Longman Scientific & Technical: Harlow, UK, 1992; ISBN 978-0-582-04564-9. [Google Scholar]
  8. Terzaghi, K.; Peck, R.B.; Mesri, G. Soil Mechanics in Engineering Practice; John Wiley & Sons: Hoboken, NJ, USA, 1996; ISBN 978-0-471-08658-4. [Google Scholar]
  9. ASTM D1883-16, Standard Test Method for California Bearing Ratio (CBR) of Laboratory-Compacted Soils; ASTM International: West Conshohocken, PA, USA, 2016. [CrossRef]
  10. ASTM D4429-09a, Standard Test Method for CBR (California Bearing Ratio) of Soils in Place; ASTM International: West Conshohocken, PA, USA, 2009. [CrossRef]
  11. Decky, M.; Remisova, E.; Mecar, M.; Bartuska, L.; Lizbetin, J.; Dreveny, I. In situ Determination of Load Bearing Capacity of Soils on the Airfields. Procedia Earth Planet. Sci. 2015, 15, 11–18. [Google Scholar] [CrossRef] [Green Version]
  12. Motaghedi, H.; Eslami, A. Analytical Approach for Determination of Soil Shear Strength Parameters from CPT and CPTu Data. Arab. J. Sci. Eng. 2014, 39, 4363–4376. [Google Scholar] [CrossRef]
  13. Sullivan, P.M.; Bullock, C.D.; Renfroe, N.A.; Albert, M.R.; Koenig, G.G.; Peck, L.; O’Neill, K. Tech. Rep. GL-97-15 Soil Moisture Strength Prediction Model Version II (SMSP II); US Army Waterways Experiment Station: Vicksburg, MS, USA, 1997; p. 117. [Google Scholar]
  14. Kennedy, J.G.; Rush, E.S.; Turnage, G.W.; Morris, P.A. TR-GL-88-13 Updated Soil Moisture–Strength Prediction (SMSP) Methodology; US Army Engineer Waterways Experiment Station: Vicksburg, MS, USA, 1988. [Google Scholar]
  15. Saxton, K.E.; Johnson, H.P.; Shaw, R.H. Modeling Evapotranspiration and Soil Moisture. Trans. Am. Soc. Agric. Eng. 1974, 17, 673–677. [Google Scholar] [CrossRef]
  16. McGann, C.R.; Bradley, B.A.; Taylor, M.L.; Wotherspoon, L.M.; Cubrinovski, M. Development of an empirical correlation for predicting shear wave velocity of Christchurch soils from cone penetration test data. Soil Dyn. Earthq. Eng. 2015, 75, 66–75. [Google Scholar] [CrossRef]
  17. Collins, J.G. Tech. Rep. Influence of Water Tables on Soil Moisture and Soil Strength. Report on Soil Trafficability Prediction; US Army Waterways Experiment Station: Vicksburg, MS, USA, 1967. [Google Scholar]
  18. Baladi, G.Y.; Rohani, B. TR-GL-79-6 A Terrain-Vehicle Interaction Model for Analysis of Steering Performance of Track-Laying Vehicle; US Army Engineer Waterways Experiment Station: Vicksburg, MS, USA, 1979. [Google Scholar]
  19. McCullough, M.; Jayakumar, P.; Dasch, J.; Gorsich, D. The Next Generation NATO Reference mobility model development. J. Terramechan. 2017, 73, 49–60. [Google Scholar] [CrossRef]
  20. Beven, K.J. Rainfall-Runoff Modelling: The Primer, 2nd ed.; John Wiley & Sons: Hoboken, NJ, USA, 2012; ISBN 978-1-119-95101-1. [Google Scholar]
  21. Knight, S.J. Some Factors Affecting Moisture Content-Density-Cone Index Relations; US Army Engineer Waterways Experiment Station: Vicksburg, MS, USA, 1961. [Google Scholar]
  22. Asteris, P.G.; Roussis, P.C.; Douvika, M.G. Feed-forward neural network prediction of the mechanical properties of sandcrete materials. Sensors 2017, 17, 1344. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  23. Mullai, P.; Rene, E.R.; Park, H.S.; Sabarathinam, P.L. Adaptive Network Based Fuzzy Interference System (ANFIS) Modeling of an Anaerobic Wastewater Treatment Process. In Handbook of Research on Industrial Informatics and Manufacturing Intelligence: Innovations and Solutions; IGI Global: Hershey, PA, USA, 2012; pp. 252–270. [Google Scholar] [CrossRef]
  24. Liou, Y.A.; Galantowicz, J.F.; England, A.W. A Land Surface Process/Radiobrightness Model with Coupled Heat and Moisture Transport for Prairie Grassland. IEEE Trans. Geosci. Remote Sens. 1999, 37, 1848–1859. [Google Scholar] [CrossRef]
  25. Baghdadi, N.; Gaultier, S.; King, C. Retrieving surface roughness and soil moisture from synthetic aperture radar (SAR) data using neural networks. Can. J. Remote Sens. 2002, 28, 701–711. [Google Scholar] [CrossRef]
  26. Bouttier, F.; Mahfouf, J.-F.; Noilhan, J. Sequential Assimilation of Soil Moisture from Atmospheric Low-Level Parameters. Part I: Sensitivity and Calibration Studies. J. Appl. Meteorol. Climatol. 1993, 32, 1335–1351. [Google Scholar] [CrossRef] [Green Version]
  27. Gill, M.K.; Asefa, T.; Kemblowski, M.W.; McKee, M. Soil moisture prediction using support vector machines. J. Am. Water Resour. Assoc. 2006, 42, 1033–1046. [Google Scholar] [CrossRef]
  28. Padmini, D.; Ilamparuthi, K.; Sudheer, K.P. Ultimate bearing capacity prediction of shallow foundations on cohesionless soils using neurofuzzy models. Comput. Geotech. 2008, 35, 33–46. [Google Scholar] [CrossRef]
  29. Kuo, Y.L.; Jaksa, M.B.; Lyamin, A.V.; Kaggwa, W.S. ANN-based model for predicting the bearing capacity of strip footing on multi-layered cohesive soil. Comput. Geotech. 2009, 36, 503–516. [Google Scholar] [CrossRef]
  30. Kiran, S.; Lal, B.; Tripathy, S.S. Shear Strength Prediction of Soil based on Probabilistic Neural Network. Indian J. Sci. Technol. 2016, 9. [Google Scholar] [CrossRef]
  31. Kanungo, D.P.; Sharma, S.; Pain, A. Artificial Neural Network (ANN) and Regression Tree (CART) applications for the indirect estimation of unsaturated soil shear strength parameters. Front. Earth Sci. 2014, 8, 439–456. [Google Scholar] [CrossRef]
  32. Dawson, C.W.; Wilby, R. An artificial neural network approach to rainfall-runoff modelling. Hydrol. Sci. J. 1998, 43, 47–66. [Google Scholar] [CrossRef]
  33. Senthil Kumar, A.R.; Sudheer, K.P.; Jain, S.K.; Agarwal, P.K. Rainfall-runoff modelling using artificial neural networks: Comparison of network types. Hydrol. Process. 2005, 19, 1277–1291. [Google Scholar] [CrossRef]
  34. Lohani, A.K.; Goel, N.K.; Bhatia, K.K.S. Takagi–Sugeno fuzzy inference system for modeling stage–discharge relationship. J. Hydrol. 2006, 331, 146–160. [Google Scholar] [CrossRef]
  35. Şen, Z.; Altunkaynak, A. Fuzzy awakening in rainfall-runoff modeling. Hydrol. Res. 2004, 35, 31–43. [Google Scholar] [CrossRef]
  36. Cicmanec, L.; Safranko, J.; Petrasek, M. Application of altered methodology for bearing strength measurements of unpaved airport surfaces. In Proceedings of the 22nd International Scientific Conference Transport Means 2018, Kaunas, Lithuania, 3–5 October 2018; pp. 336–341. [Google Scholar]
  37. Kutner, M.H.; Nachtsheim, C.J.; Neter, J.; Li, W. Applied Linear Statistical Models, 5th ed.; McGraw-Hill Irwin: New York, NY, USA, 1997; p. 233. ISBN 0-07-238688-6. [Google Scholar] [CrossRef]
  38. Seber, G.A.F.; Lee, A.J. Linear Regression Analysis, 2nd ed.; John Wiley & Sons: Hoboken, NJ, USA, 2012; Volume 329, ISBN 978-0-471-41540-4. [Google Scholar]
  39. Jang, J.-S.R. ANFIS: Adaptive-network-based fuzzy inference system. IEEE Trans. Syst. Man. Cybern. 1993, 23, 665–685. [Google Scholar] [CrossRef]
  40. Jang, J.-S.R.; Sun, C.-T. Neuro-fuzzy modeling and control. Proc. IEEE 1995, 83, 378–406. [Google Scholar] [CrossRef]
  41. Jang, J.S.R.; Sun, C.T.; Mizutani, E. Neuro-Fuzzy and Soft Computing—A Computational Approach to Learning and Machine Intelligence [Book Review]. IEEE Trans. Autom. Control 1997, 42, 1482–1484. [Google Scholar] [CrossRef]
  42. Wang, L.-X. Adaptive Fuzzy Systems and Control: Design and Stability Analysis; Prentice-Hall, Inc.: Hoboken, NJ, USA, 1994; ISBN 978-0-13-099631-2. [Google Scholar]
  43. Werbos, P. Beyond Regression: New Tools for Prediction and Analysis in the Behavioral. Ph.D. Thesis, Harvard University, Cambridge, MA, USA, 1974. [Google Scholar]
  44. Principe, J.C.; Euliano, N.R.; Lefebvre, W.C. Neural and Adaptive Systems: Fundamentals through Simulations; John Wiley & Sons: Hoboken, NJ, USA, 2000; Volume 672, ISBN 0-471-35167-9. [Google Scholar]
  45. Lehmann, E.L.; Casella, G. Theory of Point Estimation, 2nd ed.; Springer Inc.: New York, NY, USA, 1998; Volume 41, ISBN 0-387-98502-6. [Google Scholar]
  46. Legates, D.R.; McCabe, G.J. Evaluating the use of “goodness-of-fit” measures in hydrologic and hydroclimatic model validation. Water Resour. Res. 1999, 35, 233–241. [Google Scholar] [CrossRef]
  47. Schaap, M.G.; Leij, F.J. Database-related accuracy and uncertainty of pedotransfer functions. Soil Sci. 1998, 163, 765–779. [Google Scholar] [CrossRef]
Figure 1. A scheme of the aerodrome dynamic penetrometer (ADP).
Figure 1. A scheme of the aerodrome dynamic penetrometer (ADP).
Sensors 21 03373 g001
Figure 2. A time series of observed soil strength and predicted by the LRF model (M2).
Figure 2. A time series of observed soil strength and predicted by the LRF model (M2).
Sensors 21 03373 g002
Figure 3. A time series of observed soil strength and predicted by the LRF model (M3).
Figure 3. A time series of observed soil strength and predicted by the LRF model (M3).
Sensors 21 03373 g003
Figure 4. A time series of observed soil strength and predicted by the LRF model (M5).
Figure 4. A time series of observed soil strength and predicted by the LRF model (M5).
Sensors 21 03373 g004
Figure 5. A time series of observed soil strength and predicted by the LRF model (M10).
Figure 5. A time series of observed soil strength and predicted by the LRF model (M10).
Sensors 21 03373 g005
Figure 6. A time series of observed soil strength and predicted by the FL model (M2).
Figure 6. A time series of observed soil strength and predicted by the FL model (M2).
Sensors 21 03373 g006
Figure 7. A time series of observed soil strength and predicted by the FL model (M5).
Figure 7. A time series of observed soil strength and predicted by the FL model (M5).
Sensors 21 03373 g007
Figure 8. A time series of observed soil strength and predicted by the FL model (M7).
Figure 8. A time series of observed soil strength and predicted by the FL model (M7).
Sensors 21 03373 g008
Figure 9. A time series of observed soil strength and predicted by the ANN model (M2).
Figure 9. A time series of observed soil strength and predicted by the ANN model (M2).
Sensors 21 03373 g009
Figure 10. A time series of observed soil strength and predicted by the ANN model (M3).
Figure 10. A time series of observed soil strength and predicted by the ANN model (M3).
Sensors 21 03373 g010
Figure 11. A time series of observed soil strength and predicted by the ANN model (M5).
Figure 11. A time series of observed soil strength and predicted by the ANN model (M5).
Sensors 21 03373 g011
Figure 12. A time series of observed soil strength and predicted by the ANN model (M7).
Figure 12. A time series of observed soil strength and predicted by the ANN model (M7).
Sensors 21 03373 g012
Figure 13. Comparisons of the mean square errors (MSEs) for the LRF, FL, and ANN models; (a) calibration data; (b) validation data.
Figure 13. Comparisons of the mean square errors (MSEs) for the LRF, FL, and ANN models; (a) calibration data; (b) validation data.
Sensors 21 03373 g013
Figure 14. Comparisons of the correlation coefficients (R) for the LRF, FL, and ANN models; (a) calibration data; (b) validation data.
Figure 14. Comparisons of the correlation coefficients (R) for the LRF, FL, and ANN models; (a) calibration data; (b) validation data.
Sensors 21 03373 g014
Figure 15. Comparisons of the root mean square errors (RMSEs) for the LRF, FL, and ANN models; (a) calibration data; (b) validation data.
Figure 15. Comparisons of the root mean square errors (RMSEs) for the LRF, FL, and ANN models; (a) calibration data; (b) validation data.
Sensors 21 03373 g015
Figure 16. (a) A refined model conception; (b) soil moisture measurement probes.
Figure 16. (a) A refined model conception; (b) soil moisture measurement probes.
Sensors 21 03373 g016
Table 1. Linear regression model performance evaluation.
Table 1. Linear regression model performance evaluation.
ModelCalibrationValidation
MSERRMSEMSERRMSE
Precipitation rate and mean air temperature
M10.0270.3430.1660.030.3990.172
M20.0240.4180.1550.0250.5380.158
Precipitation rate and antecedent soil strength
M30.0050.8760.0710.0080.8610.092
M40.0050.8740.0720.0080.8590.091
M50.0050.8760.0710.0080.8610.092
Precipitation rate, mean air temperature, and antecedent soil strength
M60.0050.880.070.0080.8680.089
M70.0050.8810.070.0080.8680.089
M80.0050.8810.070.0080.8690.088
M90.0050.8790.070.0080.8660.088
M100.0050.8810.0690.0070.8730.084
Table 2. Fuzzy logic model performance evaluation.
Table 2. Fuzzy logic model performance evaluation.
ModelCalibrationValidation
MSERRMSEMSERRMSE
Precipitation rate and mean air temperature
M10.0260.6180.160.030.4050.173
M20.020.7120.1420.020.6380.142
Precipitation rate and antecedent soil strength
M30.0040.9510.0610.0040.9320.063
M40.0040.9490.0630.0050.9130.07
M50.0040.9530.0610.0040.9340.061
Precipitation rate, mean air temperature and antecedent soil strength
M60.0030.9570.0580.0030.9420.058
M70.0030.9590.0580.0030.9430.057
M80.0040.9460.0650.0060.9010.077
M90.0040.9460.0650.0060.9390.075
M100.0040.9510.0620.0040.9280.064
Table 3. Performance evaluation of the artificial neural network models.
Table 3. Performance evaluation of the artificial neural network models.
ModelCalibrationValidation
MSERRMSEMSERRMSE
Precipitation rate and mean air temperature
M10.0240.6550.1540.0260.4560.16
M20.0210.710.1430.0170.6990.13
Precipitation rate and antecedent soil strength
M30.0030.9580.0580.0030.9420.058
M40.0040.9560.0590.0040.9380.059
M50.0030.9610.0560.0030.9480.056
Precipitation rate, mean air temperature and antecedent soil strength
M60.0040.9550.060.0030.9480.054
M70.0030.9620.0560.0030.9460.055
M80.0030.960.0560.0050.9220.069
M90.0030.9610.0550.0030.9470.055
M100.0030.9610.0550.0030.9480.054
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Cicmanec, L. Applicability of Fuzzy Logic and Artificial Neural Network for Unpaved Airfield Surface Bearing Strength Prediction. Sensors 2021, 21, 3373. https://doi.org/10.3390/s21103373

AMA Style

Cicmanec L. Applicability of Fuzzy Logic and Artificial Neural Network for Unpaved Airfield Surface Bearing Strength Prediction. Sensors. 2021; 21(10):3373. https://doi.org/10.3390/s21103373

Chicago/Turabian Style

Cicmanec, Ludek. 2021. "Applicability of Fuzzy Logic and Artificial Neural Network for Unpaved Airfield Surface Bearing Strength Prediction" Sensors 21, no. 10: 3373. https://doi.org/10.3390/s21103373

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop