Next Article in Journal
A Smart and Sustainable Future for Viticulture Is Rooted in Soil: How to Face Cu Toxicity
Next Article in Special Issue
Performance Evaluation of Hybrid WOA-SVR and HHO-SVR Models with Various Kernels to Predict Factor of Safety for Circular Failure Slope
Previous Article in Journal
Modeling and Control of an Underactuated System for Dynamic Body Weight Support
Previous Article in Special Issue
Prediction of Swelling Index Using Advanced Machine Learning Techniques for Cohesive Soils
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
Applied Sciences
Volume 11
Issue 3
10.3390/app11030908
applsci-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

The Effectiveness of Ensemble-Neural Network Techniques to Predict Peak Uplift Resistance of Buried Pipes in Reinforced Sand

by
Jie Zeng
1,
Panagiotis G. Asteris
2,*,
Anna P. Mamou
2,
Ahmed Salih Mohammed
3,
Emmanuil A. Golias
4,
Danial Jahed Armaghani
5,
Koohyar Faizi
6 and
Mahdi Hasanipanah
7,*
1
Department of Transportation and Municipal Engineering, Chongqing Jianzhu College, Chongqing 400072, China
2
Computational Mechanics Laboratory, School of Pedagogical and Technological Education, 14121 Heraklion, Athens, Greece
3
Civil Engineering Department, College of Engineering, University of Sulaimani, Sulaimani 46001, Kurdistan Region, Iraq
4
Department of Civil Engineering, Democritus University of Thrace, 67100 Xanthi, Greece
5
Department of Civil Engineering, Faculty of Engineering, University of Malaya, Kuala Lumpur 50603, Malaysia
6
School of Engineering, University of Birmingham, Birmingham B15 2TT, UK
7
Institute of Research and Development, Duy Tan University, Da Nang 550000, Vietnam
*
Authors to whom correspondence should be addressed.
Appl. Sci. 2021, 11(3), 908; https://doi.org/10.3390/app11030908
Submission received: 23 November 2020 / Revised: 13 January 2021 / Accepted: 18 January 2021 / Published: 20 January 2021
(This article belongs to the Collection Heuristic Algorithms in Engineering and Applied Sciences)
Browse Figures
Versions Notes

Abstract

:
Buried pipes are extensively used for oil transportation from offshore platforms. Under unfavorable loading combinations, the pipe’s uplift resistance may be exceeded, which may result in excessive deformations and significant disruptions. This paper presents findings from a series of small-scale tests performed on pipes buried in geogrid-reinforced sands, with the measured peak uplift resistance being used to calibrate advanced numerical models employing neural networks. Multilayer perceptron (MLP) and Radial Basis Function (RBF) primary structure types have been used to train two neural network models, which were then further developed using bagging and boosting ensemble techniques. Correlation coefficients in excess of 0.954 between the measured and predicted peak uplift resistance have been achieved. The results show that the design of pipelines can be significantly improved using the proposed novel, reliable and robust soft computing models.

1. Introduction

Buried pipes are extensively used to transport oil and gas from offshore platforms. Under unfavorable loading combinations, the pipe’s uplift resistance may be exceeded and may lead to excessive deformations [1,2,3,4,5] and significant disruptions. The peak uplift resistance of buried pipes is typically determined using a combination of laboratory, field tests and numerical modelling [1,2,3,4,5,6,7,8,9,10]. It has been shown that the peak uplift resistance of buried pipes depends on the density of the surrounding soil, although the relative pipe-to-soil movement required to mobilize the peak uplift resistance is not significantly affected by soil density [11]. The increase in pipe embedment depth is attributed to the increase in the peak uplift resistance up to a critical embedment depth, beyond which no further increase in the normalized peak uplift resistance is recorded [5].
Laboratory-scale and field tests for the prediction of the peak uplift resistance of buried pipes are time-consuming and costly to perform [7] and in this context advanced numerical modelling may offer a viable alternative. A variety of artificial intelligence techniques have been employed in the literature for the prediction of the uplift resistance of buried pipes, including artificial neural network (ANN), neuro-genetic network (NGN), genetic programming and simulated annealing (GP-SA), multivariate adaptive regression spline (MARS), support vector machine (SVM), intelligent fuzzy radial basis function neural network inference method (IFRIM) and group method of data handling-harmony search (GMDH-HS). A summary of the various artificial intelligence (AI) and soft computing techniques (SC) used in the literature to predict the uplift resistance of buried pipes in various soil types is shown in Table 1. Although artificial neural networks (ANN) have been widely used for the prediction of the peak uplift resistance of buried pipes [6,12,13,14], the capabilities of ANN may have not have been fully explored. For example, only a limited number of studies developed artificial network models in combination with other techniques, which may have enhanced their accuracy [13]. It has been shown that when artificial neural networks are developed with boosting and bagging ensemble techniques, the prediction accuracy of artificial intelligence models may significantly increase [15,16,17,18,19,20,21,22,23,24,25,26,27,28,29,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44].
This paper aims to perform a series of small-scale tests on pipes buried in geogrid-reinforced sands and the measured peak uplift resistance was used to calibrate advanced numerical models employing neural networks. Therefore, multilayer perceptron (MLP) and Radial Basis Function (RBF) primary structure types were used to train two neural network models, which were then developed using bagging and boosting ensemble techniques.

2. Materials and Methods

2.1. Laboratory Test Procedure

A series of 44 small-scale uplift resistance tests were performed and the measured peak uplift resistance was used to calibrate advanced numerical models employing neural networks. Figure 1 shows the layout of the pullout system used for the small-scale uplift resistance tests. The pullout system comprised a rectangular test chamber, and a pulling arm system joined to an AC motor, which applied an uplift force to the buried pipes. More details regarding the testing methodology can be found in Faizi et al. [8] and Armaghani et al. [9] The small-scale tests investigated the effect of varying the pipe diameter, pipe burial depth, and geogrid geometry on the uplift resistance of buried pipes, so as to identify the most suitable input parameters affecting the peak uplift resistance of pipes. Table 2 lists the range parameter values investigated in the 44 small-scale uplift resistance tests performed in this research. In addition, Figure 2 and Figure 3 show typical uplift resistance tests in reinforced sand conducted in this study.

2.2. Background of SC Techniques

2.2.1. ANN

Artificial neural networks (ANNs) are advanced numerical models evolved from the idea of simulating the interaction of the synapsis of brain neurons. An artificial neural network (ANN) is an adaptive method that alters its composition according to its outer or inner knowledge that runs within the network through the learning stage [55,56,57,58]. In an ANN, associations among neurons generally carry different weights that show how influential the association is. The neuron measures by creating a weighted aggregate of its input, that is, the activation of each input neuron is multiplied by the corresponding link weight. ANNs are categorized into two main types; Multi-Layer Perceptron (MLP) and Radial Basis Function (RBF) [59]. The popularity of ANN models is associated with their robustness compared to linear numerical modeling methods [60]. Both MLP and RBF comprise non-linear universal approximators with feed-forward structures [61,62].
An MLP is a type of feed-forward ANN, which comprises at least three layers of links: (1) input layer, (2) hidden layer and (3) output layer. Every link is a neuron that utilizes a non-linear activation function except for the input links. It is worth noting that the MLP employs a supervised learning procedure named backpropagation training [63,64]. The MLP can be differentiated from a linear perceptron through its multiple layers and non-linear activation. MLP can also detect data which are not linearly associated [65].
The RBF network is an ANN that employs RBFs as activation functions. The product of the system is a linear compound of RBFs of the data inputs and neuron parameters. Similar to the MLP, the RBF network typically comprises three layers: (1) input layer, (2) hidden layer with a non-linear RBF activation function and (3) linear output layer. The input layer should be signified as a vector of real numbers. At that stage, the product of the system is a scalar function of the input vector.
MLP and RBF have significant architectural differences [66]. An MLP-NN might comprise one or more hidden layers, while the RBF-NN displays only one hidden layer. The MLP-NN might have several non-linear hidden layers, compared to the RBF-NN, that contains one non-linear hidden layer which is accompanied by a linear output layer. Regarding the activation function of every neuron, a dot product is executed in an MLP-NN, while an RBF-NN calculates a vector norm. Due to the nature of the activation functions, MLP can create global input-output non-linear mappings, whereas RBF-NNs can only produce local estimates. Figure 4 shows the significant differences between the architecture of MLP and RBF.

2.2.2. Ensemble Approach

Ensemble learning (EL) is an advanced numerical modelling technique which uses various models usually termed “weak learners”, which are trained to solve the same problem and which are consolidated to generate more reliable results. The main underlying assumption is that if weak models are perfectly merged, then the results will be more accurate and the consolidated model is likely to be more robust. Employing ensembles to conduct predictions may be justified due to their remarkable capability to generalize outcomes and decrease model variation, due to their lower susceptibility to data noise [67]. In this paper, two primary ensemble techniques including bagging and boosting were employed. Boosting is a method applied to resolve classification and regression problems. Boosting techniques primarily focus on bias mitigation and on enhancing the model’s suitability to data. Compared with bagging techniques that primarily decrease diversity, boosting is a technique that involves sequentially fitting various weak learners in a highly adaptive process. Every model in the series is applied, providing higher importance to observations in the dataset examined by the earlier models in the series. Each novel model concentrates on fitting the most challenging measurements and the outcome is an intense learner with a lower bias.
Bagging, or bootstrap aggregating, is one of the most established methods for generating ensemble models [67]. While this technique was primarily developed to solve classification problems, it was later employed to analyze regression data. Bagging is defined by producing and refitting various samples, by utilizing the bootstrap method from an identical set of data. As a result, it is likely to create many different trees for an identical predictor and employ them for creating an aggregate forecast. The prediction can be achieved by voting or by an average for classification and regression problems [68]. This prediction creates various samples for an identical set. The benefit of utilizing this method for ensemble creation is that it minimizes any error in the baseline predictors. The prediction accuracy of the bagging technique can present its predictive performance measures related to calculations of cross-validation and measures of testing sets [69].

3. Results and Discussion

3.1. Laboratory Results

Figure 5 shows the effect of pipe diameter and burial depth on the peak uplift resistance of pipes buried in non-reinforced sand. The results show that the peak uplift resistance increased with increasing pipe diameter. For 100 mm burial depths, the peak uplift resistance increased from 36.48 to 49.8 N as the pipe diameter increased from 25 mm to 55 mm. Similar trends were observed for 150 mm burial depths with the peak ultimate resistance increasing from 49.92 to 76.8 N as the pipe diameter increased from 25 to 55 mm. For both burial depths, the peak uplift resistance values are related to the pipe with a diameter of 55 mm. It is clear from this figure that pipe diameter and burial depth have a great influence on the results of the peak uplift resistance. Actually, there is a direct connection between the peak uplift resistance values of pipes and their diameters. Specifically, it was found that there is a big difference in the peak uplift resistance values from D = 25 mm to D = 35 mm, while the mentioned variance is decreased from D = 45 mm to D = 55 m significantly. In this regard, Dickin [70] mentioned that the difference in the peak uplift resistance values turn out to be lesser in the case of greater pipe diameters.
Figure 6 shows the effect of the geogrid layout on the peak uplift resistance of sand. The geogrid layout was varied by including different geogrid lengths and numbers of layers. The results in Figure 6 show that increasing the geogrid length and number of layers significantly increased the peak ultimate resistance of the buried pipe. Inclusion of geogrid reinforcement changed the uplift resistance to the displacement response of the sand. In the non-reinforced sand, the uplift resistance increased with the increasing strain up to a peak value, followed by strain softening, whereas in the reinforced soil the uplift resistance increased monotonically with the increasing strain. The results in Figure 5 and Figure 6 show the influence of pipe diameter, burial depth, geo-grid length and geo-grid number of layers on the uplift resistance of pipes and justifies them as appropriate input parameters for the artificial neural network modeling for the prediction of the peak ultimate resistance.

3.2. Soft Computing Predictive Models

This paper applied two ensemble approaches on the two most commonly used ANN models for predicting the peak uplift resistance of pipelines buried in sand. The ensemble techniques employed in this research include boosting and bagging techniques. ANN-MLP and ANN-RBF were also developed to estimate the peak uplift resistance of pipes buried in sand. Two standard models (STANDARDANNMLP and STANDARDANNRBF), without applying the ensemble approaches, were developed to benchmark the ANN-ensemble models. Before the models’ development, the data were divided into train and test partitions with an 80:20 proportion. The results of these models were then analyzed using a number of performance criteria, including the mean absolute error (MAE), correlation coefficient (R), and gains. The expression for calculating the correlation coefficient (R) and mean absolute error (MAE) are presented below:
R = 1 − Σ i y i − f i 2 Σ i y i − y ¯ 2
M A E = 1 N ∑ j = 1 N y i − y j
where y are the measured values, ȳ and y′ show are the mean and predicted values of y and N is the total number of data.
This research initially applied standard ANN models based on MLP and RBF structures to a database of 44 laboratory test data. In these two models, a single hidden layer, with a maximum training time of 5 min, and an over-fit prevention of 30% were used. It is worth mentioning that the neural network modelling internally divides samples into a model building set and an over-fit prevention set. The structure of these models are shown in Figure 7.
Thereafter, bagging and boosting techniques were applied to the trained ANN, to assess the effectiveness of these techniques when applied to standard ANN models. For these four models (ANNMLP-BOOSTED, ANNMLP-BAGGED, ANNRBF-BOOSTED, and ANNRFB-BAGGED), the “mean” value was set as the combination rule for the target variable. In addition, the quantity of component models for boosting and bagging was established as in [10]. The measured and predicted peak uplift resistances of the buried pipes for all six models are shown in Figure 8.
The performance of these models was assessed using the criteria mentioned above. In addition, a simple ranking system was deployed to obtain a comprehensive assessment. In this system, each model performance is evaluated based on R and MAE within each partition. Then, each model is ranked according to the value of each criterion. Thus, for R, the highest rank is assigned to a model which obtains the highest value; and for RMSE, the highest rank should be given to a model which acquires the lowest value. It should be noted that, in this case, the highest value is six because this research deployed six models. The cumulative rank of each model is calculated using the following expression:
C u m m u l a t i v e   r a n k i n g   =   ∑ α t r + α t e + β t r + β t e
where α shows the ranking of R, β represents the ranking of MAE, with the subscript “tr” and “te” denoting training and testing values respectively.
Table 3 shows the results of each performance criterion and the rankings and cumulative ranking of each model. As can be seen, the ANNMLP-BOOSTED model obtained the highest cumulative, training R, and training and testing MAE rankings. Alternatively, the ANNRFB-BAGGED model achieved the lowest cumulative ranking in addition to the testing and training of R and MAE rankings. For the total ranking of the training phase, the highest-ranking was achieved by ANNMLP-BOOSTED, while both ANNMLP-BOOSTED and ANNMLP-BAGGED achieved the highest and similar testing phase total ranking. For a better understanding of the ensemble models developed in this study, a diagram is provided in Figure 9, which compares the models with other ML models, such as KNN, SVM, and CHAID models.
In addition to using R and MAE criteria for evaluating the models’ performance, a series of gain charts were employed to allow a more in-depth performance assessment (Figure 10). Gains are measured as (quantity of hits in quantile/whole quantity of hits) × 100%. At this point, it is essential to state that “hit” points show the progress of a predictive model to forecast the values more significant than the middle point of the field’s range (peak uplift resistance > 78.92 N). In the diagram mentioned above, the blue line in the faultless model with tremendous confidence (where hits = 100% of cases), the oblique red line signifies the at-chance model, and the other three lines in the center depict the models applied in this study. In general, the higher-level lines display more reliable models, especially on the chart’s left side. To analyze a model applied and the at-chance model, the region between a model and the red line can be utilized. The area mentioned above signifies the superiority of an applied model versus the at-chance model. The region between a model employed and the excellent model illustrates areas of improvement for an applied model.
According to the results of gains charts, for the ANNMLP-ensemble models in both testing and training phases, the ANNMLP-BOOSTED models performed better than all the other models developed in this study. Moreover, for ANNRBF-ensemble models, all models showed similar performance in the testing phase. On the other hand, for the training phase, the ANNRBF-BOOSTED model outperformed all the other models.
This study shows that boosting and bagging techniques can improve performance prediction (both the accuracy level and system error) of the MLP model. However, these techniques were not able to improve the performance of the RBF model, which may imply that both ensemble techniques are more suitable for the MLP-ANN model than the RBF-ANN model. The boosting technique showed better effectiveness than the bagging technique when applied to MLP and RBF models. The better performance of the boosting technique may be associated with its ability to mind the weightage of the more eminent accuracy sample and the lower accuracy sample, and that it can at a later stage supply the merged results. Furthermore, the net error is assessed in every learning run, and it operates well with interactions. Moreover, the boosting method is more appropriate when the users deal with under-fitting or bias in the data.

4. Limitations and Future Research

The proposed neural network is applied in the five-dimensional space defined by the five parameters which influence the development of the peak uplift resistance of buried pipes in reinforced sand. In fact, the neural network is applicable for any parameter values ranging between the lowest and highest values of each parameter, as presented in Table 2. It should be mentioned that any developed soft computing-based model such as artificial neural networks can predict an output parameter only for dataset output parameter values ranging between the lowest and highest values of each parameter used during its training stage.
At this point it must be stressed that in certain areas, more data are required in order to achieve the optimum fitting of the proposed neural network to the data. Pipe diameters, burial depths, geo-grid lengths and number of geo-grid layers should in the future be designed with the aim of revealing the development of peak uplift resistance of buried pipes in reinforced sand for intermediate values of these parameters, not included in the database presented and used herein. Through this optimization process, the influence of each parameter on the peak uplift resistance will be further elaborated, and the neural network, having been trained for all the ranges of the input parameters, will be able to predict intermediate values more accurately.

5. Summary and Conclusions

A series of small scale laboratory tests for buried pipes in reinforced and non-reinforced sands were conducted by measuring the peak uplift resistance to calibrate advanced numerical models employing neural network methods. Many studies have employed ANN modelling techniques to predict the peak uplift resistance. However, a few studies hybridized the ANN with other modelling techniques. Besides, the ANN capacities were not explored completely in previous studies. Thus, this study investigated the feasibility of employing ANN modelling techniques while considering different capabilities of ANN. Multilayer perceptron (MLP) and Radial Basis Function (RBF) primary structure types were used to train two neural network models, which were then developed using bagging and boosting ensemble techniques.
The main conclusions of this study are the following:
  • The results of the numerical modelling revealed that boosting and bagging techniques can significantly improve the performance prediction (both the accuracy level and the system error) of the MLP model. However, these techniques were not able to improve the performance of the RBF model, which may imply that both ensemble techniques are more suitable for the MLP-ANN than the RBF-ANN model.
  • The boosting technique performed better than the bagging technique when applied to MLP and RBF models. In addition, correlation coefficients in excess of 0.954 were achieved between the measured and predicted peak uplift resistance.
  • The proposed developed models reveal the complicated non-linear response of the peak uplift resistance of buried pipes in reinforced sand. Furthermore, they can be useful tools for researchers, engineers and for supporting the teaching and interpretation of the peak uplift resistance of buried pipes in reinforced sand.
It is important to mention that the proposed models in this study should be utilized within the condition and variation of the input variables. The peak uplift results of the other situations may be different and unreliable. While this is common in that the geo-technical database is small in size and these datasets are used for predicting the variables of interest, further studies can expand the database with more datasets to achieve better accuracies and fewer errors.

Author Contributions

Formal analysis, J.Z. and D.J.A.; Conceptualization, D.J.A. and A.S.M.; Supervision, P.G.A.; Writing—Review and editing, D.J.A., P.G.A., A.P.M., E.A.G., A.S.M. and J.Z.; Data Curation, K.F.; Resources, M.H. All authors have read and agreed to the published version of the manuscript.

Funding

The first author would like to acknowledge the Science and Technology Planning Project of Chongqing Education Commission (KJQN201804305, KJQN201904307) (JG-KJ-2019-006).

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. White, D.J.; Cheuk, C.Y.; Bolton, M.D. The uplift resistance of pipes and plate anchors buried in sand. Géotechnique 2008, 58, 771–779. [Google Scholar] [CrossRef] [Green Version]
  2. Maltby, T.; Calladine, C. An investigation into upheaval buckling of buried pipelines—II. Theory and analysis of experimental observations. Int. J. Mech. Sci. 1995, 37, 965–983. [Google Scholar] [CrossRef]
  3. Baumgard, A.J. Monotonic and cyclic soil responses to upheaval buckling in offshore buried pipelines. Ph.D. Thesis, University of Cambridge, Cambridge, UK, 2001. [Google Scholar]
  4. Newson, T.; Deljoui, P. Finite Element Modelling of Upheaval Buckling of Buried offshore Pipelines in Clayey Soils. In Proceedings of the GeoShanghai International Conference, Shanghai, China, 6–8 June 2006; pp. 351–358. [Google Scholar]
  5. Zheng, G.; Zhang, W.; Zhang, W.; Zhou, H.; Yang, P. Neural network and support vector machine models for the prediction of the liquefaction-induced uplift displacement of tunnels. Undergr. Space 2020. [Google Scholar] [CrossRef]
  6. Nazari, A.; Rajeev, P.; Sanjayan, J. Offshore pipeline performance evaluation by different artificial neural networks approaches. Measurement 2015, 76, 117–128. [Google Scholar] [CrossRef]
  7. El-Abbasy, M.S.; Senouci, A.; Zayed, T.; Mirahadi, F.; Parvizsedghy, L. Artificial neural network models for predicting condition of offshore oil and gas pipelines. Autom. Constr. 2014, 45, 50–65. [Google Scholar] [CrossRef]
  8. Faizi, K.; Armaghani, D.J.; Momeni, E.; Nazir, R.; Mohamad, E.T. Uplift Resistance of Buried Pipelines Enhanced by Geogrid. Soil Mech. Found. Eng. 2014, 51, 188–195. [Google Scholar] [CrossRef]
  9. Jahed, D.; Faizi, K.; Hajihassani, M.; Tonnizam, E. Effects of soil reinforcement on uplift resistance of buried pipeline. Measurement 2015, 64, 57–63. [Google Scholar] [CrossRef]
  10. Zucca, M.; Valente, M. On the limitations of decoupled approach for the seismic behaviour evaluation of shallow multi-propped underground structures embedded in granular soils. Eng. Struct. 2020, 211, 110497. [Google Scholar] [CrossRef]
  11. Thusyanthan, N.I.; Ganesan, S.A.; Bolton, M.D.; Allan, P. Upheaval buckling resistance of pipelines buried in clayey backfill. In Proceedings of the Eighteenth International Offshore and Polar Engineering Conference, Vancouver, BC, Canada, 6–11 July 2008. [Google Scholar]
  12. Liu, X.; Zheng, Q.; Wu, K.; Yang, Y.; Zhao, Z.; Zhang, H. Development of a novel approach for strain demand prediction of pipes at fault crossings on the basis of multi-layer neural network driven by strain data. Eng. Struct. 2020, 214, 110685. [Google Scholar] [CrossRef]
  13. Choobbasti, A.J.; Tavakoli, H.; Kutanaei, S.S. Modeling and optimization of a trench layer location around a pipeline using artificial neural networks and particle swarm optimization algorithm. Tunn. Undergr. Space Technol. 2014, 40, 192–202. [Google Scholar] [CrossRef]
  14. Rahman, M.; Wang, J.; Deng, W.; Carter, J. A neural network model for the uplift capacity of suction caissons. Comput. Geotech. 2001, 28, 269–287. [Google Scholar] [CrossRef]
  15. Asteris, P.G.; Roussis, P.C.; Douvika, M.G. Feed-Forward Neural Network Prediction of the Mechanical Properties of Sandcrete Materials. Sensors 2017, 17, 1344. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  16. Asteris, P.G.; Moropoulou, A.; Skentou, A.D.; Apostolopoulou, M.; Mohebkhah, A.; Cavaleri, L.; Rodrigues, H.; Varum, H. Stochastic Vulnerability Assessment of Masonry Structures: Concepts, Modeling and Restoration Aspects. Appl. Sci. 2019, 9, 243. [Google Scholar] [CrossRef] [Green Version]
  17. Chen, H.; Asteris, P.G.; Armaghani, D.J.; Gordan, B.; Pham, B.T. Assessing Dynamic Conditions of the Retaining Wall: Developing Two Hybrid Intelligent Models. Appl. Sci. 2019, 9, 1042. [Google Scholar] [CrossRef] [Green Version]
  18. Hajihassani, M.; Abdullah, S.S.; Asteris, P.G.; Armaghani, D.J. A Gene Expression Programming Model for Predicting Tunnel Convergence. Appl. Sci. 2019, 9, 4650. [Google Scholar] [CrossRef] [Green Version]
  19. Huang, L.; Asteris, P.G.; Koopialipoor, M.; Armaghani, D.J.; Tahir, M.M. Invasive Weed Optimization Technique-Based ANN to the Prediction of Rock Tensile Strength. Appl. Sci. 2019, 9, 5372. [Google Scholar] [CrossRef] [Green Version]
  20. Duan, J.; Asteris, P.G.; Nguyen, H.; Bui, X.-N.; Moayedi, H. A novel artificial intelligence technique to predict compressive strength of recycled aggregate concrete using ICA-XGBoost model. Eng. Comput. 2020, 1–18. [Google Scholar] [CrossRef]
  21. Sarir, P.; Chen, J.; Asteris, P.G.; Armaghani, D.J.; Tahir, M.M. Developing GEP tree-based, neuro-swarm, and whale optimization models for evaluation of bearing capacity of concrete-filled steel tube columns. Eng. Comput. 2019, 1–19. [Google Scholar] [CrossRef]
  22. Apostolopoulou, M.; Asteris, P.G.; Armaghani, D.J.; Douvika, M.G.; Lourenço, P.B.; Cavaleri, L.; Bakolas, A.; Moropoulou, A. Mapping and holistic design of natural hydraulic lime mortars. Cem. Concr. Res. 2020, 136, 106167. [Google Scholar] [CrossRef]
  23. Zhou, J.; Li, E.; Yang, S.; Wang, M.; Shi, X.; Yao, S.; Mitri, H.S. Slope stability prediction for circular mode failure using gradient boosting machine approach based on an updated database of case histories. Saf. Sci. 2019, 118, 505–518. [Google Scholar] [CrossRef]
  24. Zhou, J.; Li, X.; Mitri, H.S. Classification of Rockburst in Underground Projects: Comparison of Ten Supervised Learning Methods. J. Comput. Civ. Eng. 2016, 30, 04016003. [Google Scholar] [CrossRef]
  25. Zhou, J.; Shi, X.; Li, X. Utilizing gradient boosted machine for the prediction of damage to residential structures owing to blasting vibrations of open pit mining. J. Vib. Control. 2016, 22, 3986–3997. [Google Scholar] [CrossRef]
  26. Zhou, J.; Li, X.; Mitri, H.S. Comparative performance of six supervised learning methods for the development of models of hard rock pillar stability prediction. Nat. Hazards 2015, 79, 291–316. [Google Scholar] [CrossRef]
  27. Yang, H.; Xing, S.; Wang, Q.; Li, Z. Model test on the entrainment phenomenon and energy conversion mechanism of flow-like landslides. Eng. Geol. 2018, 239, 119–125. [Google Scholar] [CrossRef]
  28. Yang, H.; Li, Z.; Jie, T.; Zhang, Z. Effects of joints on the cutting behavior of disc cutter running on the jointed rock mass. Tunn. Undergr. Space Technol. 2018, 81, 112–120. [Google Scholar] [CrossRef]
  29. Zhao, X.; Fourie, A.; Qi, C. An analytical solution for evaluating the safety of an exposed face in a paste backfill stope incorporating the arching phenomenon. Int. J. Miner. Met. Mater. 2019, 26, 1206–1216. [Google Scholar] [CrossRef]
  30. Qi, C. Big data management in the mining industry. Int. J. Miner. Met. Mater. 2020, 27, 131–139. [Google Scholar] [CrossRef]
  31. Zhao, X.; Fourie, A.; Veenstra, R.; Qi, C. Safety of barricades in cemented paste-backfilled stopes. Int. J. Miner. Met. Mater. 2020, 27, 1054–1064. [Google Scholar] [CrossRef]
  32. Zhao, X.; Fourie, A.; Qi, C. Mechanics and safety issues in tailing-based backfill: A review. Int. J. Miner. Met. Mater. 2020, 27, 1165–1178. [Google Scholar] [CrossRef]
  33. Liu, B.; Yang, H.; Karekal, S. Effect of Water Content on Argillization of Mudstone during the Tunnelling process. Rock Mech. Rock Eng. 2020, 53, 799–813. [Google Scholar] [CrossRef]
  34. Yang, H.; Lan, Y.; Lu, L.; Zhou, X. A quasi-three-dimensional spring-deformable-block model for runout analysis of rapid landslide motion. Eng. Geol. 2015, 185, 20–32. [Google Scholar] [CrossRef]
  35. Asteris, P.G.; Douvika, M.G.; Karamani, C.A.; Skentou, A.D.; Chlichlia, K.; Cavaleri, L.; Daras, T.; Armaghani, D.J.; Zaoutis, T.E. A Novel Heuristic Algorithm for the Modeling and Risk Assessment of the COVID-19 Pandemic Phenomenon. Comput. Model. Eng. Sci. 2020, 125, 815–828. [Google Scholar] [CrossRef]
  36. Zhou, J.; Bejarbaneh, B.Y.; Armaghani, D.J.; Tahir, M.M. Forecasting of TBM advance rate in hard rock condition based on artificial neural network and genetic programming techniques. Bull. Int. Assoc. Eng. Geol. 2020, 79, 2069–2084. [Google Scholar] [CrossRef]
  37. Zhou, J.; Qiu, Y.; Armaghani, D.J.; Zhang, W.; Li, C.; Zhu, S.; Tarinejad, R. Predicting TBM penetration rate in hard rock condition: A comparative study among six XGB-based metaheuristic techniques. Geosci. Front. 2020. [Google Scholar] [CrossRef]
  38. Zhou, J.; Qiu, Y.; Zhu, S.; Armaghani, D.J.; Li, C.; Nguyen, H.; Yagiz, S. Optimization of support vector machine through the use of metaheuristic algorithms in forecasting TBM advance rate. Eng. Appl. Artif. Intell. 2021, 97, 104015. [Google Scholar] [CrossRef]
  39. Li, D.; Armaghani, D.J.; Zhou, J.; Lai, S.H.; Hasanipanah, M. A GMDH Predictive Model to Predict Rock Material Strength Using Three Non-destructive Tests. J. Nondestruct. Evaluat. 2020, 39, 1–14. [Google Scholar] [CrossRef]
  40. Zhou, J.; Asteris, P.G.; Armaghani, D.J.; Pham, B.T. Prediction of ground vibration induced by blasting operations through the use of the Bayesian Network and random forest models. Soil Dyn. Earthq. Eng. 2020, 139, 106390. [Google Scholar] [CrossRef]
  41. Lu, S.; Koopialipoor, M.; Asteris, P.G.; Bahri, M.; Armaghani, D.J. A Novel Feature Selection Approach Based on Tree Models for Evaluating the Punching Shear Capacity of Steel Fiber-Reinforced Concrete Flat Slabs. Materials 2020, 13, 3902. [Google Scholar] [CrossRef]
  42. Armaghani, D.J.; Momeni, E.; Asteris, P. Application of group method of data handling technique in assessing deformation of rock mass. Metaheuristic Comput. Appl. 2020, 1, 1–18. [Google Scholar]
  43. Telikani, A.; Gandomi, A.H.; Shahbahrami, A.; Dehkordi, M.N.; Amir, H.; Mohammad, N.D. Privacy-preserving in association rule mining using an improved discrete binary artificial bee colony. Expert Syst. Appl. 2020, 144, 113097. [Google Scholar] [CrossRef]
  44. Harandizadeh, H.; Armaghani, D.J. Prediction of air-overpressure induced by blasting using an ANFIS-PNN model optimized by GA. Appl. Soft Comput. 2021, 99, 106904. [Google Scholar] [CrossRef]
  45. Pai, G.A.V. Prediction of uplift capacity of suction caissons using a neuro-genetic network. Eng. Comput. 2005, 21, 129–139. [Google Scholar] [CrossRef]
  46. Alavi, A.H.; Gandomi, A.H.; Mousavi, M.; Mollahasani, A. High-precision modeling of uplift capacity of suction caissons using a hybrid computational method. Géoméch. Eng. 2010, 2, 253–280. [Google Scholar] [CrossRef]
  47. Alavi, A.H.; Aminian, P.; Gandomi, A.H.; Esmaeili, M.A. Genetic-based modeling of uplift capacity of suction caissons. Expert Syst. Appl. 2011, 38, 12608–12618. [Google Scholar] [CrossRef]
  48. Gandomi, A.H.; Alavi, A.H.; Yun, G.J. Formulation of uplift capacity of suction caissons using multi expression programming. KSCE J. Civ. Eng. 2011, 15, 363–373. [Google Scholar] [CrossRef]
  49. Samui, P.; Das, S.K.; Kim, D. Uplift capacity of suction caisson in clay using multivariate adaptive regression spline. Ocean Eng. 2011, 38, 2123–2127. [Google Scholar] [CrossRef]
  50. Muduli, P.K.; Das, M.R.; Samui, P.; Das, S.K. Uplift Capacity of Suction Caisson in Clay Using Artificial Intelligence Techniques. Mar. Georesour. Geotechnol. 2013, 31, 375–390. [Google Scholar] [CrossRef]
  51. Cheng, M.-Y.; Cao, M.-T.; Tran, D.H. A hybrid fuzzy inference model based on RBFNN and artificial bee colony for predicting the uplift capacity of suction caissons. Autom. Constr. 2014, 41, 60–69. [Google Scholar] [CrossRef]
  52. Shahr-Babak, M.M.; Khanjani, M.J.; Qaderi, K. Uplift capacity prediction of suction caisson in clay using a hybrid intelligence method (GMDH-HS). Appl. Ocean Res. 2016, 59, 408–416. [Google Scholar] [CrossRef]
  53. Derakhshani, A. Estimating uplift capacity of suction caissons in soft clay: A hybrid computational approach based on model tree and GP. Ocean Eng. 2017, 146, 1–8. [Google Scholar] [CrossRef]
  54. Derakhshani, A. On the uncertainty analysis of uplift capacity of suction caissons in clay based on the fuzzy sets theory. Ocean Eng. 2018, 170, 416–425. [Google Scholar] [CrossRef]
  55. Asteris, P.G.; Apostolopoulou, M.; Skentou, A.D.; Moropoulou, A. Application of artificial neural networks for the prediction of the compressive strength of cement-based mortars. Comput. Concr. 2019, 24, 329–345. [Google Scholar]
  56. Armaghani, D.J.; Hatzigeorgiou, G.D.; Karamani, C.; Skentou, A.; Zoumpoulaki, I.; Asteris, P.G. Soft computing-based techniques for concrete beams shear strength. Procedia Struct. Integr. 2019, 17, 924–933. [Google Scholar] [CrossRef]
  57. Armaghani, D.J.; Asteris, P.G. A comparative study of ANN and ANFIS models for the prediction of cement-based mortar materials compressive strength. Neural Comput. Appl. 2020, 1–32. [Google Scholar] [CrossRef]
  58. Asteris, P.G.; Apostolopoulou, M.; Armaghani, D.J.; Cavaleri, L.; Chountalas, A.T.; Guney, D.; Hajihassani, M.; Hasanipanah, M.; Khandelwal, M.; Karamani, P.G.; et al. On the metaheuristic models for the prediction of cement-metakaolin mortars compressive strength. Metaheuristic Comput. Appl. 2020, 1, 63–99. [Google Scholar]
  59. Mai, V.; Khalil, I.; Meli, C. ECG biometric using multilayer perceptron and radial basis function neural networks. In Proceedings of the 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Boston, MA, USA, 30 August–3 September 2011; Volume 2011, pp. 2745–2748. [Google Scholar]
  60. Efendioglu, H.S.; Yildirim, T.; Fidanboylu, K. Prediction of Force Measurements of a Microbend Sensor Based on an Artificial Neural Network. Sensors 2009, 9, 7167–7176. [Google Scholar] [CrossRef]
  61. Bishop, C.M. Neural Networks for Pattern Recognition; Oxford University Press: New York, NY, USA, 1995; ISBN 0198538642. [Google Scholar]
  62. Dreyfus, G. Neural Networks: Methodology and Applications; Springer: Berlin/Heidelberg, Germany, 2005; ISBN 3540288473. [Google Scholar]
  63. Asteris, P.G.; Kolovos, K.; Douvika, M.; Roinos, K. Prediction of self-compacting concrete strength using artificial neural networks. Eur. J. Environ. Civ. Eng. 2016, 20, s102–s122. [Google Scholar] [CrossRef]
  64. Chen, W.; Sarir, P.; Bui, X.-N.; Nguyen, H.; Tahir, M.M.; Armaghani, D.J. Neuro-genetic, neuro-imperialism and genetic programing models in predicting ultimate bearing capacity of pile. Eng. Comput. 2019, 36, 1101–1115. [Google Scholar] [CrossRef]
  65. Cybenko, G. Approximation by superpositions of a sigmoidal function. Math. Control. Signals Syst. 1989, 2, 303–314. [Google Scholar] [CrossRef]
  66. Haykin, S.S. Neural Networks and Learning Machines; Pearson: Upper Saddle River, NJ, USA, 2009. [Google Scholar]
  67. Mendes-Moreira, J.; Soares, C.; Jorge, A.M.; Sousa, J.F. De Ensemble approaches for regression: A survey. Acm. Comput. Surv. 2012, 45, 1–40. [Google Scholar] [CrossRef]
  68. Erdal, H.; Karahanoğlu, I. Bagging ensemble models for bank profitability: An emprical research on Turkish development and investment banks. Appl. Soft Comput. 2016, 49, 861–867. [Google Scholar] [CrossRef]
  69. Hamze-Ziabari, S.; Bakhshpoori, T. Improving the prediction of ground motion parameters based on an efficient bagging ensemble model of M5′ and CART algorithms. Appl. Soft Comput. 2018, 68, 147–161. [Google Scholar] [CrossRef]
  70. Dickin, E.A. Uplift Resistance of Buried Pipelines in Sand. Soils Found. 1994, 34, 41–48. [Google Scholar] [CrossRef] [Green Version]
Applsci 11 00908 g001 550
Figure 1. The pullout system for conducting the small-scale peak uplift resistance tests.
Figure 1. The pullout system for conducting the small-scale peak uplift resistance tests.
Applsci 11 00908 g001
Applsci 11 00908 g002 550
Figure 2. Typical layout of uplift resistance test with single layer geo-grid reinforcement.
Figure 2. Typical layout of uplift resistance test with single layer geo-grid reinforcement.
Applsci 11 00908 g002
Applsci 11 00908 g003 550
Figure 3. Typical layout of the uplift resistance test with two-layer geo-grid reinforcement.
Figure 3. Typical layout of the uplift resistance test with two-layer geo-grid reinforcement.
Applsci 11 00908 g003
Applsci 11 00908 g004 550
Figure 4. Structure of MLP-ANN (a) and RBF-ANN (b).
Figure 4. Structure of MLP-ANN (a) and RBF-ANN (b).
Applsci 11 00908 g004
Applsci 11 00908 g005a 550Applsci 11 00908 g005b 550
Figure 5. The effects of burial depth and pipe diameter on the peak uplift resistance of pipes buried in sand. (a) pipe diameter; (b) burial depth.
Figure 5. The effects of burial depth and pipe diameter on the peak uplift resistance of pipes buried in sand. (a) pipe diameter; (b) burial depth.
Applsci 11 00908 g005aApplsci 11 00908 g005b
Applsci 11 00908 g006 550
Figure 6. The effects of geo-grid length and number of layers on the peak uplift resistance of pipes buried in sand.
Figure 6. The effects of geo-grid length and number of layers on the peak uplift resistance of pipes buried in sand.
Applsci 11 00908 g006
Applsci 11 00908 g007a 550Applsci 11 00908 g007b 550
Figure 7. The structures of the standard ANN models based on MLP and RBF approaches to predict the peak uplift resistance values.
Figure 7. The structures of the standard ANN models based on MLP and RBF approaches to predict the peak uplift resistance values.
Applsci 11 00908 g007aApplsci 11 00908 g007b
Applsci 11 00908 g008 550
Figure 8. Predicted peak uplift resistance values of ANNMLP and ANNRBF models.
Figure 8. Predicted peak uplift resistance values of ANNMLP and ANNRBF models.
Applsci 11 00908 g008
Applsci 11 00908 g009 550
Figure 9. Comparison between the ANN models developed in this study and other ML models.
Figure 9. Comparison between the ANN models developed in this study and other ML models.
Applsci 11 00908 g009
Applsci 11 00908 g010 550
Figure 10. Gain charts of standard and ANN-ensemble models.
Figure 10. Gain charts of standard and ANN-ensemble models.
Applsci 11 00908 g010
Table
Table 1. Summary of soft computing techniques for the prediction of the peak uplift resistance of buried pipes.
Table 1. Summary of soft computing techniques for the prediction of the peak uplift resistance of buried pipes.
Author (Year)AimSC TechniqueR or R2
Rahman et al. [14]To forecast the uplift capacity of suction caissons employing an ANN model.ANNVarious R2 are available. Highest train R2 = 0.975
Highest test R2 = 0.996
Pai [45]To predict the uplift capacity of suction caissons using a neuro-genetic network.NGN-
Alavi et al. [46]To obtain an empirical model for evaluating the complicated behavior of suction caissons’ uplift capacity by the hybrid GP-SA technique.GP-SAR2: Train = 0.858; test = 0.759
Alavi et al. [47]To examine the robustness of the conventional tree-based GP and its suitable modifications, i.e., LGP and GEP, for evaluating the complicated behavior of the uplift capacity of suction caissons.Tree-based genetic programming (TGP), linear genetic programming (LGP), and gene expression programming (GEP)TGP R2: train = 0.939; test = 0.976
LGP R2: train = 0.963; test = 0.994
GEP R2: train = 0.953; test = 0.983
Gandomi et al. [48]To assess the complex behavior of the uplift capacity of suction caissons employing a useful variant of GP, namely MEP.Multi expression programming (MEP)-
Samui et al. [49]To determine the uplift capacity of suction caisson in clay adopting the MARS model.MARSR: train = 0.998; test = 0.997
Muduli et al. [50]To forecast the uplift capacity of suction caisson in clay, based on the literature’s measured data.SVM-ANNGP R: test = 0.997
ANN R: test = 0.991
SVM R: test = 0.989
Cheng et al. [51]To predict the uplift capacity of suction caissons using an IFRIM model.IFRIMIFRIM R2: train = 0.996; test: 0.979
El-Abbasy et al. [7]To develop a model that assesses and forecasts the condition of offshore oil and gas pipelines based on numerous factors in addition to corrosion.ANNVarious R2 are available. Highest R2 = 0.995
Choobbasti et al. [13]To develop a model to obtain the minimum liquefaction potential.ANN-particle swarm optimization (PSO)-
Nazari et al. [6]To develop six different ANN models, all with a single hidden layer but with diverse neurons in the hidden layer, to forecast performance of offshore pipelines.ANNVarious R2 are available. Highest R2 = 0.995
Shahr-Babak et al. [52]To develop an uplift capacity prediction model in clay.GMDH-HSR2: train = 0.994; test = 0.996
Derakhshani [53]To develop new generic uplift capacity formulae by means of an AI-based model, a composite of M5 and GP call.Model tree and GPM5-GP-1 R: train = 0.976; test = 0.996
M5-GP-2 R: train = 0.986; test = 0.996
Derakhshani [54]1. To exploit the fuzzy sets of theory and GA optimization to examine the impact of input uncertainties on the uplift capacity estimations made by different available models.
2. To modify the previously proposed “M5-GP”-based models of the uplift capacity estimation for becoming less vulnerable to input uncertainties and more accurate.		Genetic algorithm (GA) and fuzzy set theoryImproved GP R = train = 0.996; test = 0.997
Liu et al. [12]To carry out a parametric study of strain demands of X80 pipelines subjected to fault displacements involving influence parametersANNVarious R are available. Highest R = 0.995
R2: Coefficient of determination; R: Correlation coefficient.
Table
Table 2. Results of laboratory tests to determine the peak uplift resistance of pipes buried in sand.
Table 2. Results of laboratory tests to determine the peak uplift resistance of pipes buried in sand.
Parameter/CategoryUnitRangeAverage
Pipe diameter (D)/Inputmm25–5538.6
Burial depth (H)/Input mm100 and 150134
Geo-grid length/Inputcm0–4022.5
Number of geo-grid layer/Input-0 and 21.00
Peak uplift resistance/Output N36.48–121.3681.17
Table
Table 3. Results of the applied performance criteria and cumulative ranking of each model in predicting peak uplift resistance values.
Table 3. Results of the applied performance criteria and cumulative ranking of each model in predicting peak uplift resistance values.
ModelPartitionRMAEPartition RankingCumulative Ranking
ValueRankValueRank
STANDARDANNMLPTrain0.97744.4594815
Test0.91736.24347
ANNMLP-BOOSTEDTrain0.99960.7761223
Test0.95453.848611
ANNMLP-BAGGEDTrain0.99551.73951021
Test0.96763.969511
STANDARDANNRBFTrain0.93138.2812512
Test0.91846.44537
ANNRBF-BOOSTEDTrain0.89628.186359
Test0.83529.27524
ANNRFB-BAGGEDTrain0.707115.809124
Test0.655114.18512
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Zeng, J.; Asteris, P.G.; Mamou, A.P.; Mohammed, A.S.; Golias, E.A.; Armaghani, D.J.; Faizi, K.; Hasanipanah, M. The Effectiveness of Ensemble-Neural Network Techniques to Predict Peak Uplift Resistance of Buried Pipes in Reinforced Sand. Appl. Sci. 2021, 11, 908. https://doi.org/10.3390/app11030908

AMA Style

Zeng J, Asteris PG, Mamou AP, Mohammed AS, Golias EA, Armaghani DJ, Faizi K, Hasanipanah M. The Effectiveness of Ensemble-Neural Network Techniques to Predict Peak Uplift Resistance of Buried Pipes in Reinforced Sand. Applied Sciences. 2021; 11(3):908. https://doi.org/10.3390/app11030908

Chicago/Turabian Style

Zeng, Jie, Panagiotis G. Asteris, Anna P. Mamou, Ahmed Salih Mohammed, Emmanuil A. Golias, Danial Jahed Armaghani, Koohyar Faizi, and Mahdi Hasanipanah. 2021. "The Effectiveness of Ensemble-Neural Network Techniques to Predict Peak Uplift Resistance of Buried Pipes in Reinforced Sand" Applied Sciences 11, no. 3: 908. https://doi.org/10.3390/app11030908

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop