Next Article in Journal
The Effect of Abamectin on Locusta Migratoria Neurosecretory Cells and Mid Gut, Using Ultrastructure Examination, Oxidative Stress Study, and In-Silico Molecular Docking
Previous Article in Journal
Multi-Target Effect of Aloeresin-A against Bacterial and Host Inflammatory Targets Benefits Contact Lens-Related Keratitis: A Multi-Omics and Quantum Chemical Investigation
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

The Prediction of Cu(II) Adsorption Capacity of Modified Pomelo Peels Using the PSO-ANN Model

1
Hebei Key Laboratory of Green Development of Rock and Mineral Materials, Hebei GEO University, Shijiazhuang 050031, China
2
Materials Science and Nano-Engineering MSN Department, Mohammed VI Polytechnic University, Lot 660-Hay Moulay Rachid, Ben Guerir 43150, Morocco
3
School of Chemistry and Molecular Engineering, East China University of Science and Technology, Shanghai 200237, China
*
Author to whom correspondence should be addressed.
Molecules 2023, 28(19), 6957; https://doi.org/10.3390/molecules28196957
Submission received: 13 September 2023 / Revised: 2 October 2023 / Accepted: 4 October 2023 / Published: 6 October 2023
(This article belongs to the Section Physical Chemistry)

Abstract

:
It is very well known that traditional artificial neural networks (ANNs) are prone to falling into local extremes when optimizing model parameters. Herein, to enhance the prediction performance of Cu(II) adsorption capacity, a particle swarm optimized artificial neural network (PSO-ANN) model was developed. Prior to predicting the Cu(II) adsorption capacity of modified pomelo peels (MPP), experimental data collected by our research group were used to build a consistent database. Then, a PSO-ANN model was established to enhance the model performance by optimizing the ANN’s weights and biases. Finally, the performances of the developed ANN and PSO-ANN models were deeply evaluated. The results of this investigation revealed that the proposed hybrid method did increase both the generalization ability and the accuracy of the predicted data of the Cu(II) adsorption capacity of MPPs when compared to the conventional ANN model. This PSO-ANN model thus offers an alternative methodology for optimizing the adsorption capacity prediction of heavy metals using agricultural waste biosorbents.

Graphical Abstract

1. Introduction

Copper is a toxic metal commonly found in wastewater. Excess copper uptake into the body can lead to hair loss, headache, gastrointestinal dysfunction, and central nervous system diseases [1]. Therefore, the removal of copper ions from industrial effluents is crucial before their discharge into aquatic environments. Agricultural wastes, used as biosorbents, possess several advantages because they are abundant, cheap, and renewable [2]. Pomelo peels, a kind of agricultural waste, present a quite high biosorption potential, as they are primarily composed of cellulose, hemicellulose, lignin, and pectin. These components contain carboxylic groups and phenolic acid moieties, which contribute to metal binding. At present, the use of pomelo peels as biosorbents to remove pollutants is widely discussed in the literature [3,4,5,6]. In addition, the Cu(II) adsorption of chemically modified pomelo peels (MPP) has also been reported by our group in a previous study [7].
Modeling is an indispensable stage for any process that needs to be scaled-up from Lab to Fab, but it could be also viewed as an important engineering approach for the optimization of laboratory pre-screening processes [8]. Nevertheless, biosorption is a complex process, owing to the numerous parameters and different biosorption mechanisms involved. Hence, it is difficult to simulate the results of a batch biosorption process using a single conventional mathematical model. Machine learning involves the use of artificial intelligence to learn from given data and simulate complex systems. Some of the most common ML algorithms are the support vector machine (SVM) model, the random forest (RF) model, fuzzy logic (FL), and the artificial neural network (ANN) model [9]. Among them, the ANN model provides a superior nonlinear ability to learn from a variety of complicated systems. Several studies on the adsorption capacity of heavy metal ions, such as Pb(II), Ni(II), Co(II), Cr(VI), Cu(II), and Zn(II), based on the ANN model have been reported [7,10,11,12,13,14,15,16].
There have been few studies on the optimization of ANNs’ weights and biases using intelligent algorithms. Conventional ANN models are prone to falling into local extremes when solving complex nonlinear problems, and the adsorption capacity of a heavy metal is affected by numerous nonlinear factors. Therefore, the introduction of intelligent algorithms into ANN models can improve their predictive ability. The PSO algorithm is widely utilized to optimize model performance, owing to its higher convergence rate compared to other evolutionary algorithms [17]. The prediction is not too far off from the global optimum, even if the global optimum cannot be truly found. However, hybrid methods have not been utilized in the prediction of the Cu(II) adsorption capacity of MPP, to date.
Herein, a particle swarm optimized artificial neural network (PSO-ANN) model was developed to predict the Cu(II) adsorption capacity of MPP. Because PSO finds the optimal initial weights and biases, PSO-ANN can achieve a higher accuracy than the conventional ANN model. Therefore, a database was initially built, and a sensitivity analysis of the input variables was performed. Then, the ANN and PSO-ANN models were established by using this database. During this stage, the collected datasets were fed into each model for training and testing. Finally, the performances of both models were evaluated, compared, and analyzed statistically to highlight further recommendations.

2. Results and Discussion

The objective of this study was to predict the Cu(II) adsorption capacity of MPP by using ANN and PSO-ANN models. The following subsections provide descriptions of the constructed models and their prediction outcomes.

2.1. Results Predicted from the ANN Model

The number of hidden layer neurons was determined by using a trial-and-error method as equal to 9. As a result, the configuration of the neural network was set as 4-9-1 (Figure 1). The model parameters of the ANN are listed in Table 1.
Table 2 displays the assessment results of the ANN model performance. The R2 values for the training and testing sets were close to 0.99977 and 0.99987, respectively, which were generally satisfactory. The RMSEs of the ANN were 0.0217 for the training set and 0.0159 for the testing set, while the MAE values were close to 0.0140 and 0.0125, respectively. In conclusion, the common ANN model has some generalization potential and can somewhat anticipate unknown data.

2.2. Results Predicted from the PSO-ANN Model

The prediction results of the standard ANN model depend significantly on its weights and biases. Thus, PSO was used to optimize the initial weights and biases of the ANN model training and preliminarily narrow the search space. This allowed the ANN model to reach the global minimum faster in the following iterative training instead of being prone to local minima. For the PSO-ANN model, the particle swarm size, number of iterations, learning factors, particle position constraint, particle velocity constraint, and inertia factor were set. It should be mentioned that the specification of the investigated problem had a significant impact on the particle swarm size [18]. A particle swarm size of 20 was found to be optimal after testing particle swarm sizes from 15 to 30 in intervals of 5. Table 3 displays the parameter settings of the PSO-ANN for this investigation.
The results of the PSO-ANN model performance were also assessed and then compared to those observed when using the ANN model, as reported in Table 2. In the case of the PSO-ANN, the R2 values for the training and testing sets were 0.99998 and 0.99999, respectively. The RMSEs were 0.0081 for the training set and 0.0077 for the testing set. The MAE for the training set was 0.0067, whereas it was 0.0066 for the testing set.
The R2 values of the training and testing sets for the PSO-ANN model were higher than those for the standard ANN model (Table 2). In comparison to the conventional ANN model, the RMSE and MAE values of the training and testing sets for the PSO-ANN were lower by varying degrees. Therefore, the PSO algorithm introduced into the ANN model increased the accuracy of the predicted values.

2.3. Discussion

The weight–bias matrices for the ANN and PSO-ANN are provided in Appendix A. In this study, a neural network optimized using the particle swarm algorithm was developed to predict the ability of MPP to adsorb Cu(II). The results for both models are listed in Table 2 in the preceding subsections and discussed further below.
A regression analysis of the ANN and PSO-ANN is provided in Figure 2. The majority of the data points are spread on both sides of the fitted lines, demonstrating the good ability of both models to fit the data (Figure 2). PSO-ANN achieved a higher R2, indicating its better fitting ability compared to the classical ANN approach. This is also reflected in other indicator values such as the RMSE, MSE, and MAE (Table 2). The RMSE values of the PSO-ANN (0.0081, 0.0077, and 0.0080) were significantly lower than those of the ANN (0.0217, 0.0159, and 0.0207) for the training, testing, and all data, respectively. In addition, the PSO-ANN had a lower MAE value for each phase. Therefore, the introduction of PSO into the ANN model improved its prediction accuracy, as the testing data were not included in the model training. As shown in Figure 3, the errors between the predicted and actual values based on the ANN model were larger than those based on the PSO-ANN. This indicates that the predicted values using the PSO-ANN were closer to the actual values than those using the ANN, leading to the same conclusion. Figure 4 displays the gradient change in the iterative training for the ANN and PSO-ANN. It can be seen from this figure that the gradients of the PSO-ANN and ANN both decrease sharply in the first 30 epochs. Then, these gradients decrease much slower prior to becoming stable after 30 epochs. As shown in Figure 4, the decline curve of the PSO-ANN is smoother and converges to a higher accuracy than that observed with the ANN model. In fact, some fluctuations on the gradient curve of the ANN model are observed during its training process. In addition, the training of the ANN stops at 349 epochs, even if there is still a certain distance from the ideal error value, indicating that there is a local optimal solution problem using this approach.
Based on the PSO-ANN weight matrix, the Garson equation [19] was then adopted to evaluate the relative importance of the input variables. Figure 5 depicts the relative importance of the input variables derived using the Garson equation. For this analysis, one can see that the initial Cu(II) concentration was the most influential input variable, followed by the temperature. Such a conclusion is consistent with the results obtained by the CAM, and further verifies the validity of the calculated connection weights of the developed PSO-ANN model. Furthermore, based on this analysis, the initial pH was found to have the lowest influence on the Cu(II) adsorption capacity, while, within the CAM, it was observed that the adsorption time had the smallest impact. However, the relative importance of the adsorption time (23.9%) was close to that of the initial pH (20.3%), which is consistent with the similar values of Si calculated by the CAM for the adsorption time (0.9439) and the initial pH (0.9626).
In brief, the introduction of PSO into the ANN was productive and successful. By virtue of its optimization capabilities, the particle swarm algorithm enhanced the ANN’s weights and biases, increasing the model accuracy and decreasing the prediction errors. Additionally, the adaptive treatment of the inertia factor efficiently improved the PSO algorithm to achieve a more comprehensive optimization search to converge more quickly to the global optimum. AI hybrid models can integrate and combine the advantages of both selected single models, thus leading to a better accuracy and predictive capability.
To further validate the reliability of the proposed model, comparisons with other hybrid methods based on neural networks were made. Table 4 displays the performances of other ANN-based hybrid methods, demonstrating the superiority of the PSO-ANN approach. Hence, the proposed hybrid PSO-ANN model was validated for predicting the Cu(II) adsorption capacity of MPP. However, it was undeniable that the PSO-ANN took a bit more time to reach the optimal prediction, when compared to the time requested to run the single ANN model. This main drawback could be also optimized by reducing the training time of the PSO-ANN model, which is one of our objectives for future work on designing proper applications based on the optimized prediction of heavy metal absorption using AI hybrid models.

3. Materials and Methods

3.1. Database Description and Variable Analysis

A trustworthy database is necessary for successfully training machine learning models. Otherwise, the training results cannot reflect the actual situation, which ultimately leads to model training failure. The procedures were proposed herein to build a database compiling the Cu(II) adsorption capacities using MPP as a proof of concept.
A sufficient database not only consists of a large amount of data, but also requests a comprehensive range of input and output variables. In this study, experimental data were collected from our previously reported work [7] to create such a database. The Cu(II) adsorption capacity of MPP is influenced by numerous experimental factors, such as the temperature, initial pH, adsorption time, and initial Cu(II) concentration. Therefore, different experimental factors should be identified to increase the capability of the network learning when collecting the adsorbed data. In total, a database composed of 100 experimental datasets was established in this study. These data were split into training (80) and testing (20) datasets. The database consisted of four input variables (i.e., temperature, initial pH, initial Cu(II) concentration, and adsorption time), while the output variable was the Cu(II) adsorption capacity of the MPP. A statistical analysis of the input and output variables of the database is provided in Table 5.
Notably, the interdependency between the input variables hinders the model’s performance due to multicollinearity [25,26]. Hence, the Pearson correlation coefficient (r) was used to perform a redundancy analysis for the input variables and is expressed as follows [27]:
r = k = 1 n ( x a k x a ¯ ) ( x b k x b ¯ ) k = 1 n ( x a k x a ¯ ) 2 k = 1 n ( x b k x b ¯ ) 2
where n indicates the number of data; xa and xb are the input variables; and x a ¯ and x b ¯ are the mean values of the variables. Thus, r is between −1 and 1; the larger its absolute value, the stronger the linear correlation between the input variables. If 0.9 ≤ r ≤ 1, the information redundancy between the two variables is high; only one variable is retained, and the other is deleted.
Figure 6 displays the heat map of the Pearson correlation coefficients for the input variables. The absolute values of r between the input variables were all less than 0.2, reflecting the impact of diminishing multiple collinearities.

3.2. Sensitivity Factor Analysis of Input Variables

A sensitivity factor analysis is an important method used to calculate the effect of the input variables on the output variable. Herein, the cosine amplitude method (CAM) was employed [28]. The sensitivity of each input variable can be expressed by:
S i = k = 1 n x i k y k k = 1 n x i k 2 k = 1 n y k 2
where xi is the input variable, y is the output variable, and Si is the degree of influence of each input variable on the output variable. The values of Si between the input variables and the Cu(II) adsorption capacity are shown in Figure 7. The most significant influence on the Cu(II) adsorption capacity was the initial Cu(II) concentration, followed by the temperature, while the adsorption time had the lowest impact.

3.3. Methods

ANN models have been utilized widely because of their superior nonlinear capability, while PSO is a computationally straightforward and heuristic swarm intelligent algorithm. The ANN, PSO, and PSO-ANN model developed in this work are described progressively.

3.3.1. ANN

Among the various machine learning techniques, ANNs are utilized widely for predicting the adsorption capacity of heavy metals. An ANN can be viewed as a data-processing tool or black box that produces the appropriate output based on the given inputs [7]. A back-propagation network, as the most popular network structure, continuously updates the weights and biases to decrease the errors to an acceptable level [29]. The input layer, hidden layer, and output layer making up the back-propagation neural network have weights, biases, and activation functions. The topological structure of the back-propagation neural network is detailed in Figure 8, where xi denotes the input variables, w i j represents the weight, and b denotes the bias.
The expressions for d and the neural network output y are shown in Equations (3) and (4) [30].
d = w i j x i + b
y = f ( d )
The function of bias is to modify the influence of the activation function. The activation function, abbreviated as f, enables the neural network to approximate any nonlinear function and is thus applicable to various nonlinear problems. The most widely used activation functions for neural networks are Sigmoid, SoftPlus, tanH, exponential linear unit (ELU), and rectified linear unit (ReLU) [31].
The weights and biases of the ANN model can be adjusted based on the back-propagation errors, as expressed [30]:
w ( t + 1 ) = w ( t ) α E ( t ) w ( t )
b ( t + 1 ) = b ( t ) α E ( t ) b ( t )
where α is the learning rate, t is the t-th iteration, and E is the network output error, calculated as expressed [30]:
E ( t ) = 1 n i = 1 n e i 2
where ei indicates the difference between the actual value and the predicted value, while E ( t ) w ( t ) and E ( t ) b ( t ) indicate the gradients of the output errors for each weight and bias, respectively.
The number of hidden layer neurons is an important parameter of ANNs. The trial-and-error method was used to determine the optimal number of neurons, as reported in our previous work [7]. To unify the magnitudes and improve the speed and accuracy of the model training, the training and testing datasets were normalized. The specific expression for data normalization is described in our previous work [7].
The adaptive learning rate gradient descent, gradient descent, momentum gradient descent, conjugate gradient, and Levenberg–Marquardt (LM) algorithms are often-employed algorithms in the training of ANNs [32]. The selection of an algorithm depends on the situation. As a popular and classic algorithm with a quick convergence and good precision, the LM algorithm was thus selected for this study.

3.3.2. PSO

PSO is an iterative algorithm based on the swarm evolutionary algorithm [33]. The searching process of each particle is simulated in a manner similar to the optimal route of a bird finding food. Therefore, each particle represents a potential solution to a problem. The velocity and position, as the only two properties of each particle, are continuously adjusted by iterations, until an optimal solution is found [34].
Initializing a swarm of random particles is the first step of the PSO algorithm. Assuming that N particles make up the population in an l-dimensional searching space, the position (Xm) and velocity (Vm) of the m-th particle are expressed as two l-dimensional vectors.
X m = ( x m 1 , x m 2 , x m 3 x m l )     m = 1 , 2 , , N
V m = ( v m 1 , v m 2 , v m 3 v m l )     m = 1 , 2 , , N
The optimal position of the m-th particle is the individual extreme:
P b e s t = ( p m 1 , p m 2 , p m 3 p m l )     m = 1 , 2 , , N
The optimal position of the whole population is the global extreme:
G b e s t = ( p g 1 , p g 2 , p g 3 p g l )
When searching for the individual and global extremes, the particle updates its position and velocity as follows:
v m l t = ω v m l t 1 + c 1 r 1 ( p m l x m l t 1 ) + c 2 r 2 ( p g l x m l t 1 )
x m l t = v m l t + x m l t 1
where r1 and r2 are randomly selected from the range from 0 to 1 to increase the random searchability. The individual learning factor, c1, signifies the ability of a particle to search for the best option. The global learning factor, c2, represents the searchability of the group for the best solution. The default value for the learning factors c1 and c2 is 2. The particle is thought to have only one global learning capability if c1 = 0; at this point, the particle is capable of extended search, but not local search, and converges slowly for difficult issues. The particle is thought to possess only one cognitive capacity if c2 = 0; at this point, it behaves like a blind random search and is more likely to run into the local optimal solution problem [35].
The inertia factor ω indicates the ability of a particle to continue the previous velocity, which is a fixed value in the conventional PSO algorithm [27]. Its numerical value is positively related to the global search, and inversely related to the local search [36]. Therefore, the global and local search speeds of the PSO algorithm can be enhanced by adjusting the inertia factor. Herein, the linear decreasing inertia factor was adopted to balance the global and local search capabilities of the PSO [37]. This pattern of increasing iterations and decreasing inertia factors ensures both a stronger initial search capability and, subsequentially, a more accurate local search. The specific expression is as follows:
ω = ω max t × ( ω max ω min ) t max
where ω max ∈ [0, 1] and ω min ∈ [0, 1] are the maximum and minimum inertia factors, while t and tmax are the current and maximum number of iterations, respectively.

3.3.3. PSO-ANN

A flow chart of the PSO-ANN is detailed in Figure 9. The procedure for the prediction of the Cu(II) adsorption capacity of MPP based on the PSO-ANN is as follows:
(1)
Data Normalization. The training and testing sets were constructed after reading the sample data.
(2)
Setting the Model Parameters. The maximum number of iterations, neuron numbers of each layer, functions, and termination criteria for the ANN topology were set in accordance with the features of the input data.
(3)
Optimization of Weights and Biases. The parameters of the PSO were set. The initial weights and biases of the ANN training model were then optimized using the particle swarm algorithm.
(4)
Establishment of the PSO-ANN model. The optimized weights and biases obtained from the position information of the optimal particle were assigned to the ANN as the initial values for the following training. The testing dataset was applied to verify the well-trained hybrid ANN and output the prediction result.
Figure 9. Framework of PSO-ANN.
Figure 9. Framework of PSO-ANN.
Molecules 28 06957 g009

3.4. Model Performance

In the current study, the mean square error (MSE), root mean square error (RMSE), mean absolute error (MAE), and coefficient of determination (R2) were the statistical metrics utilized to assess the performances of the neural network models. R2 is widely used to assess model reliability, while the RMSE and MAE reflect the degree of model deviation. These evaluation indicators can be calculated as expressed [38,39]:
R 2 = k = 1 n ( y 0 , k y 0 ¯ ) ( y k y ¯ ) k = 1 n ( y 0 , k y 0 ¯ ) 2 k = 1 n ( y k y ¯ ) 2
M A E = k = 1 n y 0 , k y k n
M S E = 1 n k = 1 n ( y 0 , k y k ) 2
R M S E = 1 n k = 1 n ( y 0 , k y k ) 2
where n is the total number of sample data, y is the output value, y ¯ is the average output value, y 0 is the actual value, and y 0 ¯ is the average actual value.

4. Conclusions

For this study, a PSO-ANN model was proposed to forecast the potential of MPP to adsorb Cu(II). Prior to the model training, a trustworthy database was established. The Pearson correlation coefficient was used to check the redundancy between the input variables. The sensitivity of each input variable on the output variable was calculated using the CAM. A traditional ANN was also established for a comparative analysis. The R2, MSE, RMSE, and MAE were utilized as assessment indices for describing the overall model performance. According to the training, testing, and combined data results, both the ANN and PSO-ANN demonstrated good predictive abilities, but the proposed PSO-ANN exhibited a greater prediction accuracy. Moreover, the predicted values of the PSO-ANN were closer to the actual values when comparing the model errors. This meant that the PSO effectively compensated for defects in the ANN. In conclusion, this study effectively demonstrated the enhanced validity and accuracy of the PSO-ANN in comparison to the ANN. The PSO-ANN hybrid algorithm integrated and combined the benefits of both single models used. There is great potential for the PSO-ANN to be applied for predicting the adsorption capacity of heavy metals by agricultural waste biosorbents.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/molecules28196957/s1, Table S1: Training data used for developing the ANN model during this work; Table S2: Testing data used for validation of the ANN model during this work.

Author Contributions

Conceptualization, N.Z. and H.L.; methodology, M.J. and R.Z.; software, M.J.; validation, M.J. and J.J.; formal analysis, J.J.; investigation, R.Z.; resources, N.Z.; data curation, R.Z.; writing—original draft preparation, N.Z.; writing—review and editing, J.J. and H.L.; visualization, R.Z.; supervision, N.Z.; project administration, N.Z.; funding acquisition, N.Z. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by Hebei Key Laboratory of Green Development of Rock and Mineral Materials (SZX2022003) and Hebei Center for Ecological and Environmental Geology Research (JSYF-202205).

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Data are contained within the article or the Supplementary Materials.

Conflicts of Interest

The authors declare no conflict of interest.

Appendix A

ANN:
w 1 = 0.3896 1.5177 1.2984 1.0740 2.1037 0.2933 0.1735 1.0195 0.3197 0.3678 2.0670 0.8608 0.2438 0.8786 1.5982 0.2273 0.7020 1.6717 1.5717 0.3106 1.6084 1.4682 1.5073 0.1552 0.7234 1.0571 1.7391 1.5484 0.8311 0.5281 2.0683 0.7013 0.7838 0.0696 0.4133 2.3563
w 2 = 0.1492 0.7608 0.3058 0.6069 0.0253 0.1561 0.4942 0.0460 0.1583
b 1 = 2.6569 2.2113 1.2768 0.8323 0.1785 0.4026 1.4495 1.7645 1.7248 T
b 2 = 0.8608 T
PSO-ANN:
w 1 = 1.1578 1.7366 1.7765 1.5835 2.5136 1.0985 0.9853 0.0550 0.1963 0.5870 1.6092 1.2955 2.6981 1.2580 1.1686 0.1620 0.1417 1.6898 1.0692 1.5728 2.0867 0.9284 1.6910 1.4370 0.4781 0.9032 1.1009 0.2672 0.4193 1.1676 1.3998 0.4114 3.7245 4.8049 0.8998 2.5805
w 2 = 1.8424 6762 1.2918 0.4834 2.1270 1.1607 0.6829 0.3158 0.0045
b 1 = 1.8439 0.8176 1.6900 2.577 0.7387 2.0178 1.3684 2.5751 2.5634 T
b 2 = 0.8466 T

References

  1. Damodaran, D.; Shetty, K.V.; Mohan, B.R. Effect of chelaters on bioaccumulation of Cd(II), Cu(II), Cr(VI), Pb(II) and Zn(II) in Galerina vittiformis from soil. Int. Biodeterior. Biodegrad. 2013, 85, 182–188. [Google Scholar] [CrossRef]
  2. Çoruh, S.; Geyikçi, F.; Kılıç, E.; Çoruh, U. The use of NARX neural network for modeling of adsorption of zinc ions using activated almond shell as a potential biosorbent. Bioresour. Technol. 2014, 151, 406–410. [Google Scholar] [CrossRef] [PubMed]
  3. Chen, D.Z.; Xie, S.S.; Chen, C.Q.; Quan, H.Y.; Hua, L.; Luo, X.B.; Guo, L. Activated biochar derived from pomelo peel as a high-capacity sorbent for removal of carbamazepine from aqueous solution. RSC Adv. 2017, 7, 54969–54979. [Google Scholar] [CrossRef]
  4. Cheng, D.; Ngo, H.H.; Guo, W.S.; Chang, S.W.; Nguyen, D.D.; Zhang, X.B.; Varjani, S.; Liu, Y. Feasibility study on a new pomelo peel derived biochar for tetracycline antibiotics removal in swine wastewater. Sci. Total Environ. 2020, 720, 137662. [Google Scholar] [CrossRef]
  5. Dinh, V.P.; Huynh, T.D.T.; Le, H.M.; Nguyen, V.D.; Dao, V.A.; Hung, N.Q.; Tuyen, L.A.; Lee, S.; Yi, J.; Nguyen, T.D.; et al. Insight into the adsorption mechanisms of methylene blue and chromium(iii) from aqueous solution onto pomelo fruit peel. RSC Adv. 2019, 9, 25847–25860. [Google Scholar] [CrossRef]
  6. Dinh, V.P.; Xuan, D.T.; Hung, N.Q.; Luu, T.T.; Do, T.T.T.; Nguyen, T.D.; Nguyen, V.D.; Anh, T.T.K.; Tran, N.Q. Primary biosorption mechanism of lead(II) and cadmium(II) cations from aqueous solution by pomelo (Citrus maxima) fruit peels. Environ. Sci. Pollut. Res. 2021, 28, 63504–63515. [Google Scholar] [CrossRef]
  7. Zhang, R.X.; Jiao, M.Q.; Zhao, N.; Jacquemin, J.; Zhang, Y.Q.; Liu, H.L. Assessment of Cu(II) removal from aqueous solutions by modified pomelo peels: Experiments and modelling. Molecules 2023, 28, 3438. [Google Scholar] [CrossRef]
  8. Du, J.; Shang, X.; Shi, J.; Guan, Y. Removal of chromium from industrial wastewater by magnetic flocculation treatment: Experimental studies and PSO-BP modelling. J. Water Process Eng. 2022, 47, 102822. [Google Scholar] [CrossRef]
  9. Marsland, S. Machine Learning: An Algorithmic Perspective; CRC Press: Boca Raton, FL, USA, 2015. [Google Scholar]
  10. Sarkar, B.; Sharma, U.; Adhikari, K.; Lahiri, S.K.; Baltrėnaitė, E.; Baltrėnas, P.; Dutta, S. Application of artificial neural network and particle swarm optimization for modelling and optimization of biosorption of lead(II) and nickel(II) from wastewater using dead cyanobacterial biomass. J. Indian Chem. Soc. 2021, 98, 100039. [Google Scholar] [CrossRef]
  11. Ma, X.M.; Guan, Y.L.; Mao, R.; Zheng, S.; Wei, Q. Modeling of lead removal by living Scenedesmus obliquus using backpropagation (BP) neural network algorithm. Environ. Technol. Innov. 2021, 22, 101410. [Google Scholar] [CrossRef]
  12. Faisal, A.A.H.; Nassir, Z.S.; Naji, L.A.; Naushad, M.; Ahamad, T. A sustainable approach to utilize olive pips for the sorption of lead ions: Numerial modeling with aid of artificial neural network. Sustain. Chem. Pharm. 2020, 15, 100220. [Google Scholar] [CrossRef]
  13. Moradi, P.; Hayati, S.; Ghahrizadeh, T. Modeling and optimization of lead and cobalt biosorption from water with rafsanjan pistachio shell, using experiment based models of ANN and GP, and the grey wolf optimizer. Chemom. Intell. Lab. Syst. 2020, 202, 104041. [Google Scholar] [CrossRef]
  14. Mohammadi, F.; Yavari, Z.; Rahimi, S.; Hashemi, M. Artificial neural network modeling of Cr(VI) biosorption from aqueous solutions. J. Water Chem. Technol. 2019, 41, 219–227. [Google Scholar] [CrossRef]
  15. Shandi, S.G.; Ardejani, F.D.; Sharifi, F. Assessment of Cu(II) removal from an aqueous solution by raw gundelia tournefortii as a new low-cost biosorbent: Experiments and modelling. Chin. J. Chem. Eng. 2019, 27, 1945–1955. [Google Scholar] [CrossRef]
  16. Yildiz, S. Artificial neural network (ANN) approach for modeling Zn(II) adsorption in batch process. Korean J. Chem. Eng. 2017, 34, 2423–2434. [Google Scholar] [CrossRef]
  17. Pant, P.; Chatterjee, D. Prediction of clad characteristics using ANN and combined PSO-ANN algorithms in laser metal deposition process. Surf. Interfaces 2020, 21, 100699. [Google Scholar] [CrossRef]
  18. Lan, Q.; Wang, X.C.; Sun, J.W.; Chang, Z.Y.; Deng, Q.C.; Sun, Q.C.; Liu, Z.H.; Yuan, L.Y.; Wang, J.C.; Wu, Y.J.; et al. Artificial neural network approach for mechanical properties prediction of as-cast A380 aluminum alloy. Mater. Today Commun. 2022, 31, 103301. [Google Scholar] [CrossRef]
  19. Garson, G.D. Interpreting neural-network connection weights. AI Expert 1991, 6, 46–51. [Google Scholar]
  20. Zheng, X.; Nguyen, H. A novel artificial intelligent model for predicting water treatment efficiency of various biochar systems based on artificial neural network and queuing search algorithm. Chemosphere 2022, 287, 132251. [Google Scholar] [CrossRef] [PubMed]
  21. Ke, B.; Nguyen, H.; Bui, X.N.; Bui, H.B.; Choi, Y.; Zhou, J.; Moayedi, H.; Costache, R.; Nguyen-Trang, T. Predicting the sorption efficiency of heavy metal based on the biochar characteristics, metal sources, and environmental conditions using various novel hybrid machine learning models. Chemosphere 2021, 276, 130204. [Google Scholar] [CrossRef]
  22. Bhagat, S.K.; Pyrgaki, K.; Salih, S.Q.; Tiyasha, T.; Beyaztas, U.; Shahid, S.; Yaseen, Z.M. Prediction of copper ions adsorption by attapulgite adsorbent using tuned-artificial intelligence model. Chemosphere 2021, 276, 130162. [Google Scholar] [CrossRef] [PubMed]
  23. Pooladi, M.A.; Jafari, D.; Esfandyari, M. Experimental and theoretical investigation of lead ion adsorption from the synthetic wastewater using the biosorbent derived from Cardita bicolor shell. Biomass Convers. Biorefin. 2023. [CrossRef]
  24. Zafar, M.; Aggarwal, A.; Rene, E.R.; Barbusiński, K.; Mahanty, B.; Behera, S.K. Data-driven machine learning intelligent tools for predicting chromium removal in an adsorption system. Processes 2022, 10, 447. [Google Scholar] [CrossRef]
  25. Azim, I.; Yang, J.; Javed, M.F.; Iqbal, M.F.; Mahmood, Z.; Wang, F.; Liu, Q.F. Prediction model for compressive arch action capacity of RC frame structures under column removal scenario using gene expression programming. Structures 2020, 25, 212–228. [Google Scholar] [CrossRef]
  26. Dunlop, P.; Smith, S. Estimation key characteristics of the concrete delivery and placement process using linear regression analysis. Civ. Eng. Environ. Syst. 2003, 20, 273–290. [Google Scholar] [CrossRef]
  27. Li, X.; Liu, X.J.; Li, H.Y.; Liu, R.; Zhang, Z.F.; Li, H.W.; Lyu, Q.; Chen, S.J. Prediction of SO2 and NOx in sintering flue gas based on PSO-BP neural network model. Ironmak. Steelmak. 2023, 1–8. [Google Scholar] [CrossRef]
  28. Armaghani, D.J.; Hajihassani, M.; Sohaei, H.; Mohamad, E.T.; Marto, A.; Motaghedi, H.; Moghaddam, M.R. Neuro-fuzzy technique to predict air-overpressure induced by blasting. Arab. J. Geosci. 2015, 8, 10937–10950. [Google Scholar] [CrossRef]
  29. Duan, Z.H.; Kou, S.C.; Poon, C.S. Prediction of compressive strength of recycled aggregate concrete using artificial neural networks. Constr. Build. Mater. 2013, 40, 1200–1206. [Google Scholar] [CrossRef]
  30. Dahou, Z.; Sbarta, Z.M.; Castel, A.; Ghomari, F. Artificial neural network model for steel-concrete bond prediction. Eng. Struct. 2009, 31, 1724–1733. [Google Scholar] [CrossRef]
  31. Chasiotis, V.K.; Tzempelikos, D.A.; Filios, A.E.; Moustris, K.P. Artificial neural network modelling of moisture content evolution for convective drying of cylindrical quince slices. Comput. Electron. Agric. 2020, 172, 105074. [Google Scholar] [CrossRef]
  32. Liu, Q.F.; Iqbal, M.F.; Yang, J.; Lu, X.Y.; Zhang, P.; Rauf, M. Prediction of chloride diffusivity in concrete using artificial neural network: Modelling and performance evaluation. Constr. Build. Mater. 2021, 268, 121082. [Google Scholar] [CrossRef]
  33. Huang, C.L.; Dun, J.F. A distributed PSO-SVM hybrid system with feature selection and parameter optimization. Appl. Soft Comput. 2008, 8, 1381–1391. [Google Scholar] [CrossRef]
  34. Ghorbani, N.; Kasaeian, A.; Toopshekan, A.; Bahrami, L.; Maghami, A. Optimizing a hybrid wind-PV-battery system using GA-PSO and MOPSO for reducing cost and increasing reliability. Energy 2018, 154, 581–591. [Google Scholar] [CrossRef]
  35. Huang, X.Y.; Wu, K.Y.; Wang, S.; Lu, T.; Lu, Y.F.; Deng, W.C.; Li, H.M. Compressive strength prediction of rubber concrete based on artificial neural network model with hybrid particle swarm optimization algorithm. Materials 2022, 15, 3934. [Google Scholar] [CrossRef] [PubMed]
  36. Ge, H.W.; Qian, F.; Liang, Y.C.; Du, W.L.; Wang, L. Identification and control of nonlinear systems by a dissimilation particle swarm optimization-based Elman neural network. Nonlinear Anal. Real World Appl. 2008, 9, 1345–1360. [Google Scholar] [CrossRef]
  37. Choudhary, S.; Sugumaran, S.; Belazi, A.; Abd El-Latif, A.A. Linearly decreasing inertia weight PSO and improved weight factor-based clustering algorithm for wireless sensor networks. J. Ambient Intell. Humaniz. Comput. 2021, 14, 6661–6679. [Google Scholar] [CrossRef]
  38. Ly, H.B.; Le, L.M.; Phi, L.V.; Phan, V.H.; Tran, V.Q.; Pham, B.T.; Le, T.T.; Derrible, S. Development of an AI model to measure traffic air pollution from multisensor and weather data. Sensors 2019, 19, 4941. [Google Scholar] [CrossRef]
  39. Pham, B.T.; Jaafari, A.; Prakash, I.; Bui, D.T. A novel hybrid intelligent model of support vector machines and the MultiBoost ensemble of landslide susceptibility modeling. Bull. Eng. Geol. Environ. 2019, 78, 2865–2886. [Google Scholar] [CrossRef]
Figure 1. ANN topological structure developed in this study.
Figure 1. ANN topological structure developed in this study.
Molecules 28 06957 g001
Figure 2. Regression analysis of (a,c,e) ANN and (b,d,f) PSO-ANN for training data, testing data, and all data, respectively.
Figure 2. Regression analysis of (a,c,e) ANN and (b,d,f) PSO-ANN for training data, testing data, and all data, respectively.
Molecules 28 06957 g002
Figure 3. Predicted errors of training (right) and testing (left) data from the actual values.
Figure 3. Predicted errors of training (right) and testing (left) data from the actual values.
Molecules 28 06957 g003
Figure 4. Gradient changes observed for tested models during each iterative training.
Figure 4. Gradient changes observed for tested models during each iterative training.
Molecules 28 06957 g004
Figure 5. Relative importance of input variables based on the PSO-ANN weight matrix.
Figure 5. Relative importance of input variables based on the PSO-ANN weight matrix.
Molecules 28 06957 g005
Figure 6. Heat map of the Pearson correlation.
Figure 6. Heat map of the Pearson correlation.
Molecules 28 06957 g006
Figure 7. Sensitivity factors of input variables.
Figure 7. Sensitivity factors of input variables.
Molecules 28 06957 g007
Figure 8. Structure of the back-propagation neural network.
Figure 8. Structure of the back-propagation neural network.
Molecules 28 06957 g008
Table 1. Model parameters of the ANN.
Table 1. Model parameters of the ANN.
ParameterSetting
Input layer node4
Hidden layer node9
Output layer node1
Activation functiontansig, purelin
Training functiontrainlm
Epochs1000
Learning rate0.01
Precision1 × 10−5
Epochs between display25
Momentum factor0.01
Minimum performance gradient1.00 × 10−6
Maximum validation failure6
Table 2. Performance evaluation of ANN and PSO-ANN.
Table 2. Performance evaluation of ANN and PSO-ANN.
ANNPSO-ANN
R2Training0.999770.99998
Testing0.999870.99999
MSETraining0.00050.0001
Testing0.00030.0001
RMSETraining0.02170.0081
Testing0.01590.0077
MAETraining0.01400.0067
Testing0.01250.0066
Table 3. Model parameters of PSO-ANN.
Table 3. Model parameters of PSO-ANN.
ParameterSetting
Particle swarm size20
Maximum iterations60
c12
c12
ωmax0.90
ωmin0.40
Position constraint[−5, 5]
Velocity constraint[−1, 1]
Table 4. Comparison with other ANN-based hybrid models.
Table 4. Comparison with other ANN-based hybrid models.
ReferenceModelRemoval IonsDatasetPerformance
TrainingTesting
This studyPSO-ANNCu(II)100R2 = 0.99998
RMSE = 0.0081
MAE = 0.0067
R2 = 0.99999
RMSE = 0.0077
MAE = 0.0066
Zheng et al. [20]QSA-ANNCu(II), Pb(II), Zn(II), As(III), Cd(II), and Ni(II)353R2 = 0.978
RMSE = 0.051
R2 = 0.960
RMSE = 0.074
Ke et al. [21]SVM-ANNCu(II), Pb(II), Zn(II), As(III), Cd(II), and Ni(II)353R2 = 0.995
RMSE = 0.036
MAE = 0.018
R2 = 0.987
RMSE = 0.046
MAE = 0.026
Bhagat et al. [22]ANN-M5Cu(II)95R2 = 0.9983
RMSE = 1.3799
MAE = 1.0338
R2 = 0.9974
RMSE = 0.9283
MAE = 0.6200
Pooladi et al. [23]GMDH-ANNPb(II)Not reportedR2 = 0.94
RMSE = 3.5524
MAE = 2.6958
R2 = 0.9315
RMSE = 5.3083
MAE = 4.041
Zafar et al. [24]ANFISCr(VI)18R2 = 0.99
RMSE = 0.63
R2 = 0.94
RMSE = 6.23
Table 5. Statistical analysis of each variable.
Table 5. Statistical analysis of each variable.
MaxMinAverageMedianStandard DeviationSkewness
Temperature (K)313.15288.15298.80298.153.981.33
Initial pH7.002.004.875.000.80−1.33
Adsorption time (min)60.0010.0053.5060.0013.37−1.99
Initial Cu(II) concentration (mg/L)28.004.0019.0020.004.00−1.95
Cu(II) adsorption capacity (mg/g)6.69940.77264.42364.68650.9820−1.8389
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Jiao, M.; Jacquemin, J.; Zhang, R.; Zhao, N.; Liu, H. The Prediction of Cu(II) Adsorption Capacity of Modified Pomelo Peels Using the PSO-ANN Model. Molecules 2023, 28, 6957. https://doi.org/10.3390/molecules28196957

AMA Style

Jiao M, Jacquemin J, Zhang R, Zhao N, Liu H. The Prediction of Cu(II) Adsorption Capacity of Modified Pomelo Peels Using the PSO-ANN Model. Molecules. 2023; 28(19):6957. https://doi.org/10.3390/molecules28196957

Chicago/Turabian Style

Jiao, Mengqing, Johan Jacquemin, Ruixue Zhang, Nan Zhao, and Honglai Liu. 2023. "The Prediction of Cu(II) Adsorption Capacity of Modified Pomelo Peels Using the PSO-ANN Model" Molecules 28, no. 19: 6957. https://doi.org/10.3390/molecules28196957

Article Metrics

Back to TopTop