Next Article in Journal
Mathematical Modeling of the Drug Particles Deposition in the Human Respiratory System—Part 1: Development of Virtual Models of the Upper and Lower Respiratory Tract
Previous Article in Journal
Candlestick Pattern Recognition in Cryptocurrency Price Time-Series Data Using Rule-Based Data Analysis Methods
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Comparative Analysis of Machine Learning Models for Predicting Viscosity in Tri-n-Butyl Phosphate Mixtures Using Experimental Data

1
Department of Physics and Applied Physics, University of Massachusetts, Lowell, MA 01854, USA
2
Department of Biomedical Engineering, University of Massachusetts, Amherst, MA 01003, USA
3
Department of Ophthalmology, Harvard Medical School, Harvard University, Boston, MA 02138, USA
*
Author to whom correspondence should be addressed.
Computation 2024, 12(7), 133; https://doi.org/10.3390/computation12070133
Submission received: 10 June 2024 / Revised: 21 June 2024 / Accepted: 28 June 2024 / Published: 30 June 2024
(This article belongs to the Section Computational Engineering)

Abstract

:
Tri-n-butyl phosphate (TBP) is essential in the chemical industry for dissolving and purifying various inorganic acids and metals, especially in hydrometallurgical processes. Recent advancements suggest that machine learning can significantly improve the prediction of TBP mixture viscosities, saving time and resources while minimizing exposure to toxic solvents. This study evaluates the effectiveness of five machine learning algorithms for automating TBP mixture viscosity prediction. Using 511 measurements collected across different compositions and temperatures, the neural network (NN) model proved to be the most accurate, achieving a Mean Squared Error (MSE) of 0.157% and an adjusted R2 (a measure of how well the model predicts the variability of the outcome) of 99.72%. The NN model was particularly effective in predicting the viscosity of TBP + ethylbenzene mixtures, with a minimal deviation margin of 0.049%. These results highlight the transformative potential of machine learning to enhance the efficiency and precision of hydrometallurgical processes involving TBP mixtures, while also reducing operational risks.

1. Introduction

The reduction in both the volume and radioactivity of high-level wastes prior to disposal, coupled with the recovery of unused uranium and plutonium, has been extensively researched. The initial breakthrough in solvent extraction for obtaining pure uranium and plutonium was achieved through the development of the PUREX process (Plutonium and Uranium Recovery by Extraction) [1]. Tri-n-butyl phosphate (TBP) is a crucial extractant for uranium, plutonium, zirconium, and other metals in liquid–liquid extraction processes used in the atomic energy, hydrometallurgical, and chemical industries. In solvent extractions, TBP is combined with either a polar or nonpolar diluent. This combination modifies the density, facilitating phase separation, and reduces viscosity, thereby enhancing flow and kinetic properties [1,2,3,4,5,6,7,8]. Thus, TBP and its complexes with organic solutes are viscous and possess densities that are relatively close to that of the aqueous phase in typical liquid–liquid solvent extraction systems. In these systems, viscosity is a crucial transfer property, significantly impacting the scale-up of liquid applications [9].
Due to its importance, researchers have made significant efforts to experimentally determine the viscosities of various TBP-diluent systems. In 2007, Tian et al. [10] measured the densities and viscosities of the binary mixtures of TBP with hexane and dodecane systems. Following this work, in 2008, Fang et al. [11] measured these experimental values using cyclohexane and n-heptane with the binary mixtures of TBP at atmospheric pressure in the whole composition range and over different temperatures. Fang reported that when the Grunberg Nissan equation was used to measure viscosity, the experimental data were measured with less than 1% average absolute deviation (ADD) at temperatures (from 288 to 308) K. Sagdeev et al. [12] in 2013 measured the density and viscosity of n-heptane over a wider temperature range from 298 K to 470 K using the hydrostatic weighing and falling-body techniques. They calculated the ADD of 0.21% to 0.23% between the present and reported measurements of the density for n-heptane. In the same year, Basu et al. [2] obtained the partial molar volumes of the respective components using a binary mixture of TBP with hexane, heptane, and cyclohexane at different temperatures from (298.15 to 323.15) K. Basu reported that a binary mixture of TBP with hexane could achieve a consistent negative deviation from ideality. Most recently, in 2018, Billah et al. [3] measured densities, viscosities, and refractive indices for the binary mixtures of TBP under atmospheric pressure with toluene and ethylbenzene over the entire range of composition, and at different temperatures from T = (303.15 to 323.15) K.
Artificial Intelligence (AI) and machine learning (ML) have been extensively applied across all the areas of computational science, including biomedical sciences, drug delivery, chemistry, and material sciences, to predict the future behavior of systems based on historical data [13,14,15,16,17,18]. However, in the field of computational chemistry, conventional methods for measuring the viscosity of TBP mixture systems have primarily focused on pure liquids and binary mixtures. Therefore, predictive models for the viscosity of TBP mixtures are needed for practical process calculations and equipment design. Despite their widespread use, these traditional methods are time-consuming, tedious, and require a multistage preparation process, which can be harmful to human health and the environment due to the use of toxic organic solvents. Consequently, machine learning-based models that provide reliable viscosity predictions for liquids are crucial.
The literature survey revealed that, to date, no studies have modeled the viscosity of TBP mixtures using ML techniques. This research gap inspired us to propose ML models to accurately predict the viscosity of TBP diluted in solvents using experimental data obtained from the literature [2,3,10,11]. In this study, for the first time, we propose an accurate and efficient artificial neural network (NN) to predict the relative viscosity of TBP. Additionally, we demonstrate that ML models can predict the viscosity of TBP mixtures with a high degree of accuracy. Among the five ML models developed in this study, the NN model emerges as a suitable option for accurately predicting the viscosity of TBP mixtures with a lower margin of deviation (MOD) compared to the other regular ML models.
The novelty of this research lies in its comprehensive comparison of different ML models to predict TBP mixture viscosities, which could significantly streamline industrial processes and reduce exposure to toxic solvents. The second section provides a comprehensive overview of the experimental database, feature visualization, machine learning model setup, and statistical analysis. Section 3 explores our findings, emphasizing the advantages of employing various machine learning techniques and showcasing the impressive effectiveness of each model. Section 4 comprises the discussion, and finally, Section 5 summarizes our findings, underscoring the model’s potential in enhancing viscosity refinement and advancing our knowledge of TBP fluid properties.

2. Materials and Methods

The proposed algorithm to predict the dynamic viscosity of TBP mixtures is illustrated in Figure 1. The dataset comprises 511 measurements for TBP mixtures with temperature-based density across different compositions. We pre-processed the data by standardizing it to ensure uniform scaling across all the features, and we reduced the dimensionality of the data to facilitate efficient training.
To ensure a fair comparison, we utilized five different ML algorithms—Logistic Regression (LR), Support Vector Regression (SVR), random forest (RF), Extreme Gradient Boosting (XGBoost), and neural network (NN)—employing identical experimental data points (4599 = 511 measurements × 9 features per measurement) for the viscosity of TBP mixtures across various compositions, densities, and temperatures. We hypothesized that the ML models can accurately predict viscosities compared to the actual (observed) values. To evaluate this hypothesis, we conducted a two-sample t-test on the predicted viscosity values. Further details regarding the block diagram in Figure 1 will be elaborated in the subsequent sections.

2.1. Experimental Database and Feature Visualization

The databases for this study were compiled from data reported in the literature. A total of 511 experimental points for TBP mixtures with temperature-based density, encompassing various compositions and including hexane, dodecane, cyclohexane, n-heptane, toluene, and ethylbenzene, were gathered from multiple scientific publications [3,10,11]. In the original dataset, there are nine descriptors (features), including temperature, density, and seven compositions, used to estimate viscosity. Figure 2a–h depict the distribution of the values in the dataset, with the x-axis representing the values and the y-axis indicating the frequency of each value. Figure 2i illustrates the viscosity changes in the dataset, showing a normal distribution with parameters N (1.47, 0.81).

2.2. Correlation Matrix

To assess the relationships between the features and the target variable (viscosity), the Pearson product–moment correlation coefficient was utilized [19]. The correlation heatmap in Figure 3 reveals significant insights into the relationships between the various factors influencing the viscosity of TBP mixtures. Temperature shows a moderate negative correlation with viscosity (−0.36), indicating that higher temperatures lead to lower viscosities. TBP composition has a strong positive correlation with viscosity (0.86) and density (0.80), suggesting that higher TBP content increases both viscosity and density. In contrast, hexane composition demonstrates a moderate negative correlation with viscosity (−0.38) and density (−0.55), implying that more hexane results in lower viscosity and density. Other components like cyclohexane, n-heptane, dodecane, and toluene show weaker correlations with viscosity, highlighting that their impacts are less significant compared to TBP and hexane. These correlations underscore the dominant influence of TBP and hexane compositions on the viscosity and density of the mixtures, while temperature also plays a crucial role in modifying these properties.
The exploration of the relationship between viscosity, temperature, and TBP composition is crucial because viscosity significantly affects the efficiency of industrial processes involving TBP. Temperature variations impact viscosity, thereby influencing mixing and separation processes. TBP is a primary component in these mixtures, and its concentration directly affects the physical properties of the mixture. Understanding these relationships allows us to develop accurate predictive models, enhancing process control, efficiency, and safety in industrial applications.
Figure 4 illustrates the relationships between viscosity, temperature, and TBP composition. Figure 4a depicts the association between temperature (K) and viscosity (mPa·s). The scatter plot, supplemented with a regression line, shows a negative correlation, indicating that viscosity decreases as temperature increases. The distribution plots at the top and right side of the scatter plot further emphasize this trend, revealing a broad spread of viscosity values at lower temperatures and a tighter distribution at higher temperatures.
Figure 4b presents a 3D surface plot of viscosity as a function of temperature (K) and TBP composition. This visualization shows that viscosity decreases not only with increasing temperature but also as TBP composition increases. The gradient in the color scale, from red (higher viscosity) to blue (lower viscosity), further confirms that higher temperatures and TBP compositions contribute to lower viscosity values. This indicates that both higher temperature and higher TBP concentration synergistically reduce the viscosity of the mixture.

2.3. Feature Selection and Principal Component Analysis

Principal Component Analysis (PCA) was utilized to reduce data dimensionality [20]. In achieving this, PCA effectively transforms data points from a high-dimensional to a low-dimensional space, preserving essential linear structures throughout the process. The robust optimality of the resultant low-dimensional embedding stems from the precise mathematical foundation underlying PCA. For feature selection, we employed pairwise correlation analysis in Python, setting Pearson correlation coefficients between 5% and 95% to identify highly correlated features. Subsequently, we applied PCA to these correlated features, reducing dimensionality to eight principal components, effectively capturing over 99% of the variability within the dataset. Figure 5a illustrates the explained variance for all the features, while Figure 5b depicts the variation distribution of the selected significant features, excluding density in the training of the ML algorithms. This analysis reveals that temperature exhibits the highest variation, whereas n-heptane composition shows the lowest variation among the features considered.
To elaborate further, the input variables considered were temperature and the compositions (Xi) of solvents for each species. The viscosity functionality of the solvents is outlined below:
μ = f (T, X1, X2, X3, X4, X5, X6, X7)
where X1 to X7 are the solvents and T = (288.15, 293.15, 298.15, 303.15, 308.15, 313.15, 318.15, 323.15, and 328.15) K are the experimental temperatures used to measure the compositions. After identifying and collecting the data set, the next step was to select the ML models to predict the viscosity. To do so, for comparison purposes, we trained five different ML algorithms including SVR, RF, LR, XGB, and NN, which will be explained in the following section. To train these models, we randomly split our dataset to 80% for training and 20% for validation and testing. In this study, the training set was used to generate the ML model, and the test set was utilized to investigate the prediction capability and to validate the trained model.

2.4. Machine Learning Models

All the models discussed in this section were built in Python 3.8 with Scikit-Learn 1.1.3, Keras 2.9, TensorFlow 2.9.1 libraries trained by an RTX 3090 GPU with 24 GB memory, and CUDA 11.4.

2.4.1. Support Vector Regression (SVR)

The SVR algorithm approach’s function approximation is an optimization problem, aiming to minimize the gap between predicted and desired outputs [21,22,23]. Given that our problem lacked linear separability in the input space, we employed a kernel to map the data to a higher-dimensional space, known as kernel space, where linear separability could be achieved. In this investigation, we utilized the Scikit-learn framework [24] (version 1.1.3) library with SVR class with parameters including a radial basis function (‘RBF) kernel with a 0.001 tolerance for stopping criterion, and the regularization parameter C = 1 have been used. We performed a linear SVR which is expressed below:
f x = ω T X + b
where X, ω = (ω1, ω2, …, ωn) ∈ Rn, bR, and T are, respectively, the input or support vectors, the weight vector, the intercept, and transpose operator. The optimization problem for training the linear SVR is given by the following:
Min   (   1 2   | | ω | | 2 + C 2 i = 1 n e i 2   )  
where C is a positive regularization parameter (C = 1), the penalty for incorrectly estimating the output associated with input vectors.

2.4.2. Gradient Boosted Decision Trees (XGBoost)

The XGBoost regressor employed a combination of 100 decision trees to mitigate the risk of overfitting encountered by each individual tree. XGBoost utilized a boosting technique, sequentially combining weak learners, such that each subsequent tree rectified the errors of its predecessor [25,26]. In this work, the XGBoost model was developed with a learning rate of 0.3 and the number of estimators = 100.

2.4.3. Random Forest (RF)

By utilizing different subsets of the available features, numerous independent decision trees can be simultaneously constructed on various sections of the training data. Bootstrapping ensures that each decision tree within the random forest is unique, contributing to the reduction in RF variance [27]. We found 100 trees in the forest to be optimum in our RF model.

2.4.4. Logistic Regression (LR)

The main advantage of LR is to avoid confounding effects by analyzing the association of all the variables together [28,29]. In this work, we used the “L2” regularization method which is a ridge regression and can add a squared magnitude of coefficients as the penalty term to the loss function regularization.

2.4.5. Neural Network Architecture

In the NN architecture, we implemented a feed-forward backpropagation approach to adjust the weights and determine the optimal mapping between the input features and the target output [30,31]. The architecture of the feedforward network utilized in this study is depicted in Figure 6, comprising two hidden layers with 25 and 50 neurons for the first and second hidden layers, respectively. The ‘ReLU’ activation function was employed to propagate only positive weights, as specified in Equation (4). To select the optimal parameters, we employed a cross-validated approach using the GridSearchCV method with 5-fold cross-validation in Python [32,33].
f x = m a x ( 0 , x )

2.5. Performance Metrics

The trained models’ performance was evaluated using three parameters: Mean Absolute Error (MAE), Mean Squared Error (MSE), and the adjusted correlation coefficient (R2). Regression analysis was employed to evaluate the network’s capability for ternary viscosity prediction, with the coefficient of determination serving as a metric to gauge the correlation between the trained model and the experimental data. The performance metrics used in this study were defined as below:
MAE = 1 N i N | μ i o b s μ i p r e d |
MSE = 1 N i N ( μ i o b s μ i p r e d ) 2
R 2 = i N ( μ i o b s μ i ¯ ) 2 i N ( μ i o b s μ i p r e d ) 2 i N ( μ i o b s μ i ¯ ) 2
R A d j u s t e d 2 = 1 1 R 2 N 1 N p 1  
where N is the number of viscosity data points, μ o b s is the ith observed value of the viscosity, μ p r e d is the predicted viscosity with the ML model, μ ¯ is the average value of the experimental viscosity data, and p is the number of predictors.

2.6. Statistical Analysis

In RStudio Version 2022.07.0 + 548, statistical analysis was conducted to ascertain if there were any statistically significant differences between the observed and predicted viscosity values for each ML model. It was assumed that the feature distribution was normal, and the samples were drawn from independent features. Subsequently, for each model, the null hypothesis was assessed by computing the mean (µ) for the viscosity values to test whether µobserved = µpredicted. The margin of deviation (MOD) was used to calculate the error bars as defined below:
M O D = μ o b s μ p r e d μ o b s × 100

3. Results

In this section, we discuss the performance of the various approaches and the optimal parameters for the developed ML algorithms. The developed models were trained on 408 observations with eight features (totaling 3264 data points) and tested on 103 observations with eight features (totaling 824 data points) across temperatures ranging from 288.15 K to 328.15 K.
The learning curves for the NN model are depicted in Figure 7, illustrating that the NN model began to converge after 20 epochs. Table 1 presents a comparison of all the developed models’ performance in terms of adjusted R2, MSE, and MAE. As indicated in Table 1, the NN model achieved the highest performance with an MSE of 0.157% and an adjusted R2 of 99.97%. Following the NN model, in descending order of performance, XGBoost, RF, SVR, and Logistic Regression attained adjusted R2 values of 99.54%, 99.22%, 99.06%, and 93.10%, respectively, on the test dataset.
Figure 8 presents a comparative analysis of the five ML models—LR, SVR, RF, XGB, and NN—in predicting viscosity. The scatter plots for both the training and testing datasets illustrate the relationship between the observed and predicted viscosity, with the adjusted R-squared values indicating the model’s performance. LR exhibits the adjusted R-squared values of 93.89% and 93.16% for training and testing, respectively. SVR shows significantly higher values of 99.26% and 99.06%, while RF and XGB demonstrate even stronger performance with values exceeding 99.2% for both the datasets. NN outperformed all the trained models with the R-squared values of 99.85% and 99.72%. for training and testing, respectively. The accompanying box plots, with the p-values from t-tests, indicate that there are no statistically significant differences between the observed and predicted viscosities across all the models, except for NN (p < 1 × 10−14) and a marginal significance in the training set of XGB (p = 0.03). This comprehensive evaluation highlights the superior predictive accuracy of NN and XGB models compared to LR, SVR, and RF for viscosity prediction.
Figure 9 presents a comparative analysis of the observed and predicted viscosity values under varying conditions, depicted in four subplots. Figure 9a illustrates the relationship between the viscosity and cyclohexane mole fraction, showing a decreasing trend as the mole fraction increases, with the predicted values closely aligning with the observed data. Figure 9b examines the effect of the ethylbenzene mole fraction on viscosity, also demonstrating a decrease in the viscosity with increasing mole fraction, where the predicted values consistently match the observed values. Figure 9c explores the viscosity variation with n-heptane mole fraction, revealing a similar decreasing trend, and the predicted values once again closely follow the observed data. Lastly, Figure 9d shows the viscosity dependence on temperature, with the viscosity decreasing as the temperature rises, and the predicted values aligning well with the observed ones across different temperature points. Overall, the predictive model demonstrates a high degree of accuracy in estimating viscosity across different mole fractions and temperature conditions, as evidenced by the close match between the observed and predicted data.
Figure 10 displays the MOD percentages for viscosity predictions across various factors. Temperature has a median MOD of approximately −0.1% (IQR: −0.35% to 0.15%), while cyclohexane shows a median MOD of 0.2% (IQR: 0.05% to 0.45%). For n-heptane, the median MOD is around 0.05% (IQR: −0.1% to 0.15%), and ethylbenzene shows a median MOD of 0.05% (IQR: −0.05% to 0.15%). Hexane exhibits a median MOD of 0.0% (IQR: −0.15% to 0.15%), dodecane a median MOD of 0.0% (IQR: −0.05% to 0.2%), toluene a median MOD of 0.05% (IQR: −0.1% to 0.25%), and TBP a median MOD of 0.0% (IQR: −0.05% to 0.2%). The results indicate good predictive accuracy, with most deviations being minor, and variability is lowest for ethylbenzene and TBP and highest for hexane and cyclohexane, demonstrating the model’s robust reliability across different chemical conditions and temperatures.
The computational cost analysis (Table 2) reveals that the NN has the highest training time (6.5780 s) but a low inference time (0.0055 s), making it efficient for real-time predictions. XGBoost is the most efficient overall, with the lowest training (0.0029 s) and inference (0.0018 s) times. RF shows moderate costs, while SVR is extremely fast in both training (0.0010 s) and inference (0.0004 s). LR also has low computational costs, making it suitable for quick predictions. These results highlight the trade-offs between accuracy and computational efficiency for each model.

4. Discussion

This study aimed to predict the viscosity of TBP mixtures using five different machine learning models. The analysis included 408 observations with eight features (TBP, hexane, dodecane, cyclohexane, n-heptane, toluene, ethylbenzene, and temperature). The viscosity predictions spanned temperatures from 288.15 K to 328.15 K. The performance of each model was evaluated using metrics such as Mean Squared Error (MSE), Mean Absolute Error (MAE), and adjusted R2. The NN model outperformed the others with an MSE of 0.157% and an adjusted R2 of 99.97% on the test dataset; however, it needs a longer time for training with respect to other models. XGBoost, RF, and SVR followed with the adjusted R2 values of 99.54%, 99.22%, and 99.06%, respectively, while LR had the lowest performance with an adjusted R2 of 93.16%.
The NN model’s architecture, consisting of 25 neurons in the first hidden layer and 50 neurons in the second hidden layer, demonstrated superior predictive accuracy, particularly for the TBP + Ethylbenzene system, achieving a MOD of 0.049%. This highlights the NN model’s robustness and reliability in handling the non-linear relationships in the data. The MOD was analyzed across different solvents to assess the prediction accuracy further. Temperature showed a median MOD of approximately −0.1% with low variability, indicating consistent performance across different temperature ranges. Among the solvents, cyclohexane had the highest variability in MOD, while ethylbenzene and TBP exhibited the lowest, signifying stable predictions for these solvents. The findings from this study underscore the efficacy of the ML models in predicting the viscosity of complex mixtures like TBP. The high adjusted R2 values and low MSE indicate that these models can capture the intricate dependencies between the features, providing accurate viscosity predictions. This is particularly valuable for applications in chemical engineering where precise viscosity measurements are crucial.
A primary limitation of this study is the relatively small dataset size. Despite using techniques such as GridSearchCV for hyperparameter tuning and dropout methods to prevent overfitting, a larger dataset would likely improve model accuracy and generalizability. Moreover, the results of PCA suggest only reducing the dimension by one, which is not a significant reduction. Due to the small dataset size, we chose to retain all the compositional variables to ensure the models have sufficient information to make precise predictions. Reducing dimensions further using PCA could lead to the loss of important compositional information, which is vital for capturing the intricate relationships between viscosity and the components of the mixture. Then, we chose not to reduce more dimensions, as all the molecular compositions need to be considered to maintain the integrity and accuracy of our predictions. Future research should focus on expanding the dataset to include more compositions and temperature ranges, which would enhance the models’ robustness. Moreover, while this study focused on viscosity, incorporating additional physical properties such as density could provide a more comprehensive understanding of TBP mixtures. Exploring multi-output models that predict both viscosity and density simultaneously could be a promising direction for future work. Future works should also focus on assessing model performance by comparing the simulated and observed data using a more balanced metric like the Kling–Gupta efficiency [34].
The successful application of the ML models in this study demonstrates their potential in computational chemistry, particularly in predicting the properties of complex mixtures. This approach can be extended to other chemical systems, facilitating more efficient and accurate property predictions. The integration of ML techniques in chemical engineering workflows could lead to significant advancements in process optimization, materials design, and quality control.

5. Conclusions

In this paper, we presented a comparative study of various machine learning (ML) models for predicting the viscosity of Tri-n-butyl phosphate (TBP) mixtures. The models evaluated included Logistic Regression (LR), Support Vector Regression (SVR), random forest (RF), Extreme Gradient Boosting (XGBoost), and neural network (NN). We utilized an extensive experimental dataset to train and test these models, employing Principal Component Analysis (PCA) for feature selection and dimensionality reduction.
Our primary hypothesis was that the ML models could accurately predict the viscosity of TBP mixtures, potentially outperforming the traditional experimental methods in terms of efficiency and safety. Based on our findings, this hypothesis was validated, particularly with the NN model, which achieved the highest accuracy with an MSE of 0.157% and an adjusted R2 of 99.72%. This model’s performance supports the feasibility of using ML to predict viscosity, thereby reducing the reliance on labor-intensive and hazardous traditional methods.
The investigated ML models demonstrated superior accuracy in predicting TBP viscosity, making it a reliable tool for industrial applications. Also, the ML models, once trained, can provide rapid predictions, significantly reducing the time required compared to traditional experimental methods, and reducing the need for direct handling of toxic solvents, thereby enhancing laboratory safety. The methodology can be extended to other chemical systems and different types of mixtures, showcasing its versatility. On the other hand, ML models are computationally intensive, requiring significant resources for training. The accuracy of the ML models is contingent on the quality and range of the training data, which in this study was limited to specific temperature ranges and compositions.
Future research should focus on expanding the experimental dataset to include a broader range of compositions and temperatures, enhancing the model’s robustness and accuracy. Additionally, incorporating more advanced ML techniques and exploring ensemble methods could further improve predictive performance. Predicting other related properties, such as density alongside viscosity, could provide a more comprehensive understanding of TBP mixtures. Addressing these areas will mitigate the current methodology’s disadvantages and open new avenues for applying ML in chemical process optimization.

Author Contributions

Conceptualization, methodology, data preparation and cleaning, writing, and original draft preparation, F.H.; formal analysis, review and editing, visualization, and project administration, M.M. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Data Availability Statement

The data and models presented in this study are openly available on the author’s GitHub page: https://github.com/faranak1991?tab=repositories (accessed on 29 June 2024).

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Schulz, W.W.; Bender, K.; Burger, L.; Navratil, J. Science and Technology of Tributyl Phosphate; OSTI.Gov: Oak Ridge, TN, USA, 1990.
  2. Basu, M.A.; Samanta, T.; Das, D. Volumetric and acoustic properties of binary mixtures of tri-n-butyl phosphate with n-hexane, cyclohexane, and n-heptane from T = (298.15 to 323.15) K. J. Chem. Thermodyn. 2013, 57, 335–343. [Google Scholar] [CrossRef]
  3. Billah, M.M.; Rocky, M.M.H.; Hossen, I.; Hossain, I.; Hossain, M.N.; Akhtar, S. Densities, viscosities, and refractive indices for the binary mixtures of tri-n-butyl phosphate (TBP) with toluene and ethylbenzene between (303.15 and 323.15) K. J. Mol. Liq. 2018, 265, 611–620. [Google Scholar] [CrossRef]
  4. Cui, S.; de Almeida, V.F.; Khomami, B. Molecular dynamics simulations of tri-n-butyl-phosphate/n-dodecane mixture: Thermophysical properties and molecular structure. J. Phys. Chem. B 2014, 118, 10750–10760. [Google Scholar] [CrossRef] [PubMed]
  5. Maksimov, A.I.; Kovalenko, N.A. Thermodynamic Properties and Phase Equilibria in the Water–Tri-n-butyl Phosphate System. J. Chem. Eng. Data 2016, 61, 4222–4228. [Google Scholar] [CrossRef]
  6. Wright, A.; Paviet-Hartmann, P. Review of physical and chemical properties of tributyl phosphate/diluent/nitric acid systems. Sep. Sci. Technol. 2010, 45, 1753–1762. [Google Scholar] [CrossRef]
  7. Stepanov, S.I.; Hoa, N.T.Y.; Boyarintseva, E.V.; Boyarintsev, A.V.; Kostikova, G.V.; Tsivadze, A.Y. Separation of rare-earth elements from nitrate solutions by solvent extraction using mixtures of Methyltri-n-octylammonium Nitrate and Tri-n-butyl Phosphate. Molecules 2022, 27, 557. [Google Scholar] [CrossRef] [PubMed]
  8. Hatami, F. Energy Spectrum of Primary Knock-on Atoms and Atomic Displacement Calculations in Metallic Alloys under Neutron Irradiation. arXiv 2024, arXiv:2406.08438. [Google Scholar]
  9. Tiwari, K.; Patra, C.; Chakravortty, V. Molecular interaction study on binary mixtures of dimethyl sulphoxide with benzene, carbon tetrachloride and toluene from the excess properties of ultrasonic velocity, viscosity and density. Acoust. Lett. 1995, 19, 53–59. [Google Scholar]
  10. Tian, Q.; Liu, H. Densities and viscosities of binary mixtures of tributyl phosphate with hexane and dodecane from (298.15 to 328.15) K. J. Chem. Eng. Data 2007, 52, 892–897. [Google Scholar] [CrossRef]
  11. Fang, S.; Zhao, C.-X.; He, C.-H. Densities and Viscosities of Binary Mixtures of Tri-n-butyl Phosphate+ Cyclohexane,+n-Heptane at T=(288.15, 293.15, 298.15, 303.15, and 308.15) K. J. Chem. Eng. Data 2008, 53, 2244–2246. [Google Scholar] [CrossRef]
  12. Sagdeev, D.; Fomina, M.; Mukhamedzyanov, G.K.; Abdulagatov, I. Experimental Study of the Density and Viscosity of-Heptane at Temperatures from 298 K to 470 K and Pressure upto 245 MPa. Int. J. Thermophys. 2013, 34, 1–33. [Google Scholar] [CrossRef]
  13. Castro, B.M.; Elbadawi, M.; Ong, J.J.; Pollard, T.; Song, Z.; Gaisford, S.; Pérez, G.; Basit, A.W.; Cabalar, P.; Goyanes, A. Machine learning predicts 3D printing performance of over 900 drug delivery systems. J. Control. Release 2021, 337, 530–545. [Google Scholar] [CrossRef] [PubMed]
  14. Goh, G.B.; Hodas, N.O.; Vishnu, A. Deep learning for computational chemistry. J. Comput. Chem. 2017, 38, 1291–1307. [Google Scholar] [CrossRef] [PubMed]
  15. Moradi, M.; Huan, T.; Chen, Y.; Du, X.; Seddon, J. Ensemble learning for AMD prediction using retina OCT scans. Investig. Ophthalmol. Vis. Sci. 2022, 63, 732–F0460. [Google Scholar]
  16. Moradi, M.; Du, X.; Chen, Y. Soft Attention-Based U-NET for Automatic Segmentation of OCT Kidney Images; SPIE: St. Bellingham, WA, USA, 2022; Volume 11948. [Google Scholar]
  17. Moradi, M.; Du, X.; Huan, T.; Chen, Y. Feasibility of the soft attention-based models for automatic segmentation of OCT kidney images. Biomed. Opt. Express 2022, 13, 2728–2738. [Google Scholar] [CrossRef] [PubMed]
  18. Moradi, M.; Chen, Y.; Du, X.; Seddon, J.M. Deep ensemble learning for automated non-advanced AMD classification using optimized retinal layer segmentation and SD-OCT scans. Comput. Biol. Med. 2023, 154, 106512. [Google Scholar] [CrossRef] [PubMed]
  19. Steiger, J.H. Tests for comparing elements of a correlation matrix. Psychol. Bull. 1980, 87, 245. [Google Scholar] [CrossRef]
  20. Świniarski, R.W. Rough sets methods in feature reduction and classification. Int. J. Appl. Math. Comput. Sci. 2001, 11, 565–582. [Google Scholar]
  21. Long, N.; Gianola, D.; Rosa, G.J.; Weigel, K.A. Application of support vector regression to genome-assisted prediction of quantitative traits. Theor. Appl. Genet. 2011, 123, 1065–1074. [Google Scholar] [CrossRef]
  22. Vapnik, V. The Nature of Statistical Learning Theory; Springer Science & Business Media: Berlin/Heidelberg, Germany, 1999. [Google Scholar]
  23. Toots, K.M.; Sild, S.; Leis, J.; Acree, W.E., Jr.; Maran, U. Machine Learning Quantitative Structure–Property Relationships as a Function of Ionic Liquid Cations for the Gas-Ionic Liquid Partition Coefficient of Hydrocarbons. Int. J. Mol. Sci. 2022, 23, 7534. [Google Scholar] [CrossRef]
  24. Pedregosa, F.; Varoquaux, G.; Gramfort, A.; Michel, V.; Thirion, B.; Grisel, O.; Blondel, M.; Prettenhofer, P.; Weiss, R.; Dubourg, V. Scikit-learn: Machine learning in Python. J. Mach. Learn. Res. 2011, 12, 2825–2830. [Google Scholar]
  25. Taieb, S.B.; Hyndman, R.J. A gradient boosting approach to the Kaggle load forecasting competition. Int. J. Forecast. 2014, 30, 382–394. [Google Scholar] [CrossRef]
  26. Friedman, J.H. Greedy function approximation: A gradient boosting machine. Ann. Stat. 2001, 29, 1189–1232. [Google Scholar] [CrossRef]
  27. Breiman, L. Random forests. Mach. Learn. 2001, 45, 5–32. [Google Scholar] [CrossRef]
  28. Kleinbaum, D.G.; Dietz, K.; Gail, M.; Klein, M.; Klein, M. Logistic Regression; Springer: Berlin/Heidelberg, Germany, 2002. [Google Scholar]
  29. Pampel, F.C. Logistic Regression: A Primer; Sage Publications: Washington, DC, USA, 2020; Volume 132. [Google Scholar]
  30. Dongare, A.; Kharde, R.; Kachare, A.D. Introduction to artificial neural network. Int. J. Eng. Innov. Technol. 2012, 2, 189–194. [Google Scholar]
  31. Schütt, K.T.; Gastegger, M.; Tkatchenko, A.; Müller, K.-R.; Maurer, R.J. Unifying machine learning and quantum chemistry with a deep neural network for molecular wavefunctions. Nat. Commun. 2019, 10, 5024. [Google Scholar] [CrossRef]
  32. Cai, Y.-l.; Ji, D.; Cai, D. A KNN Research Paper Classification Method Based on Shared Nearest Neighbor; NTCIR: Tokyo, Japan, 2010; pp. 336–340. [Google Scholar]
  33. Yadav, S.; Shukla, S. Analysis of k-fold cross-validation over hold-out validation on colossal datasets for quality classification. In Proceedings of the 2016 IEEE 6th International Conference on Advanced Computing (IACC), Bhimavaram, India, 27–28 February 2016; IEEE: New York, NY, USA, 2016; pp. 78–83. [Google Scholar]
  34. Gupta, H.V.; Kling, H.; Yilmaz, K.K.; Martinez, G.F. Decomposition of the mean squared error and NSE performance criteria: Implications for improving hydrological modelling. J. Hydrol. 2009, 377, 80–91. [Google Scholar] [CrossRef]
Figure 1. The main steps used in this study to predict the dynamic viscosity of TBP mixtures.
Figure 1. The main steps used in this study to predict the dynamic viscosity of TBP mixtures.
Computation 12 00133 g001
Figure 2. Distribution of the features used in this study is shown in (ah). Viscosity has a normal distribution with N (1.47, 0.81) as shown in (i). The width of all the bar charts is uniform. However, in certain charts such as toluene and ethylbenzene, there are clusters of data points that are closely grouped together, appearing as if the bars are wider at first glance. This clustering indicates that there are data points with compositions that are similar.
Figure 2. Distribution of the features used in this study is shown in (ah). Viscosity has a normal distribution with N (1.47, 0.81) as shown in (i). The width of all the bar charts is uniform. However, in certain charts such as toluene and ethylbenzene, there are clusters of data points that are closely grouped together, appearing as if the bars are wider at first glance. This clustering indicates that there are data points with compositions that are similar.
Computation 12 00133 g002
Figure 3. Correlation heatmap matrix for input features and the output target.
Figure 3. Correlation heatmap matrix for input features and the output target.
Computation 12 00133 g003
Figure 4. (a) Association of temperature with viscosity. (b) Relative viscosity versus TBP concentration (r = 0.8) and temperature (r =−0.5). Each dot represents an individual data point. The histogram along the top displays the distribution of temperature values, while the histogram along the right side shows the distribution of viscosity values. The trend line indicates the general decreasing trend of viscosity with increasing temperature.
Figure 4. (a) Association of temperature with viscosity. (b) Relative viscosity versus TBP concentration (r = 0.8) and temperature (r =−0.5). Each dot represents an individual data point. The histogram along the top displays the distribution of temperature values, while the histogram along the right side shows the distribution of viscosity values. The trend line indicates the general decreasing trend of viscosity with increasing temperature.
Computation 12 00133 g004
Figure 5. Explained variance (a), eight first features explained almost all variability, (b) distribution of important features. The red dashed line shows the cumulative variance as more components are added. The black horizontal dashed line indicates 100% variance explained, while the black vertical dashed line marks the point where the cumulative variance levels off, suggesting that 7 components are sufficient to capture nearly all the variance in the dataset.
Figure 5. Explained variance (a), eight first features explained almost all variability, (b) distribution of important features. The red dashed line shows the cumulative variance as more components are added. The black horizontal dashed line indicates 100% variance explained, while the black vertical dashed line marks the point where the cumulative variance levels off, suggesting that 7 components are sufficient to capture nearly all the variance in the dataset.
Computation 12 00133 g005
Figure 6. The optimal structure of the neural network developed in this study.
Figure 6. The optimal structure of the neural network developed in this study.
Computation 12 00133 g006
Figure 7. Learning curves for the NN for 120 Epochs: (a) accuracy profile; (b) loss profile. The model was converged after 20 epochs. A total of 10% dropout was used to avoid overfitting.
Figure 7. Learning curves for the NN for 120 Epochs: (a) accuracy profile; (b) loss profile. The model was converged after 20 epochs. A total of 10% dropout was used to avoid overfitting.
Computation 12 00133 g007
Figure 8. Evaluating the five developed models in predicting the viscosity of TBP mixtures. The labels of ‘LR’, ‘SVR’, ‘RF’, ’XGB’, and ‘NN’ refer to the respective five image rows, and “Train”, “Test”, and” Box Plot” refer to the respective three columns. A 95% confidence interval was used to plot the data. A 0.05 significance level was used to compare the predicted and observed values. Each blue dot corresponds to a pair of observed and predicted values. The orange line represents the ideal line where predicted values perfectly match the observed values.
Figure 8. Evaluating the five developed models in predicting the viscosity of TBP mixtures. The labels of ‘LR’, ‘SVR’, ‘RF’, ’XGB’, and ‘NN’ refer to the respective five image rows, and “Train”, “Test”, and” Box Plot” refer to the respective three columns. A 95% confidence interval was used to plot the data. A 0.05 significance level was used to compare the predicted and observed values. Each blue dot corresponds to a pair of observed and predicted values. The orange line represents the ideal line where predicted values perfectly match the observed values.
Computation 12 00133 g008
Figure 9. Comparison between the observed and predicted values for the four top features associated with NN performance. TBP + Ethylbenzene showed the best NN performance in predicting viscosity. The boxes represent the interquartile range (IQR), the horizontal line inside each box indicates the median, the whiskers extend to 1.5 times the IQR, and the dots represent outliers.
Figure 9. Comparison between the observed and predicted values for the four top features associated with NN performance. TBP + Ethylbenzene showed the best NN performance in predicting viscosity. The boxes represent the interquartile range (IQR), the horizontal line inside each box indicates the median, the whiskers extend to 1.5 times the IQR, and the dots represent outliers.
Computation 12 00133 g009
Figure 10. The margin of deviation of NN results with respect to the type of solvent (feature): temperature, cyclohexane, n-heptane, ethylbenzene, hexane, dodecane, toluene, and TBP. The red dashed line at 0% indicates perfect agreement between the observed and predicted viscosities. Each box plot shows the range, interquartile range (IQR), median, and outliers of the MOD for each factor.
Figure 10. The margin of deviation of NN results with respect to the type of solvent (feature): temperature, cyclohexane, n-heptane, ethylbenzene, hexane, dodecane, toluene, and TBP. The red dashed line at 0% indicates perfect agreement between the observed and predicted viscosities. Each box plot shows the range, interquartile range (IQR), median, and outliers of the MOD for each factor.
Computation 12 00133 g010
Table 1. Comparison of the five ML models in predicting the viscosity of TBP mixtures on the test set.
Table 1. Comparison of the five ML models in predicting the viscosity of TBP mixtures on the test set.
ML ModelAdj. R2 * (%)MAE (%)MSE (%)
NN99.722.8600.157
XGBoost99.543.7510.315
RF99.225.3720.530
SVR99.065.5230.650
LR93.161.5650.474
* Adjusted R-squared.
Table 2. Comparison of computational costs for the training and inference of the ML models.
Table 2. Comparison of computational costs for the training and inference of the ML models.
ML ModelTraining Time (s)Inference Time (s)
NN6.5780 0.0055
XGBoost0.00290.0018
RF0.00840.0050
SVR0.00100.0004
LR0.00190.0011
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Hatami, F.; Moradi, M. Comparative Analysis of Machine Learning Models for Predicting Viscosity in Tri-n-Butyl Phosphate Mixtures Using Experimental Data. Computation 2024, 12, 133. https://doi.org/10.3390/computation12070133

AMA Style

Hatami F, Moradi M. Comparative Analysis of Machine Learning Models for Predicting Viscosity in Tri-n-Butyl Phosphate Mixtures Using Experimental Data. Computation. 2024; 12(7):133. https://doi.org/10.3390/computation12070133

Chicago/Turabian Style

Hatami, Faranak, and Mousa Moradi. 2024. "Comparative Analysis of Machine Learning Models for Predicting Viscosity in Tri-n-Butyl Phosphate Mixtures Using Experimental Data" Computation 12, no. 7: 133. https://doi.org/10.3390/computation12070133

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop