1. Introduction
As a widely used metal forming technology, deep drawing processes have been applied to manufacturing circular or square cups in various industries for many years. With the help of stamping equipment, blanks are sheared, bent, and shaped into desired geometries and dimensions. Artificial intelligence (AI) is an emerging field of science and technology development. The purpose of AI is to allow computers to learn like humans, and through training with a database to make decisions or perform various functions. The objective of this study is to explore the influence of forming temperature, punch speed, blank diameter, and blank thickness on the forming results using finite element simulations with the variation of the four parameters and obtain a possible forming range for sound-drawn products in A7075 deep drawing processes using machine learning (ML) algorithm. A dataset for formable ranges of the parameters is constructed from ML training and verification. An AI prediction model is also established. Inputting the forming parameters, the predicted forming results can be obtained quickly. Finally, deep drawing experiments are conducted and the results obtained are used to verify the predicted formable regions of sound products and the proposed AI model.
Deep drawing is a long-established technology. Using a stamping machine, a circular sheet can be formed into circular cups or more complex shape parts used in automotive or aircraft industries [
1]. Due to long-term development, deep drawing and stamping have become a stable and well-known technology. However, these methods are limited to forming ductile metal materials. For some brittle metal materials with low formability and high hardness, such as aluminum alloy A7075, cracking or fractures are likely to occur at the cup corner during deep drawing processes. To raise the formability of the products, an elevated temperature is usually used, and other forming parameters have to be adjusted appropriately. It is necessary to obtain the formable ranges for various forming parameters. The finite element analysis has been widely applied to construct a comprehensive model for many different cases. Nevertheless, a lot of time is needed to complete all the simulations with various cases. Therefore, a new approach based on ML is proposed to replace the traditional finite element simulation-based method. The ML system learns from input data and improves the output results by adjusting internal weights. After training, it can be used to predict results or assist decision-making. After learning, the predicted forming results can be obtained quickly under different forming conditions by inputting relevant information later. This approach can save time and cost in developing various deep-drawn cup products.
Regarding the mechanical properties of aluminum alloy A7075, Tajally and Emadoddin [
2] and Cerri et al. [
3] investigated the mechanics and anisotropic behavior of A7075 plates. The former conducted annealing of A7075 plates to reduce the yield strength and hardness and to improve its formability. A series of experiments verified that annealing at 350~400 °C has obvious effects. The latter conducted high-temperature torsion testing. As the temperature increases, the ductility between 250 °C and 300 °C increases due to changes in the microstructure. In view of the influence of various forming parameters of deep drawing, Colgan and Monaghan [
1] examined some forming factors influencing the deep drawing process, utilizing an experimental rig design and statistical analysis. The parameters include the punch and die radii, the punch velocity, clamping force, friction, and drawing depth. From finite element analysis and experimental results, it seems that the punch/die radii have the greatest effect on the thickness of the deformed mild steel cups compared to blank-holder force or friction. Chen et al. [
4] used finite element analysis to investigate the effects of the gap between the punch and die, the corner radius of the punch, and the corner radius of the die shoulder in deep drawing with a circular and square die design. They found that the defects of cracks occurred due to excessive stretching of the blank. To avoid cracking to improve the formability, the die geometrical dimensions and forming parameters have to be set approximately. Gowtham et al. [
5] investigated the effects of the die radius on deep drawing results and found that reducing the die radius can cause stretch marks on the blank and uneven height of the cup.
Concerning the studies on AI, a few papers have been published to examine network algorithms to combine metal-forming technology with ML. For example, Liu et al. [
6] used a long short-term memory (LSTM) network to predict bearing failure and fracture and proposed a new LSTM model. This model combines the advantages of an LSTM network and statistical analysis to predict aviation engine bearing failure. The results show that this method has higher accuracy than recurrent neural network (RNN), support vector machine (SVM), and LSTM, thereby improving the prediction accuracy of bearing performance degradation trend and remaining service life. ML facilitates computers to read and interpret from the previously present data automatically and makes use of multiple algorithms to build models, mathematical in nature, and then makes predictions for the new data using the past data and knowledge. Lately, it has been adopted for text detection, hate speech detection, recommender system, face detection, and more. In [
7], the aspects concerning ML algorithms, K-nearest neighbor (KNN), genetic algorithm (GA), SVM, decision tree (DT), and LSTM network have been investigated.
In [
8], the authors calculated the accuracy of ML algorithms for predicting heart disease, with KNN, DT, linear regression, and SVM by using the University of California, Irvine (UCI) repository dataset for training and testing. In [
9], the previous works proposed a hybrid traffic classification method based on ML using the packet-multilayer perceptron (P-MLP) model and majority voting method to effectively classify the encrypted traffic in the network. In previous research [
10], a FaceNet training method is used to train the mask face recognition (MFR) model using migration learning combined with a CNN model and a fully connected SoftMax output classifier to dynamically update the optimizer’s learning rate (LR). The proposed ML models combined with fingerprinting for indoor localization using channel side information (CSI) [
11]. Experiments were conducted on the positioning accuracy performance of RF and backpropagation neural network (BPNN) ML models using received signal strength indicator (RSSI) and CSI information, respectively.
Shinomiya et al. [
12] used ML to control the movement of a slider and applied a convolutional neural network (CNN) with consideration of the elastic strain of the punch to predict the quality of the extruded products. Using this intelligent slider motion control, the defects can be prevented, and sound products can be obtained. Accordingly, the defect rate can be reduced significantly. Crystal plasticity analysis in sheet metal forming consumes a lot of calculation time. Cancemi et al. [
13] proposed deep learning (DL) in the investigation of the safety behavior of nuclear plant items. The proposed innovative methodology is based on an unsupervised neural network (NN) to predict potential anomalies in the cooling system of a pressurized water reactor. Yamanaka [
14] used ML models to replace complicated formula calculations and used simpler dimensionality reduction models to calculate the data from sheet-forming experiments. Thus, the efficiency of sheet metal forming simulations is improved by combining with the ML learning models.
Due to the shortage of manpower, many manufacturing companies are developing their production toward automation and intelligence. Therefore, in recent years, many companies introduced metal-forming technology combined with AI. In this paper, a new approach based on ML is proposed to predict the formable regions of a sound product for various forming parameters in the deep drawing process of an aluminum ally A7075 circular cup. By this method, the development cycle of a newly drawn product can be shortened and the production efficiency can be improved.
3. Machine Learning Classifier
A classifier is an ML model that assigns data points to different categories or labels, using supervised learning methods to learn labeled data to predict the category of subsequent data [
20]. With the development of modern AI, its advantages are gradually valued by the manufacturing industry. In terms of improving production efficiency, AI’s high degree of learning and efficient computing power can make the most appropriate decisions quickly, or by establishing a dataset for AI to learn, subsequent data can be processed in various tasks [
12].
This study uses the finite element software simulation results explained in the previous section as input data to write a prediction model and create an input dataset, allowing the model to learn the input dataset, predict subsequent inputs, and obtain the forming range of aluminum alloy 7075. In this study, the classifier function in ML is used to input data such as material temperature, material diameter, forming speed, and other parameters and forming results to classify, thereby predicting whether the input forming parameters can be successfully formed in the future. The classifiers used in this study can be divided into two categories: weak classifiers and integrated classifiers. Weak classifiers are mainly composed of a single classifier model. Weak classifiers are faster in learning speed but have lower learning rates or relatively poor accuracy.
The weak classifiers used in this study include Logistic regression, KNN, SVM, DT, etc. Integrated learning mainly consists of multiple or multiple weak classifiers, which are systematically integrated, and then the final classification prediction is obtained through weighted calculation or voting calculation. Compared with weak classifiers, due to the use of multiple weak classifiers for combined learning, the accuracy and learning effect of integrated learning classifiers are usually better than those of general weak classifiers.
AdaBoost, the full name of adaptive boosting, also known as adaptive enhancement, is an integrated learning classifier that uses the Boosting concept [
20]. The basic concept of Boosting is to combine multiple weak classifiers to form a strong classifier with a strong classification effect. The main idea is to improve prediction results through iteration. Boosting uses a weighting method to process the original data. The data of each training input set is given an initial weight by the model. In each round, a new weak classifier is used to train the training set, and each classifier is also given initial weights. After each round of learning, the data are divided into two categories: correctly classified and incorrectly classified. The weights of the two data types are updated, increasing the weight of the incorrectly classified data and reducing the weight of the correctly classified data so that the model can respond to the incorrectly classified data. The data are learned again, and the updated weights are given to the next round of classifiers for re-training.
Since the efficiency and accuracy of each classifier are different, all classifiers need to be integrated at the end of all training. At this time, the weight of the classifier with a higher error rate and poor accuracy is reduced, while the weight of the classifier with better performance and poor accuracy is reduced. The weight of higher classifiers increases, and finally, the updated weights of all classifiers and their corresponding classification results are statistically calculated to obtain the prediction results of the Boosting model. The structure diagram of AdaBoost is shown in
Figure 7 [
21]. After iterative training of the classifier, the overall model is gradually improved, and finally, excellent prediction results are obtained.
In terms of programming, Python is used to write research-related programs and establish a virtual environment for running classification prediction models. The input data learned by the program are the four forming parameters and forming results set in the Deform simulation. The four parameters are forming temperature, punch speed, material diameter, and material thickness. A total of 624 pieces of the input dataset are recorded for model training, as shown in
Table 5, where the forming results are represented by 0 and 1, where 1 represents the material being formed smoothly, and 0 represents material rupture.
Input the dataset into the program and use it. The data are divided into two categories: training and test sets, with the number of records being 8:2. Then, write the classifier used in the study. The operation flow chart of the program is shown in
Figure 8. The input data are imported into the specified folder at the model’s front end. It is necessary to check whether the input dataset has missing values or other incorrect data formats before it can be input into the classifier for internal learning. Otherwise, it needs to be re-entered. Confirm the content of the dataset. The program will pop up an error message if an error occurs during the classifier learning process. You must reconfirm the input dataset or modify the classification model to avoid program code or logic errors.
After the input dataset is confirmed to be correct, the model will be divided into training and test datasets. In ML, to evaluate the accuracy of the prediction model, the model will use the data of the training set to learn and then predict the output of the test set. The accuracy is obtained by comparison. The ratio of training and test sets is 8:2. After obtaining the test set, a program must be set up to distinguish the data used for prediction and the output result data. In this study, the four data types were used for prediction. The parameter factor, the output result data, is the material forming result. After the data are learned by the classifier, the results of model learning need to be tested.
The trained model predicts the output of the test set, and the results will be compared with the original correct answers. Evaluation indicators such as accuracy and error will be recorded. After training and testing, the model will summarize and export the model evaluation indicators of all classifiers and present the prediction results in charts, drawings, etc., to facilitate the researchers’ interpretation. Model evaluation indicators can be used to determine which classifier has the best performance and the most accurate prediction results, and the classifier with the best results can be selected as a classification prediction system. In the future, one only needs to enter relevant forming parameters, and the model will provide prediction results for reference.
The confusion matrix is a 2 × 2 matrix. The horizontal and vertical axes represent the actual and predicted results, respectively. The four blocks of the matrix represent different meanings, as shown in
Figure 9 [
22].
Some results of the confusion matrix of classifiers are shown in
Figure 10, where the dark color is used for highlighting the values. From
Figure 10a, it is observed that the weak classifier of DT suffers a higher FN with 12. From
Figure 10b, it is observed that the weak classifier of KNN suffers higher FP with 19. However, From
Figure 10c, it is observed that there are lower FP with 2 and FN with 0 for the strong classifier of AdaBoost.
Other evaluation indicators can be derived from the confusion matrix, and various model functions can be analyzed. The accuracy rate indicates the accuracy of the model’s incorrect prediction. The calculation formula is shown as follows:
The highest accuracy may not always mean that the model’s prediction effect is the best, so it needs to be combined with other evaluations. Indicators are discussed together. The precision rate represents the model’s accuracy in predicting positive examples. The calculation formula is shown as follows:
where the higher the ratio of TP, the higher the model’s accuracy. A high accuracy rate means that the model is less likely to make mistakes when its prediction is positive. The recall rate represents the rate of correct samples being classified as positive. The calculation formula is shown as follows:
A high recall rate means that the higher the proportion of correct samples that are judged as positive in the model, the less likely it is that the correct sample will be judged as wrong. The calculation formula of the
F1 score is shown as follows:
which requires using two widely referenced values, precision and recall because they can reflect the algorithm’s accuracy. The receiver operating characteristic curve (ROC curve) is a visual accuracy indicator, as shown in
Figure 11. The ROC curve’s horizontal and vertical axes represent the model’s false positive rate (FPR) and true positive rate (TPR). The farther the curve result deviates from the diagonal, the higher the accuracy. The larger the area under the curve (AUC, Area under the curve), the higher the accuracy and the better the model performance. The AUC value can compare the performance of different models, and models with larger AUC have better classification performance [
23].
The numerical values of the evaluation indicators can be used to determine which classifier model is better. Compare the accuracy, precision, recall, F1 score, and area under the ROC curve AUC, as shown in
Table 6. The closer the values of these five indicators are to 1, the better the performance and effect of the model. From the values in the table, we know that the first 6 rows are the results of weak classifiers. In terms of accuracy, some weak classifiers have higher accuracy. The precision and recall rate values are also the same as the accuracy rates. The performance of weak classifiers is mostly between 0.84 and 0.94. The prediction effect needs to be strengthened. Since the values of the precision rate and recall rate also affect the performance, the F1 score’s value of the F1 score also fluctuates wildly. The value of AUC reflects the predictive value of the model.
In
Table 6, the evaluation index results of the integrated learning classifiers are shown in the 7th to 11th rows. From the numerical comparison, the integrated learning’s accuracy, precision, and recall have greater progress than the weaker classifiers. The accuracy, precision, and recall rate even have a performance of 1, which improves prediction accuracy. The closer the AUC is to 1, the higher the prediction value of the model. Therefore, the ensemble learning classifier has a better prediction effect and higher classification accuracy than the weak classifier. The model has better predictive value, so this study will use an integrated learning classifier as the main architecture of the classification prediction model, in which the Ada Boost classifier is used to predict the material formability range of aluminum alloy A7075.
After the model completes learning, the subsequent input of forming parameters can predict the results. From this, different forming parameters can be input to obtain the formable range of the material. The material thickness is fixed at 2 mm, and the forming ranges under different forming temperatures, punch speeds, and material diameters are compared, as shown in
Figure 12. The three lines in the figure represent the three diameters of aluminum alloy 7075 discs, respectively, with diameters of 55, 58, and 61 mm. The area under the curve is the range in which the material can be successfully formed. The forming range of the material with a diameter of 61 mm is compared to the diameters of 55 and 58 mm. The range is small and difficult to form at low or too-high temperatures. The forming range of a diameter of 61 mm is approximately above 180 °C and below 350 °C. Forming in this range will have better results. The forming range of a material with a diameter of 58 mm is larger than that of 61 mm. However, it is also difficult to form at room (or lower) temperatures due to excessive material stress. Too high temperatures will also cause poor forming effects. Therefore, the formable range is from approximately 170 °C to 380 °C. The forming range of the material with a diameter of 55 mm is relatively loose, and the forming range can be smoothly formed from 250 °C to as high as 450 °C. Since the deep extension cup formed by the material disc with a diameter of 55 mm has a relatively low extension, the specimen material has a relatively low extension. The deformation is not large, and the forming conditions are relatively loose, so the impact of temperature and stamping speed is small.
The material diameter is controlled to 61 mm and the stretch ratio to 1.9. We change the material thickness, forming temperature, and punch speed for comparison, as shown in
Figure 13. The three lines represent the material forming range with material thicknesses of 1, 1.5, and 2 mm, respectively. The forming curve range of a material with a thickness of 1 mm is small. The forming temperature is about 170 °C to 270 °C. It can be formed smoothly. After 270 °C, the punch speed needs to be controlled. It cannot be formed after 340 °C. Therefore, the forming range of a 1 mm material is more suitable for forming between 200 °C and 250 °C. The forming range of a material with a thickness of 1.5 mm is larger than that of a material with a thickness of 1 mm. The formable temperature range falls between 140 °C and 410 °C. The blank is not easy to form at a too-low temperature, so deep processing should be carried out between 170 °C and 370 °C. The extension-forming effect is better. The forming range of a material with a thickness of 2 mm is larger than that of 1 mm but smaller than that of 1.5 mm. The forming temperature range is about 170 °C to 370 °C. Forming at low or high temperatures is difficult, so it is suitable. The forming temperature is about 200 °C to 350 °C.
To sum up, under the conditions of the same material diameter and the same draw ratio, the suitable thickness of the extension cup falls within a range rather than excessively increasing or reducing the thickness. If you want to produce thinner or thicker plates for a deep extension cup, the extension ratio of the extension cup needs to be reduced; that is, the material diameter can be reduced to form effectively. From the previous results, it can be concluded that the three parameters—forming temperature, material diameter, and material thickness—will have a greater impact on the forming of deep extension cups, while the impact of punch speed is relatively small. The punch speed is fixed at 24 mm/s, and the effects of the other three parameters are compared, as shown in
Figure 14.
As the blank diameter increases or the draw ratio increases, the formable ranges become narrow. Therefore, the forming temperature must be controlled within a certain range to avoid bad forming results. Forming at too low or too high temperatures may lead to bad forming results. The correlation function of forming temperature with respect to blank diameter and thickness can be calculated from the above figures. When the drawing ratio is between 1.72 and 1.8, the blank thickness is 1.5 to 2 mm. The minimum and maximum forming temperatures can be expressed by the following:
and
respectively, where LDR (limiting drawing ratio) is the draw ratio of the drawn cup [
19]. When the draw ratio is between 1.72 and 1.8, and the thickness is between 1 mm and 1.5 mm, the minimum and maximum forming temperatures are expressed by the following:
and
respectively, where
t is the blank thickness. If the draw ratio is 1.8 to 1.9 and the thickness is 1.5 to 2 mm. The minimum and maximum forming temperatures are expressed by the following:
and
respectively. If the draw ratio is 1.8 to 1.9 and the thickness is 1 to 1.5 mm, the minimum and maximum forming temperatures can be expressed by the following:
and
respectively. It can be known from the above formable ranges and related functions under the same blank thickness, materials with smaller blank diameters have advantages in forming compared to materials with larger blank diameters. Different blank thicknesses affect the formable range differently. The suitable blank thickness is inside the formable range. A thinner blank may not withstand the material’s stretching during deep drawing and make cracks occur. A thicker blank may be difficult to bend, thus, breakage may occur. Therefore, it is important to control the forming parameter appropriately in the deep drawing process of aluminum alloy A7075.