Next Article in Journal
Assessing Trail Running Biomechanics: A Comparative Analysis of the Reliability of StrydTM and GARMINRP Wearable Devices
Next Article in Special Issue
THz Generation by Two-Color Plasma: Time Shaping and Ultra-Broadband Polarimetry
Previous Article in Journal
Reliability of Dynamic Shoulder Strength Test Battery Using Multi-Joint Isokinetic Device
Previous Article in Special Issue
High-Density Polyethylene Custom Focusing Lenses for High-Resolution Transient Terahertz Biomedical Imaging Sensors
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Virtual Sensor for On-Line Hardness Assessment in TIG Welding of Inconel 600 Alloy Thin Plates

by
Jacek Górka
1,*,
Wojciech Jamrozik
2,*,
Bernard Wyględacz
1,
Marta Kiel-Jamrozik
3 and
Batalha Gilmar Ferreira
4
1
Department of Welding Engineering, Silesian University of Technology, Konarskiego Str. 18a, 44-100 Gliwice, Poland
2
Department of Fundamentals of Machinery Design, Silesian University of Technology, Konarskiego Str. 18a, 44-100 Gliwice, Poland
3
Department of Biomaterials and Medical Devices Engineering, Silesian University of Technology, Roosevelta Str. 40, 41-800 Zabrze, Poland
4
Department of Mechatronics and Mechanical Systems Engineering, Polytechnic School of Engineering, University of Sao Paulo (USP), São Paulo 05508-900, SP, Brazil
*
Authors to whom correspondence should be addressed.
Sensors 2024, 24(11), 3569; https://doi.org/10.3390/s24113569
Submission received: 13 May 2024 / Revised: 29 May 2024 / Accepted: 29 May 2024 / Published: 1 June 2024
(This article belongs to the Special Issue Research Development in Terahertz and Infrared Sensing Technology)

Abstract

:
Maintaining high-quality welded connections is crucial in many industries. One of the challenges is assessing the mechanical properties of a joint during its production phase. Currently, in industrial practice, this occurs through NDT (non-destructive testing) conducted after the production process. This article proposes the use of a virtual sensor, which, based on temperature distributions observed on the joint surface during the welding process, allows for the determination of hardness distribution across the cross-section of a joint. Welding trials were conducted with temperature recording, hardness measurements were taken, and then, neural networks with different hyperparameters were tested and evaluated. As a basis for developing a virtual sensor, LSTM networks were utilized, which can be applied to time series prediction, as in the analyzed case of hardness value sequences across the cross-section of a welded joint. Through the analysis of the obtained results, it was determined that the developed virtual sensor can be applied to predict global temperature changes in the weld area, in terms of both its value and geometry changes, with the mean average error being less than 20 HV (mean for model ~35 HV). However, in its current form, predicting local hardness disturbances resulting from process instabilities and defects is not feasible.

Graphical Abstract

1. Introduction

Welding plays a pivotal role in the industrial sector, serving as the backbone of manufacturing, construction, and engineering projects around the globe. It provides a robust method for joining metals and thermoplastics, enabling the creation of complex structures and machinery essential for infrastructure development, transportation networks [1], and energy production [2]. The versatility and strength of welding techniques facilitate innovations in design and materials science, driving advancements in aerospace, automotive, and renewable energy industries. Furthermore, the continual evolution of welding technologies, including automation and robotic welding, underscores its critical importance in enhancing efficiency, safety, and quality in industrial operations. As such, welding remains an indispensable skill and process, underpinning the growth and sustainability of modern industrial economies. Inconel is a trademark for a group of metal alloys known for their high nickel–chromium content and exceptional heat resistance, making them ideal for extreme environments such as jet engines and gas turbines [3]. Additionally, Inconel superalloys exhibit excellent resistance to corrosion and creep, ensuring long-term durability and reliability in harsh operating conditions. Maintaining those properties during welding as well as repairing using welding techniques are vital tasks, and they have been widely investigated [4,5,6,7].
The fundamental principle behind using artificial neural networks (ANNs) in welding quality monitoring is their ability to learn from data. By analyzing numerous parameters associated with the welding process, such as temperature, voltage, current, and feed rate, ANNs can identify complex relationships between these variables and the quality of the weld. This capability allows for the prediction of weld quality outcomes with high accuracy, even in the presence of variability in input parameters or environmental conditions. In the realm of research incorporating ANNs into welding practices, the advent of the error back-propagation algorithm in the mid-1980s marked the beginning of the ANN’s extensive application across various welding methodologies. This includes utilizing ANNs for predicting the quality of welds based on control parameters, recommending optimal welding control parameters to achieve specific weld characteristics, deriving profiles from laser vision sensing images, and employing vision sensors for quality and seam tracking in welding processes [8,9,10,11,12,13,14,15,16,17,18]. Furthermore, machine learning techniques have been extensively adopted in diverse welding procedures. These applications encompass leveraging deep learning and reinforcement learning for controlling laser welding, utilizing deep learning for the prediction of weld quality in arc welding, and implementing Support Vector Machine (SVM), a specific machine learning algorithm, for the classification of weld quality [11,12,13,14].
The prediction of weld mechanical properties based on temperature measurements using machine learning techniques represents a groundbreaking approach in the field of welding research and quality control. By leveraging the capabilities of machine learning algorithms, such as regression models, neural networks, or decision trees, researchers and engineers can accurately forecast the mechanical properties of welds, such as tensile strength, hardness, and ductility, from temperature data collected during the welding process. This method hinges on the principle that the thermal history of a weld zone is intricately linked to its microstructural evolution, which in turn dictates the mechanical properties of the weld. Machine learning models are trained on datasets comprising temperature profiles and corresponding mechanical properties from numerous welding experiments. Once trained, these models can predict the mechanical outcomes of new welds based solely on their thermal signatures. This predictive modeling offers immense potential for optimizing welding parameters in real time to achieve desired mechanical properties, significantly enhancing the efficiency and reliability of welding operations. It also minimizes the need for costly and time-consuming post-weld mechanical testing, thereby streamlining the manufacturing process. The use of machine learning for predicting weld mechanical properties from temperature measurements is a vivid illustration of how digital technologies are transforming traditional manufacturing practices, paving the way for smarter, more adaptable, and efficient production systems.
The knowledge about the welding process state and, finally, about the quality and properties of joints is based on observations and measurements using different type of sensors. A physical sensor responds to physical inputs such as temperature, noise, vibrations, or light intensity, converting these into impulses, usually in the form of electrical signals that can be digitized and recorded. In contrast, a virtual sensor, which operates solely on software, autonomously generates outputs by synthesizing and integrating data received (either synchronously or asynchronously) from physical sensors or other virtual sensors [15]. Virtual sensors exclusively utilize data collected by physical sensors. The information they produce is commonly incorporated into more sophisticated functions or software applications. These applications amalgamate this input with data from additional sources and apply analytical algorithms to the aggregated dataset [16,17]. These sensors are favored because they are adaptable, cost-effective, and capable of measuring elements that are challenging to assess due to their complexity [16]. In welding practice, virtual sensors are applied to predict weld bead geometry based on process parameters [18], the detection of wear of the secondary cable of a welding gun [19], and the control of robotic welding [20].
In the case of the welding process and the prediction of mechanical properties like hardness or impact strength, the main drawback limiting the possibility of the elaboration and application of these methods is the necessity of gathering a relatively large amount of real-life data. This demands the performance of many welding trials with different process parameters to obtain samples with different qualities of joints [21,22]. Next, proper analysis must be made, which is preceded with the cutting of samples, etching, etc. [23,24,25]. This high workload cannot be omitted by sample generation using, e.g., finite-element-method simulation. This is the case because in simulations for fixed sets of parameters, the same results will always be obtained [26,27,28]. During welding for the same set of parameters, slightly different results are gathered due to differences in the material structure or temporary changes in process conditions [29,30,31].
In this paper, the design and application of a novel virtual sensor that can be used to predict changes in hardness in the cross-section of a welded joint is described. The key idea was to apply temperature profiles gathered on the surface of a welded workpiece in three different distances of the prediction area (under the welding torch). The main innovation is the transformation from a two-dimensional temperature matrix into a hardness vector, which can be used directly during manufacturing to evaluate local faults of welding that lead to disturbance or the lowering of joint quality and mechanical properties.

2. Materials and Methods

To develop a virtual sensor of acceptable quality, several steps must be taken (Figure 1). Initially, an active experiment should be conducted where joints are produced under various process settings. Throughout this process, the temperature distribution on the surface of the workpiece samples is recorded. In the subsequent step, the samples are sectioned, grouped into sets for each, and secured through hot mounting. Following this, the specimens are subjected to grinding and polishing to achieve a high-quality surface, making them suitable for hardness testing. The hardness of each sample is determined using the Vickers hardness test. The collected hardness data are then linked with the corresponding thermal profiles. Ultimately, this dataset is utilized to develop an artificial neural network designed to forecast the hardness distribution across the cross-section of welded joints.

2.1. Welding of Test Joints

The test samples, crafted from the nickel superalloy Inconel 600, were subjected to TIG welding and were all fabricated from 1.2 mm thick sheets. These materials were procured from Huntington Alloys Corporation located in the Huntington, WV, USA. The creation of this material entailed an industrial procedure, which included melting the Inconel 600 inside an electric furnace. Following the melting process, the material underwent plastic deformation through cold rolling, which was intermittently coupled with a heat treatment process known as recrystallization annealing. The chemical composition of the used material is shown in Table 1.
All workpieces were joined using the Casto TIG 2002 device (Castolin Eutectic Gmbh, Kriftel, Germany, Figure 2). The TIG welding of thin sheets was performed under laboratory conditions with the following constant parameters: shield gas flow Ar 12 L/min, ridge shield gas flow Ar 3 L/min. For welding a tungsten electrode (thoriated), type WT20 (diameter 2.4 mm) was used.
The temperature distribution across the welded joints was captured using an FILR A655sc infrared camera, as shown in Figure 1. This camera boasted a spatial resolution of 640 × 480 pixels and a 16 bit dynamic range and was calibrated with an emissivity setting of ε = 0.13. The change in emissivity related to temperature variation was disregarded for the methodologies applied, as there was no requirement to differentiate temperatures between the molten and solidified areas of the joint. Additionally, any reflections emanating from the intense heat of the welding torch and the welding arc itself were adjusted for using a fixed reflected temperature value. Infrared images were recorded at a frame rate of 60 fps. The optical axis of the camera was positioned at an 87-degree angle to the sample’s plane, maintaining a 600 mm gap from the welded object. Data post-processing and analysis was performed in the MATLAB R2023b environment with the use of an additional Teledyne FLIR Science File SDK (to read and process IR sequences).
Joints were made for various sets of process parameters, which are shown in Table 2. The selection of parameters was conducted in order to achieve joints differing in mechanical properties. The resulting joint face is presented in Figure 3. It can be seen that the seam width as well as the discoloration of welds is different for various sets of parameters that are causing different amounts of heat input.

2.2. Hardness Examination

To examine the joint zone (JT), the heat-affected zone (HAZ), and the base material area (BM), Adler’s reagent was applied to the joint surfaces. This etchant is composed of 3 g of ammonium chlorocuprate ((NH4)3(CuCl4)), 20 mL of distilled water, 50 mL of hydrochloric acid (HCl), and 15 g of iron chloride (FeCl3). The etching process was performed incrementally, lasting between 10 and 15 s at ambient temperature. Macro-level examination of the etched joints was conducted with an OLYMPUS GX71 light microscope by Olympus Corporation (Tokyo, Japan), featuring up to 50× magnification. The breadth of the HAZ and the dimensions of the welded joint’s face and ridge were accurately measured to within ±0.1 mm using metallographic analysis under a microscope. Metallographic examinations at the microscopic level involved analyzing welded joint samples cut across the weld’s longitudinal axis. These samples were set in Duracryl Plus self-hardening resin (Figure 4), then sequentially sanded on water-based abrasive sheets ranging from 320 to 1000 grit. With each switch in abrasive paper, the sanding direction was altered by 90°. The samples were then polished on a Struers Planopol-3 machine (Struers A/S, Ballerup, Denmark) using a felt disk and an Al2O3 water suspension. The hardness of the cross-sectional areas was measured employing the Struers DuraScan 50 hardness tester (Henri Hauser AG, Biel, Switzerland) with a force of 9.807 N; thus, the hardness of 1 HV (or HV) was measured.

2.3. Data Processing and Neural Model Elaboration

The first stage that influences results is the extraction of temperature profiles. For test purposes, three profiles were extracted, and the offset between them was 50 px. Due to perspective distortion, profiles were cut out in the bottom area of the thermogram, which represented the region closer to the welding torch. In this region, geometric distortion was low, and the image was in focus. As there was a constant welding speed set on the automated weld stand (Figure 2), there was a linear relationship between welding speed and the position of the welded workpiece. Additionally, thermograms were recorded with a constant framerate; thus, an IR image where the workpiece was in an assumed position in relation to the reference point was developed. Thanks to these dependencies, thermograms were found, in which the lowest profile (Slice 1, Figure 5) was in the approximate location at which the workpiece was cut apart to create samples for hardness measurements.
Extracted profiles, three for each image, were linked with corresponding hardness profiles. Thus, a pair of input data to virtual sensor and expected sensor output was created.
To find the best combination of networks’ topologies and hyperparameters, the MATLAB Experiment Manager was used. The general structure of the network is presented in Figure 6. The network consists of LSTM Layers (one or two), a fully connected layer (FC), a rectified linear unit layer (ReLU), and a dropout layer. The LSTM architecture includes cell states and gates (input, forget, and output gates) that control the flow of information, allowing the network to retain or discard information over long sequences. The network’s ability to selectively remember and forget information allows it to capture intricate patterns and relationships in the sequence data. The ReLU layer is used to introduce non-linearity into the model, while the dropout layer realizes a regularization task that is used to prevent overfitting.
Three parameters were optimized during one experiment session: LSTM network depth, number of hidden units, and initial learning rate. LSTM network depth is a parameter that directly influences the topology of the network. After the input layer, a number of LSTM layers is present. The first experiment was a preliminary one. In this one, only the suitability of the general network topology was checked, without judging the values of creatin parameters. The number of layers was optimized and the best value was searched for in a range from one layer to seven layers in experiment 2 and [1; 2] in experiment 3, respectively. The number of LSTM layers affects a model’s capacity to learn hierarchical patterns and long-term dependencies, with more layers enabling deeper feature extraction but increasing the risk of overfitting and computational complexity. Balancing the number of layers is crucial for achieving optimal performance without excessive overfitting or excessive training time. The next hyperparameter that was optimized was the number of hidden units in each LSTM layer. In this case, the search range was [10; 600] in experiment 2 and [1; 900] in experiment 3. The number of hidden units determines the capacity of a model to learn and represent complex patterns in the data. It also affects the model’s ability to generalize from training data to unseen data and influences the ability of the LSTM to retain and utilize information over long sequences. The initial learning rate range was [0.001; 0.3] in both experiments. The initial learning rate is crucial for determining the convergence speed, stability, and final performance of an LSTM network; a high learning rate can lead to fast but potentially unstable convergence, while a low learning rate results in slower, more precise training. A wider range of parameters in the case of the second experiment was chosen to check a field of possible solutions. Then, the final, optimal network was selected using only a limited range of parameters in which the previous best ones were placed.

3. Results and Discussion

The elaboration of the neural model for a virtual sensor started with training pairs’ extraction. There were 93 hardness profiles measured for nine welded test pieces. Corresponding thermal profiles were found in the sequences of thermograms taken during the welding. Exemplary temperature profiles and resulting hardness profiles are presented in Figure 7 and Figure 8. For further calculations, temperature was standardized using the z-score distance measure. It can be noticed that slice 1, representing temperature profile, which is located closest to the welding pool, has the shape that is most relevant in the context of temperature changes in the joint.
After analyzing the results from all performed experiments (see Appendix A), the two best models were selected according to MAE. The detailed results for the two best models, N30e3 and N04e3, and for the reference model that gave weak results (N33e2) are shown in Table 3. It can be noticed that there were quite large differences between hardness profile prediction quality within one model for various welded samples. For example, for N30e3, which was considered as the best model, the MAE varied from 24.72 to 47.54. Moreover, this model was not the best choice for all test samples, as for 12.2.5 and 12.5.2, N04e3 performed better according to MAE. Because of this, both models were further evaluated in detail.
The structure of the N30e3 network is presented in Table 4. The network had eight layers and 8.7 million learnable parameters in total. In contrast, the N04e3 network was smaller and had 7 million learnables. The training time of each individual network was similar for all models, and it was in the range of one to two minutes.
Initially, a subjective assessment of the results obtained from three selected models was conducted. Relevant results from the samples are shown in Figure 9, Figure 10, Figure 11 and Figure 12. The first observed phenomenon concerns the shape of the obtained hardness profiles. In the case of the N04e3 models, the better representation of transition zones, where a decrease in hardness values occurs before the weld and then increases, was observed in most cases. On the other hand, regarding the representation of hardness values in the weld zone, the responses obtained from the N04e3 model are characterized by the better representation of minimum values. However, responses from the N30e3 model tend to indicate maximum values obtained in the weld area.
To quantify the similarity between models, additional metrics were used, as the subjective assessment of predicted shapes of hardness profiles differs from the objective one. This is especially the case when results seem to differ significantly after visual investigation, but the difference in the value of the mean maximal absolute error is low. In order to investigate the performance of the selected models, which are the core of virtual sensors, in more detail, several additional similarity measures were applied. The first are common distance measures: Euclidean distance and Manhattan distance [32]. Those measures allow one to measure the straight-line distance between two points in Euclidean space. They are simple approaches but might not be effective for time series that are shifted in time or amplitude. The next applied measure is the cosine similarity [33]. It measures the cosine of the angle between two vectors, which can be useful for understanding the similarity between two series regardless of their magnitude. Another simple and commonly used metric is the Pearson correlation [28]. It can be used to assess the similarity of vectors regardless of their average values and variability, but at the same time, this type of correlation assumes that the relationship is linear and that the data are normally distributed, which might not always be the case in real-world data. The longest common subsequence (LCSS) is a method used to measure similarity between two sequences by identifying the longest subsequence present in both sequences without changing the order of items [34]. This method is beneficial in problems where patterns over time/location are more important than the actual values of data points. The final approaches used are dynamic time warping (DTW) and restricted time warping [35]. DTW allows the stretching and compressing of data series to find an optimal match, making it more suitable for time series that may vary in speed. In the restricted version of DTW, additional constraints are applied on the warping window, limiting how far the alignment can stray locally. The purpose of this is to prevent extreme distortions in the time alignment, which might be irrelevant.
Applying eight described measures led to a set of results (Table 5, Figure 13). First, it can be noticed that in most cases, the general order of model performances stands. Nevertheless, for the cosine similarity, the results for sample 12.9.5 (Figure 11) are opposite to those of the visual assessment of the hardness profile outputted by models. In this case, CS suggests that the results given by model N33e2 are better than the output from the N04e3 model. This is incorrect, because N04e3 results in a general shape and approximate value of hardness change in the joint area that is well reproduced, while the N33e2 model only produces a straight line. For other metrices, there is common disagreement when evaluating the quality of the N04e3 and N33e3 models. The comparison of LCSS and RDTW is especially interesting and gives insights into how models behave for certain data inputs. The LCSS measures more relevant positions, similar to DTW and RDTW. E.g., in the case of sample 12.10.4 (Figure 12), the large advantage of the N30e3 model is visible. It can be seen, when analyzing the plots of ground truth and predicted profiles, that the N30e3 model converges better with real data, as the left slope of the hardness decrease in the joint is closer to the real one, and for the right slope, where hardness increases, the offset between the real data and predicted data is smaller than that in the case of the N04e3 model. In DTW, where the translation of the hardness profile is less important than its shape, the N04e3 model is favorable, because the predicted hardness profile (and also the exact hardness values) is closer to the real data, mainly in the joint part, but it is translated. The property of LCSS, in which some points of profiles can remain unmatched, leads to intuitively better results in this case, because no correspondence has to be found for noisy or degraded regions.

4. Conclusions and Future Developments

This contribution aims to introduce the current state-of-the-art deep learning techniques to the prediction of hardness distribution on the cross-section of a welded joint. The prediction is based on a virtual sensor that utilizes information about the process temperature recorded on the workpiece surface. The proposed method was tested on real-life data obtained during an active welding experiment, where welded joints were produced for the same type of welded material using various process parameters. The conclusions obtained in this paper can be summarized in the following points:
  • A method was developed to be applied to predict the hardness of joints made using TIG (GTAW—gas tungsten arc welding).
  • The selected neural networks, being the bases of the virtual sensor, have two LSTM layers and 746 and 851 neurons in each layer, respectively.
  • The best hardness profile prediction was made with N04e3. In this case, the MAE was 19.62 HV. The best overall performance was obtained for the N30e3 model, for which the average MAE for all verification samples was 34.12 HV.
  • The application of profile similarity measurements allowed the in-depth investigation of virtual sensor performance. It was revealed that MAE global error is good for quantifying the overall quality of model output, but similarity measures like longest common subsequence (LCSS) and restricted dynamic time warping (RDTW) can also be successfully applied to quantify local quality, especially in the case of transient profile regions between joints and base materials.
The main question that arose at the stage of result analysis was whether the obtained results were suitable enough to indisputably state that joints can be accepted as meeting quality requirements in terms of mechanical properties. As the dataset used to train neural models was limited, the identification of hardness deviations, especially in the heat-affected zone, was insufficient. Local changes, especially increases in hardness within the heat-affected zone, remained unrepresented. Additionally, there were no local hardness changes in the fusion zone, which would manifest as temperature variations in the input profiles. On the other hand, the decrease in hardness in the fusion zone was accurately replicated (within the range of mean values). The width of the zone with reduced hardness was also effectively predicted.
Possible directions for further development are grouped into three main areas. First of all, additional samples have to be welded and new data acquired for different material geometries (e.g., the thickness of welded sheets). The authors assume that there can be a neural model that is specialized in assessing certain types of joints made from a single material or for a small group of related materials. The second direction is connected to the enhancement of model input space to allow signals from other sensors and process parameters to be used. The last considered development path is devoted to the further optimization of the neural model in terms of structure and other error or similarity measures that would be used to steer network training.

Author Contributions

Conceptualization, W.J., B.G.F. and J.G.; methodology, W.J. and J.G.; software, W.J. and B.W.; validation, W.J. and J.G.; formal analysis, W.J. and B.G.F.; investigation, W.J., B.W., M.K.-J. and J.G.; resources, W.J.; data curation, W.J., B.W. and M.K.-J.; writing—original draft preparation, W.J. and B.W.; writing—review and editing, J.G.; visualization, W.J. and B.G.F.; project administration, W.J.; funding acquisition, W.J. All authors have read and agreed to the published version of the manuscript.

Funding

The experimental part of this study was funded by the Polish National Science Centre (NCN), Miniatura 3 project (2019), grant number 2019/03/X/ST8/00422.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

The data presented in this study are available on request from the corresponding author. The data are not publicly available because the authors do not wish to publish additional material.

Conflicts of Interest

The authors declare that they have no conflicts of interest. The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript, or in the decision to publish the results.

Appendix A

The detailed results of the training and validation of models with various hyperparameter values have been compiled in the appendix.
Table A1. Neural model training results achieved in experiment no. 2.
Table A1. Neural model training results achieved in experiment no. 2.
TrialLSTM DepthNumber of Hidden UnitsInitial Learning RateTraining RMSETraining LossValidation RMSEValidation LossMean Max Absolute
Error
165360.001931.43493.8620.97219.8343.28
271350.068829.79443.8122.69257.3943.82
344990.078633.82572.0428.47405.2954.32
432250.001731.79505.4515.43119.0540.86
532700.001831.51496.5116.52136.4151.16
675060.001031.58498.7320.68213.8040.92
774350.001031.93509.7421.60233.2254.33
832030.002034.27587.2521.80237.6652.01
975990.001031.59498.8722.89262.0852.86
107130.108227.13368.0121.69235.3044.20
117100.021430.80474.3923.21269.2653.60
1222230.263850.551277.7822.25247.4542.28
134590.299835.60633.6623.00264.4842.12
1471780.298538.37736.1723.57277.8945.24
152140.116227.51378.3915.78124.4540.77
162120.299330.51465.4823.54277.0848.56
1731380.082631.83506.6332.29521.2557.14
1826000.295841.85875.8822.57254.7643.01
1976000.134739.64785.5366.972242.2897.55
206210.298732.00512.1227.31372.9150.03
2124070.299539.56782.4625.38322.1450.04
2245350.001031.90508.8216.01128.2348.44
2326000.028435.99647.5922.32249.1944.59
2425210.006026.36347.3616.52136.5040.01
2525990.003228.18397.1814.89110.9036.87
2626000.001532.73535.6818.36168.5042.04
2726000.004530.58467.5818.70174.9338.34
2826000.005225.97337.1918.75175.6942.16
2924880.002431.13484.4015.98127.7340.96
305100.001033.28553.6423.47275.3358.03
3124950.006026.31346.2116.62138.0736.60
3224670.007828.54407.3417.69156.4540.91
332120.001030.45463.6323.82283.7663.44
3471060.001033.20551.0523.15267.9656.99
3573870.020932.36523.6024.07289.7143.84
3625580.003830.53465.9717.68156.2239.77
3752950.145139.06763.0148.281165.2675.82
3824990.019931.38492.4322.90262.2543.97
393350.066926.99364.3019.04181.2342.28
407950.296355.291528.5334.93610.0164.52
4134910.005029.40432.0716.13130.0940.13
4271710.028330.73472.0924.38297.1245.49
4325800.003331.44494.2417.65155.7142.65
442580.151530.34460.2818.62173.4242.21
4564950.003529.47434.3219.47189.4641.13
4654260.022831.03481.5722.65256.4541.94
4721750.005928.98419.8214.48104.8637.16
487440.007331.03481.5121.08222.1242.30
4922090.004830.37461.2916.30132.8638.01
5073040.005726.68355.8019.71194.3439.66
Table A2. Neural model training results achieved in experiment no. 3.
Table A2. Neural model training results achieved in experiment no. 3.
TrialLSTM DepthNumber of Hidden UnitsInitial Learning RateTraining RMSETraining LossValidation RMSEValidation LossMean Max Absolute
Error
11850.178728.53407.0317.98161.6443.80
22670.001531.42493.7523.22269.6960.36
321380.083034.28587.6025.88334.9853.39
427640.001127.09366.9714.87110.5436.67
526880.019335.12616.6720.79216.1745.90
628070.271727.37374.5021.30226.9441.82
727470.232340.38815.4320.13202.7042.25
828990.001133.48560.6116.58137.4240.28
926620.001031.17485.8914.24101.4237.75
101590.002327.13368.1316.56137.1149.37
1116250.293955.651548.2320.15202.9745.01
1217750.001026.76357.9516.64138.4855.67
1327420.001927.73384.5815.06113.3640.03
1427420.001030.31459.2715.89126.3039.82
1527370.001030.17455.0117.14146.9038.91
1619000.048232.65532.8923.76282.3648.17
1714240.013529.91447.3319.83196.5444.49
1823780.001032.64532.6616.77140.6742.87
1926020.001032.19517.9917.38151.0240.09
2027510.001034.19584.3415.79124.7239.47
2113820.001028.21397.8017.95161.0468.02
2227450.001431.98511.4615.23115.9836.84
2329000.001527.94390.2516.11129.7538.02
2427500.001330.22456.7115.15114.7838.39
251150.051722.36250.0718.37168.7840.69
26140.023423.91285.8717.81158.6740.14
2712720.047639.05762.6318.97179.8642.77
2829000.003425.69329.9615.47119.5937.06
2929000.004125.08314.5318.05162.8840.16
3028510.002027.55379.5013.7494.4635.79
3128530.002129.30429.2314.93111.4236.76
3228650.002125.62328.2014.23101.2537.88
332150.299929.77443.0620.93219.0344.63
3419000.006229.39431.8815.78124.4538.63
3528990.002226.69356.0715.65122.5437.30
3629000.077737.14689.8323.05265.7049.53
3718980.010932.31521.9118.47170.5039.36
3824650.299831.46494.7220.26205.1842.06
3928990.002228.72412.4914.0498.6337.18
40210.012027.91389.5816.80141.1539.76
4128980.002628.44404.3120.97219.9341.35
4223860.008329.69440.8418.48170.7442.51
4328990.001730.36460.8116.51136.3737.91
44130.007926.76358.1617.12146.6241.20
4518990.145446.551083.5835.68636.4061.21
4615810.005825.51325.2615.92126.6637.83
4718730.003827.88388.7816.77140.6741.64
4817100.007329.28428.6918.17165.1340.70
4913240.005029.75442.6718.97179.9044.51
50210.020327.58380.4117.63155.4941.35

References

  1. Chen, H.; Pinkerton, A.J.; Li, L. Fibre laser welding of dissimilar alloys of Ti-6Al-4V and Inconel 718 for aerospace applications. Int. J. Adv. Manufact. Technol. 2011, 52, 977–987. [Google Scholar] [CrossRef]
  2. Holub, L.; Dunovský, L.; Kovanda, K.; Kolařík, L. SAW—Narrow Gap Welding CrMoV Heat-resistant Steels Focusing to the Mechanical Properties Testing. Procedia Eng. 2015, 100, 1640–1648. [Google Scholar] [CrossRef]
  3. Pedroso, A.F.V.; Sousa, V.F.C.; Sebbe, N.P.V.; Silva, F.J.G.; Campilho, R.D.S.G.; Sales-Contini, R.C.M.; Nogueira, F.R. A Review of INCONEL® Alloy’s Non-conventional Machining Processes. In Flexible Automation and Intelligent Manufacturing: Establishing Bridges for More Sustainable Manufacturing Systems; Silva, F.J.G., Pereira, A.B., Campilho, R.D.S.G., Eds.; FAIM 2023. Lecture Notes in Mechanical Engineering; Springer: Cham, Switzerland, 2024. [Google Scholar] [CrossRef]
  4. Dinda, G.P.; Dasgupta, A.K.; Mazumder, J. Laser Aided Direct Metal Deposition of Inconel 625 Superalloy: Microstructural Evolution and Thermal Stability. Mater. Sci. Eng. A 2009, 509, 98–104. [Google Scholar] [CrossRef]
  5. Ma, D.; Stoica, A.D.; Wang, Z.; Beese, A.M. Crystallographic Texture in an Additively Manufactured Nickel-Base Superalloy. Mater. Sci. Eng. A 2017, 684, 47–53. [Google Scholar] [CrossRef]
  6. Sonar, T.; Balasubramanian, V.; Malarvizhi, S.; Venkateswaran, T.; Sivakumar, D. An overview on welding of Inconel 718 alloy—Effect of welding processes on microstructural evolution and mechanical properties of joints. Mater. Charact. 2021, 174, 110997. [Google Scholar] [CrossRef]
  7. German, C.; Lin, X. GTAW Welded Inconel 625 Alloy Fuel Cladding for the Canadian SCWR: Microstructure and Mechanical Property Characterization. ASME J. Nucl. Rad. Sci. 2021, 7, 031304. [Google Scholar] [CrossRef]
  8. Andersen, K.; Cook, G.E.; Karsai, G.; Ramaswamy, K. Artificial Neural Networks Applied to Arc Welding Process Modeling and Control. IEEE Trans. Ind. Appl. 1990, 26, 824–830. [Google Scholar] [CrossRef]
  9. Cook, G.E.; Barnett, R.J.; Andersen, K.; Strauss, A.M. Weld Modeling and Control Using Artificial Neural Networks. IEEE Trans. Ind. Appl. 1995, 31, 1484–1491. [Google Scholar] [CrossRef]
  10. Moon, H.S.; Na, S.J. A Neuro-Fuzzy Approach to Select Welding Conditions for Welding Quality Improvement in Horizontal Fillet Welding. J. Manuf. Syst. 1996, 15, 392–403. [Google Scholar] [CrossRef]
  11. Guenther, J.; Pilarski, P.M.; Helfrich, G.; Shen, H.; Diepold, K. Intelligent Laser Welding Through Representation, Prediction, and Control Learning: An Architecture with Deep Neural Networks and Reinforcement Learning. Mechatronics 2016, 34, 1–11. [Google Scholar] [CrossRef]
  12. Kim, M.S.; Shin, S.M.; Kim, S.; Rhee, D.H. A Study on the Algorithm for Determining Back Bead Generation in GMA Welding Using Deep Learning. J. Weld. Join. 2018, 36, 74–81. [Google Scholar] [CrossRef]
  13. Petkovic, D. Prediction of Laser Welding Quality by Computational Intelligence Approaches. Optik 2017, 140, 597–600. [Google Scholar] [CrossRef]
  14. Chen, J.; Wang, T.; Gao, X.; Wei, L. Real-Time Monitoring of High-Power Disk Laser Welding Based on Support Vector Machine. Comput. Ind. 2018, 94, 75–81. [Google Scholar] [CrossRef]
  15. Kabadayi, S.; Pridgen, A.; Julien, C. Virtual sensors: Abstracting data from physical sensors. In Proceedings of the International Symposium on a World of Wireless, Mobile and Multimedia Networks, Buffalo-Niagara Falls, NY, USA, 26–29 June 2006; pp. 587–592. [Google Scholar] [CrossRef]
  16. Liu, L.; Kuo, S.; Zhou, M. Virtual sensing techniques and their applications. In Proceedings of the 2009 International Conference on Networking, Sensing and Control, Okayama, Japan, 26–29 March 2009; pp. 31–36. [Google Scholar]
  17. Ko, J.; Lee, B.-B.; Lee, K.; Hong, S.G.; Kim, N.; Paek, J. Sensor virtualization module: Virtualizing IoT devices on mobile smartphones for effective sensor data management. Int. J. Distrib. Sens. Netw. 2015, 11, 730762. [Google Scholar] [CrossRef]
  18. Fernández-Zabalza, A.; Veiga, F.; Suárez, A.; López, J.R.A. The Use of Virtual Sensors for Bead Size Measurements in Wire-Arc Directed Energy Deposition. Appl. Sci. 2024, 14, 1972. [Google Scholar] [CrossRef]
  19. Ibáñez, D.; Garcia, E.; Soret, J.; Martos, J. Incipient Wear Detection of Welding Gun Secondary Circuit by Virtual Resistance Sensor Using Mahalanobis Distance. Sensors 2023, 23, 894. [Google Scholar] [CrossRef] [PubMed]
  20. Cederberg, P.; Olsson, M.; Bolmsjö, G. Virtual triangulation sensor development, behavior simulation and CAR integration applied to robotic arc-welding. J. Intell. Robot. Syst. 2002, 35, 365–379. [Google Scholar] [CrossRef]
  21. Górka, J. Analysis of simulated welding thermal cycles S700MC using thermal imaging camera. Mod. Technol. Ind. Eng. 2014, 837, 375. [Google Scholar] [CrossRef]
  22. Kik, T.; Górka, J.; Kotarska, A.; Poloczek, T. Numerical Verification of Tests on the Influence of the Imposed Thermal Cycles on the Structure and Properties of the S700MC Heat-Affected Zone. Metals 2020, 10, 974. [Google Scholar] [CrossRef]
  23. Jamrozik, W.; Górka, J.; Kik, T. Temperature-Based Prediction of Joint Hardness in TIG Welding of Inconel 600, 625 and 718 Nickel Superalloys. Materials 2021, 14, 442. [Google Scholar] [CrossRef]
  24. Jamrozik, W.; Gorka, J. Assessing MMA Welding Process Stability Using Machine Vision-Based Arc Features Tracking System. Sensors 2021, 21, 84. [Google Scholar] [CrossRef] [PubMed]
  25. Zhou, X.; Chen, M.; Shang, W.; Shen, H.; Xu, H. Real time Monitoring Method of Welding Defects Based on LSTM Sequence Model. In Proceedings of the 2023 IEEE 3rd International Conference on Information Technology, Big Data and Artificial Intelligence (ICIBA), Chongqing, China, 26–28 May 2023; pp. 1203–1207. [Google Scholar] [CrossRef]
  26. Shang, L.; Zhang, Z.; Tang, F.; Cao, Q.; Yodo, N.; Pan, H.; Lin, Z. Deep Learning Enriched Automation in Damage Detection for Sustainable Operation in Pipelines with Welding Defects under Varying Embedment Conditions. Computation 2023, 11, 218. [Google Scholar] [CrossRef]
  27. Luo, Z.; Wu, D.; Zhang, P.; Ye, X.; Shi, H.; Cai, X.; Tian, Y. Laser Welding Penetration Monitoring Based on Time-Frequency Characterization of Acoustic Emission and CNN-LSTM Hybrid Network. Materials 2023, 16, 1614. [Google Scholar] [CrossRef] [PubMed]
  28. Shi, Y.H.; Wang, Z.S.; Chen, X.Y.; Cui, Y.-X.; Xu, T.; Wang, J.-Y. Real-time K-TIG welding penetration prediction on embedded system using a segmentation-LSTM model. Adv. Manuf. 2023, 11, 444–461. [Google Scholar] [CrossRef]
  29. Li, L.; Cheng, F.; Wu, S. An LSTM-based measurement method of 3D weld pool surface in GTAW. Measurement 2021, 171, 108809. [Google Scholar] [CrossRef]
  30. Li, H.; Ma, Y.; Duan, M.; Wang, X.; Che, T. Defects detection of GMAW process based on convolutional neural network algorithm. Sci. Rep. 2023, 13, 21219. [Google Scholar] [CrossRef] [PubMed]
  31. Kumaresan, S.; Aultrin, K.S.J.; Kumar, S.S.; Anand, M.D. Transfer Learning With CNN for Classification of Weld Defect. IEEE Access 2021, 9, 95097–95108. [Google Scholar] [CrossRef]
  32. Chang, F.; Zhou, G.; Ding, K.; Li, J.; Jing, Y.; Hui, J.; Zhang, C. A CNN-LSTM and Attention-Mechanism-Based Resistance Spot Welding Quality Online Detection Method for Automotive Bodies. Mathematics 2023, 11, 4570. [Google Scholar] [CrossRef]
  33. Cassisi, C.; Montalto, P.; Aliotta, M.; Cannata, A.; Pulvirenti, A. Similarity Measures and Dimensionality Reduction Techniques for Time Series Data Mining. In Advances in Data Mining Knowledge Discovery and Applications; IntechOpen: London, UK, 2012. [Google Scholar] [CrossRef]
  34. Li, B.; Han, L. Distance Weighted Cosine Similarity Measure for Text Classification. In Intelligent Data Engineering and Automated Learning—IDEAL 2013. IDEAL 2013. Lecture Notes in Computer Science; Yin, H., Tang, K., Gao, Y., Klawonn, F., Lee, M., Weise, T., Li, B., Yao, X., Eds.; Springer: Berlin/Heidelberg, Germany, 2013; Volume 8206. [Google Scholar] [CrossRef]
  35. Bergroth, L.; Hakonen, H.; Raita, T. A survey of longest common subsequence algorithms. In Proceedings of the Seventh International Symposium on String Processing and Information Retrieval (SPIRE), A Curuna, Spain, 27–29 September 2000; pp. 39–48. [Google Scholar] [CrossRef]
Figure 1. Diagram of performed research stages.
Figure 1. Diagram of performed research stages.
Sensors 24 03569 g001
Figure 2. Welding device, TIG torch, and IR camera used during studies.
Figure 2. Welding device, TIG torch, and IR camera used during studies.
Sensors 24 03569 g002
Figure 3. Welded samples made during the experiment. The side of the weld face is shown.
Figure 3. Welded samples made during the experiment. The side of the weld face is shown.
Sensors 24 03569 g003
Figure 4. Package of samples after inclusion in self-hardener resin. Samples extracted from workpiece no. 12.2.
Figure 4. Package of samples after inclusion in self-hardener resin. Samples extracted from workpiece no. 12.2.
Sensors 24 03569 g004
Figure 5. Thermogram taken during welding process of sample 12.1. With red lines, horizontal profiles are marked. From this IR image and corresponding hardness profile, training pair no. 12.1.2 was crated.
Figure 5. Thermogram taken during welding process of sample 12.1. With red lines, horizontal profiles are marked. From this IR image and corresponding hardness profile, training pair no. 12.1.2 was crated.
Sensors 24 03569 g005
Figure 6. Schematic diagram of neural network used as a virtual sensor for hardness prediction.
Figure 6. Schematic diagram of neural network used as a virtual sensor for hardness prediction.
Sensors 24 03569 g006
Figure 7. Visualization of training data pair no. 12.1.2.
Figure 7. Visualization of training data pair no. 12.1.2.
Sensors 24 03569 g007
Figure 8. Visualization of training data pair no. 12.2.2.
Figure 8. Visualization of training data pair no. 12.2.2.
Sensors 24 03569 g008
Figure 9. Results of virtual sensor testing for sample no. 12.2.5: (a) model N04e3; (b) model N30e3; (c) model N33e2; (d) input data.
Figure 9. Results of virtual sensor testing for sample no. 12.2.5: (a) model N04e3; (b) model N30e3; (c) model N33e2; (d) input data.
Sensors 24 03569 g009
Figure 10. Results of virtual sensor testing for sample no. 12.8.6: (a) model N04e3; (b) model N30e3; (c) model N33e2; (d) input data.
Figure 10. Results of virtual sensor testing for sample no. 12.8.6: (a) model N04e3; (b) model N30e3; (c) model N33e2; (d) input data.
Sensors 24 03569 g010
Figure 11. Results of virtual sensor testing for sample no. 12.9.5: (a) model N04e3; (b) model N30e3; (c) model N33e2; (d) input data.
Figure 11. Results of virtual sensor testing for sample no. 12.9.5: (a) model N04e3; (b) model N30e3; (c) model N33e2; (d) input data.
Sensors 24 03569 g011
Figure 12. Results of virtual sensor testing for sample no. 12.10.4: (a) model N04e3; (b) model N30e3; (c) model N33e2; (d) input data.
Figure 12. Results of virtual sensor testing for sample no. 12.10.4: (a) model N04e3; (b) model N30e3; (c) model N33e2; (d) input data.
Sensors 24 03569 g012
Figure 13. Similarity of real and predicted hardness profile measured with different metrices: (a) Pearson correlation; (b) Euclidean distance; (c) Manhattan distance; (d) cosine similarity; (e) longest common subsequence; (f) dynamic time warping (DTW); (g) restricted dynamic time warping, window length 1; (h) restricted dynamic time warping, window length 5.
Figure 13. Similarity of real and predicted hardness profile measured with different metrices: (a) Pearson correlation; (b) Euclidean distance; (c) Manhattan distance; (d) cosine similarity; (e) longest common subsequence; (f) dynamic time warping (DTW); (g) restricted dynamic time warping, window length 1; (h) restricted dynamic time warping, window length 5.
Sensors 24 03569 g013
Table 1. Chemical composition of the investigated Inconel superalloys.
Table 1. Chemical composition of the investigated Inconel superalloys.
Super-
Alloy
Element Concentration, % wt
NiCrFeMoNbCoMnCuAlTiSiCSP
Inconel
600
74.4315.768.60-0.080.050.250.090.180.270.120.010.0020.005
Concentration proportion of elementsNb + Ta—0.08%; Ni + Co—74.48%, Ta—0.0002%
Table 2. TIG welding parameters used for the generation of samples.
Table 2. TIG welding parameters used for the generation of samples.
IDPlate
Thickness
mm
Current
A
Welding
Speed
mm/s
12.11.2603.0
12.21.2603.0
12.31.2605.0
12.41.2605.0
12.51.2604.0
12.61.2604.0
12.81.2607.0
12.91.2607.0
12.101.2704.0
Table 3. MAE results obtained for hardness prediction with use of two best models and reference model.
Table 3. MAE results obtained for hardness prediction with use of two best models and reference model.
ModelSampleAvg
12.1.612.2.512.3.412.4.312.5.212.6.112.6.712.8.612.9.512.10.4
N30e347.5433.5430.8824.7232.6634.3339.5729.3538.8729.7434.12
N04e352.0319.6231.6224.1629.6241.5349.1526.9255.9922.6035.32
N33e264.8281.2055.3450.6062.27101.1659.8254.0958.1754.2564.17
Table 4. Detailed structure of N30e3 network.
Table 4. Detailed structure of N30e3 network.
NameTypeLearnable Sizes
SISequential input, 3 dimensions-
LSTM_1LSTM with 851 unitsInput weights 3404 × 3
Recurrent weights 3404 × 851
Bias 344 × 1
LSTM_2LSTM with 851 unitsInput weights 3404 × 851
Recurrent weights 3404 × 851
Bias 344 × 1
FC_1100 fully connected layersWeights 100 × 851
Bias 100 × 1
ReLUReLU-
Dropout50% dropout-
FC_21 fully connected layerWeights 1 × 100
Bias 1 × 1
ROAbsolute mean squared error-
Table 5. Results of model assessment with different series similarity measures.
Table 5. Results of model assessment with different series similarity measures.
ModelSample
12.1.612.2.512.3.412.4.312.5.212.6.112.6.712.8.612.9.512.10.4
Manhattan Distance
N04e3826539642518466649686391781529
N30e3709574451410540595583350584408
N33e21133133711291081115513831299114311521077
Cosine Similarity
N04e30.99650.99820.99730.99920.99800.99620.99630.99930.99550.9981
N30e30.99550.99680.99800.99850.99790.99710.99720.99890.99740.9984
N33e20.99130.98830.99320.99390.99170.98680.99030.99580.99690.9931
Euclidean Distance
N04e31288210681801111176714581
N30e312299837491104986410178
N33e2172191156149162206185160170149
Longest Common Subsequence, Δ = 5
N04e331302828333327353533
N30e338383839333135453151
N33e22232121133
Pearson Correlation
N04e30.74300.90500.75030.92200.86340.83960.78470.89320.22340.8320
N30e30.65180.81590.81540.84890.84630.90560.86630.83720.46960.8537
N33e2−0.0883−0.1799−0.1032−0.0539−0.1588−0.3719−0.0551−0.0458−0.0442−0.1186
Dynamic Time Warping
N04e3388404288363337429513333548272
N30e3307317249234342430467245473205
N33e2113312271129108111551302129911431152989
Restricted Dynamic Time Warping, W = 1
N04e3754479570479433579634350730466
N30e3635510408352478534540314532342
N33e21133133711291081115513831299114311521077
Restricted Dynamic Time Warping, W = 5
N04e3554404406420373469514339590327
N30e3376338298263363446470245473235
N33e21133133711291081115513831299114311521077
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Górka, J.; Jamrozik, W.; Wyględacz, B.; Kiel-Jamrozik, M.; Ferreira, B.G. Virtual Sensor for On-Line Hardness Assessment in TIG Welding of Inconel 600 Alloy Thin Plates. Sensors 2024, 24, 3569. https://doi.org/10.3390/s24113569

AMA Style

Górka J, Jamrozik W, Wyględacz B, Kiel-Jamrozik M, Ferreira BG. Virtual Sensor for On-Line Hardness Assessment in TIG Welding of Inconel 600 Alloy Thin Plates. Sensors. 2024; 24(11):3569. https://doi.org/10.3390/s24113569

Chicago/Turabian Style

Górka, Jacek, Wojciech Jamrozik, Bernard Wyględacz, Marta Kiel-Jamrozik, and Batalha Gilmar Ferreira. 2024. "Virtual Sensor for On-Line Hardness Assessment in TIG Welding of Inconel 600 Alloy Thin Plates" Sensors 24, no. 11: 3569. https://doi.org/10.3390/s24113569

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop