Next Article in Journal
Major and Minor Contributions to X-ray Characteristic Lines in the Framework of the Boltzmann Transport Equation
Next Article in Special Issue
Laser Cleaning as Novel Approach to Preservation of Historical Books and Documents on a Paper Basis
Previous Article in Journal
Response to Mono-Energetic Neutrons and Light Output Function for Liquid Organic Scintillators PYR5/DIPN and THIO5/DIPN
Previous Article in Special Issue
Effect of Process Parameters on Laser Powder Bed Fusion of Al-Sn Miscibility Gap Alloy
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Review

A Survey of Process Monitoring Using Computer-Aided Inspection in Laser-Welded Blanks of Light Metals Based on the Digital Twins Concept

by
Ahmad Aminzadeh
1,
Sasan Sattarpanah Karganroudi
1,2,*,
Mohammad Saleh Meiabadi
3,
Dhanesh G. Mohan
4 and
Kadiata Ba
5
1
Département de Mathématique, Informatique et Génie, Université du Québec à Rimouski, Rimouski, QC G56 3A1, Canada
2
Department of Mechanical Engineering, Université du Québec à Trois-Rivières, Trois-Rivieres, QC G8Z 4M3, Canada
3
Department of Mechanical Engineering, École de Technologie Supérieure, 1100 Notre Dame West, Montreal, QC H3C 1K3, Canada
4
Institute of Materials Joining, Shandong University, Jinan 250061, China
5
Applied Sciences Department, Université du Québec à Chicoutimi, 555 boul. Université, Chicoutimi, QC G7H 2B1, Canada
*
Author to whom correspondence should be addressed.
Quantum Beam Sci. 2022, 6(2), 19; https://doi.org/10.3390/qubs6020019
Submission received: 20 April 2022 / Revised: 24 April 2022 / Accepted: 9 May 2022 / Published: 16 May 2022
(This article belongs to the Special Issue Laser Assisted Manufacturing)

Abstract

:
The benefits of laser welding include higher production values, deeper penetration, higher welding speeds, adaptability, and higher power density. These characteristics make laser welding a superior process. Many industries are aware of the benefits of switching to lasers. For example, metal-joining is migrating to modern industrial laser technology due to improved yields, design flexibility, and energy efficiency. However, for an industrial process to be optimized for intelligent manufacturing in the era of Industry 4.0, it must be captured online using high-quality data. Laser welding of aluminum alloys presents a daunting challenge, mainly because aluminum is a less reliable material for welding than other commercial metals such as steel, primarily because of its physical properties: high thermal conductivity, high reflectivity, and low viscosity. The welding plates were fixed by a special welding fixture, to validate alignments and improve measurement accuracy, and a Computer-Aided Inspection (CAI) using 3D scanning was adopted. Certain literature has suggested real-time monitoring of intelligent techniques as a solution to the critical problems associated with aluminum laser welding. Real-time monitoring technologies are essential to improving welding efficiency and guaranteeing product quality. This paper critically reviews the research findings and advances for real-time monitoring of laser welding during the last 10 years. In the present work, a specific methodology originating from process monitoring using Computer-Aided Inspection in laser-welded blanks is reviewed as a candidate technology for a digital twin. Moreover, a novel digital model based on CAI and cloud manufacturing is proposed.

1. Introduction

The transportation industry has dedicated a lot of engineering effort and innovative research into reducing the weight of its products. Air pollution and emission of greenhouse gases from the transportation sector have had detrimental environmental and health effects for decades. For this reason, governments have enacted restrictive regulations on automotive industries to prevent and control the spread of vehicular emissions. Strict regulations have led car manufacturers to look for different solutions and new technologies to solve the problem. One of the strategies that has been adopted in this field is to reduce the weight of cars, leading to fuel consumption and carbon dioxide emission reduction. Given that the body and other exterior components are a large portion of the car’s weight, using light metal structures such as aluminum alloys in automobiles is an effective way to lessen the overall car weight. Aluminum alloys are known for their superior properties, such as strength-to-weight ratio, heat resistance, and corrosion resistance. Laser welding is an effective method of joining materials with high accuracy, good flexibility, and low distortion [1]. However, laser welding of aluminum structures is associated with a range of difficulties due to excessive heat dissipation, the hydrogen solubility of molten aluminum, and an oxide layer inclusion. Manufacturers are motivated by Computer-Aided Inspection (CAI) to ensure high product quality and avoid production defects, which requires automated, rapid, and accurate inspection [2]. CAI commonly refers to automated inspection, among other computer-aided applications extensively used in different industries [3]. By using manufacturing standards and geometric dimensioning and tolerancing (GD&T) criteria, CAI is not only able to detect laser welding defects but also to compensate for these shortcomings. Advances in scanning technology, digital cameras, and controllers have led to a significant increase in real-time monitoring of laser welding processes. A digital twin (DT) aims to build a digital replica of a physical system in a virtual space, such that the digital replica represents the same elements and the same dynamics of a physical system. DT systems can be very helpful for understanding, analyzing, and improving a product, service system, or production [4]. DT systems can also be used to inspect the process, to enable visualization of the impact of variations [5]. Integration of real-time monitoring and real-time simulation in a laser welding process ultimately leads to adopting a DT in laser welding processes. To communicate data, information technology advancements, like the Internet of Things (IoT) and Augmented Reality (AR), can be implemented to link the physical system and its digital twin [6]. Real-time data collection, data analysis, and physics-based simulation are basic phases in defect detection aimed at avoiding the occurrence of defects, and improving the quality of this cutting-edge technology. Thus, a critical review of monitoring technology for the laser welding process is provided. Kong, et al. [7] utilized spectrographic monitoring to control the laser welding process of galvanized high strength steel in two cases, with zinc coating and without zinc coating, in a lap joint configuration. Considering zinc vapor signals as the process feedback, welding defects were identified by the presence of spatters induced by zinc vapor at the faying surface. A series of experiments were conducted to investigate the effects of laser welding parameters on the keyhole dynamics and weld pool, using a high-speed charge-coupled device (CCD) camera with a green laser as an illumination source. The results revealed that welding quality strongly depends on zinc vapor at the faying surface; a higher depth of penetration was also observed in the case of removing the zinc coating. Sebestova, et al. [8] monitored Nd: YAG laser welding by measuring plasma spectral emission lines to calculate the plasma electron temperature. They found a relationship between electron temperature and depth of penetration, which can be used as a controller to identify welding defects and achieve desired penetration depth. Liu, et al. [9] studied laser hot-wire welding of butt joints to assess the molten pool dynamics and the stability of the welding process. A high-speed CCD camera and a spectrometer were used for real-time monitoring of the process through visualization of the molten pool and calculation of the electron temperature according to the Boltzmann plot method. Research established that the contribution of a hot wire facilitates the formation of a molten pool, though laser beams were not able to make the molten pool in butt joints with a large gap. Harooni, et al. [10] conducted real-time spectroscopic monitoring of laser welding of AZ31B magnesium alloy in lap joint configuration. Spectroscopic analysis was performed to study the correlation of the oxide layer on welding sheets and the generation of defects in the interface of overlapped sheets. In addition, a high-speed CCD camera, assisted with a green laser as an illumination source, was employed to monitor the molten pool and the keyhole dynamics due to the oxide layer. The results confirmed that the existing oxide layer on magnesium sheets leads to the generation of pores in the interface area. Blecher, et al. [11] utilized inline coherent imaging for real-time monitoring of keyhole depth in five different alloys. A comparison of real-time keyhole depth measurements and metallographic depth measurements proved that the proposed method was capable of time measurement of keyhole depth except for aluminum alloys. Luo, et al. [12] improvised the acoustic signal monitoring of laser welding by offering a plane microphone array with a time delay recognition. They concluded that the welding process could be monitored and justified using the suggested method even with background noises in the working environment, which had been an obstacle to traditional acoustic signal monitoring. Mirapeix, et al. [13] proposed plasma optical spectroscopy to identify aluminum in the laser welding of Usibor1500 tailor-welded blanks. The estimation of aluminum was done by the line-to-continuum method in real-time. A correlation was identified between aluminum content in real-time monitoring and off-line tests like macrographs or tensile tests. However, the correlation found in the tensile specimen test at lower aluminum contents was not clear because it was affected by other parameters like seam geometry. Recently, our research team developed a new automatic technique to address the distortion in real-time monitoring of aluminum laser-welded blanks [14,15]. The research also provided experimental and numerical investigation of different types of key process parameters and their impact on production quality in automobile applications [16,17,18,19]. Wang, et al. [20] developed a real-time monitoring system for disk laser welding based on the feature selection method for pattern recognition, and the Support Vector Machine (SVM) and Back-Propagation (BP) neural network for pattern classification. Images of the plume and spatters were processed, and a sequential forward floating selection (SFFS) algorithm was used for detecting the optimal feature subset. The classification accuracy of BP and SVM were very close to one other; however, the accuracy of SVM reached the maximum of 98.43 using 10 features. It should be noted that the overall processing time remained a challenge for the proposed method. In another study, Wang, et al. [21] used a combination of a Support Vector Machine and a Pearson product-moment correlation coefficient to characterize disk laser welding quality. High-speed photography was employed for image processing, and the area of the plume, the number of spatters, and the horizontal coordinate of the plume centroid were selected among six features to establish an SVM model with 93.58% classification accuracy. The authors concluded that the proposed monitoring system could be used for real-time monitoring of high-power laser welding. De Bono, et al. [22] evaluated two different monitoring methods of laser welding: optical-based and laser interferometry monitoring methods. The optical-based method investigated photodiodes signals of butt welding, and the laser interferometry monitoring took advantage of the In-Process Depth Meter (IDM) sensor from Precitec in stake welding. Photodiode data obtained at the wavelengths between 600 and 850 nm deduced defects correlated to laser power and joint contamination and gap. However, for detecting defects like porosities and cracks, photodiode data need to be decomposed by orthogonal empirical mode decomposition (OEMD) theory. The data acquired by the IDM sensor established a correlation between the IDM signal and the keyhole depth. Chen, et al. [23] employed an SVM model for real-time monitoring in high-power disk laser welding using 15 features of the metal vapor plume and spatters. A high-speed camera was used to capture laser-induced metal vapor for image processing. SVM classification using seven features reached a remarkably accurate 95.93% by 10-fold cross-validation. The authors suggested that the centroid, perimeter, average grayscale value, and quantity of the spatters were critical to improving welding quality. Pasinetti, et al. [24] proposed in-line monitoring of the laser welding process by a smart vision system based on the Industrial Internet of Things (IIoT) approach, to make an interconnection and remotely control the process. Two different setups were used to fulfill two goals. The first setup, called seam tracking, was targeted to keep the laser welding in an optimal position. The second setup, called the keyhole monitor, aimed to detect incomplete keyhole penetration. The researchers suggested that the architecture used enables remote monitoring of multiple welding units from a central unit. Lei, et al. [25] developed a multi-information fused modeling system for predicting weld waist width and the weld back width by a combination of Principal Component Analysis (PCA), genetic algorithm (GA), and neural networks (NN). Images were acquired by a modified optical fiber laser coaxial monitoring system, and pre-processed by the PCA algorithm to effectively remove the redundancy of extracted information. Two morphological features, in addition to laser power and welding speed, were selected as input parameters of the NN. GA was used to optimize the architecture of the NN. Considering the low errors of the developed model, and the short processing time of less than 90 m, the authors proposed that it could be used for real-time monitoring of the laser welding process. Zhang, et al. [26] employed a multiple-optical-sensor system to integrate with a Deep Belief Network (DBN) that was optimized by a genetic algorithm for online monitoring of the high-power disc laser welding process. The multiple-optical-sensor system was able to deliver effectively a thorough insight into the laser welding process. A deep learning model based on the DBN demonstrated more than 10% higher average accuracy compared to the back-propagation neural network (BPNN) model. Haubold [27] offered a monitoring system for remote laser welding using two parallel processing algorithms customized for identifying spatter number and size. The reproducibility of spatter formation was investigated at four different settings of process parameters for ten repetitions. Although a correlation between spatter number and the corresponding standard deviation was established, no resolution for reduction of spatter size and number was made. Shevchik, et al. [28] developed a hybrid monitoring system for data acquisition and processing applied to titanium laser welding. The monitoring system included optical and acoustic sensors combined with machine learning (ML) techniques. M-band wavelets transformation was utilized to decompose optical and acoustic signals, and the normalized energy of the frequency bands was extracted. The Laplacian graph Support Vector Machine (LapSVM) was used to correlate the extracted features with welding quality. The proposed method displayed more than 85.9% classification accuracy, which is notable given the low cost of data preparation. Accordingly, the researchers claimed that the hybrid monitoring system could be used for the industrialization of laser welding monitoring, and they also raised some concerns about sensors selection rather than sensors combination. Zhang, et al. [29] put forward a vision-based monitoring system for laser welding of tailor rolled blanks (TRB) through coaxial visual monitoring and Convolution Neural Network (CNN) processing algorithms. The monitoring system was dedicated to evaluating the penetration quality of the laser welding of TRB. Four statuses for the penetration state were considered for the creation of an image dataset to train and validate the CNN. They advised that with the 2 ms latency of the CNN for TRB, the proposed monitoring system could be effectively employed for real-time monitoring applications. Gonzalez, et al. [30] introduced ConvLBM to monitor laser deposition and welding processes based on medium wavelength infrared (MWIR) imaging. ConvLBM employed a Convolution Neural Network (CNN) to obtain features from MWIR. ConvLBM estimated dilution for the laser deposition process due to its significance on the quality of the process. Defect characterization was also achieved for the laser welding process by ConvLBM for three different materials, proving the adaptability of the monitoring method for different applications. Kaewprachum, et al. [31] employed an infrared camera for real-time monitoring of the laser welding process to apprehend fast dynamic heating phenomena. The images were captured and analyzed to reveal the effects of laser power and welding speed on the average molten pool temperature and the width of the molten pool. Infrared camera measurements were validated by microscopic measurements, and a good correspondence was observed, especially at high powers. Papacharalampopoulos, et al. [32] employed a methodology as a candidate for process-level digital twins (DTs) in laser welding. A simplified laser welding paradigm capable of displaying temperature profiles was studied to assess the employed methodology. The proposed digital twin approach consisted of decomposing spatial domains, adaptation to accuracy, adaptation to measurements, and estimation of inner state, providing intuitiveness to the operator, and real-time function. The methodology was adopted to solve linear partial differential equations, and was validated following measures ensuring the operational performance of a DT.
To the best of the authors’ knowledge, the present work is the most comprehensive attempt to present a DT for laser-welded blanks. A virtual system of the physical laser welding system has been developed using CAI to monitor, quality control, and optimize the laser welding process. The developed DT resides in the cloud, and it continuously communicates with physical and virtual systems to provide appropriate commands to operating processes and machines in real-time. In this DT, an evaluation of different aspects of laser welding qualities has been made in order to give a product license to laser-welded blanks.

2. Quality Control Based on 3D Geometrical Inspection

For developing a DT, the raw data of a physical system is collected to extract inspection features and analyze the physical system in real-time. Computer-Aided Inspection (CAI) can help to identify defects and abnormalities occurring in the geometry of a physical system. A 3D scan measurement is one of the CAI tools which provides non-contact, non-destructive, and accurate measurements of a physical system. In other words, it is a 3D geometric inspection technology using data acquisition and data pre-processing to obtain the size and shape of a physical part to display the part in digital space in three dimensions. The 3D scanning provides an opportunity to immediately detect where the digital replica does not match with the 3D CAD model. Three-dimensional scanning is a viable option for the quality control of geometrical features of special welding jigs and fixtures. Using 3D scanning, it is possible to identify where deviations occur, and to measure them instantly. To better understand Geometric Dimensioning and Tolerancing (GD&T), manufacturing standards such as ASME Y14.5 and ISO-GPS have been developed in the era of automation. In addition, as part of its standards and requirements, the American Society of Mechanical Engineers (ASME) also established rules, definitions, defaults, and recommended practices. According to the ASME, parts and workpieces should be evaluated in a free state. Therefore, it is necessary to consider the compliance and deformation of non-rigid parts during the inspection. In response, definitions for geometric dimensioning and tolerancing of non-rigid parts have been developed, based on the ASME Y14.5 and ISO standards. Figure 1 presents the types and tools of CAI algorithms. In fact, inspection 4.0 aims at intelligent inspection by illustrating the basic work that can be implemented. Based on the compliance behavior and inspection parameters, a digital inspection protocol can be implemented onto the cloud, and the appropriate machine and inspection method will be selected. This novel aspect will be presented in the upcoming parts of this article. Generally, components are designed to fit into the right material and mechanical properties based on rigid and non-rigid concepts in computer-aided modeling.
Regarding the compliance behavior of parts, rigid and non-rigid parts, CAI algorithms are developed. CAI is primarily used for comparing the reference geometry, computer-assisted design (CAD), with measured data, scan models [34]. Due to gravity and/or residual stress, some mechanical components often have different shapes in the free-state position compared to the state-of-use position. To make it possible to inspect different types of parts, different registration methods have been developed to classify workpieces into rigid and non-rigid ones. Furthermore, rigid registration is the primary step in computer-assisted inspections of non-rigid parts. In conventional CAI software, it is assumed by default that any data entered into the software is from a rigid part. Therefore, any deviation between the input data and the nominal CAD model should be considered a potential manufacturing defect [35]. Rigid registration has the primary goal of bringing CAD and scan models into a common coordinate system without deforming either model. The model is translated and rotated using an optimal transformation matrix without affecting its shape [36]. Initial CAI approaches were introduced using a rigid registration algorithm with Iterative Close Points (ICP) [37]. The ICP algorithm is known as one of the most robust and efficient rigid registration approaches. Although various methods have been developed over the years—including those described by researchers [38,39]—in different domains, such as aeronautic inspections, the ICP algorithm remains a widely used registration approach [40], thanks to its statistically robust and reliable method of registering. A CAD and a scan of a workpiece that is not presented in the same coordinate systems are shown in Figure 2a, and the ICP algorithm applies the best geometrical fit in Figure 2b. In this regard, the closest point in the reference set (CAD) is first identified for every point the point cloud set contains. The transformation matrix (rotation and translation) is then calculated, to move the CAD model towards scan data. This iteration is repeated until the best geometrical fit is obtained.
Each iteration of the ICP registration minimizes the distance between the two models by estimating and computing the transformation matrix that combines translation and rotation. The Hausdorff distance is the main tool in this algorithm [41]. A distance measure is taken between the CAD mesh and the point cloud data acquired by scanning. In other words, it is the maximum distance between every point of a non-empty set and some point of another non-empty set. Equation (1) illustrates this, where dH (X, Y) is the Hausdorff distance and (X, Y) are the two non-empty subsets.
    d H ( X ,   Y ) = max { s u p x X i n f y Y d ( x , y ) , s u p y Y i n f x X d ( x , y ) }
The ICP algorithm has undergone a lot of improvements and upgrades, as it is one of the most powerful and widely used algorithms. The ICP algorithm was also modified and developed to decrease calculation time [42]. This method proposes a robust solution by applying random sampling to the point clouds. The algorithm also knew the minimization strategy [43] or measured the transformation in a way that minimizes its error. By using the corresponding points in previous iterations of the ICP algorithm, and searching only in the immediate neighborhood of those points, the closest points search was significantly improved in terms of speed [44]. In addition, some techniques have been used to improve the efficiency and speed of the registration process [45]. A variation of the algorithm has also been implemented to enhance the conversion of the sets by taking color information from the workpieces. Even though not all scanners are able to capture the color information from workpieces, this algorithm can still be used. There have been many variants of the algorithm explored and many improvements made by the ICP algorithm [43].
Since non-rigid workpieces have so much more parameters to consider, rigid registration needs to be accompanied by non-rigid algorithms, to take into consideration the part’s deviation in its free state [46]. Scanning models cannot be compared to CAD models due to the flexible deformation of parts in a free state. CAI methods can resolve this problem for non-rigid parts where defects (e.g., geometric deviations from the CAD model) are separated from the deformations caused by the compliance or flexible deformation of non-rigid parts. Typically, non-rigid parts are dimensioned and inspected with over-constrained inspection fixtures to compensate for the flexible nature of these components and to ensure that the measurement setup accurately reflects the part’s assembly functionality.

3. Verification and Validation of the Methods in CAI

All Computer-Aided Inspection methods cited are based on scan data and computational calculations. It follows that verification and validation of the calculations are imperative due to this aspect of the methods. Both rigid and non-rigid inspection methods are prone to uncertainty in computational simulations and measurement errors due to inaccuracies in data acquisition devices. Due to the technical limitations of devices, optical effects (such as light fraction and reflectivity of surfaces), or the inaccessible features of some parts, scanners are inaccurate. The results of CAI are influenced by these noisy data. Simulation models can be assessed for accuracy, reliability, and robustness by applying verification and validation (V&V) approaches [47]. Validation evaluates the consistency of computed simulation results compared to the actual ones, while verification measures the accuracy of the solution to a problem using a computational model. All numerical methods, including CAI methods, must be thoroughly verified and validated because of various sources of uncertainty in computer codes and simulations. Validating the result of a numerical approach concerning input noise aims at evaluating a computational model’s robustness. An effective computational model should be able to produce satisfactory results despite the presence of noises in the input. A robust approach can still produce acceptable results for noise-containing input data compared with noise-free input data. Typically, the input noise in CAI methods comes from measurement noise that is inherent to measuring data acquisition devices. Thus, it is necessary to study the robustness of CAI methods, given the noise generated by scanning devices. A first development model will be generated based on the CAI method, and real feedback will be received during the production process. Furthermore, by combining the concepts of physical and simulation, the human and machine interface theory can make a powerful and self-learning device. This smart connected modeling is the trigger for Industry 4.0 and intelligent manufacturing by developing a digital twin model.

4. Digital Twins (DT)

Industry 4.0 is the latest revolution in the industrial era, and refers to the digitization of manufacturing by merging physical and virtual (digital) worlds. Digital twins (DTs) are a strategy within Industry 4.0, operating on the virtualization principle [48]. DTs are digitalized integrated systems to monitor, analyze, and simulate the behavior of a physical system. DTs are composed of three main components: the physical system, the virtual system, and the communication layer that connects these two systems. The communication layer is a linkage for data storage, data processing, and data mapping functionalities [49]. The data from the physical and virtual systems must be stored and processed in the communication layer. In this regard, the communication layer needs to be capable of transmitting a big amount of data (big data) in addition to easy fault detection characteristics. Internet of Things (IoT) technology can be used to make interactions between different layers of the integrated systems for real-time data transmission. IoT effectively maintains two-way synchronization of physical and virtual systems, to keep the virtual system updated and to provide real-time control commands for the physical system. The physical system changes are reflected in the virtual system; in other words, the virtual system is updated by employing feedback from the physical system. Real-time control commands are made based on the past and present conditions of the physical system to take care of the consistency of the manufacturing process and the quality of manufactured parts [50]. The constant synchronization between physical and virtual systems through the communication layer ends up in a real-time quality control platform which is also supported and updated by the physical system. As illustrated in Figure 3, all sorts of information originating from physical and virtual systems—GD&T standards, historical data, customer feedback, and fabrication protocols—are communicating with the cloud network to provide enough material to make decisions. Continuous and online communication between different physical and virtual data providers is only made possible by the ability of IoT [51] to transmit large volumes of data.
Smart welding is heading inevitably toward the Industry 4.0 paradigm. A schematic of the DT model designed for intelligent laser welding leading to a product license for laser-welded blanks is presented in Figure 4. In this DT, all data from the physical system, including seam tracking, in-process depth meter, and weld inspect data, are communicating with the cloud to update and support the cloud. There is a two-way network of interactions between consequent stages of physical and virtual twins, to transfer and update information, guaranteeing high-quality laser seam according to standards, process command, and specifications defined in the cloud. The application of DTs might facilitate the provision of production licenses for parts manufactured in different production sites, with no need to re-inspect the parts.
In general, digital twins are efficient platforms for predicting every machine and device’s performance, due to their intelligent data processing capability. In a virtual model or DT, physical models of machine operations will be combined with sensor data collected and processed from real assets during real-world operations. In this regard, operators of laser welding machines will benefit from being able to predict structural failure and to plan maintenance activities more effectively. This strategy will result in reduced maintenance costs and operational downtime during welding. As shown in the following model, aluminum sheets are prepared before welding to ensure there is no contamination on the surface. Then, the clamping procedure is adjusted to apply an equivalent force on the surface of the plates. To do so, alignment sensors are used to define the error, and the results are sent to the cloud for future action. By using the validation method, all the process parameters are set, and acceptance/rejection outcomes will be considered, to make a cloud-based smart decision based on the DG&T criteria. If the alignment has been accepted, automatic laser welding will start, and real-time monitoring will be done (seam tracking, in-process depth penetration, weld inspection, etc.). Using sensors and artificial intelligence, digital platforms and physical operations communicate data simultaneously. A cloud platform should be able to process big data and refine it based on pass/fail production criteria. Finally, a license will be issued for the quality assessment of each production. It is worth mentioning that this model can be used in mass production as well as remote manufacturing platforms in any location throughout the world. Thus, this model can be considered the first step toward cloud manufacturing and connected production which can be remotely accessible anytime.

5. Summary and Future Scopes

Investigation of the digital twins market reflects the challenges that have hindered cost-efficient application of digital twins (DTs) in manufacturing. Some of these challenges are due to the complex physics of manufacturing processes and production uncertainties, which in turn leads to difficulties in capturing physical phenomena by a virtual replica. The desire is to set up data-driven digital twins based on a hierarchical structure without any conflict between the physical and virtual systems, which entails appropriate communication and collaboration between them. However, the development of digital twins is still costly due to the restrictions of communication platforms. The ability to predict, prevent and resolve problems and faults also requires the proper implementation of data analysis, decision making, and problem-solving techniques.
In this regard, an overview of computer-aided process monitoring was reviewed, based on the digital twins concept for lightweight laser-welded metals. Different types of 3D geometric inspection, Computer-Aided Inspection (CAI) methods, and tools in the manufacturing industry, are presented and compared in this paper. CAI approaches address automated inspection challenges and requirements for different types of manufactured parts. The development of this process is essential in the production cycle of a part, and therefore should not be ignored. In addition, as moving further toward Industry 4.0, its concepts ought to be incorporated into geometric inspections allowing a comparison between nominal data (CAD model) with respect to a manufactured part, to determine whether it meets specifications without having to apply human judgment. An automated cloud-based Inspection 4.0 is therefore applied. Another objective is to propose an automated production cycle that does not require human intervention. This survey presents an agile approach allowing automation of the laser-welded blanks process. Applying CAI, the process is automated along with the implementation of its DTs. This original model allows remote monitoring of the process, increasing its precision by removing human intervention, increasing productivity, and providing a proper decision-making tool. The challenge now is to integrate artificial intelligence to delegate all redundant work to the machines, and have them provide feedback and auto-maintenance at some point. More research is also needed to develop cost-effective digital twins so that these solutions can meet Industry 4.0 requirements.

Author Contributions

Conceptualization, A.A., S.S.K. and M.S.M.; methodology, S.S.K., D.G.M. and K.B.; validation, S.S.K., M.S.M. and D.G.M.; formal analysis, A.A., S.S.K. and K.B.; investigation, A.A., S.S.K. and M.S.M.; resources, S.S.K. and D.G.M.; data curation, M.S.M. and K.B.; writing—original draft preparation, A.A., S.S.K. and M.S.M.; writing—review and editing, S.S.K., A.A., D.G.M., K.B. and M.S.M.; visualization, A.A., D.G.M. and K.B., supervision and project administration, S.S.K. All authors have read and agreed to the published version of the manuscript.

Funding

We acknowledge the support of the Fonds Québécois de la Recherche sur la Nature et les Technologies (FRQNT) [funding reference number 06351].

Institutional Review Board Statement

This article does not involve human or animal participation or data, therefore ethics approval is not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

All data, material, and codes used in this paper are available.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Katayama, S. Handbook of Laser Welding Technologies; Elsevier: Amsterdam, The Netherlands, 2013. [Google Scholar]
  2. Zhao, F.; Xu, X.; Xie, S.Q. Computer-Aided Inspection Planning-The state of the art. Comput. Ind. 2009, 60, 453–466. [Google Scholar] [CrossRef]
  3. Minetola, P.; Iuliano, L.; Calignano, F. A customer oriented methodology for reverse engineering software selection in the computer aided inspection scenario. Comput. Ind. 2015, 67, 54–71. [Google Scholar] [CrossRef]
  4. Zhang, L.; Chen, X.; Zhou, W.; Cheng, T.; Chen, L.; Guo, Z. Digital Twins for Additive Manufacturing: A State-of-the-Art Review. Appl. Sci. 2020, 10, 8350. [Google Scholar] [CrossRef]
  5. Gaha, R.; Durupt, A.; Eynard, B. Towards the implementation of the Digital Twin in CMM inspection process: Opportunities, challenges and proposals. Procedia Manuf. 2020, 54, 216–221. [Google Scholar] [CrossRef]
  6. Papacharalampopoulos, A.; Michail, C.; Stavropoulos, P. Manufacturing Process Control through a Digital Twin: Encoding Issues. In Proceedings of the TESConf 2020—9th International Conference Through-Life Engineering Services, Cranfield, Bedfordshire, UK, 3–4 November 2020. [Google Scholar] [CrossRef]
  7. Kong, F.; Ma, J.; Carlson, B.; Kovacevic, R. Real-time monitoring of laser welding of galvanized high strength steel in lap joint configuration. Opt. Laser Technol. 2012, 44, 2186–2196. [Google Scholar] [CrossRef]
  8. Sebestova, H.; Chmelickova, H.; Nozka, L.; Moudry, J. Non-destructive real time monitoring of the laser welding process. J. Mater. Eng. Perform. 2012, 21, 764–769. [Google Scholar] [CrossRef]
  9. Liu, W.; Liu, S.; Ma, J.; Kovacevic, R. Real-time monitoring of the laser hot-wire welding process. Opt. Laser Technol. 2014, 57, 66–76. [Google Scholar] [CrossRef]
  10. Harooni, M.; Carlson, B.; Kovacevic, R. Detection of defects in laser welding of AZ31B magnesium alloy in zero-gap lap joint configuration by a real-time spectroscopic analysis. Opt. Lasers Eng. 2014, 56, 54–66. [Google Scholar] [CrossRef]
  11. Blecher, J.J.; Galbraith, C.M.; Van Vlack, C.; Palmer, T.A.; Fraser, J.M.; Webster, P.J.L.; DebRoy, T. Real time monitoring of laser beam welding keyhole depth by laser interferometry. Sci. Technol. Weld. Join. 2014, 19, 560–564. [Google Scholar] [CrossRef]
  12. Luo, Z.; Liu, W.; Wang, Z.; Ao, S. Monitoring of laser welding using source localization and tracking processing by microphone array. Int. J. Adv. Manuf. Technol. 2016, 86, 21–28. [Google Scholar] [CrossRef]
  13. Mirapeix, J.; Vila, E.; Valdiande, J.J.; Riquelme, A.; Garcia, M.; Cobo, A. Real-time detection of the aluminium contribution during laser welding of Usibor1500 tailor-welded blanks. J. Mater. Process. Technol. 2016, 235, 106–113. [Google Scholar] [CrossRef] [Green Version]
  14. Aminzadeh, A.; Karganroudi, S.S.; Barka, N.; El Ouafi, A. A real-time 3D scanning of aluminum 5052-H32 laser welded blanks; geometrical and welding characterization. Mater. Lett. 2021, 296, 129883. [Google Scholar] [CrossRef]
  15. Aminzadeh, A.; Karganroudi, S.S.; Barka, N. A novel approach of residual stress prediction in ST-14/ST-44 laser welded blanks; mechanical characterization and experimental validation. Mater. Lett. 2021, 285, 129193. [Google Scholar] [CrossRef]
  16. Aminzadeh, A.; Nasiri, N.; Barka, N.; Parvizi, A.; Abrinia, K.; Moradi, M.; Sattarpanah Karganroudi, S. Statistical Analysis of Laser-Welded Blanks in Deep Drawing Process: Response Surface Modeling. J. Mater. Eng. Perform. 2022, 31, 2240–2256. [Google Scholar] [CrossRef]
  17. Aminzadeh, A.; Sattarpanah Karganroudi, S.; Barka, N. Experimental and numerical investigation of forming defects and stress analysis in laser-welded blanks during deep drawing process. Int. J. Adv. Manuf. Technol. 2021, 117, 1193–1207. [Google Scholar] [CrossRef]
  18. Aminzadeh, A.; Parvizi, A.; Moradi, M. Multi-objective topology optimization of deep drawing dissimilar tailor laser welded blanks; experimental and finite element investigation. Opt. Laser Technol. 2020, 125, 106029. [Google Scholar] [CrossRef]
  19. Aminzadeh, A.; Parvizi, A.; Safdarian, R.; Rahmatabadi, D. Comparison between laser beam and gas tungsten arc tailored welded blanks via deep drawing. Proc. Inst. Mech. Eng. Part B J. Eng. Manuf. 2020, 235, 673–688. [Google Scholar] [CrossRef]
  20. Wang, T.; Chen, J.; Gao, X.; Qin, Y. Real-time monitoring for disk laser welding based on feature selection and SVM. Appl. Sci. 2017, 7, 884. [Google Scholar] [CrossRef] [Green Version]
  21. Wang, T.; Chen, J.; Gao, X.; Li, W. Quality monitoring for laser welding based on high-speed photography and support vector machine. Appl. Sci. 2017, 7, 299. [Google Scholar] [CrossRef] [Green Version]
  22. De Bono, P.; Allen, C.; D’Angelo, G.; Cisi, A. Investigation of optical sensor approaches for real-time monitoring during fibre laser welding. J. Laser Appl. 2017, 29, 022417. [Google Scholar] [CrossRef] [Green Version]
  23. Chen, J.; Wang, T.; Gao, X.; Wei, L. Real-time monitoring of high-power disk laser welding based on support vector machine. Comput. Ind. 2018, 94, 75–81. [Google Scholar] [CrossRef]
  24. Pasinetti, S.; Sansoni, G.; Docchio, F. In-Line Monitoring of Laser Welding Using a Smart Vision System. In Proceedings of the IEEE Metrology for Industry 4.0 and IoT, Brescia, Italy, 16–18 April 2018; pp. 134–139. [Google Scholar] [CrossRef] [Green Version]
  25. Lei, Z.; Shen, J.; Wang, Q.; Chen, Y. Real-time weld geometry prediction based on multi-information using neural network optimized by PCA and GA during thin-plate laser welding. J. Manuf. Process. 2019, 43, 207–217. [Google Scholar] [CrossRef]
  26. Zhang, Y.; You, D.; Gao, X.; Katayama, S. Online Monitoring of Welding Status Based on a DBN Model During Laser Welding. Engineering 2019, 5, 671–678. [Google Scholar] [CrossRef]
  27. Haubold, M.W.; Zäh, M.F. Real-time spatter detection in laser welding with beam oscillation. Procedia CIRP 2019, 79, 159–164. [Google Scholar] [CrossRef]
  28. Shevchik, S.A.; Le-Quang, T.; Farahani, F.V.; Faivre, N.; Meylan, B.; Zanoli, S.; Wasmer, K. Laser welding quality monitoring via graph support vector machine with data adaptive kernel. IEEE Access 2019, 7, 93108–93122. [Google Scholar] [CrossRef]
  29. Zhang, Z.; Li, B.; Zhang, W.; Lu, R.; Wada, S.; Zhang, Y. Real-time penetration state monitoring using convolutional neural network for laser welding of tailor rolled blanks. J. Manuf. Syst. 2020, 54, 348–360. [Google Scholar] [CrossRef]
  30. Gonzalez-Val, C.; Pallas, A.; Panadeiro, V.; Rodriguez, A. A convolutional approach to quality monitoring for laser manufacturing. J. Intell. Manuf. 2020, 31, 789–795. [Google Scholar] [CrossRef] [Green Version]
  31. Keawprachum, B.; Srisungsitthisunti, P. Real-time process monitoring of laser welding by infrared camera and image processing. Key Eng. Mater. 2020, 856, 160–168. [Google Scholar] [CrossRef]
  32. Papacharalampopoulos, A.; Stavropoulos, P.; Petrides, D. Towards a digital twin for manufacturing processes: Applicability on on laser laser welding. Procedia CIRP 2019, 88, 110–115. [Google Scholar] [CrossRef]
  33. Sattarpanah Karganroudi, S. Contribution à L’inspection Automatique des Pièces Flexibles à L’état Libre Sans Gabarit de Conformation; Université du Québec à Trois-Rivières: Trois-Rivières, QC, Canada, 2017. [Google Scholar]
  34. Sabri, V.; Sattarpanah, S.; Tahan, S.A.; Cuillière, J.C.; François, V.; Pham, X.T. A robust and automated FE-based method for fixtureless dimensional metrology of non-rigid parts using an improved numerical inspection fixture. Int. J. Adv. Manuf. Technol. 2017, 92, 2411–2423. [Google Scholar] [CrossRef]
  35. Babanezhad, K.; Aidibe, A.; Foucault, G.; Tahan, A.; Bigeon, J. Improved Bi-Criterion flexible registration for fixtureless inspection of compliant parts. Precis. Eng. 2020, 65, 116–129. [Google Scholar] [CrossRef]
  36. Sattarpanah Karganroudi, S.; Cuillière, J.-C.; François, V.; Tahan, S.-A. “What-if” scenarios towards virtual assembly-state mounting for non-rigid parts inspection using permissible loads. Int. J. Adv. Manuf. Technol. 2018, 97, 353–373. [Google Scholar] [CrossRef]
  37. Besl, P.J.; McKay, N.D. Method for registration of 3-D shapes. In Sensor Fusion IV: Control Paradigms and Data Structures; SPIE: Bellingham, WA, USA, 1992; Volume 1611, pp. 586–606. [Google Scholar]
  38. Li, Y.; Gu, P. Free-form surface inspection techniques state of the art review. Comput. Des. 2004, 36, 1395–1417. [Google Scholar] [CrossRef]
  39. Savio, E.; Chiffre, L.D.; Schmittc, R. Metrology of freeform shaped parts. CIRP Ann. 2007, 56, 810–835. [Google Scholar] [CrossRef]
  40. Ravishankar, S.; Dutt, H.; Gurumoorthy, B. Automated inspection of aircraft parts using a modified ICP algorithm. Int. J. Adv. Manuf. Technol. 2010, 46, 227–236. [Google Scholar] [CrossRef]
  41. Henrikson, J. Completeness and total boundedness of the Hausdorff metric. MIT Undergrad. J. Math. 1999, 1, 10. [Google Scholar]
  42. Masuda, T.; Yokoya, N. A robust method for registration and segmentation of multiple range images. Comput. Vis. Image Underst. 1995, 61, 295–307. [Google Scholar] [CrossRef]
  43. Rusinkiewicz, S.; Levoy, M. Efficient variants of the ICP algorithm. In Proceedings of the Third International Conference on 3-D Digital Imaging and Modeling, Quebec City, QC, Canada, 28 May–1 June 2001; pp. 145–152. [Google Scholar]
  44. Greenspan, M.; Godin, G. A nearest neighbor method for efficient ICP. In Proceedings of the Third International Conference on 3-D Digital Imaging and Modeling, Quebec City, QC, Canada, 28 May–1 June 2001; pp. 161–168. [Google Scholar]
  45. Zhu, L.; Barhak, J.; Srivatsan, V.; Katz, R. Efficient registration for precision inspection of free-form surfaces. Int. J. Adv. Manuf. Technol. 2007, 32, 505–515. [Google Scholar] [CrossRef] [Green Version]
  46. Sattarpanah Karganroudi, S.; Cuillière, J.-C.; Francois, V.; Tahan, S.-A. Automatic fixtureless inspection of non-rigid parts based on filtering registration points. Int. J. Adv. Manuf. Technol. 2016, 87, 687–712. [Google Scholar] [CrossRef]
  47. Schwer, L.E. An overview of the PTC 60/V&V 10: Guide for verification and validation in computational solid mechanics. Eng. Comput. 2007, 23, 245–252. [Google Scholar]
  48. Roy, R.B.; Mishra, D.; Pal, S.K.; Chakravarty, T.; Panda, S.; Chandra, M.G.; Pal, A.; Misra, P.; Chakravarty, D.; Misra, S. Digital twin: Current scenario and a case study on a manufacturing process. Int. J. Adv. Manuf. Technol. 2020, 107, 3691–3714. [Google Scholar] [CrossRef]
  49. Zheng, Y.; Yang, S.; Cheng, H. An application framework of digital twin and its case study. J. Ambient. Intell. Humaniz. Comput. 2019, 10, 1141–1153. [Google Scholar] [CrossRef]
  50. Mohan, D.G.; Tomków, J.; Sattarpanah Karganroudi, S. Laser Welding of UNS S33207 Hyper-Duplex Stainless Steel to 6061 Aluminum Alloy Using High Entropy Alloy as a Filler Material. Appl. Sci. 2022, 12, 2849. [Google Scholar] [CrossRef]
  51. Duriagina, Z.; Holyaka, R.; Tepla, T.; Kulyk, V.; Arras, P.; Eyngorn, E. Identification of Fe3O4 nanoparticles biomedical purpose by magnetometric methods. In Biomaterials in Regenerative Medicine; InTech: Rijeka, Croatia, 2018; p. 448. [Google Scholar] [CrossRef] [Green Version]
Figure 1. Computer-Aided Inspection methods and tools [33].
Figure 1. Computer-Aided Inspection methods and tools [33].
Qubs 06 00019 g001
Figure 2. CAD and scanned models (a) before registration (b) after rigid registration using ICP algorithm [33].
Figure 2. CAD and scanned models (a) before registration (b) after rigid registration using ICP algorithm [33].
Qubs 06 00019 g002
Figure 3. The cloud network in a 4.0 manufacturing factory.
Figure 3. The cloud network in a 4.0 manufacturing factory.
Qubs 06 00019 g003
Figure 4. Digital twins model for Inspection 4.0 of laser-welded blanks.
Figure 4. Digital twins model for Inspection 4.0 of laser-welded blanks.
Qubs 06 00019 g004
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Aminzadeh, A.; Sattarpanah Karganroudi, S.; Meiabadi, M.S.; Mohan, D.G.; Ba, K. A Survey of Process Monitoring Using Computer-Aided Inspection in Laser-Welded Blanks of Light Metals Based on the Digital Twins Concept. Quantum Beam Sci. 2022, 6, 19. https://doi.org/10.3390/qubs6020019

AMA Style

Aminzadeh A, Sattarpanah Karganroudi S, Meiabadi MS, Mohan DG, Ba K. A Survey of Process Monitoring Using Computer-Aided Inspection in Laser-Welded Blanks of Light Metals Based on the Digital Twins Concept. Quantum Beam Science. 2022; 6(2):19. https://doi.org/10.3390/qubs6020019

Chicago/Turabian Style

Aminzadeh, Ahmad, Sasan Sattarpanah Karganroudi, Mohammad Saleh Meiabadi, Dhanesh G. Mohan, and Kadiata Ba. 2022. "A Survey of Process Monitoring Using Computer-Aided Inspection in Laser-Welded Blanks of Light Metals Based on the Digital Twins Concept" Quantum Beam Science 6, no. 2: 19. https://doi.org/10.3390/qubs6020019

Article Metrics

Back to TopTop