Next Article in Journal
Cell Fault Identification and Localization Procedure for Lithium-Ion Battery System of Electric Vehicles Based on Real Measurement Data
Next Article in Special Issue
Algorithms in Low-Code-No-Code for Research Applications: A Practical Review
Previous Article in Journal
A Momentum-Based Local Face Adversarial Example Generation Algorithm
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Review

A Synergic Approach of Deep Learning towards Digital Additive Manufacturing: A Review

1
Department of Metallurgical and Materials Engineering, Indian Institute of Technology, Ropar 140001, Punjab, India
2
Graduate Institute of Ambient Intelligence and Smart Systems, National Chung Cheng University, Chiayi 621301, Taiwan
3
Department of Computer Science and Information Engineering, National Chung Cheng University, Chiayi 621301, Taiwan
*
Authors to whom correspondence should be addressed.
Algorithms 2022, 15(12), 466; https://doi.org/10.3390/a15120466
Submission received: 18 November 2022 / Revised: 5 December 2022 / Accepted: 5 December 2022 / Published: 8 December 2022
(This article belongs to the Collection Featured Reviews of Algorithms)

Abstract

:
Deep learning and additive manufacturing have progressed together in the previous couple of decades. Despite being one of the most promising technologies, they have several flaws that a collaborative effort may address. However, digital manufacturing has established itself in the current industrial revolution and it has slowed down quality control and inspection due to the different defects linked with it. Industry 4.0, the most recent industrial revolution, emphasizes the integration of intelligent production systems and current information technologies. As a result, deep learning has received a lot of attention and has been shown to be quite effective at understanding image data. This review aims to provide a cutting-edge deep learning application of the AM approach and application. This article also addresses the current issues of data privacy and security and potential solutions to provide a more significant dimension to future studies.

1. Introduction

Rapid prototyping (RP) is a collection of manufacturing techniques that may produce a finished product straight from a 3D model in a layer-by-layer fashion. Because of its numerous advantages, this technology has become a crucial component of the fourth industrial revolution. Globally, technology is transforming the manufacturing industry. Despite this, the industry’s adoption of this technology is hampered by layer-related flaws and poor process reproducibility. The function and mechanical qualities of printed objects can be significantly impacted by flaws such as lack of fusion, porosity, and undesirable dimensional deviation, which are frequent occurrences [1,2]. Variability in product quality, which poses a significant obstacle to its adoption in the production line, is one of the process’s key downsides. To overcome this hurdle, inspecting and overseeing the additive manufacturing (AM) process are essential. The importance of in-depth material and component analysis is growing, which leads this technology toward the integration of data science and deep learning. These newly discovered data are invaluable for acquiring a fresh understanding of AM processes and decision-making [3]. Unlike traditional manufacturing procedures, AM creates goods from digital 3D models layer-by-layer, line-by-line, or piece-by-piece [4,5]. AM fabrication methods have been developed to print natural working objects using diverse types and forms of materials, including fused filament fabrication (FFF), stereolithography (SLA), selective laser sintering (SLS), selective laser melting (SLM), and laser-engineered net shaping (LENS). The various techniques will be discussed in the further section. The materials’ anisotropic character, porosity caused by inadequate material fusion, and warping due to residual tension brought on by the fast-cooling nature of additive manufacturing techniques are only a few of the particular difficulties that must be solved. Deep learning (DL) has recently gained popularity in pattern recognition and computer vision due to its dominance in feature extraction and picture interpretation. Convolutional neural networks (CNNs) are one of the most widely employed techniques in deep learning, and they have been extensively used for object detection, action recognition, and image classification [6]. CNN is widely used for computer vision task applications [7]. DL integrated design is used for AM framework. In other words, deep learning simulates the input and output data for the given part [8]. The review represents a new phase of AM-related data analysis, where data gathering is the primary component of technological inspection. Many reviews on additive manufacturing and AI have been published, but no specific article emphasizes the deep learning perspective with additive manufacturing. Other fields, including medical AM, have embraced deep learning as an essential component for analyzing deep learning in conjunction with additive manufacturing. The literature review shows that many reviews are available on various topics related to artificial intelligence and additive manufacturing. However, no reviews were focused on deep learning and additive manufacturing. Various reviews have been carried out on this work, which is somewhat broadly related to our topic of interest. All the reviews of reviews used in this work are highlighted in Figure 1. However, the work has been focused on deep learning and additive manufacturing because much work has been conducted in this area from 2014 to October 2022 (shown in Figure 2). Thus, the main aim of the present review is to give an overview of the various articles associated with these two key technologies. The bar graph and citations index of all those works is well illustrated in Figure 2.
Immense effort has been made while collecting articles from various well-known databases such as (i) Google Scholar (ii) ScienceDirect, and (iii) IEEE Xplore. The various keywords used for the searches were: additive manufacturing (AM), deep learning (DL), Industry 4.0, design for additive manufacturing DFAM, big data, Internet of Things, computer vision, data security, explainable AI, trustworthy AI, federated learning, digital twins and sustainability. To focus on the goal of literature evaluation, the key technical terms were merged to obtain pertinent research study resources. The prominent academic search engine provided the majority of the research materials. The various research articles related to this field were gathered, and co-occurrence analysis was conducted using VOS viewer [9]. The network, co-occurrence, and density visualization of various keywords associated with it are shown in Figure 3. It is well illustrated in Figure 4 that the density of additive manufacturing and deep learning is more correlated than machine learning. Any new manufacturing technique needs early adopters or champions in the customer community to be adopted for widespread use. In the early 1990s, AM experienced the same thing. The early adopters, Dick Aubin at United Technologies, Pete Sferro at Ford Motor Company, and Clint Atwood at Sandia National Laboratory, were the key players in this technique [10]. This idea is emerging because of the significant degree of design flexibility AM technology offers. Design for additive manufacturing (DfAM) techniques or instruments are required to benefit fully from the unique skills offered by AM processes [11]. DfAM is a general term for design techniques or tools that allow the capabilities of additive manufacturing technology to be fully utilized to enhance functional performance and other significant product life-cycle aspects, such as dependability, manufacturability, and cost [12]. Due to its theoretical ability to produce more complex parts in any shape without requiring more work in the manufacturing processes, AM is given more design freedom. A consolidated view of incorporating an additive manufacturing process chain with deep learning has been illustrated in Figure 4. It demonstrates that quality control can be implemented in a very efficient manner in synergy with deep learning. From the beginning to the end of RP, data generation and input play a significant part in the AM process. Throughout this process’s exclusive design and production cycle, enormous amounts of data are generated. To optimize the AM process and make the process more efficient and dependable, this data must be gathered and examined. Diverse research teams have attempted experiments combining deep learning techniques with AM to enhance product quality, detect and forecast various flaws and distortions in the made part, optimize process times, and cut costs [13].
AM products must be produced using sophisticated quality control to demonstrate and achieve their intended repeatability, reproducibility, reliability, and exactness before being used as final products [10]. The widespread adoption of AM techniques needs to be improved by dimensional errors and the existence of flaws. These variables give rise to concern about the quality of the products created via additive manufacturing, hence using quality control (QC) methodologies is essential to improving this developing technology [14]. Both metal AM and welding undergo periodic partial melting, cooling, or deposition during manufacturing. Metal AM and welded products frequently share similar product quality concerns due to deposition, including layer misalignment, dimensional inaccuracies, and residual stress generation [15].
Industry 4.0 uses the fusion of advanced information technology and intelligent industrial systems. Due to its many advantages, including time and material savings, quick prototyping, high efficiency, and decentralized production techniques, AM is a critical component of Industry 4.0 [16]. These encompass a number of the most recent technical advancements, including artificial intelligence, cloud computing, digital twins, the Internet of Things, and cyber-physical systems. The word “AM” is also used to refer to several industrial processes that enable the production of things by stacking layers on top of one another. Numerous studies and applications of these technologies have been conducted to create homogenous and heterogeneous items with intricate geometries [17]. Intelligent production systems and cutting-edge information technologies are being encouraged to integrate through the implementation of Industry 4.0. This new movement is believed to necessitate AM, which is considered a significant element [18]. The primary drawback of AM-manufactured parts is their lower strength and related quality, together with the expensive cost of the printing technology. The industry can manufacture novel products with this disruptive technology, which can address various issues in the future production system. Additive manufacturing is a new paradigm that will be utilized by Industry 4.0 to accomplish the necessary objectives in this futuristic manufacturing system [19]. Therefore, a consolidated view of the respective technology leads to the integration of this new field viz additive manufacturing and deep learning. This has the potential to lead the automation in Industry 4.0 sustainably. A representative diagram is shown in Figure 5.
This review revolves around a few major recent buzzwords, such as deep learning (DL), Industry 4.0, AM, big data, the Internet of Things (IoT), and computer vision. In the complete work, the authors have emphasized that the different DL algorithms have already proved themselves in the AM domain. The paper is divided into seven sections. Section 1 introduces the crux of this review article.
Section 2 discusses the various error and defects associated with the AM. Major importance is given to the generation of a dataset (defect) associated with the technology. Section 3 provides an in-depth study of the various DL models used in the AM until now. In Section 4, the DL has been correlated with the AM in three aspects: process, material, and application. Section 5 discusses the concern about the challenges and solution associated with the integration of two different technologies of the 21st century. Section 6 deals with the future thrust areas, which can be focused on developing the technology as a whole. Finally, Section 7 concludes the overall review of the work. In a crux, the review focuses on additive manufacturing industries in the era of Industry 4.0. In addition, in the complete writeup, emphasis has been given to the incorporation of deep learning in additive manufacturing which can lead to automation in the specified sector.

2. Classification and Correlation of Deep Learning with Additive Manufacturing

There is no question that every nation must participate in the global effort to develop sustainable standards for every technology and industry. ASTM clause 2792-12 defines AM as the technology that creates objects from 3D models by layer-by-layer addition of materials [20]. Future production will be individually customized and environmentally friendly, depending on needs. The techniques involved in additive manufacturing range from designing with any computer-aided design (CAD) software to producing the finished product [21]. However, there are restrictions on how AM standards can be applied. Numerous studies have shown that mechanical characteristics along the X-Y axis might differ in the Z-axis, as in the case of the SLA process. PBF determines the finished product’s mechanical qualities (powder bed fusion) and sintering, which depend on the laser power, layer thickness, tolerances, and other factors [22].
AM techniques can be classified according to material type, solidification process, and deposition methods [23]. Understanding the process and technology associated with this term is essential before we delve into the deep learning part. Therefore, this section aims to classify the AM process in all possible aspects and correlate it with deep learning.

2.1. Process-Based Classification

Additive manufacturing is growing and expanding with a wide range of technology and applications. According to ASTM F 42, additive manufacturing has been classified into seven categories, shown in Figure 6 with the associated technology [23]. There are quite a few different techniques, tools, and materials included in each of the seven process categories that additive manufacturing technologies fall under, and they may be used to meet the requirements of a broad range of industries, from aerospace to healthcare. Defining the mechanical characteristics of the final part is a necessity in industrial domains, along with certification of the personnel participating in each manufacturing phase, the product design stage, and so on [24].

2.2. Application-Based Classification

The ability to manufacture complex structures, mass customization, waste reduction, and design freedom are some of additive manufacturing’s (AM) main benefits [25]. Additive manufacturing includes rapid development tools [26]. However, over the past ten years, AM has advanced dramatically in technological competence and has been employed increasingly in direct manufacturing [11]. This has led to new businesses specializing in components’ rapid manufacture (RM) [27]. Various sections that have warmly embraced this technology are summarized in Table 1.

3. Errors and Defects Associated with Additive Manufacturing

Before delving into the discussion of deep learning in AM, it is a prerequisite for us to know the kind of dataset associated with the techniques used in various printing methods. Therefore, the cause of printing error, the technique used to acquire the defect in the parts, and the type of defect associated with the technology must be overturned before moving to its solution by AI.

3.1. Printing Errors

Printing errors are a tedious problem in AM. Printing errors will happen when the physical part is printed. Thus, there must be some feedback mechanism while printing the model, which can monitor the process while printing is ongoing. The printed error is also further classified as minor and major errors. Minor errors can be neglected if the previous or later layer of the print compensates for the defect. However, a significant error cannot be compensated, and the part cannot reach the required accuracy [46]. The most popular method of AM is fused deposition modeling (FDM). The name also illustrates the process of layering the fused material to create a portion. When it comes to cost-effectiveness and manufacturing speed, this is one of the most promising RP techniques. It is widely utilized, and this method includes roughly half of all 3D printing devices [47]. According to Bochmann et al. [48] and another literature reason for various printing errors associated with this technology is demonstrated in Figure 7.

3.2. Data Acquisition

Three-dimensional shape measurement, also known as range imaging and depth sensing, plays an essential role in many applications. The common approaches, however, need to deliver precise and dense measurements for a trustworthy 3D reconstruction. The secret to successful 3D scanning is to measure your thing accurately enough to record the specifics required for an adequate duplication [49]. A few 3D scanning options can aid with this and develop a 3D model almost instantly that is prepared for 3D printing. The various data acquisition techniques have been summarized in Table 2, along with their merits and demerits.

3.3. Defect Associated

In the past few decades, with the growth of the fourth industrial revolution, the popularity of 3D-printed goods has grown, and they are also demonstrating financial and time savings. From the CAD model, the additive manufacturing product is constructed layer-by-layer. Nevertheless, the printed product from the AM technology is associated with various defects due to the variation in properties and structure, which further lead to the quality of the printed product [5]. The various defects associated with the AM are summarized in Table 3, along with its cause and effect on the printed component. Recoater streaking can further classify as micro–macro, depending on the grain type [6].

4. Deep Learning Models in Additive Manufacturing

In the additive manufacturing sector, parts quality inspection is essential and can be used to enhance products. However, the manual recognition used in the conventional inspection procedure may be biased and low in efficiency. As a result, deep learning has emerged as a reliable technique for quality inspection of the AM-built part. Deep learning is a type of machine learning. The first step in the machine learning (ML) pipeline is the manual extraction of pertinent characteristics from images. These characteristics are also used to categorize the image based on particular characteristics. However, in deep learning, the pertinent characteristic is automatically retrieved from the dataset rather than being manually extracted [68]. The sector-wise representation of various deep learning models associated with AM to date is presented in Figure 8. The various model of DL associated with the AM has been discussed in this section elaborately.

4.1. Convolutional Neural Networks (CNNs)

Convolutional neural networks are one of the deep neural network types that have received the most attention. Because of the rapid development in the amount of annotated data and considerable advances in the capacity of graphics processor units, convolutional neural network research has quickly developed and achieved state-of-the-art outcomes on several applications [69]. CNNs are made up of neurons that learn to optimize themselves, similar to traditional ANNs [70]. CNNs are frequently used in academic and commercial projects due to their benefits, such as down sampling, weight sharing, and local connection. A CNN model typically requires four components to be built. Convolution is an essential step in feature extraction. Feature maps are the results of convolution. We will lose boundary information if we use a convolution kernel of a specific size [71]. Padding is thus used to increase the input with a zero value, which can modify the size indirectly. Furthermore, the stride is employed to control the density of convolving. The density diminishes as the stride size increases. Feature maps generated after convolution contain many features, which might cause overfitting. Pooling (also known as aggregation) avoids redundancy [72]. The basic architecture of CNN is presented in Figure 9. Table 4 provides a summary of various literature on CNN. The deep CNN was accepted as the winning entry in the ImageNet Challenge 2012 (LSVRC-2012), developed by Krizhevsky, Sutskever, and Hinton. Since then, DL has been successfully used for several use cases, including, text processing, computer visions, sentiment analysis, recommendation systems, etc. Besides that, big businesses like Google, Facebook, Amazon, IBM, and others have established their own DL research facilities [73]. In addition to that, AM has also incorporated it enormously. As shown in Figure 8.

4.2. Recurrent Neural Networks (RNNs), GRU and LSTM

Recurrent neural networks (RNN) are built to handle sequential or time series data. Time series data can take the form of text, audio, video, and so on. The architecture of the RNN unit demonstrates this. It uses the previous step’s input as well as the current input. Tanh is the activation function here; alternative activation functions can be used in place of tanh. RNNs have short-term memory issues. The vanishing gradient issue causes it. RNN will not remember the long sequences of input [84]. To address this issue, two customized variants of RNN were developed. They are as follows: (1) GRU (gated recurrent unit) (2) LSTM (long-term memory). All the network is shown in Figure 10.
LSTMs and GRUs use memory cells to store the activation values of preceding words in extended sequences [85]. The concept of gates enters the picture now. Gates are used in networks to control the flow of information. Gates can learn which inputs in a sequence are essential and retain their knowledge in the memory unit. They can provide data in extended sequences and use it to generate predictions. The workflow of GRU is similar to that of RNN. However, the distinction is in the operations performed within the GRU unit. Table 5 summarizes the various literature on the sequences model.

4.3. Generative Adversarial Networks (GANs) and Autoencoder

The GAN has recently gained popularity in the fields of computer science and manufacturing, ranking among the most widely used deep learning approaches. The GANs are used in computer vision applications in many areas such as medical, and industrial automation. The generating network and the discriminative network are the two networks that make up a GAN [13]. The generator generates the fake image and the decimator differentiates the fake image from the original image. First, using a generator, we create a fake image out of a batch of random vectors drawn from a Gaussian distribution. The generated image does not mirror the real input distribution because the generator has not been educated. We feed the discriminator batches of actual and created fake images from the input distribution so that it can learn to distinguish between the two types of images. An image-enhancement generative adversarial network (IEGAN) is created, and the training procedure uses a new objective function. The thermal images obtained from an AM method are used for image segmentation to confirm the superiority and viability of the proposed IEGAN. Results of experiments show that the created IEGAN works better than the original GAN in raising the contrast ratio of thermal images [27]. Figure 11 depicts the GAN and autoencoder overview.
An autoencoder is used for unsupervised learning data encodings. An autoencoder trains the network to identify the key elements of the input image to learn a lower-dimensional representation (encoding) for higher-dimensional data, generally for dimensionality reduction. Ironically, the bottleneck is the most crucial component of the neural network. The autoencoder is widely applied in noise reductions in the image. The auto-encode takes X as input and tries to generate X as output [96]. Table 6 summarizes the various literature on GAN and autoencoders.

4.4. Restricted Boltzmann Machines (RBMs) and Deep Belief Networks (DBNs)

Geoffrey Hinton also developed RBMs, which have a wide range of applications including feature engineering, collaborative filtering, computer vision, and topic modeling [106]. RBMs, as their name suggests, are a minor variation of Boltzmann machines. They are simpler to design and more effective to train than Boltzmann machines since their neurons must form a bipartite network, which means there are no connections between nodes within a group (visible and hidden). Particularly, this connection constraint enables RBMs to adopt training methods that are more effective and sophisticated than those available to BM, such as the gradient-based contrastive divergence algorithm.
A strong generative model known as a deep belief network (DBN) makes use of a deep architecture made up of numerous stacks of restricted Boltzmann machines (RBM). Each RBM model transforms its input vectors nonlinearly (similar to how a standard neural network functions) and generates output vectors that are used as inputs by the subsequent RBM model in the sequence. DBNs now have a lot of flexibility, which also makes them simpler to grow. DBNs can be employed in supervised or unsupervised contexts using a generative model. In numerous applications, DBNs may perform feature learning, extraction, and classification [107]. Table 7 summarizes various literature on DBNs.

4.5. Other Deep-Learning Networks

In addition to the above-described deep learning model, there are a few more DL algorithms that have been used, such as radial basis function networks (RBFNs), self-organizing maps (SOMs), multilayer perceptrons (MLPs), etc. However, a significantly less prominent use case was present while doing a literature survey on these models. Much work has been done using MLP, but it has some limitations over CNN. Object detections and segmentations are used in defect detections in AM.
Li et al. used the YOLO object detection deep learning model for defect detection in adaptive manufacturing. It enables rapid and precise flaw identification for wire and arc additive manufacturing (WAAM). Yolo algorithm performances are compared with a traditional object detections algorithm. It shows that it can be used in real-world industrial applications and has the potential to be used as a vision-based approach in defect identification systems [110].
Chen et al. discuss how we improve classifying the product quality in AM by using the YOLO algorithm. The outcome shows that 70% of product quality is classified in Realtime video. The YOLO algorithm performances are compared with different version from version 2 to version 5 and the YOLO algorithm reduces the labor cost [111].
Wang et al. developed center net-based defect detection for AM. The center net uses object size, a heatmap, and a density map for defect detection. The suggested model, Center Net-CL, outperforms traditional object detection models, such as one-stage, two-stage, and anchor-free models, in terms of detection performance. Although this strategy worked effectively, it is only applicable in certain sectors [112].
The semantic segmentation framework for additive manufacturing can improve the visual analysis of production processes and allow the detection of specific manufacturing problems. The semantic segmentation work will enable the localization of 3D printed components in picture frames that were collected and the application of image processing techniques to its structural elements for further tracking of manufacturing errors. The use of image style transfer is highly valuable for future study in the area of converting synthetic renderings to actual photographs of 3D printed objects [113].
Wong et al. reported the challenges of segmentations in AM. The image size is very small and the appearance of defect variations is also very small, so it is very difficult to detect defects in AM. Three-dimensional CNN achieved good performances in volumetric images. A 3D U-Net model was used to detect errors automatically using computed tomography (XCT) pictures of AM specimens [114].
Wang et al. presented anunsupervised deep learning algorithm for defect segmentations in AM. The unsupervised models extract local features as well as global features in the image for improving the defect segmentations in AM. A self-attention model performs better than the without-self-attention model for defect detection in AM [115].
Job scheduling is the biggest problem in AM. The order in which the job is scheduled is to be decided for the better performance of AM. Deep reinforcement learning can be applied to decide the job orders. Traditional approaches need a lot of time since they can only find the best answer at a particular moment and must start again if the state changes. Deep reinforcement learning (DRL) is employed to handle the problem of job scheduling AM. The DRL approach uses proximal policy optimization (PPO) to identify the best scheduling strategy to address the state’s dimension disaster [116].
Abualkishik et al. discussed how natural language processing can be applied to customer satisfaction and improve the process of the AM. Graph pooling and the learning parameter can be applied as proof of customer satisfaction [117].

5. Challenges and Solution

5.1. Data Privacy

Demands for personalized and individualized products are surging, necessitating new production paradigms that keep up with the transformation. In the framework of Industry 4.0, pervasive connectivity, digitization, and sharing offer a chance for the next-generation production paradigm. By utilizing the benefits of connectivity and sharing across the product life-cycle, customized production refers to a customer-centric production paradigm in which specific demands and preferences are translated into individualized goods and services at a reasonable price [118]. A manufacturing company may ship physical objects, blueprints, or STL files to domestic and foreign locations based on the client’s demands, requirements, and specifications [119]. There are numerous devices connected to the IoT network in 3D printers. Therefore the main concerns are related to communication and design elements’ security and privacy [120]. Frustaci et al. [121] have classified the threat in the digital world into three-layer, application, transportation, and perception levels, respectively. The main security threats within this layer are as follows.
  • Data leakage: by being aware of the service or application’s flaws, the attacker can steal data (including user data, such as user passwords).
  • Denial of service attack: attackers have the power to eliminate an application’s or service’s availability.
  • Malicious code injection: through the use of known vulnerabilities, attackers can upload malicious code into software applications.
Pearce et al. presented a use case in which they designed and researched a harmful Trojan for AVR-based Marlin-compatible 3D printers to further illustrate the risk. They demonstrated the Trojan’s capacity to evade programming tools. It can degrade the quality of prints produced through additive manufacturing even with strict design restrictions and diminish tensile strengths by up to 50% [122].

5.2. Model Generalization

Deep learning models have recently demonstrated excellent performance in a variety of fields, including computer vision, text, and speech processing. However, despite their cutting-edge performance, it still needs to be a determined generalized model for applications [123]. Zhang et al. [124] state that, despite their massive size, successful deep ANN can show a minimal difference in training and test performance. Conventional wisdom attributes minor generalization errors to either model family properties or training regularization techniques.

5.3. Computational Time

Due to its capacity to outperform other methodologies and even humans at many issues, DL is swiftly emerging as the go-to tool for many artificial intelligence problems. Even though deep learning is very popular, we are still attempting to estimate how long it will take to train a network to tackle a certain problem. This training period can be calculated as the product of the number of epochs needed to reach the desired degree of accuracy and the training period per epoch. However, this relationship is not sincere and worsens as other tasks take up the execution time. For instance, the amount of time it takes to load data from memory or the performance degradation brought on by inefficient parallel processing [125]. The number of floating-point operations limits how long it takes for a neural network to execute during a forward pass (FLOPs). The deep neural network architecture and the volume of data define the FLOPs. The time needed for each of these FLOPs depends on the device specification. Similar to data size, communication times are linearly related to them when memory bandwidth is used and data transfers are properly controlled [126]. Thompson et al. state that deep learning has recently achieved great success, from defeating humans in the game of Go to world-leading performance in picture classification, speech recognition, translation, and other tasks. However, this development has been accompanied by an insatiable need for processing power. The fundamental question for deep learning’s future is how performance scales up or how much the field’s performance improves as processing power increases. It has become fashionable to employ optimization to develop network topologies that are computationally efficient to train while still performing well on a subset of learning challenges [67,127]. Designers take advantage of the fact that many datasets are comparable, allowing for the usage of previously trained models in meta-learning and transfer learning [128].

5.4. Trustworthiness

The study of artificial intelligence has been revitalized by recent developments in machine and deep learning, which have sparked optimism that AI will play a crucial role in everyday life, with no exception for smart manufacturing as well as additive manufacturing. However, the quick spread of AI will lead to several ethical, societal, and legal problems. It undermines the public’s trust in its systems [129]. The majority of users perceive AI systems as invisible black boxes with no information about how they make decisions within. Therefore, queries such as “why should I trust you?” are frequently directed toward AI or deep learning systems [130,131,132,133]. Because of this, various research suggests necessary criteria, principles, or mechanisms raise the level of AI system trust. Trustworthy AI (TAI) concepts have been prevalent in this new domain [134,135,136,137]. To the highest degree possible, AI must be trusted in its creation, application, and use if it is to contribute to human and societal wellbeing [138]. Table 8 shows the summaries of the necessary criteria, principles, or mechanisms of TAI.
Table 8 shows that the majority of earlier investigations provided comparable summaries. In order for AI systems to be referred to as trustworthy AI systems, they must adhere to the aforementioned concepts or requirements. The Trusted AI project from the Linux Foundation AI [135] proposed a very good open-source framework to achieve TAI in the technical approach. KServe [139] has incorporated this framework, but due to the original framework’s numerous methods, only a small number of algorithms have been added to KServe for the current version. The Trusted AI Project consists of three primary parts: AI Explainability (AIX360) [140], AI Fairness (AIF360) [141], and an Adversarial Robustness Toolbox (ART) [142]. Further explanation will be provided.

5.5. AI Explainability (AIX)

AI Explainability’s primary goal is to enlighten on how and why predictions are made by AI models while retaining high levels of predictive performance. People who use the system and are affected by it could have a solid comprehension of the system, its applications, and its limitations with the right explanation [132,143]. Additionally, it will respond to the query “Why should I trust you?” that was previously raised, and systems will win over users’ increased trust. Or, depending on the explanation, people would understand when and why they should not trust the AI models [130]. Figure 12 shows that traditional AI models, particularly black box models, do not explain their output. It causes users to not understand why the model produces such an output with a given input. On the other hand, AIX provides methods that explain every given input, allowing users to gain a better understanding of the AI output. Several AIX methods, such as LIME (local interpretable model-agnostic explanations) [2], SHAP [144], Grad-CAM [145], Protodash [146], etc., have been put out in earlier research. TAI requirements, such as explainability, transparency, and accountability, will have a greater chance of being met with AIX implementation. In additive manufacturing, for example, AIX can help to explain defect classification on 3D printed products using deep learning. AIX can show an extended explanation of why the product is classified as a certain defect or why not [147]. Further, it will help to explain what AI models have learned during their training and how they distinguish the defect class. A useful survey on how and where AIX is used in Industry 4.0 was published by Ahmed et al. [148].

5.6. AI Fairness

The AI model does not always deliver fair decisions, according to several earlier studies. Unfair deep-learning algorithms may have serious consequences for certain groups or people. Some individuals have even suffered significant losses as a result of these unfair decisions or predictions. Tolan et al. [149] discovered that machine learning models produce inaccurate predictions of juvenile recidivism risk for certain groups. According to Dastin [150], the AI model for hiring tools created by Amazon gave all female candidates a negative rating and favored male candidates. This is because the dataset used in the training was based on the existing staff statistics, which show that men outnumber women. As a result, their AI model unintentionally learned that men candidates are chosen first. According to these studies [151,152,153,154] embedding-based machine learning systems can exacerbate biases and discriminate against users, especially those who belong to underprivileged social groups.
As seen in Figure 13, several possible nodes can cause bias or unfairness in a machine or deep learning workflow. The first node was the dataset. If the dataset was imbalanced, then it would have a high possibility of producing an AI model with embedded bias or only being accurate for a certain prediction class [153]. The second node was model training, to be exact in the processes of feature selection (feature engineering), data cleaning, and data preprocessing [155]. This step needs to be handled carefully; otherwise, if sensitive features such as gender, race, region, etc. are not handled properly, it will also increase the possibility of producing an unfair AI model [153]. The last node was the AI model itself. If we could ensure the previous two-step is correct, then the possibility that an AI model could give an unfair prediction might be because of external attacks [156,157,158,159,160]. The attacks will be further discussed in the next subsection.
In the field of AM, an imbalance in the data can prevent the AI model from correctly classifying. For instance, there is an unbalanced amount of data on normal products and defective products. When these data are used for training, they can cause the model to be wrong or unable to classify product defects properly [161]. Or, when the model is only trained using defective product data and does not include normal product data, the model will tend to continue to detect defects even though the true results are normal. As a result, the predicted results are inaccurate and cause losses for both customers and business owners [162].
The aforementioned problems require a variety of approaches to be solved. For instance, good data governance could aid in reducing the problems with accountability, fairness, discrimination, and trust [163]. From the beginning to the end of the system lifecycle, the system must be completely monitored and validated for data flow by good data governance. AIF360’s bias mitigation algorithms [141] may be utilized to address these problems as well. Additionally, several approaches can be used, such as FairALM [153], to mitigate issues with fairness in image classification situations, or FairGrad [154], which enforces fairness using a reweighting scheme that iteratively learns group-specific weights based on whether or not they are disadvantaged. How to defend machine learning models and applications from attacks is a topic we will cover in more detail in the following subsection.

5.7. Adversarial Robustness Toolbox (ART)

It is crucial to assess a deep learning model’s robustness and reliability as we strive to deploy them outside of virtual and controlled domains. This analysis should focus less on the model’s accuracy or the fact that it generally works. A very robust model is necessary to assure security and boost trustworthiness because deep learning algorithms are sensitive to adversarial attacks [164,165,166,167]. The adversarial robustness toolbox (ART) [13] is a comprehensive set of tools for academicians and software developers to defend and evaluate machine learning models. Figure 14 depicts the four categories of attack in deep learning. Researchers have been developing several adversarial attack methods to assess deep learning models, so based on the results, solutions to defend against those kinds of attacks are also presented [34,168]. With the help of ART, the model can be trained under adversarial training in the hope of increasing model robustness [157,164,169]. As a result, the trained model could detect and defend against adversarial attacks.
A perfect study case to illustrate the importance of model robustness would be quality control in AM that uses computer vision to identify defective products. Assume the deep learning defect detection model has been effectively attacked. The model is then said to classify the fault with a high degree of accuracy. Every input the model received was incorrectly classified as a result of the attack; either a defective product was labeled as a normal one or vice versa. Of course, both consumers and business owners will suffer losses as a result. A defective product could be sent to customers. Business owners would receive numerous complaints and lose their devoted customers. It makes sense, given this example, that efforts to make the model more robust are crucial.

6. Future Thrust Areas in Additive Manufacturing

In this section, different future trust technologies, how to use these technologies in additive manufacturing, and research directions of additive manufacturing in terms of technologies are addressed. According to emerging research (a market research and strategy consulting company) report 2021, the top five companies which are in the advanced stage of Industry 4.0 development are Intel Corporation, General Electric Company, IBM Corporation, Siemens AG, and Cisco Systems Inc. However, there are lot of new companies those who are in the early stage of acquiring Industry 4.0 in their product process cycle. Some of the new companies associated with the early stage of Industry 4.0 are Indu 4.0 and Scale AI.

6.1. Big Data Analytics and IoT

The impact of Industry 4.0 on mass personalization and customization is significant. While AM technologies allow for the customization of final products, they cannot be used for the large-scale mass manufacturing of 3D-printed objects. While this is going on, big data research provides a suitable approach for handling the enormous volumes of data produced by AM techniques [170]. Apart from its contributions to AM research and production, Big Data analysis approaches can also be used to assist designers and engineers by gathering helpful information from clients and customers [171]. In recent work, Francis et al. have created a unique DL technique that accurately predicts distortion within LBAM tolerance limits by considering local heat transfer for pointwise distortion prediction. The DL technique provides accurate predictions and fits into the Industry 4.0 framework of evaluating massive data with many sensors [172].
Kevin Ashton, co-founder of the Auto-ID center at Massachusetts Institute of Technology in the United States, created the term “Internet of Things” in 1999 [173]. The IoT offers greater individualization, less material waste, and faster manufacturing in AM processes [174]. The use of 3D printing and cyber-physical systems in production, design, and maintenance procedures is possible. The 3D printer and other cloud platforms can both access this content. No matter how far away the user is from the AM machine, they may still access the collected content [175].

6.2. Digital Twins

Digital twinning provides virtual copies of physical locations, plant processes, business processes, and assets. Combined with AI, it allows plant operators to discover value in plant data, which they can use to drive improvement across multiple operations [176]. According to recent investigations and research, building a first-generation digital twin of AM is feasible. However, this technology is still in its early stages and faces numerous research obstacles [177]. Digital twin (DT) implementations can assist smart manufacturing by linking the physical and cyber spaces [178]. Artificial intelligence (AI) applications based on machine learning (ML) are considered promising manufacturing technology. However, ML methods necessitate a significant number of high-quality training datasets, and hand labeling is frequently required in the case of supervised ML [179]. Recently Alexopoulos et al. [180] have suggested a framework for putting the pr DT-driven approach to building ML models into practice. A real-world use case has been used to implement the proposed framework.

6.3. AI-Enabled Human-Centred AM

AM of human-centered goods begins with the design phase. As a result, design for AM (DfAM) has been widely researched using the principle of designing and optimizing the product and the manufacturing processes to achieve the required quality and performance while minimizing time and cost [181]. DfAM must account for several design variables and their complex interactions since AM products typically have complex geometries (mainly the human-centered AM mentioned in this section). As a result, traditional design methodologies face a substantial challenge. To address this difficulty, DfAM has seen an increase in AI and machine learning use in recent years. Designers, for example, have used AI to optimize the geometry of AM goods [8,182]. In recent work, Tang et al. [183] investigated the customization of porous lattice shoe soles, where machine learning was applied as a surrogate model. In the meantime, these studies have shown the need for quality evaluation in AM, particularly for manufacturing human-centered customized items, which are frequently of high quality [184,185] in the AM.

6.4. Federated Learning

The industry’s 4.0-based approach to digital transformation in smart manufacturing is fully interconnected, autonomous, and monitored using advanced artificial intelligence and machine learning techniques [186]. The main limitations of artificial intelligence and machine learning are that data is centralized, no data privacy, no model training in real-time, and no personalization in smart manufacturing. The advanced decentralized machine learning technique, called federated learning, helps to solve the above-mentioned limitations in smart and additive manufacturing [187]. Decentralized federated learning with IIOT provides a smart solution to different problems in the industry [188]. The IIOT helps to optimize the process, provide effective resource allocation, manage the load, and task management, and minimize the cost using federated learning [189], and in addition, confidential data distribution in the industry to increase productivity using federated learning [190]. In particular, industrial internet federated learning [191], managing defects in design and manufacturing [192], data analysis and storage [193], privacy and effective model sharing for design [194], cognitive computing in the industry [195], and future industry collaboration for effective design model and defect updating in AM are some of the main supporting research directions using the federated learning technology [196]. The structure of the industry-based federated learning representation is shown in Figure 15.

6.5. Sustainability

AM has been rapidly evolving, revealing a significant promise for energy-saving and cleaner environmental production through reduced material and resource consumption. Sustainability in terms of industries production, design, technologies, the life cycle of AM, and managing the environment are considered in AM [27]. Representation of the different AM sustainability factors is shown in Figure 16. Sustainable and smart additive manufacturing is a new concept that combines the fundamental principles of smart manufacturing, sustainable manufacturing, and additive manufacturing (SSAM) [197]. SSAM particularly focuses on energy consumption and environmental impacts.
In examining the life cycle of SAM, it is apparent the entire life cycle needs to reduce energy consumption over design, preparation of materials, manufacturing, real-time usage, and end treatment of materials [198]. Energy optimization methods help to reduce the energy usage. Sustainability of AM from the recycling of materials and based on recycling an economy is also one of the main researches to consider in AM [199]. The role of environmental sustainability in managing the wastage of raw materials, energy usage, and managing pollution emissions in Industry 4.0 needs consideration in AM [200]. For sustainability, many techniques are used in AM. Technological [201] sustainability is grouped into two types, technical and policies. The machinery, materials, and designs are all taken into account in the technical design [202]. The standard rules and behaviors are considered in the policy [203]. Different processes are also considered for sustainable AM. Process specification-relevant technologies such as direct metal and selective metal sintering are used to evaluate the energy consumption in AM [204]. The different effective frameworks are considered for sustainable AM. For improving quality [205] and improving the life cycle of sustainability [206], different effective frameworks need to be considered. Different performance indicators are also considered to manage sustainability, such as the amount of consumption (energy, water), efficiency, availability, recycling, value recovery, etc. [207,208].
Finally, all the work has been summarized in a sustainable pyramid, where manufacturing will lead the foundation of Industry 4.0. Above that, deep learning will create the pillars for achieving sustainability. The sustainable pyramid is shown in Figure 17.

7. Conclusions

In the year 2015, various leaders from 193 countries of the world met together to face the future. They agreed to 17 global goals (officially known as the Sustainable Development Goals or SDGs), which aim to create a better world by 2030. The United Nations Development Program (UNDP) is helping countries to achieve this goal. Goal 12 is to ensure “responsible consumption and production”, which is the main aim of this review. As a result of the fragmented coordination of the AM community, it is necessary to include all stakeholders, including those from government, academia, and industry, in a workshop to discuss important issues that affect all organizations and markets.
The primary objective of this article is to outline current research in deep learning and additive manufacturing. There are several evaluations on these two issues that are given individually. However, much effort has been expended in the integration of the same. While writing this evaluation, it was discovered that none of the articles highlighted the research conducted in these two fields over the previous decade. As a result, all the research on applying deep learning in additive manufacturing has been collected and summarized in this review article. This will assist readers in comprehending the trend and benefits of combining the two essential technologies. Furthermore, several future endeavors (such as digital twins, XAI, federated learning, and so on) that can be implemented into this technology have been emphasized. Moreover, all the challenges and solutions using deep learning are outlined, which can assist new researchers entering this sector.
Additive manufacturing has several advantages in terms of prototypes, personalized products, energy savings, and material waste. As a result, smaller start-ups with new ideas, less space, and less inventory in the warehouse can enter the market. Various limitations in this sector can be addressed by adding deep learning. By integrating these two technologies, quality control may be entirely atomized, increasing the operation’s overall productivity. Furthermore, the entire process may be remotely watched by using it as a digital twin. Many new developing companies provide end-to-end 3D printing software packages that cover everything from the design process to post-print validation, as well as correcting software faults and hardware compatibility issues.
Many datasets are associated with the process, so implementing deep learning would be easy for this technology. It is known that deep learning is an essential element of Industry 4.0. Thus, incorporating deep learning into it would lead to automation in digital manufacturing as the quality control and process parameter would be optimized through the feedback control loop with the help of deep learning. There are certain drawbacks to implementing DL in the design, process, or production of AM, as with two sides of the same coin. Therefore, in this review AM is discussed from scratch (from model building to dataset generation) and how deep learning can be implemented. Various kinds of defects are also listed, together with the respective technology. However, in the later section, different deep learning techniques have been discussed along with specific AM technologies, which will give researchers ideas on implementing two key technologies of deep learning: XAI and federated learning. The first explains the black box model of deep learning, and the latter emphasizes data security. Federated learning also reduces data handling, which can also help in data preprocessing.
In a nutshell, the sole purpose of this review is to achieve sustainability through manufacturing so that, as a research community, we can contribute towards the United Nations Sustainable Development Goals and create a better world by 2030.

Author Contributions

A.P.: Devised the review, the main conceptual ideas and structure of the paper; N.S.: Supervised the outline of the additive manufacturing and material used in the process, Overall supervision; S.U.: Added fairness, robustness and explainability to the specified areas; J.A.: Added to the future thrust areas in AM; P.K.: Formatting, Deep learning section; P.-A.H.: Supervised the outline of the Deep learning and its application to the area of research, Overall supervision. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Data Availability Statement

Not applicable.

Acknowledgments

The authors are grateful to the Indian Institute of Technology, Ropar, and National Chung Cheng University Chiayi County, Taiwan, for providing Ph.D. scholarship through MHRD (Ministry of Human Resource and Development) and TEEP (Taiwan Experience Education Programs).

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Shamsaei, N.; Yadollahi, A.; Bian, L.; Thompson, S.M. An overview of Direct Laser Deposition for additive manufacturing; Part II: Mechanical behavior, process parameter optimization and control. Addit. Manuf. 2015, 8, 12–35. [Google Scholar] [CrossRef]
  2. Grasso, M.; Colosimo, B.M. Process defects and in situ monitoring methods in metal powder bed fusion: A review. Meas. Sci. Technol. 2017, 28, 044005. [Google Scholar] [CrossRef] [Green Version]
  3. Razvi, S.S.; Feng, S.; Narayanan, A.; Lee, Y.-T.T.; Witherell, P. A Review of Machine Learning Applications in Additive Manufacturing. In Proceedings of the International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, Anaheim, CA, USA, 18–21 August 2019; American Society of Mechanical Engineers: New York, NY, USA, 2019. [Google Scholar] [CrossRef]
  4. Jiang, J.; Weng, F.; Gao, S.; Stringer, J.; Xu, X.; Guo, P. A support interface method for easy part removal in directed energy deposition. Manuf. Lett. 2019, 20, 30–33. [Google Scholar] [CrossRef]
  5. Xiong, J.; Zhang, Y.; Pi, Y. Control of deposition height in WAAM using visual inspection of previous and current layers. J. Intell. Manuf. 2021, 32, 2209–2217. [Google Scholar] [CrossRef]
  6. Schmidhuber, J. Deep Learning in Neural Networks: An Overview. Neural Netw. 2015, 61, 85–117. [Google Scholar] [CrossRef] [Green Version]
  7. Li, Y.; Yan, H.; Zhang, Y. A Deep Learning Method for Material Performance Recognition in Laser Additive Manufacturing. In Proceedings of the 2019 IEEE 17th International Conference on Industrial Informatics (INDIN), Helsinki, Finland, 22–25 July 2019; pp. 1735–1740. [Google Scholar] [CrossRef]
  8. Jiang, J.; Xiong, Y.; Zhang, Z.; Rosen, D.W. Machine learning integrated design for additive manufacturing. J. Intell. Manuf. 2022, 33, 1073–1086. [Google Scholar] [CrossRef]
  9. Van Eck, N.J.; Waltman, L. Citation-based clustering of publications using CitNetExplorer and VOSviewer. Scientometrics 2017, 111, 1053–1070. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  10. Kim, H.; Lin, Y.; Tseng, T.-L.B. A review on quality control in additive manufacturing. Rapid Prototyp. J. 2018, 24, 645–669. [Google Scholar] [CrossRef]
  11. Plocher, J.; Panesar, A. Review on design and structural optimisation in additive manufacturing: Towards next-generation lightweight structures. Mater. Des. 2019, 183, 108164. [Google Scholar] [CrossRef]
  12. Tang, Y.; Zhao, Y.F. A survey of the design methods for additive manufacturing to improve functional performance. Rapid Prototyp. J. 2016, 22, 569–590. [Google Scholar] [CrossRef]
  13. Chinchanikar, S.; Shaikh, A.A. A Review on Machine Learning, Big Data Analytics, and Design for Additive Manufacturing for Aerospace Applications. J. Mater. Eng. Perform. 2022, 31, 6112–6130. [Google Scholar] [CrossRef]
  14. Charalampous, P.; Kostavelis, I.; Tzovaras, D. Non-destructive quality control methods in additive manufacturing: A survey. Rapid Prototyp. J. 2020, 26, 777–790. [Google Scholar] [CrossRef]
  15. Lee, J.; Park, H.; Chai, S.; Kim, G.; Yong, H.; Bae, S.; Kwon, D. Review on Quality Control Methods in Metal Additive Manufacturing. Appl. Sci. 2021, 11, 1966. [Google Scholar] [CrossRef]
  16. Mehrpouya, M.; Dehghanghadikolaei, A.; Fotovvati, B.; Vosooghnia, A.; Emamian, S.S.; Gisario, A. The Potential of Additive Manufacturing in the Smart Factory Industrial 4.0: A Review. Appl. Sci. 2019, 9, 3865. [Google Scholar] [CrossRef] [Green Version]
  17. Butt, J. Exploring the Interrelationship between Additive Manufacturing and Industry 4.0. Designs 2020, 4, 13. [Google Scholar] [CrossRef]
  18. Dilberoglu, U.M.; Gharehpapagh, B.; Yaman, U.; Dolen, M. The Role of Additive Manufacturing in the Era of Industry 4.0. Procedia Manuf. 2017, 11, 545–554. [Google Scholar] [CrossRef]
  19. Haleem, A.; Javaid, M. Additive Manufacturing Applications in Industry 4.0: A Review. J. Ind. Integr. Manag. 2019, 4, 1930001. [Google Scholar] [CrossRef]
  20. Kawalkar, R.; Dubey, H.K.; Lokhande, S.P. A review for advancements in standardization for additive manufacturing. Mater. Today Proc. 2022, 50, 1983–1990. [Google Scholar] [CrossRef]
  21. Taborda, L.L.L.; Maury, H.; Pacheco, J. Design for additive manufacturing: A comprehensive review of the tendencies and limitations of methodologies. Rapid Prototyp. J. 2021, 27, 918–966. [Google Scholar] [CrossRef]
  22. Puebla, K.; Arcaute, K.; Quintana, R.; Wicker, R.B. Effects of environmental conditions, aging, and build orientations on the mechanical properties of ASTM type I specimens manufactured via stereolithography. Rapid Prototyp. J. 2012, 18, 374–388. [Google Scholar] [CrossRef]
  23. Wong, K.V.; Hernandez, A. A Review of Additive Manufacturing. ISRN Mech. Eng. 2012, 2012, 208760. [Google Scholar] [CrossRef] [Green Version]
  24. Moroni, G.; Petrò, S.; Shao, H. On Standardization Efforts for Additive Manufacturing. In Proceedings of the 5th International Conference on the Industry 4.0 Model for Advanced Manufacturing, Belgrade, Serbia, 1–4 June 2020; Springer: Cham, Switzerland, 2020; pp. 156–172. [Google Scholar] [CrossRef]
  25. Ngo, T.D.; Kashani, A.; Imbalzano, G.; Nguyen, K.T.Q.; Hui, D. Additive Manufacturing (3D Printing): A Review of Materials, Methods, Applications and Challenges. Compos. Part B Eng. 2018, 143, 172–196. [Google Scholar] [CrossRef]
  26. Rosen, D.W. Research supporting principles for design for additive manufacturing. Virtual Phys. Prototyp. 2014, 9, 225–232. [Google Scholar] [CrossRef]
  27. Ford, S.; Despeisse, M. Additive manufacturing and sustainability: An exploratory study of the advantages and challenges. J. Clean. Prod. 2016, 137, 1573–1587. [Google Scholar] [CrossRef]
  28. Minnema, J.; van Eijnatten, M.; Kouw, W.; Diblen, F.; Mendrik, A.; Wolff, J. CT image segmentation of bone for medical additive manufacturing using a convolutional neural network. Comput. Biol. Med. 2018, 103, 130–139. [Google Scholar] [CrossRef] [Green Version]
  29. Perone, C.S.; Cohen-Adad, J. Promises and limitations of deep learning for medical image segmentation. J. Med. Artif. Intell. 2019, 2, 1. [Google Scholar] [CrossRef]
  30. Javaid, M.; Haleem, A. Additive manufacturing applications in orthopaedics: A review. J. Clin. Orthop. Trauma 2018, 9, 202–206. [Google Scholar] [CrossRef] [PubMed]
  31. Kamali, A.H.; Moradi, M.; Goodarzian, F.; Ghasemi, P. A discrete event simulation method for performance analysis of an additive manufacturing in the dental clinic. Int. J. Adv. Manuf. Technol. 2022, 118, 2949–2979. [Google Scholar] [CrossRef] [PubMed]
  32. Shen, Z.; Shang, X.; Li, Y.; Bao, Y.; Zhang, X.; Dong, X.; Wan, L.; Xiong, G.; Wang, F.-Y. PredNet and CompNet: Prediction and High-Precision Compensation of In-Plane Shape Deformation for Additive Manufacturing. In Proceedings of the 2019 IEEE 15th International Conference on Automation Science and Engineering (CASE), Vancouver, BC, Canada, 22–26 August 2019; pp. 462–467. [Google Scholar] [CrossRef]
  33. Salmi, M. Additive Manufacturing Processes in Medical Applications. Materials 2021, 14, 191. [Google Scholar] [CrossRef]
  34. Guzzi, E.A.; Tibbitt, M.W. Additive Manufacturing of Precision Biomaterials. Adv. Mater. 2020, 32, e1901994. [Google Scholar] [CrossRef] [PubMed]
  35. Tuomi, J.; Paloheimo, K.-S.; Vehviläinen, J.; Björkstrand, R.; Salmi, M.; Huotilainen, E.; Kontio, R.; Rouse, S.; Gibson, I.; Mäkitie, A.A. A Novel Classification and Online Platform for Planning and Documentation of Medical Applications of Additive Manufacturing. Surg. Innov. 2014, 21, 553–559. [Google Scholar] [CrossRef]
  36. Shin, J.; Lee, Y.; Li, Z.; Hu, J.; Park, S.S.; Kim, K. Optimized 3D Bioprinting Technology Based on Machine Learning: A Review of Recent Trends and Advances. Micromachines 2022, 13, 363. [Google Scholar] [CrossRef]
  37. Jung, J.W.; Lee, J.-S.; Cho, D.-W. Computer-aided multiple-head 3D printing system for printing of heterogeneous organ/tissue constructs. Sci. Rep. 2016, 6, 21685. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  38. Delic, M.; Eyers, D.R. The effect of additive manufacturing adoption on supply chain flexibility and performance: An empirical analysis from the automotive industry. Int. J. Prod. Econ. 2020, 228, 107689. [Google Scholar] [CrossRef]
  39. Leal, R.; Barreiros, F.; Alves, M.; Romeiro, F.; Vasco, J.C.; Santos, M.; Marto, C. Additive manufacturing tooling for the automotive industry. Int. J. Adv. Manuf. Technol. 2017, 92, 1671–1676. [Google Scholar] [CrossRef]
  40. Shapiro, A.; Borgonia, J.P.; Chen, Q.N.; Dillon, R.P.; McEnerney, B.; Polit-Casillas, R.; Soloway, L. Additive Manufacturing for Aerospace Flight Applications. J. Spacecr. Rocket. 2016, 53, 952–959. [Google Scholar] [CrossRef]
  41. Schiller, G.J. Additive manufacturing for Aerospace. In Proceedings of the 2015 IEEE Aerospace Conference, Big Sky, MT, USA, 7–14 March 2015; pp. 1–8. [Google Scholar] [CrossRef]
  42. Yakout, M.; Cadamuro, A.; Elbestawi, M.A.; Veldhuis, S.C. The selection of process parameters in additive manufacturing for aerospace alloys. Int. J. Adv. Manuf. Technol. 2017, 92, 2081–2098. [Google Scholar] [CrossRef]
  43. Busachi, A.; Erkoyuncu, J.; Colegrove, P.; Drake, R.; Watts, C.; Martina, F. Defining Next-Generation Additive Manufacturing Applications for the Ministry of Defence (MoD). Procedia CIRP 2016, 55, 302–307. [Google Scholar] [CrossRef] [Green Version]
  44. Segonds, F. Design by Additive Manufacturing: An application in aeronautics and defence. Virtual Phys. Prototyp. 2018, 13, 237–245. [Google Scholar] [CrossRef] [Green Version]
  45. Busachi, A.; Erkoyuncu, J.; Colegrove, P.; Drake, R.; Watts, C.; Wilding, S. Additive manufacturing applications in Defence Support Services: Current practices and framework for implementation. Int. J. Syst. Assur. Eng. Manag. 2017, 9, 657–674. [Google Scholar] [CrossRef] [Green Version]
  46. Turkmen, K.G.H.S. Common FDM 3D Printing Defects. In Proceedings of the International Congress on 3D Printing (Additive Manufacturing) Technologies and Digital Industry, Antalya, Turkey, 19–21 April 2018. [Google Scholar]
  47. Anitha, R.; Arunachalam, S.; Radhakrishnan, P. Critical parameters influencing the quality of prototypes in fused deposition modelling. J. Mater. Process. Technol. 2001, 118, 385–388. [Google Scholar] [CrossRef]
  48. Bochmann, L.; Bayley, C.; Helu, M.; Transchel, R.; Wegener, K.; Dornfeld, D. Understanding error generation in fused deposition modeling. Surf. Topogr. Metrol. Prop. 2015, 3, 014002. [Google Scholar] [CrossRef]
  49. Doubrovski, Z.; Verlinden, J.C.; Geraedts, J.M.P. Optimal Design for Additive Manufacturing: Opportunities and Challenges. In Proceedings of the International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, Washington, DC, USA, 28–31 August 2011; Volume 54860, pp. 635–646. [Google Scholar] [CrossRef]
  50. Linder, W. Digital Photogrammetry; Springer: Berlin/Heidelberg, Germany, 2009. [Google Scholar] [CrossRef]
  51. Di Stefano, F.; Chiappini, S.; Gorreja, A.; Balestra, M.; Pierdicca, R. Mobile 3D scan LiDAR: A literature review. Geomat. Nat. Hazards Risk 2021, 12, 2387–2429. [Google Scholar] [CrossRef]
  52. Ramakrishnan, S.; Nagarkar, K.; DeGennaro, M.; Srihari, K.; Courtney, A.K.; Emick, F. A Study of the CT Scan Area of a Healthcare Provider. In Proceedings of the 2004 Winter Simulation Conference, Washington, DC, USA, 5–8 December 2004; Volume 2, pp. 939–945. [Google Scholar] [CrossRef]
  53. Yuan, L. Solidification Defects in Additive Manufactured Materials. JOM 2019, 71, 3221–3222. [Google Scholar] [CrossRef] [Green Version]
  54. Haghsefat, K.; Tingting, L. FDM 3D Printing Technology and Its Fundemental Properties. In Proceedings of the International Conference on Innovation and Research in Engineering Sciences, Tbilisi, Georgia, 30 June 2020. [Google Scholar]
  55. Kumbhar, N.N.; Mulay, A.V. Post Processing Methods used to Improve Surface Finish of Products which are Manufactured by Additive Manufacturing Technologies: A Review. J. Inst. Eng. Ser. C 2018, 99, 481–487. [Google Scholar] [CrossRef]
  56. Bishop, E.G.; Leigh, S.J. Using Large-Scale Additive Manufacturing (LSAM) as a Bridge Manufacturing Process in Response to Shortages in PPE during the COVID-19 Outbreak. Int. J. Bioprinting 2020, 6, 281. [Google Scholar] [CrossRef]
  57. Acevedo, R.; Sedlak, P.; Kolman, R.; Fredel, M. Residual stress analysis of additive manufacturing of metallic parts using ultrasonic waves: State of the art review. J. Mater. Res. Technol. 2020, 9, 9457–9477. [Google Scholar] [CrossRef]
  58. Geng, D.; Zhao, J. Analysis and Optimization of Warpage Deformation in 3D Printing Training Teaching—Taking Jilin University Engineering Training Center as an example. In Proceedings of the 2018 International Workshop on Education Reform and Social Sciences (ERSS 2018), Qingdao, China, 29–30 December 2019. [Google Scholar] [CrossRef] [Green Version]
  59. Kadam, V.; Kumar, S.; Bongale, A.; Wazarkar, S.; Kamat, P.; Patil, S. Enhancing Surface Fault Detection Using Machine Learning for 3D Printed Products. Appl. Syst. Innov. 2021, 4, 34. [Google Scholar] [CrossRef]
  60. Scime, L.; Beuth, J. A multi-scale convolutional neural network for autonomous anomaly detection and classification in a laser powder bed fusion additive manufacturing process. Addit. Manuf. 2018, 24, 273–286. [Google Scholar] [CrossRef]
  61. Scime, L.; Beuth, J. Anomaly detection and classification in a laser powder bed additive manufacturing process using a trained computer vision algorithm. Addit. Manuf. 2018, 19, 114–126. [Google Scholar] [CrossRef]
  62. Fischer, F.G.; Zimmermann, M.G.; Praetzsch, N.; Knaak, C. Monitoring of the powder bed quality in metal additive manufacturing using deep transfer learning. Mater. Des. 2022, 222, 111029. [Google Scholar] [CrossRef]
  63. Mukherjee, T.; Zuback, J.S.; De, A.; Debroy, T. Printability of alloys for additive manufacturing. Sci. Rep. 2016, 6, 19717. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  64. Mukherjee, T.; DebRoy, T. Mitigation of lack of fusion defects in powder bed fusion additive manufacturing. J. Manuf. Process. 2018, 36, 442–449. [Google Scholar] [CrossRef]
  65. Gordon, J.V.; Narra, S.P.; Cunningham, R.W.; Liu, H.; Chen, H.; Suter, R.M.; Beuth, J.L.; Rollett, A.D. Defect structure process maps for laser powder bed fusion additive manufacturing. Addit. Manuf. 2020, 36, 101552. [Google Scholar] [CrossRef]
  66. Du, Y.; Mukherjee, T.; DebRoy, T. Physics-informed machine learning and mechanistic modeling of additive manufacturing to reduce defects. Appl. Mater. Today 2021, 24, 101123. [Google Scholar] [CrossRef]
  67. Zhang, B.; Seede, R.; Xue, L.; Atli, K.C.; Zhang, C.; Whitt, A.; Karaman, I.; Arroyave, R.; Elwany, A. An efficient framework for printability assessment in Laser Powder Bed Fusion metal additive manufacturing. Addit. Manuf. 2021, 46, 102018. [Google Scholar] [CrossRef]
  68. Guo, Y.; Liu, Y.; Oerlemans, A.; Lao, S.; Wu, S.; Lew, M.S. Deep learning for visual understanding: A review. Neurocomputing 2016, 187, 27–48. [Google Scholar] [CrossRef]
  69. Gu, J.; Wang, Z.; Kuen, J.; Ma, L.; Shahroudy, A.; Shuai, B.; Liu, T.; Wang, X.; Wang, G.; Cai, J.; et al. Recent advances in convolutional neural networks. Pattern Recognit. 2018, 77, 354–377. [Google Scholar] [CrossRef] [Green Version]
  70. O’Shea, K.; Nash, R. An Introduction to Convolutional Neural Networks. arXiv 2015, arXiv:1511.08458. [Google Scholar] [CrossRef]
  71. Shrestha, A.; Mahmood, A. Review of Deep Learning Algorithms and Architectures. IEEE Access 2019, 7, 53040–53065. [Google Scholar] [CrossRef]
  72. Li, Z.; Liu, F.; Yang, W.; Peng, S.; Zhou, J. A Survey of Convolutional Neural Networks: Analysis, Applications, and Prospects. IEEE Trans. Neural Networks Learn. Syst. 2021, 33, 6999–7019. [Google Scholar] [CrossRef]
  73. Karoly, A.I.; Galambos, P.; Kuti, J.; Rudas, I.J. Deep Learning in Robotics: Survey on Model Structures and Training Strategies. IEEE Trans. Syst. Man Cybern. Syst. 2021, 51, 266–279. [Google Scholar] [CrossRef]
  74. Saluja, A.; Xie, J.; Fayazbakhsh, K. A closed-loop in-process warping detection system for fused filament fabrication using convolutional neural networks. J. Manuf. Process. 2020, 58, 407–415. [Google Scholar] [CrossRef]
  75. Li, X.; Siahpour, S.; Lee, J.; Wang, Y.; Shi, J. Deep Learning-Based Intelligent Process Monitoring of Directed Energy Deposition in Additive Manufacturing with Thermal Images. Procedia Manuf. 2020, 48, 643–649. [Google Scholar] [CrossRef]
  76. Caggiano, A.; Zhang, J.; Alfieri, V.; Caiazzo, F.; Gao, R.; Teti, R. Machine learning-based image processing for on-line defect recognition in additive manufacturing. CIRP Ann. 2019, 68, 451–454. [Google Scholar] [CrossRef]
  77. Cui, W.; Zhang, Y.; Zhang, X.; Li, L.; Liou, F. Metal Additive Manufacturing Parts Inspection Using Convolutional Neural Network. Appl. Sci. 2020, 10, 545. [Google Scholar] [CrossRef] [Green Version]
  78. Jin, Z.; Zhang, Z.; Gu, G.X. Autonomous in-situ correction of fused deposition modeling printers using computer vision and deep learning. Manuf. Lett. 2019, 22, 11–15. [Google Scholar] [CrossRef]
  79. Snow, Z.; Diehl, B.; Reutzel, E.W.; Nassar, A. Toward in-situ flaw detection in laser powder bed fusion additive manufacturing through layerwise imagery and machine learning. J. Manuf. Syst. 2021, 59, 12–26. [Google Scholar] [CrossRef]
  80. Yuan, B.; Guss, G.M.; Wilson, A.C.; Hau--Riege, S.P.; DePond, P.J.; McMains, S.; Matthews, M.J.; Giera, B. Machine--Learning--Based Monitoring of Laser Powder Bed Fusion. Adv. Mater. Technol. 2018, 3, 1800136. [Google Scholar] [CrossRef]
  81. Yang, Z.; Lu, Y.; Yeung, H.; Krishnamurty, S. Investigation of Deep Learning for Real-Time Melt Pool Classification in Additive Manufacturing. In Proceedings of the 2019 IEEE 15th International Conference on Automation Science and Engineering (CASE), Vancouver, BC, Canada, 22–26 August 2019; pp. 640–647. [Google Scholar] [CrossRef]
  82. Narayanan, B.N.; Beigh, K.; Loughnane, G.; Powar, N.U. Support vector machine and convolutional neural network based approaches for defect detection in fused filament fabrication. In Applications of Machine Learning; SPIE: Bellingham, WA, USA, 2019; p. 36. [Google Scholar] [CrossRef]
  83. Zhang, Y.; Hong, G.S.; Ye, D.; Zhu, K.; Fuh, J.Y. Extraction and evaluation of melt pool, plume and spatter information for powder-bed fusion AM process monitoring. Mater. Des. 2018, 156, 458–469. [Google Scholar] [CrossRef]
  84. Sherstinsky, A. Fundamentals of Recurrent Neural Network (RNN) and Long Short-Term Memory (LSTM) Network. Phys. D Nonlinear Phenom. 2020, 404, 132306. [Google Scholar] [CrossRef] [Green Version]
  85. Fu, R.; Zhang, Z.; Li, L. Using LSTM and GRU neural network methods for traffic flow prediction. In Proceedings of the 31st Youth Academic Annual Conference of Chinese Association of Automation (YAC 2016), Wuhan, China, 11–13 November 2016; pp. 324–328. [Google Scholar] [CrossRef]
  86. Ren, K.; Chew, Y.; Zhang, Y.; Fuh, J.; Bi, G. Thermal field prediction for laser scanning paths in laser aided additive manufacturing by physics-based machine learning. Comput. Methods Appl. Mech. Eng. 2020, 362, 112734. [Google Scholar] [CrossRef]
  87. Mozaffar, M.; Liao, S.; Lin, H.; Ehmann, K.; Cao, J. Geometry-agnostic data-driven thermal modeling of additive manufacturing processes using graph neural networks. Addit. Manuf. 2021, 48, 102449. [Google Scholar] [CrossRef]
  88. Inyang-Udoh, U.; Mishra, S. A Physics-Guided Neural Network Dynamical Model for Droplet-Based Additive Manufacturing. IEEE Trans. Control Syst. Technol. 2022, 30, 1863–1875. [Google Scholar] [CrossRef]
  89. Mozaffar, M.; Paul, A.; Al-Bahrani, R.; Wolff, S.; Choudhary, A.; Agrawal, A.; Ehmann, K.; Cao, J. Data-driven prediction of the high-dimensional thermal history in directed energy deposition processes via recurrent neural networks. Manuf. Lett. 2018, 18, 35–39. [Google Scholar] [CrossRef]
  90. Zhang, Z.; Liu, Z.; Wu, D. Prediction of melt pool temperature in directed energy deposition using machine learning. Addit. Manuf. 2021, 37, 101692. [Google Scholar] [CrossRef]
  91. Nalajam, P.K.; Varadarajan, R. A Hybrid Deep Learning Model for Layer-Wise Melt Pool Temperature Forecasting in Wire-Arc Additive Manufacturing Process. IEEE Access 2021, 9, 100652–100664. [Google Scholar] [CrossRef]
  92. Hu, F.; Qin, J.; Li, Y.; Liu, Y.; Sun, X. Deep Fusion for Energy Consumption Prediction in Additive Manufacturing. Procedia CIRP 2021, 104, 1878–1883. [Google Scholar] [CrossRef]
  93. Tian, Q.; Guo, S.; Melder, E.; Bian, L.; Guo, W. Deep Learning-Based Data Fusion Method for In Situ Porosity Detection in Laser-Based Additive Manufacturing. J. Manuf. Sci. Eng. 2021, 143, 041011. [Google Scholar] [CrossRef]
  94. Zhao, Y.; Zhang, Y.; Wang, W. Research on condition monitoring of FDM equipment based on LSTM. In Proceedings of the 2021 IEEE International Conference on Advances in Electrical Engineering and Computer Applications (AEECA), Dalian, China, 27–28 August 2021; pp. 612–615. [Google Scholar] [CrossRef]
  95. Yarahmadi, A.M.; Breuß, M.; Hartmann, C. Long Short-Term Memory Neural Network for Temperature Prediction in Laser Powder Bed Additive Manufacturing. In Proceedings of SAI Intelligent Systems Conference; Springer: Cham, Switzerland, 2023; pp. 119–132. [Google Scholar] [CrossRef]
  96. Tan, Y.; Jin, B.; Nettekoven, A.; Chen, Y.; Yue, Y.; Topcu, U.; Sangiovanni-Vincentelli, A. An Encoder-Decoder Based Approach for Anomaly Detection with Application in Additive Manufacturing. In Proceedings of the 2019 18th IEEE International Conference On Machine Learning And Applications (ICMLA), Boca Raton, FL, USA, 16–19 December 2019; pp. 1008–1015. [Google Scholar] [CrossRef] [Green Version]
  97. Liu, W.; Wang, Z.; Tian, L.; Lauria, S.; Liu, X. Melt pool segmentation for additive manufacturing: A generative adversarial network approach. Comput. Electr. Eng. 2021, 92, 107183. [Google Scholar] [CrossRef]
  98. Hertlein, N.; Buskohl, P.R.; Gillman, A.; Vemaganti, K.; Anand, S. Generative adversarial network for early-stage design flexibility in topology optimization for additive manufacturing. J. Manuf. Syst. 2021, 59, 675–685. [Google Scholar] [CrossRef]
  99. Gobert, C.; Arrieta, E.; Belmontes, A.; Wicker, R.B.; Medina, F.; McWilliams, B. Conditional generative adversarial networks for in-situ layerwise additive manufacturing data. In Proceedings of the 2019 International Solid Freeform Fabrication Symposium, Austin, TX, USA, 12–14 August 2019; University of Texas at Austin: Austin, TX, USA, 2019; pp. 192–201. [Google Scholar]
  100. Sharpe, C.; Seepersad, C.C. Topology Design with Conditional Generative Adversarial Networks. In Proceedings of the International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, Anaheim, CA, USA, 18–21 August 2019; American Society of Mechanical Engineers: Houston, TX, USA, 2019. [Google Scholar] [CrossRef]
  101. Siegkas, P. Generating 3D porous structures using machine learning and additive manufacturing. Mater. Des. 2022, 220, 110858. [Google Scholar] [CrossRef]
  102. Ramlatchan, A.; Li, Y. Image Synthesis Using Conditional GANs for Selective Laser Melting Additive Manufacturing. In Proceedings of the 2022 International Joint Conference on Neural Networks (IJCNN), Padua, Italy, 18–23 July 2022; pp. 1–8. [Google Scholar] [CrossRef]
  103. Cannizzaro, D.; Varrella, A.G.; Paradiso, S.; Sampieri, R.; Chen, Y.; Macii, A.; Patti, E.; Di Cataldo, S. In-Situ Defect Detection of Metal Additive Manufacturing: An Integrated Framework. IEEE Trans. Emerg. Top. Comput. 2021, 10, 74–86. [Google Scholar] [CrossRef]
  104. Shi, Z.; Mandal, S.; Harimkar, S.; Liu, C. Surface Morphology Analysis Using Convolutional Autoencoder in Additive Manufacturing with Laser Engineered Net Shaping. Procedia Manuf. 2021, 53, 16–23. [Google Scholar] [CrossRef]
  105. Shi, Z.; Al Mamun, A.; Kan, C.; Tian, W.; Liu, C. An LSTM-autoencoder based online side channel monitoring approach for cyber-physical attack detection in additive manufacturing. J. Intell. Manuf. 2022, 1–17. [Google Scholar] [CrossRef]
  106. Salakhutdinov, R.; Mnih, A.; Hinton, G. Restricted Boltzmann machines for collaborative filter-ing. In Proceedings of the 24th International Conference on Machine Learning—ICML ’07, Corvalis, OR, USA, 20–24 June 2007; IEEE: New York, NY, USA, 2007; pp. 791–798. [Google Scholar] [CrossRef]
  107. Hua, Y.; Guo, J.; Zhao, H. Deep Belief Networks and deep learning. In Proceedings of the 2015 International Conference on Intelligent Computing and Internet of Things, Harbin, China, 17–18 January 2015; pp. 1–4. [Google Scholar] [CrossRef]
  108. Ye, D.; Hong, G.S.; Zhang, Y.; Zhu, K.; Fuh, J.Y.H. Defect detection in selective laser melting technology by acoustic signals with deep belief networks. Int. J. Adv. Manuf. Technol. 2018, 96, 2791–2801. [Google Scholar] [CrossRef]
  109. Ye, D.; Fuh, J.Y.H.; Zhang, Y.; Hong, G.S.; Zhu, K. In situ monitoring of selective laser melting using plume and spatter signatures by deep belief networks. ISA Trans. 2018, 81, 96–104. [Google Scholar] [CrossRef]
  110. Li, W.; Zhang, H.; Wang, G.; Xiong, G.; Zhao, M.; Li, G.; Li, R. Deep learning based online metallic surface defect detection method for wire and arc additive manufacturing. Robot. Comput. Manuf. 2023, 80, 102470. [Google Scholar] [CrossRef]
  111. Chen, Y.W.; Shiu, J.M. An implementation of YOLO-family algorithms in classifying the product quality for the acrylonitrile butadiene styrene metallization. Int. J. Adv. Manuf. Technol. 2022, 119, 8257–8269. [Google Scholar] [CrossRef] [PubMed]
  112. Wang, R.; Cheung, C.F. CenterNet-based defect detection for additive manufacturing. Expert Syst. Appl. 2022, 188, 116000. [Google Scholar] [CrossRef]
  113. Petsiuk, A.; Singh, H.; Dadhwal, H.; Pearce, J.M. Synthetic-to-real Composite Semantic Seg-mentation in Additive Manufacturing. arXiv 2022, arXiv:2210.07466. [Google Scholar] [CrossRef]
  114. Wong, V.W.H.; Ferguson, M.; Law, K.H.; Lee, Y.-T.T.; Witherell, P. Automatic Volumetric Segmentation of Additive Manufacturing Defects with 3D U-Net. Janaury 2021. Available online: http://arxiv.org/abs/2101.08993 (accessed on 30 October 2022).
  115. Wang, R.; Cheung, C.; Wang, C. Unsupervised Defect Segmentation with Self-Attention in Ad-ditive Manufacturing. SSRN Electron. J. 2022. [Google Scholar] [CrossRef]
  116. Zhu, H.; Zhang, Y.; Liu, C.; Shi, W. An Adaptive Reinforcement Learning-Based Scheduling Approach with Combination Rules for Mixed-Line Job Shop Production. Math. Probl. Eng. 2022, 2022, 1672166. [Google Scholar] [CrossRef]
  117. Abualkishik, A.Z.; Almajed, R. Deep Neural Network-based Fusion and Natural Language Processing in Additive Manufacturing for Customer Satisfaction. Fusion Pract. Appl. 2021, 3, 70–90. [Google Scholar] [CrossRef]
  118. Guo, D.; Ling, S.; Li, H.; Ao, D.; Zhang, T.; Rong, Y.; Huang, G.Q. A framework for personalized production based on digital twin, blockchain and addi-tive manufacturing in the context of Industry 4.0. In Proceedings of the 2020 IEEE 16th International Conference on Automation Science and Engineering (CASE), Hong Kong, China, 20–21 August 2020; pp. 1181–1186. [Google Scholar] [CrossRef]
  119. Rana, M.M.; Dahotre, N. IoT-Based Cyber-Physical Additive Manufacturing Systems: A Secure Communication Architecture, Research Challenges and Directions. In Proceedings of the 2021 6th International Conference on Inventive Computation Technologies (ICICT), Coimbatore, India, 20–22 January 2021; pp. 216–219. [Google Scholar] [CrossRef]
  120. Kurt, M.N.; Ogundijo, O.; Li, C.; Wang, X. Online Cyber-Attack Detection in Smart Grid: A Reinforcement Learning Approach. IEEE Trans. Smart Grid 2019, 10, 5174–5185. [Google Scholar] [CrossRef] [Green Version]
  121. Frustaci, M.; Pace, P.; Aloi, G.; Fortino, G. Evaluating Critical Security Issues of the IoT World: Present and Future Challenges. IEEE Internet Things J. 2018, 5, 2483–2495. [Google Scholar] [CrossRef]
  122. Pearce, H.; Yanamandra, K.; Gupta, N.; Karri, R. FLAW3D: A Trojan-Based Cyber Attack on the Physical Outcomes of Additive Manufacturing. IEEE/ASME Trans. Mechatron. 2022, 3, 1–10. [Google Scholar] [CrossRef]
  123. Jakubovitz, D.; Giryes, R.; Rodrigues, M.R.D. Generalization Error in Deep Learning. In Compressed Sensing and Its Applications; Birkhäuser: Cham, Switzerland, 2019; pp. 153–193. [Google Scholar] [CrossRef] [Green Version]
  124. Zhang, C.; Bengio, S.; Hardt, M.; Recht, B.; Vinyals, O. Understanding deep learning (still) re-quires rethinking generalization. Commun. ACM 2021, 64, 107–115. [Google Scholar] [CrossRef]
  125. Justus, D.; Brennan, J.; Bonner, S.; McGough, A.S. Predicting the Computational Cost of Deep Learning Models. In Proceedings of the 2018 IEEE International Conference on Big Data (Big Data), Seattle, WA, USA, 10–13 December 2018; pp. 3873–3882. [Google Scholar] [CrossRef] [Green Version]
  126. Jouppi, N.P.; Young, C.; Patil, N.; Patterson, D.; Agrawal, G.; Bajwa, R.; Yoon, D.H. In-Datacenter Performance Analysis of a Tensor Processing Unit. In Proceedings of the 44th Annual International Symposium on Computer Architecture, Toronto, Canada, 24–28 June 2017; pp. 1–12. [Google Scholar] [CrossRef] [Green Version]
  127. Cai, H.; Gan, C.; Wang, T.; Zhang, Z.; Han, S. Once-for-All: Train One Network and Specialize It for Efficient Deployment. 2019; pp. 1–15. Available online: http://arxiv.org/abs/1908.09791 (accessed on 25 October 2022).
  128. Long, M.; Zhu, H.; Wang, J.; Jordan, M.I. Deep transfer learning with joint adaptation networks. In Proceedings of the 34th International Conference on Machine Learning ICML, Sydney, Australia, 6–11 August 2017; Volume 5, pp. 3470–3479. [Google Scholar]
  129. Kumar, M.; Moser, B.A.; Fischer, L.; Freudenthaler, B. Information Theoretic Evaluation of Privacy-Leakage, Interpretability, and Transferability for Trustworthy AI. arXiv 2022. Available online: http://arxiv.org/abs/2106.06046 (accessed on 27 October 2022).
  130. Ribeiro, M.T.; Singh, S.; Guestrin, C. ‘Why Should I Trust You?’: Explaining the Predictions of Any Classifier. arXiv 2016. Available online: http://arxiv.org/abs/1602.04938 (accessed on 25 October 2022).
  131. Zhou, P.; Finley, B.; Lee, L.-H.; Liao, Y.; Xie, H.; Hui, P. Towards User-Centered Metrics for Trustworthy AI in Immersive Cyberspace. arXiv 2022. Available online: https://arxiv.org/abs/2203.03718v1 (accessed on 25 October 2022).
  132. Markus, A.F.; Kors, J.A.; Rijnbeek, P.R. The role of explainability in creating trustworthy artificial intelligence for health care: A comprehensive survey of the terminology, design choices, and evaluation strategies. J. Biomed. Inform. 2021, 113, 103655. [Google Scholar] [CrossRef]
  133. Floridi, L. Establishing the rules for building trustworthy AI. Nat. Mach. Intell. 2019, 1, 261–262. [Google Scholar] [CrossRef]
  134. Brundage, M.; Avin, S.; Wang, J.; Belfield, H.; Krueger, G.; Hadfield, G.; Anderljung, M. Toward Trustworthy AI Development: Mechanisms for Supporting Verifiable Claims. arXiv 2020, arXiv:2004.07213. Available online: http://arxiv.org/abs/2004.07213 (accessed on 26 October 2022).
  135. Trusted AI—LFAI & Data. 11 May 2022. Available online: https://lfaidata.foundation/projects/trusted-ai/ (accessed on 26 October 2022).
  136. Thiebes, S.; Lins, S.; Sunyaev, A. Trustworthy artificial intelligence. Electron. Mark. 2021, 31, 447–464. [Google Scholar] [CrossRef]
  137. Baker-Brunnbauer, J. TAII Framework for Trustworthy AI Systems. ROBONOMICS J. Autom. Econ. 2021, 2, 17. [Google Scholar]
  138. Antoniadi, A.; Du, Y.; Guendouz, Y.; Wei, L.; Mazo, C.; Becker, B.; Mooney, C. Current Challenges and Future Opportunities for XAI in Machine Learning-Based Clinical Decision Support Systems: A Systematic Review. Appl. Sci. 2021, 11, 5088. [Google Scholar] [CrossRef]
  139. KServe. KSERVE, 11 May 2022. Available online: https://github.com/kserve/kserve (accessed on 25 October 2022).
  140. AI Explainability 360 (v0.2.1). Trusted-AI, 11 May 2022. Available online: https://github.com/Trusted-AI/AIX360 (accessed on 25 October 2022).
  141. AI Fairness 360 (AIF360). Trusted-AI, 11 May 2022. Available online: https://github.com/Trusted-AI/AIF360 (accessed on 25 October 2022).
  142. Adversarial Robustness Toolbox (ART) v1.10. Trusted-AI, 11 May 2022. Available online: https://github.com/Trusted-AI/adversarial-robustness-toolbox (accessed on 17 November 2022).
  143. Kaur, D.; Uslu, S.; Durresi, A.; Badve, S.; Dundar, M. Trustworthy Explainability Acceptance: A New Metric to Measure the Trustworthiness of Interpretable AI Medical Diagnostic Systems. In Conference on Complex, Intelligent, and Software Intensive Systems; Springer: Cham, Switzerland, 2021; pp. 35–46. [Google Scholar] [CrossRef]
  144. Lundberg, S.M.; Lee, S.-I. A Unified Approach to Interpreting Model Predictions. October 2017, vol. 30. Available online: https://proceedings.neurips.cc/paper/2017/hash/8a20a8621978632d76c43dfd28b67767-Abstract.html (accessed on 17 November 2022).
  145. Selvaraju, R.R.; Cogswell, M.; Das, A.; Vedantam, R.; Parikh, D.; Batra, D. Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization. Robonomics J. Autom. Econ. 2022, 31, 336–359. [Google Scholar] [CrossRef]
  146. Gurumoorthy, K.S.; Dhurandhar, A.; Cecchi, G.; Aggarwal, C. Efficient Data Representation by Selecting Prototypes with Importance Weights. arXiv 2019. Available online: http://arxiv.org/abs/1707.01212 (accessed on 17 November 2022).
  147. Samek, W.; Montavon, G.; Lapuschkin, S.; Anders, C.J.; Muller, K.-R. Explaining Deep Neural Networks and Beyond: A Review of Methods and Applications. Proc. IEEE 2021, 109, 247–278. [Google Scholar] [CrossRef]
  148. Ahmed, I.; Jeon, G.; Piccialli, F. From Artificial Intelligence to Explainable Artificial Intelligence in Industry 4.0: A Survey on What, How, and Where. IEEE Trans. Ind. Inform. 2022, 18, 5031–5042. [Google Scholar] [CrossRef]
  149. Tolan, S.; Miron, M.; Gómez, E.; Castillo, C. Why Machine Learning May Lead to Unfairness: Evidence from Risk Assessment for Juvenile Justice in Catalonia. In Proceedings of the ICAIL ’19: Seventeenth International Conference on Artificial Intelligence and Law, Association for Computing Machinery, Montreal, QC, Canada, 17–21 June 2019; pp. 83–92. [Google Scholar] [CrossRef]
  150. Dastin, J. Amazon Scraps Secret AI Recruiting Tool that Showed Bias against Women *. In Ethics of Data and Analytics; Auerbach Publications: Boca Raton, FL, USA, 2022. [Google Scholar]
  151. Manzini, T.; Lim, Y.C.; Tsvetkov, Y.; Black, A.W. Black Is to Criminal as Caucasian Is to Police: Detecting and Removing Multiclass Bias in Word Embeddings. arXiv 2019. Available online: http://arxiv.org/abs/1904.04047 (accessed on 17 November 2022).
  152. Yang, K.; Qinami, K.; Fei-Fei, L.; Deng, J.; Russakovsky, O. Towards fairer datasets: Filtering and balancing the distribution of the people subtree in the ImageNet hierarchy. In Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency, Association for Computing Machinery, Barcelona, Spain, 27–30 January 2020; pp. 547–558. [Google Scholar] [CrossRef]
  153. Lokhande, V.S.; Akash, A.K.; Ravi, S.N.; Singh, V. FairALM: Augmented Lagrangian Method for Training Fair Models with Little Regret. In European Conference on Computer Vision; Springer: Cham, Switzerland, 2020; pp. 365–381. [Google Scholar] [CrossRef]
  154. Maheshwari, G.; Perrot, M. FairGrad: Fairness Aware Gradient Descent. arXiv 2022. Available online: http://arxiv.org/abs/2206.10923 (accessed on 17 November 2022).
  155. Zhao, B.; Xiao, X.; Gan, G.; Zhang, B.; Xia, S.-T. Maintaining Discrimination and Fairness in Class Incremental Learning. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA, 13–19 June 2020; pp. 13208–13217. Available online: https://openaccess.thecvf.com/content_CVPR_2020/html/Zhao_Maintaining_Discrimination_and_Fairness_in_Class_Incremental_Learning_CVPR_2020_paper.html (accessed on 17 November 2022).
  156. Chen, P.-Y.; Zhang, H.; Sharma, Y.; Yi, J.; Hsieh, C.-J. ZOO: Zeroth Order Optimization Based Black-box Attacks to Deep Neural Networks without Training Substitute Models. In Proceedings of the 10th ACM Workshop on Artificial Intelligence and Security, Dallas, TX, USA, 2–6 April 2017; Association for Computing Machinery: New York, NY, USA; pp. 15–26. [Google Scholar] [CrossRef] [Green Version]
  157. Chen, P.-Y.; Sharma, Y.; Zhang, H.; Yi, J.; Hsieh, C.-J. EAD: Elastic-Net Attacks to Deep Neural Networks via Adversarial Examples. In Proceedings of the AAAI Conference on Artificial Intelligence; AAAI Press: Palo Alto, CA, USA; New Orleans, LA, USA, 2018; Volume 32. [Google Scholar] [CrossRef]
  158. Newaz, A.I.; Haque, N.I.; Sikder, A.K.; Rahman, M.A.; Uluagac, A.S. Adversarial Attacks to Machine Learning-Based Smart Healthcare Systems. In Proceedings of the GLOBECOM 2020–2020 IEEE Global Communications Conference, Taipei, Taiwan, 7–11 December 2020; pp. 1–6. [Google Scholar] [CrossRef]
  159. Lin, J.; Xu, L.; Liu, Y.; Zhang, X. Composite Backdoor Attack for Deep Neural Network by Mix-ing Existing Benign Features. In Proceedings of the 2020 ACM SIGSAC Conference on Computer and Communications Security, Virtual, 9–13 November 2020; Association for Computing Machinery: New York, NY, USA, 2020; pp. 113–131. [Google Scholar] [CrossRef]
  160. Cheng, S.; Liu, Y.; Ma, S.; Zhang, X. Deep Feature Space Trojan Attack of Neural Networks by Controlled Detoxification. In Proceedings of the AAAI Conference on Artificial Intelligence, Virtually, 2–9 May 2021; AAAI Press: Palo Alto, CA, USA, 2021; Volume 35, pp. 1148–1156. [Google Scholar] [CrossRef]
  161. Xivuri, K.; Twinomurinzi, H. A Systematic Review of Fairness in Artificial Intelligence Algorithms. In Conference on e-Business, e-Services and e-Society; Springer: Cham, Switzerland, 2021; pp. 271–284. [Google Scholar] [CrossRef]
  162. John-Mathews, J.-M.; Cardon, D.; Balagué, C. From Reality to World. A Critical Perspective on AI Fairness. J. Bus. Ethics 2022, 178, 945–959. [Google Scholar] [CrossRef]
  163. Janssen, M.; Brous, P.; Estevez, E.; Barbosa, L.S.; Janowski, T. Data governance: Organizing data for trustworthy Artificial Intelligence. Gov. Inf. Q. 2020, 37, 101493. [Google Scholar] [CrossRef]
  164. Silva, S.H.; Najafirad, P. Opportunities and Challenges in Deep Learning Adversarial Robustness: A Survey. arXiv 2020. Available online: http://arxiv.org/abs/2007.00753 (accessed on 17 November 2022).
  165. Raj, A.; Bresler, Y.; Li, B. Improving Robustness of Deep-Learning-Based Image Reconstruction. In Proceedings of the 37th International Conference on Machine Learning, Virtual Event, 12–18 July 2020; pp. 7932–7942. Available online: https://proceedings.mlr.press/v119/raj20a.html (accessed on 17 November 2022).
  166. Goswami, G.; Ratha, N.; Agarwal, A.; Singh, R.; Vatsa, M. Unravelling Robustness of Deep Learning Based Face Recognition Against Adversarial Attacks. In Proceedings of the AAAI Conference on Artificial Intelligence, New Orleans, LA, USA, 2–7 February 2018; Volume 32. [Google Scholar] [CrossRef]
  167. Wang, J.; Chen, J.; Sun, Y.; Ma, X.; Wang, D.; Sun, J.; Cheng, P. RobOT: Robustness-Oriented Testing for Deep Learning Systems. In Proceedings of the 2021 IEEE/ACM 43rd International Conference on Software Engineering (ICSE), Madrid, Spain, 22–30 May 2021; pp. 300–311. [Google Scholar] [CrossRef]
  168. Carlini, N.; Wagner, D. Towards Evaluating the Robustness of Neural Networks. In Proceedings of the 2017 IEEE Symposium on Security and Privacy (SP), San Jose, CA, USA, 22–26 May 2017; pp. 39–57. [Google Scholar] [CrossRef] [Green Version]
  169. Tramèr, F.; Kurakin, A.; Papernot, N.; Goodfellow, I.; Boneh, D.; McDaniel, P. Ensemble Adversarial Training: Attacks and Defenses. arXiv 2017, arXiv:1705.07204. [Google Scholar] [CrossRef]
  170. Hajjaji, Y.; Boulila, W.; Farah, I.R.; Romdhani, I.; Hussain, A. Big data and IoT-based applications in smart environments: A systematic review. Comput. Sci. Rev. 2020, 39, 100318. [Google Scholar] [CrossRef]
  171. Bi, K.; Lin, D.; Liao, Y.; Wu, C.-H.; Parandoush, P. Additive manufacturing embraces big data. Prog. Addit. Manuf. 2021, 6, 181–197. [Google Scholar] [CrossRef]
  172. Francis, J.; Bian, L. Deep Learning for Distortion Prediction in Laser-Based Additive Manufacturing using Big Data. Manuf. Lett. 2019, 20, 10–14. [Google Scholar] [CrossRef]
  173. Munirathinam, S. Industry 4.0: Industrial Internet of Things (IIOT). In Advances in Computers; Elsevier: Amsterdam, The Netherlands, 2020; pp. 129–164. [Google Scholar] [CrossRef]
  174. Amanullah, M.A.; Habeeb, R.A.A.; Nasaruddin, F.H.; Gani, A.; Ahmed, E.; Nainar, A.S.M.; Akim, N.M.; Imran, M. Deep learning and big data technologies for IoT security. Comput. Commun. 2020, 151, 495–517. [Google Scholar] [CrossRef]
  175. Ashima, R.; Haleem, A.; Bahl, S.; Javaid, M.; Mahla, S.K.; Singh, S. Automation and manufacturing of smart materials in additive manufacturing technologies using Internet of Things towards the adoption of industry 4.0. Mater. Today Proc. 2021, 45, 5081–5088. [Google Scholar] [CrossRef]
  176. Tuegel, E.; Ingraffea, A.R.; Eason, T.G.; Spottswood, S.M. Reengineering Aircraft Structural Life Prediction Using a Digital Twin. Int. J. Aerosp. Eng. 2011, 2011, 154798. [Google Scholar] [CrossRef] [Green Version]
  177. DebRoy, T.; Zhang, W.; Turner, J.; Babu, S.S. Building digital twins of 3D printing machines. Scr. Mater. 2017, 135, 119–124. [Google Scholar] [CrossRef]
  178. Juarez, M.G.J.; Botti, V.J.; Giret, A.S. Digital Twins: Review and Challenges. J. Comput. Inf. Sci. Eng. 2021, 21, 030802. [Google Scholar] [CrossRef]
  179. Groshev, M.; Guimaraes, C.; Martin-Perez, J.; de la Oliva, A. Toward Intelligent Cyber-Physical Systems: Digital Twin Meets Artificial Intelligence. IEEE Commun. Mag. 2021, 59, 14–20. [Google Scholar] [CrossRef]
  180. Alexopoulos, K.; Nikolakis, N.; Chryssolouris, G. Digital twin-driven supervised machine learning for the development of artificial intelligence applications in manufacturing. Int. J. Comput. Integr. Manuf. 2020, 33, 429–439. [Google Scholar] [CrossRef] [Green Version]
  181. Liu, C.; Tian, W.; Kan, C. When AI meets additive manufacturing: Challenges and emerging opportunities for human-centered products development. J. Manuf. Syst. 2022, 64, 648–656. [Google Scholar] [CrossRef]
  182. Kollmann, H.T.; Abueidda, D.W.; Koric, S.; Guleryuz, E.; Sobh, N.A. Deep learning for topology optimization of 2D metamaterials. Mater. Des. 2020, 196, 109098. [Google Scholar] [CrossRef]
  183. Tang, Y.; Dong, G.; Xiong, Y.; Wang, Q. Data-driven Design of Customized Porous Lattice Sole Fabricated by Additive Manufacturing. Procedia Manuf. 2021, 53, 318–326. [Google Scholar] [CrossRef]
  184. Yang, H.; Rao, P.; Simpson, T.; Lu, Y.; Witherell, P.; Nassar, A.R.; Reutzel, E.; Kumara, S. Six-Sigma Quality Management of Additive Manufacturing. Proc. IEEE 2021, 109, 347–376. [Google Scholar] [CrossRef] [PubMed]
  185. Colosimo, B.M.; Huang, Q.; Dasgupta, T.; Tsung, F. Opportunities and challenges of quality engineering for additive manufacturing. J. Qual. Technol. 2018, 50, 233–252. [Google Scholar] [CrossRef] [Green Version]
  186. Li, L.; Fan, Y.; Tse, M.; Lin, K.-Y. A review of applications in federated learning. Comput. Ind. Eng. 2020, 149, 106854. [Google Scholar] [CrossRef]
  187. Yin, X.; Zhu, Y.; Hu, J. A Comprehensive Survey of Privacy-preserving Federated Learning. ACM Comput. Surv. 2021, 54, 1–36. [Google Scholar] [CrossRef]
  188. Kanagavelu, R.; Li, Z.; Samsudin, J.; Hussain, S.; Yang, F.; Yang, Y.; Goh, R.S.M.; Cheah, M. Federated Learning for Advanced Manufacturing Based on Industrial IoT Data Analytics. In Implementing Industry; Springer: Cham, Switzerland, 2021; pp. 143–176. [Google Scholar] [CrossRef]
  189. Guo, Y.; Zhao, Z.; He, K.; Lai, S.; Xia, J.; Fan, L. Efficient and flexible management for industrial Internet of Things: A federated learning approach. Comput. Networks 2021, 192, 108122. [Google Scholar] [CrossRef]
  190. Zellinger, W.; Wieser, V.; Kumar, M.; Brunner, D.; Shepeleva, N.; Gálvez, R.; Langer, J.; Fischer, L.; Moser, B. Beyond federated learning: On confidentiality-critical machine learning applications in industry. Procedia Comput. Sci. 2019, 180, 734–743. [Google Scholar] [CrossRef]
  191. Zhang, X.; Hou, H.; Fang, Z.; Wang, Z. Industrial Internet Federated Learning Driven by IoT Equipment ID and Blockchain. Wirel. Commun. Mob. Comput. 2021, 2021, 7705843. [Google Scholar] [CrossRef]
  192. Mehta, M.; Shao, C. Federated learning-based semantic segmentation for pixel-wise defect detection in additive manufacturing. J. Manuf. Syst. 2022, 64, 197–210. [Google Scholar] [CrossRef]
  193. KAggour, K.S.; Kumar, V.S.; Cuddihy, P.; Williams, J.W.; Gupta, V.; Dial, L.; Hanlon, T.; Gambone, J.; Vinciquerra, J. Federated Multimodal Big Data Storage & Analytics Platform for Additive Manufacturing. In Proceedings of the 2019 IEEE International Conference on Big Data (Big Data), Los Angeles, CA, USA, 9–12 December 2019; pp. 1729–1738. [Google Scholar] [CrossRef]
  194. Hao, M.; Li, H.; Luo, X.; Xu, G.; Yang, H.; Liu, S. Efficient and Privacy-Enhanced Federated Learning for Industrial Artificial Intelligence. IEEE Trans. Ind. Inform. 2019, 16, 6532–6542. [Google Scholar] [CrossRef]
  195. Qu, Y.; Pokhrel, S.R.; Garg, S.; Gao, L.; Xiang, Y. A Blockchained Federated Learning Framework for Cognitive Computing in Industry 4.0 Networks. IEEE Trans. Ind. Inform. 2021, 17, 2964–2973. [Google Scholar] [CrossRef]
  196. Rieke, N.; Hancox, J.; Li, W.; Milletarì, F.; Roth, H.R.; Albarqouni, S.; Bakas, S.; Galtier, M.N.; Landman, B.A.; Maier-Hein, K.; et al. The future of digital health with federated learning. NPJ Digit. Med. 2020, 3, 119. [Google Scholar] [CrossRef] [PubMed]
  197. Majeed, A.; Zhang, Y.; Ren, S.; Lv, J.; Peng, T.; Waqar, S.; Yin, E. A big data-driven framework for sustainable and smart additive manufacturing. Robot. Comput. Manuf. 2021, 67, 102026. [Google Scholar] [CrossRef]
  198. Peng, T.; Kellens, K.; Tang, R.; Chen, C.; Chen, G. Sustainability of additive manufacturing: An overview on its energy demand and environmental impact. Addit. Manuf. 2018, 21, 694–704. [Google Scholar] [CrossRef]
  199. Colorado, H.A.; Velásquez, E.I.G.; Monteiro, S.N. Sustainability of additive manufacturing: The circular economy of materials and environmental perspectives. J. Mater. Res. Technol. 2020, 9, 8221–8234. [Google Scholar] [CrossRef]
  200. Javaid, M.; Haleem, A.; Singh, R.P.; Suman, R.; Rab, S. Role of additive manufacturing applications towards environmental sustainability. Adv. Ind. Eng. Polym. Res. 2021, 4, 312–322. [Google Scholar] [CrossRef]
  201. Niaki, M.K.; Torabi, S.A.; Nonino, F. Why manufacturers adopt additive manufacturing technologies: The role of sustainability. J. Clean. Prod. 2019, 222, 381–392. [Google Scholar] [CrossRef]
  202. Dwivedi, G.; Srivastava, S.K.; Srivastava, R.K. Analysis of barriers to implement additive manufacturing technology in the Indian automotive sector. Int. J. Phys. Distrib. Logist. Manag. 2017, 47, 972–991. [Google Scholar] [CrossRef]
  203. Rogers, H.; Baricz, N.; Pawar, K.S. 3D printing services: Classification, supply chain implications and research agenda. Int. J. Phys. Distrib. Logist. Manag. 2016, 46, 886–907. [Google Scholar] [CrossRef]
  204. Fruggiero, F.; Lambiase, A.; Bonito, R.; Fera, M. The load of sustainability for Additive Manufacturing processes. Procedia Manuf. 2019, 41, 375–382. [Google Scholar] [CrossRef]
  205. Delgadillo, R.R.; Medini, K.; Wuest, T. A DMAIC Framework to Improve Quality and Sustainability in Additive Manufacturing—A Case Study. Sustainability 2022, 14, 581. [Google Scholar] [CrossRef]
  206. Ribeiro, I.; Matos, F.; Jacinto, C.; Salman, H.; Cardeal, G.; Carvalho, H.; Godina, R.; Peças, P. Framework for Life Cycle Sustainability Assessment of Additive Manufacturing. Sustainability 2020, 12, 929. [Google Scholar] [CrossRef] [Green Version]
  207. Taddese, G.; Durieux, S.; Duc, E. Sustainability performance indicators for additive manufacturing: A literature review based on product life cycle studies. Int. J. Adv. Manuf. Technol. 2020, 107, 3109–3134. [Google Scholar] [CrossRef]
  208. Agnusdei, L.; Del Prete, A. Additive manufacturing for sustainability: A systematic literature review. Sustain. Futur. 2022, 4, 100098. [Google Scholar] [CrossRef]
Figure 1. Various review of the review for deep learning towards digital additive manufacturing.
Figure 1. Various review of the review for deep learning towards digital additive manufacturing.
Algorithms 15 00466 g001
Figure 2. Number of publications and citations report.
Figure 2. Number of publications and citations report.
Algorithms 15 00466 g002
Figure 3. Network, co-occurrence, and density visualization of various associated keywords.
Figure 3. Network, co-occurrence, and density visualization of various associated keywords.
Algorithms 15 00466 g003
Figure 4. Incorporation of deep learning in AM cycle.
Figure 4. Incorporation of deep learning in AM cycle.
Algorithms 15 00466 g004
Figure 5. Integration of additive manufacturing with deep learning.
Figure 5. Integration of additive manufacturing with deep learning.
Algorithms 15 00466 g005
Figure 6. Classification of additive manufacturing on ASTM F-42 and its associated technology.
Figure 6. Classification of additive manufacturing on ASTM F-42 and its associated technology.
Algorithms 15 00466 g006
Figure 7. The printing error associated with additive manufacturing.
Figure 7. The printing error associated with additive manufacturing.
Algorithms 15 00466 g007
Figure 8. Sector-wise representation of various deep learning models associated with AM.
Figure 8. Sector-wise representation of various deep learning models associated with AM.
Algorithms 15 00466 g008
Figure 9. Basic architecture of CNN.
Figure 9. Basic architecture of CNN.
Algorithms 15 00466 g009
Figure 10. (a) Recurrent neural networks (RNNs),(b) GRU and (c) LSTM.
Figure 10. (a) Recurrent neural networks (RNNs),(b) GRU and (c) LSTM.
Algorithms 15 00466 g010
Figure 11. (a) Generative adversarial networks (GANs) and (b) Autoencoder.
Figure 11. (a) Generative adversarial networks (GANs) and (b) Autoencoder.
Algorithms 15 00466 g011
Figure 12. General overview of AI Explainability.
Figure 12. General overview of AI Explainability.
Algorithms 15 00466 g012
Figure 13. Deep learning workflow and possible sources of unfairness.
Figure 13. Deep learning workflow and possible sources of unfairness.
Algorithms 15 00466 g013
Figure 14. Four categories of attack in deep learning [142].
Figure 14. Four categories of attack in deep learning [142].
Algorithms 15 00466 g014
Figure 15. General federated learning framework.
Figure 15. General federated learning framework.
Algorithms 15 00466 g015
Figure 16. Additive manufacturing toward sustainability.
Figure 16. Additive manufacturing toward sustainability.
Algorithms 15 00466 g016
Figure 17. Sustainable pyramid for smart digital manufacturing.
Figure 17. Sustainable pyramid for smart digital manufacturing.
Algorithms 15 00466 g017
Table 1. Application of additive manufacturing and deep learning in various fields.
Table 1. Application of additive manufacturing and deep learning in various fields.
SectorApplicationModalitiesUseMaterialProcessDeep Learning ModelReferences
Medical OrthopedicsAnatomic modelsImplant Stainless steel, TitaniumClassification, SegmentationCNN, U NET[28,29,30]
Dental Crowns Fixtures Titanium, MFH Shape deformation in AM partPredNet and CompNet[31,32,33]
PharmaNADrug deliveryPolymerOptimizationLSTM[34,35]
Bioprinting Extrusion-based, Inkjet Tissue engineering Bio ink Classification [36,37]
Automotive Production flexibilityCustom parts Metal, PolymerOptimization, Quality controlCNN, [38,39]
Aerospace Electron beam melting, Selective laser melting, and laser deposition,Microtrusses,
Multifunctional Structures
Multi materials,
Metals, Titanium, Ceramics
Parameter optimization,
Segmentation
LSTM, CNN[40,41,42]
Defense Defense Support ServiceDelocalized manufacturingNAComputer visionDeep learning[43,44,45]
Table 2. Data acquisition technique.
Table 2. Data acquisition technique.
TechniqueDescriptionQualityDrawbackReference
PhotogrammetryBased on images collected from various angles surrounding an object and then “stitched” together using software applications LowThe method requires a studio setup because it involves a complex camera system that can be challenging to set up and is not easily portable.[50]
Light-based 3D scanningA structured–light 3D scanner produces a light pattern of parallel stripes on an object’s surface. This projection is then recorded by the scanner’s camera and converted into a digital duplicate.HighFor small objects.[51]
CT scanningCT scanning involves numerous X-ray projections into an object, producing images merged to generate a computerized 3D model.HighCT scanning is exceptional in providing data on the exterior and inside components.[52]
Table 3. Various defects associated with AM.
Table 3. Various defects associated with AM.
AnomalyCauseAffectReferences
Cracking Small cavities, stress buildup, and uneven heating or coolingFailure of a printed part.[53]
PorosityInadequate printing procedure or materialCavities in the printed component [53]
Material ShrinkageProperty of the material used.Lead to the generation of residual stress, which can induce cracks in the material.[54]
Poor surface finishTechnique and materials used in printingMore time in post-processing[55]
StringingPrinting technique and material used Extra material attached to the part needs post-processing[56]
Residual StressThe print is rapidly heated or cooled.The excessive tensile strength can result in the creation of cracks or flaws such as warpage.[57]
WrappingIncorrect cooling of the printed component or because of the materials’ processingThe component swells upward, causing a change in form.[58]
BlisteringLower layers need to be adequately cooled.Because of the weights of the top layers, the lowest layer swells outward.[59]
Recoater HoppingAs a result of the recoater blade impacting a componentLead to an inhomogeneous spreading of material[60]
Recoater StreakingIt happened because the recoater blade damaged itself or because it dragged a contaminant across the powder bed.Poor surface quality[61]
Super-ElevationWhen a section bends or coils upward through the powder layer, this occurs.The effect of leftover thermal stresses or swelling.[60]
Incomplete SpreadingWhen not enough powder is consistently taken from the powder dispenser, this error happens.As a result, there is a lack of powder, the severity of which is greatest near the powder collector.[62]
Lack of fusion This flaw is a result of improper laser power, scanning speed, laser spot radius, layer thickness, hatch spacing, and alloy choice, among other factors.Insufficient overlaps of successive melt pools, Lead o part rejection[63,64,65]
BallingMolten pools break in the separated islandLead to a discontinuous melting track[66,67]
Table 4. Summary of various literature on the related CNN.
Table 4. Summary of various literature on the related CNN.
Type of CNNAM ProcessActivationLossOptimizerAccuracyReferences
CNN Leaky-Relu and SoftMaxCross entropyAdam99.3%[74]
Alex NetPowder bed fusionSoftMax and Relu-Momentum-based Stochastic Gradient Descent97%[60]
CNNDirect energy depositionSoftMax and ReluCross entropyAdam80[75]
CNNSelective laser meltingSoftMax and ReluCross entropyGradient descent99.4[76]
CNNMetal AMSoftMax and ReluCross entropyAdam92.1%[77]
ResNet 50FDM 98[78]
CNNPBFSoftMax and Relu [79]
CNNLASER PBFReLU and
sigmoid
Standard mean squared error and cross-entropyAdam93.1[80]
CNNPBF (melt pool classification)Reply 9.84[81]
CNNFused filament fabricationSoftMax and Relu 99.5[82]
CNNPBF (Melt pool, plume and splatter)SoftMax and Relu Mini batch gradient descent92.7[83]
Table 5. Summary of various literature on sequences model.
Table 5. Summary of various literature on sequences model.
ModelAM ProcedureProblemOutcomeReferences
RNN +DNNLaser-basedLaser scanning patterns and the thermal history distributions correlated, and finding a relationship is complex.The created RNN-DNN model can forecast thermal fields for any geometry using various scanning methodologies. The agreement between the numerical simulation results and the RNN-DNN forecasts was more significant than 95%.[86]
RGNN
GNN
DEDSpecific model generalizability has remained a barrier across a wide range of geometries.Deep learning architecture provides a feasible substitute for costly computational mechanics or experimental techniques by successfully forecasting long thermal histories for unknown geometries during the training phase.[87]
Conv-RNNInkjet AM Height data from the input–output relationship.The model was empirically validated and shown to outperform a trained MLP with significantly fewer data.[88]
RNN, GRUDEDHigh-dimensional thermal history in DED processes is forecast with changes in geometry such as build dimensions, toolpath approach, laser power, and scan speed.The model can predict the temperature history of each given point of the DED based on a test-set database and with minimum training.[89]
LSTMDEDTo determine the temperature of the molten pool, analytical and numerical methods have been developed; however, since the real-time melt pool temperature distribution is not taken into account, the accuracy of these methods is rather low.Developed a machine learning-based data-driven predictive algorithm to accurately estimate the melt pool temperature during DED.[90]
CNN,
LSTM
DED Forecasting melt pool temperature is layer-by-layer.By combining CNN and LSTM networks, geographical and temporal information may be retrieved from melt pool temperature data.[91]
CNN, LSTMSLSSeveral factors determine the energy consumption of AM systems. These aspects include traits with multiple dimensions and structures, making them difficult to examine.A data fusion strategy is offered for estimating energy consumption.[92]
PyroNet, IRNet, LSTMLaser-based Additive ManufacturingIntends to advance awareness of the fundamental connection between the LBAM method and porosity.DL-based data fusion method that takes advantage of the measured melt pool’s thermal history as well as two newly built deep learning neural networks to estimate porosity in LBAM sections.[93]
LSTMFDMIt is investigated how equipment operating conditions affect the quality of the generated products using standard data features from the printer’s sensor signals (vibration, current, etc.).An intelligent monitoring system has been designed in terms of working conditions and product quality.[94]
LSTMPBFDuring the printing process to avoid an uneven and harsh temperature distribution across the printing plateAnticipate temperature gradient distributions during the printing process[95]
Table 6. Summary of various literature on GAN and autoencoders.
Table 6. Summary of various literature on GAN and autoencoders.
ModelAM ProcedureProblemSolutionRef
GANDEDMelt pool segmentationThe melt pool’s morphology is examined by segmenting the collected thermal images.[97]
GANNATopology optimizationA deep learning-based system has been successfully built to generate designs with little compliance suited for additive manufacturing.[98]
CGANPBFMonitoring in-situ layer-wise images for unseen conditional inputsUsing the turbine blade data collection, a CGAN was trained and used to produce new in-situ layerwise images for unseen conditional inputs.[99]
GANNATopology design, concept generationDiscusses avenues for further developments that would enable the engineering design community to further leverage generative machine learning techniques to their full potential.[100]
GAN, a bag of features Mimicking–biomimicking porous structures.Within the same resolution, created structures demonstrated consistency in compressive properties; however, reducing resolution considerably affects resultant properties. The structures developed have the potential to be scaled and employed with various materials and additive manufacturing techniques.[101]
CGANSLMThe difficulty is gathering enough data to characterize the internal microstructures to evaluate their physical attributes, as the laser passes at high speeds over powder grains at a micrometer scale.The fake data can be generated using generative models with the same qualities as the experimental photographs could be generated.[102]
GANPBFLimited defect monitoring data, difficulties acquiring and integrating AM process data during fabricationGenerative adversarial network (GAN)-based off-axis camera mounted on top of the machine to detect faults in real-time and automatically provide synthetic images for dataset augmentation[103]
AutoencoderLaser Engineered Net ShapingSurface profiles are often highly nonlinear; (2) a significant number of outliers and missing regions may occur in the observed surface profile.A technique based on convolutional autoencoders is used to extract useful features from surface profiles.[104]
fused filament fabrication (FFF)Monitoring and effectively detecting cyber-physical threats has become a significant hurdle to the widespread use of AM technology.To detect unexpected process/product changes caused by cyber-physical attacks, a data-driven feature extraction strategy based on the LSTM-autoencoder is developed.[105]
Table 7. Summary of various literature on DBN.
Table 7. Summary of various literature on DBN.
ModelAMProblemSolutionRef
DBNSLMDue to the addition of several phases during defect identification using conventional classification algorithms, the system becomes fairly complex.The DBN technique might achieve a high defect identification rate among five melted states without signal preprocessing. It is implemented without feature extraction and signal preprocessing using a streamlined classification structure.[108]
DBNSLM Melted state recognition during the SLM process.[109]
Table 8. Summaries of the necessary criteria, principles, and mechanisms of TAI.
Table 8. Summaries of the necessary criteria, principles, and mechanisms of TAI.
ReferenceNecessary Criteria, Mechanisms, or Frameworks of TAI
Floridi [133]Criteria of TAI
Floridi [133]
(1)
Human agency and oversight
(2)
Robustness and safety
(3)
Privacy and data governance
(4)
Transparency
(5)
Diversity, nondiscrimination, and fairness
(6)
Societal and environmental well-being
(7)
Accountability
M. Brundage et al. [134]Mechanism of TAI
M. Brundage et al. [134]
(1)
Institutional mechanisms: Largely pertain to values, incentives, and accountability. Institutional mechanisms influence or make clear the incentives of those who work on AI development and provide us with a better understanding of how they behave, including their efforts to create AI systems which are fair, safe, and privacy-preserving.
(2)
Software mechanisms: Particular AI systems and their characteristics are significantly relevant to software mechanisms. Software mechanisms can be used to support formal and informal claims about the characteristics of certain AI systems, facilitating better comprehension and control. The software mechanisms include privacy-preserving machine learning, interpretability, and audit trails.
(3)
Hardware mechanisms: Physical computational resources and their characteristics are significantly relevant to hardware mechanisms. Hardware mechanisms can justify claims about how an organization is using its general-purpose computing capabilities by offering better confidence about the privacy and security of AI systems. They can also be used to support verifiable claims. The hardware mechanisms concentrate on high-precision computing measurement, hardware security features for machine learning, and computing power support for academic institutions.
Trusted AI Project [135]Framework of TAI
Trusted AI Project [135]
(1)
Reproducibility
(2)
Robustness
(3)
Equitability
(4)
Privacy
(5)
Explainability
(6)
Accountability
(7)
Transparency
(8)
Security
Thiebes et al. [136]Criteria of TAI
Thiebes et al. [136]
(1)
Beneficence
(2)
Non-maleficence
(3)
Autonomous
(4)
Justice
(5)
Explicability
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Pratap, A.; Sardana, N.; Utomo, S.; Ayeelyan, J.; Karthikeyan, P.; Hsiung, P.-A. A Synergic Approach of Deep Learning towards Digital Additive Manufacturing: A Review. Algorithms 2022, 15, 466. https://doi.org/10.3390/a15120466

AMA Style

Pratap A, Sardana N, Utomo S, Ayeelyan J, Karthikeyan P, Hsiung P-A. A Synergic Approach of Deep Learning towards Digital Additive Manufacturing: A Review. Algorithms. 2022; 15(12):466. https://doi.org/10.3390/a15120466

Chicago/Turabian Style

Pratap, Ayush, Neha Sardana, Sapdo Utomo, John Ayeelyan, P. Karthikeyan, and Pao-Ann Hsiung. 2022. "A Synergic Approach of Deep Learning towards Digital Additive Manufacturing: A Review" Algorithms 15, no. 12: 466. https://doi.org/10.3390/a15120466

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop