*Article* **Identification of Abnormal Processes with Spatial-Temporal Data Using Convolutional Neural Networks**

#### **Yumin Liu 1, Zheyun Zhao 1,\*, Shuai Zhang 1 and Uk Jung 2**


Received: 2 December 2019; Accepted: 2 January 2020; Published: 6 January 2020

**Abstract:** Identifying abnormal process operation with spatial-temporal data remains an important and challenging work in many practical situations. Although spatial-temporal data identification has been extensively studied in some domains, such as public health, geological condition, and environment pollution, the challenge associated with designing accurate and convenient recognition schemes is very rarely addressed in modern manufacturing processes. This paper proposes a general recognition framework for identifying abnormal process with spatial-temporal data by employing a convolutional neural network (CNN) model. Firstly, motivated by the pasting case study, the spatial-temporal data are transformed into process images for capturing spatial and temporal interrelationship. Then, the CNN recognition model is presented for identifying different types of these process images, leading to the identification of abnormal process with spatial-temporal data. The specific architecture parameters of CNN are determined step by step. According to the performance comparison with alternative methods, the proposed method is able to accurately identify the abnormal process with spatial-temporal data.

**Keywords:** spatial-temporal data; pasting process; process image; convolutional neural network
