Search Results (4)

Using long short-term memory (LSTM) networks to build a named entity recognition model is important for the task of named entity recognition. However, traditional memory networks lack a direct connection between input information and hidden states, leading to key feature information not being fully learned during training and causing information loss. This paper designs a bidirectional variant of the long short-term memory (BiLSTM) network called Mogrifier-BiGRU, which combines the BERT pre-trained model and the conditional random field (CRF) network model. The Mogrifier gating interaction unit is set with more hyperparameters to achieve deep interaction of gating information, changing the relationship between input and hidden states so that they are no longer independent. By introducing more nonlinear transformations, the model can learn more complex input–output mapping relationships. Then, by combining Bayesian optimization with the improved Mogrifier-BiGRU network, the optimal hyperparameters of the model are automatically calculated. Experimental results show that the model method based on the gating interaction mechanism can effectively combine feature information, improving the accuracy of Chinese-named entity recognition. On the dataset, an F1-score of 85.42% was achieved, which is 7% higher than traditional methods and 10% higher for the accuracy of some entity recognition. Full article

Lithium-ion battery health and remaining useful life (RUL) are essential indicators for reliable operation. Currently, most of the RUL prediction methods proposed for lithium-ion batteries use data-driven methods, but the length of training data limits data-driven strategies. To solve this problem and improve the safety and reliability of lithium-ion batteries, a Li-ion battery RUL prediction method based on iterative transfer learning (ITL) and Mogrifier long and short-term memory network (Mogrifier LSTM) is proposed. Firstly, the capacity degradation data in the source and target domain lithium battery historical lifetime experimental data are extracted, the sparrow search algorithm (SSA) optimizes the variational modal decomposition (VMD) parameters, and several intrinsic mode function (IMF) components are obtained by decomposing the historical capacity degradation data using the optimization-seeking parameters. The highly correlated IMF components are selected using the maximum information factor. Capacity sequence reconstruction is performed as the capacity degradation information of the characterized lithium battery, and the reconstructed capacity degradation information of the source domain battery is iteratively input into the Mogrifier LSTM to obtain the pre-training model; finally, the pre-training model is transferred to the target domain to construct the lithium battery RUL prediction model. The method’s effectiveness is verified using CALCE and NASA Li-ion battery datasets, and the results show that the ITL-Mogrifier LSTM model has higher accuracy and better robustness and stability than other prediction methods. Full article

Pen-holding postures (PHPs) can significantly affect the speed and quality of writing, and incorrect postures can lead to health problems. This paper presents and experimentally implements a methodology for quickly recognizing and correcting poor writing postures using a digital dot matrix pen. The method first extracts basic handwriting information, including page number, handwriting coordinates, movement trajectory, pen tip pressure, stroke sequence, and pen handling time. This information is then used to generate writing features that are fed into our proposed fusion classification model, which combines a simple parameter-free attention module for convolutional neural networks (CNNs) called NetworkSimAM, CNNs, and an extension of the well-known long short-term memory (LTSM) called Mogrifier LSTM or MLSTM. Finally, the method ends with a classification step (Softmax) to recognize the type of PHP. The implemented method achieves significant results through receiver operating characteristic (ROC) curves and loss functions, including a recognition accuracy of 72%, which is, for example, higher than that of the single-stroke model (i.e., TabNet incorporating SimAM). The obtained results show that a promising solution is provided for accurate and efficient PHP recognition and has the potential to improve writing speed and quality while reducing health problems induced by incorrect postures. Full article

Accurate and efficient short-term forecasting of multiple loads is of great significance to the operation control and scheduling of integrated energy distribution systems. In order to improve the effect of load forecasting, a mogrifier-quantum weighted memory enhancement long short-term memory (Mogrifier-QWMELSTM) neural network forecasting model is proposed. Compared with the conventional LSTM neural network model, the model proposed in this paper has three improvements in model structure and model composition. First, the mogrifier is added to make the data fully interact with each other. This addition can help enhance the correlation between the front and rear data and improve generalization, which is the main disadvantage of LSTM neural network. Second, the memory enhancement mechanism is added on the forget gate to realize the extraction and recovery of forgotten information. The addition can help improve the gradient transmission ability in the learning process of the neural network, make the neural network remain sensitive to distant data information, and enhance the memory ability. Third, the model is composed of quantum weighted neurons. Compared with conventional neurons, quantum weighted neurons have significant advantages in nonlinear data processing and parallel computing, which help to improve the accuracy of load forecasting. The simulation results show that the weighted mean accuracy of the proposed model can reach more than 97.5% in summer and winter. Moreover, the proposed model has good forecasting effect on seven typical days in winter, which shows that the model has good stability. Full article