Next Article in Journal
A Lightweight Fault-Detection Scheme for Resource-Constrained Solar Insecticidal Lamp IoTs
Next Article in Special Issue
Adoption of Transformer Neural Network to Improve the Diagnostic Performance of Oximetry for Obstructive Sleep Apnea
Previous Article in Journal
Estimating Structural Damage to Mangrove Forests Using Airborne Lidar Imagery: Case Study of Damage Induced by the 2017 Hurricane Irma to Mangroves in the Florida Everglades, USA
Previous Article in Special Issue
Evaluation of the Accuracy of Contactless Consumer Sleep-Tracking Devices Application in Human Experiment: A Systematic Review and Meta-Analysis
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Customized Deep Sleep Recommender System Using Hybrid Deep Learning

Department of Computer Science, Dankook University, 152 Jukjeon-ro Campus, Suji-gu, Yongin-si 16890, Republic of Korea
*
Author to whom correspondence should be addressed.
Sensors 2023, 23(15), 6670; https://doi.org/10.3390/s23156670
Submission received: 22 June 2023 / Revised: 16 July 2023 / Accepted: 24 July 2023 / Published: 25 July 2023
(This article belongs to the Special Issue Sensors in Sleep Monitoring)

Abstract

:
This paper proposes a recommendation system based on a hybrid learning approach for a personal deep sleep service, called the Customized Deep Sleep Recommender System (CDSRS). Sleep is one of the most important factors for human life in modern society. Optimal sleep contributes to increasing work efficiency and controlling overall well-being. Therefore, a sleep recommendation service is considered a necessary service for modern individuals. Accurate sleep analysis and data are required to provide such a personalized sleep service. However, given the variations in sleep patterns between individuals, there is currently no international standard for sleep. Additionally, service platforms face a cold start problem when dealing with new users. To address these challenges, this study utilizes K-means clustering analysis to define sleep patterns and employs a hybrid learning algorithm to evaluate recommendations by combining user-based and collaborative filtering methods. It also incorporates feedback top-N classification processing for user profile learning and recommendations. The behavior of the study model is as follows. Using personal information received through mobile devices and data, such as snoring, sleep time, movement, and noise collected through AI motion beds, we recommend sleep and receive user evaluations of recommended sleep. This assessment reconstructs the profile and, finally, makes recommendations using top-N classification. The experimental results were evaluated using two absolute error measurement methods: mean squared error (MSE) and mean absolute percentage error (MAPE). The research results regarding the hybrid learning methods show 13.2% fewer errors than collaborative filtering (CF) and 10.2% fewer errors than content-based filtering (CBF) on an MSE basis. According to the MAPE, the methods are 14.7% more accurate than the CF model and 9.2% better than the CBF model. These results demonstrate that CDSRS systems can provide more accurate recommendations and customized sleep services to users than CF, CBF, and combination models. As a result, CDSRS, a hybrid learning method, can better reflect a user’s evaluation than traditional methods and can increase the accuracy of recommendations as the number of users increases.

1. Introduction

Sleep is considered to be one of the most significant factors in modern society that affects human life [1]. As we can see from events like “World Sleep Day,” the importance of sleep is emphasized in our daily lives, and efforts are being made worldwide to prevent and manage sleep disorders. Sleep technology, or “sleep tech,” is recognized as a future industry and is gaining traction, as demonstrated by its inclusion in CES 2020~2022, and it is evolving into various fields through the integration of artificial intelligence and IoT technologies [2,3,4].
Sleep technology, also known as “sleep tech”, is a combination of sleep and technology that aims to improve the quality of sleep by analyzing sleep-related data. The initial steps in this field involved the integration and development of IoT technology [5]. One of the representative products is the motion bed, which collects sleep data from the user and analyzes them to improve the user’s sleep environment [6,7]. Other research directions in sleep technology involve data analysis such as brainwave analysis. Standardized evaluation guidelines are being designed using biological data collected from existing IoT devices, and service satisfaction is being improved through user satisfaction surveys [8]. However, because sleep evaluation guidelines vary between studies and there is no international standard for optimal sleep, it cannot be deemed sufficient to provide accurate sleep state predictions and personalized services. In order to provide personalized sleep services, a requirement for personalized sleep pattern analysis is present [9].
The goal of this research is to analyze non-standardized sleep data in a personalized way using cluster analysis and to solve the cold start problem of the service using a hybrid collaborative filtering approach with profile composition and feedback evaluation. In this paper, we propose a Customized Deep Recommender System (CDSRS) that utilizes motion beds to collect data and construct user profiles and incorporates user feedback evaluations to address the cold start problem. The expected contributions are (i) the improvement of the cold start problem of the platform, (ii) the improvement of the accuracy of hybrid recommendation systems in personalized sleep services, and (iii) the evaluation of pattern recognition through cluster analysis and suitable recommendations for users. These results effectively provide recommendation services for sleep with low relevance and solve the cold start problem that occurs in the platform.
The focus of this study is on the accuracy of the recommendation system. The user profiles, reconstructed using hybrid learning combining pattern definitions and feedback methods, contribute to improving the effectiveness and accuracy of sleep recommendations. Traditional methods, such as CF or CBF, have a problem in that there is no way to increase the accuracy of recommendations as the number of users increases, like those that do not reflect a user’s sleep assessment. However, the CDSRS system is a hybrid learning method that easily reflects a user’s sleep assessment and can increase the accuracy of recommendations as the number of users increases. The evaluation of recommendation accuracy is based on two performance error functions: MSE and MAPE. Section 2 describes related research and technologies, while Section 3 explains the learning method, system structure, and algorithm of CDSRS. Finally, Section 4 and Section 5 describe the research results and conclusions.

2. Related Work

2.1. Recommender Systems

Recommender systems (RSs) provide necessary and accurate information to help users choose the most suitable option in a particular environment. This has made RSs popular software [10]. They are successfully used by platform-oriented companies such as Netflix and YouTube to provide recommendations to users [11,12]. The goal of an RS is to provide personalized content to users, which can reduce their selection time and increase efficiency. Additionally, when used by many users, RSs can help identify situational needs. There are various types of recommendation algorithms, such as collaborative filtering, content-based filtering, and user-based filtering. However, these types of filtering have a major drawback [13]. When a new user starts using the system, the cold start problem occurs. Many studies have been conducted to address the cold start problem [14,15].
The fields that most use recommendation systems include clothing, movies, and food, among others, and recommendations are provided based on the user’s psychology, personality, and situational information. To provide recommendations, it is important to understand the correlations between this information or apply it according to the RS algorithm. RSs can also provide personalized medicine and digital healthcare in the sleep tech field, helping users improve their health, and can increase the level of predicting and evaluating content by utilizing sleep data [16,17].

2.2. Deep Learning (DL)

Deep learning is one of the methods for implementing artificial intelligence, analyzing data, and deriving results based on algorithms. This is why deep learning is popular in building personalized systems [18,19,20]. Deep learning is used in various fields, and machine learning is divided into three types of learning methods: supervised learning, unsupervised learning, and reinforcement learning [21]. Among them, deep learning is a machine learning method that uses neural networks. Current research shows that machine learning techniques and filtering techniques are used in recommendation systems. Hybrid methods that can use deep learning to improve recommendations are also available [22,23].

2.3. Sleep Technology

Sleep is an essential element of human life, but it can be overlooked in modern times, leading to sleep disorders. For this reason, sleep tech is gaining popularity, and a significant amount of research is being conducted [24,25,26]. Recent techniques in sleep include sleep posture recognition using microwave Doppler radar and machine learning classifiers and sleep posture recognition using dual-frequency microwave Doppler radar [27,28,29,30,31,32]. However, since there is no standard for sleep data, it is difficult for recommendation systems to provide accurate content. As sleep patterns define machine learning and recommendation system performance, further research is needed. In this paper, the main goal is to create a standard using pattern analysis based on cluster characteristics to improve system efficiency using machine learning.

2.4. Personalized Systems

The fourth industrial revolution has led to innovative technological advancements such as cloud computing and artificial intelligence, but it has also given rise to the important element of personalized systems [33]. One of the most prominent examples is personalized recommendation systems. These systems provide tailored recommendation services based on a user’s information. When users are satisfied, the quality of the service improves, leading to expansion into various fields.

3. The Proposed CDSRS (Customized Deep Sleep Recommender System)

The Customized Deep Sleep Recommender System (CDSRS) process is carried out according to steps 1 to 6 shown in Figure 1. In step 1, it collects sleep information using a customized AI motion bed and transmits the data necessary to create a personal profile. In step 2, the data server in the data store is used to configure the user’s profile and sleep content, and step 3 reconstructs the user’s profile when evaluation information is sent. The hybrid learning method in data processing learns algorithms based on user profiles and user evaluations. In step 4, user feedback provides user profiles and collects user evaluation information, which is then transmitted to the data server. The feedback function helps improve the accuracy of sleep recommendations for users. In step 6, it provides sleep services using motion beds to users through recommendations.
The sleep system is composed of user sleep data and recommendation information, which are important parts of sleep care. Figure 2 and Figure 3 illustrate the concept of technological development for sleep care design models, system overview, structure, and service utilization cases in the service flow. Figure 2 shows the concept of the service model and introduces the components of each service.
The model consists of nine steps in sequential order. Clustering is performed in steps 3 to 5 using the user’s sleep data to define patterns. Currently, the user’s sleep data are rearranged into patterns. Steps 6 to 9 express detailed sleep patterns by adding user satisfaction data through additional surveys. The user’s satisfaction data, obtained through the survey, are used to respecify the recommendation presented to the user. The CDSRS uses a hybrid learning method to learn and test the dataset, evaluate the learning model, and provide more appropriate recommendations based on the user’s sleep evaluation through top-N recommendations with higher accuracy than traditional filtering techniques. Fusion care is defined by combining user feedback evaluations with sleep data. The preferred sleep pattern is constructed by determining the healthcare service paradigm and data content. Additionally, a personalized profile is created through the service model, which suggests individualized services by analyzing noise and BMI during sleep.

3.1. System Architecture of the CDSRS

The proposed system architecture for the CDSRS is shown in Figure 3, below. It consists of three models that incorporate user feedback and a module for processing and managing data that are generated by adjusting the AI motion bed through a mobile UI and creating user profiles based on that experience. The hybrid learning method involves a top-N classification that recommends sleep pattern content as the recommended learning method. The learning method of the inference function processes user sleep pattern evaluations by pattern using the Knn algorithm [34]. In the next step, the recommendation engine provides users with optimal sleep recommendations based on the functions of the learning method according to their evaluations and sleep preferences.

3.2. Learning Methods of the Deep Sleep System

The key idea behind the system’s process is to analyze the user profile and preferences by using clustered recommendations in a motion bed environment and to calculate the similarity index between the user and sleep patterns based on feedback evaluations to achieve optimization. The CDSRS is composed of various features and learning methods, as shown in Figure 3.
The algorithm used in the data analysis and user profile server is the K-means clustering technique, which is used for pattern analysis because there is no similarity between sleep data (snoring, noise, BMI, sleep time). The process involves two steps: finding the K-value using the Elbow Method in step 1 and verifying the appropriate K-value using the silhouette validation algorithm in step 2 [35].
Table 1 describes the definition of the algorithm, including specific parameters.
The process shown in Figure 4 suggests sleep to the user based on a predefined pattern. First, we create a profile using the user’s sleep data. We then create a sleep matrix with the K-means classification model for the classification of less relevant sleep data such as BMI, sleep time, and snoring. If the profile is created, you will continue to the next step, but if not, you will reconfigure the profile. The CF model is then used to make recommendations, receive user feedback, and reconstruct profiles using hybrid learning methods. After that, a test is conducted with a learning and evaluation model using Knn, and finally, the output is received as a top-N classification model. If the result of the algorithm obtains the list you want, the algorithm ends; otherwise, it goes back to the profile configuration step.
The CDSRS algorithm consists of the following. The input value is the user’s sleep data, which contains data such as sleep time, moving, sound, and snoring; see Figure 5 for more information. The output value is a list of recommendations from the top-N classification of hybrid learning methods. In this case, the user can control the motion bed by selecting the desired item from the recommendation list. The first of the algorithms constructs a user’s profile with the user’s sleep data. Then, it uses the K-means classification model to create a sleep matrix in a similar group. When a sleep matrix is created, it uses a CF algorithm to calculate similarity and provide recommendation services. Otherwise, it returns to the profile configuration step. In this process, you will receive an evaluation and add it to your profile, gaining sleep pattern analysis data for hybrid learning. Once the appropriate values are obtained, we test them using the evaluation model and, finally, train the top-N classification model. However, the obtained Nan values will be retrained with the Knn algorithm. The last return value is the top-N recommendation you set, and if the number of recommendations you want is achieved, the process ends; otherwise, it returns to the profile configuration step. The process of the CDSRS algorithm is as follows in Algorithm 1.
Algorithm 1: CDSRS
InputUser’s sleep data
OutputTop-N Categorized Recommendation List
1.Create profile with Sleep Data
2.Use K-means Classification model
3.IF System create Sleep Matrix (SM) with Sleep Data
4.  then, Use CF to Deep Sleep Service recommendation based on (SM) similarity
5.  Save & Update User’s Rating
6.Else: Back to line 2
7.Training Sleep Recommendation model
8.IF System have recommendation results
9.  then, Test set to Evaluate model
10.  If Loss value is Nan:
11.   then, Train Set Using Knn
12.   Back to line 10
13.  else:
14.   Learning Top-N Classification Model
15.   return (Top-N Sleep Recommendations)
16.Else:
17.  Train set Using Knn
18.  Test set to Evaluate model
19.  If Loss value is Nan:
20.   then, Train Set Using Knn
21.  else:
22.   Learning Top-N Classification Model
23.   return (Top-N Sleep Recommendations)
24.Save & Update Profile
25.IF Top-N Sleep recommendations == User wants
26.  then, Process End
27.  return (Top-N Sleep Recommendations)
28.Else: Back to line 1
In lines 1 to 2, Algorithm 2 integrates information such as BMI, noise, etc., to calculate similarity and improve patterns. In lines 3 to 5, we repeat the similarity calculation between the sleep matrix (SM) and the user (U) to configure the user-defined profile using Algorithm 3. The resulting data are no longer independent, and this method is called hybrid learning, which combines profile and user evaluation results. This hybrid learning method solves the cold start problem for new users.
Finally, in lines 9 to 24, the user’s assessment of the proposed sleep recommendation is used by Algorithm 4 to analyze the data into a top-N classification. This learning method reconstructs user profiles and excludes less relevant sleep data. This allows you to improve your personalized recommendations through repeated feedback assessments.
Algorithm 2: CSPD (Clustering for Sleep Pattern Definition)
InputUser’s sleep data
Outputsum_of_squared_distance, k
1.sum_of_squared_distance = []
2.for k = 1, k in range(1,9) do
3.   sum _ of _ squared _ distance = i = 1 1 dist ( x , ai ) 2 ;
4. return (sum_of_squared_distance, k)
5. S ( i ) = ( b i     a i ) max ( a i , b i )
6. a ( i ) = n C n i n ;   b ( i ) = n D n i n ;
7.def i in X,C,D:
8. If   a ( i )   <   b ( i ) ,   s ( i ) = 1 a ( i ) b ( i )
9. If   a ( i )   >   b ( i ) ,   s ( i ) = b ( i ) a ( i )   1
10. Label = KMeans(n_clusters = k)
11. return (s(i),k)
Algorithm 3: PUSA (Prediction User Similarity Algorithm in Sleep Pattern Label)
Inputsim(U1,U2),SM(Sleep Rating Matrix)
Outputsim_score
1. def   sim _ score ( U 1 , U 2 , SM ) :   sim ( U 1 , U 2 ) = 1 n ( U 1 i   ×   U 2 i ) i n ( U 1 i ) 2   ×   i n ( U 2 i ) 2
2. If labeln not in [SM]:
3.   Break;
4. else:
5.   Return sum([pow(RatingMatrix [U1][SM]–RatingMatrix [U2][SM],2)])
6. For labeln in RatingMatrix [U1]
7.   If labeln in RatingMatrix [,U2]
8.    then, Ignore score sim < 1
9. Return (sim_score)
Algorithm 4: PHRA(Prediction of Hybrid Learning Top-N Rating Algorithm)
InputRatingMatrix
OutputTop-N recommendation list
1.RatingMatrix = Sleep Pattern Rating Matrix
2. def   Top N _ prediction ( R , sim i ) :   R predict = i = 1 N sim i R i i = 1 N sim i
3.   For U in RatingMatrix:
4.    if U not in RatingMatrix
5.     Break
6.    else:
7.     result [RM] = Rpredict
8.     return result
9.Sort list (RatingMatrix SM list)
10.Return (Top-N recommendation list)

3.2.1. User Profile Configuration

The profile module consists of pattern analysis, profile management, and feedback reflection. Each module is composed of a user profile and sleep content that reflects the user’s sleep time, BMI, snoring measurement, and noise level during sleep. This basic step helps generate recommendations for personalization and sleep preference collection related to the learning method. Figure 5, below, illustrates the profile structure, explaining the collection and analysis of user data, which helps create customized sleep recommendation content.
First, the user file consists of the user’s ID data, UID, PW, name, sleep data, BMI, birth, and gender. Sleep data are collected through the bed and consist of sleep time, moving, sound, and snoring. For personalized referral systems, we preprocess the UID to configure the sleep matrix and reconstruct it into SMID, pattern label, and rating data. Finally, the algorithm constructs the data in the rating matrix based on the pattern label and the user evaluation.
The creation of a profile is a core feature of personalized sleep recommendation services, which is aided by the learning method. Users can evaluate the first recommended sleep and choose recommendations for sleep content through analysis. This allows users to agree with the analysis of their profile information, enabling the process to be repeated and providing more appropriate content.
With vast amounts of data, classification and definition must be accurately determined, as ambiguous and unrelated data can lead to unclear analysis results. This can result in a loss of meaning and features even if users are classified. Therefore, evaluation and reflection are added to the profile construction process to ensure an accurate optimization process. This reconstruction of the profile helps with user satisfaction and the processing of the profile.

3.2.2. Cold Start Problem

The cold start problem refers to the situation where a recommendation system cannot provide appropriate recommendations to new users because of insufficient pre-existing information. To solve this problem, the CDSRS uses a hybrid learning approach to reconfigure the user’s profile through feedback, even for new users, so that appropriate recommendations can be made.

3.2.3. Defining User Sleep Patterns

The sleep data collected with the AI bed consists of snoring, noise during sleep, BMI, and sleep duration. However, given the nature of sleep data, there is a lack of correlation between the variables. This can lead to inadequate recommendations even after classifying the data. Therefore, we use the K-means algorithm to create meaningful correlations. The K-means algorithm is used to classify data into k clusters, which define the user’s sleep patterns and help find similarities between users and predict additional patterns.
The pseudocode below describes the process of defining sleep patterns, which has a significant impact on recommendations. First, lines 1 to 4 calculate the distance using sleep data and determine the number of centroids (k-value). Lines 5 to 10 go through the silhouette validation process to derive an appropriate k-value out of multiple values. Line 11 returns the silhouette value and the k-value.
Figure 6 shows a graph of changes in the k-value according to the sum of squared distances. We judge that the appropriate k-value is around three to five, and to verify this, the silhouette validation method is used. At this point, the k-value is defined as the number of sleep patterns.
Figure 7 represents the process of determining the appropriate number of sleep patterns before recommending similar sleep to users. The silhouette score increases or decreases as the value of k increases. When the k-value is five, the optimal silhouette score is obtained, and it is confirmed that it decreases when the k-value is six, so the efficiency is best when the number of clusters is five.
Through the above process, user profile information is generated. By clustering the data, the meaning of the data becomes clearer, and user satisfaction can be confirmed through recommendations.

3.2.4. Collaborative Filtering

Collaborative filtering predicts users’ interests based on evaluations and feedback gathered from multiple users. With this method, we increase the similarity between users and generated recommendations using sleep-data-based profiles. The resulting process is conceptually simple. When given a user, we normalize their sleep data, calculate the distance from the cluster centroids, and find the cluster corresponding to the user’s sleep pattern. Then, we recommend similar users from that cluster. The algorithm does not need to compute the similarity between all users. The idea is to recommend the most similar sleep patterns between a specific cluster and its corresponding users. This is performed by constructing a user sleep rating matrix, as shown in Table 2.
PUSA uses the Euclidean distance calculation. However, it can be difficult to compare values with just the Euclidean distance formula. Therefore, the algorithm normalizes the data values to create a rating matrix. Additionally, the algorithm explains how to calculate the similarity between two users in the given user SM. The similarity value ranges from −1 to 1, with 1 indicating high similarity and −1 indicating that the users are dissimilar. The defined sim (U1, U2) is used to calculate the similarity between each SM and the users.
Lines 1 to 5 of Algorithm 3 explain how to calculate the similarity between users using Euclidean distance. Lines 6 to 8 transform the values to be in a range of −1 to 1 to construct an SM (Sleep matrix), which represents the ratings given by all users for the same sleep patterns, as shown in Table 3. In this algorithm, the recommendation is based on distance similarity between users and is used as the default setting for user preferences. Values from other patterns are ignored.

3.2.5. User-Based filtering

User-based filtering considers user preferences and ratings to recommend relevant preferences, bringing in the user’s sleep-related attributes and calculating the similarity with evaluation items provided in the user’s sleep data profile. Conceptually, the algorithm operates by determining the sleep patterns that the user is most likely to rate similarly based on past evaluations. In this scenario, the user-based recommendation system continuously relearns using the user profile. The algorithm equation calculates the predicted score by multiplying the user’s evaluation weight by the sim similarity. This is the algorithm that predicts the recommended sleep patterns and scores using the top-N method based on the user’s rated sleep pattern evaluation, as shown in lines 1 to 7 [36]. The final formula for the learning method is Algorithm 4.
Several models can be used to obtain similarity values within a group of sleep patterns and obtain predicted values using sleep pattern evaluations. This is because we want to assign importance levels that vary according to user evaluations. Sleep data analysis considering user evaluations is related to the user’s sleep time, snoring, and primarily recommended sleep evaluations. Through this, the filtering process can create more accurate similar users compared with the initially calculated similar users. The pseudocode in lines 8 to 9 describes the SM list using the predicted values calculated with user evaluations and similarity. This algorithm is effective in the sleep evaluation matrix, so it is ultimately used to normalize weight evaluations.
The proposed algorithm relies on user feedback and engagement, as it is based on user evaluations for profile processing. The learning method’s model is based on user feedback information and user profile feedback. The personalized inference engine analyzes and processes the sleep group, while the recommendation and the adaptation device are integrated with the inference function. The profile is composed of five attributes: sleep duration, snoring severity, noise, BMI, and five sleep patterns. User-based collaborative filtering is utilized in the recommendation algorithm to address the cold start problem.

4. Experiment and Evaluation

To verify the performance of the proposed CDSRS, experiments were conducted to calculate the error values that could be derived from incorrect recommendation results [37]. The calculation of error values is similar to supervised learning. Assuming that there is no correct answer in the experimental environment, the difference between the final predicted value and the actual correct answer is defined as the error value. A high error value means that the prediction is inaccurate. To compare the proposed model, the error values of the single CF and CBF models and the combined CF + CBF model were calculated.
The MAPE calculates the relative proportion of the error to the actual value by dividing the difference between the actual and predicted values by the actual value. Then, the absolute value of this proportion is taken, and the average is calculated. Since the degree of error is expressed as a percentage, it is easy to intuitively understand the performance of the model. The MSE is the value obtained by squaring the difference between the predicted value and the actual value and then calculating the average. As the predicted value deviates more from the actual value, the MSE value increases geometrically.
Figure 8 shows the results of the MAPE and the MSE in the Google Keras environment [38]. CF showed the lowest accuracy with 79.5% in the MAPE, and the model combined with CBF had lower accuracy than the CDSRS. The proposed CDSRS had the highest accuracy at 94.2%. CF showed the highest error value with 22.4 in the MSE. CBF improved by about three compared with CF, and the combined model showed an increased error value. The proposed CDSRS had the lowest error value at 9.2, and it was improved by 12.2 compared with CF.
To evaluate the recommendation system, the proposed recommendations to the user include sleep patterns labeled with a sleep label and an estimated sleep rating. To assess the performance of the CDSRS, it must be tested using different machine learning approaches and compared in terms of performance. The CF and CBF algorithms are combined into a single algorithm, CF + CBF, to make predictions. Therefore, the proposed CDSRS method calculates the accuracy and reliability of the performance comparison based on two evaluation criteria. The MAPE has a range of 0–100%, as it is an accurately calculated percentage. The CPRDS had an accuracy of 95.4%, making it the closest to the benchmark of 100%.
Next, we calculate the accuracy of the recommendation using the MSE. The calculation of error using the MSE is similar to calculating the error value using the MAE. However, unlike the MAE, squared operations are performed to weight higher error values. This means that higher error values are given more weight, while lower error values are given less weight.
To evaluate the performance of the CDSRS learning algorithm, two evaluation criteria, the MSE and the MAPE, were used. As shown in Table 4 and Table 5, the CDSRS exhibited a relatively high value of MAPE at around 10% compared with other models, while the accuracy value of the MSE model decreased by approximately eight, indicating that it is the most stable and improved average model. The proposed CDSRS can analyze and predict sleep data with low correlation as patterns and recommend sleep patterns using ML by incorporating user changes. As shown in Table 6 and Table 7, the experimental results demonstrate that the proposed CDSRS outperforms the combination CF, CBF, and CF + CBF models in terms of performance.

5. Conclusions and Future Works

This paper introduces a hybrid deep learning approach to construct a personalized sleep service recommendation system. The proposed system utilizes K-means clustering to analyze sleep data with low correlation and identify similar sleep patterns, which are then used to create user profiles. User feedback from the top-N-rated process is employed to reconstruct the profiles. The system leverages this feedback and user sleep data for learning purposes and subsequently generates and releases the final recommendations in the form of a top-N list. This hybrid learning approach effectively addresses the cold start problem and enhances the efficiency and accuracy of the recommendations. Furthermore, a matrix combining sleep patterns and user ratings is employed as a variable to improve the model’s accuracy.
To evaluate the performance of the proposed model, 1000 user data points were considered, and K-means clustering was employed to define five sleep patterns. The sleep data used in this study consist of the user’s UID, BMI, snoring, sleep time, noise, and movement. The mean squared error (MSE) and mean absolute percentage error (MAPE) were used for error verification. Based on the MSE values, the CDSRS model exhibited 13.2% less error compared with the collaborative filtering (CF) model and 10.2% less error compared with the content-based filtering (CBF) model. Regarding the MAPE, the CF model achieved 79.5% accuracy, while the CBF and CF + CBF models achieved 85% accuracy. Notably, the proposed CDSRS model demonstrated the highest accuracy, reaching 94.2%. Traditional methods do not reflect user sleep assessments, and there is no way to improve the accuracy of recommendations as the number of users increases, but CDSRS can solve existing problems using advanced results and hybrid methods, allowing users to make more accurate recommendations and provide customized services.
In future studies, CDSRS can combine EEG (EEG) data. EEG refers to an electrophysiological measurement method that records the electrical activity of the brain through electrodes. This has the potential to increase our understanding of sleep stages and provide more accurate and personalized services. EEG patterns allow research to identify specific sleep stages that an individual is experiencing, allowing RSs to deliver more accurate, customized recommendations. In addition, real-time sleep monitoring can be integrated to improve the accuracy of personalized recommendations by providing the system with the user’s sleep state. It can also be replaced by feedback, such as surveys, instead of user feedback methods using traditional ranking systems. These systems can leverage natural language processing models to provide more diverse and sophisticated recommendations.

Author Contributions

Conceptualization, J.-H.P.; methodology, J.-H.P.; validation, J.-H.P.; formal analysis, J.-H.P.; resources, J.-H.P.; data curation J.-H.P.; writing—original draft preparation, J.-H.P. and J.-D.L.; writing—review and editing, J.-D.L.; supervision. All authors have read and agreed to the published version of the manuscript.

Funding

The present research was conducted by the research fund of Dankook University in 2022. (R202200552).

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

The data presented in this study are available on request from the corresponding author.

Acknowledgments

The present research was conducted by Dankook University in 2022.

Conflicts of Interest

The researchers claim no conflict of interest.

References

  1. Grandner, M.A. Sleep, health, and society. Sleep Med. Clin. 2017, 12, 1–22. [Google Scholar] [CrossRef] [PubMed]
  2. Perez-Pozuelo, I.; Zhai, B.; Palotti, J.; Mall, R.; Aupetit, M.; Garcia-Gomez, J.M.; Taheri, S.; Guan, Y.; Fernandez-Luque, L. The future of sleep health: A data-driven revolution in sleep science and medicine. NPJ Digit. Med. 2020, 3, 42. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  3. Gradisar, M.; Gardner, G.; Dohnt, H. Recent worldwide sleep patterns and problems during adolescence: A review and meta-analysis of age, region, and sleep. Sleep Med. 2011, 12, 110–118. [Google Scholar] [CrossRef] [PubMed]
  4. Han, H.; Jo, J.; Son, Y.; Park, J. Smart sleep care system for quality sleep. In Proceedings of the 2015 International Conference on Information and Communication Technology Convergence (ICTC), Jeju, Republic of Korea, 28–30 October 2015; pp. 393–398. [Google Scholar]
  5. Schaltenbrand, N.; Lengelle, R.; Macher, J.-P. Neural network model: Application to automatic analysis of human sleep. Comput. Biomed. Res. 1993, 26, 157–171. [Google Scholar] [CrossRef] [PubMed]
  6. Kogure, T.; Shirakawa, S.; Shimokawa, M.; Hosokawa, Y. Automatic sleep/wake scoring from body motion in bed: Validation of a newly developed sensor placed under a mattress. J. Physiol. Anthropol. 2011, 30, 103–109. [Google Scholar] [CrossRef] [Green Version]
  7. Laurino, M.; Arcarisi, L.; Carbonaro, N.; Gemignani, A.; Menicucci, D.; Tognetti, A. A smart bed for non-obtrusive sleep analysis in real world context. IEEE Access 2020, 8, 45664–45673. [Google Scholar] [CrossRef]
  8. Baron, K.G.; Duffecy, J.; Berendsen, M.A.; Mason, I.C.; Lattie, E.G.; Manalo, N.C. Feeling validated yet? A scoping review of the use of consumer-targeted wearable and mobile technology to measure and improve sleep. Sleep Med. Rev. 2018, 40, 151–159. [Google Scholar] [CrossRef]
  9. Amatriain, X. Mining large streams of user data for personalized recommendations. ACM SIGKDD Explor. Newsl. 2013, 14, 37–48. [Google Scholar] [CrossRef]
  10. Adomavicius, G.; Tuzhilin, A. Toward the next generation of recommender systems: A survey of the state-of-the-art and possible extensions. IEEE Trans. Knowl. Data Eng. 2005, 17, 734–749. [Google Scholar] [CrossRef]
  11. Gomez-Uribe, C.A.; Hunt, N. The netflix recommender system: Algorithms, business value, and innovation. ACM Trans. Manag. Inf. Syst. 2015, 6, 1–19. [Google Scholar] [CrossRef] [Green Version]
  12. Davidson, J.; Liebald, B.; Liu, J.; Nandy, P.; Van Vleet, T.; Gargi, U.; Gupta, S.; He, Y.; Lambert, M.; Livingston, B. The YouTube video recommendation system. In Proceedings of the Fourth ACM Conference on Recommender Systems, Barcelona, Spain, 26–30 September 2010; pp. 293–296. [Google Scholar]
  13. Lika, B.; Kolomvatsos, K.; Hadjiefthymiades, S. Facing the cold start problem in recommender systems. Expert Syst. Appl. 2014, 41, 2065–2073. [Google Scholar] [CrossRef]
  14. Wei, J.; He, J.; Chen, K.; Zhou, Y.; Tang, Z. Collaborative filtering and deep learning based recommendation system for cold start items. Expert Syst. Appl. 2017, 69, 29–39. [Google Scholar] [CrossRef] [Green Version]
  15. Bobadilla, J.; Ortega, F.; Hernando, A.; Bernal, J. A collaborative filtering approach to mitigate the new user cold start problem. Knowl.-Based Syst. 2012, 26, 225–238. [Google Scholar] [CrossRef] [Green Version]
  16. Rayward, A.T.; Duncan, M.J.; Brown, W.J.; Plotnikoff, R.C.; Burton, N.W. A cross-sectional cluster analysis of the combined association of physical activity and sleep with sociodemographic and health characteristics in mid-aged and older adults. Maturitas 2017, 102, 56–61. [Google Scholar] [CrossRef] [PubMed]
  17. Wiesner, M.; Pfeifer, D. Health recommender systems: Concepts, requirements, technical basics and challenges. Int. J. Environ. Res. Public Health 2014, 11, 2580–2607. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  18. Praveen, B.; Talukdar, S.; Mahato, S.; Mondal, J.; Sharma, P.; Islam, A.R.M.; Rahman, A. Analyzing trend and forecasting of rainfall changes in India using non-parametrical and machine learning approaches. Sci. Rep. 2020, 10, 10342. [Google Scholar] [CrossRef]
  19. Jordan, M.I.; Mitchell, T.M. Machine learning: Trends, perspectives, and prospects. Science 2015, 349, 255–260. [Google Scholar] [CrossRef]
  20. Raschka, S.; Patterson, J.; Nolet, C. Machine learning in python: Main developments and technology trends in data science, machine learning, and artificial intelligence. Information 2020, 11, 193. [Google Scholar] [CrossRef] [Green Version]
  21. El Naqa, I.; Murphy, M.J. What Is Machine Learning? Springer: Berlin/Heidelberg, Germany, 2015. [Google Scholar]
  22. Shon, T.; Moon, J. A hybrid machine learning approach to network anomaly detection. Inf. Sci. 2007, 177, 3799–3821. [Google Scholar] [CrossRef]
  23. Saravi, B.; Hassel, F.; Ülkümen, S.; Zink, A.; Shavlokhova, V.; Couillard-Despres, S.; Boeker, M.; Obid, P.; Lang, G.M. Artificial intelligence-driven prediction modeling and decision making in spine surgery using hybrid machine learning models. J. Pers. Med. 2022, 12, 509. [Google Scholar] [CrossRef]
  24. Datko, P.; Scherz, W.D.; Velicu, O.R.; Seepold, R.; Madrid, N.M. Personal recommendation system for improving sleep quality. In Proceedings of the Intelligent Decision Technologies 2016: Proceedings of the 8th KES International Conference on Intelligent Decision Technologies (KES-IDT 2016)—Part I, Puerto de la Cruz, Spain, 15–17 June 2016; pp. 405–412. [Google Scholar]
  25. Liao, W.-H.; Yang, C.-M. Video-based activity and movement pattern analysis in overnight sleep studies. In Proceedings of the 2008 19th International Conference on Pattern Recognition, Tampa, FL, USA, 8–11 December 2008; pp. 1–4. [Google Scholar]
  26. Pandey, V.; Upadhyay, D.D.; Nag, N.; Jain, R.C. Personalized User Modelling for Context-Aware Lifestyle Recommendations to Improve Sleep. In Proceedings of the HealthRecSys@ RecSys, Online, 26 September 2020; pp. 8–14. [Google Scholar]
  27. Droitcour, A.; Lubecke, V.; Lin, J.; Boric-Lubecke, O. A microwave radio for Doppler radar sensing of vital signs. In Proceedings of the 2001 IEEE MTT-S International Microwave Sympsoium Digest (Cat. No. 01CH37157), Phoenix, AZ, USA, 20–24 May 2001; pp. 175–178. [Google Scholar]
  28. Singh, A.; Lubecke, V.; Boric-Lubecke, O. Pulse pressure monitoring through non-contact cardiac motion detection using 2.45 GHz microwave Doppler radar. In Proceedings of the 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Boston, MA, USA, 30 August–3 September 2011; pp. 4336–4339. [Google Scholar]
  29. Zakrzewski, M.; Raittinen, H.; Vanhala, J. Comparison of center estimation algorithms for heart and respiration monitoring with microwave Doppler radar. IEEE Sens. J. 2011, 12, 627–634. [Google Scholar] [CrossRef]
  30. Kagawa, M.; Ueki, K.; Tojima, H.; Matsui, T. Noncontact screening system with two microwave radars for the diagnosis of sleep apnea-hypopnea syndrome. In Proceedings of the 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Osaka, Japan, 3–7 July 2013; pp. 2052–2055. [Google Scholar]
  31. Lee, Y.S.; Pathirana, P.N.; Steinfort, C.L.; Caelli, T. Monitoring and analysis of respiratory patterns using microwave doppler radar. IEEE J. Transl. Eng. Health Med. 2014, 2, 1800912. [Google Scholar] [CrossRef] [PubMed]
  32. Islam, S.M.M.; Lubecke, V.M. Sleep posture recognition with a dual-frequency microwave Doppler radar and machine learning classifiers. IEEE Sens. Lett. 2022, 6, 3500404. [Google Scholar] [CrossRef]
  33. Schwab, K. The Fourth Industrial Revolution. 2017. Available online: https://www.weforum.org/about/the-fourth-industrial-revolution-by-klaus-schwab (accessed on 23 July 2023).
  34. Kotsiantis, S.B.; Zaharakis, I.; Pintelas, P. Supervised machine learning: A review of classification techniques. Emerg. Artif. Intell. Appl. Comput. Eng. 2007, 160, 3–24. [Google Scholar]
  35. Yuan, C.; Yang, H. Research on K-value selection method of K-means clustering algorithm. J 2019, 2, 226–235. [Google Scholar] [CrossRef] [Green Version]
  36. Xue, F.; He, X.; Wang, X.; Xu, J.; Liu, K.; Hong, R. Deep item-based collaborative filtering for top-n recommendation. ACM Trans. Inf. Syst. 2019, 37, 1–25. [Google Scholar] [CrossRef] [Green Version]
  37. Elahi, M.; Ricci, F.; Rubens, N. A survey of active learning in collaborative filtering recommender systems. Comput. Sci. Rev. 2016, 20, 29–50. [Google Scholar] [CrossRef]
  38. Gulli, A.; Pal, S. Deep Learning with Keras; Packt Publishing Ltd.: Birmingham, UK, 2017. [Google Scholar]
Figure 1. Customized Deep Sleep Recommender System (CDSRS).
Figure 1. Customized Deep Sleep Recommender System (CDSRS).
Sensors 23 06670 g001
Figure 2. CDSRS service model and service flow steps.
Figure 2. CDSRS service model and service flow steps.
Sensors 23 06670 g002
Figure 3. System architecture of the CDSRS.
Figure 3. System architecture of the CDSRS.
Sensors 23 06670 g003
Figure 4. Flow chart of CDSRS algorithm.
Figure 4. Flow chart of CDSRS algorithm.
Sensors 23 06670 g004
Figure 5. User profile structure.
Figure 5. User profile structure.
Sensors 23 06670 g005
Figure 6. K-values for sleep pattern labels.
Figure 6. K-values for sleep pattern labels.
Sensors 23 06670 g006
Figure 7. Silhouette verification for appropriate k-values.
Figure 7. Silhouette verification for appropriate k-values.
Sensors 23 06670 g007
Figure 8. Each experiment’s MAPE/MSE results.
Figure 8. Each experiment’s MAPE/MSE results.
Sensors 23 06670 g008
Table 1. Sleep research trends.
Table 1. Sleep research trends.
YearSleep Research
2001A microwave radio for Doppler radar sensing of vital signs;
2008Video-based activity and movement pattern analysis in overnight sleep studies;
2011Comparison of center estimation algorithms for heart and respiration monitoring with microwave Doppler radar;
Pulse pressure monitoring through non-contact cardiac motion detection using 2.45 GHz microwave Doppler radar;
2013Noncontact screening system with two microwave radars for the diagnosis of sleep apnea–hypopnea syndrome;
2014Monitoring and analysis of respiratory patterns using microwave Doppler radar
2016Personal recommendation system for improving sleep quality;
2020Personalized user modeling for context-aware lifestyle recommendations to improve sleep;
2022Sleep posture recognition with a dual-frequency microwave Doppler radar and machine learning classifiers.
Table 2. Parameters.
Table 2. Parameters.
ParametersDescription
KNumber of sleep pattern labels
Sim (Ua,Ub)Euclidean distance to calculate the similarity between two users
SMSMn, number of sleep labels in rating matrix
Rating MatrixUser’s sleep pattern rating matrix, from −1 to 0 to 1 in the sleep rating matrix
Sleep RatingOne to five ratings of sleep patterns evaluated by users
UUn, number of users in rating matrix
Top-NN with high accuracy in the algorithm result list
NanError value
Table 3. Sleep rating matrix.
Table 3. Sleep rating matrix.
U1U2U3U4Un
SM11 1−1
SM2−1 −1
SM311 1
SMn 1 −1
Table 4. Formulas of MSE and MAPE evaluation criteria.
Table 4. Formulas of MSE and MAPE evaluation criteria.
Evaluation CriterionFormulaFunctional
MSE 1 n 1 n ( d i d ^ i ) 2 Mean squared error is a combination measurement of bias and variance of prediction.
MAPE 100 n 1 n d i d ^ i d i Mean absolute percentage error is similar to MAE but is normalized by a true observation. The downside is that, when the true observation is zero, this metric will be problematic.
Table 5. Summary of mean squared error (MSE) values.
Table 5. Summary of mean squared error (MSE) values.
ModelThe Average Error Value of the Model According to MSEProposed Method
MSECFCBFCF + CBFCDSRS
22.419.423.89.2
Table 6. Accuracy of recommendations using MAPE.
Table 6. Accuracy of recommendations using MAPE.
ModelMean Error Values of the Models According to MAPEProposed Method
MAPECFCBFCF + CBFCDSRS
79.58684.394.2
Table 7. Comparison of final results.
Table 7. Comparison of final results.
Comparison of Final ResultsA Proposed Method
ModelCFCBFCF + CBFCDSRS
MSE22.419.423.89.2
MAPE79.58684.394.2
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Park, J.-H.; Lee, J.-D. A Customized Deep Sleep Recommender System Using Hybrid Deep Learning. Sensors 2023, 23, 6670. https://doi.org/10.3390/s23156670

AMA Style

Park J-H, Lee J-D. A Customized Deep Sleep Recommender System Using Hybrid Deep Learning. Sensors. 2023; 23(15):6670. https://doi.org/10.3390/s23156670

Chicago/Turabian Style

Park, Ji-Hyeok, and Jae-Dong Lee. 2023. "A Customized Deep Sleep Recommender System Using Hybrid Deep Learning" Sensors 23, no. 15: 6670. https://doi.org/10.3390/s23156670

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop