1. Introduction
In recent years, there has been a growing trend towards the application of Information Communication Technologies (ICT) in various topics in the health area [
1,
2,
3,
4]. Health Informatics (HI) has occupied a strategic role in society, generating relevant impacts on economic and human aspects. Recent research in this regard considers physical and mental health involving topics such as prevention and care of noncommunicable diseases [
5,
6,
7], use of mobile and context-aware systems [
8,
9] and assistance in the treatment of stress, anxiety and depression [
4,
10,
11]. HI research also considers specific diseases such as Alzheimer [
12] and specific technology issues as strategies for recording vital signs [
13], application of machine learning to identify medication-associated acute kidney injury [
14] and use of visual analytics for handling of Electronic Health Records (EHR) [
15].
Furthermore, the publication in recent years of a relevant number of literature reviews related to the application of ICT in health confirms the growing trend of research in this direction. These reviews addressed a variety of topics, such as gamification and serious games in the treatment of depression [
16], use of robotics in human care [
17,
18], computing applied to education on noncommunicable chronic diseases [
19], collection and analysis of physiological data in smart environments [
20] and more recently Internet of Things (IoT) and occupational well-being in Industry 4.0 [
21], application of machine learning on patient reported outcome measurements for predicting outcomes [
22], and visual analytics for EHR [
23].
Cardiac auscultation has been a practice used in medicine since the 4th century. Initially, auscultation was performed by placing the ear directly on the patient’s chest. The invention of the stethoscope by Laënnec in 1816 allowed the development of methods for the analyzing of cardiac sounds. Currently, due to the advancement of technology and the discovery of other examination methods, the auscultation remains a crusial part in noninvasive clinical examination [
24].
The technique of cardiac auscultation depends on the practice and skills of the professional who performs it, and this clinical experience is fundamental in identifying cardiac dysfunctions. A computational solution, with scope in the acquisition, processing, and analysis of the signal can help health professionals in the identification of the characteristics of cardiac sounds.
The phonocardiogram (PCG) exam is one of the tests that performs the observation of the heart sounds. It is a noninvasive and widespread method for the diagnosis of heart problems, such as detection of structural abnormalities and defects in the heart valves due to heart murmurs [
25].
According to Chowdhury et al. [
26], cardiovascular diseases (CVD) are the leading cause of human death worldwide. Based on the British Heart Foundation in 2014, CVD were the second leading cause of death in the United Kingdom with more than 155,000 people, causing almost 27% of all deaths. In 2017, this disease was responsible for 3.9 million deaths in Europe, namely, CVD account for 45% of all deaths in Europe.
Tiwari et al. [
27] considered world health organization (WHO) [
28] data to affirm that CVD are the leading cause of death globally. An estimated 17.9 million people die annually from cardiovascular problems, accounting for 32% of global deaths. According to Kobat and Dogan [
29], if there were more facilities in the early-stage diagnosis of the problem, there would be more possibilities of successful treatment for this disorder.
According to Leng et al. [
30], most heart disease is associated with and related to the heart’s sounds. Cardiac auscultation, characterized by listening to the sound of the heart due to the cardiac cycle, remains an essential method for the early diagnosis of cardiac dysfunction.
Due to the disorders caused by the pandemic of the new coronavirus (COVID-19), increased the acceptance of automation in health area. In this sense, the use of information technology and Internet of Things (IoT) opens up possibilities that should impact in the future on the accuracy rate of diagnosis and remote monitoring [
31]. In addition, the use of IoT and Cloud Computing allows the development and implementation of routines that meet the need for hospital and outpatient care with a focus on patient well-being [
32].
IoT has a relevant demand in the medical area, especially for patients who require greater follow-up of vital signs. Wearables can be used in remote monitoring of vital signs, generating reduced waiting time in outpatient clinics and emergency rooms, thus producing greater comfort and humanization to patients. IoT devices can also be used for asset tracking and localization, management of medicines and materials, control of chronic diseases, among other hospital routines [
13,
20].
Furthermore, the use of Artificial Intelligence (AI) in medicine has fostered the development of more accurate diagnoses and more efficient treatments for patients [
33]. With the possibility of using a database with large volume of information (Big Data), AI solutions are constantly improving accuracy indexes [
34].
AI-based cardiac auscultation in the context of Machine Learning (ML) [
35] uses preprocessing algorithms for signal acquisition, so that training is later developed to detect abnormal heart rate patterns by applying models, for example, of convolutional neural networks (CNN) [
36].
This article presents a literature review of scientific articles that use IoT and ML in the interpretation of cardiac auscultation. In a special way, this article is dedicated to the review of works that use machine learning to predict diseases through heart sounds. The study applied the methodology of a systematic mapping, searching research articles in 6 databases of scientific publications. The initial search found 4372 works, and after the application of the inclusion and exclusion criteria, 58 articles were selected for complete reading and discussion. The study allowed to answer the questions of the research outlined by the methodological process.
The terms ML and Deep Learning (DL) were used according to the definitions found in the articles contained in this literature review, having been applied only as a description of the methods and models observed in the selected articles.
The definitions of the terms ML and DL are complementary, composing strategies that increasingly help in cognitive computing. Before ML, applications just followed instructions written in an algorithm, and executions were based on specific code. However, if there were new rules to be incorporated, the code would need to be partially rewritten. ML offers an extended approach, as a model can be built that allows situations where an intelligent solution can learn new rules. The categories of algorithms used in ML are mainly statistical. DL is a subcategory of ML, which concerns the use of neural networks considering the deep term as the number of layers of the network.
The main contribution of this study is related to the fact of clarifying the scenario in the development of articles between January 2010 and July 2021 regarding the use of ML methods with IoT for the prediction and classification of cardiac dysfunctions in beneficial to early treatment, telemedicine and with the possibility of reducing the need for hospitalization.
The article is organized into four sections. The first contextualizes the theme and presents the current scenario.
Section 2 describes the research methodology.
Section 3 discusses the results for each research question. Finaly,
Section 4 approaches the final considerations discussing future works.
3. Results
The following sections answer the research questions presented in
Table 1, using as reference the identification number (ID) shown in the first column of
Table 5. The section also presents a bibliometric analysis and trends.
3.1. GQ1—What IoT Features Are Being Used to Capture Human Chest Sound Signals?
Among the 58 articles selected, 6.90% (4 works) (IDs = 9, 43, 46, 51) mention the use of IoT devices to capture sound signals. According to Santos et al. [
90], in the field of health, IoT is known as the Internet of Health Things (IoHT), being a field of rapid progress, with several investments related to the improvement and use of IoT. It is estimated that by 2020, IoHT had an economic impact of US
$ 170 billion. The authors presented several components of models that make use of IoHT devices such as monitoring heart rate, body temperature, blood pressure, and blood oxygenation. The authors reported in this segment of the IoTH, the easy adaptation of the use of electrocardiogram and photoplethysmography exams, presented features such as wearables, cloud data storage and diagnostic predictions though the ML.
Balakrishnand et al. [
83] (51) implemented an integrated system solution for asynchronous acquisition, storage, and analysis of cardiac sound with ML algorithms.
Deperlioglu et al. [
78] (46) presented the use of the IoHT, evidencing the need for a safe process that should be included in the model due to the use of the Internet. They used cardiac sounds of pascal B-Training and Physiobank-PhysioNet A-Training (
https://physionet.org/ (accessed on 29 October 2021)) for model training and obtained an accuracy rate greater than 90%. The model proposed by the authors uses the digital stethoscope architecture with a bluetooth connection by beacons to the server with cloud access, with CNN for diagnosis. The authors classified the solution without the need for complex hybrid models for use in a hospital or clinical environment.
Aileni et al. [
47] (9) used intensive care units (ICU) to demonstrate a model for acquiring biomedical signals with the objective of respiratory monitoring by flexible and wearable sensors. The model used the Arduino, connected by Bluetooth, to the notebook for processing and analysis of the signal by the MatLab software and Android smartphone. MatLab software was used in 24 works (IDs = 2, 3, 7, 8, 9, 11, 16, 17, 18, 24, 26, 27, 30, 35, 37, 39, 42, 46, 48, 54, 55, 56, 57, 58).
According to Ukil et al. [
32] (43), remote and automated management of health care has a significant potential for use in healthcare. IoT and machine learning can assist in screening with diagnostic indications, minimizing patient care time. The authors’ proposal is a predictive model for the presence of cardiac abnomality based on data from a PCG, but with special concern related to the use of IoT, and the confidentiality of the patient´s health information.
The main tool used to pick up signals was the digital stethoscope, mentioning in 44 articles (IDs = 3, 4, 5, 6, 7, 8, 10, 11, 13, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 29, 30, 31, 32, 33, 35, 36, 37, 38, 39, 42, 44, 45, 46, 48, 49, 50, 51, 52, 53, 54, 56). The connectivity of digital stethoscopes occurs, in most equipment, by Bluetooth, not over the Internet, and for this reason these equipments are not considered IoT devices. In the future, the internet connection will be incorporated into more smart stethoscope projects. The prototypes in Arduino and microcontrollers, simulating the stethoscope, already use the Internet connection involving lower production cost.
3.3. GQ3—What Methods Are Currently Being Used for Heart Rate Observation?
Among the 58 articles selected, 45 works (77.59%, IDs = 3, 4, 5, 6, 7, 8, 10, 11, 13, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 29, 30, 31, 32, 33, 35, 36, 37, 38, 39, 42, 41, 44, 45, 46, 48, 49, 50, 51, 52, 53, 54, 56) cite heart rate observation methods. There are two widely used methods for observing the heartbeat. The first is performed through electrical pulses captured by electrodes in electrocardiogram tests (2 studies; 18, 30). This method can even use sensors of the Arduino to create heart rate monitoring solutions. The second method has as its main device the stethoscope (44 articles, IDs = 3, 4, 5, 6, 7, 8, 10, 11, 13, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 29, 30, 31, 32, 33, 35, 36, 37, 38, 39, 42, 44, 45, 46, 48, 49, 50, 51, 52, 53, 54, 56). This device works by touching the headset on the patient’s body. The sound is amplified and reaches the olives connected to the ear through the cables.
With the increased use of smartwatches, another method of heartbeat observation is photoplethysmography (PPG). Elgendi et al. [
74] (41) presented the use of PPG, stating that the method is most commonly used in pulse oximetry in clinical environments to measure oxygen saturation, for observation of heart rate and blood pressure (BP).
3.4. FQ1—Is There Mention of Care Using Machine Learning?
Among the 58 articles selected, 34 works (58.62%,IDs = 1, 2, 5, 6, 10, 19, 20, 21, 22, 25, 31, 32, 33, 34, 35, 36, 37, 39, 40, 41, 42, 43, 44, 46, 48, 49, 50, 51, 52, 53, 54, 55, 56, 58) mention care using Machine Learning. Leng et al. [
30] (36) showed the possible interactions between the electronic stethoscope, the sensor-captured signal decomposition algorithm, machine learning techniques and cardiac sound segmentation.
Chowdhury et al. [
26] (35) proposed a portable system for early detection of heart disease behind heart-produced sounds. The model used for training the dataset PhysioNet-2016 with machine learning algorithms in MatLab. The system is described as a model of an intelligent digital stethoscope to monitor the patient’s heart sounds and diagnose any abnormality in real-time. Communication is performed through low-power wireless technology (Bluetooth) between the stethoscope and a personal computer. Among the selected articles, 16 works mention the use of Bluetooth (IDs = 1, 3, 4, 6, 9, 14, 21, 22, 31, 35, 36, 38, 41, 44, 46, 51).
Thiyagaraja et al. [
76] (44) presented a detailed description of a smartphone-based electronic stethoscope that can record, process, and identify 16 types of heart sounds. According to the authors, the solution proposed is portable, low cost, and does not require a highly trained user to operate. The model includes the use of machine learning algorithms.
Ren et al. [
40] (2) used convolutional neural networks (CNN) (19 articles cite CNN, IDs = 1, 2, 10, 19, 23, 31, 32, 33, 39, 41, 43, 46, 47, 49, 51, 52, 54, 55, 58) for classification of PCG scale images for the task of classifying cardiac sounds between normal and abnormal. PCG signal representations were obtained by dataset from: Massachusetts Institute of Technology (MIT), Aalborg University, Aristotle University of Thessaloniki, University of Haute Alsace, Dalian University of Technology, and Shiraz University. The toolbox wavelet of Matlab 2017 performs the generation of scaleogram images in cardiac sounds.
Liu et al. [
75] (42) created a database with free/open access to heart sounds so researchers could use it as a dataset in ML algorithms. They reported that the area of cardiac auscultation had been widely studied due to the high potential to detect pathology in clinical applications accurately. However, comparative analyses of algorithms in the literature were hampered by the lack of quality open databases rigorously validated and standardized with cardiac sound records.
3.5. FQ2—What Methods Are Used to Predict Cardiovascular Diseases?
Du et al. [
69] (34) demonstrated the use of big data, statistical methods, and machine learning methods through electronic health records. Because health records have nonlinear characteristics, the authors created a CVD development risk score and tested machine learning algorithms such as Extreme Gradient Boosting (XGBoost), Logistic Regression, Decision Tree, k-Nearest Neighbors (KNN), Random Forest, Missing Data, and Support Vector Machine (SVM). They achieved better accuracy indexes with extreme gradient boosting nonlinear algorithms.
Shuvo et al. [
68] (32) proposed the model called CardioXNet, which contemplated the detection of five classes of patterns in the classification of bullies, such as normal, aortic snoosis, mitral snoosis, mitral regurgitation, and mitral valve prolapse. The classification was obtained through the DL method, using CNN architectures, Pre-trained Unsupervised Networks (UPNs) and Recurrent and Recursive Neural Networks (RNNs).
According to Brunese et al. [
85] (53), every 37 s a person loses his life due to CVD. The authors implemented a model that proposed the automatic detection as a first level screening, using DL algorithms for interpretation of cardiac sounds. The model makes use of a smartphone with an iStethoscope Pro application.
Maritsch et al. [
39] (1) described physiological reactions of the human body to external stimuli, such as emotional stress and physical activities, which tend to interfere with heart rate. Monitoring these variations in physiological signals, through a smartwatch device, and then using ML algorithms, analyzing the context of the individual, can serve as a method for cadiovascular health camp.
Humayun et al. [
25] (31) proposed a method to detect abnormalities by auscultation of cardiac sounds provided by the PPG signal.The authors proposed the CNN architecture composed of convolutional time units (tConv), with the objective of emulate the finite impulse response (FIR) filters. The digital filters process an input sequence, converting this continuous time signal to a filtered representation of the signal through a mathematical function.
Chowdhury et al. [
26] (35) used algorithms with statistical methods to apply the classification model of normal and abnormal signals of heart leaflets. The PhysioNet- 2016 dataset was used to calibrate the KNN algorithm in the accuracy of the classification.
According to Balakrishnand et al. [
83] (51), heart rate monitoring can play an important role in predicting diseases with the highest death rate on the planet. The authors proposed to perform monitoring through low-cost wearable devices, Cloud Computing (providing scalability and reliability to the model) and integration with ML algorithms, and also using statistical algorithms of linear regression.
Ukil et al. [
32] (43) cited remote and automated health care management as a robust model, which will impact future rates of cardiovascular pathologic prognoses. The work is based on training obtained by a public data set of MIT-Physionet, with the objective of analyzing the PCG, integrated with an IoT architecture and with ML and CNN algorithms. The model presented accuracy greater than 85 % in its predictions.
According to Amiri et al. [
73] (40), one of the most challenging tasks is to perform heart assessment in newborns through PCG. This affirmation is justified due to the difficulty in extracting physiological characteristics of the signal obtained from newborns. In the study, the method of classification between healthy and pathologies cardiac sounds was used. It achieved 92.2% accuracy with the use of SVM algorithms, including an infrastructure containing minimally a digital stethoscope connected to a mobile device and a cloud server with intelligent services.
Gómez-Quintana et al. [
80] (48) reported that congenital heart diseases (CCDs), originating due to heart malformation, affect a certain of 1% of newborns and are responsible for 3% of all deaths of children. CVD are usually detected by ultrasound examination between the 12th and 16th weeks of gestation. The authors’ work aimed to develop a tool to assist clinical decision-making based on machine learning with the XGBoost algorithm. After the analysis of the model, they concluded through a comparison of the level of accuracy of the model to an experienced neonatologist with the same cohort.
Chorba et al. [
81] (49) affirmed that due to the heterogeneity in the interpretative capacity of medical professionals to detect pathological characteristics during cardiac auscultation, they presented a computational approach as a promising alternative to assist in the diagnosis of pathologies in the medical area through auscultation. The authors proposed the use of DL algorithms with CNN architecture, using the last layer to normalize probability distribution through a softmax function as a goal of detecting murmurss and valvulopathy. The training was conducted through the physionet public dataset.
According to Tiwari et al. [
27] (33), PCG represent the sign of the bullies produced by the mechanical action of the heart in the cardiac cycle. The authors showed interest in producing work with PCG use due to the low cost because it is not an invasive method and due to the possibility of easy adaptation for remote use via signal recording by a smartphone. Therefore, they proposed an architecture using CNN and Q transforms for heart rate classification.
Swarup and Makaryus [
71] (38) evidenced that the auscultation of cardiac sounds is a low-cost and effective method for diagnosing CVD. An analysis of sound characteristics was implemented by the Fourier transform and neural network algorithm.
3.9. SQ3—Which Articles Address Primary Health Care and Focus on Low-Cost Proposals?
Few countries have a universal public health system. Perhaps for this reason no article used as reference the term primary health care, regularly called in Brazil as Unified Health System (SUS). The term cited in the articles for the use of intelligent equipment and services is related to the screening of patient care centers.
In Brazil, primary health care is related to the first care of users in the single health system. The main objectives are to guide on disease prevention, help in possible cases of public or individual health problems and direct the most severe to higher levels of care, functioning as a filter to organize the flow of the most complex and costly services to the public health network.
The term filter in the previous paragraph should be understood as screening, carried out with the use of intelligent devices of low financial cost to assist in the referral and meassures to patients in substitution for more sophisticated and costly exams.
Among the 58 articles selected, 30 works (51.72%, IDs = 1, 3, 4, 5, 6, 7, 9, 10, 13, 15, 19, 20, 23, 27, 29, 30, 31, 32, 33, 35, 36, 41, 44, 46, 48, 49, 50, 51, 52, 58) inform the possibility of using low-cost devices to assist in screening more sophisticated tests for the finding of a cardiac disjunction.
Maritsch et al. [
16] (1) reported the world population’s increased use of smartwatches for cardiac monitoring. Frank and Meng [
42] (4), Szot et al. [
44] (6) and Waqar et al. [
41] (3) proposed the creation of low-cost digital stethoscopes based on Arduino. The articles of the cited authors present the use of low-cost devices to monitor and support the analysis of signals produced by the human heart.
Fattah et al. [
43] (5) proposed a low-cost digital stethoscope for remote monitoring and the use of machine learning algorithms. The use of this equipment is primarily intended for personnel monitoring in hard-to-reach locations.
Sinharay et al. [
45] (7) presented a similar proposal, however they tried to adapt a low-cost sensor to a smartphone to leave the equipment with similar operation to the stethoscope, assisting patients with locomotion difficulties, elderly, newly operated, thinking of developing countries with low fluidity of public transport.
Gradl et al. [
52] (14) implemented a model using virtual reality. The experiment was carried out with the immersion of 14 participants in environments that could cause behavioral changes, being possible their real-time visualization of cardiac activity using wearable sensors and smartphones.
Articles that present smart stethoscope designs with bluetooth communication ([
48] (10)), cloud signal storage (14 articles, IDs = 5, 19, 32, 36, 40, 41, 43, 44, 46, 48, 49, 51, 55, 56), in order to improve signal amplification ([
55] (17)), using signal processing by MatLab ([
56] (18)), enabling solutions via ubiquitous computing ([
71] (38), [
76] (44)).