Next Article in Journal
Evaluation and Prediction of Ecological Sustainability in the Upper Reaches of the Yellow River Based on Improved Three-Dimensional Ecological Footprint Model
Next Article in Special Issue
A Collector Deceives—About the Ways of Deceiving Women by Men and Men by Women as far as Spending Money on Collecting Items Is Concerned
Previous Article in Journal
Increasing Access to Care for the Underserved: Voices of Riders, Drivers, & Staff of a Rural Transportation Program
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Correlations between Problematic Mobile Phone Use and Depressiveness and Daytime Sleepiness, as Well as Perceived Social Support in Adolescents

by
Marta Nowak
1,
Kamila Rachubińska
1,*,
Małgorzata Starczewska
1,
Ewa Kupcewicz
2,
Aleksandra Szylińska
3,
Aneta Cymbaluk-Płoska
4 and
Elżbieta Grochans
1
1
Department of Nursing, Faculty of Health Sciences, Pomeranian Medical University, Żołnierska 48, 71-210 Szczecin, Poland
2
Department of Nursing, Collegium Medicum, University of Warmia and Mazury in Olsztyn, 14 C Zolnierska Street, 10-719 Olsztyn, Poland
3
Department of Medical Rehabilitation and Clinical Physiotherapy, Pomeranian Medical University, Żołnierska 54, 71-210 Szczecin, Poland
4
Department of Gynecological Surgery and Gynecological Oncology of Adults and Adolescents, Pomeranian Medical University, 70-111 Szczecin, Poland
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2022, 19(20), 13549; https://doi.org/10.3390/ijerph192013549
Submission received: 4 August 2022 / Revised: 10 October 2022 / Accepted: 17 October 2022 / Published: 19 October 2022
(This article belongs to the Special Issue Addiction Behavior)

Abstract

:
(1) The aim of this study was to estimate the scale of mobile phone addiction among young adults as well as to establish whether the low level of perceived social support is related to problematic smartphone use, and whether an addictive pattern of mobile phone use is related to the prevalence of depressiveness and excessive daytime sleepiness. (2) The study was carried out using the diagnostic poll method via the questionnaire technique. Both the author’s own questionnaire and the following standardized research tools were used: the Mobile Phone Problem Use Scale for Adolescents (MPPUSA), the Beck Depression Inventory (BDI), the Epworth Sleepiness Scale (ESS), and the Multidimensional Scale of Perceived Social Support (MSPSS). (3) Perceived social support was significantly lower in the group of respondents who problematically used their mobile phones in comparison with the ones who used them in a proper way. Severity of depressive symptoms and daytime sleepiness was significantly higher in respondents addicted to their mobiles compared to nonaddicted ones. (4) Conclusions: An important correlation between phone addiction and the prevalence of depressive symptoms and excessive daytime sleepiness exists. Problematic mobile phone use concerns individuals with low levels of perceived social support.

1. Introduction

This paper is organized into six sections. Section 1 presents the theoretical foundation of the studied phenomenon of smartphone addiction. Section 2 presents the study design, the methods used, and the description of the statistical analysis. The description of the study results and their graphical illustration in the form of tables are presented in Section 3. Section 4 discusses the results of the study, which were compared with the results of different researchers. The limitations of the study are presented in Section 5, while conclusions and proposals for future work are discussed in Section 6.
The first invented telephone, patented in 1986, differed radically not only in appearance, but above all in the multitude of functions offered in relation to currently available smartphones. Even comparing the first prototype of a mobile phone from the 1960s to the latest models, one can observe a huge technological progress and the expansion of the possibilities offered, which integrally permeate human functioning in many aspects of everyday life. Basic applications such as the ability to make calls and write text messages, combined with the advanced capabilities offered by applications (social media, health management, finances) made the number of smartphone users in 2016 (3.7 billion) almost double in 2021 (6.3 billion), and according to forecasts, in the next five years this number will increase by several hundred million [1].
In recent decades, the increased use of a mobile phone has become associated with problematic mobile phone use (PMPU), which translates into worse functioning in terms of somatic and mental health [2], as well as a reduced quality of life level (QOL) and health-related quality of life (HRQOL) [3,4,5].
The phenomenon of addiction to a mobile phone, although classified as a behavioral addiction, has an unspecified nosological position and has no clear definition. The 2013 Diagnostic and Statistical Manual of Mental Disorders DSM-5 identified gambling disorder as the only behavioral addiction in the non-substance-use disorder category. Moreover, in the International Statistical Classification of Diseases and Health Problems ICD-11, in the category of mental, behavioral, or neurodevelopmental disorders and the subcategory of disorders resulting from addictive behavior, only gambling disorder (both online and offline) was distinguished. Problematic mobile phone use has been defined, partly, as a potential behavioral addiction through the use of mobile phones or smartphones. PMPU can cause issues for users when enacted as an excessive form of relationship maintenance or in banned or dangerous situations during addictive use [6,7].
Significant symptoms of PMPU include nomophobia, phantom phone signals, and phubbing. Nomophobia is an abbreviation of a phrase “no mobile phone” and is defined as the fear of being detached from one’s mobile phone. The phenomenon manifests as a feeling of discomfort, anxiety, nervousness and fear, frustration, or even aggression, depending on the level of risk of the inability to use the phone, or on the duration of the separation [8,9]. Phantom phone signals refer to phantom vibration (PV) and phantom ringing (PR) of the mobile phone. The essence of the phenomenon lies in experiencing individual vibrations, hearing their phone ring or seeing the phone light up when it does not actually take place [10]. The term phubbing is a neologism resulting from the combination of the words phone and snubbing and refers to the disregard of the interlocutor in the social environment for the benefit of using a mobile phone. It has been observed that phubbing behavior is a common phenomenon among adolescents (49.3%) and is closely related to both the problematic use of the Internet and phones [11,12,13].

1.1. Controversy around a Behavioral Addiction

Opponents of the phrase “behavioral addiction” believe that it is stigmatizing and pathologizing behavior within the normal limits, which is a natural result of continuous technological progress. Researchers also point out that the analysis and definition of behavioral addictions should take into account not only the sociocultural context, but also the professional or university context, so as to avoid misinterpretation of data. As an example of the importance of sociocultural determinants, we can mention Asian countries, whose moral standards translate into increased use of a mobile phone. A critical approach is also shown in connection with the permanent supplementation of the group of behavioral addictions with newer and newer phenomena, which in consequence are incomparable with other behavioral addictions, and even more so with substance addictions [14,15].
According to the opponents, such a multidirectional expansion of behavioral addictions, we can also put the credibility and significance of this category at stake. The reason for this phenomenon is, inter alia, the deficit of a thorough framework and theoretical foundations, which in turn translates into a lack of consistency in the terminology used, and in the methodology of conducting research. In line with the idea of Clark and Watson, which says that “a good theory expresses not only what a construct is, but also what it is not”, researchers dealing with the phenomenon of smartphone addiction have distinguished a definition and exclusion criteria relating to the described phenomenon. Working criteria, proposed by researchers of interdisciplinary fields, constitute a specific starting point for the development of this area of science and can be used in the diagnosis of addictions in particular, minimizing false-positive results [16,17].

1.2. Background

1.2.1. Factors of Problematic Smartphone Use

The basis of behavioral addictions, including PMPU, is complex and unclear. The complexity results from the number of theories trying to explain the etiology of the phenomenon and the ambiguity from insufficient understanding and inability to explain its mechanisms. Currently, the following factors are listed as the underlying determinants: biogenetical, psychological, and sociocultural, which together create a biopsychosocial model of a behavioral addictions [18].
Biological and genetic factors relate primarily to the reward system and the neurotransmitter—dopamine. The physiological significance of the reward system is the secretion of dopamine as a result of taking actions of significant biological importance. It is possible to activate the reward system as a result of taking actions that are not of fundamental biological importance—for example, using social networking sites via a mobile phone or shopping leads to immediate gratification, increasing the level of dopamine and the functioning of the reward system. It should be noted that the body’s reaction to rewarding and stressful factors is an individual trait, associated with genetic and environmental determinants, as well as with the individual structure of the dopaminergic system. For example, the male sex is characterized by a higher basic activity of the discussed system, but lower reactivity to natural stimuli and psychoactive substances in relation to the females. Age is also an important issue influencing the functioning of the reward system. Puberty is a special stage during which many changes are happening in the way the brain works. The increased activation of the reward system occurring at that time and the simultaneous suppression of the systems regulating it lead to risky behaviors by young adults. Such behaviors include, inter alia, problematic use of a mobile phone or the Internet [19,20,21].
Among sociocultural factors, one can distinguish the continuous technological progress that causes a whole array of global consequences. The universal development of electronics infrastructure and simultaneous societal preoccupation with online life have both contributed to the occurrence of FOMO (fear of missing out). The idea behind this is that experiencing anxiety as a result of not being able to participate in online activities, especially those involving the current publication of content by other users. The pressure to continuously follow information on different social platforms and apps leads to an uncontrollable functioning on the Internet, hence the use of cellular phones [22,23].

1.2.2. Implications of Problematic Mobile Phone Use

Consequences of the PMPU accessed via mobile phone might be divided into three categories that include somatic, mental, and social spheres of human life. The somatic sphere regards the wide range of disorders that include problems with sight and hearing, headaches and vertigo, tinnitus, carpal tunnel syndrome, and sleep disorders leading to disturbances of circadian rhythm, as well as chronic fatigue syndrome and—characteristically for smartphone users—text neck syndrome and SMS thumb due to repetitive use of handheld devices [24,25,26]. Belonging to an internet community that shows many forms of virtual pathology and generates new, artificial trends also favors the development of mental implications, which include lowered mental immunity, emotional lability, increased depressiveness, aggression, inadequate self-esteem, lowered self-value, and personality disorders [27,28].
Implications regarding the social sphere are above all related to the gradual alienation from the closest environment as a result of preoccupation with the subject of dependance. Those consequences include deterioration of social relations and loss of interpersonal skills and former interests, as well as the minimization of contact with closest ones, which lead to the sense of social isolation and loneliness [29]. On the other hand, loneliness, anxiety (including social anxiety), and depression constituting internalizing symptoms are considered not only consequences, but also important factors in the development and severity of behavioral addictions [30,31,32]. Thus, people with a high level of neuroticism characterized by an increased tendency to experience negative emotions and feelings—sadness, regret, envy, jealousy, anxiety—are more susceptible to behavioral addictions [33,34,35].
The described group of implications also refers to financial problems that are generated by the growing needs related to the growing use of a mobile phone and the desire to have more and more modern models. The problematic use of the above-mentioned technologies may also contribute to the legal consequences related to improper compliance with the law in the internet sphere. The research results also emphasize the correlation between the risky use of smartphones and the creation of dangers in the public environment, especially among pedestrians staring at the smartphone screen [36,37].

1.3. Aim of the Study

The aim of this study was to estimate the scale of problematic mobile phone use among young adults and to demonstrate whether negative effects such as low level of social support, increased depressiveness, and daytime sleepiness are significantly related to this phenomenon.

2. Materials and Methods

2.1. Setting and Design

The study included 567 respondents: students, graduates, and senior high school students from two cities—Koszalin and Szczecin. The study was a part of a major project. The study inclusion criteria were as follows: age above 18 and below 29 years; and providing informed consent for the participation in the study. The exclusion criteria were: lack of consent for the participation in the study as well as the age below 18 and above 29 years. Respondents received written information regarding the aim of the study as well as the possibility to withdraw consent at any stage of the study. The study was carried out in accordance with the Declaration of Helsinki and was approved by the Bioethical Commission of Pomeranian Medical University in Szczecin.

2.2. Research Instrument

The study was carried out using the diagnostic poll method via questionnaire technique. In the study, author’s own questionnaire form regarding sociodemographic data (sex, age, professional activity, place of residence, and marital status) as well as the following standardized research tools were used.
We used the Polish adaptation of the Mobile Phone Problem Use Scale for Adolescents (MPPUSA) by O. Lopez-Fernandez, L. Honrubia-Serrano, M. Freixa-Blanxart, and W. Gibson. The tool consists of three subscales. The first is referring to the level of mobile phone dominance over the other aspects of an individual’s life. The second one deals with the severity of preoccupation with its use, and the third one relates to the dimension of addiction and dependency on a smartphone. A respondent uses a 10-point scale where “1” stands for “not true at all” and “10” for “extremely true”. The range of results varies between 26 and 260 points and the obtained results are assigned to one of the four categories. The first category includes scores between 26 and 29 points and identifies individuals who occasionally use their mobile phones. The second group includes scores from 30 to 130 points and indicates a non-problem use of smartphones. The third category contains scores from 131 to 166 points and signalizes risk of problematic use of a mobile phone, whereas the fourth group, presence of mobile phone (dependence) problem use, is scored between 167 and 260 points [38].
We also used the Polish adaptation of The Multidimensional Scale of Perceived Social Support (MSPSS) by G. Zimet et al. The questionnaire consists of twelve statements that are related to the subjectively experienced social support by a surveyed individual from: significant others, family, and friends. The scores vary between 1 and 7 points, where results from 1 to 2.9 indicate low support, scores between 3 and 5 points indicate average support, and scores from 5.1 to 7 points are identified as high social support [39,40].
In addition, we used the Beck Depression Inventory (BDI) by A. T. Beck, R. A. Steer, and G. K. Brown in its Polish adaptation. The inventory consists of 21 positions regarding specific symptoms of depression, to which the surveyed person responds by choosing one of the four possible answers. The obtained score is a sum of points corresponding with the respondent’s answers and is assigned to one of the four following point categories: 0–11, lack of depression; 12–26, mild depression; 27–49, moderate depression; 50–63, severe depression [41,42].
The Epworth Sleepiness Scale is a questionnaire that subjectively assesses the likelihood of falling asleep during eight daily activities. The results between 0 and 9 points show regular daytime sleepiness, 10–14 indicate excessive daytime sleepiness, and scores above 14 are identified as pathological daytime sleepiness [43,44].

2.3. Statistical Analysis

The data gathered during the research process were collected in a Microsoft Office Excel spreadsheet. The statistical analysis was carried out using the R program, version 3.6.2. The analysis of quantitative variables was performed by calculating the mean, standard deviation, median, quartiles, and minimum and maximum. To evaluate the normality of distribution of the studied variables, we used the Shapiro–Wilk test. The Shapiro–Wilk test is a test of normality in frequentist statistics. The analysis of qualitative data was conducted by calculating the number and percentage of occurrences for each value. The comparison of qualitative variables in two groups was carried out with Mann–Whitney U test while the comparison in three or more groups was carried out with Kruskal–Wallis test, and in case of statistically significant differences, a post hoc analysis with Dunn’s test was conducted in order to identify groups that varied in a statistically significant way. The Mann–Whitney U test is a nonparametric test of the null hypothesis where, for randomly selected values X and Y from two populations, the probability of X being greater than Y is equal to the probability of Y being greater than X. The Kruskal–Wallis test is a nonparametric method for testing whether samples originate from the same distribution. It is used for comparing two or more independent samples of equal or different sample sizes. It extends the Mann–Whitney U test, which is used for comparing only two groups. The relationship between the analyzed parameters was evaluated using the analysis of the logistic regression model. The multivariable logistic regression was corrected for potentially distorting data (age, gender, education). The results of regression were presented with the value of the OR with 95% confidence intervals and the statistical significance value. The statistical significance level was set at 0.05; thus, all the p values below 0.05 were interpreted as significant [45,46].

3. Results

3.1. Characteristics of the Respondents

The study included 567 individuals, 305 of which were women (53.97%). Age of respondents varied between 18 and 29 years and was 20.53 years on average (SD = 2.78). The majority of respondents had primary education—250 of those surveyed (44.09%). Most respondents were single—311 individuals (54.85%). The largest group consisted of surveyed who lived in cities with more than 100 thousand residents—218 respondents (38.45%). The structure of professional activity showed that 351 respondents (61.90%) were unemployed and studying.
The analysis of the MPUSA regarding mobile phone use showed that 34 individuals (6%) displayed presence of mobile phone (dependence) problem use, 74 respondents (13.05%) were at risk of problematic use, while for 455 persons (80.25%) using a mobile phone was not a problem. Respondents who occasionally used their mobile phone included 4 people (0.7%).

3.2. Assessment of Correlation between Mobile Phone Use and Social Support, Severity of Depressiveness and Daytime Sleepiness among Respondents

The data analysis showed a statistically significant relationship between using mobile phones by the surveyed person according to the MPPUSA and their perceived social support according to the MSPSS (p < 0.05). It has been proven that individuals who used their phones correctly were characterized with greater support from acquaintances (p = 0.007 A > C) and a higher general level of support (p = 0.034 A > C) than ones who pathologically used their mobiles (Table 1).
The analysis of the data showed no significant relationship (p > 0.05) between sex, professional activity, or place of residence, as well as marital status and the prevalence of risky and problematic patterns of mobile phone use.
Data analysis also showed a significant correlation between problematic mobile phone use and being at the risk of such a thing and the severity of symptoms of depression and daytime sleepiness (p < 0.05). It has been established that symptoms of depression (p < 0.001 C,B > A) as well as excessive daytime sleepiness (p < 0.001 B,C > A) were much more common in respondents who presented problematic mobile phone use or were at risk of problematic use in comparison with ones who presented nonproblematic mobile phone use group. (Table 2).
Univariate and multivariate regression analysis were performed. The results are presented in Table 3. A statistically significant relationship was demonstrated between telephone abuse and an increase in the BDI score (OR = 1.032, p <0.001), mild depression (OR = 2.322, p = 0.001), and moderate depression (OR = 2.269, p = 0.009); and on the ESS scale (OR = 1.096, p <0.001), excessive somnolence (OR = 1.939, p = 0.005) and pathological daytime sleepiness (OR = 2.886, p = 0.002).

4. Discussion

The results of our own studies showed that the problem of mobile phone addiction concerned 6% of respondents. The mobile phone or smartphone is a modern accessory, the long-term use of which is conditioned by the multitude of available functions, which, through access to the internet, enable implementation not only in the entertainment area, but also in the professional, social, or scientific and information areas. The results of this study are consistent with the study results of other authors who also identified a minimal phenomenon of problematic mobile phone use, ranging from 1% to 7.5% [46,47,48,49].
A significantly higher percentage of people addicted to mobile phones, in relation to the result obtained in the course of this study, was obtained by authors researching Asian countries, whose cultural norms, as in the case of problematic internet use, clearly translate into increased phone use [50,51,52]. As probable causes of the discrepancies in the results, apart from sociocultural differences, we should mention methodological inconsistencies. Different tools were used in selected works. The issue of setting limit values in the standardized research tools used is also problematic. Researchers repeatedly declare a change in the limit values in the tools used, because the values adopted by the author would result in overrecognition of the studied phenomena. Therefore, it is confirmed by the fact of methodological inconsistency and it is difficult to compare different research results.
As far as the analysis of pattern of mobile phone use is concerned, no sociodemographic variable was linked with the pathologic use. However, it is worth mentioning that both women and men were addicted to using the internet and smartphone or were at risk of developing problematic patterns of use to the same degree. This result complies with the results obtained in studies by other authors. An analysis of the pattern of smartphone use among 1441 students at medical universities in China established that within the age range, phone addiction concerned 29.3% of women and 30.3% of men. The authors used a different tool than this study—the SAS-SV form—and adopted separate cut-off points for both sexes—31 points for men and 32 for women [53]. Another study included medical students from India and used the SAS-SV in order to analyze their patterns of mobile phone use with different cut-off points for both sexes. Its results showed that 45.45% of women and 57.87% of men were addicted to mobile phones [54]. Furthermore, a subjective sense of addiction was expressed by 49.23% of respondents. For reference, 34.22% of participants in this study considered themselves dependent [55]. It is also worth noting that the frequency of mobile phone use by the surveyed and their subjective sense of being addicted was much greater than the percentage of addicted individuals. Thus, long-term use of a given device should not be unequivocally identified as an addiction since, in principle, it does not only refer to the time that an individual spends using it but also to their relationship with the given device.
Our own research has shown a relationship between phone abuse and the occurrence of mild and moderate depression symptoms.
The results of this study have also demonstrated that respondents with problematic mobile phone use more frequently presented with severe depressiveness compared to the nonaddicted individuals. Other authors also analyzed the relationship between PMPU and symptoms of depression, which showed that addicted individuals much more frequently were characterized with symptoms of depression and loneliness in comparison with those who were not dependent on their phones [56,57]. An analysis of the link between smartphone addiction and depressiveness with a different research tool than in this study—the Depression Anxiety Stress Scale (DASS)—has also confirmed the presence of the described correlation. Phone-addicted individuals significantly more often showed increased depressiveness, as well as being characterized with severe anxiety and—a phenomenon specific for smartphone users—FOMO [58].
Our own research has shown a relationship between phone abuse and the occurrence of excessive sleepiness and pathological daytime sleepiness. The results of the author’s own studies identified more frequent excessive daytime sleepiness in the group of individuals who used their mobile phones pathologically. Corresponding results were obtained in two independent studies which analyzed the phonoholism phenomenon and the prevalence of sleep disorders among adolescents from Thailand and Hongkong. Authors of both studies used the same study tool as this paper—the Epworth Sleepiness Scale (ESS)—and established that individuals dependent on smartphones showed excessive daytime sleepiness more frequently than nonaddicted ones. Other authors also suggested that smartphone addiction is associated with adolescents’ poor sleep quality. It is believed that an underlying cause of sleep disorders is exposure to blue light, which is emitted by electronic devices, above all smartphones. Evening exposure to blue light reduces melatonin production—the sleep hormone that is associated with the physiological circadian rhythm—in effect causing delayed falling asleep as well as prolonged standby time [59,60,61,62,63].
Social support from parents and family but also from friends and peers is closely associated with problematic smartphone use in adolescents and young adults [64]. Other authors who researched PMPU and analyzed its relationship with perceived social support, with the same study tool as the following study, obtained similar results. A study on 1149 nursing students showed that persons who problematically used their phones had lower support from family, friends, and significant others in comparison with respondents who used their phones in proper way [65]. The study on a group of 494 Turkish students showed, however, that respondents’ PMPU was characterized with lower social support (according to the MSPSS) compared with the surveyed who were not addicted. In comparison, the author’s own studies showed that phone addicts had lower general social support as well as lower social support from acquaintances compared to non-addicts. The authors also demonstrated that individuals’ problematic mobile phone or smartphone use, besides low subjectively perceived social support, was also characterized with greater loneliness and social phobia, which translated into increased smartphone use [66,67].

5. Limitations

The digressions described in this study dictated certain limitations and implications for the professional practice. Problematic mobile phone use creates an important relationship between the severe symptoms of depressiveness and excessive daytime sleepiness. The pathologic pattern of phone use more frequently concerns individuals whose social support level is low. Obtained results might be useful in planning prophylactic measures and matching interventional strategies in order to minimize phone use among young adults. The main advantages of this study are research tools that were used since they were also used in the majority of studies, results of which were compared to the results of this study. An additional asset of this study is the fact that groups of both gender representatives were almost equal, which reduces the risk of biased results, which contributes to the quality and credibility of the study. The presented studies also have their disadvantages, including the number of respondents, which does not constitute a representative number for the age group that was the subject of this study. The participants filled out the questionnaire forms themselves by carrying out a self-assessment and choosing answers that resembled the reality as closely as possible. The described technique carries a risk of obtaining false answers because of conscious or subconscious answer manipulation, which increases with the level of knowledge on the subject of the study. The study did not take into account the tools that allow for the selection of people with ADHD, autism spectrum disorder, etc., among the respondents, which is another limitation of our study. The described disadvantages, however, do not disqualify the results of this study since each of the cited studies used the same methods and techniques.

6. Conclusions

The scale of the problematic mobile phone use phenomenon in respondents was low. Many respondents, however, expressed a subjective sense of being addicted to their smartphones in comparison with the obtained results. Problematic mobile phone use concerns members of both sexes, residents of villages and cities, as well as single people and those in relationships (both formal and informal) to the same degree. Mobile phone addiction is associated with the risk of severe symptoms of depression and excessive daytime sleepiness. Problematic mobile phone use much more frequently concerns individuals who perceive their social support level as low. The obtained results might prove useful in planning prophylactic measures and matching interventional strategies in order to minimize mobile phone and smartphone use among young adults. This study provides important findings and can provide a starting point for wider research into the concerned issues and area.

Author Contributions

Conceptualization, M.N. and E.G.; methodology, M.N.; software, K.R.; validation, E.K. and M.S.; formal analysis, E.G., A.S. and A.C.-P.; investigation, M.N.; resources, E.K.; data curation, M.N.; writing—original draft preparation, M.N.; writing—review and editing, K.R.; visualization, M.S.; supervision, K.R.; project administration, E.G.; funding acquisition, M.S. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki and approved by the Ethics Committee of Pomeranian Medical University in Szczecin KB-0012/46/01/2013.

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

Not applicable.

Acknowledgments

We thank all participants for their participation and all the staff of the survey team for their efforts that made this study possible.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Statista Research Department. Number of Smartphone Subscriptions Worldwide from 2016 to 2021 with Forecasts from 2022 to 2027. Available online: https://www.statista.com/statistics/330695/number-of-smartphone-users-worldwide/ (accessed on 6 October 2022).
  2. Ratan, Z.A.; Parrish, A.M.; Zaman, S.B.; Alotaibi, M.S.; Hosseinzadeh, H. Smartphone Addiction and Associated Health Outcomes in Adult Populations: A Systematic Review. Int. J. Environ. Res. Public Health 2021, 18, 12257. [Google Scholar] [CrossRef] [PubMed]
  3. Pearson, A.D.; Young, C.M.; Shank, F.; Neighbors, C. Flow mediates the relationship between problematic smartphone use and satisfaction with life among college students. J. Am. Coll. Health 2021, 1–9. [Google Scholar] [CrossRef]
  4. Buctot, D.B.; Kim, N.; Kim, J.J. Factors associated with smartphone addiction prevalence and its predictive capacity for health-related quality of life among Filipino adolescents. Child. Youth Serv. Rev. 2020, 110, 104758. [Google Scholar] [CrossRef]
  5. Masaeli, N.; Billieux, J. Is Problematic Internet and Smartphone Use Related to Poorer Quality of Life? A Systematic Review of Available Evidence and Assessment Strategies. Curr. Addict. Rep. 2022, 9, 235–250. [Google Scholar] [CrossRef]
  6. American Psychiatric Association (APA). DSM-V Diagnostic and Statistical Manual of Mental Disorders, 5th ed.; American Psychi-atric Association: Washington, DC, USA, 2013; Available online: https://psychiatry.org/psychiatrists/practice/dsm (accessed on 16 September 2022).
  7. Reed, G.M.; First, M.B.; Kogan, C.S.; Hyman, S.E.; Gureje, O.; Gaebel, W.; Maj, M.; Stein, D.J.; Maercker, A.; Tyrer, P.; et al. Innovations and changes in the ICD-11 classification of mental, behavioural and neurodevelopmental disorders. World Psychiatry 2019, 18, 3–19. [Google Scholar] [CrossRef] [Green Version]
  8. Olivencia-Carrión, M.A.; Ferri-García, R.; del Mar Rueda, M.; Jiménez-Torres, M.G.; López-Torrecillas, F. Temperament and characteristics related to nomophobia. Psychiatry Res. 2018, 266, 5–10. [Google Scholar] [CrossRef] [PubMed]
  9. Czerski, W. Nomofobia-szczególnie groźna odmiana uzależnienia od telefonu komórkowego. Eduk.–Tech.–Inform. 2018, 3, 212–217. [Google Scholar] [CrossRef]
  10. Pisano, S.; Muratori, P.; Senese, V.P.; Gorga, C.; Siciliano, M.; Carotenuto, M.; Iuliano, R.; Bravaccio, C.; Signoriello, S.; Gritti, A.; et al. Phantom Phone Signals in youths: Prevalence, correlates and relation to psychopathology. PLoS ONE 2019, 14, e0210095. [Google Scholar] [CrossRef] [Green Version]
  11. Rahman, M.A.; Duradoni, M.; Guazzini, A. Identification and prediction of phubbing behavior: A data-driven approach. Neural Comput. Appl. 2022, 34, 3885–3894. [Google Scholar] [CrossRef]
  12. Guazzini, A.; Duradoni, M.; Capelli, A.; Meringolo, P. An Explorative Model to Assess Individuals’ Phubbing Risk. Future Internet 2019, 11, 21. [Google Scholar] [CrossRef]
  13. Davey, S.; Davey, A.; Raghav, S.K.; Singh, J.V.; Singh, N.; Blachnio, A.; Przepiórkaa, A. Predictors and consequences of “Phubbing” among adolescents and youth in India: An impact evaluation study. J. Fam. Community Med. 2018, 25, 35. [Google Scholar]
  14. Petry, N.M.; Zajac, K.; Ginley, M.K. Behavioral Addictions as Mental Disorders: To Be or Not To Be? Annu. Rev. Clin. Psychol. 2018, 14, 399–423. [Google Scholar] [CrossRef] [PubMed]
  15. Panova, T.; Carbonell, X. Is smartphone addiction really an addiction? J. Behav. Addict. 2018, 7, 252–259. [Google Scholar] [CrossRef] [PubMed]
  16. Kardefelt-Winther, D.; Heeren, A.; Schimmenti, A.; van Rooij, A.; Maurage, P.; Carras, M.; Edman, J.; Blaszczynski, A.; Khazaal, Y.; Billieux, J.; et al. How can we conceptualize behavioral addiction without pathologizing common behaviors? Addiction 2017, 112, 1709–1715. [Google Scholar] [CrossRef]
  17. Lin, Y.H.; Chiang, C.L.; Lin, P.H.; Chang, L.R.; Ko, C.H.; Lee, Y.H.; Lin, S.H. Proposed Diagnostic Criteria for Smartphone Addiction. PLoS ONE 2016, 11, e0163010. [Google Scholar] [CrossRef] [Green Version]
  18. Rowicka, M. Uzależnienia Behawioralne-Terapia i Profilaktyka; Krajowe Biuro do Spraw Przeciwdziałania Narkomanii: Warszawa, Poland, 2015. [Google Scholar]
  19. Gryz, M.; Lehner, M.; Wisłowska-Stanek, A.; Płaźnik, A. Funkcjonowanie układu dopaminergicznego w warunkach stresu—Poszukiwanie podstaw różnic indywidualnych, badania przedkliniczne. Psychiatr. Pol. 2018, 52, 459–470. [Google Scholar] [CrossRef]
  20. Moal, M.L. Individual vulnerabilities relative for potential pathological conditions. Brain Res. 2016, 1645, 65–67. [Google Scholar] [CrossRef]
  21. Poon, J.A.; Thompson, J.C.; Forbes, E.E.; Chaplin, T.M. Adolescents’ Reward-related Neural Activation: Links to Thoughts of Nonsuicidal Self-Injury. Suicide Life-Threat. Behav. 2019, 49, 76–89. [Google Scholar] [CrossRef] [Green Version]
  22. Dempsey, A.E.; O’Brien, K.D.; Tiamiyu, M.F.; Elhai, J.D. Fear of missing out (FoMO) and rumination mediate relations between social anxiety and problematic Facebookuse. Addict. Behav. Rep. 2019, 9, 100150. [Google Scholar]
  23. Tomczyk, Ł. FOMO (Fear of Missing out)-wyzwanie diagnostyczne i edukacyjne. Lub. Rocz. Pedagog. 2018, 37, 139–150. [Google Scholar] [CrossRef] [Green Version]
  24. Barabas, M. Fonoholizm zagrożeniem dla rozwoju dzieci i młodzieży. Eduk.–Tech.–Inform. 2018, 2, 92–97. [Google Scholar] [CrossRef]
  25. Węgrzyn-Odzioba, L. Zagrożenia bezpieczeństwa społecznego związane z funkcjonowaniem w cyberprzestrzeni. TEKA Political Sci. Int. Relat. 2018, 13, 77–96. [Google Scholar] [CrossRef]
  26. Shah, P.P.; Sheth, M.S. Correlation of smartphone use addiction with text neck syndrome and SMS thumb in physiotherapy students. Int. J. Community Med. Public Health 2018, 5, 2512–2516. [Google Scholar] [CrossRef] [Green Version]
  27. Kocur, J.; Trendak, W. Czynniki ryzyka samobójczego w uzależnieniach behawioralnych. Suicydologia 2016, 8, 51–55. [Google Scholar]
  28. Sha, P.; Sariyska, R.; Riedl, R.; Lachmann, B.; Montag, C. Linking Internet Communication and Smartphone Use Disorder by taking a closer look at the Facebook and WhatsApp applications. Addict. Behav. Rep. 2019, 9, 100148. [Google Scholar] [CrossRef] [PubMed]
  29. Kim, H.J.; Min, J.Y.; Kim, H.J.; Min, K.B. Accident risk associated with smartphone addiction: A study on university students in Korea. J. Behav. Addict. 2017, 6, 699–707. [Google Scholar] [CrossRef]
  30. Oliva, A.; Antolín-Suárez, L.; Rodríguez-Meirinhos, A. Uncovering the Link between Self-control, Age and Psychological Maladjustment among Spanish Adolescents and Young Adults. Psychosoc. Interv. 2019, 28, 49–55. [Google Scholar] [CrossRef] [Green Version]
  31. Elhai, J.D.; Dvorak, R.D.; Levine, J.C.; Hall, B.J. Problematic smartphone use: A conceptual overview and systematic review of relations with anxiety and depression psychopathology. J. Affect. Disord. 2017, 207, 251–259. [Google Scholar] [CrossRef]
  32. Pera, A. The Psychology of Addictive Smartphone Behavior in Young Adults: Problematic Use, Social Anxiety and Depressive Stress. Front. Psychiatry 2020, 15, 573473. [Google Scholar] [CrossRef]
  33. Xiong, S.; Xu, Y.; Zhang, B.; Zhu, L.; Xie, J. Smartphone Addiction and Eysenck’s Personality Traits among Chinese Adolescents: A Meta-Analysis. Front. Psychol. 2022, 12, 794112. [Google Scholar] [CrossRef] [PubMed]
  34. Gao, T.; Xiang, Y.T.; Zhang, H.; Zhang, Z.; Mei, S. Neuroticism and quality of life: Multiple mediating effects of smartphone addiction and depression. Psychiatry Res. 2017, 258, 457–461. [Google Scholar] [CrossRef]
  35. Marengo, D.; Poletti, I.; Settanni, M. The interplay between neuroticism, extraversion and social media addiction in young adult Facebook users: Testing the mediating role of online activity using objective data. Addict. Behav. 2020, 102, 106150. [Google Scholar] [CrossRef] [PubMed]
  36. Sobrinho-Junior, S.A.; de Almeida, A.C.N.; Ceabras, A.A.P.; da Silva Carvalho, C.L.; Lino, T.B.; Christofoletti, G. Risks of Accidents Caused by the Use of Smartphone by Pedestrians Are Task- and Environment-Dependent. Int. J. Environ. Res. Public Health 2022, 19, 10320. [Google Scholar] [CrossRef]
  37. Fernández, C.; Vicente, M.A.; Carrillo, I.; Guilabert, M.; Mira, J.J. Factors Influencing the Smartphone Usage Behavior of Pedestrians: Observational Study on “Spanish Smombies”. J. Med. Internet. Res. 2020, 22, e19350. [Google Scholar] [CrossRef]
  38. López-Fernández, O.; Honrubia-Serrano, M.L.; Freixa-Blanxart, M. Adaptación española del “Mobile Phone Problem Use Scale” para población adolescente. Adicciones 2012, 24, 123–130. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  39. Zimet, G.D.; Dahlem, N.W.; Zimet, S.G.; Farley, G.K. The Multidimensional Scale of Perceived Social Support. J. Personal. Assess. 1988, 52, 30–41. [Google Scholar] [CrossRef] [Green Version]
  40. Buszman, K.; Przybyła-Basista, H. Polska adaptacja Wielowymiarowej Skali Spostrzeganego Wsparcia Społecznego. Pol. Forum Psychol. 2017, 22, 581–599. [Google Scholar]
  41. Zawadzki, B.; Popiel, A.; Pragłowska, E. Charakterystyka psychometryczna polskiej adaptacji Kwestionariusza Depresji BDI-II Aarona T. Becka. Psychol.-Etol.-Genet. 2009, 19, 71–95. [Google Scholar]
  42. Beck, A.T.; Steer, R.A.; Brown, G.K. BDI-II. Beck Depression Inventory: Manual; The Psychological Corporation: San Antonio, TX, USA, 1996. [Google Scholar]
  43. Bindi, P.; Bayles, A.; Acquadro, C.; Johns, M. Challenges in translating the Epworth Sleepiness Scale into 66 languages. Value Health 2016, 19, A93. [Google Scholar] [CrossRef]
  44. Murray, W.; Johns, A. New Method for Measuring Daytime Sleepiness: The Epworth Sleepiness Scale. Sleep 1991, 14, 540–545. [Google Scholar]
  45. Mishra, P.; Pandey, C.M.; Singh, U.; Keshri, A.U.; Sabaretnam, M. Selection of appropriate statistical methods for data analysis. Ann. Card. Anaesth. 2019, 22, 297–301. [Google Scholar] [CrossRef]
  46. De-Sola, J.; Rubio, G.; Talledo, H.; Pistoni, L.; Van Riesen, H.; Rodríguez de Fonseca, F. Cell Phone Use Habits among the Spanish Population: Contribution of Applications to Problematic Use. Front. Psychiatry 2019, 10, 883. [Google Scholar] [CrossRef]
  47. De-Sola, J.; Talledo, H.; Rodriguez de Fonseca, F.; Rubio, G. Prevalence of problematic cell phone use in an adult population in Spain as assessed by the mobile phone problem use scale (MPPUS). PLoS ONE 2017, 12, 8. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  48. Lopez-Fernandez, O.; Kuss, D.; Romo, L.; Morvan, Y.; Kern, L.; Graziani, P.; Rousseau, A.; Rumpf, H.J.; Bischof, A.; Gässler, A.K.; et al. Self-reported dependence on mobile phones in young adults: A European cross-cultural empirical survey. J. Behav. Addict. 2017, 6, 168–177. [Google Scholar] [CrossRef] [PubMed]
  49. Hussain, Z.; Griffiths, M.D.; Sheffield, D. An investigation into problematic smartphone use: The role of narcissism, anxiety, and personality factors. J. Behav. Addict. 2017, 6, 378–386. [Google Scholar] [CrossRef] [Green Version]
  50. Warzecha, K.; Pawlak, A. Pathological use of mobile phones by secondary school students. Arch. Psychiatry Psychother. 2017, 1, 27–36. [Google Scholar] [CrossRef]
  51. Aljomaa, S.S.; Mohammad, M.F.; Albursan, I.S.; Bakhiet, S.F.; Abduljabbar, A.S. Smartphone addiction among university students in the light of some variables. Comput. Hum. Behav. 2016, 61, 155–164. [Google Scholar] [CrossRef]
  52. Tateno, M.; Teo, A.R.; Ukai, W.; Kanazawa, J.; Katsuki, R.; Kubo, H.; Kato, T.A. Internet Addiction, Smartphone Addiction and Hikikomori Trait in Japanese Young Adult: Social Isolation and Social Network. Front. Psychiatry 2019, 10, 455. [Google Scholar] [CrossRef] [Green Version]
  53. Alhassan, A.A.; Alqadhib, E.M.; Taha, N.W.; Alahmari, R.A.; Salam, M.; Almutairi, A.F. The relationship between addiction to smartphone usage and depression among adults: A cross sectional study. BMC Psychiatry 2018, 18, 148. [Google Scholar] [CrossRef]
  54. Chen, B.; Liu, F.; Ding, S.; Ying, X.; Wang, L.; Wen, Y. Gender differences in factors associated with smartphone addiction: A cross-sectional study among medical college students. BMC Psychiatry 2017, 17, 341. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  55. Dharmadhikari, S.P.; Harshe, S.D.; Bhide, P.P. Prevalence and Correlates of Excessive Smartphone Use among Medical Students: A Cross-sectional Study. Indian J. Psychol. Med. 2019, 41, 549–555. [Google Scholar] [CrossRef]
  56. Kim, S.G.; Park, J.; Kim, H.T.; Pan, Z.; Lee, Y.; McIntyre, R.S. The relationship between smartphone addiction and symptoms of depression, anxiety and attention-deficit/hyperactivity in South Korean adolescents. Ann. Gen. Psychiatry 2019, 18, 1. [Google Scholar] [CrossRef] [Green Version]
  57. Mehmood, A.; Bu, T.; Zhao, E.; Zelenina, V.; Alexander, N.; Wang, W.; Siddiqi, S.M.; Qiu, X.; Yang, X.; Qiao, Z.; et al. Exploration of Psychological Mechanism of Smartphone Addiction among International Students of China by Selecting the Framework of the I-PACE Model. Front. Psychol. 2021, 12, 758610. [Google Scholar] [PubMed]
  58. Elhai, J.D.; Levine, J.C.; Dvorak, R.D.; Hall, B.J. Fear of missing out, need for touch, anxiety and depression are related to problematic smartphone use. Comput. Hum. Behav. 2016, 63, 509–516. [Google Scholar] [CrossRef]
  59. Ng, K.C.; Wu, L.H.; Lam, H.Y.; Lam, L.K.; Nip, P.Y.; Ng, C.M.; Leung, K.C.; Leung, S.F. The relationships between mobile phone use and depressive symptoms, bodily pain and daytime sleepiness in Hong Kong secondary school students. Addict. Behav. 2020, 101, 105975. [Google Scholar] [CrossRef] [PubMed]
  60. Boonluksiri, P. Effect of smartphone overuse on sleep problems in medical students. Asia Pac. Sch. 2018, 3, 25–28. [Google Scholar] [CrossRef]
  61. Shechter, A.; Wookhyun Kim, E.; St-Onge, M.P.; Westwood, A.J. Blocking nocturnal blue light for insomnia: A randomized controlled trial. J. Psychiatr. Res. 2018, 96, 196–202. [Google Scholar] [CrossRef]
  62. Rathakrishnan, B.; Bikar Singh, S.S.; Kamaluddin, M.R.; Yahaya, A.; Mohd Nasir, M.A.; Ibrahim, F.; Ab Rahman, Z. Smartphone Addiction and Sleep Quality on Academic Performance of University Students: An Exploratory Research. Int. J. Environ. Res. Public Health 2021, 18, 8291. [Google Scholar] [CrossRef]
  63. Dhamija, S.; Shailaja, B.; Chaudhari, B.; Chaudhury, S.; Saldanha, D. Prevalence of smartphone addiction and its relation with sleep disturbance and low self- esteem among medical college students. Ind. Psychiatry J. 2021, 30, 189–194. [Google Scholar]
  64. Song, H.Y.; Kim, J.H. Smartphone Use Type, Fear of Missing Out, Social Support and Smartphone Screen Time among Adolescents in Korea: Interactive Effects. Front. Public Health 2022, 16, 822741. [Google Scholar] [CrossRef]
  65. Akturk, U.; Budak, F. The Correlation Between the Perceived Social Support of Nursing Students and Smartphone Addiction. Int. J. Caring Sci. 2019, 12, 1825–1836. [Google Scholar]
  66. Aker, S.; Şahin, M.K.; Sezgin, S.; Oğuz, G. Psychosocial Factors Affecting Smartphone Addiction in University Students. J. Addict. Nurs. 2017, 28, 215–219. [Google Scholar] [CrossRef] [PubMed]
  67. Darcin, A.E.; Kose, S.; Noyan, C.O.; Nurmedov, S.; Yılmaz, O.; Dilbaz, N. Smartphone addiction and its relationship with social anxiety and loneliness. Behav. Inf. Technol. 2016, 35, 520–525. [Google Scholar] [CrossRef]
Table 1. The analysis of correlation between mobile phone use according to the MPPUSA and social support according to the MSPSS in the surveyed group.
Table 1. The analysis of correlation between mobile phone use according to the MPPUSA and social support according to the MSPSS in the surveyed group.
SupportMobile Phone Usep
Casual and Regular Users (A)
N = 459
Users at Risk (B)
N = 74
Problematic Users (C)
N = 34
Significant otherM ± SD5.5 ± 1.75.6 ± 1.45.3 ± 1.5p = 0.272
Me6.265.5
Q1–Q34.7–74.5–74.5–6.7
FamilyM ± SD5.1 ± 1.74.7 ± 1.74.7 ± 1.7p = 0.076
Me5.54.65
Q1–Q34–6.53.6–6.24–5.9
AcquaintancesM ± SD5.4 ± 1.65.3 ± 1.44.7 ± 1.6p = 0.007
A > C
Me5.65.54.9
Q1–Q34.5–74.3–6.54–6
GeneralM ± SD5.3 ± 1.45.2 ± 1.24.9 ± 1.3p = 0.034
A > C
Me5.65.34.9
Q1–Q34.5–6.54.2–6.24.2–5.8
N—number of respondents, M ± SD—mean ± standard deviation, Me—median, Q1–Q3—quartiles, p—Kruskal–Wallis test + post hoc analysis (Dunn’s test).
Table 2. The analysis of correlation between the mobile phone use according to the MPPUSA and the severity of depressiveness according to the BDI as well as daytime sleepiness according to the ESS.
Table 2. The analysis of correlation between the mobile phone use according to the MPPUSA and the severity of depressiveness according to the BDI as well as daytime sleepiness according to the ESS.
Depressiveness According to the BDIMobile Phone Use According to the MPPUSAp
Casual and Regular Users—A (N = 459)Users at Risk—B (N = 74)Problematic Users—C (N = 34)
M ± SD11.9 ± 11.516.6 ± 11.719.5 ± 15.8p < 0.001
C,B > A
Me814.517
Q1–Q33–177.3–23.85.5–32
Sleepiness According to the ESSCasual and Regular Users—A (N = 459)Users at Risk—B (N = 74)Problematic Users—C (N = 34)p
M ± SD8.2 ± 4.710.6 ± 410.3 ± 5.9p < 0.001
B,C > A
Me81110
Q1–Q35–118–135.8–14
N—number of respondents, M ± SD—mean ± standard deviation, Me—median, Q1–Q3—quartiles, p—Kruskal–Wallis test + post hoc analysis (Dunn’s test).
Table 3. Univariate and multivariate regression for respondents with problematic mobile phone use.
Table 3. Univariate and multivariate regression for respondents with problematic mobile phone use.
No AdjustedMultifactorial *
pORCl −95%Cl +95%pORCl −95%Cl +95%
BDIquantitative<0.0011.0361.0191.052<0.0011.0321.0151.049
no depression 1.000 1.000
mild depression0.0012.3141.4353.7320.0012.3221.4293.774
moderately severe depression0.0012.6671.4764.8170.0092.2691.2244.206
very severe depression0.1084.4440.72127.3860.1274.1830.66726.248
ESSquantitative<0.0011.1061.0571.157<0.0011.0961.0461.148
normal daytime sleepiness 1.000 1.000
excessive daytime sleepiness0.0041.9721.2453.1230.0051.9391.2153.093
pathological daytime sleepiness<0.0013.3181.7286.3690.0022.8861.4735.653
MPSSquantitative0.0940.8830.7631.0210.0580.8610.7371.005
low support 1.000 1.000
moderate support0.0542.6590.9857.1780.0732.5060.9186.840
high support0.6201.2810.4803.4170.7621.1670.4293.174
Legend: OR—odds ratio, Cl—confidence interval. Notes: * Analysis adjusted by age, sex, education.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Nowak, M.; Rachubińska, K.; Starczewska, M.; Kupcewicz, E.; Szylińska, A.; Cymbaluk-Płoska, A.; Grochans, E. Correlations between Problematic Mobile Phone Use and Depressiveness and Daytime Sleepiness, as Well as Perceived Social Support in Adolescents. Int. J. Environ. Res. Public Health 2022, 19, 13549. https://doi.org/10.3390/ijerph192013549

AMA Style

Nowak M, Rachubińska K, Starczewska M, Kupcewicz E, Szylińska A, Cymbaluk-Płoska A, Grochans E. Correlations between Problematic Mobile Phone Use and Depressiveness and Daytime Sleepiness, as Well as Perceived Social Support in Adolescents. International Journal of Environmental Research and Public Health. 2022; 19(20):13549. https://doi.org/10.3390/ijerph192013549

Chicago/Turabian Style

Nowak, Marta, Kamila Rachubińska, Małgorzata Starczewska, Ewa Kupcewicz, Aleksandra Szylińska, Aneta Cymbaluk-Płoska, and Elżbieta Grochans. 2022. "Correlations between Problematic Mobile Phone Use and Depressiveness and Daytime Sleepiness, as Well as Perceived Social Support in Adolescents" International Journal of Environmental Research and Public Health 19, no. 20: 13549. https://doi.org/10.3390/ijerph192013549

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop