Next Article in Journal
Toxicity Thresholds Based on EDTA Extractable Nickel and Barley Root Elongation in Chinese Soils
Next Article in Special Issue
A Phenotype Classification of Internet Use Disorder in a Large-Scale High-School Study
Previous Article in Journal
‘We All Work Together to Vaccinate the Child’: A Formative Evaluation of a Community-Engagement Strategy Aimed at Closing the Immunization Gap in North-West Ethiopia
Previous Article in Special Issue
Investigating the Effect of Personality, Internet Literacy, and Use Expectancies in Internet-Use Disorder: A Comparative Study between China and Germany
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
IJERPH
Volume 15
Issue 4
10.3390/ijerph15040668
ijerph-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Review

Association between Internet Gaming Disorder or Pathological Video-Game Use and Comorbid Psychopathology: A Comprehensive Review

by
Vega González-Bueso
1,†,
Juan José Santamaría
1,*,†,
Daniel Fernández
2,3,
Laura Merino
1,
Elena Montero
1 and
Joan Ribas
1
1
Atención e Investigación en Socioadicciones (AIS), Mental Health and Addictions Network, Generalitat de Catalunya (XHUB), C/Forn-7-9 Local, 08014 Barcelona, Spain
2
Research and Development Unit, Parc Sanitari Sant Joan de Déu, Fundació Sant Joan de Déu, CIBERSAM, Dr. Antoni Pujadas, 42, Sant Boi de Llobregat, 08830 Barcelona, Spain
3
School of Mathematics and Statistics, Victoria University of Wellington, Wellington 6140, New Zealand
*
Author to whom correspondence should be addressed.
†
These authors contributed equally to this work.
Int. J. Environ. Res. Public Health 2018, 15(4), 668; https://doi.org/10.3390/ijerph15040668
Submission received: 27 February 2018 / Revised: 30 March 2018 / Accepted: 31 March 2018 / Published: 3 April 2018
(This article belongs to the Special Issue Internet and Mobile Phone Addiction: Health and Educational Effects)
Browse Figures
Versions Notes

Abstract

:
The addictive use of video games is recognized as a problem with clinical relevance and is included in international diagnostic manuals and classifications of diseases. The association between “Internet addiction” and mental health has been well documented across a range of investigations. However, a major drawback of these studies is that no controls have been placed on the type of Internet use investigated. The aim of this study is to review systematically the current literature in order to explore the association between Internet Gaming Disorder (IGD) and psychopathology. An electronic literature search was conducted using PubMed, PsychINFO, ScienceDirect, Web of Science and Google Scholar (r.n. CRD42018082398). The effect sizes for the observed correlations were identified or computed. Twenty-four articles met the eligibility criteria. The studies included comprised 21 cross-sectional and three prospective designs. Most of the research was conducted in Europe. The significant correlations reported comprised: 92% between IGD and anxiety, 89% with depression, 85% with symptoms of attention deficit hyperactivity disorder (ADHD), and 75% with social phobia/anxiety and obsessive-compulsive symptoms. Most of the studies reported higher rates of IGD in males. The lack of longitudinal studies and the contradictory results obtained prevent detection of the directionality of the associations and, furthermore, show the complex relationship between both phenomena.

1. Introduction

The problematic use of video games is recognized by mental health professionals as an addictive behavior with clinical relevance. This is due to the negative consequences it may have for affected people in several functional areas such as relationship conflicts, sleep problems or occupational functioning [1,2]. However, in the current literature, the terms “Internet addiction” (IA) and “pathological Internet use” (PIU) have commonly been used to refer to all sorts of activities including, but not limited to, the use of video games. All these activities are derived from the excessive use of devices connected to the Internet (i.e., computers, smartphones and other devices to play on and navigate). This classification has frequently been criticized as being too broad and not distinguishing between problematic activities and the medium itself on which they take place [3,4], despite the fact that persons engaged in these activities have different sociodemographic characteristics and motivations [5]. For example, the Internet preference activities for males are those related to entertainment and leisure, whereas women tend to choose activities related to interpersonal communication and educational assistance; additionally, these differences may be mediated by age [6].
The non-inclusion of IA as a diagnosis, and the inclusion of “Internet Video-Game Disorder” (Internet Gaming Disorder, IGD) in Section III of the diagnostic manual DSM-5 [7] as a condition that requires further study, seems to support considering both disorders as different problems. Likewise, the most recent inclusion of Gaming Disorder in the beta version of the ICD-11 (International Classification of Diseases) of the World Health Organization [8] seems to confirm this trend. In this document, the problem is defined as “a pattern of persistent or recurrent gaming behavior (‘digital gaming’ or ‘video-gaming’), which may be online (i.e., over the Internet) or offline, manifested by: (1) impaired control over gaming (e.g., onset, frequency, intensity, duration, termination, context); (2) increasing priority given to gaming to the extent that gaming takes precedence over other life interests and daily activities; and (3) continuation or escalation of gaming despite the occurrence of negative consequences. The behavior pattern is of sufficient severity to result in significant impairment in personal, family, social, educational, occupational or other important areas of functioning. The pattern of gaming behavior may be either continuous or, on the other hand, episodic and recurrent. The gaming behavior and other features are normally evident over a period of at least 12 months for a diagnosis to be assigned, although the required duration may be shortened if all diagnostic requirements are met and symptoms are severe”.
The psychopathology associated with addictive behaviors, with or without substance, can result from a problem or, alternatively, lead to further issues [9,10]. If the association between two disorders is higher than expected by chance, it is likely that there are mechanisms contributing to that association. Four general models of increased comorbidity have been described [11,12,13]: common factor models, secondary substance-use disorder models, secondary psychiatric disorder models, and bidirectional models. In the first instance, both disorders share risk factors and the higher comorbidity is the result. In the second case, the addictive disorder contributes to other psychiatric disorders. In the third condition, the psychiatric disorder precipitates the addictive behavior. Finally, either disorder can increase vulnerability to the other disorder; in such cases the higher comorbidity reported may be due to inappropriate sampling, assessment, study design or other biases in the published studies.
In the case of behavioral addictions, the temporal linearity of that relationship remains unclear. Associations between IA or PIU and various psychiatric symptoms have been reported in the literature. Specifically, they have been related to depression, attention deficit hyperactivity disorder (ADHD), anxiety, obsessive-compulsive symptoms, and hostility or aggression [14]. Depression seems to be the most common comorbidity in all age groups (adolescents, adults and the general population). However, the designs used to explore these relationships are not sufficiently comprehensive or complex to confirm the hypothesis for the above models. It is possible that a specific psychiatric problem might have an influence on developing an IA, or that a person with an IA diagnosis, due to various negative consequences, will later develop a comorbid psychiatric disorder. It is also possible that both problems share biological, sociodemographic or psychological underlying mechanisms that make people vulnerable to both pathologies; these may thus become evident at the same time [15]. A major drawback of these studies is that, in most, the type of Internet use is not controlled or, alternatively, the results are not separated by use. In many studies, playing video games is the most common activity among people with IA [16,17,18,19]; still, the results have been analyzed without taking this aspect into account.
Therefore, some interesting questions remain. One is whether IGD has similar comorbidities to IA or, rather, the comorbidities are different. In the latter case, one may wonder if other Internet-based issues are affecting in some way the results of studies focused on IA in general. An additional question pertains to the directionality of both conditions (IGD and psychopathology).
The aim of this study is to review systematically the current literature to elicit epidemiological evidence supporting or refuting the association between Internet gaming addiction and psychopathology. An additional objective is to explore the relationship between these conditions. Such results can furnish clinicians with updated information and provide a direction for future investigative endeavors.

2. Materials and Methods

This systematic review was conducted in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses-P 2015 statement for systematic review and meta-analysis protocols [20]. The databases reviewed between October and December 2017 were PubMed, PsychINFO, ScienceDirect, Web of Science, and Google Scholar, using the following search terms and logic: “(Internet OR online) gaming addiction AND (psychopathology OR comorbidity)”. Without considering the results in Google Scholar, these database search parameters yielded a total of 688 results, including the following results in each database: PubMed (54 results), PsychINFO (354 results), and ScienceDirect (280 results). Due to the large number of results provided by Google Scholar (more than 17,500 results), we reviewed only the first 30 pages of results. Additional articles were identified through searching the citations in the literature selected.
The studies were systematically and independently reviewed by the authors (Vega González-Bueso and Juan José Santamaría); paying attention to the study type, study population, methodology, outcome measures, effect sizes and interpretation of results. In cases of discrepancies, these were resolved through consensus or referral to a third reviewer (Laura Merino). The inclusion criteria were: (i) the inclusion of empirically collected data; (ii) IGD assessed by standardized questionnaires or other proposed criteria based on international disease classifications; (iii) psychiatric comorbidity assessed by standardized questionnaires; (iv) availability of the full text; (v) published after the year 2010 (this allowed us to review the most recent research in a field where the subject of addiction evolves rapidly); (vi) written in English or in Spanish (the two languages known by the authors); and (vii) article published in a peer-reviewed journal.
Studies were also included if the object of research was IA, only if it was specified that the Internet was used to play video games, and/or the results were separated according to Internet use and whether video games were one of those activities.
The exclusion criteria were: (i) articles containing only anecdotal evidence on psychopathology associated with IGD; (ii) authors not providing a specific definition or criteria for IGD; (iii) case reports and case series; (iv) studies only reporting results on phenomenons such as motivation to play video games, decision-making, stress, lifestyle, impulsivity and sexual attitude, without reporting other psychiatric comorbidity.
A review protocol exists at the PROSPERO International prospective register of systematic reviews [21] registration number CRD42018082398.
In order to facilitate the comparisons with pathological Internet use, the reviewing method applied by Carli et al. in 2013 [14] was followed: the effect sizes of the associations between IGD and psychopathology were identified by the reviewed publications or calculated using the data provided by the authors, when available. In order to compare the different associations, the effect sizes d and R2 were stated as small, moderate, or large, according to Cohen [22]; OR were converted into these groups according to Chinn [23]. The effect sizes were interpreted accordingly: small (d = 0.2, R2 = 0.01, OR = 1.45), moderate (d = 0.5, R2 = 0.06, OR = 2.50), and large (d = 0.8, R2 = 0.14, OR = 4.25). Full association was considered when a correlation was found for both genders after multivariate analyses. If a correlation was identified for only one gender, it was classified as a partial association. The geographical distribution of studies was also mapped (Figure 1).

3. Results

After deleting duplicate studies, a total of 68 articles were screened and identified through the present systematic search. After applying inclusion and exclusion criteria, a total of 24 studies were selected and included. Table 1 shows a summary of the main characteristics of the studies examining the relationship between IGD and comorbid psychopathology, including effect sizes.

3.1. Design of the Included Studies

Nineteen of the 24 articles included were cross-sectional studies [24,25,26,27,28,29,30,31,32,33,34,35,36,37,38,39,40,41,42], the rest were two longitudinal studies [43,44], two case-control studies [45,46], and a cohort study [47]. The research was performed, in descending order, in South Korea (4), Australia (3), Germany (3), Norway (2), Taiwan (2), Canada (1), USA (1), Singapore (1), Spain (1), United Kingdom (1), France (1), Finland (1), Deutschland (1) Austria (1) and Sweden (1). Most of the studies were performed in European countries (12).

3.2. Characteristics of the Used Samples

The 24 studies had a total of 53,889 participants. All studies examined both genders. The number of participants in each study ranged from 102 to 12,938 (M = 2155.56; standard deviation (SD): 3176.05). Nine of the studies in this review [24,28,29,33,37,38,40,43,47] targeted adolescent groups, six studies [26,27,30,34,42,46] targeted adults, one [44] targeted children and eight studies [25,31,32,35,36,39,41,45] were carried out in the general population. A total of three studies were conducted in clinical populations, using people in outpatient treatment for IGD [45] or other mental health problems, namely Gambling Disorder [26] and other unspecified psychiatric problems [38].

3.3. Methods of Assessing Internet Gaming Disorder (IGD)

Since 2013, the DSM-5 includes a proposal of diagnostic criteria for IGD. However, only five out of 15 of the reviewed articles published after this year used these criteria [27,29,34,39,46]; three use psychometric questionnaires based on them [30,38,40] to assess the problem.
These diagnostic criteria pertain to repetitive use of Internet-based games, often with other players, that leads to significant issues with functioning. Five of the following criteria must be met within one year: “(i) Preoccupation or obsession with Internet games. (ii) Withdrawal symptoms when not playing Internet games. (iii) A build-up of tolerance (i.e., more time needs to be spent playing the games). (iv) The person has tried to stop or curb playing Internet games but has failed to do so. (v) The person has had a loss of interest in other life activities, such as hobbies. (vi) A person has had continued overuse of Internet games even with awareness of how much they impact a person’s life. (vii) The person has lied to others about his or her Internet game usage. (viii) The person uses Internet games to relieve anxiety or guilt (i.e., it is a way to escape). (ix) The person has lost or put at risk opportunities or relationships because of Internet games”.
The questionnaires based on these criteria were the Internet Gaming Disorder Test-10 (IGDT-10) [48]; the Gaming Addiction Identification (GAIT) [49] and the Internet Gaming Disorder Scale (IGDS) [50].
The IGDT-10 includes the nine diagnostic criteria of the DSM-5. Each criterion was operationalized using a single item, except for the last criterion referring to “jeopardy or losing a significant relationship, job, or educational or career opportunity because of participation in Internet games.” This criterion was operationalized with two items, given its complexity and description of more than one construct.
The GAIT is a screening instrument used to identify addictive factors related to gaming addiction in adolescents. Primarily developed based on items from the AUDIT Alcohol Consumption Questions (AUDIT-C) [51], and the criteria for gambling disorder suggested by the DSM-5, GAIT covers seven of the nine criteria in the proposed IGD criteria. These items are: preoccupation, withdrawal, tolerance, unsuccessful attempts to control the behavior, loss of interests, harm, and loss of a significant relationship or educational opportunity due to gaming. Questions regarding lying/deception to hide the gaming, and escape/mood modification, are not included.
Finally, the IGDS measures each of the nine DSM-5 definitions with three items, either through separating core aspects of a criterion into different items or by applying changes in phrasing or synonyms. Furthermore, the proposed terms “Internet gaming” or “Internet games” were replaced with “gaming” or “games.”
The remaining studies employed either measures based on the DSM-IV Gambling Disorder criteria (Pathological Technology Use (PTU), Gaming Addiction Scale (GAS)) or based on DSM-IV Addiction criteria (Gaming Addiction Scale for Adolescents (GASA), Video-game Dependency Test (VDT), Assessment of Internet and Computer Game Addiction (AICGA), Video-Game Use Questionnaire (VGUQ)), or questionnaires used to measure IA problems (Computer/Gaming-station Addiction Scale (CGAS), Generalized Problematic Internet Use Scale (GPIUS), Young Internet Addiction Scale (YIAS), Compulsive Internet Use Scale (CIUS), Problematic Internet use scale (ISS-20), Young Diagnostic Questionnaire (YDQ), Chen’s Internet Addiction Scale (CIAS), and Problem Video-Game Playing Test (PVGT)).

3.4. Methods Assessing Psychopathology

Different psychometric assessments were used in the reviewed articles to measure psychopathology.
Depression was measured using various assessment tools, i.e., the Hopkins Symptom Checklist [52], the Asian Adolescent Depression Scale [53], the Beck Depressive Inventory [54], the Beck Depressive Inventory-II [55], the Center for Epidemiologic Studies-Depression Scale-10 [56], the Depressive Mood List [57], the Questionnaire for Depression Diagnostics [58], the Depression Self-Rating Scale [59], the Patient Health Questionnaire-9 [60] and the Depression and Somatic Symptoms Scale [61].
To assess anxiety, in each study, different measures were used, these are the State-Trait Anxiety Inventory [62], the Screen for Child Anxiety-Related Emotional Disorders [63], the Beck Anxiety Scale [64], the Spence Children’s Anxiety Scale [65], and the Generalized Anxiety Disorder Scale-7 [66]. In addition, some authors used questionnaires evaluating both depression and anxiety, the Revised Children’s Anxiety and Depression Scale [67], the School Health Promotion [68], the Hospital Anxiety and Depression Scale [69], the Youth Self-Report [70] and the Reynolds Adolescent Adjustment Screening Inventory [71].
To measure ADHD symptoms or hyperactivity, three authors [38,42,43] used the ADHD Self-Report Scale [72], two authors [24,37] used the Strengths and Difficulties Questionnaire [73], one author [45] used the Dupaul’s ADHD scale [74], and one author [46] used the ADHD DSM-IV-TR criteria diagnosis for adult and childhood [75].
To assess social phobia and social anxiety, two studies [41,43] used the Social Phobia Inventory [76], one study [25] used the Social Phobia Scale [77], and one study [44] used the Revised Social Anxiety Scale for Children [78].
Several studies used questionnaires to assess multiple conditions: in three articles [26,34,35] the Symptom Checklist 90-Revision [79] was employed to assess several conditions (somatization, obsessive-compulsive disorder, interpersonal sensitivity, depression, anxiety, hostility, phobic anxiety, paranoid ideation, and psychoticism), and one study [27] used the Brief Symptoms Inventory [80] to measure the same psychopathologies. Another study [28] evaluated depression, anxiety and obsessive-compulsive disorder through the Revised Children’s Anxiety and Depression Scale [67]. Finally, one article [24] assessed emotional problems and hyperactivity using the Strengths and Difficulties Questionnaire [73].
Finally, in one study [38] the association between IGD and psychoticism was explored through the Psychotic-like Experiences Test [81].

3.5. Effect Size of the Associations of Psychopathology with IGD

Regarding the associations between the analyzed mental disorders and IGD, the effect sizes reported in the reviewed papers comprised different levels of association: 35 large [24,25,26,27,30,31,41,42,43,45,46,47,82], 13 moderate [26,29,31,37,45], eight small [25,33,38,40], and seven non-association [36,38,43,44,83]. In order to summarize these results, Table 2 shows the observed associations identified between IGD and psychopathology only for the main four outcomes. The largest correlations were identified between IGD and anxiety and depression and ADHD, whereas the weakest were observed between IGD and obsessive-compulsive disorder.

3.6. Psychopathology, IGD and Sample Characteristics (Age, Gender)

Twenty-one studies were conducted in healthy populations; only three analyzed clinical populations (IGD or other mental health problems).
Regarding age, the analyzed studies included in the present review focused on three age groups as target populations: general population, adolescents and adults.
Eight articles examined groups of general population formed by children, adolescents and adults together, exploring the association between IGD and 1 depression and anxiety [31,32,39,45], depression [36,41], anxiety [25], social phobia [25,41], ADHD [45] and several psychiatric symptoms using the SCL-90-R [35]. One of these studies focused on a clinical sample of IGD patients [45]. All studies found a large effect size in the correlation between IGD in the general population and depression, except for one that found a non-correlation between both disorders. Large correlation effects with IGD in the general population were also found with ADHD and social phobia. Two studies analyzing anxiety found large effect sizes and two found moderate effect sizes. Large effect sizes were also found with the remaining SCL-90-R scales.
Six studies were focused on adults, analyzing the association between IGD and depression and anxiety [34], depression [30], ADHD [42,46] and several psychiatric symptoms [26,27]; here the SCL-90-R and the Brief Symptom Inventory (BSI) questionnaires were used. One of these studies focused on a clinical sample of pathological gamblers [26]. The authors identified correlations between IGD and depression and anxiety with large and moderate effect sizes, large effect sizes with ADHD, paranoid ideation and obsessive-compulsive symptoms, and finally, large and moderate effect sizes with the remaining SCL-90-R scales.
Adolescent participant groups were used in the remaining 10 studies. One of these studies [38] focused on adolescents with unspecified psychiatric problems. An association between depression and IGD in adolescents was found in seven articles and non-association in one; the effect sizes varied between large (2), moderate (2) and small (2) and no association (1). Anxiety correlated with IGD in adolescents in four of the five studies exploring this relationship; the sizes of the effects varied between large (1), moderate (1) and small (2). The association with ADHD was found in four out of five studies, with effect sizes: large (1), moderate (1) and small (2). Social phobia or social anxiety showed a large association and no association in two studies. Finally, non-association was found with obsessive-compulsive disorder (OCD) and psychoticism in the adolescent population.
With respect to gender, all studies reported higher video-game use among males. Seventeen studies [25,26,27,28,30,32,33,34,35,37,38,39,40,42,43,45,46] found higher rates of IGD among males. Two [24,29] reported no gender differences. The association between psychopathology and IGD was found for both sexes in all the articles (full association), except one [35] that only analyzed the relationship between males.

3.7. IGD and Depression

Nineteen of the 21 studies examined some form of depression as a comorbid symptom. Thirteen studies found a full association [26,27,29,30,31,37,38,40,41,43,45,47,82], and two [28,36] found no association. Specifically, King et al. [28] reported association with depression in PIU groups, demonstrating significantly more severe depression and anxiety symptoms than either the non-problematic user’s group or the pathological video gamers group. In contrast, the pathological video gamers group scores did not differ significantly from the non-problematic users group.
Four studies were not cross-sectional, there were two longitudinal studies [43,44], one cohort study [47], and one case-control [45]. The results of these studies showed large effect size associations with depression. In the case of the longitudinal studies, Gentile et al. [43] reported elevated depressive symptoms after the pathological video-gaming problems started and these symptoms persisted and increased only if the pathological abuse persisted, while Van Rooij et al. [44], in their longitudinal study exploring two different times (years 2008 and 2009) found correlations with depressive mood only in Time 2 when comparing addicted heavy gamers with non-addicted heavy gamers. In the cohort study, the authors reported a correlation between video game addiction and depression with a large effect size only in Time 1, but they did not find any significant correlation between these two variables two years later. Among the rest of correlations detected, the effect sizes for the association with depression comprised eight large [27,30,31,41,43,45,47,82], three moderate [26,29,37], and two small [38,40] observed effects.

3.8. IGD and Anxiety

Regarding the correlation between IGD and anxiety, 11 studies found a full association, one study found a partial association, and one study found no association. The studies finding full association were: a longitudinal study [43] identifying a large effect size; a case-control study [45] identifying a moderate effect size; a cross-sectional study [25], where the authors reported a large effect size in the correlation with the anxiety trait, but a small effect size with anxiety state; and eight cross-sectional studies [26,27,29,31,32,34,38,40] identifying large effect sizes (1), moderate effect sizes (3), and small effect sizes (2). Just as in the case of depression, in the longitudinal study carried out by Gentile et al. [43], the anxiety symptoms appeared after pathological video-gaming problems. A partial association only in males was found in a study [35] and here there was a moderate effect size. Finally, no association with anxiety was found in one cross-sectional study [28].

3.9. IGD and Attention Deficit Hyperactivity Disorder (ADHD)

The relationship between IGD and ADHD and hyperactivity symptoms were analyzed in eight studies. Seven of them reported full association, with four finding large [24,42,45,46], two finding small [38,40], and one reporting moderate, effect sizes [37]. The studies comprised two case-control, five cross-sectional and one longitudinal design; the latter found no association between the two variables [43].

3.10. IGD and Social Phobia and Social Anxiety

Four studies included social phobia or social anxiety as a comorbid symptom in their studies. These studies comprised two longitudinal [43,44] and three cross-sectional designs [25,41,44]. One longitudinal and two cross-sectional studies found full association with IGD, reporting large effect sizes. Furthermore, the longitudinal study, similar to the results found regarding anxiety and depression, found that social phobia symptoms worsen after a youth becomes a pathological gamer, and improve if an individual stops this activity. In the remaining longitudinal study, no association was found between social anxiety and IGD.

3.11. IGD and Obsessive-Compulsive Symptoms

Four studies examined obsessive-compulsive symptoms as a comorbid problem. Three studies [26,27,35] found a full association with large effect sizes, and one [28] found no association.

3.12. Publication Bias

In order to detect possible publication bias, a funnel plot was conducted for depression and anxiety, as there was only a sufficient number of studies reporting results for these two pathologies (according to Grading of Recommendations, Assessment, Development and Evaluation Working Group (GRADE guides), a minimum of five to 10 studies with the same statistic reported are needed). A total of seven studies analyzing the relationship between depression and IGD, and a total of five analyzing anxiety and IGD, reported d values or data to calculate them. Figure 2 depicts the distribution of the reported or calculated correlations for depression and anxiety. The x-axis and y-axis represent the reported d values and the inverse of the sample size, respectively.
The location of the studies shows a bias towards the left side of the funnel plot, i.e., low values of d, indicating a possible publication bias. Even so, we would like to remark that the number of studies is very small to conclude with definitive results in both psychopathologies [84,85], and thus this information must be interpreted cautiously.

4. Discussion

The main purpose of this review was to explore the state of current literature about the relationship between IGD and comorbid psychopathologies, as this knowledge is crucial to the positioning of the disorder as a behavioral addiction. A secondary aim was to analyze the effect size of these correlations and the potential effect of publication bias. In the reviewed papers on IGD and comorbid psychological pathologies, 92% of the studies describe significant correlations with anxiety, 89% with depression, 87% with ADHD or hyperactivity symptoms, and 75% with social phobia/anxiety and obsessive-compulsive symptoms. However, the potential publication bias detected in the preliminary analysis demands caution in interpretation of the results. Notwithstanding this, it should be noted that despite the inclusion of IGD in Section III of the Diagnostic and Statistical Manual DSM-5 [7] and in the beta version of the ICD-11 (International Classification of Diseases) [8], only a marginally small number of publications were centered on IGD in the literature, and several authors continue analyzing IA or PIU as a whole, without distinguishing the different possible problematic activities that users experience with this medium.
With regard to the main purpose, IGD showed strong correlations with most of the analyzed psychopathologies, in comparison with PIU, where the strongest association was found with depression [14]. The effect sizes examined indicated that the strongest associations were found with anxiety, depression, and ADHD or hyperactivity symptoms and social phobia/anxiety.
The fact as to whether the addictive behaviors (with or without substance use) may be a consequence or a trigger of psychopathology [15] cannot be unraveled yet. The lack of longitudinal studies analyzing the temporal linearity of these events in AI or PIU precludes clarifying whether a specific psychiatric problem helps to develop an AI or, alternatively, a person with a diagnosis of AI —due to negative consequences stemming from it—later developed a comorbid psychiatric disorder. A third possibility is that both problems share underlying biological, sociodemographic or psychological mechanisms that make people vulnerable to both pathologies (which manifest at the same time). In the case of this review, two longitudinal studies and one cohort study required data on whether IGD was the cause or consequence of psychopathological problems; as a result, contradictory results were obtained. On the one hand, the results of the longitudinal study performed by Gentile et al. [43] showed that the adolescents who became and stayed pathological gamers during the study period, in the last time measured, ended up with increased levels of depression, anxiety and social phobia, while those who were pathological at the start but stopped being pathological, ended up with reduced levels of depression, anxiety and social phobia. These results seem to demonstrate that gaming predicts other mental health disorders longitudinally, rather than simply being correlated with them. On the other hand, van Rooij et al. [44] found a relation between addicted heavy gamers and depression in the second year, but no correlation with social anxiety at any time. Finally, Brunborg et al. [47] only found a correlation between depression and IGD at Time 1, but not at other times.
These ambiguous results show the complex relationship between the intrinsic characteristics of online video games, the consequences of their abuse, and associated psychopathologies. The literature shows that adolescents with high scores in IGD also have negative consequences at the psychosocial level: fewer recreational activities, fewer social activities and contacts, and diminished academic performance [86,87]. These abnormalities in “real-world” social support can affect people with different personality profiles in different ways. Generally, each online video game has an associated players’ community. This may lead players to find people online with similar interests and, thus, expand or replace their “real-life” social network. As these online relationships spend more and more time, “real-world” social relations will tend to deteriorate or disappear and this lack of “real-life” social support can lead some players to develop symptomatology. But in other cases, establishing this type of online relationships can help alleviate the psychological distress of some players, helping the person to establish social relationships through the Internet and build their lives around it. Some authors provide evidence that personality characteristics (e.g., extraversion, introversion) affect the choice of online or offline options for relationships [88].
Finally, age could be another key factor influencing comorbid psychopathology. In the present review, the strongest associations were found in the adult population. Results focusing on other behavioral addictions (i.e., Gambling Disorder), shows that younger adults, as opposed to older patients, only experience the symptoms of the addiction as psychological discomfort [89], without another comorbid psychopathology. One possible explanation is that older gamblers have experienced the negative consequences of the disorder for a longer period, and this has led them to develop comorbid psychopathology. It is also possible that the psychological symptoms associated with IGD require a longer time period to appear in certain subjects. Another hypothesis is that, first, children and adolescents tend to underestimate the long-term negative consequences of risky or prejudicial behaviors; and second, compared with adults, when making decisions adolescents tend to give more weight to short-term rewards compared with attendant risks [90]. Future research should analyze the differences in the perception of the negative consequences caused by IGD among adults and adolescents.
In relation to gender differences, similar to IA results all the reviewed studies reported higher video-game use among males, and most of the articles found a higher prevalence of IGD in males. Other authors have found that female respondents report less frequent play and less orientation to game genres featuring competition and three-dimensional rotation [91,92]. These characteristics in women players may be a protective factor against IGD. Regarding the amount of time spent playing, although contradictory results have been found regarding the relationship between this factor and IGD [31,42], some authors suggest that its control could be a protective factor in its appearance [93]. With respect to the type of video game chosen, it is likely that both the competitive factor and the immersive factor (in this case favored by a three-dimensional environment) of the online games, characteristics that women do not usually choose, may influence the development of IGD [94,95,96].
In order to clarify these points, future studies should focus on an analysis of the relationships between the personality of the affected people, the video-game preferences (e.g., massively multiplayer online role-playing game or MMORPG, multiplayer online battle arena or MOBA, first-person shooter gamers), the perception of the negative consequences generated by the problematic use, and the associated psychopathology.
The geographical distribution of the research in IGD seems to be more homogeneous than in IA; 50% of the included studies were developed in Europe and 50% were conducted in the rest of the world (29% in Asia, 30% in Australia, and 8% in North America). The prevalence of the problem and its correlation with psychopathology has been reported in all countries; therefore, it seems that it is a global problem and independent of cultural variation.
In contrast to IA, where there is a lack of common diagnostic criteria [14], in the case of IGD there are several questionnaires available based on the proposed diagnostic criteria for the disorder in the DSM-5. Despite this inclusion, the debate about the adequacy of these criteria and the emphasis upon online gaming rather than “general” gaming addiction is still active [97,98]. Therefore, although there is no gold standard questionnaire for IGD, the authors have a diagnostic base in which to frame their research. In the present review, of the 15 included articles published after the appearance of the DSM-5, only eight authors used these criteria or questionnaires based on them. The rest of the published research is based on measures for IA problems or questionnaires adapted from Gambling Disorder and general addiction criteria. This variability in evaluation methods, and basing the division of the comparison groups (IGD problems vs. no IGD problems) exclusively in the results of auto-administered data, could in part explain the variability found between IGD and comorbid psychopathology.
A consensus on the evaluation method of the problem is critical; in addition, studies focused on clinical populations with a diagnosis confirmed by professionals are needed. The data based on self-reports may not be accurate and may be limited in how they diagnose people [99]; therefore, in future research it would be helpful to complement the results of self-report questionnaires with clinical interviews (at least for the positive cases).

5. Limitations

The results of this review should be interpreted with several limitations in mind. First (as noted), some of the studies were published before the inclusion of IGD as a diagnostic category in the DSM-5. Thus, inconsistencies in clinical definitions and evaluations should be expected. Second, restrictions applied to the language of the articles, and heterogeneity in the nomenclature surrounding IGD across the different studies, suggests a potential risk that a relevant article was missed. However, articles written in other languages (with abstracts in English) were included in the review process; furthermore, a search in the citations of the selected literature was carried out. Third, reviewing only the first 30 pages of results in Google Scholar may have produced some bias; however, this method has been shown to be commonly used [100] and seems not to influence the results of the reviews. In addition, searches in other search engines and citations of included articles may have reduced that risk.

6. Conclusions

The present review included 24 studies analyzing the association between IGD and psychopathology. Compared with IA (which showed strong correlations only with depression), IGD showed strong correlations with anxiety, depression, ADHD or hyperactivity symptoms, social phobia/anxiety, and obsessive-compulsive symptoms. The lack of longitudinal studies and the contradictory results obtained makes it difficult to detect the directionality of these associations and shows the existing complexity of the relationship between IGD and psychopathology. In addition, due to a possible publication bias, the results should be interpreted with caution.
For future research, it would be helpful to investigate the relationships between personality styles, type of video-game problem, negative consequences, and associated psychopathology. It is also necessary to reach a consensus on the diagnostic criteria of IGD and on psychometric instruments used to research the subject. Studies centered in the clinical population, with diagnostic interviews that confirm the presence of the disorder, are critically needed.

Acknowledgments

This work was funded by an AIS (Atención e InvestigaciónenSocioaddiciones) intramural research program. This research has been partially supported by the Marsden grant number E2987-3648 (Royal Society of New Zealand). This partial funder had no role in the study design, data collection, and analysis, decision to publish, or preparation of the manuscript.

Author Contributions

Vega González-Bueso and Juan José Santamaría conceived and planned the review. Vega González-Bueso and Juan José Santamaría carried out the search and revision of the literature. Juan José Santamaría and Daniel Fernández analyzed the data. Vega González-Bueso and Juan José Santamaría drafted the study. All authors (Vega González-Bueso, Juan José Santamaría, Daniel Fernández, Laura Merino, Elena Montero and Joan Ribas) revised the article critically for important intellectual content. All authors (Vega González-Bueso, Juan José Santamaría, Daniel Fernández, Laura Merino, Elena Montero and Joan Ribas) commented on and approved the final manuscript and are accountable for all aspects of the work.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. King, D.L.; Haagsma, M.C.; Delfabbro, P.H.; Gradisar, M.; Griffiths, M.D. Toward a consensus definition of pathological video-gaming: A systematic review of psychometric assessment tools. Clin. Psychol. Rev. 2013, 33, 331–342. [Google Scholar] [CrossRef] [PubMed]
  2. Sim, T.; Gentile, D.A.; Bricolo, F.; Serpelloni, G.; Gulamoydeen, F. A Conceptual Review of Research on the Pathological Use of Computers, Video Games, and the Internet. Int. J. Ment. Health Addict. 2012, 10, 748–769. [Google Scholar] [CrossRef]
  3. King, D.L.; Delfabbro, P.H. Issues for DSM-5: Video-gaming disorder? Aust. N. Z. J. Psychiatry 2013, 47, 20–22. [Google Scholar] [CrossRef] [PubMed]
  4. Starcevic, V.; Aboujaoude, E. Internet addiction: Reappraisal of an increasingly inadequate concept. CNS Spectr. 2017, 22, 7–13. [Google Scholar] [CrossRef] [PubMed]
  5. Thompson, T. Demographic and motivation variables associated with Internet usage activities. Internet Res. 2001, 11, 125–137. [Google Scholar] [CrossRef]
  6. Weiser, E.B. Gender Differences in Internet Use Patterns and Internet Application Preferences: A Two-Sample Comparison. CyberPsychol. Behav. 2000, 3, 167–178. [Google Scholar] [CrossRef]
  7. American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders (DSM-5), 5th ed.; American Psychiatric Association: Washington, DC, USA, 2013. [Google Scholar]
  8. ICD-11 Beta Draft—Mortality and Morbidity Statistics. Available online: https://icd.who.int/dev11/l-m/en (accessed on 17 November 2017).
  9. Saban, A.; Flisher, A.J. The Association between Psychopathology and Substance Use in Young People: A Review of the Literature. J. Psychoact. Drugs 2010, 42, 37–47. [Google Scholar] [CrossRef] [PubMed]
  10. Petit, A.; Karila, L.; Chalmin, F.; Lejoyeux, M. Methamphetamine Addiction: A Review of the Literature. J. Addict. Res. Ther. 2012, 1, 2–7. [Google Scholar] [CrossRef]
  11. Anthony, J.C. Epidemiology of drug dependence and illicit drug use. Curr. Opin. Psychiatry 1991, 4, 435–439. [Google Scholar] [CrossRef]
  12. Kosten, T.R.; Ziedonis, D.M. Substance abuse and schizophrenia: Editors’ introduction. Schizophr. Bull. 1997, 23, 181–186. [Google Scholar] [CrossRef] [PubMed]
  13. Lehman, A.F.; Myers, C.P.; Corty, E. Assessment and classification of patients with psychiatric and substance abuse syndromes. Hosp. Community Psychiatry 1989, 40, 1019–1025. [Google Scholar] [CrossRef] [PubMed]
  14. Carli, V.; Durkee, T.; Wasserman, D.; Hadlaczky, G.; Despalins, R.; Kramarz, E.; Wasserman, C.; Sarchiapone, M.; Hoven, C.W.; Brunner, R.; et al. The association between pathological internet use and comorbid psychopathology: A systematic review. Psychopathology 2013, 46, 1–13. [Google Scholar] [CrossRef] [PubMed]
  15. Dong, G.; Lu, Q.; Zhou, H.; Zhao, X. Precursor or Sequela: Pathological Disorders in People with Internet Addiction Disorder. PLoS ONE 2011, 6, e14703. [Google Scholar] [CrossRef] [PubMed]
  16. Floros, G.; Siomos, K.; Stogiannidou, A.; Giouzepas, I.; Garyfallos, G. Comorbidity of psychiatric disorders with Internet addiction in a clinical sample: The effect of personality, defense style and psychopathology. Addict. Behav. 2014, 39, 1839–1845. [Google Scholar] [CrossRef] [PubMed]
  17. Young, K.S. Cognitive behavior therapy with Internet addicts: Treatment outcomes and implications. Cyberpsychol. Behav. 2007, 10, 671–679. [Google Scholar] [CrossRef] [PubMed]
  18. Chang, F.-C.; Chiu, C.-H.; Lee, C.-M.; Chen, P.-H.; Miao, N.-F. Predictors of the initiation and persistence of Internet addiction among adolescents in Taiwan. Addict. Behav. 2014, 39, 1434–1440. [Google Scholar] [CrossRef] [PubMed]
  19. Durkee, T.; Kaess, M.; Carli, V.; Parzer, P.; Wasserman, C.; Floderus, B.; Apter, A.; Balazs, J.; Barzilay, S.; Bobes, J.; et al. Prevalence of pathological internet use among adolescents in Europe: Demographic and social factors. Addiction 2012, 107, 2210–2222. [Google Scholar] [CrossRef] [PubMed]
  20. Moher, D.; Shamseer, L.; Clarke, M.; Ghersi, D.; Liberati, A.; Petticrew, M.; Shekelle, P.; Stewart, L.A. PRISMA-P Group Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Syst. Rev. 2015, 4, 1. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  21. Available online: https://www.crd.york.ac.uk/PROSPERO/ (accessed on 17 November 2017).
  22. Cohen, J. Statistical Power Analysis for the Behavioral Sciences, 2nd ed.; L. Erlbaum Associates: Hillsdale, NJ, USA, 1988; ISBN 9780805802832. [Google Scholar]
  23. Chinn, S. A simple method for converting an odds ratio to effect size for use in meta-analysis. Stat. Med. 2000, 19, 3127–3131. [Google Scholar] [CrossRef]
  24. Baer, S.; Bogusz, E.; Green, D.A. Stuck on screens: Patterns of computer and gaming station use in youth seen in a psychiatric clinic. J. Can. Acad. Child Adolesc. Psychiatry 2011, 20, 86–94. [Google Scholar] [PubMed]
  25. Cole, S.H.; Hooley, J.M. Clinical and Personality Correlates of MMO Gaming. Soc. Sci. Comput. Rev. 2013, 31, 424–436. [Google Scholar] [CrossRef]
  26. Jiménez-Murcia, S.; Fernández-Aranda, F.; Granero, R.; Chóliz, M.; La Verde, M.; Aguglia, E.; Signorelli, M.S.; Sá, G.M.; Aymamí, N.; Gómez-Peña, M.; et al. Video game addiction in gambling disorder: Clinical, psychopathological, and personality correlates. Biomed. Res. Int. 2014, 7, 105–110. [Google Scholar] [CrossRef] [PubMed]
  27. Kim, N.R.; Hwang, S.S.-H.; Choi, J.-S.; Kim, D.-J.; Demetrovics, Z.; Király, O.; Nagygyörgy, K.; Griffiths, M.D.; Hyun, S.Y.; Youn, H.C.; et al. Characteristics and Psychiatric Symptoms of Internet Gaming Disorder among Adults Using Self-Reported DSM-5 Criteria. Psychiatry Investig. 2016, 13, 58. [Google Scholar] [CrossRef] [PubMed]
  28. King, D.L.; Delfabbro, P.H.; Zwaans, T.; Kaptsis, D. Clinical features and axis I comorbidity of Australian adolescent pathological Internet and video game users. Aust. N. Z. J. Psychiatry 2013, 47, 1058–1067. [Google Scholar] [CrossRef] [PubMed]
  29. King, D.L.; Delfabbro, P.H. The Cognitive Psychopathology of Internet Gaming Disorder in Adolescence. J. Abnorm. Child Psychol. 2016, 44, 1635–1645. [Google Scholar] [CrossRef] [PubMed]
  30. Laconi, S.; Pirès, S.; Chabrol, H. Internet gaming disorder, motives, game genres and psychopathology. Comput. Hum. Behav. 2017, 75, 652–659. [Google Scholar] [CrossRef]
  31. Männikkö, N.; Billieux, J.; Kääriäinen, M. Problematic digital gaming behavior and its relation to the psychological, social and physical health of Finnish adolescents and young adults. J. Behav. Addict. 2015, 4, 281–288. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  32. Mentzoni, R.A.; Brunborg, G.S.; Molde, H.; Myrseth, H.; Skouverøe, K.J.M.; Hetland, J.; Pallesen, S. Problematic Video Game Use: Estimated Prevalence and Associations with Mental and Physical Health. Cyberpsychol. Behav. Soc. Netw. 2011, 14, 591–596. [Google Scholar] [CrossRef] [PubMed]
  33. Müller, K.W.; Janikian, M.; Dreier, M.; Wölfling, K.; Beutel, M.E.; Tzavara, C.; Richardson, C.; Tsitsika, A. Regular gaming behavior and internet gaming disorder in European adolescents: Results from a cross-national representative survey of prevalence, predictors, and psychopathological correlates. Eur. Child Adolesc. Psychiatry 2015, 24, 565–574. [Google Scholar] [CrossRef] [PubMed]
  34. Na, E.; Lee, H.; Choi, I.; Kim, D.-J. Comorbidity of Internet gaming disorder and alcohol use disorder: A focus on clinical characteristics and gaming patterns. Am. J. Addict. 2017, 26, 326–334. [Google Scholar] [CrossRef] [PubMed]
  35. Starcevic, V.; Berle, D.; Porter, G.; Fenech, P. Problem Video Game Use and Dimensions of Psychopathology. Int. J. Ment. Health Addict. 2011, 9, 248–256. [Google Scholar] [CrossRef]
  36. Stetina, B.U.; Kothgassner, O.D.; Lehenbauer, M.; Kryspin-Exner, I. Beyond the fascination of online-games: Probing addictive behavior and depression in the world of online-gaming. Comput. Hum. Behav. 2011, 27, 473–479. [Google Scholar] [CrossRef]
  37. Strittmatter, E.; Kaess, M.; Parzer, P.; Fischer, G.; Carli, V.; Hoven, C.W.; Wasserman, C.; Sarchiapone, M.; Durkee, T.; Apter, A.; et al. Pathological Internet use among adolescents: Comparing gamers and non-gamers. Psychiatry Res. 2015, 228, 128–135. [Google Scholar] [CrossRef] [PubMed]
  38. Vadlin, S.; Åslund, C.; Hellström, C.; Nilsson, K.W. Associations between problematic gaming and psychiatric symptoms among adolescents in two samples. Addict. Behav. 2016, 61, 8–15. [Google Scholar] [CrossRef] [PubMed]
  39. Wang, H.R.; Cho, H.; Kim, D.-J. Prevalence and correlates of comorbid depression in a nonclinical online sample with DSM-5 internet gaming disorder. J. Affect. Disord. 2018, 226, 1–5. [Google Scholar] [CrossRef] [PubMed]
  40. Wartberg, L.; Kriston, L.; Kramer, M.; Schwedler, A.; Lincoln, T.M.; Kammerl, R. Internet gaming disorder in early adolescence: Associations with parental and adolescent mental health. Eur. Psychiatry 2017, 43, 14–18. [Google Scholar] [CrossRef] [PubMed]
  41. Wei, H.-T.; Chen, M.-H.; Huang, P.-C.; Bai, Y.-M. The association between online gaming, social phobia, and depression: An internet survey. BMC Psychiatry 2012, 12, 92. [Google Scholar] [CrossRef] [PubMed]
  42. Panagiotidi, M. Problematic Video Game Play and ADHD Traits in an Adult Population. Cyberpsychol. Behav. Soc. Netw. 2017, 20, 292–295. [Google Scholar] [CrossRef] [PubMed]
  43. Gentile, D.A.; Choo, H.; Liau, A.; Sim, T.; Li, D.; Fung, D.; Khoo, A. Pathological video game use among youths: A two-year longitudinal study. Pediatrics 2011, 127, e319–e329. [Google Scholar] [CrossRef] [PubMed]
  44. Van Rooij, A.J.; Schoenmakers, T.M.; Vermulst, A.A.; Van Den Eijnden, R.J.J.M.; Van De Mheen, D. Online video game addiction: Identification of addicted adolescent gamers. Addiction 2011, 106, 205–212. [Google Scholar] [CrossRef] [PubMed]
  45. Hyun, G.J.; Han, D.H.; Lee, Y.S.; Kang, K.D.; Yoo, S.K.; Chung, U.-S.; Renshaw, P.F. Risk factors associated with online game addiction: A hierarchical model. Comput. Hum. Behav. 2015, 48, 706–713. [Google Scholar] [CrossRef]
  46. Yen, J.-Y.; Liu, T.-L.; Wang, P.-W.; Chen, C.-S.; Yen, C.-F.; Ko, C.-H. Association between Internet gaming disorder and adult attention deficit and hyperactivity disorder and their correlates: Impulsivity and hostility. Addict. Behav. 2017, 64, 308–313. [Google Scholar] [CrossRef] [PubMed]
  47. Brunborg, G.S.; Mentzoni, R.A.; Frøyland, L.R. Is video gaming, or video game addiction, associated with depression, academic achievement, heavy episodic drinking, or conduct problems? J. Behav. Addict. 2014, 3, 27–32. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  48. Király, O.; Sleczka, P.; Pontes, H.M.; Urbán, R.; Griffiths, M.D.; Demetrovics, Z. Validation of the Ten-Item Internet Gaming Disorder Test (IGDT-10) and evaluation of the nine DSM-5 Internet Gaming Disorder criteria. Addict. Behav. 2017, 64, 253–260. [Google Scholar] [CrossRef] [PubMed]
  49. Vadlin, S.; Åslund, C.; Nilsson, K.W. Development and content validity of a screening instrument for gamingaddiction in adolescents: The Gaming Addiction Identification Test (GAIT). Scand. J. Psychol. 2015, 56, 458–466. [Google Scholar] [CrossRef] [PubMed]
  50. Lemmens, J.S.; Valkenburg, P.M.; Gentile, D.A. The Internet Gaming Disorder Scale. Psychol. Assess. 2015, 27, 567–582. [Google Scholar] [CrossRef] [PubMed]
  51. Bush, K.; Kivlahan, D.R.; McDonell, M.B.; Fihn, S.D.; Bradley, K.A. The AUDIT alcohol consumption questions (AUDIT-C): An effective brief screening test for problem drinking. Ambulatory Care Quality Improvement Project (ACQUIP). Alcohol Use Disorders Identification Test. Arch. Intern. Med. 1998, 158, 1789–1795. [Google Scholar] [CrossRef] [PubMed]
  52. Derogatis, L.R.; Lipman, R.S.; Rickels, K.; Uhlenhuth, E.H.; Covi, L. The Hopkins Symptom Checklist (HSCL): A self-report symptom inventory. Behav. Sci. 1974, 19, 1–15. [Google Scholar] [CrossRef] [PubMed]
  53. Woo, B.S.C.; Chang, W.C.; Fung, D.S.S.; Koh, J.B.K.; Leong, J.S.F.; Kee, C.H.Y.; Seah, C.K.F. Development and validation of a depression scale for Asian adolescents. J. Adolesc. 2004, 27, 677–689. [Google Scholar] [CrossRef] [PubMed]
  54. Beck, A.T.; Ward, C.H.; Mendelson, M.; Mock, J.; Erbaugh, J. An inventory for measuring depression. Arch. Gen. Psychiatry 1961, 4, 561–571. [Google Scholar] [CrossRef] [PubMed]
  55. Beck, A.T.; Steer, R.A.; Ball, R.; Ranieri, W.F. Comparison of Beck Depression Inventories-IA and-II in Psychiatric Outpatients. J. Pers. Assess. 1996, 67, 588–597. [Google Scholar] [CrossRef] [PubMed]
  56. Andresen, E.M.; Malmgren, J.A.; Carter, W.B.; Patrick, D.L. Screening for depression in well older adults: Evaluation of a short form of the CES-D (Center for Epidemiologic Studies Depression Scale). Am. J. Prev. Med. 1994, 10, 77–84. [Google Scholar] [CrossRef]
  57. Kandel, D.B.; Davies, M. Epidemiology of depressive mood in adolescents: An empirical study. Arch. Gen. Psychiatry 1982, 39, 1205–1212. [Google Scholar] [CrossRef] [PubMed]
  58. Kühner, C. Fragebogen zur Depressionsdiagnostik nach DSM-IV (FDD-DSMIV); Hogrefe: Göttingen, Germany, 1997. [Google Scholar]
  59. Svanborg, P.; Ekselius, L. Self-assessment of DSM-IV criteria for major depression in psychiatric out- and inpatients. Nord. J. Psychiatry 2003, 57, 291–296. [Google Scholar] [CrossRef] [PubMed]
  60. Spitzer, R.L.; Kroenke, K.; Williams, J.B. Validation and utility of a self-report version of PRIME-MD: The PHQ primary care study. Primary Care Evaluation of Mental Disorders. Patient Health Questionnaire. JAMA 1999, 282, 1737–1744. [Google Scholar] [CrossRef] [PubMed]
  61. Hung, C.-I.; Wang, S.-J.; Liu, C.-Y. Validation of the Depression and Somatic Symptoms Scale by comparison with the Short Form 36 scale among psychiatric outpatients with major depressive disorder. Depress. Anxiety 2009, 26, 583–591. [Google Scholar] [CrossRef] [PubMed]
  62. Spielberger, C.; Gorsuch, R.L.; Lushene, R.E. Manual for the State/Trait Anxiety Inventory; Consulting Psychologists Press: Palo Alto, CA, USA, 1970. [Google Scholar]
  63. Birmaher, B.; Khetarpal, S.; Brent, D.; Cully, M.; Balach, L.; Kaufman, J.; Neer, S.M. The Screen for Child Anxiety Related Emotional Disorders (SCARED): Scale construction and psychometric characteristics. J. Am. Acad. Child Adolesc. Psychiatry 1997, 36, 545–553. [Google Scholar] [CrossRef] [PubMed]
  64. Beck, A.T.; Epstein, N.; Brown, G.; Steer, R.A. An inventory for measuring clinical anxiety: Psychometric properties. J. Consult. Clin. Psychol. 1988, 56, 893–897. [Google Scholar] [CrossRef] [PubMed]
  65. Spence, S.H. A measure of anxiety symptoms among children. Behav. Res. Ther. 1998, 36, 545–566. [Google Scholar] [CrossRef]
  66. Spitzer, R.L.; Kroenke, K.; Williams, J.B.W.; Löwe, B. A Brief Measure for Assessing Generalized Anxiety Disorder. Arch. Intern. Med. 2006, 166, 1092. [Google Scholar] [CrossRef] [PubMed]
  67. Chorpita, B.F.; Yim, L.; Moffitt, C.; Umemoto, L.A.; Francis, S.E. Assessment of symptoms of DSM-IV anxiety and depression in children: A revised child anxiety and depression scale. Behav. Res. Ther. 2000, 38, 835–855. [Google Scholar] [CrossRef]
  68. Kunttu, K.; Pesonen, T. Student Health Survey 2012: A National Survey among Finnish University Students; Finnish Student Health Service; Ylioppilaiden Terveydenhoitosäätiön Tutkimuksia 47: Helsinki, Finland, 2013. [Google Scholar]
  69. Zigmond, A.S.; Snaith, R.P. The hospital anxiety and depression scale. Acta Psychiatr. Scand. 1983, 67, 361–370. [Google Scholar] [CrossRef] [PubMed]
  70. Achenbach, T. Manual for the Youth Self-Report and 1991 Profile; Department of Psychiatry, University of Vermont: Burlington, VT, USA, 1999. [Google Scholar]
  71. Reynolds, W. Reynolds Adolescent Adjustment Screening InventoryTM (RAASITM): Professional Manual; Psychological Assessment Resources: Lutz, FL, USA, 2001. [Google Scholar]
  72. Kessler, R.C.; Adler, L.; Ames, M.; Demler, O.; Faraone, S.; Hiripi, E.; Howes, M.J.; Jin, R.; Secnik, K.; Spencer, T.; et al. The World Health Organization Adult ADHD Self-Report Scale (ASRS): A short screening scale for use in the general population. Psychol. Med. 2005, 35, 245–256. [Google Scholar] [CrossRef] [PubMed]
  73. Goodman, R. The Strengths and Difficulties Questionnaire: A research note. J. Child Psychol. Psychiatry 1997, 38, 581–586. [Google Scholar] [CrossRef] [PubMed]
  74. DuPaul, G.J. Parent and Teacher Ratings of ADHD Symptoms: Psychometric Properties in a Community-Based Sample. J. Clin. Child Psychol. 1991, 20, 245–253. [Google Scholar] [CrossRef]
  75. American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders, 4th ed.; American Psychiatric Association Text Revision: Arlington, TA, USA, 2000. [Google Scholar]
  76. Connor, K.M.; Davidson, J.R.; Churchill, L.E.; Sherwood, A.; Foa, E.; Weisler, R.H. Psychometric properties of the Social Phobia Inventory (SPIN). New self-rating scale. Br. J. Psychiatry 2000, 176, 379–386. [Google Scholar] [CrossRef] [PubMed]
  77. Mattick, R.P.; Clarke, J.C. Development and validation of measures of social phobia scrutiny fear and social interaction anxiety. Behav. Res. Ther. 1998, 36, 455–470. [Google Scholar] [CrossRef]
  78. La Greca, A.M.; Stone, W.L. Social Anxiety Scale for Children-Revised: Factor Structure and Concurrent Validity. J. Clin. Child Psychol. 1993, 22, 17–27. [Google Scholar] [CrossRef]
  79. Derogatis, L.R. SCL-90-R. Administration, Scoring and Procedures Manual; Clinical Psychometric Research Inc.: Baltimore, MD, USA, 1990. [Google Scholar]
  80. Derogatis, L.R.; Melisaratos, N. The Brief Symptom Inventory: An introductory report. Psychol. Med. 1983, 13, 595–605. [Google Scholar] [CrossRef] [PubMed]
  81. Laurens, K.; Hodgins, S.; MaughanN, B.; Murray, R.; Rutter, M.; Taylor, E. Community screening for psychotic-like experiences and other putative antecedents of schizophrenia in children aged 9–12 years. Schizophr. Res. 2007, 90, 130–146. [Google Scholar] [CrossRef] [PubMed]
  82. STARCEVIC, V. Problematic Internet use: A distinct disorder, a manifestation of an underlying psychopathology, or a troublesome behaviour? World Psychiatry 2010, 9, 92–93. [Google Scholar] [CrossRef] [PubMed]
  83. King, D.L.; Delfabbro, P.H.; Griffiths, M.D. Trajectories of Problem Video Gaming Among Adult Regular Gamers: An 18-Month Longitudinal Study. Cyberpsychol. Behav. Soc. Netw. 2013, 16, 72–76. [Google Scholar] [CrossRef] [PubMed]
  84. Monroe, J. Meta-Analysis for Observational Studies: Statistical Methods for Heterogeneity, Publication Bias and Combining Studies: Statistics; University of California: Los Angeles, CA, USA, 2007. [Google Scholar]
  85. Sutton, A.J. Methods for Meta-Analysis in Medical Research; J. Wiley: Chichester, UK, 2000; ISBN 9780471490661. [Google Scholar]
  86. Beutel, M.E.; Hoch, C.; Wölfling, K.; Müller, K.W. Clinical characteristics of computer game and internet addiction in persons seeking treatment in an outpatient clinic for computer game addiction. Z. Psychosom. Med. Psychother. 2011, 57, 77–90. [Google Scholar] [CrossRef] [PubMed]
  87. Batthyány, D.; Müller, K.W.; Benker, F.; Wölfling, K. Computer game playing: Clinical characteristics of dependence and abuse among adolescents. Wien. Klin. Wochenschr. 2009, 121, 502–509. [Google Scholar] [CrossRef] [PubMed]
  88. Goby, V.P. Personality and Online/Offline Choices: MBTI Profiles and Favored Communication Modes in a Singapore Study. Cyberpsychol. Behav. 2006, 9, 5–13. [Google Scholar] [CrossRef] [PubMed]
  89. González-Ibáñez, A.; Mora, M.; Gutiérrez-Maldonado, J.; Ariza, A.; Lourido-Ferreira, M.R. Pathological gambling and age: Differences in personality, psychopathology, and response to treatment variables. Addict. Behav. 2005, 30, 383–388. [Google Scholar] [CrossRef] [PubMed]
  90. Halpern-Felsher, B.L.; Cauffman, E. Costs and benefits of a decision: Decision-making competence in adolescents and adults. J. Appl. Dev. Psychol. 2001, 22, 257–273. [Google Scholar] [CrossRef]
  91. Lucas, K.; Sherry, J.L. Sex Differences in Video Game Play. Commun. Res. 2004, 31, 499–523. [Google Scholar] [CrossRef]
  92. Greenberg, B.S.; Sherry, J.; Lachlan, K.; Lucas, K.; Holmstrom, A. Orientations to Video Games Among Gender and Age Groups. Simul. Gaming 2010, 41, 238–259. [Google Scholar] [CrossRef]
  93. Young, K. Understanding Online Gaming Addiction and Treatment Issues for Adolescents. Am. J. Fam. Ther. 2009, 37, 355–372. [Google Scholar] [CrossRef]
  94. Floros, G.; Siomos, K. Patterns of Choices on Video Game Genres and Internet Addiction. Cyberpsychol. Behav. Soc. Netw. 2012, 15, 417–424. [Google Scholar] [CrossRef] [PubMed]
  95. Elliott, L.; Golub, A.; Ream, G.; Dunlap, E. Video Game Genre as a Predictor of Problem Use. Cyberpsychol. Behav. Soc. Netw. 2012, 15, 155–161. [Google Scholar] [CrossRef] [PubMed]
  96. King, D.; Delfabbro, P.; Griffiths, M. Video Game Structural Characteristics: A New Psychological Taxonomy. Int. J. Ment. Health Addict. 2010, 8, 90–106. [Google Scholar] [CrossRef]
  97. Petry, N.M.; Rehbein, F.; Gentile, D.A.; Lemmens, J.S.; Rumpf, H.-J.; Mößle, T.; Bischof, G.; Tao, R.; Fung, D.S.S.; Borges, G.; et al. An international consensus for assessing internet gaming disorder using the new DSM-5 approach. Addiction 2014, 109, 1399–1406. [Google Scholar] [CrossRef] [PubMed]
  98. Kuss, D.J.; Griffiths, M.D.; Pontes, H.M. Chaos and confusion in DSM-5 diagnosis of Internet Gaming Disorder: Issues, concerns, and recommendations for clarity in the field. J. Behav. Addict. 2017, 6, 103–109. [Google Scholar] [CrossRef] [PubMed]
  99. Bhandari, A.; Wagner, T. Self-Reported Utilization of Health Care Services: Improving Measurement and Accuracy. Med. Care Res. Rev. 2006, 63, 217–235. [Google Scholar] [CrossRef] [PubMed]
  100. Kaptsis, D.; King, D.; Delfabbro, P.; Gradisar, M. Withdrawal symptoms in internet gaming disorder: A systematic review. Clin. Psychol. Rev. 2016, 43, 58–66. [Google Scholar] [CrossRef] [PubMed]
Ijerph 15 00668 g001 550
Figure 1. PRISMA 2009 protocols flow diagram.
Figure 1. PRISMA 2009 protocols flow diagram.
Ijerph 15 00668 g001
Ijerph 15 00668 g002 550
Figure 2. Funnel plots with pseudo-95% confidence limits: (a) anxiety, (b) depression.
Figure 2. Funnel plots with pseudo-95% confidence limits: (a) anxiety, (b) depression.
Ijerph 15 00668 g002
Table
Table 1. Studies examining the relationship between Internet Gaming Disorder (IGD) and comorbid psychopathology, including effect sizes.
Table 1. Studies examining the relationship between Internet Gaming Disorder (IGD) and comorbid psychopathology, including effect sizes.
SourceStudy TypeNPopulation Age aSexCountryIGD MeasuresPsychopathology MeasuresPsychopathology OutcomeAssociationEffect Size95% CI of d
Baer et al., 2011 [24]cross-sectional102adolescents
13.7 ± 1.9		M/FCanadaComputer/Gaming-station Addiction Scale (CGAS)Strengths and Difficulties QuestionnaireEmotional problemsfullR2 = 0.29–
HyperactivityfullR2 = 0.18–
Cole & Hooley, 2013 [25]cross-sectional163general population
27.3 ± 9.1		M/FUSAGeneralized Problematic Internet Use Scale (GPIUS)State-Trait Anxiety Inventory (STAI)Anxiety statefulld = 0.26−0.05–0.57
Anxiety traitfulld = 1.070.74–1.40
Social Phobia ScaleSocial phobiafulld = 1.170.83–1.50
Jiménez-Murcia et al., 2014 [26]cross-sectional193adults with GD
42.4 ± 13.4		M/FSpainVideo-game Dependency Test (VDT)Symptom Checklist 90-revisionSomatizationfulld = 0.570.16–0.983
Obsessive-Compulsivefulld = 0.840.424–1.257
Interpersonal Sensitivityfulld = 0.760.341–1.169
Depressionfulld = 0.580.17–0.991
Anxietyfulld = 0.640.216–1.064
Hostilityfulld = 0.680.255–1.106
Phobic-Anxietyfulld = 0.550.127–0.973
Paranoid Ideationfulld = 0.830.402–1.259
Psychoticismfulld = 0.560.137–0.983
Kim et al., 2016 [27]cross-sectional3041adults 20–49M/FSouth KoreaIGD diagnostic criteria in DSM-5Brief Symptom Inventory (BSI)Somatizationfulld = 1.591.481–1.703
Obsessive-Compulsivefulld = 1.671.557–1.78
Interpersonal Sensitivityfulld = 1.611.499–1.721
Depressionfulld = 1.751.642–1.867
Anxietyfulld = 1.751.642–1.866
Hostilityfulld = 1.721.61–1.834
Phobic-Anxietyfulld = 1.821.705–1.928
Paranoid Ideationfulld = 1.741.623–1.847
Psychoticismfulld = 1.761.646–1.87
King et al., 2013 [28]cross-sectional1287adolescents
12–18		M/FAustraliaPathological Technology Use (PTU)Revised Children’s Anxiety and Depression ScaleDepressionnone–
Obsessive-Compulsive Disorder (OCD)none–
Anxietynone–
King & Delfabbro, 2016 [29]cross-sectional824adolescents
14.1 ± 1.5		M/FAustraliaIGD Diagnostic criteria in DSM-5Depression Anxiety Stress Scales, 21-item versionDepressionfull *d = 0.620.087–1.155
Anxietyfull *d = 0.50−0.035–1.025
Laconi et al., 2017 [30]cross-sectional418adults
21.9 ± 3		M/FFranceInternet Gaming Disorder Test-10 (IGDT-10)Center for Epidemiologic Studies, Depression Scale-10Depressionfulld = 2.6871.969–3.405
Männikkö et al., 2015 [31]cross-sectional293general population
18.7 ± 3.4		M/FFinlandGaming Addiction Scale (GAS)School Health Promotion (SHP)DepressionfullR2 = 0.17-
AnxietyfullR2 = 0.11-
Mentzoni, et al., 2011 [32]cross-sectional816general population
15–40		M/FNorwayGaming Addiction Scale for Adolescents (GASA)Hospital Anxiety and Depression Scale (HADS)Depressionfulln/a-
Anxietyfulln/a-
Müller et al., 2015 [33]cross-sectional12,938adolescents
15.8 ± 0.7		M/FGermanyAssessment of Internet and Computer Game Addiction (AICGA)Youth Self-ReportAnxious-Depressionfulld = 0.340.183–0.496
Withdrawn-Depressionfulld = 0.350.347–0.507
Na et al., 2017 [34]cross-sectional1819adults 20–49M/FSouth KoreaIGD diagnostic criteria in DSM-5Symptom Checklist 90-revisionDepressionfulln/a-
Anxietyfulln/a-
Starcevic et al., 2011 [35]cross-sectional1945general population over 14M/FAustraliaVideo-Game Use Questionnaire (VGUQ)Symptom Checklist 90Somatizationpartial>d = 1.020.854–1.187
Obsessive-Compulsivepartiald = 1.3651.196–1.534
Interpersonal Sensitivitypartiald = 1.2281.059–1.396
Depressionpartiald = 1.2641.096–1.433
Anxietypartial>d = 1.1490.981–1.317
Hostilitypartial>d = 1.2761.108–1.445
Phobic-Anxietypartial>d = 1.1310.964–1.299
Paranoid Ideationpartial>d = 1.2031.035–1.371
Psychoticismpartial>d = 1.3681.199–1.537
Stetina et al., 2011 [36]cross-sectional468general population
11–67		M/FAustriaProblematic Internet use scale (ISS-20)Questionnaire for depression diagnostics (FDD for DSM-IV)Depressionnone--
Strittmatter et al., 2015 [37]cross-sectional9758adolescents
15.0 ± 1.3		M/FGermanyYoung Diagnostic Questionnaire (YDQ)Beck Depression Inventory IIDepressionfulld = 0.580.449–0.702
Strengths and Difficulties Questionnaire (SDQ)Hyperactivityfulld = 0.530.399–0.652
Vadlin et al., 2016 [38]cross-sectionalN1 (1868) N2 (242)adolescents
12–18		M/FSwedenGaming Addiction Identification (GAIT)Depression Self-Rating Scale (DSRS-A)DepressionfullOR 2.47 (1.44–4.25)-
Spence Children‘s Anxiety Scale (SCAS)AnxietyfullOR 2.06 (1.27–3.33)-
Adult ADHD Self-Report Scale (ASRS-A)Attention Deficit Hyperactivity Disorder (ADHD)fullOR 2.43 (1.44–4.11)-
Psychotic-like experiences (PLEs)Psychoticismnone--
Wang et al., 2018 [39]cross-sectional7200general population
14–39		M/FSouth KoreaIGD diagnostic criteria in DSM-5Patient Health Questionnaire9 (PHQ9)Depressionfulln/a-
Generalized Anxiety Disorder Scale (GAD-7)Anxietyn/a--
Wartberg et al., 2017 [40]cross-sectional1095adolescents
13.0 ± 0.82		M/FGermanyInternet Gaming Disorder Scale (IGDS)Reynolds Adolescent Adjustment Screening InventoryDepression and anxietyfullOR 1.09 (1.02–1.17)-
HyperactivityfullOR 1.27 (1.16–1.39)-
Wei et al., 2012 [41]cross-sectional722general population
21.8 ± 4.9		M/FTaiwanChen’s Internet Addiction Scale (CIAS)Depression and Somatic Symptoms Scale (DSSS)DepressionfullR2 = 0.298-
Social Phobia Inventory (SPIN)Social phobiafulln/a-
Panagiotidi, 2017 [42]cross-sectional205adults
27.4 ± 10		M/FUnited KingdomProblem Video-Game Playing Test (PVGT)ADHD Self-Report Scale (ASRS)ADHDfullR2 = 0.22-
Gentile et al., 2011 [43]Longitudinal3034children, adolescents
11.2 ± 2.06		M/FSingaporePathological Technology Use (PTU)Asian Adolescent Depression Scale (AADS)DepressionfullR2 = 0.49-
Child Anxiety-Related Emotional Disorders (SCARED)AnxietyfullR2 = 0.29-
Adult ADHD Self-Report Scale (ASRS-A)ADHDnone--
Social Phobia Inventory (SPIN)Social phobiafullR2 = 0.20-
Van Rooij et al., 2011 [44]LongitudinalT1 (1572) T2 (1476)children
13–16		M/FDeutschlandCompulsive Internet Use Scale (CIUS)Depressive Mood ListT1: Depression
T2: Depression		none
full #		n/a-
Revised Social Anxiety Scale for ChildrenT1: Social anxiety
T2: Social anxiety		none
none		--
Hyun et al., 2015 [45]case-control308general population
21.0 ± 5.9		M/FSouth KoreaYoung Internet Addiction Scale (YIAS)Beck Depressive Inventory (BDI)Depressionfulld = 1.090.88–1.305
Beck Anxiety Scale (BAI)Anxietyfulld = 0.640.437–0.845
Dupaul’s ADHD scale (K-ARS)ADHDfulld = 1.050.838–1.262
Yen et al., 2016 [46]case-control174adults
23.29 ± 2.34
23.38 ± 2.40		M/FTaiwanSemi-structured interview with the DSM-5 IGD criteriaADHD DSM-IV-TR criteria diagnosis for adult and childhoodADHDfullOR 13.51 (4.49–40.64)-
Brunborg et al., 2014 [47]cohort1928adolescents
13–17		M/FNorwayGame Addiction Scale for Adolescents (GASA)Hopkins Symptom ChecklistDepressionT1: full
other time: none		R2 = 0.25-
-
a Age is presented in years as a range or mean with standard deviation (SD). M/F = both males and females analyzed together. * Low severity symptoms. n/a Non-enough data provided to calculate the effect size or not applicable. # When non-addicted heavy gamers and addicted heavy gamers compared. > A difference was found between IGD subjects and non IGD subjects but the psychopathology scores on both groups were not clinical.
Table
Table 2. Number of observed associations identified between IGD and psychopathology stratified by effect size for the four main outcomes.
Table 2. Number of observed associations identified between IGD and psychopathology stratified by effect size for the four main outcomes.
Effect SizeDepressionAnxietyADHD/Hyper-ActivitySocial Phobia/Anxiety
Small a2220
Moderate b3510
Large c8242
None2111
Total151083
a d = 0.2, R2 = 0.01, OR = 1.45. b d = 0.5, R2 = 0.06, OR = 2.50. c d = 0.8, R2 = 0.14, OR = 4.25.

Share and Cite

MDPI and ACS Style

González-Bueso, V.; Santamaría, J.J.; Fernández, D.; Merino, L.; Montero, E.; Ribas, J. Association between Internet Gaming Disorder or Pathological Video-Game Use and Comorbid Psychopathology: A Comprehensive Review. Int. J. Environ. Res. Public Health 2018, 15, 668. https://doi.org/10.3390/ijerph15040668

AMA Style

González-Bueso V, Santamaría JJ, Fernández D, Merino L, Montero E, Ribas J. Association between Internet Gaming Disorder or Pathological Video-Game Use and Comorbid Psychopathology: A Comprehensive Review. International Journal of Environmental Research and Public Health. 2018; 15(4):668. https://doi.org/10.3390/ijerph15040668

Chicago/Turabian Style

González-Bueso, Vega, Juan José Santamaría, Daniel Fernández, Laura Merino, Elena Montero, and Joan Ribas. 2018. "Association between Internet Gaming Disorder or Pathological Video-Game Use and Comorbid Psychopathology: A Comprehensive Review" International Journal of Environmental Research and Public Health 15, no. 4: 668. https://doi.org/10.3390/ijerph15040668

APA Style

González-Bueso, V., Santamaría, J. J., Fernández, D., Merino, L., Montero, E., & Ribas, J. (2018). Association between Internet Gaming Disorder or Pathological Video-Game Use and Comorbid Psychopathology: A Comprehensive Review. International Journal of Environmental Research and Public Health, 15(4), 668. https://doi.org/10.3390/ijerph15040668

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop