Proposing and Validating the Diagnosis Scale for Internet Gaming Disorder in Taiwanese ADHD Adolescents: Likert Scale Method Based on the DSM-5
Abstract
:1. Introduction
2. Methods
2.1. Participants and Data Collection
2.2. Measurements
2.2.1. Chen Internet Addiction Scale for Gaming Disorder
2.2.2. Swanson, Nolan, and Pelham, Version IV Questionnaire for ADHD and ODD
2.2.3. Taiwanese Version of the Internet Gaming Disorder Scale with Likert Scale (IGDS-SF-T-L)
2.3. Statistical Analyses
3. Results
3.1. The Reliability Analyses
3.2. Test the Construct Validity
3.3. Diagnostic Accuracy Indices and Receiver Operating Characteristic (ROC) Curve Analysis
4. Discussion
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
References
- Aarseth, E.; Bean, A.M.; Boonen, H.; Carras, M.C.; Coulson, M.; Das, D.; Deleuze, J.; Dunkels, E.; Edman, J.; Ferguson, C.J.; et al. Scholars’ open debate paper on the World Health Organization ICD-11 Gaming Disorder proposal. J. Behav. Addict. 2017, 6, 267–270. [Google Scholar] [CrossRef]
- Kuss, D.J.; Griffiths, M.D.; Pontes, H.M. DSM-5 diagnosis of Internet Gaming Disorder: Some ways forward in overcoming issues and concerns in the gaming studies field. J. Behav. Addict 2017, 6, 133–141. [Google Scholar] [CrossRef] [Green Version]
- Griffiths, M.D.; Kuss, D.J.; Lopez-Fernandez, O.; Pontes, H.M. Problematic gaming exists and is an example of disordered gaming. J. Behav. Addict 2017, 6, 296–301. [Google Scholar] [CrossRef] [Green Version]
- Pontes, H.M.; Griffiths, M.D. Assessment of Internet Gaming Disorder in clinical research: Past and present perspectives. Clin. Res. Regul. Aff. 2014, 31, 35–48. [Google Scholar] [CrossRef] [Green Version]
- Paulus, F.W.; Ohmann, S.; von Gontard, A.; Popow, C. Internet gaming disorder in children and adolescents: A systematic review. Dev. Med. Child Neurol. 2018, 60, 645–659. [Google Scholar] [CrossRef]
- Petry, N.M.; Rehbein, F.; Ko, C.H.; O’Brien, C.P. Internet Gaming Disorder in the DSM-5. Curr. Psychiatry Rep. 2015, 17, 72. [Google Scholar] [CrossRef] [PubMed]
- APA. Diagnostic and Statistical Manual of Mental Disorders: DSM-5, 5th ed.; American Psychiatric Association: Washington, DC, USA, 2013. [Google Scholar]
- Maldonado-Murciano, L.; M Pontes, H.; Griffiths, M.D.; Barrios, M.; Gómez-Benito, J.; Guilera, G. The Spanish Version of the Internet Gaming Disorder Scale-Short Form (IGDS9-SF): Further Examination Using Item Response Theory. Int. J. Environ. Res. Public Health 2020, 17, 7111. [Google Scholar] [CrossRef] [PubMed]
- Fuster, H.; Carbonell, X.; Pontes, H.M.; Griffiths, M.D. Spanish validation of the Internet Gaming Disorder-20 (IGD-20) Test. Comput. Hum. Behav. 2016, 56, 215–224. [Google Scholar] [CrossRef] [Green Version]
- Pontes, H.M.; Griffiths, M.D. Portuguese Validation of the Internet Gaming Disorder Scale-Short-Form. Cyberpsychol. Behav. Soc. Netw. 2016, 19, 288–293. [Google Scholar] [CrossRef]
- Pontes, H.M.; Macur, M.; Griffiths, M.D. Internet Gaming Disorder Among Slovenian Primary Schoolchildren: Findings From a Nationally Representative Sample of Adolescents. J. Behav. Addict. 2016, 5, 304–310. [Google Scholar] [CrossRef] [Green Version]
- Monacis, L.; Palo, V.; Griffiths, M.D.; Sinatra, M. Validation of the Internet Gaming Disorder Scale-Short-Form (IGDS9-SF) in an Italian-speaking sample. J. Behav. Addict. 2016, 5, 683–690. [Google Scholar] [CrossRef] [Green Version]
- Pontes, H.M.; Griffiths, M.D. Measuring DSM-5 Internet Gaming Disorder: Development and validation of a short psychometric scale. Comput. Hum. Behav. 2015, 45, 137–143. [Google Scholar] [CrossRef] [Green Version]
- Kiraly, O.; Sleczka, P.; Pontes, H.M.; Urban, R.; Griffiths, M.D.; Demetrovics, Z. Validation of the Ten-Item Internet Gaming Disorder Test (IGDT-10) and evaluation of the nine DSM-5 Internet Gaming Disorder criteria. Addict. Behav. 2017, 64, 253–260. [Google Scholar] [CrossRef] [Green Version]
- Ko, C.H.; Yen, J.Y.; Chen, S.H.; Wang, P.W.; Chen, C.S.; Yen, C.F. Evaluation of the diagnostic criteria of Internet gaming disorder in the DSM-5 among young adults in Taiwan. J. Psychiatr. Res. 2014, 53, 103–110. [Google Scholar] [CrossRef]
- Sigerson, L.; Li, A.Y.; Cheung, M.W.; Luk, J.W.; Cheng, C. Psychometric properties of the Chinese Internet Gaming Disorder Scale. Addict. Behav. 2017, 74, 20–26. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Pontes, H.M.; Stavropoulos, V.; Griffiths, M.D. Measurement Invariance of the Internet Gaming Disorder Scale-Short-Form (IGDS9-SF) between the United States of America, India and the United Kingdom. Psychiatry Res. 2017, 257, 472–478. [Google Scholar] [CrossRef] [Green Version]
- Koronczai, B.; Urban, R.; Kokonyei, G.; Paksi, B.; Papp, K.; Kun, B.; Arnold, P.; Kallai, J.; Demetrovics, Z. Confirmation of the three-factor model of problematic internet use on off-line adolescent and adult samples. Cyberpsychol. Behav. Soc. Netw. 2011, 14, 657–664. [Google Scholar] [CrossRef] [Green Version]
- Schou Andreassen, C.; Billieux, J.; Griffiths, M.D.; Kuss, D.J.; Demetrovics, Z.; Mazzoni, E.; Pallesen, S. The relationship between addictive use of social media and video games and symptoms of psychiatric disorders: A large-scale cross-sectional study. Psychol. Addict. Behav. 2016, 30, 252–262. [Google Scholar] [CrossRef] [Green Version]
- Kim, N.R.; Hwang, S.S.; Choi, J.S.; Kim, D.J.; Demetrovics, Z.; Kiraly, O.; Nagygyorgy, K.; Griffiths, M.D.; Hyun, S.Y.; Youn, H.C.; et al. Characteristics and Psychiatric Symptoms of Internet Gaming Disorder among Adults Using Self-Reported DSM-5 Criteria. Psychiatry Investig. 2016, 13, 58–66. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Gonzalez-Bueso, V.; Santamaria, J.J.; Fernandez, D.; Merino, L.; Montero, E.; Ribas, J. Association between Internet Gaming Disorder or Pathological Video-Game Use and Comorbid Psychopathology: A comprehensive Review. Int. J. Environ. Res. Public Health 2018, 15, 668. [Google Scholar] [CrossRef] [Green Version]
- Polanczyk, G.; de Lima, M.S.; Horta, B.L.; Biederman, J.; Rohde, L.A. The worldwide prevalence of ADHD: A systematic review and metaregression analysis. Am. J. Psychiatry 2007, 164, 942–948. [Google Scholar] [CrossRef] [PubMed]
- Martin-Fernandez, M.; Matali, J.L.; Garcia-Sanchez, S.; Pardo, M.; Lleras, M.; Castellano-Tejedor, C. Adolescents with Internet Gaming Disorder (IGD): Profiles and treatment response. Adicciones 2016, 29, 125–133. [Google Scholar] [PubMed]
- Bozkurt, H.; Coskun, M.; Ayaydin, H.; Adak, I.; Zoroglu, S.S. Prevalence and patterns of psychiatric disorders in referred adolescents with Internet addiction. Psychiatry Clin. Neurosci. 2013, 67, 352–359. [Google Scholar] [CrossRef] [PubMed]
- Chen, S.H.; Weng, L.C.; Su, Y.J. Development of Chinese Internet Addiction Scale and its psychometric study. Chin. J. Psychol. 2003, 45, 279–294. [Google Scholar]
- Liu, Y.C.; Liu, S.K.; Shang, C.Y.; Lin, C.H.; Tu, C.; Gau, S.S. Norm of the Chinese Version of the Chinese version of the Swanson, Nolan, and Pelham, version IV scale for ADHD. Taiwan J. Psychiatry 2006, 20, 290–304. [Google Scholar]
- Simundic, A.M. Measures of Diagnostic Accuracy: Basic Definitions. EJIFCC 2009, 19, 203–211. [Google Scholar] [PubMed]
- Hajian-Tilaki, K. Receiver Operating Characteristic (ROC) Curve Analysis for Medical Diagnostic Test Evaluation. Casp. J. Intern. Med. 2013, 4, 627–635. [Google Scholar]
- Manuel Porcel, J.; Vives, M.; Esquerda, A.; Ruiz, A. Usefulness of the British Thoracic Society and the American College of Chest Physicians guidelines in predicting pleural drainage of non-purulent parapneumonic effusions. Respir. Med. 2006, 100, 933–937. [Google Scholar] [CrossRef] [Green Version]
- Koo, H.J.; Han, D.H.; Park, S.Y.; Kwon, J.H. The Structured Clinical Interview for DSM-5 Internet Gaming Disorder: Development and Validation for Diagnosing IGD in Adolescents. Psychiatry Investig. 2017, 14, 21–29. [Google Scholar] [CrossRef] [Green Version]
- Cicchetti, D.V. Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychol. Assess. 1994, 6, 284–290. [Google Scholar]
- Chang, Y.C.; Lane, H.Y.; Yang, K.H.; Huang, C.L. Optimizing early prediction for antipsychotic response in schizophrenia. J. Clin. Psychopharmacol. 2006, 26, 554–559. [Google Scholar] [CrossRef] [PubMed]
- Pontes, H.M. Current practices in the clinical and psychometric assessment of internet gaming disorder in the era of the DSM-5: A mini review of existing assessment tools. Ment. Health Addict. Res. 2016, 1, 18–19. [Google Scholar] [CrossRef] [Green Version]
- King, D.L.; Haagsma, M.C.; Delfabbro, P.H.; Gradisar, M.; Griffiths, M.D. Toward a consensus definition of pathological video-gaming: A systematic review of psychometric assessment tools. Clin. Psychol. Rev. 2013, 33, 331–342. [Google Scholar] [CrossRef] [PubMed] [Green Version]
Research Question Composition | Demographic Characteristics | IA Internet Addiction (CIAS > 56) | Significance | |
---|---|---|---|---|
No (n = 46) | Yes (n = 56) | p-Value | ||
Sex | Male | 36 (78.3%) | 34 (60.7%) | 0.086 a |
Female | 10 (21.7%) | 22 (39.3%) | ||
Performance | Middle | 24 (53.3%) | 23 (41.8%) | 0.315 a |
Worse | 21 (46.7%) | 32 (58.2%) | ||
Interpersonal | Good | 35 (77.8%) | 26 (47.3%) | 0.002 a |
relationship | Bad | 10 (22.2%) | 29 (52.7%) | |
ODD | No | 15 (32.6%) | 8 (14.3%) | 0.034 a |
Yes | 31 (67.4%) | 48 (85.7%) | ||
DMDD | No | 22 (47.8%) | 12 (21.4%) | 0.006 a |
Yes | 24 (52.2%) | 44 (78.6%) | ||
Comorbidity | Yes | 36 (78.3%) | 56 (100.0%) | <0.001 a |
No | 10 (21.7%) | 0 (0.0%) | ||
Subtype | Combined | 33 (71.7%) | 32 (57.1%) | 0.212 a |
Inattentive | 13 (28.3%) | 24 (42.9%) | ||
Family Psychiatric | Yes | 9 (19.6%) | 12 (21.4%) | 1.000 a |
History | No | 37 (80.4%) | 44 (78.6%) | |
Sibling with ADHD | Yes | 11 (23.9%) | 9 (16.1%) | 0.331 a |
No | 35 (76.1%) | 47 (83.9%) | ||
Daily on line | More than 1h | 20 (43.5%) | 46 (82.1%) | <0.001 a |
Chatting or Gaming | Less than 1h | 26 (56.5%) | 10 (17.9%) | |
Weekend on line | More than 3h | 18 (39.1%) | 48 (85.7%) | <0.001 a |
Chatting or Gaming | Less than 3h | 28 (60.9%) | 8 (14.3%) | |
Treatment Effect | Good | 12 (48.0%) | 13 (34.2%) | 0.303 a |
Bad | 13 (520.0%) | 25 (65.8%) | ||
Attend Parent Group | Yes | 6 (22.2%) | 9 (20.9%) | 1.000 a |
Program | No | 21 (77.8%) | 34 (79.1%) | |
Compliance | Good | 11 (45.8%) | 12 (30.8%) | 0.414 a |
Bad | 13 (54.2%) | 27 (69.2%) | ||
Height | 137.98 ± 18.02 | 149.09 ± 18.55 | 0.003 b | |
Weight | 34.34 ± 13.60 | 46.59 ± 18.39 | <0.001 b | |
Age | 10.07 ± 3.06 | 12.25 ± 3.64 | 0.002 b | |
Father’s Age | 42.67 ± 6.38 | 46.50 ± 7.81 | 0.009 b | |
Mother’s Age | 40.20 ± 7.41 | 43.38 ± 6.88 | 0.027 b | |
SNAP_1_9 | (Inattention) | 19.80 ± 3.06 | 21.30 ± 3.74 | 0.031 b |
SNAP_10_18 | (Hyperactivity) | 14.11 ± 6.91 | 13.89 ± 7.16 | 0.877 b |
SNAP_19_26 | (Emotionality) | 11.85 ± 6.20 | 14.18 ± 4.70 | 0.033 b |
DMDD Total | 1.09 ± 1.13 | 1.93 ± 1.04 | <0.001 b | |
CIAS | 41.02 ± 10.26 | 72.52 ± 11.00 | <0.001 b | |
DSMS-SF-T | 5.26 ± 4.54 | 14.75 ± 5.23 | <0.001 b |
Cut-off Valuea | (14/15) | (13/14) | (12/13) | (11/12) | (10/11) | (9/10) | (8/9) | (7/8) | (6/7) | (5/6) | (4/5) |
---|---|---|---|---|---|---|---|---|---|---|---|
Sensitivity | 0.446 | 0.607 | 0.661 | 0.732 | 0.839 | 0.893 | 0.929 | 0.964 | 0.964 | 0.982 | 0.982 |
Specificity | 1.000 | 0.935 | 0.935 | 0.870 | 0.848 | 0.826 | 0.696 | 0.652 | 0.609 | 0.587 | 0.500 |
LR+ b | NA | 9.310 | 10.131 | 5.613 | 5.515 | 5.134 | 3.051 | 2.772 | 2.464 | 2.378 | 1.964 |
LR− c | 0.554 | 0.420 | 0.363 | 0.308 | 0.190 | 0.130 | 0.103 | 0.055 | 0.059 | 0.030 | 0.036 |
AUC d | 0.723 | 0.771 | 0.798 | 0.801 | 0.844 | 0.859 | 0.812 | 0.808 | 0.786 | 0.785 | 0.741 |
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. |
© 2021 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).
Share and Cite
Chang, Y.-C.; Tzang, R.-F. Proposing and Validating the Diagnosis Scale for Internet Gaming Disorder in Taiwanese ADHD Adolescents: Likert Scale Method Based on the DSM-5. Int. J. Environ. Res. Public Health 2021, 18, 1492. https://doi.org/10.3390/ijerph18041492
Chang Y-C, Tzang R-F. Proposing and Validating the Diagnosis Scale for Internet Gaming Disorder in Taiwanese ADHD Adolescents: Likert Scale Method Based on the DSM-5. International Journal of Environmental Research and Public Health. 2021; 18(4):1492. https://doi.org/10.3390/ijerph18041492
Chicago/Turabian StyleChang, Yue-Cune, and Ruu-Fen Tzang. 2021. "Proposing and Validating the Diagnosis Scale for Internet Gaming Disorder in Taiwanese ADHD Adolescents: Likert Scale Method Based on the DSM-5" International Journal of Environmental Research and Public Health 18, no. 4: 1492. https://doi.org/10.3390/ijerph18041492