Evaluating ADHD Assessment for Dogs: A Replication Study
Abstract
:Simple Summary
Abstract
1. Introduction
Current Study
2. Materials and Methods
2.1. Ethics Statement
2.2. Subjects
2.3. Measures
2.3.1. Dog ARS
2.3.2. Dog ARS IDK
2.3.3. Covariates of Non-Interest
2.4. Methods, Statistical Analyses, and Samples Used for the Different Aims in the Present Study
2.4.1. Aim 1/Question 1: Is There a Difference between the Item Ratings of the Current (C Dog ARS) and the Prior Sample (V Dog ARS)?
2.4.2. Aim 2/Question 1: Is There a Difference between the Factor Structure of the Current (C Dog ARS) and the Prior Sample (V Dog ARS)?
2.4.3. Aim 2/Question 2: How Reliable Is the C Dog ARS across Time (40-Day Test–Retest Reliability) at the Level of the Total Score, Subscale Scores, and Individual Item Scores?
2.4.4. Aim 2/Question 3: To What Extent Are C Dog ARS Scores Associated with Dog Age, Sex and Training Status (External Validity)?
2.4.5. Aim 3/Question 1: Are There Any Ambiguous Items on the Dog ARS IDK-O, as Indicated by a High Proportion of Owner “I Don’t Know” Responses?
2.4.6. Aim 3/Question 2: Are There Any Ambiguous Items on the Dog ARS IDK-T, as Indicated by a High Proportion of Trainer “I Don’t Know” Responses?
2.4.7. Aim 4/Question 1: How Reliable Is the Dog Ars across Raters (Interrater Reliability), at the Level of the Total Score, Subscale Scores, and Individual Item Scores?
2.5. Statistical Analyses
2.5.1. Aim 1/Question 1: Is There a Difference between the Item Ratings of the Current (C Dog ARS) and the Prior Sample (V Dog ARS)?
2.5.2. Aim 2/Question 1: Is There a Difference between the Factor Structure of the Current (C Dog ARS) and the Prior Sample (V Dog ARS)?
2.5.3. Aim 2/Question 2: How Reliable Is the C Dog ARS across Time (40-Day Test–Retest Reliability) at the Level of the Total Score, Subscale Scores, and Individual Item Scores?
2.5.4. Aim 2/Question 3: To What Extent Are C Dog ARS Scores Associated with Dog Age, Sex, and Training Status (External Validity)?
2.5.5. Aim 3/Question 1: Are There Any Ambiguous Items on the Dog ARS IDK-O, as Indicated by a High Proportion of Owner “I Don’t Know” Responses?
2.5.6. Aim 3/Question 2: Are There Any Ambiguous Items on the Dog ARS IDK-T, as Indicated by a High Proportion of Trainer “I Don’t Know” Responses?
2.5.7. Aim 4/Question 1: How Reliable Is the Dog ARS across Raters (Interrater Reliability), at the Level of the Total Score, Subscale Scores, and Individual Item Scores?
3. Results
3.1. Aim 1/Question 1: Is There a Difference between the Item Ratings of the Current (C Dog ARS) and the Prior Sample Obtained by Vas and Colleagues (V Dog ARS)?
Stability of Item Scores
3.2. Aim 2/Question 1: Is There a Difference between the Factor Structure of the C Dog ARS and V Dog ARS?
3.2.1. Reliability of Subscales
3.2.2. Factor Analysis
3.3. Aim 2/Question 2: How Reliable Is the C Dog ARS across Time (40-Day Test-Retest Reliability) at the Level of the Total Score, Subscale Scores, and Individual Item Scores?
3.4. Aim 2/Question 3: To what Extent Are C Dog ARS Scores Associated with Dog Age, Sex, and Training Status (External Validity)?
3.4.1. Inattention
3.4.2. Hyperactivity/Impulsivity
3.5. Aim 3/Question 1: Are There Any Ambiguous Items on the Dog ARS IDK for Owners (Dog ARS IDK-O), as Indicated by a High Proportion of Owner “I Don’t Know” Responses?
3.6. Aim 3/Question 2: Are There Any Ambiguous Items on the Dog ARS IDK for Trainers (Dog ARS IDK-T), as Indicated by a High Proportion of Owner “I Don’t Know” Responses?
3.7. Aim 4/Question 1: How Reliable Is the Dog ARS IDK across Raters (Interrater Reliability), at the Level of the Total Score, Subscale Scores, and Individual Item Scores?
4. Discussion
5. Conclusions
Supplementary Materials
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
References
- Polanczyk, G.V.; Willcutt, E.G.; Salum, G.A.; Kieling, C.; Rohde, L.A. ADHD prevalence estimates across three decades: An updated systematic review and meta-regression analysis. Int. J. Epidemiol. 2014, 43, 434–442. [Google Scholar] [CrossRef] [PubMed]
- Matte, B.; Anselmi, L.; Salum, G.; Kieling, C.; Gonçalves, H.; Menezes, A.; Grevet, E.; Rohde, L.A. ADHD in DSM-5: A field trial in a large, representative sample of 18- to 19-year-old adults. Psychol. Med. 2015, 45, 361–373. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Fayyad, J.; De Graaf, R.; Kessler, R.; Alonso, J.; Angermeyer, M.; Demyttenaere, K.; de Girolamo, G.; Haro, J.M.; Karam, E.G.; Lara, C.; et al. Cross-national prevalence and correlates of adult attention-deficit hyperactivity disorder. Br. J. Psychiatry 2007, 190, 402–409. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- McBurnett, K.; Pfiffner, L.J.; Willcutt, E.; Tamm, L.; Lerner, M.; Ottolini, Y.L.; Furman, M.B. Experimental Cross-Validation of DSM-IV Types of Attention-Deficit/Hyperactivity Disorder. J. Am. Acad. Child Adolesc. Psychiatry 1999, 38, 17–24. [Google Scholar] [CrossRef]
- Evans, S.W.; Owens, J.S.; Bunford, N. Evidence-Based Psychosocial Treatments for Children and Adolescents with Attention-Deficit/Hyperactivity Disorder. J. Clin. Child Adolesc. Psychol. 2014, 43, 527–551. [Google Scholar] [CrossRef] [Green Version]
- Karalunas, S.L.; Nigg, J.T. Heterogeneity and Subtyping in Attention-Deficit/Hyperactivity Disorder—Considerations for Emerging Research Using Person-Centered Computational Approaches. Biol. Psychiatry 2020, 88, 103–110. [Google Scholar] [CrossRef]
- Barkley, R.A.; Murphy, K.R. Impairment in Occupational Functioning and Adult ADHD: The Predictive Utility of Executive Function (EF) Ratings Versus EF Tests. Arch. Clin. Neuropsychol. 2010, 25, 157–173. [Google Scholar] [CrossRef] [Green Version]
- Bunford, N.; Evans, S.W.; Wymbs, F. ADHD and Emotion Dysregulation Among Children and Adolescents. Clin. Child Fam. Psychol. Rev. 2015, 18, 185–217. [Google Scholar] [CrossRef]
- Gácsi, M.; Maros, K.; Sernkvist, S.; Faragó, T.; Miklosi, A. Human Analogue Safe Haven Effect of the Owner: Behavioural and Heart Rate Response to Stressful Social Stimuli in Dogs. PLoS ONE 2013, 8, e58475. [Google Scholar] [CrossRef] [Green Version]
- Topál, J.; Gergely, G.; Erdőhegyi, A.; Csibra, G.; Miklósi, A. Differential Sensitivity to Human Communication in Dogs, Wolves, and Human Infants. Science 2009, 325, 1269–1272. [Google Scholar] [CrossRef] [Green Version]
- Miklósi, A.; Topál, J.; Csányi, V. Comparative social cognition: What can dogs teach us? Anim. Behav. 2004, 67, 995–1004. [Google Scholar] [CrossRef]
- Topál, J.; Román, V.; Turcsán, B. The dog (Canis familiaris) as a translational model of autism: It is high time we move from promise to reality. Wiley Interdiscip. Rev. Cogn. Sci. 2019, 10, e1495. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Bunford, N.; Csibra, B.; Peták, C.; Ferdinandy, B.; Miklósi, A.; Gácsi, M. Associations among behavioral inhibition and owner-rated attention, hyperactivity/impulsivity, and personality in the domestic dog (Canis familiaris). J. Comp. Psychol. 2019, 133, 233–243. [Google Scholar] [CrossRef] [PubMed]
- Vas, J.; Topál, J.; Péch, A.; Miklósi, A. Measuring attention deficit and activity in dogs: A new application and validation of a human ADHD questionnaire. Appl. Anim. Behav. Sci. 2007, 103, 105–117. [Google Scholar] [CrossRef]
- Wright, H.F.; Mills, D.S.; Pollux, P.M.J. Development and Validation of a Psychometric Tool ForAssessing Impulsivity in the Domestic Dog (Canis Familiaris). Int. J. Comp. Psychol. 2011, 24, 210–225. [Google Scholar]
- Wan, M.; Hejjas, K.; Ronai, Z.; Elek, Z.; Sasvari-Szekely, M.; Champagne, F.A.; Miklósi, A.; Kubinyi, E. DRD4andTHgene polymorphisms are associated with activity, impulsivity and inattention in Siberian Husky dogs. Anim. Genet. 2013, 44, 717–727. [Google Scholar] [CrossRef] [Green Version]
- Gerencsér, L.; Bunford, N.; Moesta, A.; Miklósi, A. Development and validation of the Canine Reward Responsiveness Scale –Examining individual differences in reward responsiveness of the domestic dog. Sci. Rep. 2018, 8, 4421. [Google Scholar] [CrossRef] [Green Version]
- Puurunen, J.; Sulkama, S.; Tiira, K.; Araujo, C.; Lehtonen, M.; Hanhineva, K.; Lohi, H. A non-targeted metabolite profiling pilot study suggests that tryptophan and lipid metabolisms are linked with ADHD-like behaviours in dogs. Behav. Brain Funct. 2016, 12, 27. [Google Scholar] [CrossRef] [Green Version]
- Pelham, J.W.E.; Fabiano, G.A.; Massetti, G. Evidence-Based Assessment of Attention Deficit Hyperactivity Disorder in Children and Adolescents. J. Clin. Child Adolesc. Psychol. 2005, 34, 449–476. [Google Scholar] [CrossRef]
- Booster, G.D.; Dupaul, G.J.; Eiraldi, R.; Power, T.J. Functional Impairments in Children With ADHD: Unique Effects of Age and Comorbid Status. J. Atten. Disord. 2010, 16, 179–189. [Google Scholar] [CrossRef]
- Reyes, A.D.L.; Augenstein, T.M.; Wang, M.; Thomas, S.A.; Drabick, D.A.G.; Burgers, D.E.; Rabinowitz, J. The validity of the multi-informant approach to assessing child and adolescent mental health. Psychol. Bull. 2015, 141, 858–900. [Google Scholar] [CrossRef] [PubMed]
- DuPaul, G.J.; Power, T.J.; Anastopoulos, A.D.; Reid, R. ADHD Rating Scale—IV: Checklists, Norms, and Clinical Interpretation; Guilford Press: New York, NY, USA, 1998; p. 79. ISBN 978-1-57230-423-9. [Google Scholar]
- Hoppe, N.; Bininda-Emonds, O.R.P.; Gansloßer, U. Correlates of Attention Deficit Hyperactivity Disorder (ADHD)-Like Behavior in Domestic Dogs: First Results from a Questionnaire-Based Study. Vet.- Med. Open J. 2017, 2, 95–131. [Google Scholar] [CrossRef]
- Salonen, M.; Sulkama, S.; Mikkola, S.; Puurunen, J.; Hakanen, E.; Tiira, K.; Araujo, C.; Lohi, H. Prevalence, comorbidity, and breed differences in canine anxiety in 13,700 Finnish pet dogs. Sci. Rep. 2020, 10, 2962. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Sulkama, S.; Puurunen, J.; Salonen, M.; Mikkola, S.; Hakanen, E.; Araujo, C.; Lohi, H. Canine hyperactivity, impulsivity, and inattention share similar demographic risk factors and behavioural comorbidities with human ADHD. Transl. Psychiatry 2021, 11, 501. [Google Scholar] [CrossRef]
- Watson, F.; Packer, R.M.A.; Rusbridge, C.; Volk, H.A. Behavioural changes in dogs with idiopathic epilepsy. Vet. Rec. 2020, 186, 93. [Google Scholar] [CrossRef] [Green Version]
- Hejjas, K.; Vas, J.; Kubinyi, E.; Sasvari-Szekely, M.; Miklósi, A.; Rónai, Z. Novel repeat polymorphisms of the dopaminergic neurotransmitter genes among dogs and wolves. Mamm. Genome 2007, 18, 871–879. [Google Scholar] [CrossRef]
- Hejjas, K.; Vas, J.; Topál, J.; Szántai, E.; Rónai, Z.; Székely, A.; Kubinyi, E.; Horvath, Z.; Sasvári-Székely, M.; Miklosi, A. Association of polymorphisms in the dopamine D4 receptor gene and the activity-impulsivity endophenotype in dogs. Anim. Genet. 2007, 38, 629–633. [Google Scholar] [CrossRef]
- Kubinyi, E.; Vas, J.; Hejjas, K.; Ronai, Z.; Brúder, I.; Turcsán, B.; Sasvari-Szekely, M.; Miklosi, A. Polymorphism in the Tyrosine Hydroxylase (TH) Gene Is Associated with Activity-Impulsivity in German Shepherd Dogs. PLoS ONE 2012, 7, e30271. [Google Scholar] [CrossRef] [Green Version]
- Lit, L.; Belanger, J.M.; Boehm, D.; Lybarger, N.; Haverbeke, A.; Diederich, C.; Oberbauer, A.M. Characterization of a dopamine transporter polymorphism and behavior in Belgian Malinois. BMC Genet. 2013, 14, 45. [Google Scholar] [CrossRef] [Green Version]
- Bunford, N.; Csibra, B.; Gácsi, M. Individual Differences in Response to Ambiguous Stimuli in a Modified Go/No-Go Paradigm are Associated with Personality in Family Dogs. Sci. Rep. 2019, 9, 11067. [Google Scholar] [CrossRef]
- Mongillo, P.; Bono, G.; Regolin, L.; Marinelli, L. Selective attention to humans in companion dogs, Canis familiaris. Anim. Behav. 2010, 80, 1057–1063. [Google Scholar] [CrossRef]
- Bray, E.E.; Sammel, M.D.; Seyfarth, R.M.; Serpell, J.; Cheney, D.L. Temperament and problem solving in a population of adolescent guide dogs. Anim. Cogn. 2017, 20, 923–939. [Google Scholar] [CrossRef] [PubMed]
- Kubinyi, E.; Gosling, S.D.; Miklósi, A. A comparison of rating and coding behavioural traits in dogs. Acta Biol. Hung. 2015, 66, 27–40. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Wan, M.; Kubinyi, E.; Miklósi, A.; Champagne, F. A cross-cultural comparison of reports by German Shepherd owners in Hungary and the United States of America. Appl. Anim. Behav. Sci. 2009, 121, 206–213. [Google Scholar] [CrossRef]
- Mick, E.; Faraone, S.V.; Biederman, J. Age-dependent expression of attention-deficit/hyperactivity disorder symptoms. Psychiatr. Clin. N. Am. 2004, 27, 215–224. [Google Scholar] [CrossRef]
- Biederman, J.; Mick, E.; Faraone, S.V. Age-Dependent Decline of Symptoms of Attention Deficit Hyperactivity Disorder: Impact of Remission Definition and Symptom Type. Am. J. Psychiatry 2000, 157, 816–818. [Google Scholar] [CrossRef]
- Lit, L.; Schweitzer, J.B.; Iosif, A.-M.; Oberbauer, A.M. Owner reports of attention, activity, and impulsivity in dogs: A replication study. Behav. Brain Funct. 2010, 6, 28. [Google Scholar] [CrossRef] [Green Version]
- Costello, A.B.; Osborne, J.W. Best practices in exploratory factor analysis: Four recommendations for getting the most from your analysis. Pract. Assess. Res. Eval. 2005, 10, 1–9. [Google Scholar] [CrossRef]
- Cicchetti, D.V. Guidelines, Criteria, and Rules of Thumb for Evaluating Normed and Standardized Assessment Instruments in Psychology. Psychol. Assess. 1994, 6, 7. [Google Scholar] [CrossRef]
- Vaz, S.; Falkmer, T.; Passmore, A.E.; Parsons, R.; Andreou, P. The Case for Using the Repeatability Coefficient When Calculating Test–Retest Reliability. PLoS ONE 2013, 8, e73990. [Google Scholar] [CrossRef]
- Riemer, S.; Mills, D.S.; Wright, H. Impulsive for life? The nature of long-term impulsivity in domestic dogs. Anim. Cogn. 2014, 17, 815–819. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Baker, S.R.; Gibson, B.J.; Sufi, F.; Barlow, A.P.S.; Robinson, P.G. 9—The Dentine Hypersensitivity Experience Questionnaire (DHEQ): A Longitudinal Validation Study. In Dentine Hypersensitivity; Robinson, P.G., Ed.; Academic Press: Boston, MA, USA, 2015; pp. 141–154. ISBN 978-0-12-801631-2. [Google Scholar]
- Rindskopf, D. Reliability: Measurement. In International Encyclopedia of the Social & Behavioral Sciences; Smelser, N.J., Baltes, P.B., Eds.; Pergamon: Oxford, UK, 2001; pp. 13023–13028. ISBN 978-0-08-043076-8. [Google Scholar]
- Wright, H.F.; Mills, D.S.; Pollux, P.M. Behavioural and physiological correlates of impulsivity in the domestic dog (Canis familiaris). Physiol. Behav. 2012, 105, 676–682. [Google Scholar] [CrossRef] [Green Version]
- Brucks, D.; Soliani, M.; Range, F.; Marshall-Pescini, S. Reward type and behavioural patterns predict dogs’ success in a delay of gratification paradigm. Sci. Rep. 2017, 7, 42459. [Google Scholar] [CrossRef] [PubMed]
- De Los Reyes, A.; Kazdin, A.E. Informant Discrepancies in the Assessment of Childhood Psychopathology: A Critical Review, Theoretical Framework, and Recommendations for Further Study. Psychol. Bull. 2005, 131, 483–509. [Google Scholar] [CrossRef]
- Narad, M.E.; Garner, A.A.; Peugh, J.L.; Tamm, L.; Antonini, T.N.; Kingery, K.M.; Simon, J.O.; Epstein, J.N. Parent–teacher agreement on ADHD symptoms across development. Psychol. Assess. 2015, 27, 239–248. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Shrout, P.E.; Fleiss, J.L. Intraclass correlations: Uses in assessing rater reliability. Psychol. Bull. 1979, 86, 420–428. [Google Scholar] [CrossRef] [PubMed]
- Sundvall, L.; Ingerslev, H.J.; Knudsen, U.B.; Kirkegaard, K. Inter- and intra-observer variability of time-lapse annotations. Hum. Reprod. 2013, 28, 3215–3221. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Rowan, A.; Kartal, T. Dog Population & Dog Sheltering Trends in the United States of America. Animals 2018, 8, 68. [Google Scholar] [CrossRef] [Green Version]
- Kubinyi, E.; Turcsán, B.; Miklósi, Á. Dog and owner demographic characteristics and dog personality trait associations. Behav. Process. 2009, 81, 392–401. [Google Scholar] [CrossRef]
- Wallis, L.J.; Range, F.; Müller, C.A.; Serisier, S.; Huber, L.; Zsó, V. Lifespan development of attentiveness in domestic dogs: Drawing parallels with humans. Front. Psychol. 2014, 5, 71. [Google Scholar] [CrossRef] [Green Version]
- Marck, A.; Berthelot, G.; Foulonneau, V.; Marc, A.; Antero, J.; Noirez, P.; Bronikowski, A.M.; Morgan, T.; Garland, T.; Carter, P.A.; et al. Age-Related Changes in Locomotor Performance Reveal a Similar Pattern for Caenorhabditis elegans, Mus domesticus, Canis familiaris, Equus caballus, and Homo sapiens. J. Gerontol. Ser. A 2017, 72, 455–463. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Hardy, K.K.; Kollins, S.H.; Murray, D.W.; Riddle, M.A.; Greenhill, L.; Cunningham, C.; Abikoff, H.B.; McCracken, J.T.; Vitiello, B.; Davies, M.; et al. Factor Structure of Parent- and Teacher-Rated Attention-Deficit/Hyperactivity Disorder Symptoms in the Preschoolers with Attention-Deficit/Hyperactivity Disorder Treatment Study (PATS). J. Child Adolesc. Psychopharmacol. 2007, 17, 621–633. [Google Scholar] [CrossRef] [PubMed]
- Abnorm, J.; Psychol, C.; Pennington, B.F.; Hartman, C.A. Modeling Rater Disagreement for ADHD: Are Parents or Teachers Biased? J. Abnorm. Child Psychol. 2007, 35, 536–542. [Google Scholar]
- Mitsis, E.M.; McKAY, K.E.; Schulz, K.P.; Newcorn, J.H.; Halperin, J.M. Parent–Teacher Concordance for DSM-IV Attention-Deficit/Hyperactivity Disorder in a Clinic-Referred Sample. J. Am. Acad. Child Adolesc. Psychiatry 2000, 39, 308–313. [Google Scholar] [CrossRef]
- Wolraich, M.L.; Lambert, E.W.; Bickman, L.; Simmons, T.; Doffing, M.A.; Worley, K.A. Assessing the Impact of Parent and Teacher Agreement on Diagnosing Attention-Deficit Hyperactivity Disorder. J. Dev. Behav. Pediatr. 2004, 25, 41–47. [Google Scholar] [CrossRef]
- Weckerly, J.; Aarons, G.A.; Leslie, L.K.; Garland, A.F.; Landsverk, J.; Hough, R.L. Attention on Inattention: The Differential Effect of Caregiver Education on Endorsement of ADHD Symptoms. J. Dev. Behav. Pediatr. JDBP 2005, 26, 201–208. [Google Scholar] [CrossRef]
- Faraone, S.V.; Biederman, J.; Milberger, S. How Reliable Are Maternal Reports of Their Children’s Psychopathology? One-Year Recall of Psychiatric Diagnoses of ADHD Children. J. Am. Acad. Child Adolesc. Psychiatry 1995, 34, 1001–1008. [Google Scholar] [CrossRef]
- Flint, H.E.; Coe, J.B.; Pearl, D.L.; Serpell, J.A.; Niel, L. Effect of training for dog fear identification on dog owner ratings of fear in familiar and unfamiliar dogs. Appl. Anim. Behav. Sci. 2018, 208, 66–74. [Google Scholar] [CrossRef]
- Masson, S.; Gaultier, E. Retrospective Study on Hypersensitivity-Hyperactivity Syndrome in Dogs: Long-Term Outcome of High Dose Fluoxetine Treatment and Proposal of a Clinical Score. Dog Behav. 2018, 4, 15–35. [Google Scholar] [CrossRef]
- Evans, S.W.; Brady, C.E.; Harrison, J.; Bunford, N.; Kern, L.; State, T.; Andrews, C. Measuring ADHD and ODD Symptoms and Impairment Using High School Teachers’ Ratings. J. Clin. Child Adolesc. Psychol. 2013, 42, 197–207. [Google Scholar] [CrossRef]
- Caterino, L.C.; Gómez-Benito, J.; Balluerka, N.; Amador-Campos, J.A.; Stock, W.A. Development and validation of a scale to assess the symptoms of attention-deficit/hyperactivity disorder in young adults. Psychol. Assess. 2009, 21, 152–161. [Google Scholar] [CrossRef] [PubMed]
- Span, S.A.; Earleywine, M.; Strybel, T.Z. Confirming the Factor Structure of Attention Deficit Hyperactivity Disorder Symptoms in Adult, Nonclinical Samples. J. Psychopathol. Behav. Assess. 2002, 24, 129–136. [Google Scholar] [CrossRef]
- Glutting, J.J.; Youngstrom, E.A.; Watkins, M.W. ADHD and College Students: Exploratory and Confirmatory Factor Structures with Student and Parent Data. Psychol. Assess. 2005, 17, 44–55. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Martel, M.M.; Levinson, C.A.; Langer, J.K.; Nigg, J.T. A Network Analysis of Developmental Change in ADHD Symptom Structure from Preschool to Adulthood. Clin. Psychol. Sci. 2016, 4, 988–1001. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Connor, D.F.; Chartier, K.; Preen, E.C.; Kaplan, R.F. Impulsive Aggression in Attention-Deficit/Hyperactivity Disorder: Symptom Severity, Co-Morbidity, and Attention-Deficit/Hyperactivity Disorder Subtype. J. Child Adolesc. Psychopharmacol. 2010, 20, 119–126. [Google Scholar] [CrossRef] [PubMed]
- Dowson, J.H.; Blackwell, A.D. Impulsive aggression in adults with attention-deficit/hyperactivity disorder. Acta Psychiatr. Scand. 2010, 121, 103–110. [Google Scholar] [CrossRef] [PubMed]
Study | Measure | Factors and Number of Items | Psychometric Property | |||
---|---|---|---|---|---|---|
Internal Consistency | Test–Retest Reliability | Convergent Validity | Expert Rating | |||
Vas et al., 2007 [14] | ADHD | IA (6) | Acceptable internal consistency | – | Age is not a key correlate of ADHD | – |
H/I (7) | ||||||
Lit et al., 2010 [38] | ADHD | IA (6) | Only on a priori subscales | – | No key correlates | – |
H/I-1 (4) | ||||||
H/I-2 (2) | ||||||
Wright et al., 2011 [15] | I | Behavioural regulation (8) | Unacceptable Cronbach’s alpha on the Responsiveness factor (=0.44) | Pearson’s correlation between test and retest scores | Two items were correlated with the total questionnaire scores, contradictory results with behaviour tests | – |
Aggression and response to novelty (5) | ||||||
Responsiveness (5) |
Aim/Question | Method | Sample |
---|---|---|
A1. Replicability of the Dog ARS at the item level Q1. Stability of item ratings | Comparing current and previously obtained data: Q1. Average item ratings and SDs | Q1.: V Dog ARS (N = 220) vs. C Dog ARS (N = 319) |
A2. General replicability of the Dog ARS Q1. Stability of factor structure Q2. Test-retest reliability of the Dog ARS Q3. Effect of age, sex, and training status on subscales | Comparing current and previously obtained data: Q1. Exploratory factor analysis, Cronbach’s alpha Q2. Intraclass correlation coefficient and item level, agreement rate (%) between test–retest ratings Q3. GLM | Q1. and Q3.: V Dog ARS (N = 220) vs. C Dog ARS (N = 319) Q2.: C Dog ARS vs. its retest (n = 140/319) |
A3. Identification of ambiguous items in the Dog ARS Q1. Identify ambiguous items for owners Q2. Identify ambiguous items for trainers and owners | Q1. & Q2.: Inclusion of an “I don’t know” response option for each item | Q1.: Dog ARS IDK-O (N = 520) Q2.: Dog ARS IDK-T subsample: (n = 86/520) |
A4. Owner vs. Trainer ratings on the Dog ARS Q1. Interrater reliability at the level of the total score, subscale scores, and individual item scores | Comparing owner and trainer ratings: Q1.: Intraclass correlation coefficient and item level agreement rate (%) between trainer-owner ratings | Q1.: Dog ARS IDK-T subsample: (n = 86/520) |
Items | M (SD) | Difference between Variance and Means (Levene’s Test and Independent Samples t-Tests) | Corrected Item—Total Correlation | Cronbach’s Alpha If Item Deleted | Cronbach’s Alpha | ||||
---|---|---|---|---|---|---|---|---|---|
V | C | V | C | V | C | V | C | ||
Inattention subscale | 0.78 | 0.81 | |||||||
1. My/this dog has learning difficulties, because it is careless or because other things easily attract its attention. | 0.71 (0.73) | 0.84 (0.69) | F(454) = 6.26, p = 0.013 * t(454) = −2.04, p = 0.042 * | 0.58 | 0.72 | 0.74 | 0.75 | ||
2. It is easy to attract my/this dog’s attention, but it also quickly loses interest. | 0.82 (0.84) | 0.98 (0.76) | F(441) = 13.44, p < 0.001 * t(441) = −2.23, p = 0.026 * | 0.64 | 0.60 | 0.72 | 0.78 | ||
3. It is difficult for my/this dog to concentrate on a task or play. | 0.50 (0.69) | 0.59 (0.63) | F(537) = 1.37, p = 0.242 t(537) = −1.69, p = 0.091 | 0.58 | 0.62 | 0.74 | 0.78 | ||
7. It seems that my/this dog does not listen even if it knows that someone is directly speaking to him/her. | 0.50 (0.70) | 0.56 (0.67) | F(537) = 0.20, p = 0.654 t(537) = −0.94, p = 0.346 | 0.41 | 0.45 | 0.78 | 0.81 | ||
10. My/this dog solves simple tasks easily, but he/she often has difficulties with complicated tasks, even if those are known or have been often practiced. | 0.66 (0.77) | 0.62 (0.67) | F(425) = 5.24, p = 0.022 * t(425) = 0.55, p = 0.584 | 0.48 | 0.47 | 0.76 | 0.81 | ||
12. My/this dog’s attention can be easily distracted. | 0.96 (0.79) | 1.15 (0.72) | F(537) = 0.37, p = 0.545 t(537) = −2.84, p = 0.005 * | 0.50 | 0.62 | 0.76 | 0.77 | ||
Hyperactivity/impulsivity subscale | 0.73 | 0.78 | |||||||
4. My/this dog leaves from its place when it should stay. | 1.20 (0.96) | 1.08 (0.74) | F(391 = 34.60, p < 0.001 * t(391) = 1.58, p = 0.114 | 0.35 | 0.43 | 0.72 | 0.77 | ||
5. My/this dog cannot be quiet or easily calmed. | 0.81 (0.98) | 0.83 (0.91) | F(537) = 2.34, p = 0.127 t(537) = −0.25, p = 0.806 | 0.40 | 0.42 | 0.71 | 0.77 | ||
6. My/this dog fidgets all the time. | 1.39 (1.10) | 1.18 (0.93) | F(415) = 22.99, p < 0.001 * t(415) = 2.38, p = 0.018 * | 0.58 | 0.58 | 0.67 | 0.74 | ||
8. My/this dog is excessive or difficult to control, or if it lunges, it is difficult to hold back. | 0.71 (0.81) | 0.76 (0.80) | F(537) = 0.001, p = 0.972 t(537) = −0.59, p = 0.553 | 0.55 | 0.61 | 0.68 | 0.73 | ||
9. My/this dog would always play and run. | 1.40 (1.00) | 1.30 (0.92) | F(537) = 3.54, p = 0.060 t(537) = 1.23, p = 0.220 | 0.45 | 0.50 | 0.70 | 0.76 | ||
11. My/this dog is likely to react hastily, and that is why it is failing tasks. | 0.93 (0.84) | 1.02 (0.74) | F(537) = 7.94, p = 0.005 * t(537) = −1.27, p = 0.206 | 0.37 | 0.49 | 0.72 | 0.76 | ||
13. My/this dog cannot wait as it has no self-control. | 0.98 (0.98) | 1.10 (0.90) | F(537) = 1.48, p = 0.224 t(537) = −1.51, p = 0.131 | 0.45 | 0.52 | 0.70 | 0.75 |
Aimed to Measure | Item | Factor 1 | Factor 2 | ||
---|---|---|---|---|---|
V | C | V | C | ||
Inattention | Item 3 | 0.765 | 0.800 | −0.120 | 0.016 |
Item 1 | 0.729 | 0.781 | 0.134 | 0.270 | |
Item 2 | 0.795 | 0.772 | −0.043 | −0.012 | |
Item 12 | 0.584 | 0.700 | 0.366 | 0.305 | |
Item 10 | 0.664 | 0.578 | 0.039 | 0.209 | |
Item 7 | 0.512 | 0.485 | 0.218 | 0.337 | |
Hyperactivity/impulsivity | Item 6 | −0.119 | −0.026 | 0.794 | 0.822 |
Item 9 | −0.157 | −0.010 | 0.715 | 0.759 | |
Item 8 | 0.308 | 0.325 | 0.682 | 0.699 | |
Item 11 | 0.207 | 0.299 | 0.517 | 0.558 | |
Item 13 | 0.096 | 0.334 | 0.581 | 0.538 | |
Item 5 | 0.091 | 0.167 | 0.515 | 0.503 | |
* Item 4 | 0.377 | 0.432 | 0.392 | 0.411 |
Item | Interrater Agreement (Owner–Trainer) | Test–Retest Agreement (Owner) |
---|---|---|
Inattention subscale | ||
1. My/this dog has learning difficulties because it is careless or because other things easily attract its attention. | 55.3% | 67.4% |
2. It is easy to attract my/this dog’s attention, but it also quickly loses interest. | 47.1% | 63.1% |
3. It is difficult for my/this dog to concentrate on a task or play. | 55.3% | 68.1% |
7. It seems that my/this dog does not listen even if it knows that someone is directly speaking to him/her. | 52.9% | 66.7% |
10. My/this dog solves simple tasks easily, but he/she often has difficulties with complicated tasks, even if those are known or have been often practiced. | 35.5% | 63.8% |
12. My/this dog’s attention can be easily distracted. | 50.6% | 61.7% |
Hyperactivity/impulsivity subscale | ||
4. My/this dog leaves from its place when it should stay. | 57.8% | 67.4% |
5. My/this dog cannot be quiet or easily calmed. | 47.1% | 61.0% |
6. My/this dog fidgets all the time. | 47.1% | 58.9% |
8. My/this dog is excessive or difficult to control, or if it lunges, it is difficult to hold back. | 42.9% | 64.5% |
9. My/this dog would always play and run. | 44.2% | 65.2% |
11. My/this dog is likely to react hastily and that is why it is failing tasks. | 46.9% | 62.4% |
13. My/this dog cannot wait as it has no self-control. | 47.6% | 53.9% |
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. |
© 2022 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Csibra, B.; Bunford, N.; Gácsi, M. Evaluating ADHD Assessment for Dogs: A Replication Study. Animals 2022, 12, 807. https://doi.org/10.3390/ani12070807
Csibra B, Bunford N, Gácsi M. Evaluating ADHD Assessment for Dogs: A Replication Study. Animals. 2022; 12(7):807. https://doi.org/10.3390/ani12070807
Chicago/Turabian StyleCsibra, Barbara, Nóra Bunford, and Márta Gácsi. 2022. "Evaluating ADHD Assessment for Dogs: A Replication Study" Animals 12, no. 7: 807. https://doi.org/10.3390/ani12070807
APA StyleCsibra, B., Bunford, N., & Gácsi, M. (2022). Evaluating ADHD Assessment for Dogs: A Replication Study. Animals, 12(7), 807. https://doi.org/10.3390/ani12070807