Interformat Reliability of Web-Based Parent-Rated Questionnaires for Assessing Neurodevelopmental Disorders Among Preschoolers: Cross-sectional Community Study

Overview

Journal JMIR Pediatr Parent

Date 2021 Jan 18

PMID 33455899

Citations 1

Authors

Masanori Tanaka

Manabu Saito

Michio Takahashi

Masaki Adachi

Kazuhiko Nakamura

Affiliations

Soon will be listed here.

Abstract

Background: Early detection and intervention for neurodevelopmental disorders are effective. Several types of paper questionnaires have been developed to assess these conditions in early childhood; however, the psychometric equivalence between the web-based and the paper versions of these questionnaires is unknown.

Objective: This study examined the interformat reliability of the web-based parent-rated version of the Autism Spectrum Screening Questionnaire (ASSQ), Attention-Deficit/Hyperactivity Disorder Rating Scale (ADHD-RS), Developmental Coordination Disorder Questionnaire 2007 (DCDQ), and Strengths and Difficulties Questionnaire (SDQ) among Japanese preschoolers in a community developmental health check-up setting.

Methods: A set of paper-based questionnaires were distributed for voluntary completion to parents of children aged 5 years. The package of the paper format questionnaires included the ASSQ, ADHD-RS, DCDQ, parent-reported SDQ (P-SDQ), and several additional demographic questions. Responses were received from 508 parents of children who agreed to participate in the study. After 3 months, 300 parents, who were among the initial responders, were randomly selected and asked to complete the web-based versions of these questionnaires. A total of 140 parents replied to the web-based format and were included as a final sample in this study.

Results: We obtained the McDonald ω coefficients for both the web-based and paper formats of the ASSQ (web-based: ω=.90; paper: ω=.86), ADHD-RS total and subscales (web-based: ω=.88-.94; paper: ω=.87-.93), DCDQ total and subscales (web-based: ω=.82-.94; paper: ω=.74-.92), and P-SDQ total and subscales (web-based: ω=.55-.81; paper: ω=.52-.80). The intraclass correlation coefficients between the web-based and paper formats were all significant at the 99.9% confidence level: ASSQ (r=0.66, P<.001); ADHD-RS total and subscales (r=0.66-0.74, P<.001); DCDQ total and subscales (r=0.66-0.71, P<.001); P-SDQ Total Difficulties and subscales (r=0.55-0.73, P<.001). There were no significant differences between the web-based and paper formats for total mean score of the ASSQ (P=.76), total (P=.12) and subscale (P=.11-.47) mean scores of DCDQ, and the P-SDQ Total Difficulties mean score (P=.20) and mean subscale scores (P=.28-.79). Although significant differences were found between the web-based and paper formats for mean ADHD-RS scores (total: t=2.83, P=.005; Inattention subscale: t=2.15, P=.03; Hyperactivity/Impulsivity subscale: t=3.21, P=.002), the effect sizes were small (Cohen d=0.18-0.22).

Conclusions: These results suggest that the web-based versions of the ASSQ, ADHD-RS, DCDQ, and P-SDQ were equivalent, with the same level of internal consistency and intrarater reliability as the paper versions, indicating the applicability of the web-based versions of these questionnaires for assessing neurodevelopmental disorders.

Citing Articles

The Current Knowledge, Attitudes, and Practices of the Neglected Methodology of Web-Based Questionnaires Among Chinese Health Workers: Web-Based Questionnaire Study.

Fang H, Lv Y, Chen L, Zhang X, Hu Y J Med Internet Res. 2022; 25:e41591.

PMID: 36533302 PMC: 9919466. DOI: 10.2196/41591.

References

Cousins M, Smyth M . Developmental coordination impairments in adulthood. Hum Mov Sci. 2003; 22(4-5):433-59. DOI: 10.1016/j.humov.2003.09.003. View

Ritter P, Lorig K, Laurent D, Matthews K . Internet versus mailed questionnaires: a randomized comparison. J Med Internet Res. 2004; 6(3):e29. PMC: 1550608. DOI: 10.2196/jmir.6.3.e29. View

Schoenfelder E, Kollins S . Topical Review: ADHD and Health-Risk Behaviors: Toward Prevention and Health Promotion. J Pediatr Psychol. 2016; 41(7):735-40. PMC: 6281045. DOI: 10.1093/jpepsy/jsv162. View

Koo T, Li M . A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research. J Chiropr Med. 2016; 15(2):155-63. PMC: 4913118. DOI: 10.1016/j.jcm.2016.02.012. View

Alfonsson S, Maathz P, Hursti T . Interformat reliability of digital psychiatric self-report questionnaires: a systematic review. J Med Internet Res. 2014; 16(12):e268. PMC: 4275488. DOI: 10.2196/jmir.3395. View

Buchanan T . Internet-based questionnaire assessment: appropriate use in clinical contexts. Cogn Behav Ther. 2005; 32(3):100-9. DOI: 10.1080/16506070310000957. View

Braekman E, Berete F, Charafeddine R, Demarest S, Drieskens S, Gisle L . Measurement agreement of the self-administered questionnaire of the Belgian Health Interview Survey: Paper-and-pencil versus web-based mode. PLoS One. 2018; 13(5):e0197434. PMC: 5962098. DOI: 10.1371/journal.pone.0197434. View

Adachi M, Takahashi M, Takayanagi N, Yoshida S, Yasuda S, Tanaka M . Adaptation of the Autism Spectrum Screening Questionnaire (ASSQ) to preschool children. PLoS One. 2018; 13(7):e0199590. PMC: 6038992. DOI: 10.1371/journal.pone.0199590. View

Strang J, Kenworthy L, Daniolos P, Case L, Wills M, Martin A . Depression and Anxiety Symptoms in Children and Adolescents with Autism Spectrum Disorders without Intellectual Disability. Res Autism Spectr Disord. 2012; 6(1):406-412. PMC: 3355529. DOI: 10.1016/j.rasd.2011.06.015. View

10.

Takayanagi N, Yoshida S, Yasuda S, Adachi M, Kaneda-Osato A, Tanaka M . Psychometric properties of the Japanese ADHD-RS in preschool children. Res Dev Disabil. 2016; 55:268-78. DOI: 10.1016/j.ridd.2016.05.002. View

11.

Landa R . Efficacy of early interventions for infants and young children with, and at risk for, autism spectrum disorders. Int Rev Psychiatry. 2018; 30(1):25-39. PMC: 6034700. DOI: 10.1080/09540261.2018.1432574. View

12.

Matsuishi T, Nagano M, Araki Y, Tanaka Y, Iwasaki M, Yamashita Y . Scale properties of the Japanese version of the Strengths and Difficulties Questionnaire (SDQ): a study of infant and school children in community samples. Brain Dev. 2008; 30(6):410-5. DOI: 10.1016/j.braindev.2007.12.003. View

13.

Saito M, Hirota T, Sakamoto Y, Adachi M, Takahashi M, Osato-Kaneda A . Prevalence and cumulative incidence of autism spectrum disorders and the patterns of co-occurring neurodevelopmental disorders in a total population sample of 5-year-old children. Mol Autism. 2020; 11(1):35. PMC: 7227343. DOI: 10.1186/s13229-020-00342-5. View

14.

Hollandare F, Andersson G, Engstrom I . A comparison of psychometric properties between internet and paper versions of two depression instruments (BDI-II and MADRS-S) administered to clinic patients. J Med Internet Res. 2010; 12(5):e49. PMC: 3057311. DOI: 10.2196/jmir.1392. View

15.

Kim Y, Fombonne E, Koh Y, Kim S, Cheon K, Leventhal B . A comparison of DSM-IV pervasive developmental disorder and DSM-5 autism spectrum disorder prevalence in an epidemiologic sample. J Am Acad Child Adolesc Psychiatry. 2014; 53(5):500-8. PMC: 4058782. DOI: 10.1016/j.jaac.2013.12.021. View

16.

Ehlers S, Gillberg C, Wing L . A screening questionnaire for Asperger syndrome and other high-functioning autism spectrum disorders in school age children. J Autism Dev Disord. 1999; 29(2):129-41. DOI: 10.1023/a:1023040610384. View

17.

Howlin P, Magiati I . Autism spectrum disorder: outcomes in adulthood. Curr Opin Psychiatry. 2017; 30(2):69-76. DOI: 10.1097/YCO.0000000000000308. View

18.

Doi Y, Ishihara K, Uchiyama M . Reliability of the strengths and difficulties questionnaire in Japanese preschool children aged 4-6 years. J Epidemiol. 2014; 24(6):514-8. PMC: 4213227. View

19.

Daley D, Van der Oord S, Ferrin M, Danckaerts M, Doepfner M, Cortese S . Behavioral interventions in attention-deficit/hyperactivity disorder: a meta-analysis of randomized controlled trials across multiple outcome domains. J Am Acad Child Adolesc Psychiatry. 2014; 53(8):835-47, 847.e1-5. DOI: 10.1016/j.jaac.2014.05.013. View

20.

Piek J, Rigoli D, Pearsall-Jones J, Martin N, Hay D, Bennett K . Depressive symptomatology in child and adolescent twins with attention-deficit hyperactivity disorder and/or developmental coordination disorder. Twin Res Hum Genet. 2007; 10(4):587-96. DOI: 10.1375/twin.10.4.587. View