Agreement Between Web-based and Paper Versions of a Socio-demographic Questionnaire in the NutriNet-Santé Study

Overview

Journal Int J Public Health

Specialty Public Health

Date 2011 May 4

PMID 21538094

Citations 90

Authors

Anne-Claire Vergnaud

Mathilde Touvier

Caroline Mejean

Emmanuelle Kesse-Guyot

Clothilde Pollet

Aurelie Malon

Katia Castetbon

Serge Hercberg

Affiliations

Soon will be listed here.

Abstract

Objectives: Web-based studies nowadays raise a major interest as they can improve all steps involved in observational studies. Our objective was to compare the web-based version of the NutriNet-Santé self-administered socio-demographic and economic questionnaire with the traditional paper version.

Methods: Both versions of the questionnaire were sent to 170 volunteers and filled in by 147 of them (either paper first, n = 76, or web-based first, n = 71). Agreement between versions was assessed by intraclass correlations (ICC) and kappas.

Results: Agreement between both versions was high, with ICC and kappas ranging between 0.81-1.00 and 0.76-1.00, respectively, similarly across groups of administration order, age, gender and self-estimated web knowledge in general. The web-based version was the one preferred by 93.7% of the subjects and enabled to avoid 553 missing values (2.00% of the total entries), 24 inconsistent data (0.09%), 8 aberrant data (0.03%), 472 data entry errors (0.85%) and to save 2,800 <euro> (US $4,072) when sent to 170 subjects.

Conclusion: The web-based socio-demographic and economic questionnaire provided information of similar-to-superior quality compared to the traditional paper version, with substantial logistic and cost advantages.

Citing Articles

Development of Multimorbidity Indexes Based on Common Mental Health Conditions.

Kose J, Kesse-Guyot E, Duquenne P, Hercberg S, Galan P, Touvier M Int J Public Health. 2025; 70:1607952.

PMID: 40012814 PMC: 11859580. DOI: 10.3389/ijph.2025.1607952.

Mental Multimorbidity Among General-Population Adults: Sex-Specific Sociodemographic Profiles of Anxiety, Insomnia, and Eating Disorders.

Andreeva V, Arnault N, Chambaron S, Samieri C, Brindisi M, Duquenne P Int J Public Health. 2024; 69:1607546.

PMID: 39529858 PMC: 11550948. DOI: 10.3389/ijph.2024.1607546.

Dietary pattern trajectories in French adults of the NutriNet-Santé cohort over time (2014-2022): role of socio-economic factors.

Toujgani H, Berlivet J, Berthy F, Alles B, Brunin J, Fouillet H Br J Nutr. 2024; :1-10.

PMID: 39417338 PMC: 11617108. DOI: 10.1017/S0007114524002514.

Co-occurrence of habit-forming risk behaviors and their socio-demographic, health status and lifestyle determinants: a population-based cross-sectional study.

Kose J, Duquenne P, Hercberg S, Galan P, Touvier M, Fezeu L Arch Public Health. 2024; 82(1):26.

PMID: 38419088 PMC: 10900606. DOI: 10.1186/s13690-024-01251-2.

Food additive emulsifiers and cancer risk: Results from the French prospective NutriNet-Santé cohort.

Sellem L, Srour B, Javaux G, Chazelas E, Chassaing B, Viennois E PLoS Med. 2024; 21(2):e1004338.

PMID: 38349899 PMC: 10863884. DOI: 10.1371/journal.pmed.1004338.

References

Feinstein A, Cicchetti D . High agreement but low kappa: I. The problems of two paradoxes. J Clin Epidemiol. 1990; 43(6):543-9. DOI: 10.1016/0895-4356(90)90158-l. View

Hammersley R . A digest of memory phenomena for addiction research. Addiction. 1994; 89(3):283-93. DOI: 10.1111/j.1360-0443.1994.tb00890.x. View

Pealer L, Weiler R, Pigg Jr R, Miller D, Dorman S . The feasibility of a web-based surveillance system to collect health risk behavior data from college students. Health Educ Behav. 2001; 28(5):547-59. DOI: 10.1177/109019810102800503. View

Bertrais S, Preziosi P, Mennen L, Galan P, Hercberg S, Oppert J . Sociodemographic and geographic correlates of meeting current recommendations for physical activity in middle-aged French adults: the Supplémentation en Vitamines et Minéraux Antioxydants (SUVIMAX) Study. Am J Public Health. 2004; 94(9):1560-6. PMC: 1448494. DOI: 10.2105/ajph.94.9.1560. View

Shrout P, Fleiss J . Intraclass correlations: uses in assessing rater reliability. Psychol Bull. 1979; 86(2):420-8. DOI: 10.1037//0033-2909.86.2.420. View

Graham A, Papandonatos G . Reliability of internet- versus telephone-administered questionnaires in a diverse sample of smokers. J Med Internet Res. 2008; 10(1):e8. PMC: 2483847. DOI: 10.2196/jmir.987. View

Ward E, Jemal A, Cokkinides V, Singh G, Cardinez C, Ghafoor A . Cancer disparities by race/ethnicity and socioeconomic status. CA Cancer J Clin. 2004; 54(2):78-93. DOI: 10.3322/canjclin.54.2.78. View

Joinson A . Social desirability, anonymity, and Internet-based questionnaires. Behav Res Methods Instrum Comput. 1999; 31(3):433-8. DOI: 10.3758/bf03200723. View

Greene J, Speizer H, Wiitala W . Telephone and web: mixed-mode challenge. Health Serv Res. 2008; 43(1 Pt 1):230-48. PMC: 2323139. DOI: 10.1111/j.1475-6773.2007.00747.x. View

10.

Landis J, Koch G . The measurement of observer agreement for categorical data. Biometrics. 1977; 33(1):159-74. View

11.

Hercberg S, Preziosi P, Briancon S, Galan P, Triol I, Malvy D . A primary prevention trial using nutritional doses of antioxidant vitamins and minerals in cardiovascular diseases and cancers in a general population: the SU.VI.MAX study--design, methods, and participant characteristics. SUpplementation en.... Control Clin Trials. 1998; 19(4):336-51. DOI: 10.1016/s0197-2456(98)00015-4. View

12.

Schatzkin A, Subar A, Moore S, Park Y, Potischman N, Thompson F . Observational epidemiologic studies of nutrition and cancer: the next generation (with better observation). Cancer Epidemiol Biomarkers Prev. 2009; 18(4):1026-32. PMC: 2688809. DOI: 10.1158/1055-9965.EPI-08-1129. View

13.

McCabe S, Boyd C, Couper M, Crawford S, Darcy H . Mode effects for collecting alcohol and other drug use data: Web and U.S. mail. J Stud Alcohol. 2003; 63(6):755-61. DOI: 10.15288/jsa.2002.63.755. View

14.

Clark A, DesMeules M, Luo W, Duncan A, Wielgosz A . Socioeconomic status and cardiovascular disease: risks and implications for care. Nat Rev Cardiol. 2009; 6(11):712-22. DOI: 10.1038/nrcardio.2009.163. View

15.

Ekman A, Litton J . New times, new needs; e-epidemiology. Eur J Epidemiol. 2007; 22(5):285-92. DOI: 10.1007/s10654-007-9119-0. View

16.

Touvier M, Mejean C, Kesse-Guyot E, Pollet C, Malon A, Castetbon K . Comparison between web-based and paper versions of a self-administered anthropometric questionnaire. Eur J Epidemiol. 2010; 25(5):287-96. DOI: 10.1007/s10654-010-9433-9. View

17.

McLaren L . Socioeconomic status and obesity. Epidemiol Rev. 2007; 29:29-48. DOI: 10.1093/epirev/mxm001. View

18.

Brigham J, Lessov-Schlaggar C, Javitz H, Krasnow R, McElroy M, Swan G . Test-retest reliability of web-based retrospective self-report of tobacco exposure and risk. J Med Internet Res. 2009; 11(3):e35. PMC: 2762856. DOI: 10.2196/jmir.1248. View

19.

Drewnowski A . Obesity, diets, and social inequalities. Nutr Rev. 2009; 67 Suppl 1:S36-9. DOI: 10.1111/j.1753-4887.2009.00157.x. View

20.

Stanton C, Papandonatos G, Lloyd-Richardson E, Niaura R . Consistency of self-reported smoking over a 6-year interval from adolescence to young adulthood. Addiction. 2007; 102(11):1831-9. PMC: 3500030. DOI: 10.1111/j.1360-0443.2007.01974.x. View