Effect of Questionnaire Length, Personalisation and Reminder Type on Response Rate to a Complex Postal Survey: Randomised Controlled Trial

Overview

Journal BMC Med Res Methodol

Publisher Biomed Central

Specialties General Medicine
Health Services

Date 2011 May 10

PMID 21548947

Citations 114

Authors

Shannon Sahlqvist

Yena Song

Fiona Bull

Emma Adams

John Preston

David Ogilvie

Affiliations

Soon will be listed here.

Abstract

Background: Minimising participant non-response in postal surveys helps to maximise the generalisability of the inferences made from the data collected. The aim of this study was to examine the effect of questionnaire length, personalisation and reminder type on postal survey response rate and quality and to compare the cost-effectiveness of the alternative survey strategies.

Methods: In a pilot study for a population study of travel behaviour, physical activity and the environment, 1000 participants sampled from the UK edited electoral register were randomly allocated using a 2×2 factorial design to receive one of four survey packs: a personally addressed long (24 page) questionnaire pack, a personally addressed short (15 page) questionnaire pack, a non-personally addressed long questionnaire pack or a non-personally addressed short questionnaire pack. Those who did not return a questionnaire were stratified by initial randomisation group and further randomised to receive either a full reminder pack or a reminder postcard. The effects of the survey design factors on response were examined using multivariate logistic regression.

Results: An overall response rate of 17% was achieved. Participants who received the short version of the questionnaire were more likely to respond (OR=1.48, 95% CI 1.06 to 2.07). In those participants who received a reminder, personalisation of the survey pack and reminder also increased the odds of response (OR=1.44, 95% CI 1.01 to 1.95). Item non-response was relatively low, but was significantly higher in the long questionnaire than the short (9.8% vs 5.8%; p=.04). The cost per additional usable questionnaire returned of issuing the reminder packs was £23.1 compared with £11.3 for the reminder postcards.

Conclusions: In contrast to some previous studies of shorter questionnaires, this trial found that shortening a relatively lengthy questionnaire significantly increased the response. Researchers should consider the trade off between the value of additional questions and a larger sample. If low response rates are expected, personalisation may be an important strategy to apply. Sending a full reminder pack to non-respondents appears a worthwhile, albeit more costly, strategy.

Citing Articles

The short version of the ALR-RSI scale is a valid and reproducible scale to evaluate psychological readiness to return to sport after ankle lateral reconstruction.

Mahieu A, Moussa M, Valentin E, Lopes R, Hardy A J Exp Orthop. 2025; 12(1):e70160.

PMID: 39968527 PMC: 11832589. DOI: 10.1002/jeo2.70160.

Glaucoma Disease-Specific Adherence Measurement Tools Validated for Measuring Adherence to Glaucoma Medications: A Systematic Review.

Abaidoo B, Mashige K, Govender-Poonsamy P, Tagoe N, Essuman V, Adam S Health Sci Rep. 2025; 8(2):e70427.

PMID: 39931261 PMC: 11808388. DOI: 10.1002/hsr2.70427.

Workplace Health and Wellbeing in Small and Medium Sized Enterprises (SMEs): A Mixed Methods Evaluation of Provision and Support Uptake.

Lloyd N, Smeeton N, Freethy I, Jones J, Wills W, Dennington-Price A Int J Environ Res Public Health. 2025; 22(1).

PMID: 39857543 PMC: 11764598. DOI: 10.3390/ijerph22010090.

Development of ICF-based patient-reported outcome and experience measures to study social participation among people with chronic diseases: a mixed-methods protocol.

Van den Broecke M, de Jong S, Kiasuwa Mbengi R, Vanroelen C BMJ Open. 2025; 14(12):e087798.

PMID: 39806694 PMC: 11667263. DOI: 10.1136/bmjopen-2024-087798.

Caregiver-Reported Economic Impacts of Pediatric Rare Diseases-A Scoping Review.

Buckle N, Doyle O, Kodate N, Kinch M, Somanadhan S Healthcare (Basel). 2025; 12(24).

PMID: 39766005 PMC: 11727781. DOI: 10.3390/healthcare12242578.

References

Burton N, Haynes M, Wilson L, Giles-Corti B, Oldenburg B, Brown W . HABITAT: A longitudinal multilevel study of physical activity change in mid-aged adults. BMC Public Health. 2009; 9:76. PMC: 2664805. DOI: 10.1186/1471-2458-9-76. View

Scott P, Edwards P . Personally addressed hand-signed letters increase questionnaire response: a meta-analysis of randomised controlled trials. BMC Health Serv Res. 2006; 6:111. PMC: 1574304. DOI: 10.1186/1472-6963-6-111. View

Singer E, Van Hoewyk J , Maher M . Experiments with incentives in telephone surveys. Public Opin Q. 2000; 64(2):171-88. DOI: 10.1086/317761. View

Besson H, Brage S, Jakes R, Ekelund U, Wareham N . Estimating physical activity energy expenditure, sedentary time, and physical activity intensity by self-report in adults. Am J Clin Nutr. 2009; 91(1):106-14. DOI: 10.3945/ajcn.2009.28432. View

Ogilvie D, Bull F, Powell J, Cooper A, Brand C, Mutrie N . An applied ecological framework for evaluating infrastructure to promote walking and cycling: the iConnect study. Am J Public Health. 2011; 101(3):473-81. PMC: 3036680. DOI: 10.2105/AJPH.2010.198002. View

Kalantar J, Talley N . The effects of lottery incentive and length of questionnaire on health survey response rates: a randomized study. J Clin Epidemiol. 1999; 52(11):1117-22. DOI: 10.1016/s0895-4356(99)00051-7. View

Ogilvie D, Mitchell R, Mutrie N, Petticrew M, Platt S . Personal and environmental correlates of active travel and physical activity in a deprived urban population. Int J Behav Nutr Phys Act. 2008; 5:43. PMC: 2538543. DOI: 10.1186/1479-5868-5-43. View

Cummins S, Petticrew M, Higgins C, Findlay A, Sparks L . Large scale food retailing as an intervention for diet and health: quasi-experimental evaluation of a natural experiment. J Epidemiol Community Health. 2005; 59(12):1035-40. PMC: 1732985. DOI: 10.1136/jech.2004.029843. View

Dirmaier J, Harfst T, Koch U, Schulz H . Incentives increased return rates but did not influence partial nonresponse or treatment outcome in a randomized trial. J Clin Epidemiol. 2007; 60(12):1263-70. DOI: 10.1016/j.jclinepi.2007.04.006. View

10.

Giles-Corti B, Knuiman M, Timperio A, Van Niel K, Pikora T, Bull F . Evaluation of the implementation of a state government community design policy aimed at increasing local walking: design issues and baseline results from RESIDE, Perth Western Australia. Prev Med. 2007; 46(1):46-54. DOI: 10.1016/j.ypmed.2007.08.002. View

11.

Mond J, Rodgers B, Hay P, Owen C, Beumont P . Mode of delivery, but not questionnaire length, affected response in an epidemiological study of eating-disordered behavior. J Clin Epidemiol. 2004; 57(11):1167-71. DOI: 10.1016/j.jclinepi.2004.02.017. View

12.

Craig C, Marshall A, Sjostrom M, Bauman A, Booth M, Ainsworth B . International physical activity questionnaire: 12-country reliability and validity. Med Sci Sports Exerc. 2003; 35(8):1381-95. DOI: 10.1249/01.MSS.0000078924.61453.FB. View

13.

Nakash R, Hutton J, Jorstad-Stein E, Gates S, Lamb S . Maximising response to postal questionnaires--a systematic review of randomised trials in health research. BMC Med Res Methodol. 2006; 6:5. PMC: 1421421. DOI: 10.1186/1471-2288-6-5. View

14.

Edwards P, Roberts I, Clarke M, DiGuiseppi C, Pratap S, Wentz R . Methods to increase response rates to postal questionnaires. Cochrane Database Syst Rev. 2007; (2):MR000008. DOI: 10.1002/14651858.MR000008.pub3. View

15.

Spittaels H, Verloigne M, Gidlow C, Gloanec J, Titze S, Foster C . Measuring physical activity-related environmental factors: reliability and predictive validity of the European environmental questionnaire ALPHA. Int J Behav Nutr Phys Act. 2010; 7(1):48. PMC: 2892430. DOI: 10.1186/1479-5868-7-48. View