The Patient Experiences Questionnaire for Out-of-Hours Care (PEQ-OHC): Data Quality, Reliability, and Validity

Overview

Journal Scand J Prim Health Care

Specialty Public Health

Date 2010 May 4

PMID 20433404

Citations 13

Authors

Andrew M Garratt

Kirsten Danielsen

Oddvar Forland

Steinar Hunskaar

Affiliations

Soon will be listed here.

Abstract

Objective: To develop and evaluate the Patient Experiences Questionnaire for Out-of-Hours Care (PEQ-OHC) in Norway.

Design: Questionnaire development was based on a systematic literature review of existing questionnaires, interviews with users, and expert group consultation. Questionnaire testing followed a postal survey of users who had attended out-of-hours centres in the North, West, and South of Norway.

Setting: Primary care out-of-hours services.

Subjects: The questionnaire was pre-tested with 13 users and was then mailed to 542 users who had had telephone contact and/or had a consultation with one of three out-of-hours centres.

Main Outcome Measures: Data quality, internal consistency, reliability, and construct validity.

Results: The questionnaire was considered to have good content validity by the expert group. There were 225 (41.51%) respondents to the postal questionnaire. Levels of missing data at the item and scale level were acceptable. Principal component analysis supported the four scales of user experiences relating to telephone contact, doctor services, nursing services, and organization. Item-total correlations were all above 0.5 and Cronbach's alpha was above 0.80 for all scales. Statistically significant associations based on explicit hypotheses were evidence for the construct validity of the PEQ-OHC.

Conclusion: The development of the PEQ-OHC followed a rigorous process based on a systematic review, interviews with users, and an expert group which lend the questionnaire content validity. The PEQ-OHC has evidence for data quality, internal consistency, reliability, and construct validity.

Citing Articles

Current Advances in Patient-Perceived Quality Assessment Within Romanian Healthcare.

Bancsik K, Daina M, Ghitea T, Bancsik R, Daina L Cureus. 2024; 16(9):e70111.

PMID: 39318657 PMC: 11421845. DOI: 10.7759/cureus.70111.

Perception and satisfaction of patients after telemedicine urology consultations: A matched analysis with physicians' perspective.

Turcotte B, Belanger L, Blais A, Blouin A, Bolduc S, Bolduc-Mokhtar A Can Urol Assoc J. 2022; 16(10):334-339.

PMID: 35621285 PMC: 9565072. DOI: 10.5489/cuaj.7819.

Validation and Adjustment of the Patient Experience Questionnaire (PEQ): A Regional Hospital Study in Norway.

Addo S, Mykletun R, Olsen E Int J Environ Res Public Health. 2021; 18(13).

PMID: 34281076 PMC: 8296920. DOI: 10.3390/ijerph18137141.

Patient experience studies in the circumpolar region: a scoping review.

Ingemann C, Hansen N, Hansen N, Jensen K, Larsen C, Chatwood S BMJ Open. 2020; 10(10):e042973.

PMID: 33020108 PMC: 7537463. DOI: 10.1136/bmjopen-2020-042973.

The Adolescent Patient Experiences of Diabetes Care Questionnaire (APEQ-DC): Reliability and Validity in a Study Based on Data from the Norwegian Childhood Diabetes Registry.

Iversen H, Bjertnaes O, Helland Y, Skrivarhaug T Patient Relat Outcome Meas. 2020; 10:405-416.

PMID: 31920415 PMC: 6938190. DOI: 10.2147/PROM.S232166.

References

Thompson K, Parahoo K, Farrell B . An evaluation of a GP out-of-hours service: meeting patient expectations of care. J Eval Clin Pract. 2004; 10(3):467-74. DOI: 10.1111/j.1365-2753.2004.00446.x. View

Sitzia J . How valid and reliable are patient satisfaction data? An analysis of 195 studies. Int J Qual Health Care. 1999; 11(4):319-28. DOI: 10.1093/intqhc/11.4.319. View

Moll van Charante E, Giesen P, Mokkink H, Oort F, Grol R, Klazinga N . Patient satisfaction with large-scale out-of-hours primary health care in The Netherlands: development of a postal questionnaire. Fam Pract. 2006; 23(4):437-43. DOI: 10.1093/fampra/cml017. View

Van Uden C, Ament A, Hobma S, Zwietering P, Crebolder H . Patient satisfaction with out-of-hours primary care in the Netherlands. BMC Health Serv Res. 2005; 5(1):6. PMC: 545962. DOI: 10.1186/1472-6963-5-6. View

Fitzpatrick R . Patients' assessments of the outcomes of primary care consultations. Scand J Prim Health Care Suppl. 1993; 2:68-71. DOI: 10.3109/02813439309045507. View

Crow R, Gage H, Hampson S, Hart J, Kimber A, Storey L . The measurement of satisfaction with healthcare: implications for practice from a systematic review of the literature. Health Technol Assess. 2003; 6(32):1-244. DOI: 10.3310/hta6320. View

Garratt A, Bjorngaard J, Dahle K, Bjertnaes O, Saunes I, Ruud T . The Psychiatric Out-Patient Experiences Questionnaire (POPEQ): data quality, reliability and validity in patients attending 90 Norwegian clinics. Nord J Psychiatry. 2006; 60(2):89-96. DOI: 10.1080/08039480600583464. View

Salisbury C, Burgess A, Lattimer V, Heaney D, Walker J, Turnbull J . Developing a standard short questionnaire for the assessment of patient satisfaction with out-of-hours primary care. Fam Pract. 2005; 22(5):560-9. DOI: 10.1093/fampra/cmi050. View

Anden A, Andersson S, Rudebeck C . Concepts underlying outcome measures in studies of consultations in general practice. Scand J Prim Health Care. 2006; 24(4):218-23. DOI: 10.1080/02813430600853271. View

10.

Glynn L, Byrne M, Newell J, Murphy A . The effect of health status on patients' satisfaction with out-of-hours care provided by a family doctor co-operative. Fam Pract. 2004; 21(6):677-83. DOI: 10.1093/fampra/cmh616. View

11.

Jackson J, CHAMBERLIN J, Kroenke K . Predictors of patient satisfaction. Soc Sci Med. 2001; 52(4):609-20. DOI: 10.1016/s0277-9536(00)00164-7. View

12.

Hallam L . Out of hours primary care. BMJ. 1997; 314(7075):157-8. PMC: 2125708. DOI: 10.1136/bmj.314.7075.157. View

13.

Jenkinson C, Coulter A, Bruster S, Richards N, Chandola T . Patients' experiences and satisfaction with health care: results of a questionnaire study of specific aspects of care. Qual Saf Health Care. 2002; 11(4):335-9. PMC: 1757991. DOI: 10.1136/qhc.11.4.335. View

14.

McKinley R, Hastings A, French D, Baker R . Reliability and validity of a new measure of patient satisfaction with out of hours primary medical care in the United Kingdom: development of a patient questionnaire. BMJ. 1997; 314(7075):193-8. PMC: 2125677. DOI: 10.1136/bmj.314.7075.193. View

15.

Evans R, Edwards A, Evans S, Elwyn B, Elwyn G . Assessing the practising physician using patient surveys: a systematic review of instruments and feedback methods. Fam Pract. 2007; 24(2):117-27. DOI: 10.1093/fampra/cml072. View

16.

Richards S, Pound P, Dickens A, Greco M, Campbell J . Exploring users' experiences of accessing out-of-hours primary medical care services. Qual Saf Health Care. 2007; 16(6):469-77. PMC: 2653185. DOI: 10.1136/qshc.2006.021501. View

17.

Garratt A, Bjertnaes O, Barlinn J . Parent experiences of paediatric care (PEPC) questionnaire: reliability and validity following a national survey. Acta Paediatr. 2007; 96(2):246-52. DOI: 10.1111/j.1651-2227.2007.00049.x. View

18.

Hansen B, Munck A . Out-of-hours service in Denmark: the effect of a structural change. Br J Gen Pract. 1999; 48(433):1497-9. PMC: 1313198. View

19.

Vedsted P, Sokolowski I, Heje H . Data quality and confirmatory factor analysis of the Danish EUROPEP questionnaire on patient evaluation of general practice. Scand J Prim Health Care. 2008; 26(3):174-80. PMC: 3409606. DOI: 10.1080/02813430802294803. View

20.

Campbell J, Dickens A, Richards S, Pound P, Greco M, Bower P . Capturing users' experience of UK out-of-hours primary medical care: piloting and psychometric properties of the Out-of-hours Patient Questionnaire. Qual Saf Health Care. 2007; 16(6):462-8. PMC: 2653188. DOI: 10.1136/qshc.2006.020172. View