A Systematic Review of Stakeholder Engagement in Comparative Effectiveness and Patient-centered Outcomes Research

Overview

Journal J Gen Intern Med

Publisher Springer

Specialty General Medicine

Date 2014 Jun 5

PMID 24893581

Citations 217

Authors

Thomas W Concannon

Melissa Fuster

Tully Saunders

Kamal Patel

John B Wong

Laurel K Leslie

Joseph Lau

Affiliations

Soon will be listed here.

Abstract

Objectives: We conducted a review of the peer-reviewed literature since 2003 to catalogue reported methods of stakeholder engagement in comparative effectiveness research and patient-centered outcomes research.

Methods And Results: We worked with stakeholders before, during and after the review was conducted to: define the primary and key research questions; conduct the literature search; screen titles, abstracts and articles; abstract data from the articles; and analyze the data. The literature search yielded 2,062 abstracts. The review was conducted on 70 articles that reported on stakeholder engagement in individual research projects or programs.

Findings: Reports of stakeholder engagement are highly variable in content and quality. We found frequent engagement with patients, modestly frequent engagement with clinicians, and infrequent engagement with stakeholders in other key decision-making groups across the healthcare system. Stakeholder engagement was more common in earlier (prioritization) than in later (implementation and dissemination) stages of research. The roles and activities of stakeholders were highly variable across research and program reports.

Recommendations: To improve on the quality and content of reporting, we developed a 7-Item Stakeholder Engagement Reporting Questionnaire. We recommend three directions for future research: 1) descriptive research on stakeholder-engagement in research; 2) evaluative research on the impact of stakeholder engagement on the relevance, transparency and adoption of research; and 3) development and validation of tools that can be used to support stakeholder engagement in future work.

Citing Articles

Bridging the gap: empowering patients as research partners through a structured training program.

Redding A, Copeland L, Murphy D, Clemmons-Lloyd K, Cummings K, Doyle J Res Involv Engagem. 2025; 11(1):17.

PMID: 40038786 PMC: 11881312. DOI: 10.1186/s40900-025-00685-4.

A review of reported stakeholder engagement in early-stage translational research.

Concannon T, Hughes M, LaVertu A, Garlick J, Rushforth A J Clin Transl Sci. 2025; 9(1):e24.

PMID: 39911929 PMC: 11795857. DOI: 10.1017/cts.2024.620.

Assessing the context within academic health institutions toward improving equity-based, community and patient-engaged research.

Adsul P, Sanchez-Youngman S, Dickson E, Jacquez B, Kuhlemeier A, Muhammad M J Clin Transl Sci. 2025; 9(1):e6.

PMID: 39830606 PMC: 11736299. DOI: 10.1017/cts.2024.675.

Multidisciplinary stakeholder engagement in a type 2 diabetes comparative effectiveness study utilizing real-world data.

Golembiewski E, Mickelson M, Brito J, Montori V, McCoy R J Clin Transl Sci. 2025; 8(1):e220.

PMID: 39790475 PMC: 11713436. DOI: 10.1017/cts.2024.666.

Screening for breast cancer: a systematic review update to inform the Canadian Task Force on Preventive Health Care guideline.

Bennett A, Shaver N, Vyas N, Almoli F, Pap R, Douglas A Syst Rev. 2024; 13(1):304.

PMID: 39702409 PMC: 11656969. DOI: 10.1186/s13643-024-02700-3.

References

Sox H, Greenfield S . Comparative effectiveness research: a report from the Institute of Medicine. Ann Intern Med. 2009; 151(3):203-5. DOI: 10.7326/0003-4819-151-3-200908040-00125. View

Chung B, Jones L, Dixon E, Miranda J, Wells K . Using a community partnered participatory research approach to implement a randomized controlled trial: planning community partners in care. J Health Care Poor Underserved. 2010; 21(3):780-95. PMC: 2962454. DOI: 10.1353/hpu.0.0345. View

Boutain D . Collective knowledge sharing as a social justice strategy: the difference it made in a service project about preterm birth disparity. ANS Adv Nurs Sci. 2009; 32(2):E68-80. DOI: 10.1097/ANS.0b013e3181a3b54e. View

Spatz E, Phipps M, Wang O, Lagarde S, Lucas G, Curry L . Expanding the safety net of specialty care for the uninsured: a case study. Health Serv Res. 2011; 47(1 Pt 2):344-62. PMC: 3393006. DOI: 10.1111/j.1475-6773.2011.01330.x. View

Wong C, Mouanoutoua V, Chen M . Engaging community in the quality of hypertension care project with Hmong Americans. J Cult Divers. 2009; 15(1):30-6. View

Stiffman A, Freedenthal S, Brown E, Ostmann E, Hibbeler P . Field research with underserved minorities: the ideal and the real. J Urban Health. 2005; 82(2 Suppl 3):iii56-66. PMC: 3455895. DOI: 10.1093/jurban/jti064. View

Breslin M, Mullan R, Montori V . The design of a decision aid about diabetes medications for use during the consultation with patients with type 2 diabetes. Patient Educ Couns. 2008; 73(3):465-72. DOI: 10.1016/j.pec.2008.07.024. View

Hitchcock K, Appelt K . Sustainable collaboration for community outreach: lessons from the Spanish Access to Literature/Uso Directo (SALUD) project. J Med Libr Assoc. 2008; 96(1):58-60. PMC: 2212335. DOI: 10.3163/1536-5050.96.1.58. View

Lieu T, Au D, Krishnan J, Moss M, Selker H, Harabin A . Comparative effectiveness research in lung diseases and sleep disorders: recommendations from the National Heart, Lung, and Blood Institute workshop. Am J Respir Crit Care Med. 2011; 184(7):848-56. PMC: 3265273. DOI: 10.1164/rccm.201104-0634WS. View

10.

Morrato E, Concannon T, Meissner P, Shah N, Turner B . Dissemination and implementation of comparative effectiveness evidence: key informant interviews with Clinical and Translational Science Award institutions. J Comp Eff Res. 2013; 2(2):185-94. PMC: 3961460. DOI: 10.2217/cer.13.10. View

11.

Tanjasiri S, Tran J, Palmer P, Foo M, Hanneman M, Lee C . Developing a community-based collaboration to reduce cancer health disparities among Pacific Islanders in California. Pac Health Dialog. 2009; 14(1):119-27. View

12.

Buckler A, Bresolin L, Reed Dunnick N, Sullivan D . A collaborative enterprise for multi-stakeholder participation in the advancement of quantitative imaging. Radiology. 2011; 258(3):906-14. DOI: 10.1148/radiol.10100799. View

13.

Savage C, Xu Y, Lee R, Rose B, Kappesser M, Anthony J . A case study in the use of community-based participatory research in public health nursing. Public Health Nurs. 2006; 23(5):472-8. DOI: 10.1111/j.1525-1446.2006.00585.x. View

14.

Ray J, White M, Cannon P, Bowen C, ORourke K . Implementing the Florida KidCare open enrollment communications campaign: a framework for mobilizing community partners to reduce the number of uninsured children. Int Q Community Health Educ. 2007; 26(4):365-77. DOI: 10.2190/IQ.26.4.e. View

15.

Peterson T, Dolan T, Hanft S . Partnering with youth organizers to prevent violence: an analysis of relationships, power, and change. Prog Community Health Partnersh. 2010; 4(3):235-42. DOI: 10.1353/cpr.2010.0011. View

16.

Davis R, Hitch A, Nichols M, Rizvi A, Salaam M, Mayer-Davis E . A collaborative approach to the recruitment and retention of minority patients with diabetes in rural community health centers. Contemp Clin Trials. 2008; 30(1):63-70. DOI: 10.1016/j.cct.2008.09.007. View

17.

Burke J, Jones J, Yonas M, Guizzetti L, Virata M, Costlow M . PCOR, CER, and CBPR: alphabet soup or complementary fields of health research?. Clin Transl Sci. 2013; 6(6):493-6. PMC: 5350967. DOI: 10.1111/cts.12064. View

18.

Moher D, Liberati A, Tetzlaff J, Altman D . Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med. 2009; 6(7):e1000097. PMC: 2707599. DOI: 10.1371/journal.pmed.1000097. View

19.

Taylor-Piliae R, Sivarajan Froelicher E . Methods to optimize recruitment and retention to an exercise study in Chinese immigrants. Nurs Res. 2007; 56(2):132-6. DOI: 10.1097/01.NNR.0000263971.46996.14. View

20.

Goins R, Garroutte E, Fox S, Geiger S, Manson S . Theory and practice in participatory research: lessons from the Native Elder Care Study. Gerontologist. 2011; 51(3):285-94. PMC: 3095653. DOI: 10.1093/geront/gnq130. View