Clinicians' Experience with Infographic Summaries from the BMJ Rapid Recommendations: a Qualitative User-testing Study Among Residents and Interns at a Large Teaching Hospital in Switzerland

Overview

Journal BMJ Open

Date 2025 Feb 10

PMID 39929503

Authors

Tiffany Hirschel

Per Vandvik

Thomas Agoritsas

Affiliations

Soon will be listed here.

Abstract

Objective: Clinicians need trustworthy clinical practice guidelines to succeed with evidence-based diagnosis and treatment at the bedside. The BMJ Rapid Recommendations explore innovative ways to enhance dissemination and uptake, including multilayered interactive infographics linked to a digitally structured authoring and publication platform (the MAGICapp). We aimed to assess user experiences of physicians in training in various specialties when they interact with these infographics.

Design: We conducted a qualitative user-testing study to assess user experience of a convenience sample of physicians in training. User testing was carried out through guided think-aloud sessions. We assessed six facets of user experience using a revised version of Morville's framework: usefulness, understandability, usability, credibility, desirability and identification.

Setting: Setting include Geneva's University Hospital, a large teaching hospital in Switzerland.

Participants: Participants include a convenience sample of residents and interns without restriction regarding medical field or division of care.

Results: Most users reported a positive experience. The infographics were understandable and useful to rapidly grasp the key elements of the recommendation, its rationale and supporting evidence, in a credible way. Some users felt intimidated by numbers or the amount of information, although they perceived there could be a learning curve while using generic formats. Plain language summaries helped complement the visuals but could be further highlighted. Despite their generally positive experience, several users had limited understanding of key GRADE (Grading of Recommendations Assessment, Development and Evaluation) domains of the quality of evidence and remained uncertain by the implication of weak or conditional recommendations.

Conclusion: Our study allowed to identify several aspects of guideline formats that improve their understandability and usefulness. Guideline organisations can use our findings to adapt their presentation format to enhance their dissemination and uptake in clinical practice. Avenues for research include the interplay between infographics and the digital authoring platform, multiple comparisons and living guidelines.

References

Santesso N, Wiercioch W, Barbara A, Dietl H, Schunemann H . Focus groups and interviews with the public led to the development of a template for a GRADE Plain Language Recommendation (PLR). J Clin Epidemiol. 2021; 141:18-25. DOI: 10.1016/j.jclinepi.2021.09.018. View

Alexander P, Li S, Gionfriddo M, Stoltzfus R, Neumann I, Brito J . Senior GRADE methodologists encounter challenges as part of WHO guideline development panels: an inductive content analysis. J Clin Epidemiol. 2015; 70:123-8. DOI: 10.1016/j.jclinepi.2015.09.003. View

Van Bostraeten P, Aertgeerts B, Bekkering G, Delvaux N, Dijckmans C, Ostyn E . Infographic summaries for clinical practice guidelines: results from user testing of the BMJ Rapid Recommendations in primary care. BMJ Open. 2023; 13(11):e071847. PMC: 10649784. DOI: 10.1136/bmjopen-2023-071847. View

Bastian H, Glasziou P, Chalmers I . Seventy-five trials and eleven systematic reviews a day: how will we ever keep up?. PLoS Med. 2010; 7(9):e1000326. PMC: 2943439. DOI: 10.1371/journal.pmed.1000326. View

Tikkinen K, Dahm P, Lytvyn L, Heen A, Vernooij R, Siemieniuk R . Prostate cancer screening with prostate-specific antigen (PSA) test: a clinical practice guideline. BMJ. 2018; 362:k3581. PMC: 6283372. DOI: 10.1136/bmj.k3581. View

Vandvik P, Otto C, Siemieniuk R, Bagur R, Guyatt G, Lytvyn L . Transcatheter or surgical aortic valve replacement for patients with severe, symptomatic, aortic stenosis at low to intermediate surgical risk: a clinical practice guideline. BMJ. 2016; 354:i5085. DOI: 10.1136/bmj.i5085. View

Huang S, Martin L, Yeh C, Chin A, Murray H, Sanderson W . The effect of an infographic promotion on research dissemination and readership: A randomized controlled trial. CJEM. 2018; 20(6):826-833. DOI: 10.1017/cem.2018.436. View

Laine C, Taichman D, Mulrow C . Trustworthy clinical guidelines. Ann Intern Med. 2011; 154(11):774-5. DOI: 10.7326/0003-4819-154-11-201106070-00011. View

Martinez Garcia L, Arevalo-Rodriguez I, Sola I, Haynes R, Vandvik P, Alonso-Coello P . Strategies for monitoring and updating clinical practice guidelines: a systematic review. Implement Sci. 2012; 7:109. PMC: 3520818. DOI: 10.1186/1748-5908-7-109. View

10.

Agoritsas T, Darbellay Farhoumand P, Siemieniuk R, Heen A, Lytvyn L, Macdonald H . [The BMJ Rapid Recommendations: towards a new model for the production of clinical practice guidelines]. Rev Med Suisse. 2019; 15(N° 632-633):149-155. View

11.

Balshem H, Helfand M, Schunemann H, Oxman A, Kunz R, Brozek J . GRADE guidelines: 3. Rating the quality of evidence. J Clin Epidemiol. 2011; 64(4):401-6. DOI: 10.1016/j.jclinepi.2010.07.015. View

12.

Busse J, Vankrunkelsven P, Zeng L, Heen A, Merglen A, Campbell F . Medical cannabis or cannabinoids for chronic pain: a clinical practice guideline. BMJ. 2021; 374:n2040. DOI: 10.1136/bmj.n2040. View

13.

Prasad K, Siemieniuk R, Hao Q, Guyatt G, ODonnell M, Lytvyn L . Dual antiplatelet therapy with aspirin and clopidogrel for acute high risk transient ischaemic attack and minor ischaemic stroke: a clinical practice guideline. BMJ. 2018; 363:k5130. DOI: 10.1136/bmj.k5130. View

14.

Alonso-Coello P, Schunemann H, Moberg J, Brignardello-Petersen R, Akl E, Davoli M . GRADE Evidence to Decision (EtD) frameworks: a systematic and transparent approach to making well informed healthcare choices. 1: Introduction. BMJ. 2016; 353:i2016. DOI: 10.1136/bmj.i2016. View

15.

Siemieniuk R, Lytvyn L, Mah Ming J, Mullen R, Anam F, Otieno T . Antiretroviral therapy in pregnant women living with HIV: a clinical practice guideline. BMJ. 2017; 358:j3961. PMC: 5590100. DOI: 10.1136/bmj.j3961. View

16.

Spicer J, Coleman C . Creating Effective Infographics and Visual Abstracts to Disseminate Research and Facilitate Medical Education on Social Media. Clin Infect Dis. 2022; 74(Suppl_3):e14-e22. DOI: 10.1093/cid/ciac058. View

17.

Proietti M, Nobili A, Raparelli V, Napoleone L, Mannucci P, Lip G . Adherence to antithrombotic therapy guidelines improves mortality among elderly patients with atrial fibrillation: insights from the REPOSI study. Clin Res Cardiol. 2016; 105(11):912-920. DOI: 10.1007/s00392-016-0999-4. View

18.

Alonso-Coello P, Martinez Garcia L, Carrasco J, Sola I, Qureshi S, Burgers J . The updating of clinical practice guidelines: insights from an international survey. Implement Sci. 2011; 6:107. PMC: 3191352. DOI: 10.1186/1748-5908-6-107. View

19.

Agarwal A, Hunt B, Stegemann M, Rochwerg B, Lamontagne F, Ac Siemieniuk R . A living WHO guideline on drugs for covid-19. BMJ. 2020; 370:m3379. DOI: 10.1136/bmj.m3379. View

20.

Agoritsas T, Heen A, Brandt L, Alonso-Coello P, Kristiansen A, Akl E . Decision aids that really promote shared decision making: the pace quickens. BMJ. 2015; 350:g7624. PMC: 4707568. DOI: 10.1136/bmj.g7624. View