Accuracy and Readability of Cardiovascular Entries on Wikipedia: Are They Reliable Learning Resources for Medical Students?

Overview

Journal BMJ Open

Specialty General Medicine

Date 2015 Oct 8

PMID 26443650

Citations 22

Authors

Samy A Azer

Nourah M AlSwaidan

Lama A Alshwairikh

Jumana M AlShammari

Affiliations

Soon will be listed here.

Abstract

Objective: To evaluate accuracy of content and readability level of English Wikipedia articles on cardiovascular diseases, using quality and readability tools.

Methods: Wikipedia was searched on the 6 October 2013 for articles on cardiovascular diseases. Using a modified DISCERN (DISCERN is an instrument widely used in assessing online resources), articles were independently scored by three assessors. The readability was calculated using Flesch-Kincaid Grade Level. The inter-rater agreement between evaluators was calculated using the Fleiss κ scale.

Results: This study was based on 47 English Wikipedia entries on cardiovascular diseases. The DISCERN scores had a median=33 (IQR=6). Four articles (8.5%) were of good quality (DISCERN score 40-50), 39 (83%) moderate (DISCERN 30-39) and 4 (8.5%) were poor (DISCERN 10-29). Although the entries covered the aetiology and the clinical picture, there were deficiencies in the pathophysiology of diseases, signs and symptoms, diagnostic approaches and treatment. The number of references varied from 1 to 127 references; 25.9±29.4 (mean±SD). Several problems were identified in the list of references and citations made in the articles. The readability of articles was 14.3±1.7 (mean±SD); consistent with the readability level for college students. In comparison, Harrison's Principles of Internal Medicine 18th edition had more tables, less references and no significant difference in number of graphs, images, illustrations or readability level. The overall agreement between the evaluators was good (Fleiss κ 0.718 (95% CI 0.57 to 0.83).

Conclusions: The Wikipedia entries are not aimed at a medical audience and should not be used as a substitute to recommended medical resources. Course designers and students should be aware that Wikipedia entries on cardiovascular diseases lack accuracy, predominantly due to errors of omission. Further improvement of the Wikipedia content of cardiovascular entries would be needed before they could be considered a supplementary resource.

Citing Articles

Free Open Access Medical Education (FOAMed) use in medical students: a literature review.

Morgan J BMC Med Educ. 2025; 25(1):20.

PMID: 39755631 PMC: 11699786. DOI: 10.1186/s12909-024-06392-0.

A Picture Paints a Thousand Words: Perspectives of the Use of Images and Videos of Physical Findings in Virtual OSCE Teaching Sessions.

Au Y, Li C, Dalavaye N, Elahi A, Vyas R, Baskaran R Adv Med Educ Pract. 2024; 15:909-920.

PMID: 39372503 PMC: 11453138. DOI: 10.2147/AMEP.S463374.

Accuracy and Utility of Internet Image Search as a Learning Tool for Retinal Pathology.

Cobbs L, Al-Hindi H, Fathy C, Mahmoudzadeh R, Uhler T, Xu D J Acad Ophthalmol (2017). 2024; 15(1):e93-e98.

PMID: 38737161 PMC: 10804767. DOI: 10.1055/s-0043-1768025.

Medical Education in a Post COVID-19 era - remote teaching methods for cardiovascular knowledge and skills.

Bridgwood B, Sabbagh C, Houghton J, Nickinson A, Pepper C, Sayers R MedEdPublish (2016). 2024; 10:62.

PMID: 38486550 PMC: 10939632. DOI: 10.15694/mep.2021.000062.1.

Artificial intelligence and obesity management: An Obesity Medicine Association (OMA) Clinical Practice Statement (CPS) 2023.

Bays H, Fitch A, Cuda S, Gonsahn-Bollie S, Rickey E, Hablutzel J Obes Pillars. 2023; 6:100065.

PMID: 37990659 PMC: 10662105. DOI: 10.1016/j.obpill.2023.100065.

References

Rasberry L . Wikipedia: what it is and why it matters for healthcare. BMJ. 2014; 348:g2478. DOI: 10.1136/bmj.g2478. View

Frambach J, Driessen E, Chan L, van der Vleuten C . Rethinking the globalisation of problem-based learning: how culture challenges self-directed learning. Med Educ. 2012; 46(8):738-47. DOI: 10.1111/j.1365-2923.2012.04290.x. View

Nissen L, Kirkegaard H, Perez N, Horlyk U, Larsen L . Inter-rater agreement of the triage system RETTS-HEV. Eur J Emerg Med. 2013; 21(1):37-41. DOI: 10.1097/MEJ.0b013e32836397d9. View

Probst M, Kanzaria H, Hoffman J, Mower W, Moheimani R, Sun B . Emergency Physicians' Perceptions and Decision-making Processes Regarding Patients Presenting with Palpitations. J Emerg Med. 2015; 49(2):236-43.e2. PMC: 4522216. DOI: 10.1016/j.jemermed.2015.02.013. View

Sullivan . Current medical diagnosis and treatment 1998 . BMJ. 1999; 318(7185):743A. PMC: 1115179. DOI: 10.1136/bmj.318.7185.743a. View

Cherla D, Sanghvi S, Choudhry O, Jyung R, Eloy J, Liu J . Readability assessment of Internet-based patient education materials related to acoustic neuromas. Otol Neurotol. 2013; 34(7):1349-54. DOI: 10.1097/MAO.0b013e31829530e5. View

Hargrave D, Hargrave U, Bouffet E . Quality of health information on the Internet in pediatric neuro-oncology. Neuro Oncol. 2006; 8(2):175-82. PMC: 1871939. DOI: 10.1215/15228517-2005-008. View

Grewal P, Alagaratnam S . The quality and readability of colorectal cancer information on the internet. Int J Surg. 2013; 11(5):410-3. DOI: 10.1016/j.ijsu.2013.03.006. View

Gschliesser A, Stifter E, Neumayer T, Moser E, Papp A, Pircher N . Inter-expert and intra-expert agreement on the diagnosis and treatment of retinopathy of prematurity. Am J Ophthalmol. 2015; 160(3):553-560.e3. DOI: 10.1016/j.ajo.2015.05.016. View

10.

Kolski D, Arlt S, Birk S, Heuwieser W . Use and acceptance of Wiki systems for students of veterinary medicine. GMS Z Med Ausbild. 2013; 30(1):Doc10. PMC: 3589678. DOI: 10.3205/zma000853. View

11.

Gaitsgory O, Burgess A, Mellis C . Opinion piece: 'medical students - learning from textbooks or electronic media?'. J Paediatr Child Health. 2013; 49(9):E370-2. DOI: 10.1111/jpc.12180. View

12.

Azer S . Evaluation of gastroenterology and hepatology articles on Wikipedia: are they suitable as learning resources for medical students?. Eur J Gastroenterol Hepatol. 2013; 26(2):155-63. DOI: 10.1097/MEG.0000000000000003. View

13.

Kingsley K, Galbraith G, Herring M, Stowers E, Stewart T, Kingsley K . Why not just Google it? An assessment of information literacy skills in a biomedical science curriculum. BMC Med Educ. 2011; 11:17. PMC: 3097006. DOI: 10.1186/1472-6920-11-17. View

14.

Jeffery R, Navarro T, Lokker C, Haynes R, Wilczynski N, Farjou G . How current are leading evidence-based medical textbooks? An analytic survey of four online textbooks. J Med Internet Res. 2012; 14(6):e175. PMC: 3799557. DOI: 10.2196/jmir.2105. View

15.

Azer S . Is Wikipedia a reliable learning resource for medical students? Evaluating respiratory topics. Adv Physiol Educ. 2015; 39(1):5-14. DOI: 10.1152/advan.00110.2014. View

16.

Egle J, Smeenge D, Kassem K, Mittal V . The Internet School of Medicine: use of electronic resources by medical trainees and the reliability of those resources. J Surg Educ. 2014; 72(2):316-20. DOI: 10.1016/j.jsurg.2014.08.005. View

17.

Wong L, Yan H, Margel D, Fleshner N . Urologists in cyberspace: A review of the quality of health information from American urologists' websites using three validated tools. Can Urol Assoc J. 2013; 7(3-4):100-7. PMC: 3650761. DOI: 10.5489/cuaj.501. View

18.

Guarino S, Leopardi E, Sorrenti S, De Antoni E, Catania A, Alagaratnam S . Internet-based versus traditional teaching and learning methods. Clin Teach. 2014; 11(6):449-53. DOI: 10.1111/tct.12191. View

19.

Callis K, Christ L, Resasco J, Armitage D, Ash J, Caughlin T . Improving Wikipedia: educational opportunity and professional responsibility. Trends Ecol Evol. 2009; 24(4):177-9. DOI: 10.1016/j.tree.2009.01.003. View

20.

Haigh C . Wikipedia as an evidence source for nursing and healthcare students. Nurse Educ Today. 2010; 31(2):135-9. DOI: 10.1016/j.nedt.2010.05.004. View