Assessing Patient-Perceived Hospital Service Quality and Sentiment in Malaysian Public Hospitals Using Machine Learning and Facebook Reviews

Overview

Journal Int J Environ Res Public Health

Publisher MDPI

Specialties Environmental Health
Public Health

Date 2021 Sep 28

PMID 34574835

Citations 7

Authors

Afiq Izzudin A Rahim

Mohd Ismail Ibrahim

Kamarul Imran Musa

Sook-Ling Chua

Najib Majdi Yaacob

Affiliations

Soon will be listed here.

Abstract

Social media is emerging as a new avenue for hospitals and patients to solicit input on the quality of care. However, social media data is unstructured and enormous in volume. Moreover, no empirical research on the use of social media data and perceived hospital quality of care based on patient online reviews has been performed in Malaysia. The purpose of this study was to investigate the determinants of positive sentiment expressed in hospital Facebook reviews in Malaysia, as well as the association between hospital accreditation and sentiments expressed in Facebook reviews. From 2017 to 2019, we retrieved comments from 48 official public hospitals' Facebook pages. We used machine learning to build a sentiment analyzer and service quality (SERVQUAL) classifier that automatically classifies the sentiment and SERVQUAL dimensions. We utilized logistic regression analysis to determine our goals. We evaluated a total of 1852 reviews and our machine learning sentiment analyzer detected 72.1% of positive reviews and 27.9% of negative reviews. We classified 240 reviews as tangible, 1257 reviews as trustworthy, 125 reviews as responsive, 356 reviews as assurance, and 1174 reviews as empathy using our machine learning SERVQUAL classifier. After adjusting for hospital characteristics, all SERVQUAL dimensions except Tangible were associated with positive sentiment. However, no significant relationship between hospital accreditation and online sentiment was discovered. Facebook reviews powered by machine learning algorithms provide valuable, real-time data that may be missed by traditional hospital quality assessments. Additionally, online patient reviews offer a hitherto untapped indication of quality that may benefit all healthcare stakeholders. Our results confirm prior studies and support the use of Facebook reviews as an adjunct method for assessing the quality of hospital services in Malaysia.

Citing Articles

Revealing patient-reported experiences in healthcare from social media using thedesign-acquire-process-model-analyse-visualise framework.

Murray C, Mitchell L, Tuke J, Mackay M Digit Health. 2024; 10:20552076241251715.

PMID: 38757085 PMC: 11097732. DOI: 10.1177/20552076241251715.

Comparative Analysis of Patient Satisfaction Surveys-A Crucial Role in Raising the Standard of Healthcare Services.

Bancsik K, Ilea C, Daina M, Bancsik R, Suteu C, Birsan S Healthcare (Basel). 2023; 11(21).

PMID: 37958022 PMC: 10647670. DOI: 10.3390/healthcare11212878.

Artificial intelligence technologies and compassion in healthcare: A systematic scoping review.

Morrow E, Zidaru T, Ross F, Mason C, Patel K, Ream M Front Psychol. 2023; 13:971044.

PMID: 36733854 PMC: 9887144. DOI: 10.3389/fpsyg.2022.971044.

Appeal of word of mouth: Influences of public opinions and sentiment on ports in corporate choice of import and export trade in the post-COVID-19 era.

Yi K, Li Y, Chen J, Yu M, Li X Ocean Coast Manag. 2022; 225:106239.

PMID: 36467315 PMC: 9700815. DOI: 10.1016/j.ocecoaman.2022.106239.

The quality of Syrian healthcare services during COVID-19: A HEALTHQUAL approach.

Allahham L, Mouselli S, Jakovljevic M Front Public Health. 2022; 10:970922.

PMID: 36033782 PMC: 9403656. DOI: 10.3389/fpubh.2022.970922.

References

Westbrook K, Babakus E, Grant C . Measuring patient-perceived hospital service quality: validity and managerial usefulness of HCAHPS scales. Health Mark Q. 2014; 31(2):97-114. DOI: 10.1080/07359683.2014.907114. View

Hefele J, Li Y, Campbell L, Barooah A, Wang J . Nursing home Facebook reviews: who has them, and how do they relate to other measures of quality and experience?. BMJ Qual Saf. 2017; 27(2):130-139. DOI: 10.1136/bmjqs-2017-006492. View

Lin Y, Hong Y, Henson B, Stevenson R, Hong S, Lyu T . Assessing Patient Experience and Healthcare Quality of Dental Care Using Patient Online Reviews in the United States: Mixed Methods Study. J Med Internet Res. 2020; 22(7):e18652. PMC: 7380989. DOI: 10.2196/18652. View

Rahim A, Ibrahim M, Musa K, Chua S . Facebook Reviews as a Supplemental Tool for Hospital Patient Satisfaction and Its Relationship with Hospital Accreditation in Malaysia. Int J Environ Res Public Health. 2021; 18(14). PMC: 8306730. DOI: 10.3390/ijerph18147454. View

Ranard B, Werner R, Antanavicius T, Schwartz H, Smith R, Meisel Z . Yelp Reviews Of Hospital Care Can Supplement And Inform Traditional Surveys Of The Patient Experience Of Care. Health Aff (Millwood). 2016; 35(4):697-705. PMC: 4845957. DOI: 10.1377/hlthaff.2015.1030. View

Hawkins J, Brownstein J, Tuli G, Runels T, Broecker K, Nsoesie E . Measuring patient-perceived quality of care in US hospitals using Twitter. BMJ Qual Saf. 2015; 25(6):404-13. PMC: 4878682. DOI: 10.1136/bmjqs-2015-004309. View

Greaves F, Laverty A, Cano D, Moilanen K, Pulman S, Darzi A . Tweets about hospital quality: a mixed methods study. BMJ Qual Saf. 2014; 23(10):838-46. PMC: 4174012. DOI: 10.1136/bmjqs-2014-002875. View

Lagu T, Greaves F . From Public to Social Reporting of Hospital Quality. J Gen Intern Med. 2015; 30(10):1397-9. PMC: 4579214. DOI: 10.1007/s11606-015-3327-1. View

Greaves F, Ramirez-Cano D, Millett C, Darzi A, Donaldson L . Harnessing the cloud of patient experience: using social media to detect poor quality healthcare. BMJ Qual Saf. 2013; 22(3):251-5. DOI: 10.1136/bmjqs-2012-001527. View

10.

Chakraborty S, Church E . Social media hospital ratings and HCAHPS survey scores. J Health Organ Manag. 2020; 34(2):162-172. DOI: 10.1108/JHOM-08-2019-0234. View

11.

Hu G, Han X, Zhou H, Liu Y . Public Perception on Healthcare Services: Evidence from Social Media Platforms in China. Int J Environ Res Public Health. 2019; 16(7). PMC: 6479867. DOI: 10.3390/ijerph16071273. View

12.

Campbell L, Li Y . Are Facebook user ratings associated with hospital cost, quality and patient satisfaction? A cross-sectional analysis of hospitals in New York State. BMJ Qual Saf. 2017; 27(2):119-129. DOI: 10.1136/bmjqs-2016-006291. View

13.

Yang M, Kiang M, Shang W . Filtering big data from social media--Building an early warning system for adverse drug reactions. J Biomed Inform. 2015; 54:230-40. DOI: 10.1016/j.jbi.2015.01.011. View

14.

Zunic A, Corcoran P, Spasic I . Sentiment Analysis in Health and Well-Being: Systematic Review. JMIR Med Inform. 2020; 8(1):e16023. PMC: 7013658. DOI: 10.2196/16023. View

15.

Shafiq M, Naeem M, Munawar Z, Fatima I . Service Quality Assessment of Hospitals in Asian Context: An Empirical Evidence From Pakistan. Inquiry. 2017; 54:46958017714664. PMC: 5798721. DOI: 10.1177/0046958017714664. View

16.

Boylan A, Turk A, Van Velthoven M, Powell J . Online patient feedback as a measure of quality in primary care: a multimethod study using correlation and qualitative analysis. BMJ Open. 2020; 10(2):e031820. PMC: 7050381. DOI: 10.1136/bmjopen-2019-031820. View

17.

Huesch M, Currid-Halkett E, Doctor J . Public hospital quality report awareness: evidence from National and Californian Internet searches and social media mentions, 2012. BMJ Open. 2014; 4(3):e004417. PMC: 3963102. DOI: 10.1136/bmjopen-2013-004417. View

18.

Zun A, Ibrahim M, Abdul Hamid A . Level of Satisfaction on Service Quality Dimensions Based on SERVQUAL Model Among Patients Attending 1 Malaysia Clinic in Kota Bharu, Malaysia. Oman Med J. 2018; 33(5):416-422. PMC: 6131925. DOI: 10.5001/omj.2018.76. View

19.

Boylan A, Williams V, Powell J . Online patient feedback: a scoping review and stakeholder consultation to guide health policy. J Health Serv Res Policy. 2019; 25(2):122-129. DOI: 10.1177/1355819619870837. View

20.

Wagland R, Recio-Saucedo A, Simon M, Bracher M, Hunt K, Foster C . Development and testing of a text-mining approach to analyse patients' comments on their experiences of colorectal cancer care. BMJ Qual Saf. 2015; 25(8):604-14. DOI: 10.1136/bmjqs-2015-004063. View