Analyzing physicians ratings and reviews landscape of a developing country (Pakistan)


  • Atif Hussain Institute of Quality & Technology Management, University of the Punjab, Pakistan
  • Hakeem-ur-Rehman Institute of Quality & Technology Management, University of the Punjab, Pakistan
  • Muhammad Usman Awan Institute of Quality & Technology Management, University of the Punjab, Pakistan



Patient Reviews, Physician Ratings Websites (PRWs), Healthcare


Studies on online reviews and ratings of physicians by patients have so far been conducted only in the context of developed countries. Therefore, this study aims to identify popular Physicians Rating Websites (PRWs), study their characteristics and report prevalence, nature and distribution of online ratings and reviews in the context of a developing country (Pakistan). Most popular PRWs were identified and ratings and reviews were scraped using Link Klipper extension and Octoparse software. Scrapped data were then analyzed. Websites and their apps were explored and also a psychologist having profiles, ratings and reviews on chosen websites was also interviewed. Two PRWs ( and are popular in Pakistan with an Alexa rank of less than 1000 in Pakistan at the time of the study, indicating high popularity. Oladoc has more profiles (15,069) as compared to Marham. However, it has less number of profiles with quantitative and narrative reviews, 23% and 11% as compared to 45% and 30.6% of Marham. Average ratings per rated doctor and average number of reviews per doctor are also greater on oladoc as compared to marham (66.32 and 22.93 as compared to 31.72 and 15.77), respectively. By removing profiles rated on both sites, there are  6,446 unique profiles on both sites which have received at least one rating which has been estimated to be about 3% of the doctors serving the country. It is concluded that online reviews and ratings of physicians is a new but increasing phenomenon. Many of the trends are issues in online ratings and reviews are same as those in the developed countries. As online reviews and ratings increase, the need to ensure objectivity and accuracy as well as user education will also increase, for which government bodies, professional associations of doctors and owners of PRWs will need to collaborate.


Allen, R., Agarwal, S. & Trolice, M. P. (2020). Cross-sectional analysis of online patient reviews of infertility care providers. F&S Reports, 1(3), 282–286. Elsevier.

Atkinson, S. (2014). Current status of online rating of Australian doctors. Australian journal of primary health, 20(3), 222–223. CSIRO.

Bäumer, F. S., Kersting, J., Kurvselis, V. & Geierhos, M. (2018). Rate Your Physician: Findings from a Lithuanian Physician Rating Website. International Conference on Information and Software Technologies (pp. 43–58).

Bensnes, S. & Huitfeldt, I. (2021). Rumor has it: How do patients respond to patient-generated physician ratings? Journal of Health Economics, 76, 102415. Elsevier.

Bernstein, D. N. & Mesfin, A. (2020). Physician-Review Websites in Orthopaedic Surgery. JBJS reviews, 8(3), e0158. LWW.

Datareportal,2021. Accessed on May 4, 2021

Etumnu, C. E., Foster, K., Widmar, N. O., Lusk, J. L. & Ortega, D. L. (2020). Does the distribution of ratings affect online grocery sales? Evidence from Amazon. Agribusiness, 36(4), 501–521. Wiley Online Library.

Evans, R. W. (2018). Negative online patient reviews in headache medicine. Headache: The Journal of Head and Face Pain, 58(9), 1435–1441. Wiley Online Library.

Furnas, H. J., Korman, J. M., Canales, F. L. & Pence, L. D. (2020). Patient Reviews: Yelp, Google, Healthgrades, Vitals, and RealSelf. Plastic and Reconstructive Surgery, 146(6), 1419–1431. Wolters Kluwer.

Gilbert, K., Hawkins, C. M., Hughes, D. R., Patel, K., Gogia, N., Sekhar, A. & Duszak Jr, R. (2015). Physician rating websites: do radiologists have an online presence? Journal of the American College of Radiology, 12(8), 867–871. Elsevier.

Goshtasbi, K., Lehrich, B. M., Moshtaghi, O., Abouzari, M., Sahyouni, R., Bagheri, K., Moshtaghi, A., et al. (2019). Patients’ online perception and ratings of neurotologists. Otology & neurotology, 40(1), 139–143. LWW.

Hao, H. (2015). The development of online doctor reviews in China: an analysis of the largest online doctor review website in China. Journal of medical Internet research, 17(6), e134. JMIR Publications Inc., Toronto, Canada.

Hao, H., Zhang, K., Wang, W. & Gao, G. (2017). A tale of two countries: International comparison of online doctor reviews between China and the United States. International journal of medical informatics, 99, 37–44. Elsevier.

He, L., He, C., Wang, Y., Hu, Z., Zheng, K. & Chen, Y. (2020). What Do Patients Care About? Mining Fine-grained Patient Concerns from Online Physician Reviews Through Computer-Assisted Multi-level Qualitative Analysis. AMIA Annual Symposium Proceedings (Vol. 2020, p. 544).

Hong, Y. A., Liang, C., Radcliff, T. A., Wigfall, L. T. & Street, R. L. (2019). What do patients say about doctors online? A systematic review of studies on patient online reviews. Journal of medical Internet research, 21(4), e12521. JMIR Publications Inc., Toronto, Canada.

Khanna, K. & Diab, M. (2021). Physician Ratings: Determinants, Accuracy, and Impact. JBJS, 103(7), e27. LWW.

Lagu, T., Metayer, K., Moran, M., Ortiz, L., Priya, A., Goff, S. L. & Lindenauer, P. K. (2017). Website characteristics and physician reviews on commercial physician-rating websites. Jama, 317(7), 766–768. American Medical Association.

Liu, J. J., Matelski, J. J. & Bell, C. M. (2018). Scope, breadth, and differences in online physician ratings related to geography, specialty, and year: observational retrospective study. Journal of medical Internet research, 20(3), e76. JMIR Publications Inc., Toronto, Canada.

McGurk, T. J. & Caquard, S. (2020). To what extent can online mapping be decolonial? A journey throughout Indigenous cartography in Canada. The Canadian Geographer/Le Géographe canadien, 64(1), 49–64. Wiley Online Library.

McLennan, S. (2019). Quantitative ratings and narrative comments on Swiss physician rating websites: frequency analysis. Journal of medical Internet research, 21(7), e13816. JMIR Publications Inc., Toronto, Canada.

McLennan, S., Strech, D. & Reimann, S. (2017). Developments in the frequency of ratings and evaluation tendencies: a review of German physician rating websites. Journal of medical Internet research, 19(8), e299. JMIR Publications Inc., Toronto, Canada.

Mulgund, P., Sharman, R., Anand, P., Shekhar, S. & Karadi, P. (2020). Data Quality Issues With Physician-Rating Websites: Systematic Review. Journal of Medical Internet Research, 22(9), e15916. JMIR Publications Inc., Toronto, Canada.

Pirveli, E. (2020). Earnings persistence and predictability within the emerging economy of Georgia. Journal of Financial Reporting and Accounting. Emerald Publishing Limited.

Poushter, J. & others. (2016). Smartphone ownership and internet usage continues to climb in emerging economies. Pew research center, 22(1), 1–44. Washington, DC, USA:

Rothenfluh, F. & Schulz, P. J. (2018). Content, quality, and assessment tools of physician-rating websites in 12 countries: quantitative analysis. Journal of medical Internet research, 20(6), e212. JMIR Publications Inc., Toronto, Canada.

Samora, J. B., Lifchez, S. D., Blazar, P. E. & others. (2016). Physician-rating web sites: ethical implications. The Journal of hand surgery, 41(1), 104–110. Elsevier.

Shaheen, B., Shaheen, G., Khan, A. & Khan, S. A. (2021). Why students select a medical career? A descriptive study conducted in various private and public sector medical colleges of Pakistan. Journal of Rawalpindi Medical College, 25(1), 10–15.

Smironva, E., Kiatkawsin, K., Lee, S. K., Kim, J. & Lee, C.-H. (2020). Self-selection and non-response biases in customers’ hotel ratings-a comparison of online and offline ratings. Current Issues in Tourism, 23(10), 1191–1204. Taylor & Francis.

Tariq, A., Khan, S. R. & Basharat, A. (2020). Internet use, ehealth literacy, and dietary supplement use among young adults in Pakistan: cross-sectional study. Journal of Medical Internet Research, 22(6), e17014. JMIR Publications Inc., Toronto, Canada.

Van Velthoven, M. H., Atherton, H. & Powell, J. (2018). A cross sectional survey of the UK public to understand use of online ratings and reviews of health services. Patient education and counseling, 101(9), 1690–1696. Elsevier.

Yadav, M. L. & Roychoudhury, B. (2019). Effect of trip mode on opinion about hotel aspects: A social media analysis approach. International Journal of Hospitality Management, 80, 155–165. Elsevier.

Yaraghi, N., Wang, W., Gao, G. G. & Agarwal, R. (2018). How online quality ratings influence patients’ choice of medical providers: Controlled experimental survey study. Journal of medical Internet research, 20(3), e99. JMIR Publications Inc., Toronto, Canada.

Yu, J., Samuel, L. T., Yalçin, S., Sultan, A. A. & Kamath, A. F. (2020). Patient-Recorded Physician Ratings: What Can We Learn From 11,527 Online Reviews of Orthopedic Surgeons? The Journal of Arthroplasty, 35(6), S364–S367. Elsevier.

Zhang, S., Wang, J.-N., Chiu, Y.-L. & Hsu, Y.-T. (2020). Exploring Types of Information Sources Used When Choosing Doctors: Observational Study in an Online Health Care Community. Journal of medical Internet research, 22(9), e20910. JMIR Publications Inc., Toronto, Canada.