Evaluation of the Usability of Drmyco Web Application Using the Think-Aloud Method

Fatemeh Pezeshki, Hanieh Keikhay Moghadam, Syed Mehdi Mirzaei, Fateme Moghbeli



Introduction: Health information technology has great potential to address some of the challenges of developed and developing countries in providing accessible, affordable and high-quality healthcare services. Telemedicine uses health information technology to overcome geographic barriers and increase access to health care services. This is particularly useful for rural and disadvantaged communities in developing countries. There are many reasons for abandoning and failing the web application; one of the most important obstacles to their use is low applicability. The purpose of this study is to investigate the usability of Drmyco web application.

Material and Methods: Evaluation was done in a laboratory environment based on a pre-prepared scenario using the think-aloud method by 15 users (health information technology students from all over the country). Then the identified problems and identified problems were classified based on the Van den Haak method. The Nielsen method was used to evaluate the severity of the problems.

Results: The average duration of the evaluation process in this study for users was 22.06 minutes. The total number of problems identified by users was 19.

Conclusion: The two principles of Layout and Comprehensiveness were identified as the most problems for users.


Usability Evaluation; Web Application; Drmyco; Think Aloud Method;


Moghbeli F, Langarizadeh M, Moghadam YA, Hasanpour Heidari S. Design the conceptual model of teleconsultation system for dental diseases. Frontiers in Health Informatics. 2019; 8: 22.

Cho H, Powell D, Pichon A, Kuhns LM, Garofalo R, Schnall R. Eye-tracking retrospective think-aloud as a novel approach for a usability evaluation. Int J Med Inform. 2019; 129: 366-73. PMID: 31445278 DOI: 10.1016/j.ijmedinf.2019.07.010

Maramba I, Chatterjee A, Newman C. Methods of usability testing in the development of eHealth applications: A scoping review. Int J Med Inform. 2019; 126: 95-104. PMID: 31029270 DOI: 10.1016/j.ijmedinf.2019.03.018

Moghbeli F, Langarizadeh M, Kouhestani A, Orooji A. Modeling the acceptance of hospital information systems among nurses: An extended technology acceptance model. Frontiers in Health Informatics. 2018; 7: 1.

Mazaheri Habibi MR, Moghbeli F, Langarizadeh M, Fatemi Aghda SA. Mobile health apps for pregnant women usability and quality rating scales: A systematic review. BMC Pregnancy Childbirth. 2024; 24(1): 34.PMID: 38183035 DOI: 10.1186/s12884-023-06206-z

Mohammadi G, Pezeshki F, Vatanchi YM, Moghbeli F. Application of technology in educating nursing students during COVID-19: A systematic review. Frontiers in Health Informatics. 2021; 10: 64.

Van den Haak MJ, De Jong MD, Schellens PJ. Evaluation of an informational web site: Three variants of the think-aloud method compared. Technical Communication. 2007; 54(1): 58-71.

Noohi S, Karamitanha F, Shoghli A. Self-care ability of the elderly and related factors. Preventive Care in Nursing & Midwifery Journal. 2022; 12(4): 19-25.

Moghadam HK, Sabzghabaei B, Moghbeli F. The effects of dietary mobile apps on nutritional disorders: A systematic review. Journal of Biomedical Physics & Engineering. 2023; 13: 211.

Arredondo A, Aviles R. Costs and epidemiological changes of chronic diseases: Implications and challenges for health systems. PLoS One. 2015; 10(3): e0118611. PMID: 25781625 DOI: 10.1371/journal.pone.0118611

Zhang L, Liu Z, Mo K, Pu W, Yin J, Ma Z, et al. Technological advances in out-of-hospital care: Digital solutions, Asia Pacific experiences, and inherent challenges. Informatics and Health. 2024; 1(1): 9-15.

Zain DSM, Bowles FA. What do our future EFL teachers think about using mobile devices in class? Applied Research on English Education. 2024; 2(1): 1-14.

Fan K, Zhao Y. Mobile health technology: A novel tool in chronic disease management. Intelligent Medicine. 2022; 2(1): 41-7.

Montaseri N, Langarizadeh M, Bayani A, Moghbeli F. The effectiveness of self-management mobile health technology in chronic disease: A systematic review. Shiraz E-Medical Journal. 2018; 19(Suppl): e66310.

Min Q, Wang X, Huang B, Xu L. Web-based technology for remote viewing of radiological images: App validation. J Med Internet Res. 2020; 22(9): e16224. PMID: 32975520 DOI: 10.2196/16224

Langarizadeh M, Moghbeli F, Ahmadi S, Langarizadeh MH, Sayadi M, Sarpourian F, et al. Design and evaluation of an educational mobile program for liver transplant patients. BMC Health Serv Res. 2023; 23(1): 974. PMID: 37684647 DOI: 10.1186/s12913-023-09989-1

Wolcott MD, Lobczowski NG. Using cognitive interviews and think-aloud protocols to understand thought processes. Curr Pharm Teach Learn. 2021; 13(2): 181-8. PMID: 33454077 DOI: 10.1016/j.cptl.2020.09.005

Johnson WR, Artino Jr AR, Durning SJ. Using the think aloud protocol in health professions education: An interview method for exploring thought processes: AMEE Guide No. 151. Med Teach. 2023; 45(9): 937-48. PMID: 36534743 DOI: 10.1080/0142159X.2022.2155123

Abtahi H, Amini S, Gholamzadeh M, Gharabaghi MA. Development and evaluation of a mobile-based asthma clinical decision support system to enhance evidence-based patient management in primary care. Informatics in Medicine Unlocked. 2023; 37: 101168.

Dannala ASSK, Chunduri SS. Heuristic usability evaluation of the BTH student portal by applying Nielsen's heuristics. 2022.

Munawar A, Usino W. User interface analysis to increase user experience on computer based test application: Case study SMK Negeri 4 Pandeglang. International Conference on IT, Communication and Technology for Better Life. Science and Technology Publications; 2019.

Ivanova D, Mitev D. Usability strategy and guidelines for building an accessible web portal. AIP Conference Proceedings. AIP Publishing; 2021.

Mahfudz MS, Agusti F, Zahra SA, Dhini BR. Heuristic evaluation analysis using the 10 Nilsen rule usability method on the KAI access application. International Conference on Science, Health, And Technology. LPPM Universitas Duta bangsa Surakarta, Indonesia; 2022.

Vanicek T, Popelka S. The think-aloud method for evaluating the usability of a regional atlas. International Journal of Geo-Information. 2023; 12(3): 95.

Santoso AR, Untoro MC, Karnila S, Effendi YA. Evaluation of usability and user interface design on Vokasiku mobile application using think aloud. AIP Conference Proceedings. AIP Publishing; 2024.

DOI: https://doi.org/10.30699/fhi.v13i0.598


  • There are currently no refbacks.