Evaluating LMS Usability by Integrating Nielsen and Budd Principles
Sari
ABSTRACT
Learning Management Systems (LMS) are integral to modern education, supporting course delivery, student engagement, and administrative functions. Usability challenges often divert users’ focus from learning content to navigating system complexities. Heuristic evaluation (HE) has revealed persistent design and usability issues in LMS interfaces, such as poor error prevention and inadequate documentation. To address the usability issues in the LMS, this study aims to evaluate the usability of the classroom ITATS using a dual-framework approach: Jakob Nielsen’s Heuristics and Andy Budd’s Heuristics. This combined approach aims to identify interface flaws and enhance usability. Nielsen’s heuristics address universal usability principles, while Budd’s guidelines emphasize modern web design elements like responsiveness and visual hierarchy. The study is evaluated by novice evaluators who are the end users of LMS. Involving novice evaluators in this study reveals a fresh perspective which cannot be shown by the experts. The study revealed about 158 issues found by 23 novice evaluators. Those were found according to Nielsen’s and Budd’s HE within the average of severity rating about 2.52 and 2.51, respectively. Nielsen’s heuristics highlight core principles such as feedback, visibility, and error prevention, while Budd’s heuristics emphasize simplicity, consistency, and user enjoyment.
Teks Lengkap:
PDF (English)Referensi
M. Okhovati, E. Sharifpoor, F. Karami Robati, Z. Oghabian, and L. Namdar, ‘Usability Evaluation of Electronic Learning Management Systems in the University of Medical Sciences’, Strides Dev. Med. Educ., vol. 21, no. 1, Feb. 2024, doi: 10.22062/sdme.2024.199565.1349.
B. K. Trombley and D. Lee, ‘Webâ€based Learning in Corporations: who is using it and why, who is not and why not?: Journal of Educational Media: Vol 27, No 3’, 2002, doi: https://doi.org/10.1080/1358165020270305.
B. Kehrwald and B. Parker, ‘Editorial 16.1: Implementing online learning, stories from the field’, J. Univ. Teach. Learn. Pract., vol. 16, no. 1, Art. no. 1, Jan. 2019, doi: 10.53761/1.16.1.1.
Q. Huang, ‘Teachers’ intention to use an electronic learning management system in the long term’, Interact. Learn. Environ., vol. 31, no. 10, pp. 7182–7195, Dec. 2023, doi: 10.1080/10494820.2022.2062607.
A. Anand, ‘61+ LMS Statistics 2025: Data, Trends, Future by 2035’, Ensaan. Accessed: Jan. 07, 2025. [Online]. Available: https://ensaantech.com/blog/lms-statistics-and-trends/
Statista, ‘Online Learning Platforms - Indonesia | Market Forecast’, Statista. Accessed: Jan. 07, 2025. [Online]. Available: https://www.statista.com/outlook/emo/online-education/online-learning-platforms/indonesia
W. M. Al-Rahmi et al., ‘Use of E-Learning by University Students in Malaysian Higher Educational Institutions: A Case in Universiti Teknologi Malaysia’, IEEE Access, vol. 6, pp. 14268–14276, 2018, doi: 10.1109/ACCESS.2018.2802325.
M. Sheikh, A. H. Muhammad, and Q. N. hasan Naveed, ‘Enhancing Usability of E-Learning Platform: A Case Study of Khan Academy’, sjesr, vol. 4, no. 2, Art. no. 2, May 2021, doi: 10.36902/sjesr-vol4-iss2-2021(40-50).
T. Hustak and O. Krejcar, ‘Principles of Usability in Human-Computer Interaction’, in Advanced Multimedia and Ubiquitous Engineering, vol. 354, J. J. Park, H.-C. Chao, H. Arabnia, and N. Y. Yen, Eds., in Lecture Notes in Electrical Engineering, vol. 354. , Berlin, Heidelberg: Springer Berlin Heidelberg, 2016, pp. 51–57. doi: 10.1007/978-3-662-47895-0_7.
A. Bartuskova, O. Krejcar, and K. Kuca, ‘Evolutionary Approach of General System Theory Applied on Web Applications Analysis’, in Advanced Computer and Communication Engineering Technology, H. A. Sulaiman, M. A. Othman, M. F. I. Othman, Y. A. Rahim, and N. C. Pee, Eds., Cham: Springer International Publishing, 2015, pp. 411–422. doi: 10.1007/978-3-319-07674-4_41.
D. Benyon, Designing interactive systems : a comprehensive guide to HCI and interaction design. Boston : Pearson, 2013. Accessed: Aug. 09, 2024. [Online]. Available: http://archive.org/details/designinginterac0000beny_i6x5
A. Edwards, ‘Heuristic_evaluation’, 2016.
H. Sharp, P. Jenifer, and Y. Rogers, Interaction Design: Beyond Human-Computer Interaction, 5th Edition. 2019.
A. Budd, ‘Heuristics for Modern Web Application Development’. Accessed: May 28, 2023. [Online]. Available: https://andybudd.com/archives/2007/01/heuristics_for_modern_web_application_de
N. K. Kiget, P. G. Wanyembi, and A. I. Peters, ‘Evaluating Usability of E-Learning Systems in Universities’, Int. J. Adv. Comput. Sci. Appl. Ijacsa, vol. 5, no. 8, Art. no. 8, 41/31 2014, doi: 10.14569/IJACSA.2014.050815.
M. Penha and W. F. M. Correia, ‘Heuristic Evaluation of Usability - a Case study with the Learning Management Systems (LMS) of IFPE’, Int. J. Humanit. Soc. Sci., vol. 4, no. 6, 2014.
R. Lanzilotti, C. Ardito, M. F. Costabile, and A. D. Angeli, ‘eLSE Methodology: A Systematic Approach to the e-Learning Systems Evaluation’, J. Educ. Technol. Soc., vol. 9, no. 4, pp. 42–53, 2006.
K. V. Vlasenko, S. V. Volkov, I. V. Lovianova, I. V. Sitak, O. O. Chumak, and N. H. Bohdanova, ‘Exploring usability principles for educational online courses: a case study on an open platform for online education’, Educ. Technol. Q., vol. 2023, no. 2, pp. 173–187, Jun. 2023, doi: 10.55056/etq.602.
R. Molich and J. Nielsen, ‘Improving a Human- Computer Dialogue’, Commun. ACM, vol. 33, no. 3, 1990.
C. Jiménez, C. Rusu, S. Roncagliolo, R. Inostroza, and V. Rusu, ‘Evaluating a Methodology to Establish Usability Heuristics’, in 2012 31st International Conference of the Chilean Computer Science Society, Nov. 2012, pp. 51–59. doi: 10.1109/SCCC.2012.14.
J. Sauro and J. R. Lewis, Quantifying the user experience: practical statistics for user research. Amsterdam Waltham, MA: Elsevier/Morgan Kaufmann, 2012.
J. Lazar, Research methods in human computer interaction, 2nd edition. Cambridge, MA: Elsevier, 2017.
J. Nielsen, ‘Severity Ratings for Usability Problems’. Accessed: May 28, 2023. [Online]. Available: https://www.nngroup.com/articles/how-to-rate-the-severity-of-usability-problems/
J. Nielsen, ‘Iterative user-interface design. Computer, 26(11)’, 1993, pp. 32–41.
D. Norman, The Psychology of Everyday Things. New York: Basic Books, 1988.
S. Krug, ‘Don’t make me think, revisited: a common sense approach to Web usability’, Choice Rev. Online, vol. 51, no. 11, pp. 51-6218-51–6218, Jul. 2014, doi: 10.5860/choice.51-6218.
ISO 9241-11, ‘ISO 9241-11:2018(en), Ergonomics of human-system interaction — Part 11: Usability: Definitions and concepts’. Accessed: May 28, 2023. [Online]. Available: https://www.iso.org/obp/ui/#iso:std:iso:9241:-11:ed-2:v1:en
B. David, ‘Designing interactive systems : a comprehensive guide to HCI, UX and interaction design’, Harlow PearsonEducation, p. 604, 2013.
J. Nielsen, ‘10 Usability Heuristics for User Interface Design’, Nielsen Norman Group. Accessed: Jan. 08, 2025. [Online]. Available: https://www.nngroup.com/articles/ten-usability-heuristics/
J. Nielsen, ‘Enhancing the Explanatory Power of Usability Heuristics’, Human Factors Computing Systems, 1994.
DOI: http://dx.doi.org/10.30811/jaise.v5i3.7401
Refbacks
- Saat ini tidak ada refbacks.
Indexing :
Journal of Artificial Intelligence and Software Engineering (JAISE) licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.