Evaluating User Experience of SITASI System using HEART Metrics and Importance-Performance Analysis (IPA)

Authors

  • Elsa Harmaniola Department of Information Systems, Universitas Islam Negeri Sultan Syarif Kasim Riau https://orcid.org/0009-0009-8209-2730
  • Tengku Khairil Ahsyar Department of Information Systems, Universitas Islam Negeri Sultan Syarif Kasim Riau https://orcid.org/0000-0001-9262-159X
  • Syaifullah Syaifullah Department of Information Systems, Universitas Islam Negeri Sultan Syarif Kasim Riau https://orcid.org/0000-0002-3850-2511
  • Anofrizen Anofrizen Department of Information Systems, Universitas Islam Negeri Sultan Syarif Kasim Riau
  • Arif Marsal Department of Information Systems, Universitas Islam Negeri Sultan Syarif Kasim Riau

DOI:

https://doi.org/10.29408/edumatic.v9i2.30691

Keywords:

critical performance analysis, heart metrics, sitasi, user evaluation, user experience

Abstract

SITASI is a web-based system developed to help students manage references and citations for their final projects. Despite its importance, no comprehensive evaluation of the system’s user experience (UX) had been conducted. This study aims to evaluate the UX of SITASI used by students of the Information Systems Study Programme at UIN Suska Riau. Using a quantitative survey method, data were collected from 72 active students from the 2018-2021 cohorts through an online questionnaire. The evaluation was based on the five HEART Metrics dimensions: Happiness, Engagement, Adoption, Retention, and Task Success. Respondents were selected through random sampling using the Slovin formula. Data were analysed using SPSS version 30 for validity, reliability, and Importance-Performance Analysis (IPA). The HEART results indicated high usability levels across all dimensions, with Happiness and Retention scoring highest (73%) and Engagement lowest (70%). IPA showed an average suitability of 92%, with four indicators placed in Quadrant I, signifying urgent areas for improvement. These results serve as a foundation for actionable recommendations to enhance system satisfaction, improve performance, and develop a more user-centered and adaptive SITASI platform.

References

Adhitya, T., Dewi, E. N. F., & Nugraha, M. A. (2024). User Experience Analysis on Siliwangi University SIMAK Using Heart Metrics Framework Based on User Background. International Journal of Applied Information Systems and Informatics (JAISI), 2(1), 34-41.

Aghajanzadeh, M., Aghabayk, K., Esmailpour, J., & De Gruyter, C. (2022). Importance–Performance Analysis (IPA) of metro service attributes during the COVID-19 pandemic. Case studies on transport policy, 10(3), 1661-1672. https://doi.org/10.1016/j.cstp.2022.06.005

Agyekum, K., Akli-Nartey, E. E. K., Kukah, A. S., & Agyekum, A. K. (2023). Importance-performance analysis (IPA) of the indoor environmental quality (IEQ) of an EDGE-certified building in Ghana. International Journal of Building Pathology and Adaptation, 41(1), 73-95. https://doi.org/10.1108/IJBPA-03-2021-0040

Ahsyar, T. K. (2024). Evaluasi Usability Sistem Informasi Akademik SIAM Menggunakan Metode Heuristic Evaluation. Seminar Nasional Teknologi Informasi Komunikasi Dan Industri, 163–170. https://doi.org/https://doi.org/10.37373/infotech.v5i1.1097

Aisyah, R., Zahra, A. L., Shahita, D., & Hidayatullah, W. (2023). Analisis User Experience Pengguna Aplikasi Neobank Berdasarkan Alat Ukur HEART Metrics. Jurnal Penelitian Rumpun Ilmu Teknik, 2(1), 1–15. https://doi.org/https://doi.org/10.55606/juprit.v2i1.1006

Ananda, D., Ahsyar, T. K., Syaifullah, S., & Fronita, M. (2024). Analisa User Experience Sistem KKN Menggunakan Metode Heart Metrics dan Importance Performance Analysis (IPA). Jurnal Teknologi Sistem Informasi Dan Aplikasi, 7(3), 922–933. https://doi.org/10.32493/jtsi.v7i3.40803

Armanda, D. F., Pratama, A., & Suryanto, T. L. M. (2023). Analisis User Experience Terhadap Website E-Learning Disty (DILAN) Menggunakkan HEART Metrics. Jutisi: Jurnal Ilmiah Teknik Informatika Dan Sistem Informasi, 12(1), 31–40. https://doi.org/10.35889/jutisi.v12i1.1176

Astriani, Y., Indah, D. R., Utari, M., & Syahbani, M. H. (2024). Evaluating Netflix’s User Experience (UX) Through the Lens of The HEART Metrics Method. Journal of Applied Informatics and Computing, 8(2), 639–645. https://doi.org/https://doi.org/10.30871/jaic.v8i2.8727

Cladera, M. (2021). An application of importance-performance analysis to students’ evaluation of teaching. Educational Assessment, Evaluation and Accountability, 33(4), 701-715. https://doi.org/10.1007/s11092-020-09338-4

Faisal, A., Zein, M. T. A. A., & Agustin, N. (2024). Analisis User Experience Pada Web Commerce BC HNI Cilacap 1 Dengan Heart Framework. Proceedings of the National Conference on Electrical Engineering, Informatics, Industrial Technology, and Creative Media, 4(1), 872–880.

Falaqi, M. A., Aryani, R., & Khaira, U. (2023). Penerapan Metode HEART Metrics Pada Aplikasi Bantuan Cepat Daring (ABCD) Universitas Jambi. Jurnal Ilmiah Media Sisfo, 17(2), 161–171. https://doi.org/https://doi.org/10.33998/mediasisfo.2023.17.2.1372

Hanum, A. L., Miranti, T. K., Fatmawati, D., Diyon, M. F., & Prawiro, C. J. (2022). Analisis User Experience Aplikasi Mobile Peduli Lindungi Menggunakan Heart Metrics. Jurnal Syntax Admiration, 3(2), 362–372. https://doi.org/https://doi.org/10.46799/jsa.v3i2.390

Herawati, M. C., & Suyatno, D. F. (2023). Evaluasi User Experience Pada Aplikasi SOCO by Sociolla Menggunakan Google’s HEART Metrics dan Set GSM. Journal of Emerging Information System and Business Intelligence (JEISBI), 4(4), 79–85.

Josephine, A. A. A. F., Seta, H. B., & Purabaya, R. H. (2024). Analisis User Experience Tiktok Shop Menggunakan Framework Heart dan Importance Performance Analysis. JITSI: Jurnal Ilmiah Teknologi Sistem Informasi, 5(4), 199–205. https://doi.org/https://doi.org/10.62527/jitsi.5.4.319

Kristi, R. A., Alifian, M. Z., Nisak, S. L. Z., Abidah, I. S., & Dewi, P. K. (2022). Analisis User Experience Aplikasi TIX. ID menggunakan Heart Framework. Prosiding Seminar Nasional Teknologi Dan Sistem Informasi, 2(1), 103–112.

Pristantya, M., Sardi, I. L., & Kurniati, A. P. (2023). Analisis dan Evaluasi User Experience Membaca Buku Digital pada Aplikasi Buku Digital Menggunakan Heart Framework (Studi Kasus: Gramedia Digital). EProceedings of Engineering, 10(3), 3667-3689.

Saputra, M., Ratumbuysang, M. F. N. G., Rahmattullah, M., & Hasanah, M. (2024). Analisis Faktor-Faktor Keterlambatan Mahasiswa Tingkat Akhir Di Program Studi Pendidikan Ekonomi FKIP ULM Dalam Menyelesaikan Skripsi. Jurnal Pendidikan Ekonomi (JUPE), 12(2), 183–189. https://doi.org/10.26740/jupe.v12n2.p183-189

Sari, N., Gustriansyah, R., & Mair, Z. R. (2024). Analisis User Experience Untuk Mengoptimasi Aplikasi Prodeskel Di Kota Palembang. IDEALIS: InDonEsiA JournaL Information System, 7(1), 85–97. https://doi.org/https://doi.org/10.36080/idealis.v7i1.3126

Sidabutar, S., & Ichwani, A. (2024). Evaluasi User Experience Aplikasi Mobile SATUSEHAT Menggunakan Heart Metrics. Jurnal Pepadun, 5(1), 72–82. https://doi.org/https://doi.org/10.23960/pepadun.v5i1.184

Suhaerudin, S., & Alijoyo, F. A. (2022). Pengukuran User Experience Aplikasi Satusehat Dengan Pendekatan Metode Heart Metrics. Syntax Literate; Jurnal Ilmiah Indonesia, 7(9), 16021–16034. https://doi.org/https://doi.org/10.36418/syntax-literate.v7i9.13393

Syahidi, A. A., Asyikin, A. N., Sania, R., & Subandi, S. (2021). Implementation and Evaluation of User Experience on Mobile Augmented Reality Technology-Based Brochure Applications. Edumatic: Jurnal Pendidikan Informatika, 5(2), 137–146. https://doi.org/https://doi.org/10.29408/edumatic.v5i2.3404

Syainal, M. A., Pratama, A., & Fitri, A. S. (2023). Analisis User Experience Pada Aplikasi J&T EXPRESS Menggunakan Metode Heart Matrics. Jutisi: Jurnal Ilmiah Teknik Informatika Dan Sistem Informasi, 12(1), 367-375. https://doi.org/10.35889/jutisi.v12i1.1228

Trenggono, B. W., Faroqi, A., & Wulansari, A. (2022). Penerapan Metode Heart Metrics dalam Menganalisis User Experience Aplikasi E-Learning. Jutisi: Jurnal Ilmiah Teknik Informatika Dan Sistem Informasi, 11(2), 471–482. https://doi.org/10.35889/jutisi.v11i2.876

Yam, J. H., & Taufik, R. (2021). Hipotesis Penelitian Kuantitatif. Perspektif: Jurnal Ilmu Administrasi, 3(2), 96–102. https://doi.org/10.33592/perspektif.v3i2.1540

Downloads

Published

2025-08-14

How to Cite

Harmaniola, E., Ahsyar, T. K., Syaifullah, S., Anofrizen, A., & Marsal, A. (2025). Evaluating User Experience of SITASI System using HEART Metrics and Importance-Performance Analysis (IPA). Edumatic: Jurnal Pendidikan Informatika, 9(2), 522–531. https://doi.org/10.29408/edumatic.v9i2.30691

Issue

Vol. 9 No. 2 (2025): Edumatic: Jurnal Pendidikan Informatika

Section

Articles

License

Copyright (c) 2025 Elsa Harmaniola, Tengku Khairil Ahsyar, Syaifullah Syaifullah, Anofrizen Anofrizen, Arif Marsal

Creative Commons License

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

Semua tulisan pada jurnal ini adalah tanggung jawab penuh penulis. Edumatic: Jurnal Pendidikan Informatika bisa diakses secara free (gratis) tanpa ada pungutan biaya, sesuai dengan lisensi creative commons yang digunakan.

Lisensi Creative Commons
This work is licensed under a Lisensi a Creative Commons Attribution-ShareAlike 4.0 International License.