Implementasi Retrieval-Augmented Generation dan Semantic Search pada Chatbot Artificial Intelligence Berbasis Web untuk Optimalisasi Layanan Akademik

Authors

DOI:

https://doi.org/10.29408/jit.v9i2.35253

Keywords:

Artificial Intelligence, Academic Chatbot, LangChain, Retrieval-Augmented Generation

Abstract

Academic information services in higher education institutions still face various obstacles, such as delays in information delivery, limited access to services, and high administrative burdens due to repetitive student inquiries. This study aims to implement Retrieval-Augmented Generation (RAG) and Semantic Search technology in a web-based Artificial Intelligence chatbot to optimize academic services at the Faculty of Engineering, Hamzanwadi University. The research method used is Design Science Research (DSR), which includes data collection, system requirements analysis, design, implementation, testing, and system evaluation. The chatbot's knowledge base is built from academic documents such as academic guidelines, service SOPs, academic calendars, scholarship information, and other administrative documents. The system was developed using an integration of LangChain, Azure OpenAI Service, Azure AI Search, FastAPI, Next.js, and Supabase. Semantic Search techniques are used to perform vector embedding-based searches, while RAG is utilized to generate contextual answers based on relevant documents. Test results show that all key system features performed well with a 100% success rate in unit testing. A user satisfaction evaluation using the Customer Satisfaction Index (CSI) method with 54 respondents yielded a score of 89.34%, categorized as "Very Satisfied," with a Mean Satisfaction Score above 4.37 on a maximum scale of 5.0. The AI ​​chatbot successfully addressed traditional academic information service issues by providing 24/7 service, reducing the workload of campus staff, and ensuring information consistency through RAG technology.

References

[1] M. L. Husain, Y. Wibisono, and A. Anisyah, “Development of an Academic Services Chatbot Based on Retrieval-Augmented Generation (RAG),” Brilliance: Research of Artificial Intelligence, vol. 5, no. 2, pp. 727–735, Aug. 2025, doi: 10.47709/brilliance.v5i2.6719.

[2] S. Elysia and Herianto, “Chatbot Berbasis Retrieval Augmented Generation (RAG) untuk Peningkatan Layanan Informasi Sekolah,” Journal TIFDA (Technology Information and Data Analytic), vol. 1, no. 2, pp. 52–58, Dec. 2024, doi: 10.70491/tifda.v1i2.52.

[3] Deden Moh Alfiansyah, Wiilys, Lila Setiyani, Devi Fajar Wati, and Dedih, “Pengembangan Chatbot Berbasis Web untuk Layanan Informasi di Horizon University,” bit-Tech, vol. 7, no. 3, pp. 1068–1077, Apr. 2025, doi: 10.32877 / bt.v7i3.2318.

[4] S. Elysia and Herianto, “Chatbot Berbasis Retrieval Augmented Generation (RAG) untuk Peningkatan Layanan Informasi Sekolah,” Journal TIFDA (Technology Information and Data Analytic), vol. 1, no. 2, pp. 52–58, Dec. 2024, doi: 10.70491/tifda.v1i2.52.

[5] H. Bahtiar, Dina Sopiana, Muh. Adrian Juniarta Hidayat, and Martua Hamonangan Nasution, “Pemanfaatan Teknologi AI dalam Pembuatan Media Pembelajaran Organ Tubuh Manusia untuk Sekolah Dasar,” Jurnal Printer: Jurnal Pengembangan Rekayasa Informatika dan Komputer, vol. 3, no. 2, pp. 147–157, Dec. 2025, doi: 10.29408 / jprinter. v3i2.33167.

[6] V. U. Subiakto, C. Khodijah, and E. Yulianti, “Pemanfaatan Grup Chat Whatsapp dalam Komunikasi Koordinasi Mahasiswa Universitas Sains Indonesia,” Journal Of Islamic Studies & Sosial Science, vol. 2, pp. 53–60, 2025, doi: 10.64019/jisssv2i1.63.

[7] D. F. Cahyaningtyas and D. Maulida Zakiah, “Navigating Information Overload pada Mahasiswa Non-Library and Information Science dalam Pencarian Informasi Akademik,” Media Informasi, vol. 34, no. 2, pp. 162–171, Nov. 2025, doi: 10.22146/mi.v34i2.23427.

[8] O. Topsakal and T. C. Akinci, “Creating Large Language Model Applications Utilizing LangChain: A Primer on Developing LLM Apps Fast,” Turkey, 2023. doi: 10.59287/icaens.1127.

[9] M. Saddam Heykal Bustomy, M. Alfan Rosid, and H. Setiawan, “Implementasi Chatbot Informasi Akademik Berbasis Retrieval-Augmented Generation (RAG) Menggunakan LLaMA 3.1 [Implementation of an Academic Information Chatbot Based on Retrieval-Augmented Generation (RAG) Using LLaMA 3.1],” 2018.

[10] Rangga Wijaya Sugiarto, Petrus Sokibi, and Putri Rizkiyah, “Chatbot Layanan Akademik Calon Mahasiswa UCIC Menggunakan Metode Retrieval-Augmented Generation,” Jural Riset Rumpun Ilmu Teknik, vol. 4, no. 3, pp. 246–249, Sep. 2025, doi: 10.55606 / jurritek. v4i3.6664.

[11] Y. Yao, J. Duan, K. Xu, Y. Cai, Z. Sun, and Y. Zhang, “A Survey on Large Language Model (LLM) Security and Privacy: The Good, The Bad, and The Ugly,” Jun. 01, 2024, Shandong University. doi: 10.1016/j.hcc.2024.100211.

[12] P. Zhao et al., “Retrieval-Augmented Generation for AI-Generated Content: A Survey,” Mar. 01, 2026, Springer Nature. doi: 10.1007/s41019-025-00335-5.

[13] I. L. Kharisma, M. S. Hidayat, S. Somantri, and K. Kamdan, “Implementasi Retrieval Augmented Generation dalam Sistem Chatbot Dermatologi Berbasis Website,” Jurnal Teknik Informatika dan Sistem Informasi, vol. 11, no. 3, pp. 448–462, Dec. 2025, doi: 10.28932 / jutisi.v11i3.12258.

[14] S. Pokhrel, K. C. Bina, and P. B. Shah, “A Practical Application of Retrieval-Augmented Generation for Website-Based Chatbots: Combining Web Scraping, Vectorization, and Semantic Search,” Journal of Trends in Computer Science and Smart Technology, vol. 6, no. 4, pp. 424–442, Dec. 2024, doi: 10.36548 / jtcsst.2024.4.007.

[15] A. Aufa Alim and M. Indriasari, “Retrieval-Augmented Generation (Rag) Pada Chatbot Whatsapp Untuk Layanan Informasi Akademik Institut Teknologi Indonesia,” 2025.

[16] P. Lewis et al., “Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks,” Apr. 2021, [Online]. Available: ttp://arxiv.org/abs/2005.11401

[18] A. Brown and J. Rossouw, “Artificial intelligence as a reflexive collaborator in graduate studies supervision,” Transformation in Higher Education, vol. 11, Feb. 2026, doi: 10.4102/THE.v11i0.657.

[19] N. Haristiani, “Artificial Intelligence (AI) Chatbot as Language Learning Medium: An inquiry,” in Journal of Physics: Conference Series, Institute of Physics Publishing, Dec. 2019. doi: 10.1088/1742-6596/1387/1/012020.

[20] F. Aslam, “The Impact of Artificial Intelligence on Chatbot Technology: A Study on the Current Advancements and Leading Innovations,” 2023. [Online]. Available: www.ajpojournals.org

[21] Y. Gao et al., “Retrieval-Augmented Generation for Large Language Models: A Survey,” Springer, pp. 1–21, Mar. 2024.

[22] M. Saiful, L M Samsu, Amri Muliawan Nur, and Imam Fathurrahman, “Integrasi Artificial Intelligence dalam Sistem Informasi Web untuk Mendukung Upaya Pelestarian Budaya Sasak Gendang Beleq,” Jurnal Printer: Jurnal Pengembangan Rekayasa Informatika dan Komputer, vol. 3, no. 2, pp. 205–218, Dec. 2025, doi: 10.29408/jprinter.v3i2.33324.

[23] E. Lastyono Putra et al., “Pengembangan Aplikasi Dengan Menggunakan Metode Design Science Research (DSR) Berdasarkan Analisis Technology Readiness Index (TRI) dan Technology Acceptance Model (TAM),” TAM, Dec. 2023.

[24] H. Z. Dimas Adjie, “Implementasi Metode Design Science Research (DSR) pada Monitoring Server Voip Berbasis Web dengan Pendekatan Agile untuk Optimalisasi Kinerja Sistem (Studi Kasus: PT. XYZ),” JURNAL FASILKOM, vol. 16, pp. 175–182, Apr. 2026.

[25] J. Swacha and M. Gracel, “Retrieval-Augmented Generation (RAG) Chatbots for Education: A Survey of Applications,” Apr. 01, 2025, Multidisciplinary Digital Publishing Institute (MDPI). doi: 10.3390/app15084234.

[26] M. Adamakis and T. Rachiotis, “Artificial Intelligence in Higher Education: A State-of-the-Art Overview of Pedagogical Integrity, Artificial Intelligence Literacy, and Policy Integration,” Encyclopedia, vol. 5, no. 4, Dec. 2025, doi: 10.3390/encyclopedia5040180.

[27] M. Saiful and A. Muliawan Nur, “Application of Expert System with Web-Based Forward Chaining Method in Diagnosing Corn Plant Disease,” in Journal of Physics: Conference Series, Institute of Physics Publishing, Jul. 2020. doi: 10.1088/1742-6596/1539/1/012019.

Downloads

Published

21-07-2026

How to Cite

Saiful, M., L M Samsu, Fathurrahman, I., & Muliawan Nur, A. (2026). Implementasi Retrieval-Augmented Generation dan Semantic Search pada Chatbot Artificial Intelligence Berbasis Web untuk Optimalisasi Layanan Akademik. Infotek: Jurnal Informatika Dan Teknologi, 9(2), 604–614. https://doi.org/10.29408/jit.v9i2.35253

Most read articles by the same author(s)

1 2 3 4 > >> 

Similar Articles

<< < 1 2 3 4 5 

You may also start an advanced similarity search for this article.