Pengembangan Sistem Penerjemah Kalimat Bahasa Isyarat Bisindo To Text Dengan Kinect Real Time
DOI:
https://doi.org/10.29408/jit.v8i1.26116Keywords:
LSTM, BISINDO, Sign Language Translator, KinectAbstract
People with hearing and speech impairments often have difficulty communicating with the general public due to a lack of understanding of sign language. This results in social isolation and barriers to accessing information and education. The development of sign language translator technology is expected to improve communication and independence of people with disabilities. The methodology used in this research includes data collection through literature studies, questionnaires, and documentation. The BISINDO data processing algorithm in this research uses the Long short-term memory (LSTM) method to detect skeletons on the hands, face and body. The system implementation uses kinect to capture real-time hand movements. System development uses the Agile method to ensure functionality and fulfillment of user needs. From the evaluation results by testing system performance using confusion matrix by calculating accuracy, recall, precision and F1-Score values. As well as datasets taken in realtime with a total of 90 data, each consisting of 30 actions of my sign language, 30 actions of good sign language, 30 actions of iloveyou sign language. The results show that the system has an accuracy value of 1.0, recall 1.0, precision 1.0 and F-1 Score 1.0 with LSTM algortima, epoch 140 and response data that shows positive towards the system
References
“Aplikasi Pengenalan Huruf Abjad Bahasa Isyarat Mengunakan Metode Convolutional Neural Network.”
R. S. Swestilangen and M. Syafiq, “Strategi Mengatasi Kesepian pada Pria Dewasa Awal Penyandang Tunanetra,” Journal of Psychological Perspective, vol. 3, no. 2, pp. 97–104, Dec. 2021, doi: 10.47679/jopp.321512021.
S. Syafrial and Y. E. Nopiyanto, “Proses Pembelajaran Pendidikan Jasmani Adaptif Siswa Tunarungu,” Jambura Journal of Sports Coaching, vol. 5, no. 1, pp. 62–71, 2023.
S. D. Gusti, L. Susanti, P. Soniska, S. Marsella, and N. Asvio, “Analisis Peran Orangtua pada Tunarungu dalam Mengembangkan Interaksi Sosial,” Excellent Journal for Undergraduate, vol. 1, no. 1, pp. 1–7, 2024.
L. Sudirman, A. Antony, C. Lie, and C. Celline, “Implikasi Artificial Intelligence Terhadap Pelayanan Bantuan Hukum Bagi Penyandang Disabilitas,” ADIL: Jurnal Hukum, vol. 14, no. 2, pp. 112–138, 2023.
E. Zudeta, Y. Novitasari, and D. Fitriani, “Urgensi Bahasa Isyarat di Lingkungan Universitas,” Journal of Special Education Lectura, vol. 2, no. 1, pp. 65–72, 2024.
A. Candra et al., “Development of machine learning-based sign language translator for Bahasa Isyarat Indonesia (BISINDO),” 2024, p. 020070. doi: 10.1063/5.0199747.
S. Nur Budiman, S. Lestanti, and H. Yuana, “SIBI (Sistem Bahasa Isyarat Indonesia) berbasis Machine Learning dan Computer Vision untuk Membantu Komunikasi Tuna Rungu dan Tuna Wicara,” Jurnal Teknologi dan Manajemen Informatika, 2023.
R. E. Caraka et al., “Empowering deaf communication: a novel LSTM model for recognizing Indonesian sign language,” Univers Access Inf Soc, pp. 1–13, 2024.
H. Setiaji, A. I. Syahyadi, and N. Afif, “Pendekatan Baru Penterjemah Bahasa Isyarat Indonesia Dinamis menggunakan metode Gate Recurrent Unit,” Jurnal INSYPRO (Information System and Processing), vol. 9, no. 1, 2024.
A. Saifudin, “PERAN KECERDASAN BUATAN DALAM MENINGKATKAN PEMBELAJARAN SISWA TUNARUNGU DI ERA DIGITAL: indonesia,” Jurnal Informatika Multi, vol. 2, no. 4, pp. 153–160, 2024.
C. N. Insani, N. Arifin, and Muh. R. Rasyid, “Deteksi Gerakan Bahasa Isyarat Menggunakan Euclidean Distance,” Informatik : Jurnal Ilmu Komputer, vol. 19, no. 1, pp. 99–106, May 2023, doi: 10.52958/iftk.v19i1.5658.
S. F. Collin and D. Husin, “PENGALAMAN MULTISENSORI TEMAN TULI DALAM PERANCANGAN EDUKASI-HIBURAN DI KEMBANGAN,” Jurnal Sains, Teknologi, Urban, Perancangan, Arsitektur (Stupa), vol. 6, no. 1, pp. 509–522, Apr. 2024, doi: 10.24912/stupa.v6i1.27495.
S. Nur, A. N. Assyifa, and H. Nurjannah, “Pengembangan Aplikasi Penerjemah Bahasa Isyarat Indonesia (Bisindo) Menggunakan Metode Long-Short Term Memory,” Edusaintek: Jurnal Pendidikan, Sains dan Teknologi, vol. 11, no. 1, pp. 13–30, Jul. 2023, doi: 10.47668/edusaintek.v11i1.898.
I. Sari and E. Altiarika, “Sistem pengembangan bahasa isyarat untuk berkomunikasi dengan penyandang disabilitas (tunarungu),” J. Inf. Technol. Soc, vol. 1, no. 1, pp. 20–25, 2023.
E. Altiarika and W. P. Sari, “Pengembangan Deteksi Realtime untuk Bahasa Isyarat Indonesia dengan Menggunakan Metode Deep Learning Long Short Term Memory dan Convolutional Neural Network,” Jurnal Teknologi Informatika dan Komputer, vol. 9, no. 1, pp. 1–13, 2023.
A. M. Ambarak and A. Z. Falani, “Pengembangan Aplikasi Bahasa Isyarat Indonesia Berbasis Realtime Video Menggunakan Model Machine Learning,” JIKA (Jurnal Informatika), vol. 7, no. 1, p. 89, Feb. 2023, doi: 10.31000/jika.v7i1.7277.
P. B. Utomo, R. A. Ramadhani, and H. Kurniawan, “Deteksi Gerak Tangan sebagai Pengenal Bahasa Isyarat menggunakan Mediapipe dan Long-Short Term Memory,” Simetris: Jurnal Teknik Mesin, Elektro dan Ilmu Komputer, vol. 15, no. 1, 2024.
S. M. Ulfah and S. Ubaidah, “Penerapan bahasa isyarat dalam pembelajaran bagi anak berkebutuhan khusus tuna rungu,” Journal of Dissability Studies and Research (JDSR), vol. 2, no. 1, pp. 29–43, 2023.
Hajrah, A. Azis, and Ilma Rahim, “Analisis Penggunaan Bahasa Isyarat Indonesia (BISINDO) pada Siswa SLB,” Jurnal Onoma: Pendidikan, Bahasa, dan Sastra, vol. 9, no. 2, pp. 1396–1402, Oct. 2023, doi: 10.30605/onoma.v9i2.2717.
S. F. AURELLIA, “ANALISIS DAN PERANCANGAN USER INTERFACE DAN USER EXPERIENCE DENGAN METODE DESIGN THINKING PADA APLIKASI KAMUS DARING BISINDO,” 2023.
M. Saiful, L. M. Samsu, and F. Fathurrahman, “Sistem Deteksi Infeksi COVID-19 Pada Hasil X-Ray Rontgen menggunakan Algoritma Convolutional Neural Network (CNN),” Infotek : Jurnal Informatika dan Teknologi, vol. 4, no. 2, pp. 217–227, Jul. 2021, doi: 10.29408/jit.v4i2.3582.
E. Altiarika and W. P. Sari, “Pengembangan Deteksi Realtime untuk Bahasa Isyarat Indonesia dengan Menggunakan Metode Deep Learning Long Short Term Memory dan Convolutional Neural Network,” Jurnal Teknologi Informatika dan Komputer, vol. 9, no. 1, pp. 1–13, 2023.
T. Arifianto, S. Sunaryo, S. Sunardi, and A. Akhwan, “Deteksi Kecacatan Permukaan Rel Menggunakan Metode Deep Learning Neural Network,” Infotek : Jurnal Informatika dan Teknologi, vol. 6, no. 1, pp. 92–103, Jan. 2023, doi: 10.29408/jit.v6i1.7415.
Nasha Hikmatia A.E. and M. I. Zul, “Aplikasi Penerjemah Bahasa Isyarat Indonesia menjadi Suara berbasis Android menggunakan Tensorflow,” Jurnal Komputer Terapan, vol. 7, no. 1, pp. 74–83, Jun. 2021, doi: 10.35143/jkt.v7i1.4629.
D. Pribadi, M. Wahyudi, D. Puspitasari, A. Wibowo, R. A. Saputra, and R. Saefurrohman, “Real Time Indonesian Sign Language Hand Gesture Phonology Translation Using Deep Learning Model”.
S. Wahyuni, N. S. Layuk, R. H. Loly, and A. N. Daud, “Desain sistem speech recognition penerjemah bahasa toraja menggunakan hidden markov model,” Jurnal Penelitian Pos dan Informatika, vol. 11, no. 2, pp. 107–119, 2021.
I. N. T. A. Putra, K. S. Kartini, Y. K. Suyitno, I. M. Sugiarta, and N. K. E. Puspita, “Penerapan Library Tensorflow, Cvzone, dan Numpy pada Sistem Deteksi Bahasa Isyarat Secara Real Time,” Jurnal Krisnadana, vol. 2, no. 3, pp. 412–423, May 2023, doi: 10.58982/krisnadana.v2i3.335.
A. Widya Agata, W. S J Saputra, and C. Aji Putra, “pengenalan bahasa isyarat indonesia (bisindo) menggunakan algoritma scale invariant feature transform (sift) dan convolutional neural network (cnn),” jati (Jurnal Mahasiswa Teknik Informatika), vol. 8, no. 1, pp. 1054–1061, Mar. 2024, doi: 10.36040/jati.v8i1.8917.
S. Nur, A. N. Assyifa, and H. Nurjannah, “Pengembangan Aplikasi Penerjemah Bahasa Isyarat Indonesia (Bisindo) Menggunakan Metode Long-Short Term Memory,” Edusaintek: Jurnal Pendidikan, Sains dan Teknologi, vol. 11, no. 1, pp. 13–30, Jul. 2023, doi: 10.47668/edusaintek.v11i1.898.
Md. Khaliluzzaman, Md. Abu Bakar Siddiq Sayem, and Lutful KaderMisbah, “HActivityNet: A Deep Convolutional Neural Network for Human Activity Recognition,” EMITTER International Journal of Engineering Technology, vol. 9, no. 2, pp. 357–376, Dec. 2021, doi: 10.24003/emitter.v9i2.642.
T. Jayanti and J. Maulindar, “Optimalisasi Game Penunjang Pembelajaran Untuk Meningkatkan Kemampuan Membaca Anak Di Bimbingan Belajar Puspita Smart Center Berbasis Android,” JISAMAR (Journal of Information System, Applied, Management, Accounting and Research), vol. 7, no. 2, pp. 360–372, 2023.
C. J. Widiyono and J. Maulindar, “Implementation of Artificial Intelligence and Big Data to Overcome Covid-19 Pandemic,” in Proceeding of International Conference on Science, Health, And Technology, 2021, pp. 241–243.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 Infotek: Jurnal Informatika dan Teknologi
This work is licensed under a Creative Commons Attribution 4.0 International License.
Semua tulisan pada jurnal ini menjadi tanggung jawab penuh penulis. Jurnal Infotek memberikan akses terbuka terhadap siapapun agar informasi dan temuan pada artikel tersebut bermanfaat bagi semua orang. Jurnal Infotek ini dapat diakses dan diunduh secara gratis, tanpa dipungut biaya sesuai dengan lisense creative commons yang digunakan.
Jurnal Infotek is licensed under a Creative Commons Attribution 4.0 International License.
Statistik Pengunjung
