Bidirectional Long Short-Term Memory Model for Intent Classification in Customer Service Chatbot

Yagus Cahyadi, Sri Redjeki, Ahmad Almagrib, Bayu Satriani, Nabil Naufal

Sari


The demand for responsive and efficient customer service is a crucial aspect of enhancing customer satisfaction, particularly in Indonesian government offices abroad. To address this challenge is implementing a chatbot system based on Bidirectional Long Short-Term Memory. This model can understand conversational contexts more comprehensively, enabling it to generate relevant and timely responses. This study aims to optimize chatbot performance in enhancing customer experience by implementing the Bi LSTM algorithm to handle intent classification of customer input data. Experimental results demonstrate that this model successfully improves evaluation metrics, achieving an accuracy of 84.64%, precision of 85%, recall of 85%, and an F1-score of 85%.

Teks Lengkap:

PDF

Referensi


R. Santa, J. B. MacDonald, and M. Ferrer, “The role of trust in e-Government effectiveness, operational effectiveness and user satisfaction: Lessons from Saudi Arabia in e-G2B,†Gov Inf Q, vol. 36, no. 1, pp. 39–50, Jan. 2019, doi: 10.1016/j.giq.2018.10.007.

Y. Li and H. Shang, “Service quality, perceived value, and citizens’ continuous-use intention regarding e-government: Empirical evidence from China,†Information & Management, vol. 57, no. 3, p. 103197, Apr. 2020, doi: 10.1016/j.im.2019.103197.

K. A. Prihatna, I. G. So, H. Saroso, and W. Kosasih, “What about Service Quality, Satisfaction, and Loyalty in e-Business? A Systematic Review of Literature,†in 2021 International Conference on Information Management and Technology (ICIMTech), IEEE, Aug. 2021, pp. 767–772. doi: 10.1109/ICIMTech53080.2021.9534953.

B. Budiarno, I. B. N. Udayana, and A. Lukitaningsih, “PENGARUH KUALITAS LAYANAN, KUALITAS PRODUK TERHADAP KEPUASAN PELANGGAN DALAM MEMBENTUK LOYALITAS PELANGGAN,†Equilibrium: Jurnal Penelitian Pendidikan dan Ekonomi, vol. 19, no. 02, pp. 226–233, Jul. 2022, doi: 10.25134/equi.v19i02.4531.

A. T. Longgarini, A. N. Shaafiyah, and B. M. Rahmaningtias, “Penanganan Pekerja Migran Indonesia Non-Prosedural dalam Perspektif Hukum Keimigrasian,†Jurnal Ilmiah Universitas Batanghari Jambi, vol. 23, no. 2, p. 1474, Jul. 2023, doi: 10.33087/jiubj.v23i2.3110.

R. Zahara, “Pengaruh kualitas layanan terhadap loyalitas pelanggan dengan kepuasan pelanggan sebagai variabel intervening,†Jurnal Manajemen Strategi dan Aplikasi Bisnis, vol. 3, no. 1, pp. 31–38, Jan. 2020, doi: 10.36407/jmsab.v3i1.121.

C. V. Misischia, F. Poecze, and C. Strauss, “Chatbots in customer service: Their relevance and impact on service quality,†Procedia Comput Sci, vol. 201, pp. 421–428, 2022, doi: 10.1016/j.procs.2022.03.055.

C.-L. Hsu and J. C.-C. Lin, “Understanding the user satisfaction and loyalty of customer service chatbots,†Journal of Retailing and Consumer Services, vol. 71, p. 103211, Mar. 2023, doi: 10.1016/j.jretconser.2022.103211.

E. W. T. Ngai, M. C. M. Lee, M. Luo, P. S. L. Chan, and T. Liang, “An intelligent knowledge-based chatbot for customer service,†Electron Commer Res Appl, vol. 50, p. 101098, Nov. 2021, doi: 10.1016/j.elerap.2021.101098.

S. Schanke, G. Burtch, and G. Ray, “Estimating the Impact of ‘Humanizing’ Customer Service Chatbots,†Information Systems Research, vol. 32, no. 3, pp. 736–751, Sep. 2021, doi: 10.1287/isre.2021.1015.

A. B. Rakib, E. A. Rumky, A. J. Ashraf, Md. M. Hillas, and M. A. Rahman, “Mental Healthcare Chatbot Using Sequence-to-Sequence Learning and BiLSTM,†2021, pp. 378–387. doi: 10.1007/978-3-030-86993-9_34.

N. Lhasiw, T. Tanantong, and N. Sanglerdsinlapachai, “Thai Conversational Chatbot Classification Using BiLSTM and Data Augmentation,†2023, pp. 127–141. doi: 10.1007/978-981-99-7969-1_10.

P. Anki, A. Bustamam, H. S. Al-Ash, and D. Sarwinda, “High Accuracy Conversational AI Chatbot Using Deep Recurrent Neural Networks Based on BiLSTM Model,†in 2020 3rd International Conference on Information and Communications Technology (ICOIACT), IEEE, Nov. 2020, pp. 382–387. doi: 10.1109/ICOIACT50329.2020.9332074.

I. Casanueva, T. TemÄinas, D. Gerz, M. Henderson, and I. Vulić, “Efficient Intent Detection with Dual Sentence Encoders,†Mar. 2020.

P. Mishra, A. Biancolillo, J. M. Roger, F. Marini, and D. N. Rutledge, “New data preprocessing trends based on ensemble of multiple preprocessing techniques,†TrAC Trends in Analytical Chemistry, vol. 132, p. 116045, Nov. 2020, doi: 10.1016/j.trac.2020.116045.

F. Kamiran and T. Calders, “Data preprocessing techniques for classification without discrimination,†Knowl Inf Syst, vol. 33, no. 1, pp. 1–33, Oct. 2012, doi: 10.1007/s10115-011-0463-8.

P. Suebsombut, A. Sekhari, P. Sureephong, A. Belhi, and A. Bouras, “Field Data Forecasting Using LSTM and Bi-LSTM Approaches,†Applied Sciences, vol. 11, no. 24, p. 11820, Dec. 2021, doi: 10.3390/app112411820.

F. Shahid, A. Zameer, and M. Muneeb, “Predictions for COVID-19 with deep learning models of LSTM, GRU and Bi-LSTM,†Chaos Solitons Fractals, vol. 140, p. 110212, Nov. 2020, doi: 10.1016/j.chaos.2020.110212.

S. Siami-Namini, N. Tavakoli, and A. S. Namin, “The Performance of LSTM and BiLSTM in Forecasting Time Series,†in 2019 IEEE International Conference on Big Data (Big Data), IEEE, Dec. 2019, pp. 3285–3292. doi: 10.1109/BigData47090.2019.9005997.

Y. Yu, X. Si, C. Hu, and J. Zhang, “A Review of Recurrent Neural Networks: LSTM Cells and Network Architectures,†Neural Comput, vol. 31, no. 7, pp. 1235–1270, Jul. 2019, doi: 10.1162/neco_a_01199.

I. V. Pustokhina, D. A. Pustokhin, E. L. Lydia, P. Garg, A. Kadian, and K. Shankar, “Hyperparameter search based convolution neural network with Bi-LSTM model for intrusion detection system in multimedia big data environment,†Multimed Tools Appl, vol. 81, no. 24, pp. 34951–34968, Oct. 2022, doi: 10.1007/s11042-021-11271-7.

N. Sutarna, C. Tjahyadi, P. Oktivasari, M. Dwiyaniti, and Tohazen, “Hyperparameter Tuning Impact on Deep Learning Bi-LSTM for Photovoltaic Power Forecasting,†Journal of Robotics and Control (JRC), vol. 5, no. 3, pp. 677–693, 2024, doi: 10.18196/jrc.v5i3.21120.

T. Makarovskikh and M. Abotaleb, “Hyper-parameter Tuning for Long Short-Term Memory (LSTM) Algorithm to Forecast a Disease Spreading,†in 2022 VIII International Conference on Information Technology and Nanotechnology (ITNT), IEEE, May 2022, pp. 1–6. doi: 10.1109/ITNT55410.2022.9848654.

H. Dalianis, “Evaluation Metrics and Evaluation,†in Clinical Text Mining, Cham: Springer International Publishing, 2018, pp. 45–53. doi: 10.1007/978-3-319-78503-5_6.

D. M. W. Powers, “Evaluation: from precision, recall and F-measure to ROC, informedness, markedness and correlation,†Oct. 2020.

R. Yacouby and D. Axman, “Probabilistic Extension of Precision, Recall, and F1 Score for More Thorough Evaluation of Classification Models,†in Proceedings of the First Workshop on Evaluation and Comparison of NLP Systems, Stroudsburg, PA, USA: Association for Computational Linguistics, 2020, pp. 79–91. doi: 10.18653/v1/2020.eval4nlp-1.9.




DOI: http://dx.doi.org/10.30811/jaise.v5i1.6520

Refbacks



Indexing :

Creative Commons License
Journal of Artificial Intelligence and Software Engineering (JAISE) licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.