Retrieval-Augmented Generation (RAG) Chatbot for Handling Customer Complaints in the Energy Sector
Sari
Fast and accurate customer service is critical in the energy sector, especially for large-scale utilities like PLN. This study introduces a novel Retrieval-Augmented Generation (RAG)-based chatbot tailored for PLN’s internal operational context to automate customer complaint resolution in Bahasa Indonesia. In contrast to previous approaches that utilize only fine-tuned LLMs or retrieval-based question answering, our system uniquely integrates internal complaint records stored in internal database with a local Indonesian-optimized LLM through LangChain orchestration. The proposed architecture features temporal and linguistic preprocessing, vector embedding using FAISS, and a dynamic clarification-fallback mechanism, ensuring context-aware and grounded responses. This work contributes a scalable framework for deploying generative AI in high-stakes public utility settings, emphasizing data privacy, language fidelity, and real-time applicability. Evaluation results both simulated and human-reviewed demonstrate the chatbot’s effectiveness, achieving BLEU-4 of 46.5 and ROUGE-L of 0.63, with 92% of answers rated helpful. These findings underscore the model's potential to enhance customer experience and operational efficiency in Indonesia’s energy sector.
Kata Kunci
Teks Lengkap:
PDF (English)Referensi
A. Fadhlurohman, "Development of Indonesian language intelligent chatbot for public services in JAKI application," in Proc. IEEE Int. Smart Cities Conf. (ISC2), 2023, pp. 1–7.
B. W. Wirtz, J. C. Weyerer, and C. Geyer, "Artificial intelligence in action: Shaping the future of public sector," Digit. Policy Regul. Gov., vol. 26, no. 2, pp. 123–138, 2024.
Burges Salmon LLP, "Consumer attitudes on AI use in the energy sector – Ofgem report," 2023.
C. Ferraro, V. Demsar, S. Sands, M. Restrepo, and C. Campbell, "The paradoxes of generative AI-enabled customer service: A guide for managers," Bus. Horiz., vol. 67, no. 5, pp. 549–559, 2024.
C. Vairetti, I. Aránguiz, S. Maldonado, J. P. Karmy, and A. Leal, "Analytics-driven complaint prioritisation via deep learning and multicriteria decision-making," Eur. J. Oper. Res., vol. 312, no. 3, pp. 1108–1118, 2024.
D. A. Weinert and A. M. Rauschecker, "Enhancing large language models with retrieval-augmented generation: A radiology-specific approach," Radiol. Artif. Intell., vol. 7, no. 3, p. e240313, 2025.
D. Steybe et al., "Evaluation of a context-aware chatbot using retrieval-augmented generation for answering clinical questions on medication-related osteonecrosis of the jaw," J. Cranio-Maxillofac. Surg., vol. 53, no. 4, pp. 355–360, 2025.
E. Yang, K. M. Faust, J. Abraham, and B. Marshall, "Exploring the relationship between public trust toward the water sector and the use of bottled water within US shrinking cities," J. Water Resour. Plann. Manage., vol. 149, no. 2, p. 04023001, 2023.
H. D. Rebelo et al., "Automatic update strategy for real-time discovery of hidden customer intents in chatbot systems," Knowl.-Based Syst., vol. 243, Article 108529, 2022.
I. A. Aditya, F. N. Haryadi, I. R. Putri, and S. Suryono, "Understanding service quality concerns from public discourse in Indonesia state electric company," Heliyon, vol. 9, no. 8, p. e18768, 2023.
J. C. L. Chow, R. Li, M. Tang, S. Wu, Y. Lin, and C. Ng, "Developing effective frameworks for large language model–based medical chatbots: Insights from radiotherapy education with ChatGPT," JMIR Cancer, vol. 11, no. 1, p. e66633, 2025.
J. Swacha and M. Gracel, "Retrieval-augmented generation (RAG) chatbots for education: A sur
vey of applications," Appl. Sci., vol. 15, no. 8, p. 4234, 2025.
J. Johnson, M. Douze, and H. Jégou, "Billion-scale similarity search with FAISS," IEEE Trans. Big Data, 2021.
J. I. Criado, R. Sandoval-Almazan, and J. R. Gil-Garcia, "Artificial intelligence adoption in public administration: An overview of current research and future directions," Digit. Gov. Res. Pract., vol. 4, no. 1, pp. 1–14, 2023.
L. van Noordt and P. Misuraca, "Artificial intelligence for the public sector: Opportunities and challenges of cross-sector applications," Gov. Inf. Q., vol. 39, no. 3, 2022.
Ministry of Communication and Informatics, "Realizing Indonesia's Digital Transformation Ambition: From AI to IoT," Business of Government, 2021.
M. E. Cortés-Cediel, A. Segura-Tinoco, I. Cantador, and M. P. R. BolÃvar, "Trends and challenges of e-government chatbots: Advances in exploring open government data and citizen participation content," Gov. Inf. Q., vol. 40, no. 4, p. 101877, 2023.
M. C. Di Salvo, Y. Amichai-Hamburger, M. Monaghan, and C. Solano, "Human-in-the-loop AI: Challenges and opportunities for hybrid decision-making in public services," AI Soc., vol. 39, no. 2, pp. 311–326, 2024.
PLN Indonesia Power, "PLN focuses digital processes on equitable electricity distribution," Asian Business Review, 2024.
P. Lewis et al., "Retrieval-augmented generation for knowledge-intensive NLP tasks," in Adv. Neural Inf. Process. Syst. (NeurIPS), 2020
S. Cahyawijaya, "Bahasa Indonesia NLP pretrained models: Cendol, Komodo, and IndoLLMs," arXiv preprint, arXiv:2403.10010, 2024.
S. Cahyawijaya, W. A. Wibowo, G. I. Winata, and A. Purwarianti, "Cendol: Open instruction-tuned generative large language models for Indonesian languages," arXiv preprint, arXiv:2404.06138, 2024.
S. Wang, N. Reimers, and I. Gurevych, "SBERT: Sentence-BERT for sentence embeddings," in Proc. EMNLP, 2019.
WIZ.AI, "WIZ.AI unveils Southeast Asia's first foundation large language model (LLM) for Bahasa Indonesia," 2023.
W. Song, W. Rong, and Y. Tang, "Quantifying risk of service failure in customer complaints: A textual analysis-based approach," Adv. Eng. Inf., vol. 60, p. 102377, 2024.
W. Cho, H. Lee, and J.-H. Gu, "Optimization techniques and evaluation for building an integrated lightweight platform for AI and data collection systems on low-power edge devices," Energies, vol. 17, no. 7, pp. 1–14, 2024
X. Jiang, W. Wang, S. Tian, and Y. Su, "Applications of natural language processing and large language models in materials discovery," npj Comput. Mater., vol. 11, no. 1, p. 79, 2025
X. Tian, I. Vertommen, L. Tsiami, P. van Thienen, and S. Paraskevopoulos, "Automated customer complaint processing for water utilities based on natural language processing: Case study of a Dutch water utility," Water, vol. 14, no. 4, p. 674, 2022.
Y. Zhang, M. Karunanithi, G. Taherzadeh, and S. Liu, "A retrieval-augmented generation application for question answering in the nutrigenetic domain," Procedia Comput. Sci., vol. 215, pp. 456–462, 2024.
Yellow.ai, "Komodo-7B: The first LLM for regional languages in Indonesia," 2023.
Z. Ji et al., "Hallucination in large language models: A survey," ACM Comput. Surv., vol. 55, no. 12, Article 250, 2023
DOI: http://dx.doi.org/10.30811/jim.v10i2.7169
Refbacks
- Saat ini tidak ada refbacks.
##submission.copyrightStatement##











