A Course-Specific Agentic RAG Chatbot for IT Student Support: Architecture, Local Deployment, and Preliminary Evaluation at Hai Phong University
Research Article  ·  Published: 30 May 2026
Issue cover
Next-Generation Computing Systems and Technologies
Volume 2, Issue 2, 2026: 21-34
Research Article Open Access

A Course-Specific Agentic RAG Chatbot for IT Student Support: Architecture, Local Deployment, and Preliminary Evaluation at Hai Phong University

1 Faculty of Information Technology, Hai Phong University, Hai Phong 180000, Vietnam
* Corresponding Author: Dac-Nhuong Le, [email protected]
Volume 2, Issue 2

Article Information

Abstract

This paper introduces a course-specific agentic retrieval-augmented generation (RAG) chatbot developed to support Information Technology students at Hai Phong University. The proposed system addresses the limitations of static FAQ bots, which are unable to manage open-ended academic tasks, and model-only large language model (LLM) assistants, which may generate fluent yet insufficiently grounded responses. The prototype combines local LLM deployment, semantic retrieval of course materials, and constrained, tool-oriented orchestration to perform four key tasks: question answering, document summarization, study planning, and quiz generation. The primary contributions include a six-layer privacy-aware architecture, a semi-agentic workflow for task routing and source-grounded response generation, and an evaluation protocol that compares LLM-only, RAG, and RAG-plus-orchestration scenarios using a five-dimensional academic rubric. Preliminary local testing demonstrates response times ranging from approximately 2 to 45 seconds for inputs of 1,000-20,000 words, with summary outputs compressed to 10–30% of the original source length. These findings suggest that department-level, course-grounded academic assistance is achievable with modest infrastructure, provided that retrieval, logging, and bounded orchestration are prioritized as core design requirements.

Graphical Abstract

A Course-Specific Agentic RAG Chatbot for IT Student Support: Architecture, Local Deployment, and Preliminary Evaluation at Hai Phong University

Keywords

agentic AI educational chatbot retrieval-augmented generation local large language model academic support information technology education

Data Availability Statement

Data will be made available on request.

Funding

This work was guided and supported by Associate Professor Dr Dac-Nhuong Le, the Principal Investigator of the project “Research on developing a search system (HPUmind) to support teaching and learning in Information Technology, integrated circuit design, and semiconductors at Hai Phong University” (ĐT.XH.2025.980).

Conflicts of Interest

Dac-Nhuong Le serves as an Associate Editor of Next-Generation Computing Systems and Technologies. To ensure the integrity of the peer-review process, Dac-Nhuong Le had no involvement in the editorial review, peer review, or decision-making process for this manuscript. The manuscript was handled independently by another editor in accordance with the journal’s editorial policies. The remaining authors declare that they have no conflicts of interest.

AI Use Statement

The authors declare that no generative AI was used in the preparation of this manuscript.

Ethical Approval and Consent to Participate

Not applicable.

References

  1. Chiu, T. K. F., Xia, Q., Zhou, X., Chai, C. S., & Cheng, M. (2023). Systematic literature review on opportunities, challenges, and future research recommendations of artificial intelligence in education. Computers and Education: Artificial Intelligence, 4, 100118.
    [CrossRef] [Google Scholar]
  2. Garzón, J., Patiño, E., & Marulanda, C. (2025). Systematic review of artificial intelligence in education: Trends, benefits, and challenges. Multimodal Technologies and Interaction, 9(8), 84.
    [CrossRef] [Google Scholar]
  3. Lo, C. K., Hew, K. F., & Jong, M. S. Y. (2024). The influence of ChatGPT on student engagement: A systematic review and future research agenda. Computers & Education, 219, 105100.
    [CrossRef] [Google Scholar]
  4. Qadir, J. (2023, May). Engineering education in the era of ChatGPT: Promise and pitfalls of generative AI for education. In 2023 IEEE global engineering education conference (EDUCON) (pp. 1-9). IEEE.
    [CrossRef] [Google Scholar]
  5. Raihan, N., Siddiq, M. L., Santos, J. C., & Zampieri, M. (2025, February). Large language models in computer science education: A systematic literature review. In Proceedings of the 56th ACM technical symposium on computer science education V. 1 (pp. 938-944).
    [CrossRef] [Google Scholar]
  6. Kim, M., Kim, J., Knotts, T. L., & Albers, N. D. (2025). AI for academic success: Investigating the role of usability, enjoyment, and responsiveness in ChatGPT adoption. Education and Information Technologies, 30(10), 14393-14414.
    [CrossRef] [Google Scholar]
  7. Denny, P., Leinonen, J., Prather, J., Luxton-Reilly, A., Amarouche, T., Becker, B. A., & Reeves, B. N. (2024, March). Prompt Problems: A new programming exercise for the generative AI era. In Proceedings of the 55th ACM Technical Symposium on Computer Science Education V. 1 (pp. 296-302).
    [CrossRef] [Google Scholar]
  8. Lewis, P., Perez, E., Piktus, A., Petroni, F., Karpukhin, V., Goyal, N., ... & Kiela, D. (2020). Retrieval-augmented generation for knowledge-intensive nlp tasks. Advances in neural information processing systems, 33, 9459-9474.
    [Google Scholar]
  9. Swacha, J., & Gracel, M. (2025). Retrieval-augmented generation (RAG) chatbots for education: A survey of applications. Applied Sciences, 15(8), 4234.
    [CrossRef] [Google Scholar]
  10. Johnson, J., Douze, M., & Jégou, H. (2019). Billion-scale similarity search with GPUs. IEEE transactions on big data, 7(3), 535-547.
    [CrossRef] [Google Scholar]
  11. Pan, J. J., Wang, J., & Li, G. (2024). Survey of vector database management systems. The VLDB Journal, 33(5), 1591-1615.
    [CrossRef] [Google Scholar]
  12. Reimers, N., & Gurevych, I. (2019, November). Sentence-bert: Sentence embeddings using siamese bert-networks. In Proceedings of the 2019 conference on empirical methods in natural language processing and the 9th international joint conference on natural language processing (EMNLP-IJCNLP) (pp. 3982-3992).
    [CrossRef] [Google Scholar]
  13. Schick, T., Dwivedi-Yu, J., Dessì, R., Raileanu, R., Lomeli, M., Hambro, E., ... & Scialom, T. (2023). Toolformer: Language models can teach themselves to use tools. Advances in neural information processing systems, 36, 68539-68551.
    [Google Scholar]
  14. Wang, L., Ma, C., Feng, X., Zhang, Z., Yang, H., Zhang, J., ... & Wen, J. (2024). A survey on large language model based autonomous agents. Frontiers of Computer Science, 18(6), 186345.
    [CrossRef] [Google Scholar]
  15. Madaan, A., Tandon, N., Gupta, P., Hallinan, S., Gao, L., Wiegreffe, S., ... & Clark, P. (2023). Self-refine: Iterative refinement with self-feedback. Advances in neural information processing systems, 36, 46534-46594.
    [Google Scholar]
  16. Phung, T. N. (2026). Using explainable AI to diagnose institutional inequality in student dropout across ethnic and regional groups in Vietnam. AI & SOCIETY, 1-18.
    [CrossRef] [Google Scholar]
  17. Phung, T. N., Do, D. C., Nguyen, T. T., Nguyen, V. S., Nguyen, T. V., & Le, D. N. (2026). An integrated framework for outcome based education and AI supported blended learning in curriculum redesign and intelligent training management. Discover Computing, 29(1), 196.
    [CrossRef] [Google Scholar]

Cite This Article

APA Style
Tran, H. V., Nguyen, P. V., Vu, T. T. N., Luong, H. P., & Le, D. N. (2026). A Course-Specific Agentic RAG Chatbot for IT Student Support: Architecture, Local Deployment, and Preliminary Evaluation at Hai Phong University. Next-Generation Computing Systems and Technologies, 2(2), 21-34. https://doi.org/10.62762/NGCST.2026.601800
Export Citation
RIS Format
Compatible with EndNote, Zotero, Mendeley, and other reference managers
TY  - JOUR
AU  - Van, Tran Huu
AU  - Vinh, Nguyen Phu
AU  - Ngan, Vu Thi Tuyet
AU  - Phuong, Luong Ha
AU  - Le, Dac-Nhuong
PY  - 2026
DA  - 2026/05/30
TI  - A Course-Specific Agentic RAG Chatbot for IT Student Support: Architecture, Local Deployment, and Preliminary Evaluation at Hai Phong University
JO  - Next-Generation Computing Systems and Technologies
T2  - Next-Generation Computing Systems and Technologies
JF  - Next-Generation Computing Systems and Technologies
VL  - 2
IS  - 2
SP  - 21
EP  - 34
DO  - 10.62762/NGCST.2026.601800
UR  - https://www.icck.org/article/abs/NGCST.2026.601800
KW  - agentic AI
KW  - educational chatbot
KW  - retrieval-augmented generation
KW  - local large language model
KW  - academic support
KW  - information technology education
AB  - This paper introduces a course-specific agentic retrieval-augmented generation (RAG) chatbot developed to support Information Technology students at Hai Phong University. The proposed system addresses the limitations of static FAQ bots, which are unable to manage open-ended academic tasks, and model-only large language model (LLM) assistants, which may generate fluent yet insufficiently grounded responses. The prototype combines local LLM deployment, semantic retrieval of course materials, and constrained, tool-oriented orchestration to perform four key tasks: question answering, document summarization, study planning, and quiz generation. The primary contributions include a six-layer privacy-aware architecture, a semi-agentic workflow for task routing and source-grounded response generation, and an evaluation protocol that compares LLM-only, RAG, and RAG-plus-orchestration scenarios using a five-dimensional academic rubric. Preliminary local testing demonstrates response times ranging from approximately 2 to 45 seconds for inputs of 1,000-20,000 words, with summary outputs compressed to 10–30% of the original source length. These findings suggest that department-level, course-grounded academic assistance is achievable with modest infrastructure, provided that retrieval, logging, and bounded orchestration are prioritized as core design requirements.
SN  - 3070-3328
PB  - Institute of Central Computation and Knowledge
LA  - English
ER  - 
BibTeX Format
Compatible with LaTeX, BibTeX, and other reference managers
@article{Van2026A,
  author = {Tran Huu Van and Nguyen Phu Vinh and Vu Thi Tuyet Ngan and Luong Ha Phuong and Dac-Nhuong Le},
  title = {A Course-Specific Agentic RAG Chatbot for IT Student Support: Architecture, Local Deployment, and Preliminary Evaluation at Hai Phong University},
  journal = {Next-Generation Computing Systems and Technologies},
  year = {2026},
  volume = {2},
  number = {2},
  pages = {21-34},
  doi = {10.62762/NGCST.2026.601800},
  url = {https://www.icck.org/article/abs/NGCST.2026.601800},
  abstract = {This paper introduces a course-specific agentic retrieval-augmented generation (RAG) chatbot developed to support Information Technology students at Hai Phong University. The proposed system addresses the limitations of static FAQ bots, which are unable to manage open-ended academic tasks, and model-only large language model (LLM) assistants, which may generate fluent yet insufficiently grounded responses. The prototype combines local LLM deployment, semantic retrieval of course materials, and constrained, tool-oriented orchestration to perform four key tasks: question answering, document summarization, study planning, and quiz generation. The primary contributions include a six-layer privacy-aware architecture, a semi-agentic workflow for task routing and source-grounded response generation, and an evaluation protocol that compares LLM-only, RAG, and RAG-plus-orchestration scenarios using a five-dimensional academic rubric. Preliminary local testing demonstrates response times ranging from approximately 2 to 45 seconds for inputs of 1,000-20,000 words, with summary outputs compressed to 10–30\% of the original source length. These findings suggest that department-level, course-grounded academic assistance is achievable with modest infrastructure, provided that retrieval, logging, and bounded orchestration are prioritized as core design requirements.},
  keywords = {agentic AI, educational chatbot, retrieval-augmented generation, local large language model, academic support, information technology education},
  issn = {3070-3328},
  publisher = {Institute of Central Computation and Knowledge}
}

Article Metrics

Citations
Crossref
0
Scopus
0
Views
327
PDF Downloads
40

Publisher's Note

ICCK stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and Permissions

CC BY Copyright © 2026 by the Author(s). Published by Institute of Central Computation and Knowledge. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/), which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made.
Next-Generation Computing Systems and Technologies
Next-Generation Computing Systems and Technologies
ISSN: 3070-3328 (Online)
Portico
Preserved at
Portico