Date of Award
Spring 5-2026
Document Type
Thesis
Degree Name
Master of Science (MS)
Department
Electrical Engineering and Computer Science
First Advisor
Jonathan D. Humphreys
Second Advisor
Erik J. Linstead
Third Advisor
Chelsea M. Parlett-Pelleriti
Fourth Advisor
Elia E. Lledo
Abstract
The Fowler School of Engineering currently lacks the manpower to fulfill the advising needs of its students. Advisors spend a significant percentage of advising time handling common, basic questions which could be easily answered from existing documentation. In order to tackle this problem, we propose a locally hosted large language model leveraging a modern retrieval augmented generation pipeline in order to guarantee the language model generates the correct advising information for each student. Our RAG pipeline uses Qwen3.6:27b as the main LLM to generate responses, and a fine-tuned variant of Qwen3.5:4b as an intermediate LLM for miscellaneous tasks such as summarizing documents, query routing to collections, and message compression to preserve a manageable context window size. Two main databases are used, with a 4096 dimension Qdrant vector database used for retrieval and a PostgreSQL database used for memory. In addition, within the RAG pipeline, we have incorporated metadata filtering with the student’s catalog year, major, and minor in order to guarantee deterministic retrieval, hybrid search via both semantic dense search and sparse BM25 retrieval, and re-ranking via the BGE-Reranker-V2-M3 cross-encoder to improve retrieval results.
DOI
10.36837/chapman.000736
Creative Commons License

This work is licensed under a Creative Commons Attribution-Noncommercial-No Derivative Works 4.0 License.
Recommended Citation
S. Au, "A large language model and retrieval-augmented generation system to assist with undergraduate academic advising," M. S. thesis, Chapman University, Orange, CA, 2026. https://doi.org/10.36837/chapman.000736
Included in
Artificial Intelligence and Robotics Commons, Data Science Commons, Systems Architecture Commons