Beyond the Hype. Deploying and Evaluating a Conversational Agent Using LLMs in an Academic Setting