Authors:
L. Saikrishna, S. Sreman Narayana, P. Cheenu Sriyan
Addresses:
Department of Computer Science and Engineering, SRM Institute of Science and Technology, Ramapuram, Chennai, Tamil Nadu, India.
Abstract:
Large Language Models (LLMs) have revolutionised the landscape of natural language processing (NLP), offering sophisticated conversational capabilities across various domains. This paper explores the adaptation of Meta’s LLaMA model for financial chatbot applications, emphasising domain-specific fine-tuning and performance evaluation. Fine-tuning LLaMA for finance requires specialised datasets, encompassing market trends, financial regulations, and investment strategies to enhance contextual understanding and response accuracy. Key aspects of this process include data curation, supervised fine-tuning, and reinforcement learning techniques, which aim to align model outputs with financial reasoning and industry standards. Furthermore, evaluation metrics such as perplexity, response coherence, and financial sentiment analysis are examined to gauge chatbot effectiveness. By integrating domain-specific knowledge, LLaMA-powered financial chatbots can provide users with more precise, context-aware insights, facilitating tasks such as portfolio management, risk assessment, and regulatory compliance. Advancements in retrieval-augmented generation (RAG) and model distillation further optimise performance, ensuring efficiency and reliability in financial applications. The paper also addresses ethical considerations, including bias mitigation and regulatory compliance, to promote the responsible deployment of AI in the financial services sector.
Keywords: Financial Chatbots; Large Language Models (LLMs); Domain-Specific Fine-Tuning; Natural Language Processing (NLP); Transfer Learning; Financial Question Answering; Performance Evaluation; Prompt Engineering; Model Adaptation.
Received: 14/04/2024, Revised: 09/06/2024, Accepted: 05/08/2024, Published: 03/03/2025
DOI: 10.64091/ATIML.2025.000100
AVE Trends in Intelligent Management Letters, 2025 Vol. 1 No. 1 , Pages: 49-58