Leveraging the Potential of Large Language Models

Authors

  • Shreya Prasad Vellore Institute of Technology, Vellore, India
  • Himank Gupta Vellore Institute of Technology, Vellore, India
  • Arup Ghosh Assistant Professor of Computer Science Graceland University 1 University Place Lamoni, Iowa 50140, USA

DOI:

https://doi.org/10.31449/inf.v48i8.5635

Abstract

This study focuses on enhancing Natural Language Processing (NLP) in generative AI chatbots through the utilization of advanced pre-trained models. We assessed five distinct Large Language Models (LLMs): TRANSFORMER MODEL, FALCON 7B, LAMINI-FLAN-T5-783M, LLAMA-2-7B, and LLAMA-2-13B to identify the most effective one. Our findings revealed that the LLAMA Model excels in comprehending user queries and delivering precise responses during conversations. The article elucidates the methodology employed to evaluate and select various models for our chatbot. Through rigorous testing, we determined that the LLAMA-2-13B model exhibits enhanced response time and accuracy. Additionally, we employed tools such as Facebook Artificial Intelligence Similarity Search (FAISS) and experimented with user interfaces like Streamlit and Chainlit to enhance the chatbot's user-friendliness. The research underscores the significance of selecting the appropriate model for crafting efficient chatbots. Ultimately, the LLAMA-13B model emerged as the standout performer, showcasing superior performance. Benchmark assessments, including HellaSwag and WinoGrande, which gauge common sense reasoning, were employed to evaluate our chatbot's capabilities. The study concludes that LLAMA-based models hold significant promise for the development of innovative and user-friendly chatbots in the future.

Author Biography

Arup Ghosh, Assistant Professor of Computer Science Graceland University 1 University Place Lamoni, Iowa 50140, USA

Arup Ghosh was born in Barasat, India on March 22, 1989. He received the master’s degree in Computer Science from the University of Trento, Trento, Italy in 2012, and the Ph.D. degree in Industrial Engineering from the Ajou University, Suwon, South Korea in 2018. He is currently working as an Assistant Professor in the Department of Computer Science and Information Technology at the Graceland University, Lamoni, USA. In past, Dr. Ghosh worked as an Assistant Professor at the Vellore Institute of Technology, Vellore, India; and as a Senior R&D Engineer at UDMTEK Corporation, Suwon, South Korea.Dr. Ghosh has published more than eight research papers in reputed international journals and conference proceedings. His current research interests include Cyber-Physical Production System (Industry 4.0), Smart Manufacturing, Production System Health Performance Monitoring, Data Mining and Machine Learning, Big Data Analysis, Manufacturing Data Analysis, and Intelligent Process Control.

References

Dahiya, Menal. (2017). "A Tool of Conversation: Chatbot." INTERNATIONAL JOURNAL OF COMPUTER SCIENCES AND ENGINEERING, 5, 158-161.

Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., ... & Polosukhin, I. (2017). "Attention is all you need." Advances in neural information processing systems, 30.

Turing, A. M. (2009). "Computing machinery and intelligence." Springer Netherlands, pp. 23-65.

Weizenbaum, J. (1966). "ELIZA—a computer program for the study of natural language communication between man and machine." Communications of the ACM, 9(1), 36-45.

Klopfenstein, L. C., Delpriori, S., Malatini, S., & Bogliolo, A. (2017, June). "The rise of bots: A survey of conversational interfaces, patterns, and paradigms." In Proceedings of the 2017 conference on designing interactive systems, pp. 555-565.

Wallace, R. S. (2009). "The anatomy of ALICE." Springer Netherlands, pp. 181-210.

Marietto, M. D. G. B., de Aguiar, R. V., Barbosa, G. D. O., Botelho, W. T., Pimentel, E., França, R. D. S., & da Silva, V. L. (2013). "Artificial intelligence markup language: a brief tutorial." arXiv preprint arXiv:1307.3091.

Adamopoulou, Eleni & Moussiades, Lefteris. (2020). "An Overview of Chatbot Technology." pp. 373-383. 10.1007/978-3-030-49186-4_31.

Colace, F., De Santo, M., Lombardi, M., Pascale, F., Pietrosanto, A., & Lemma, S. (2018). "Chatbot for e-learning: A case of study." International Journal of Mechanical Engineering and Robotics Research, 7(5), 528-533.

Zellers, R., Holtzman, A., Bisk, Y., Farhadi, A., & Choi, Y. (2019). "Hellaswag: Can a machine really finish your sentence?." arXiv preprint arXiv:1905.07830.

Sakaguchi, K., Bras, R. L., Bhagavatula, C., & Choi, Y. (2021). "Winogrande: An adversarial winograd schema challenge at scale." Communications of the ACM, 64(9), 99-106.

Touvron, H., Lavril, T., Izacard, G., Martinet, X., Lachaux, M. A., Lacroix, T., ... & Lample, G. (2023). "Llama: Open and efficient foundation language models." arXiv preprint arXiv:2302.13971.

Downloads

Published

2024-05-30

How to Cite

Prasad, S., Gupta, H., & Ghosh, A. (2024). Leveraging the Potential of Large Language Models. Informatica, 48(8). https://doi.org/10.31449/inf.v48i8.5635

Issue

Vol. 48 No. 8 (2024): Online-only issue

Section

Online-only

License

I assign to Informatica, An International Journal of Computing and Informatics ("Journal") the copyright in the manuscript identified above and any additional material (figures, tables, illustrations, software or other information intended for publication) submitted as part of or as a supplement to the manuscript ("Paper") in all forms and media throughout the world, in all languages, for the full term of copyright, effective when and if the article is accepted for publication. This transfer includes the right to reproduce and/or to distribute the Paper to other journals or digital libraries in electronic and online forms and systems.

I understand that I retain the rights to use the pre-prints, off-prints, accepted manuscript and published journal Paper for personal use, scholarly purposes and internal institutional use.

In certain cases, I can ask for retaining the publishing rights of the Paper. The Journal can permit or deny the request for publishing rights, to which I fully agree.

I declare that the submitted Paper is original, has been written by the stated authors and has not been published elsewhere nor is currently being considered for publication by any other journal and will not be submitted for such review while under review by this Journal.  The Paper contains no material that violates proprietary rights of any other person or entity. I have obtained written permission from copyright owners for any excerpts from copyrighted works that are included and have credited the sources in my article. I have informed the co-author(s) of the terms of this publishing agreement.


Copyright ©  Slovenian Society Informatika