Virtual AI Tutor Assistant using Generative AI

Virtual AI Tutor Assistant using Generative AI

Current Students: Kavya Parvathapuram, Alwin Prabu

Status: Current

The goal of this project is to develop and evaluate an AI virtual tutor using generative AI. We are modeling and developing a realistic VR environment to provide offline tutoring assistance to students for courses such as Introduction to Data Science and Introduction to Computation with Python. The AI tutor integrates Chat GPT and provides interactivity capability such as lip synchronization and hand movement. The user can ask the AI virtual tutor any question. We aim to develop an on-demand AI-powered support for tutoring services. Our research will allow artificial intelligence-powered tutors to become more versatile and accessible through voice interaction. AI and machine learning are growing fields of study and research. AI tutors will enable students to get the most out of their education. The following objectives are proposed:

• Develop virtual reality instructional (VRI) tutoring modules for Avatar interaction (instructor/trainer) using generative AI and Unity 3D.
• Implement lip synchronization for avatar, text-to-speech, and speech-to-text integration.
• Create a realistic VRI module for different Data Science courses (DTSC 3010 - Introduction to Data Science & DTSC 3020 - Introduction to Computation with Python).
• Create a multi-user VR environment with tutorial mode and interacting mode with voice capability.
• Explore and export the VRI module to work on other hardware devices such as HTC Vive, Hololens2, Magic Leap 2, Apple Vision Pro, and Meta Quest 3.

Publications

1. Rajeev,S., Sharma, S, "Evaluation of Game-Theme Based Instructional Modules for Data Structure Concepts ", International Journal of Computers and their Applications, IJCA, Vol. 27, No. 1, March 2020.
2. Rajeev,S., Sharma, S, "Motivational Game-Theme Based Instructional Module for Teaching Binary Tree and Linked List, Proceedings of ISCA 28th International Conference on Software Engineering and Data Engineering (SEDE 2019) in San Diego, CA, USA , vol 64, pages 31-40, 2019.
3. Rajeev,S., Sharma, S, "Evaluation of GTI modules based on usability and likeability", Proceedings of ISCA 27th International Conference on Software Engineering and Data Engineering (SEDE 2018), New Orleans, Louisiana, USA, pp. 69-74, October 8-10, 2018.
4. Rajeev,S., Sharma, S, "Educational Game theme based Instructional module for teaching introductory programming", Proceedings of 44th Annual Conference of the IEEE Industrial Electronics Society (IECON 2018), Washington DC, USA, October 21-23, 2018.
5. Stigall, J., Sharma, S, "Usability and Learning Effectiveness of Game-Themed Instructional (GTI) Module for Teaching Stacks and Queues", Proceedings of IEEE SoutheastCon 2018, Hilton Bay Front, St. Petersburg, FL, USA, pp. 1-6, April 19 - , 2018.
6. Rajeev, S., Sharma, S, Sahu, A., "Game Theme Based Instructional Module to teach Binary Trees Data Structure", proceedings of ISCA 26th International Conference on Software Engineering and Data Engineering (SEDE-2017), San Diego,CA, USA, October 2-4, 2017.
7. Stigall, J., Sharma, S.,"Virtual Reality Instructional Modules for Introductory Programming Courses ", proceedings of IEEE Integrated STEM Education Conference (ISEC),pages: 33- 41, DOI:978-1-5090-5379-7/17, Princeton, New Jersey, Saturday, March 11, 2017.
8. Sharma, S., Ossuetta, E., "Virtual Reality Instructional Modules in Education Based on Gaming Metaphor", Explore the Future of Electronic Imaging at the 29th Annual Symposium, 2017 IS&T International Symposium on Electronic Imaging (EI 2017), The Engineering Reality of Virtual Reality 2017, Hyatt Regency San Francisco Airport, Burlingame, California, 29 January- 2 February 2017.
9. Sharma, S., Stigall, J., Rajeev, S., "Game–Theme Based Instructional Module for Teaching Object Oriented Programming", proceedings of the IEEE International Conference on Computational Science and Computational Intelligence (CSCI), Las Vegas, USA, Page 252-257, DOI 10.1109/CSCI.2015.3, December 7-9, 2015.