VR Classroom

VR Classroom (with Generative Models)

The VR Classroom project aims to create an immersive virtual learning environment and provide valuable insights into learners’ and instructors’ behaviors in the virtual environment.

Target group

School / college students, pre-service teachers and teachers.

Vision

The long-term objectives of this project include exploring human-computer interaction strategies within the context of immersive virtual learning environments, enhancing traditional educational methods, and offering valuable feedback to both learners and educators.

Mission

In the frontline, an immersive virtual learning environment that allows data tracking in multiple modalities and integrates large-language-model-based chatbot shall be developed. Based on the collected data, machine learning methods would provide insights into user behaviors, enable further analysis, and empower customization. In parallel, generative machine learning algorithms could be considered for virtual avatars and animations.

Project Outline

XR (AR/MR/VR) technologies have brought human-computer-interaction (HCI) to a new era, which has also led to giant strides in the realm of education. Particularly, virtual classrooms have shown great potential to enhance conventional education methods and provide valuable feedback for both learners and teachers. We attempt to further explore the possible applications of virtual classrooms and investigate HCI strategies in this context with our VR Classroom project. The VR classroom project aims at an immersive virtual learning environment that allows data tracking in multiple modalities such as eye tracking and hand tracking with the help of corresponding devices and sensors, especially Head Mounted Display (HMD). Moreover large-language-model-based chatbot shall be integrated. The collected data will provide valuable insights into learners’ and instructors’ behaviors in the virtual environment and enables further analysis. Furthermore, to make the learning experience more engaging and immersive, the use of generative behavior and text models that can adapt to the user’s preferences and learning style should be considered.
Available Video Material

www.edu.sot.tum.de/hctl/forschung/vr-classroom/
www.edu.sot.tum.de/hctl/lehre/interdisciplinary-projects/vr-classroom/
blog.readyplayer.me/mozilla-hubs-custom-3d-avatar/

Principle Investigator

Prof. Dr. Enkelejda Kasneci

Contact

Süleyman Özdel, ozdelsuleyman@tum.de, Mengi Wang, mengdi.wang@tum.de

Website

www.edu.sot.tum.de/hctl/forschung/vr-classroom/

Share it