VR Classroom
Educational Technology: A) EdTech Tools and Products (VR/AR; simulations, etc.)
Keywords: Virtual reality, eye tracking, artificial intelligence, generative behavior modelling
Target group: school / college students, pre-service teachers and teachers
Vision: The long-term objectives of this project include exploring human-computer interaction strategies within the context of immersive virtual learning environments, enhancing traditional educational methods, and offering valuable feedback to both learners and educators.
Mission: In the frontline, an immersive virtual learning environment that allows data tracking in multiple modalities and integrates large-language-model-based chatbot shall be developed. Based on the collected data, machine learning methods would provide insights into user behaviors, enable further analysis, and empower customization. In parallel, generative machine learning algorithms could be considered for virtual avatars and animations.
Project outline: XR (AR/MR/VR) technologies have brought human-computer-interaction (HCI) to a new era, which has also led to giant strides in the realm of education. Particularly, virtual classrooms have shown great potential to enhance conventional education methods and provide valuable feedback for both learners and teachers. We attempt to further explore the possible applications of virtual classrooms and investigate HCI strategies in this context with our VR Classroom project. The VR classroom project aims at an immersive virtual learning environment that allows data tracking in multiple modalities such as eye tracking and hand tracking with the help of corresponding devices and sensors, especially Head Mounted Display (HMD). Moreover large-language-model-based chatbot shall be integrated. The collected data will provide valuable insights into learners’ and instructors’ behaviors in the virtual environment and enables further analysis. Furthermore, to make the learning experience more engaging and immersive, the use of generative behavior and text models that can adapt to the user's preferences and learning style should be considered.
https://www.edu.sot.tum.de/hctl/forschung/vr-classroom/
Available video material:
https://www.edu.sot.tum.de/hctl/forschung/vr-classroom/
https://www.edu.sot.tum.de/hctl/lehre/interdisciplinary-projects/vr-classroom/
https://blog.readyplayer.me/mozilla-hubs-custom-3d-avatar/
Contact: