Work in progress: An AI-assisted metaverse for computer science education

Abstract

This paper proposes the use of metaverse for computer science education by leveraging virtual reality (VR) and artificial intelligence (AI) technologies. VR glasses are used to record videos such as presentation slides and classroom lectures in the metaverse. AI technologies automatically generate customized class notes summarized from the video recordings. This education metaverse can accommodate students' digital avatars in different virtual workspaces, including collaboration spaces, laboratories, and classrooms. It consists of practical features that mimic a physical classroom setup, such as real-time voice chat, avatar movement, and shared screen presentations. In the metaverse journey, the AI notes generator module is used to create personalized class notes using technologies including optical character recognition, automatic speech recognition, natural language processing, and text-to-speech. We discuss current progress and future work to prototype an AI-assisted metaverse for proof-of-concept experiments in computer science education.