Options
AI-generated environments and mixed reality interactions for user-driven story creation
Author(s)
Date Issued
2026
Publisher
IEEE
ISBN
9798331549671
9798331549688
ISSN
2771-7453
2771-7445
Citation
Dong, A., Husain, Z., Zhang, X., & Coppin, P. (2026). AI-generated environments and mixed reality interactions for user-driven story creation. In IEEE (Ed.). Conference proceedings of 2026 IEEE international conference on artificial intelligence and eXtended and virtual reality (AIxVR). 2026 IEEE International Conference on Artificial Intelligence and eXtended and Virtual Reality (AIxVR), Osaka, Japan (pp. 290-294). IEEE.
Type
Conference Paper
Abstract
Traditional storytelling is often constrained by linear structures, limiting engagement and interactivity. This research explores how AI-generated Mixed Reality (MR) environments can enhance storytelling through speech-driven interactions, realtime adaptive narratives, and Tactile feedback. The user's speech transforms real-world objects into AI-generated characters and 3D elements that shape the story. A playable MR game prototype using GPT-4 and Meshy. AI is developed to investigate how AI-generated storytelling elements integrate with physical space and influence user engagement. This research explores the intersection of Mixed Reality (MR), AI-driven storytelling, and interactive media, proposing an innovative MR-AI framework.
Loading...
Availability at HKSYU Library
