Harnessing Artificial Intelligence to Expedite Content Creation for the Development of eXtended Reality Experiences

Loading...
Thumbnail Image
Date
2025
Journal Title
Journal ISSN
Volume Title
Publisher
The Eurographics Association
Abstract
Despite eXtended Reality (XR) many benefits and demonstrated potential, the process of creating content specifically designed for distinct applications remains time-intensive and resource-demanding, hindering broader adoption. This study presents a student-driven project that investigates the role of Artificial Intelligence (AI) in streamlining the content creation process of 3D models. The proposed solution enables a user, equipped with an XR headset to use gesture recognition and perform a query via a text prompt, or as an alternative, to use voice recognition. Afterward, a request will be made to an API, which will generate the 3D model. Finally, the model will be added to a local library and become accessible in the XR environment, allowing users to manipulate, position, and other features. Initial findings highlight both opportunities and challenges, confirming it is already possible to integrate AI into a game engine with interesting results, while also showcasing that additional work is still necessary for obtaining more detailed and complex 3D models moving forward.
Description

CCS Concepts: Computing methodologies → Artificial intelligence; Human-centered computing → Mixed / augmented reality

        
@inproceedings{
10.2312:eged.20251010
, booktitle = {
Eurographics 2025 - Education Papers
}, editor = {
Kuffner dos Anjos, Rafael
and
Rodriguez Echavarria, Karina
}, title = {{
Harnessing Artificial Intelligence to Expedite Content Creation for the Development of eXtended Reality Experiences
}}, author = {
Freitas, André
and
Borges, João
and
Marques, Bernardo
and
Dias, Paulo
and
Santos, Beatriz Sousa
}, year = {
2025
}, publisher = {
The Eurographics Association
}, ISSN = {
1017-4656
}, ISBN = {
978-3-03868-266-0
}, DOI = {
10.2312/eged.20251010
} }
Citation