A Lightweight 3D Gaussian Splatting Based Virtual Object Insertion Strategy for Casually Captured Scenes

Loading...
Thumbnail Image
Date
2025
Journal Title
Journal ISSN
Volume Title
Publisher
The Eurographics Association
Abstract
The physically plausible insertion of virtual objects into scenes captured by multi-view images can be applied to multiple domains such as urban planning, augmented reality and digital marketplaces. Recent advancements in Novel View Synthesis, such as 3D Gaussian Splatting provide photorealistic representations of casually captured scenes. This raises the question if these advancements can be incorporated into the virtual insertion of single objects. In this work, we propose a lightweight strategy that estimates the effects of light interaction between a virtually inserted mesh model with corresponding material properties and a scene represented as 3D Gaussian Splats. Our approach poses minimal constraints on the capturing setup, only relying on casually captured LDR multi-view scenes, i.e., by a smartphone, while demonstrating comparable visual fidelity to strategies that pose more constraints on the capturing process.
Description

CCS Concepts: Computing methodologies → Mixed / augmented reality; Image-based rendering

        
@inproceedings{
10.2312:cgvc.20251210
, booktitle = {
Computer Graphics and Visual Computing (CGVC)
}, editor = {
Sheng, Yun
and
Slingsby, Aidan
}, title = {{
A Lightweight 3D Gaussian Splatting Based Virtual Object Insertion Strategy for Casually Captured Scenes
}}, author = {
Wirth, Tristan
and
Hagemeister, Vicky
and
Knauthe, Volker
and
Kuijper, Arjan
and
Fellner, Dieter W.
}, year = {
2025
}, publisher = {
The Eurographics Association
}, ISBN = {
978-3-03868-293-6
}, DOI = {
10.2312/cgvc.20251210
} }
Citation