Prompting Meaning: Optimizing Prompt Engineering for Architectural Point Cloud Interpretation
Loading...
Date
2025
Journal Title
Journal ISSN
Volume Title
Publisher
The Eurographics Association
Abstract
Three-dimensional point cloud visualisation is essential for preserving and analysing built heritage by providing detailed insights into architectural forms and spatial configurations. Although human perception naturally integrates visual, spatial and contextual information, AI systems have yet to match this interpretive ability, particularly about 3D point clouds. This gap in interpretation highlights the need for AI approaches that process 3D data not only geometrically but also semantically. To address this challenge, the 3D.LLM project is exploring how combining point clouds with large language models (LLMs) can improve spatial and linguistic understanding. This paper presents a prompt engineering strategy developed as part of the 3D.LLM project to improve the semantic interpretation of architectural point clouds. By linking spatial attributes to language-based reasoning, LLMs are employed to generate richer and more accurate descriptions of cultural heritage environments. Unlike conventional geometric segmentation approaches, which often fail to capture architectural nuances, this system enables a spatially aware and flexible interpretation of 3D data. To refine the AI outputs and ensure spatial precision, domain-specific benchmarks such as ArCH and Objaverse XL have been employed. Preliminary findings suggest that prompt engineering significantly improves interpretability, descriptive accuracy and contextual depth, outperforming traditional automated methods. Beyond improving accessibility to architectural heritage information, this approach encourages interdisciplinary collaboration by making complex 3D structures more accessible and useful to scholars, conservators and a wider audience.
Description
CCS Concepts: Computing methodologies → Artificial intelligence
@inproceedings{10.2312:dh.20253166,
booktitle = {Digital Heritage},
editor = {Campana, Stefano and Ferdani, Daniele and Graf, Holger and Guidi, Gabriele and Hegarty, Zackary and Pescarin, Sofia and Remondino, Fabio},
title = {{Prompting Meaning: Optimizing Prompt Engineering for Architectural Point Cloud Interpretation}},
author = {Paolanti, Marina and Muralikrishna, Nikhil and Gorgoglione, Lucrezia and Pierdicca, Roberto},
year = {2025},
publisher = {The Eurographics Association},
ISBN = {978-3-03868-277-6},
DOI = {10.2312/dh.20253166}
}