Human-Computer Interaction Commons^™

Learning To Refine Gesture-Derived Voxel-To-Loop For Generative 3d Modeling In Vr, Kallen Lonbom, Trudi Di Qi

Engineering Faculty Articles and Research

We present a generative modeling pipeline for refining and denoising coarse 3D shapes created through freehand interaction in virtual reality (VR). While recent loop-based generative models focus on shape synthesis from clean inputs, our work addresses the challenge of reconstructing coherent geometry from noisy, coarse volumetric data. To this end, we introduce a hybrid voxel-to-loop representation that captures the topology of rough voxel shapes and converts them into sequential cross-sectional loops for generative refinement. We develop two transformer architectures and evaluate their efficacy primarily on synthetically perturbed datasets with additional examples from VR. Our results demonstrate that this representation is …