TY  - JOUR
AU  - Ke, Yan
AU  - Shiri, Fatemeh
AU  - Zhang, Hu
AU  - Yu, Xin
PY  - 2026
TI  - Thinking outside the frame: viewpoint-aware spatial reasoning in large multimodal models
JO  - Visual Intelligence
SN  - 2097-3330
SP  - 21
VL  - 4
AB  - Large multimodal models (LMMs) have greatly improved cross-modal tasks but continue to struggle with spatial reasoning. In particular, they exhibit a bias toward egocentric reasoning and have limited ability to reframe spatial relations allocentrically, making them unreliable under allocentric viewpoints. In response, we first propose a lightweight viewpoint-aware self-correction strategy with low token overhead that serves as an inductive signal, sensitizing the model to frame-of-reference changes and guiding a corresponding shift in its reasoning trajectory. Second, beyond final-answer accuracy, we introduce a multi-hop spatial reasoning trace that decomposes reasoning into a front-hop object identification stage and a back-hop spatial relation inference stage to expose intermediate reasoning states and assess whether genuine viewpoint transformations occur. Third, we further design robustness-oriented metrics, including hop degradation slope (HDS) and minimality and redundancy of multi-hop reasoning (MRR), to enable a finer-grained analysis of multi-hop reasoning behavior. Finally, we conduct comprehensive quantitative and qualitative evaluations on Spatial-CoT and COMFORT to validate the effectiveness of our approach and provide insights into robustness and failure modes.
UR  - https://doi.org/10.1007/s44267-026-00126-0
DO  - 10.1007/s44267-026-00126-0