AI Chat Paper
Note: Please note that the following content is generated by AMiner AI. SciOpen does not take any responsibility related to this content.
{{lang === 'zh_CN' ? '文章概述' : 'Summary'}}
{{lang === 'en_US' ? '中' : 'Eng'}}
Chat more with AI
Powered by AMiner. Clicking this button will take you away from SciOpen.
Home Computer Modeling in Engineering & Sciences Article
PDF (3.9 MB)
Cite
EndNote(RIS) BibTeX
Collect
Submit Manuscript AI Chat Paper
Show Outline
Outline
Show full outline
Hide outline
Outline
Show full outline
Hide outline
Article | Open Access

Can Causal Circuits Enable Efficient Spatial Reasoning for Geoinformatics in Large Language Models?

Sahil Tripathi1, Manaswi Kulahara2, Abdul Khader Jilani Saudagar3, Hatoon S. AlSagri3( )
Department of Computer Science and Engineering, Jamia Hamdard, New Delhi, India
Department of Geoinformatics, TERI School of Advanced Studies, Delhi, India
Information Systems Department, College of Computer and Information Sciences, Imam Mohammad Ibn Saud Islamic University (IMSIU), Riyadh, Saudi Arabia
Show Author Information

Abstract

Spatial reasoning, defined as the ability to infer and compose relations among entities—is fundamental to geoinformatics applications such as spatial querying and map understanding. However, existing works such as Bidirectional Encoder Representations from Transformers (BERT)-based spatial Question Answering (QA) models and neuro-symbolic models rely on dataset-specific patterns, leading to shortcut learning, where reliance on superficial lexical cues rather than true relational understanding. Recent Large Language Models (LLMs)-based works, including fine-tuning and Chain-of-Thought (CoT) prompting, partially alleviate shortcut learning but remain limited by non-causal reasoning, where predictions depend on spurious correlations rather than stable relational structure. To address these limitations, we propose C a u s a l I n f e r e n c e a n d R e a s o n i n g v i a C o m p a c t s U b n e t w o r k I d e n T i f i c a t i o n ( C I R C U I T − X ) , motivated by the hypothesis that spatial reasoning in LLMs is governed by compact causal parameter subsets (a.k.a causal circuits). C I R C U I T − X operates in two stages: (i) Causal Importance Estimation (Stage I) via structured interventions to mitigate shortcut learning, and (ii) Minimal Circuit Discovery (Stage II) via structured pruning to mitigate non-causal reasoning. Empirically, C I R C U I T − X achieves up to 91% accuracy on SPAtial Reasoning on Textual Question Answering (SPARTQA) and 87% on StepGame, outperforming State-of-the-Art (SOTA) methods while improving intervention robustness by up to +11% and causal consistency by up to +16%. Therefore, it retains up to 96% of full-model performance using only 3%–6% of active parameters, while demonstrating strong robustness under cross-domain transfer with improvements of up to +10% in accuracy and substantially higher intervention stability under distribution shifts.

Keywords

Causal circuitsgeoinformaticslarge language modelsparameter-efficient learningspatial reasoningstructured pruning

References

【1】
【1】
 
 
Crossref Google Scholar
Computer Modeling in Engineering & Sciences
Volume 148 Issue 1,
July 2026
Article number: 37
DOI: 10.32604/cmes.2026.083755

{{item.num}}

Comments on this article

Go to comment

< Back to all reports

Review Status: {{reviewData.commendedNum}} Commended , {{reviewData.revisionRequiredNum}} Revision Required , {{reviewData.notCommendedNum}} Not Commended Under Peer Review

Review Comment

Cite this Report
Close
Close
Cite this article:
Tripathi S, Kulahara M, Saudagar AKJ, et al. Can Causal Circuits Enable Efficient Spatial Reasoning for Geoinformatics in Large Language Models?. Computer Modeling in Engineering & Sciences, 2026, 148(1): 37. https://doi.org/10.32604/cmes.2026.083755

6

Views

0

Downloads

0

Crossref

0

Web of Science

0

Scopus
Received: 09 April 2026
Accepted: 15 June 2026
Published: 27 July 2026
© The Author 2026.

This work is licensed under a Creative Commons Attribution 4.0 International License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.