From Perception to Cognition: A Review of Neural- Symbolic AI for Computer Vision
Main Article Content
Keywords
neural-symbolic AI, computer vision, visual reasoning, scene understanding, explainability
Abstract
Deep learning has improved core computer vision tasks a great deal, but most perception-based methods still have weak symbol grounding, limited compositional reasoning, poor generalization, and low interpretability. Neural-Symbolic AI combines neural feature learning with symbolic reasoning and has become an active approach for dealing with these problems. This paper reviews recent work on vision-focused Neural-Symbolic AI through the perception-reasoning-cognition pathway. It covers representative architectures, including scene-graph reasoning models, neural modules with differentiable logic, knowledge-graph-enhanced frameworks, and 3D neuro-symbolic grounding methods, along with their applications in visual reasoning and scene understanding. The review examines the main achievements, current limitations, and future prospects of the field. Overall, Neural-Symbolic AI shifts computer vision from pure perception toward structured understanding and reasoning, although problems remain in scalable reasoning, knowledge integration, and real-world deployment. It offers a practical direction for building more explainable and reliable vision systems.
References
- [1] D. Yu, B. Yang, D. Liu, H. Wang, and S. Pan, “A Survey on Neural-Symbolic Learning Systems,” arXiv preprint arXiv:2111.08164, 2021.
- [2] B. C. Colelough and W. Regli, “Neuro-Symbolic AI in 2024: A Systematic Review,” in CEUR Workshop Proceedings, vol. 3819, 2024, pp. 1-19.
- [3] K. Yi, J. Wu, C. Gan, A. Torralba, P. Kohli, and J. B. Tenenbaum, “Neural-Symbolic VQA: Disentangling Reasoning from Vision and Language Understanding,” in NeurIPS, 2018, pp. 1031-1042.
- [4] J. Mao, C. Gan, P. Kohli, J. B. Tenenbaum, and J. Wu, “The Neuro-Symbolic Concept Learner,” in ICLR, 2019.
- [5] J. Shi, H. Zhang, and J. Li, “Explainable and Explicit Visual Reasoning Over Scene Graphs,” in CVPR, 2019, pp. 8376-8384.
- [6] J. Hsu, J. Mao, and J. Wu, “NS3D: Neuro-Symbolic Grounding of 3D Objects and Relations,” in CVPR, 2023, pp. 2614-2623.
- [7] S. Amizadeh et al., “Neuro-Symbolic Visual Reasoning: Disentangling ‘Visual’ from ‘Reasoning’,” in ICML, 2020, pp. 279-290.
- [8] S. Badreddine, A. d’Avila Garcez, L. Serafini, and M. Spranger, “Logic Tensor Networks,” Artificial Intelligence, vol. 303, p. 103649, 2022.
- [9] W. Stammer, P. Schramowski, and K. Kersting, “Right for the Right Concept,” in CVPR, 2021, pp. 3619- 3629.
- [10] E. Marconato et al., “Neuro-Symbolic Continual Learning,” in ICML, 2023, pp. 23915-23936.
- [11] P. Barbiero et al., “Interpretable Neural-Symbolic Concept Reasoning,” in ICML, 2023, pp. 1801-1825.
