From Perception to Cognition: A Review of Neural- Symbolic AI for Computer Vision

Main Article Content

Luchang He

Keywords

neural-symbolic AI, computer vision, visual reasoning, scene understanding, explainability

Abstract

Deep learning has improved core computer vision tasks a great deal, but most perception-based methods still have weak symbol grounding, limited compositional reasoning, poor generalization, and low interpretability. Neural-Symbolic AI combines neural feature learning with symbolic reasoning and has become an active approach for dealing with these problems. This paper reviews recent work on vision-focused Neural-Symbolic AI through the perception-reasoning-cognition pathway. It covers representative architectures, including scene-graph reasoning models, neural modules with differentiable logic, knowledge-graph-enhanced frameworks, and 3D neuro-symbolic grounding methods, along with their applications in visual reasoning and scene understanding. The review examines the main achievements, current limitations, and future prospects of the field. Overall, Neural-Symbolic AI shifts computer vision from pure perception toward structured understanding and reasoning, although problems remain in scalable reasoning, knowledge integration, and real-world deployment. It offers a practical direction for building more explainable and reliable vision systems.

Abstract 8 | PDF Downloads 2

References

  • [1] D. Yu, B. Yang, D. Liu, H. Wang, and S. Pan, “A Survey on Neural-Symbolic Learning Systems,” arXiv preprint arXiv:2111.08164, 2021.
  • [2] B. C. Colelough and W. Regli, “Neuro-Symbolic AI in 2024: A Systematic Review,” in CEUR Workshop Proceedings, vol. 3819, 2024, pp. 1-19.
  • [3] K. Yi, J. Wu, C. Gan, A. Torralba, P. Kohli, and J. B. Tenenbaum, “Neural-Symbolic VQA: Disentangling Reasoning from Vision and Language Understanding,” in NeurIPS, 2018, pp. 1031-1042.
  • [4] J. Mao, C. Gan, P. Kohli, J. B. Tenenbaum, and J. Wu, “The Neuro-Symbolic Concept Learner,” in ICLR, 2019.
  • [5] J. Shi, H. Zhang, and J. Li, “Explainable and Explicit Visual Reasoning Over Scene Graphs,” in CVPR, 2019, pp. 8376-8384.
  • [6] J. Hsu, J. Mao, and J. Wu, “NS3D: Neuro-Symbolic Grounding of 3D Objects and Relations,” in CVPR, 2023, pp. 2614-2623.
  • [7] S. Amizadeh et al., “Neuro-Symbolic Visual Reasoning: Disentangling ‘Visual’ from ‘Reasoning’,” in ICML, 2020, pp. 279-290.
  • [8] S. Badreddine, A. d’Avila Garcez, L. Serafini, and M. Spranger, “Logic Tensor Networks,” Artificial Intelligence, vol. 303, p. 103649, 2022.
  • [9] W. Stammer, P. Schramowski, and K. Kersting, “Right for the Right Concept,” in CVPR, 2021, pp. 3619- 3629.
  • [10] E. Marconato et al., “Neuro-Symbolic Continual Learning,” in ICML, 2023, pp. 23915-23936.
  • [11] P. Barbiero et al., “Interpretable Neural-Symbolic Concept Reasoning,” in ICML, 2023, pp. 1801-1825.