The Integration of Artificial Intelligence and Big Data: A Review of Technologies, Applications, and Challenges

Main Article Content

Yifan Shi

Keywords

artificial intelligence, big data, AI–big data integration

Abstract

Artificial intelligence (AI) and big data are now symbiotic pillars underpinning next-generation intelligent infrastructures. Big data serves as a rich, dynamic, and heterogeneous information reservoir—characterized by scale, variety, and velocity—while AI acts as the cognitive engine that extracts meaning from this deluge through self-directed learning, contextual pattern detection, and iterative decision refinement. Yet current scholarly work on their convergence tends to prioritize narrow technical enhancements or domain-specific deployments, falling short of offering a cohesive theoretical lens to articulate *how* these two paradigms co-evolve and synergize in practice. To bridge this conceptual and practical void, this study proposes an integrative analytical architecture grounded in three interlocking layers: (1) enabling technological foundations, (2) intelligent sense-making processes, and (3) context-sensitive deployment pathways. By unifying conceptual rigor with empirical grounding, this work advances a holistic, implementation-ready framework for building intelligent systems that are not only high-performing and scalable, but also ethically grounded, transparent, and attuned to real-world socio-technical contexts.

Abstract 9 | PDF Downloads 3

References

  • [1] Yan, T., Wen, H., Li, B., Luo, K., Chen, W., & Lyu, K. (2026). Larger datasets can be repeated more: A theoretical analysis of multi-epoch scaling in linear regression (Version v2). arXiv. https://doi.org/10.48550/arXiv.2511.13421
  • [2] Zhang, Z., Zhong, Y., Jiang, Y., Hu, H., Sun, J., Ge, Z., Zhu, Y., Jiang, D., & Jin, X. (2025). DistTrain: Addressing model and data heterogeneity with disaggregated training for multimodal large language models (Version v3). arXiv. https://arxiv.org/abs/2408.04275
  • [3] Hagn, M., Heinrich, B., Krapf, T., & Schiller, A. (2025). Handling imperfection: A taxonomy for machine learning on data with data quality defects. Decision Support Systems, 196, 114493. https://doi.org/10.1016/j.dss.2025.114493
  • [4] Shen, J., Zhan, H., Dong, S., Zuo, X., Yang, W., & Ling, H. (2026). Multispectral state-space feature fusion: Bridging shared and cross-parametric interactions for object detection. Information Fusion, 127, 103895. https://doi.org/10.1016/j.inffus.2025.103895
  • [5] Chen, C., Wu, Y., Dai, Q., Zhou, H. Y., Xu, M., Yang, S., Han, X., & Yu, Y. (2024). A survey on graph neural networks and graph transformers in computer vision: A task-oriented perspective. IEEE Transactions on Pattern Analysis and Machine Intelligence, 4 6(12), 10297–10318. https://doi.org/10.1109/TPAMI.2024.3445463
  • [6] Alginahi, Y. M., Sabri, O., & Said, W. (2025). Reinforcement learning for industrial automation: A comprehensive review of adaptive control and decision-making in smart factories. Machines, 13(12), 1140. https://doi.org/10.3390/machines13121140
  • [7] George Papageorgiou, Vangelis Sarlis, Manolis Maragoudakis & Christos Tjortjis. (2024). Enhancing E- Government Services through State-of-the-Art, Modular, and Reproducible Architecture over Large Language Models. Applied Sciences, 14 (18), 8259-8259. https://doi.org/10.3390/APP14188259.
  • [8] Zicheng Zhang, Anguo Li, Li Wang, Wei Cao & Jianlin Yang. (2024). Big data-assisted urban governance: A comprehensive system for business documents classification of the government hotline. Engineering Applications of Artificial Intelligence, 132, 107997-. https://doi.org/10.1016/J.ENGAPPAI.2024.107997.
  • [9] Wei, C., Yang, W. S., & Liu, W. (2025). A privacy-preserving federated learning framework based on consortium blockchain. Journal of Zhengzhou University (Natural Science Edition), 57(4), 23 -29. https://zzdz.cbpt.cnki.net/portal/journal/portal/client/paper/01c66d864505742fda62d6ee024afd4e