Application of Deep Learning in Visual Recognition of Unsafe Behaviors of Construction Personnel

Main Article Content

Feifan Peng

Keywords

construction safety, unsafe behavior, deep learning, computer vision

Abstract

Unsafe behavior of construction personnel is a primary cause of the frequent safety accidents in the construction industry. The traditional manual inspection method has some disadvantages, such as limited coverage, strong subjectivity, poor real-time performance and so on. With the development of deep learning and computer vision technology, automatic recognition of unsafe behavior based on vision has become an important research direction of construction safety management. This paper systematically reviews the progress in the application of deep learning in visual recognition of unsafe behaviors of construction workers. Firstly, it analyzes the formation mechanism of unsafe behavior and the shortcomings of traditional management methods from the perspective of behavior safety theory. Then according to the technical route, the existing methods are divided into four categories: target detection, pose estimation, time series modeling and lightweight deployment. The principles, representative models and typical application scenarios of various methods are summarized respectively, and the applicability and limitations of various methods in the actual site application are analyzed. The analysis shows that the deep learning recognition method has been widely used in static protective equipment detection, dynamic dangerous action recognition and real-time early warning, but it still faces challenges such as small target detection difficulty, lack of robustness in complex environment, and difficulty in balancing real-time performance and accuracy. Future research should focus on multimodal fusion, video understanding of large models, online continuous learning and interpretable AI, thereby promoting the intelligent upgrading of construction safety management.

Abstract 9 | PDF Downloads 2

References

  • [1] National Bureau of Statistics. (2025) National Bureau of Statistics: A total of 19,626 people died in various production safety accidents in 2024. Safety Management Network. Retrieved from https://www.safehoo.com/Case/Stat/202503/5764614.shtml
  • [2] Tong, R. P. (2019) Review and commentary on behavioral safety research progress. Safety, 40(7), 1 - 14+88.
  • [3] Wu, C., & Wang, B. (2018) Research on meta-model of behavioral safety management. Journal of Safety Science and Technology, 14(2), 5-11.
  • [4] Fang, W. L., & Ding, L. Y. (2022) Research on intelligent recognition and correction of workers' unsafe behaviors. Journal of Huazhong University of Science and Technology (Natural Science Edition), 50(8), 131-135.
  • [5] Zhang, Y. (2020) Research on key technologies of intelligent safety monitoring for building structure construction. Dalian University of Technology.
  • [6] Liu, X. J. (2023) Intelligent monitoring method for illegal operations at construction sites based on machine vision. China Construction Informatization, (10), 82-86.
  • [7] Wang, Z. F., Yang, T., Min, H., et al. (2025) Research on mine fire image recognition method based on deep learning model. Journal of Safety Science and Technology, 21(8), 146-154.
  • [8] Kappan, M. M., Sandoval, B. E., Meijering, E., et al. (2025) A survey on deep learning for 2D and 3D human pose estimation. Artificial Intelligence Review, 59(1), 32-32.
  • [9] Cai, X., Qu, K., Liu, C., et al. (2026) JC-STNet: a physics-inspired joint-centric spatiotemporal network for real-time 2D pose estimation. The Visual Computer, 42(9), 365-365.
  • [10] Baghel, A., Kushwaha, S. K. A. (2026) PAG-GNNA: Advanced Graph Neural Network Approach for 3D Human Pose Estimation and Action Recognition. International Journal of Pattern Recognition and Artificial Intelligence.
  • [11] Xu, Y., Lu, Y. (2025) Research on Action Recognition Algorithm Based on SlowFast Network: Regular Papers. Journal of Advanced Computational Intelligence and Intelligent Informatics, 29(5), 1056-1061.
  • [12] Lasri, K., Fazazy, E.K., Mahraz, M. A., et al. (2026) Video action recognition based on multimodal SlowFast architecture. Results in Engineering, 31111265-111265.
  • [13] Junyi, S., Ma, L., Jikai, Z. (2022) Temporal Action Detection Methods Based on Deep Learning. International Journal of Pattern Recognition and Artificial Intelligence, 36(3).
  • [14] Kai, H., Chaowen, S., Tianyan, W., et al. (2024) Overview of temporal action detection based on deep learning. Artificial Intelligence Review, 57(2).
  • [15] Wang, H., Zhou, Q., Hao, Z., et al. (2026) Lightweight Safety Helmet Wearing Detection Algorithm Based on GSA-YOLO. Sensors, 26(7), 2110-2110.
  • [16] Zhang, L., Ma, H., Huang, J., et al. (2025) An Improved Lightweight Safety Helmet Detection Algorithm for YOLOv8. Computers, Materials & Continua, 83(2), 2245-2265.
  • [17] Zhu, T., Liu, H., Duan, H., et al. (2026) MMDet-Edge: A Multi-Scale and Multi-Object Detection Framework for Safety-Critical Edge Deployment. Sensors, 26(4), 1151-1151.
  • [18] Dalvi, M., Singh, N., Bhingarde, S., et al. (2025) Construction-PPE: Personal Protective Equipment Detection Dataset.
  • [19] Zhao, C., Ye, W.W., Xing, J.Q., et al. (2025) A Comprehensive Image and Video Dataset for Computer Vision-Based Safety Monitoring in Foundation Pit Construction. Mendeley Data.
  • [20] Wang, T., et al. (2025) Rehearsal-Free Continual Learning for Emerging Unsafe Behavior Recognition in Construction Industry. Sensors.