Real-time Detection of Basketball Free-throw Technique Movements Using a Deep Learning Model Based on Smartphone Video
Main Article Content
Keywords
Basketball free-throw; Deep learning; Motion capture
Abstract
This study aims to develop a deep learning model based on smartphone video recordings to enable real-time detection and feedback of basketball free-throw technique execution. Traditional analysis methods rely on manual observation, which suffers from feedback latency and high subjectivity. In this research, free-throw videos of 10 athletes were recorded using smartphones, and certified coaches classified the videos according to standard technical criteria; error categories included unstable stance, improper knee flexion, and excessive elbow abduction. The MoveNet model was employed to extract 17 key body points, and 26 features—including joint angles and inter-joint distances—were computed. The datasets were enhanced using techniques such as Gaussian noise, jitter, scaling, translation, and temporal distortion. Four models were trained and compared; on the balanced dataset, the dual-stream convolutional neural network model achieved the best overall performance, with an accuracy of 93.8%, precision, recall, and F1-score of 93.2%, 92.5%, and 92.2%, respectively, and a logarithmic loss of 0.23. Five-fold cross-validation yielded an accuracy of 93.8% ± 0.5%, demonstrating excellent stability. Confusion matrix analysis revealed that the model correctly predicted 804 out of 876 samples, exhibiting optimal class balance. This study validates the feasibility of this approach in providing athletes with instantaneous quantitative feedback; future work may explore the integration of edge computing and multimodal fusion to enhance robustness.
References
- [1] Teket O M, Yetik I S. A fast deep learning based approach for basketball video analysis[C]//Proceedings of the 2020 4th International Conference on Vision, Image and Signal Processing. 2020: 1-6.
- [2] Khobdeh S B, Yamaghani M R, Sareshkeh S K. Basketball action recognition based on the combination of YOLO and a deep fuzzy LSTM network: SB Khobdeh et al[J]. The Journal of Supercomputing, 2024, 80(3): 3528-3553.
- [3] He W, Li B. Basketball action recognition by fusing video recognition techniques with an SSD target detection algorithm[J]. Open Computer Science, 2025, 15(1): 20250027.
- [4] Shakya S R, Zhang C, Zhou Z. Basketball-51: A video dataset for activity recognition in the basketball game[C]//CS & IT Conference Proceedings. CS & IT Conference Proceedings, 2021, 11(7).
- [5] Teket O M, Yetik I S. A fast deep learning based approach for basketball video analysis[C]//Proceedings of the 2020 4th International Conference on Vision, Image and Signal Processing. 2020: 1-6.
- [6] Khobdeh S B, Yamaghani M R, Sareshkeh S K. Basketball action recognition based on the combination of YOLO and a deep fuzzy LSTM network: SB Khobdeh et al[J]. The Journal of Supercomputing, 2024, 80(3): 3528-3553.
- [7] He W, Li B. Basketball action recognition by fusing video recognition techniques with an SSD target detection algorithm[J]. Open Computer Science, 2025, 15(1): 20250027.
- [8] Wang J, Zuo L, Cordente Martínez C. Basketball technique action recognition using 3D convolutional neural networks[J]. Scientific Reports, 2024, 14(1): 13156.
- [9] Simonyan K, Zisserman A. Two-stream convolutional networks for action recognition in videos[J]. Advances in neural information processing systems, 2014, 27.
- [10] Weinzaepfel P, Harchaoui Z, Schmid C. Learning to track for spatio-temporal action localization[C]//Proceedings of the IEEE international conference on computer vision. 2015: 3164-3172.
- [11] Teket O M, Yetik I S. A fast deep learning based approach for basketball video analysis[C]//Proceedings of the 2020 4th International Conference on Vision, Image and Signal Processing. 2020: 1-6.
- [12] Shakya S R, Zhang C, Zhou Z. Basketball-51: A video dataset for activity recognition in the basketball game[C]//CS & IT Conference Proceedings. CS & IT Conference Proceedings, 2021, 11(7).
- [13] Han Z, Qin W, Wang Y, [13]Han Z, Qin W, Wang Y, et al. MultiSubjects: A multi-subject video dataset for single-person basketball action recognition from basketball gym[J]. Computer Vision and Image Understanding, 2024, 249: 104193.
- [14] Choi J, Bhattacharya S. Deep learning-based real-time smartphone pose detection for ultra-wideband tagless gate[C]//GLOBECOM 2023-2023 IEEE Global Communications Conference. IEEE, 2023: 4595-4600.
- [15] Chung J-L, Ong L-Y, Leow M-C. Comparative Analysis of Skeleton-Based Human Pose Estimation. Future Internet. 2022; 14(12):380. https://doi.org/10.3390/fi14120380
- [16] Del Piano C, Leigh S. Basketball Free Throw: A Written Technical Report[J]. Montclair State University, Advanced Coaching Techniques, PEMJ-547, 2013.
- [17] Fenty Y V, Buides R C H, Meriño J A S. Estudio cinemático de la ejecución del tiro libre en los baloncestistas de la categoría 11-12 años: II Taller” Actividad Física y Deporte”[C]//Congreso Universidad. 2025, 11(4): e46-e46.
- [18] Arrowsmith C, Burns D, Mak T [18]Arrowsmith C, Burns D, Mak T et al. Physiotherapy exercise classification with single-camera pose detection and machine learning. Sensors 2022; 23(1): 363.
- [19] Acı N and Kuluo¨ztu¨rk MF. Accuracy detection in some sports training using computer vision and deep learning techniques. Bitlis Eren University Journal of Science and Technology 2023; 13(2): 133–158.
