Optimizing Basketball Shot Trajectory using Image Segmentation Techniques for Training Feedback
DOI:
https://doi.org/10.58445/rars.1462Keywords:
Basketball, Image segmentation, trainingAbstract
In basketball, the efficiency of shot-making is crucial for success, especially in high-stakes games. Traditional self-training methods face significant challenges due to the absence of training equipment and personalized coaching. This paper presents an approach using computer vision and deep learning algorithms to provide feedback to players towards optimizing basketball shot trajectories, offering a solution for self-training. We employ image segmentation to accurately track the basketball and analyze shooting videos, enabling the extraction of critical parameters such as the release angle and shot trajectory. Our methodology integrates a Faster R-CNN model for object detection and introduces two novel parabolic curve fitting techniques: Bounce-Around and Sliding Window Sampling Consensus (SWISAC). These techniques allow for precise trajectory analysis and on-or-off-course predictions, despite occlusions by the net. Experimental results demonstrate the efficacy of our approach in providing actionable feedback for improving shooting accuracy. This research lays the groundwork for future advancements in automated sports analytics, enhancing and democratizing the training and performance feedback of basketball players.
References
B. Abdoli, J. Hardy, J. F. Riyahi, and A. Farsi, “A closer look at how self-talk influences skilled basketball performance,” The Sport Psychologist, vol. 32, no. 1, pp. 9–15, 2018.
Z. Fan, Y. Zhu, Y. He, Q. Sun, H. Liu, and J. He, “Deep learning on monocular object pose detection and tracking: A comprehensive overview,” ACM Computing Surveys, vol. 55, no. 4, pp. 1–40, 2022.
C. Zheng, S. Zhu, M. Mendieta, T. Yang, C. Chen, and Z. Ding, “3d human pose estimation with spatial and temporal transformers,” in Proceedings of the IEEE/CVF international conference on computer vision, 2021, pp. 11 656–11 665.
R. Greer and M. Trivedi, “Ensemble learning for fusion of multiview vision with occlusion and missing information: Framework and evaluations with real-world data and applications in driver hand activity recognition,” arXiv preprint arXiv:2301.12592, 2023.
A. Ghita, B. Antoniussen, W. Zimmer, R. Greer, C. Creß, A. Møgelmose, M. Trivedi, and A. C. Knoll, “Activeanno3d-an active learning framework for multi-modal 3d object detection,” in 35th IEEE Intelligent Vehicles Symposium (IV) 2024, 2024.
R. Greer, A. Gopalkrishnan, M. Keskar, and M. M. Trivedi, “Patterns of vehicle lights: Addressing complexities of camera-based vehicle light datasets and metrics,” Pattern Recognition Letters, vol. 178, pp. 209–215, 2024.
P. Sun, J. Cao, Y. Jiang, Z. Yuan, S. Bai, K. Kitani, and P. Luo, “Dancetrack: Multi-object tracking in uniform appearance and diverse motion,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022, pp. 20 993–21 002.
R. Greer, S. Desai, L. Rakla, A. Gopalkrishnan, A. Alofi, and M. Trivedi, “Pedestrian behavior maps for safety advisories: Champ framework and real-world data analysis,” in 2023 IEEE Intelligent Vehicles Symposium (IV). IEEE, 2023, pp. 1–8.
S. Minaee, Y. Boykov, F. Porikli, A. Plaza, N. Kehtarnavaz, and D. Terzopoulos, “Image segmentation using deep learning: A survey,” IEEE transactions on pattern analysis and machine intelligence, vol. 44, no. 7, pp. 3523–3542, 2021.
Z. Ivankovic, M. Rackovic, and M. Ivkovic, “Automatic player position detection in basketball games,” Multimedia tools and applications, vol. 72, pp. 2741–2767, 2014.
M. Buri ́c, M. Pobar, and M. Ivaˇsi ́c-Kos, “Object detection in sports videos,” in 2018 41st International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO). IEEE, 2018, pp. 1034–1039.
Y. Egi, “Basketball self training shooting posture recognition and trajectory estimation using computer vision and kalman filter,” Journal of Electrical Engineering, vol. 73, no. 1, pp. 19–27, 2022.
B. Zhao, “Deep learning-based basketball free throw attitude analysis and hit probability prediction system research,” Applied Mathematics and Nonlinear Sciences, vol. 9, no. 1.
Y. Wang, M. Sun, and L. Liu, “Basketball shooting angle calculation and analysis by deeply-learned vision model,” Future Generation Computer Systems, vol. 125, pp. 949–953, 2021.
S. Ren, K. He, R. Girshick, and J. Sun, “Faster r-cnn: Towards real-time object detection with region proposal networks,” Advances in neural information processing systems, vol. 28, 2015.
T.-Y. Lin, M. Maire, S. Belongie, J. Hays, P. Perona, D. Ramanan, P. Doll ́ar, and C. L. Zitnick, “Microsoft coco: Common objects in context,” in Computer Vision–ECCV 2014: 13th European Conference, Zurich, Switzerland, September 6-12, 2014, Proceedings, Part V 13. Springer, 2014, pp. 740–755.
R. Greer, B. Antoniussen, M. V. Andersen, A. Møgelmose, and M. M. Trivedi, “The why, when, and how to use active learning in large-data-driven 3d object detection for safe autonomous driving: An empirical exploration,” arXiv preprint arXiv:2401.16634, 2024.
S. E. Matos Flores, “Semi-automatic basketball jump shot annotation using multi-view activity recognition and deep learning,” in International Conference on Human-Computer Interaction. Springer, 2023, pp. 483–490.
R. Greer and M. Trivedi, “Perception without vision for trajectory prediction: Ego vehicle dynamics as scene representation for efficient active learning in autonomous driving,” arXiv preprint arXiv:2405.09049, 2024.
R. Greer, B. Antoniussen, A. Møgelmose, and M. M. Trivedi, “Language-driven active learning for diverse open-set 3d object detection,” in Vision and Language for Autonomous Driving and Robotics Workshop, CVPR, 2024.
S. Ai, J. Na, V. De Silva, and M. Caine, “A novel methodology for automating spatio-temporal data classification in basketball using active learning,” in 2021 IEEE 2nd International Conference on Pattern Recognition and Machine Learning (PRML). IEEE, 2021, pp. 39–45.
Downloads
Posted
Categories
License
Copyright (c) 2024 Vasisht Kartik
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.