User menu

Accès à distance ? S'identifier sur le proxy UCLouvain

Consensus-based trajectory estimation for ball detection in calibrated cameras systems

Primary tabs

download
  • Open access
  • PDF
  • 3.38 M
Parisot, Pascaline [UCL] De Vleeschouwer, Christophe [UCL]

This paper considers the detection of the ball in team sport scenes observed with still or motion-compensated calibrated cameras. Foreground masks do provide primary cues to identify circular moving objects in the scene, but are shown to be too noisy to achieve reliable detections of weakly contrasted balls, especially when a single viewpoint is available, as often desired for reduced deployment cost. In those cases, trajectory analysis has been shown to provide valuable complementary information to differentiate true and false positives among the candidates detected by the foreground mask(s). In this paper, we focus on the detection of ball trajectory segments, exclusively from visual cues, without considering semantic reasoning about team play to connect those segments into long trajectories. We revisit several recent works, and introduce a publicly available dataset to compare them. We conclude that randomized consensus-based methods are competitive compared to the alternative deterministic graph-based solutions, while offering the additional advantage to naturally extend to the cost-effective single-view scenario. As an original contribution, we also introduce a procedure to efficiently clean up the foreground mask in correlation-based methods and a nonlinear rank-order filter to merge the foreground cues from multiple viewpoints. We also derive recommendations regarding the camera positioning and the buffering needs of a real-time acquisition system.

Document type Article de périodique (Journal article) – Article de recherche
Access type Accès libre
Publication date 2016
Language Anglais
Journal information "Journal of Real-Time Image Processing" - Vol. 2016, no.Sept, p. 1-16 (September 2016)
Peer reviewed yes
Publisher Springer ((Germany) Heidelberg)
issn 1861-8200
e-issn 1861-8219
Publication status Publié
Affiliation UCL - SST/ICTM/ELEN - Pôle en ingénierie électrique
Links
  1. Amit Kumar, K.C., Parisot, P., De Vleeschouwer, C.: Demo: Spatio-temporal template matching for ball detection. In: ICDSC (2011)
  2. Parisot Pascaline, De Vleeschouwer Christophe, Graph-based filtering of ballistic trajectory, 10.1109/icme.2011.6012126
  3. Parisot Pascaline, Sevilmiş Berk, De Vleeschouwer Christophe, Training with Corrupted Labels to Reinforce a Probably Correct Teamsport Player Detector, Advanced Concepts for Intelligent Vision Systems (2013) ISBN:9783319028941 p.682-694, 10.1007/978-3-319-02895-8_61
  4. Delannay, D., Danhier, N., De Vleeschouwer, C.: Detection and recognition of sports (wo)men from multiple views. In: ACM/IEEE ICDSC, pp. 1–7 (2009)
  5. Fernández Iván Alén, Chen Fan, Lavigne Fabien, Desurmont Xavier, Vleeschouwer Christophe De, Browsing Sport Content through an Interactive H.264 Streaming Session, 10.1109/mmedia.2010.28
  6. Chen Fan, Delannay Damien, De Vleeschouwer Christophe, An Autonomous Framework to Produce and Distribute Personalized Team-Sport Video Summaries: A Basketball Case Study, 10.1109/tmm.2011.2166379
  7. Chen, F., De Vleeschouwer, C.: Personalized production of basketball videos from multi-sensored data under limited display resolution. CVIU 114(6), 667–680 (2010)
  8. Keemotion: Keemotion production technology. http://www.keemotion.com
  9. Sun, L., De Neyer, Q., De Vleeschouwer, C.: Multimode spatiotemporal background modeling for complex scenes. In: EUSIPCO, pp. 165–169 (2012)
  10. Stauffer C., Grimson W.E.L., Adaptive background mixture models for real-time tracking, 10.1109/cvpr.1999.784637
  11. Horprasert, T., Harwood, D., Davis, L.: A statistical approach for real-time robust background subtraction and shadow detection. In: ICCV, pp. 1–19 (1999)
  12. Reddy, V., Sanderson, C., Lovell, B.: Improved foreground detection via block-based classifier cascade with probabilistic decision integration. IEEE TCSVT 23(1), 83–93 (2013)
  13. Zhou, J., Hoang, J.: Real time robust human detection and tracking system. In: CVPR (2005)
  14. Cavallaro, A., Steiger, O., Ebrahimi, T.: Semantic video analysis for adaptive content delivery and automatic description. IEEE TCSVT 15(10), 1200–1209 (2005)
  15. Khan Saad M., Shah Mubarak, A Multiview Approach to Tracking People in Crowded Scenes Using a Planar Homography Constraint, Computer Vision – ECCV 2006 (2006) ISBN:9783540338383 p.133-146, 10.1007/11744085_11
  16. Fleuret F., Berclaz J., Lengagne R., Fua P., Multicamera People Tracking with a Probabilistic Occupancy Map, 10.1109/tpami.2007.1174
  17. Alahi, A., Jacques, L., Boursier, Y., Vandergheynst, P.: Sparsity driven people localization with a heterogeneous network of cameras. J. MIV 41(1–2), 39–58 (2011)
  18. Dollar, P., Wojek, C., Schiele, B., Perona, P.: Pedestrian detection: a benchmark. In: CVPR (2009)
  19. Felzenszwalb P F, Girshick R B, McAllester D, Ramanan D, Object Detection with Discriminatively Trained Part-Based Models, 10.1109/tpami.2009.167
  20. Viola, P., Jones, M.: Robust real-time object detection. In: International Workshop on SCTV (2001)
  21. Hawk-Eye: Hawk-Eye ball tracking system. http://www.hawkeyeinnovations.co.uk/page/sports-officiating
  22. Yan F., Christmas W., Kittler J., A Tennis Ball Tracking Algorithm for Automatic Annotation of Tennis Match, 10.5244/c.19.67
  23. Choi Kyuhyoung, Seo Yongdeuk, Probabilistic Tracking of the Soccer Ball, Lecture Notes in Computer Science (2004) ISBN:9783540239895 p.50-60, 10.1007/978-3-540-30212-4_5
  24. Public, Apidis dataset, ball detection ground-truth, and code samples. http://sites.uclouvain.be/ispgroup/index.php/Softwares/APIDIS
  25. Yi Zhang, Hanqing Lu, Changsheng Xu, Collaborate ball and player trajectory extraction in broadcast soccer video, 10.1109/icpr.2008.4761402
  26. Wang, X., Ablavsky, V., Ben Shitrit, H., Fua, P.: Take your eyes off the ball: improving ball-tracking by focusing on team play. CVIU 119, 102–115 (2014)
  27. Wang Xinchao, Türetken Engin, Fleuret François, Fua Pascal, Tracking Interacting Objects Optimally Using Integer Programming, Computer Vision – ECCV 2014 (2014) ISBN:9783319105895 p.17-32, 10.1007/978-3-319-10590-1_2
  28. Lampert Christoph H., Peters Jan, Real-time detection of colored objects in multiple camera streams with off-the-shelf hardware components, 10.1007/s11554-010-0168-3
  29. Jinchang Ren, Ming Xu, Orwell J., Jones G.A., Real-Time Modeling of 3-D Soccer Ball Trajectories From Multiple Fixed Cameras, 10.1109/tcsvt.2008.918276
  30. Labayen Mikel, Olaizola Igor G., Aginako Naiara, Florez Julian, Accurate ball trajectory tracking and 3D visualization for computer-assisted sports broadcast, 10.1007/s11042-013-1558-x
  31. Chen, H.-T., Tien, M.-C., Chen, Y.-W., Tsai, W.-J., Lee, S.-Y.: Physics-based ball tracking and 3D trajectory reconstruction with applications to shooting location estimation in basketball video. J. VCIR 20(3), 204–216 (2009)
  32. Yan, F., Kostin, A., Christmas, W., Kittler, J.: A novel data association algorithm for object tracking in clutter with application to tennis video analysis. In: CVPR, pp. 634–641 (2006)
  33. Zhou Xiangzeng, Huang Qiang, Xie Lei, Cox Stephen, A two layered data association approach for ball tracking, 10.1109/icassp.2013.6638068
  34. Chen Hua-Tsung, Tsai Wen-Jiin, Lee Suh-Yin, Yu Jen-Yu, Ball tracking and 3D trajectory approximation with applications to tactics analysis from single-camera volleyball sequences, 10.1007/s11042-011-0833-y
  35. Chakraborty Bodhisattwa, Meher Sukadev, A real-time trajectory-based ball detection-and-tracking framework for basketball video, 10.1007/s12596-012-0108-7
  36. Poiesi Fabio, Daniyal Fahad, Cavallaro Andrea, Detector-less ball localization using context and motion flow analysis, 10.1109/icip.2010.5651147
  37. Kim Kihwan, Grundmann Matthias, Shamir Ariel, Matthews Iain, Hodgins Jessica, Essa Irfan, Motion fields to predict play evolution in dynamic sport scenes, 10.1109/cvpr.2010.5540128
  38. Ohno Y., Miura J., Shirai Y., Tracking players and estimation of the 3D position of a ball in soccer games, 10.1109/icpr.2000.905293
  39. Leo, M., Mosca, N., Spagnolo, P., Mazzeo, P., D’Orazio, T., Distant, A.: Real-time multi-view analysis of soccer matches for understanding interactions between ball and players. In: ACM International Conference on Image and Video Retrieval (2008)
  40. Maksai, A., Wang, X., Fua, P.: What players do with the ball: a physically constrained interaction modeling. In: CVPR (2016)
  41. Viola Paul, Jones Michael J., Robust Real-Time Face Detection, 10.1023/b:visi.0000013087.49260.fb
  42. SportVU: STATS SportVU technology. http://www.stats.com/sportvu/sportvu.asp
  43. Fischler Martin A., Bolles Robert C., Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography, 10.1145/358669.358692
  44. Gross, J.T., Yellen, J.: Graph Theory and its Applications. CRC Press, Boca Raton (1999)
  45. Videos, Ball tracks. http://sites.uclouvain.be/ispgroup/index.php/Research/BallTrac
  46. Chen, F., Delannay, D., De Vleeschouwer, C.: Multi-sensored vision for autonomous production of personalized video summaries. In: International ICST Conference on User Centric Media (2010)
  47. Perše, M., Kristan, M., Kovačič, S., Vučkovič, G., Perš, J.: A trajectory-based analysis of coordinated team activity in a basketball game. CVIU 113, 612–621 (2009)
  48. Porikli F., Integral histogram: a fast way to extract histograms in Cartesian spaces, 10.1109/cvpr.2005.188
Bibliographic reference Parisot, Pascaline ; De Vleeschouwer, Christophe. Consensus-based trajectory estimation for ball detection in calibrated cameras systems. In: Journal of Real-Time Image Processing, Vol. 2016, no.Sept, p. 1-16 (September 2016)
Permanent URL http://hdl.handle.net/2078.1/177090