AuthorsO. A. N. Rongved, S. Hicks, V. Thambawita, H. K. Stensland, E. Zouganeli, D. Johansen, C. Midoglu, M. Riegler and P. Halvorsen
TitleUsing 3D Convolutional Neural Networks for Real-time Detection of Soccer Events
AfilliationCommunication Systems, Machine Learning
Project(s)Department of Holistic Systems
StatusPublished
Publication TypeJournal Article
Year of Publication2021
JournalInternational Journal of Semantic Computing
Volume15
Issue2
Number2
Pagination161 - 187
Date PublishedJan-06-2021
PublisherWorld Scientific
ISSN1793-351X
Keywords3d CNN, classification, Detection, soccer events, spotting
Abstract

Developing systems for the automatic detection of events in video is a task which has gained attention in many areas including sports. More specifically, event detection for soccer videos has been studied widely in the literature. However, there are still a number of shortcomings in the state-of-the-art such as high latency, making it challenging to operate at the live edge. In this paper, we present an algorithm to detect events in soccer videos in real time, using 3D convolutional neural networks. We test our algorithm on three different datasets from SoccerNet, the Swedish Allsvenskan, and the Norwegian Eliteserien. Overall, the results show that we can detect events with high recall, low latency, and accurate time estimation. The trade-off is a slightly lower precision compared to the current state-of-the-art, which has higher latency and performs better when a less accurate time estimation can be accepted. In addition to the presented algorithm, we perform an extensive ablation study on how the different parts of the training pipeline affect the final results.

URLhttps://www.worldscientific.com/doi/abs/10.1142/S1793351X2140002X
DOI10.1142/S1793351X2140002X
Citation Key28007

Contact person