Abstract
A major challenge in video surveillance is how to accurately detect anomalous behavioral patterns that may indicate public safety incidents. In this work, we address this challenge by proposing a novel architecture to translate the crowd status problem in videos into a graph stream analysis task. In particular, we integrate crowd density monitoring and graph stream mining to identify anomalous crowd behavior events. A real-time tracking algorithm is proposed for automatic identification of key regions in a scene, and at the same time, the pedestrian flow density between each pair of key regions is inferred over consecutive time intervals. These key regions are represented as the nodes of a graph, and the directional pedestrian density flow between regions is used as the edge weights in the graph. We then use Graph Edit Distance as the basis for a graph stream analysis approach, to detect time intervals of anomalous flow activity and to highlight the anomalous regions according to the heaviest subgraph. Based on the experimental evaluation on four real-world datasets and a benchmark dataset (UCSD), we observe that our proposed method achieves a high cross correlation coefficient (approximately 0.8) for all four real-world datasets, and 82% AUC with 28% EER for the UCSD datasets. Further, they all provide easily interpretable summaries of events using the heaviest subgraphs.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Li, W., Mahadevan, V., Vasconcelos, N.: Anomaly detection and localization in crowded scenes. IEEE Trans. Pattern Anal. Mach. Intell. 36, 18–32 (2014)
Cong, Y., Yuan, J., Liu, J.: Sparse reconstruction cost for abnormal event detection. In: IEEE CVPR, pp. 3449–3456 (2011)
Adam, A., Rivlin, E., Shimshoni, I., Reinitz, D.: Robust real-time unusual event detection using multiple fixed-location monitors. IEEE Trans. Pattern Anal. Mach. Intell. 30, 555–560 (2008)
Mo, X., Monga, V., Bala, R., Fan, Z.: Adaptive sparse representations for video anomaly detection. IEEE Trans. Circuits Syst. Video Technol. 24, 631–645 (2014)
Kim, J., Grauman, K.: Observe locally, infer globally: a space-time MRF for detecting abnormal activities with incremental updates. In: IEEE CVPR, pp. 2921–2928 (2009)
Roshtkhari, M.J., Levine, M.D.: Online dominant and anomalous behavior detection in videos. In: IEEE CVPR, pp. 2611–2618 (2013)
Mahadevan, V., Li, W., Bhalodia, V., Vasconcelos, N.: Anomaly detection in crowded scenes. In: IEEE CVPR, pp. 1975–1981 (2010)
Mehran, R., Oyama, A., Shah, M.: Abnormal crowd behavior detection using social force model. In: IEEE CVPR, pp. 935–942 (2009)
Xu, D., Ricci, E., Yan, Y., Song, J., Sebe, N.: Learning deep representations of appearance and motion for anomalous event detection. arXiv preprint arXiv:1510.01553 (2015)
Reddy, V., Sanderson, C., Lovell, B.C.: Improved anomaly detection in crowded scenes via cell-based analysis of foreground speed, size and texture. In: IEEE CVPRW. IEEE (2011)
Feng, Y., Yuan, Y., Lu, X.: Deep representation for abnormal event detection in crowded scenes. In: Proceedings of the ACM Multimedia Conference, pp. 591–595 (2016)
Gao, X., Xiao, B., Tao, D., Li, X.: A survey of graph edit distance. Pattern Anal. Appl. 13, 113–129 (2010)
Basseville, M., Nikiforov, I.V.: Detection of Abrupt Changes: Theory and Application, vol. 104. Prentice Hall, Englewood Cliffs (1993)
Bogdanov, P., Mongiov, M., Singh, A.K.: Mining heavy subgraphs in time-evolving networks. In: IEEE ICDM, pp. 81–90 (2011)
Barnich, O., Van Droogenbroeck, M.: ViBe: a powerful random technique to estimate the background in video sequences. In: IEEE ICASSP, pp. 945–948 (2009)
Cuevas, E., Zaldivar, D., Rojas, R.: Kalman filter for vision tracking. Technical report B, Fachbereich Mathematikund Informatik, Freie Universitat Berlin (2005)
Ltteke, F., Zhang, X., Franke, J.: Implementation of the Hungarian method for object tracking on a camera monitored transportation system. In: 7th German Conference on VDE, pp. 1–6 (2012)
Greenhill, D., Renno, J., Orwell, J., Jones, G.A.: Occlusion analysis: learning and utilising depth maps in object tracking. Image Vis. Comput. 26, 430–441 (2008)
Rajasegarar, S., Leckie, C., Palaniswami, M.: Hyperspherical cluster based distributed anomaly detection in wireless sensor networks. J. Parallel Distrib. Comput. 74, 1833–1847 (2014)
Yang, M., Rajasegarar, S., Rao, A.S., Leckie, C., Palaniswami, M.: Anomalous behavior detection in crowded scenes using clustering and spatio-temporal features. In: Shi, Z., Vadera, S., Li, G. (eds.) IIP 2016. IAICT, vol. 486, pp. 132–141. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-48390-0_14
Kennedy, H.L.: A new statistical measure of signal similarity. In: Information, Decision and Control, pp. 112–117 (2007)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer Nature Switzerland AG
About this paper
Cite this paper
Yang, M., Rashidi, L., Rajasegarar, S., Leckie, C. (2018). Graph Stream Mining Based Anomalous Event Analysis. In: Geng, X., Kang, BH. (eds) PRICAI 2018: Trends in Artificial Intelligence. PRICAI 2018. Lecture Notes in Computer Science(), vol 11012. Springer, Cham. https://doi.org/10.1007/978-3-319-97304-3_68
Download citation
DOI: https://doi.org/10.1007/978-3-319-97304-3_68
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-97303-6
Online ISBN: 978-3-319-97304-3
eBook Packages: Computer ScienceComputer Science (R0)