A Cloud-Based Deep Learning Framework for Real-Time Anomaly Detection in Public Surveillance Videos Using VGG16-LSTM
DOI:
https://doi.org/10.70454/JRIST.020202Keywords:
Cloud Computing, Public Security, Video Surveillance, Image Analysis, Anomaly DetectionAbstract
The purpose of this research is to design and train a deep learning-based surveillance network that can detect anomalous and suspicious behavior in real time using the Daily Crime Surveillance and Safety System (DCSASS). The system will enhance safety on the streets and enable detection of threats ahead through automation of anomaly detection of the video feeds. The methodology is systematic and organized and starts by gathering and authenticating video data of a high risk activity of 13 high risk classes of activities such as assault, robbery, arson and vandalism. An effective preprocessing pipeline was developed, including a Gaussian blur filter and brightness-contrast normalization to improve clarity of the frame and reduce noise. The videos were then split into frames and annotated by using official labels and separated into training and validation sets using stratified sampling to ensure class balance. A hybrid architecture was followed whereby the VGG16 convolutional neural network that was used as the frozen spatial feature extractor was integrated with the Long Short-Term Memory (LSTM) layer to learn temporal interrelations. The time intervals of the input feature vectors were converted to a repetition, simulating the motion context. The performance, such as the accuracy, loss, precision and recall, were modelled using the standard metrics. The proposed VGG16-LSTM model presented an accuracy of 95.05, low loss of 0.126, precision of 95.46 and recall of 93.11 indicating that this model is very reliable when it comes to detecting anomalies. In addition, object detection analysis yielded a precision of 85.7% and mAP 0.5 of 71.7%. The validity and scalability of the suggested framework were validated in comparison to the other existing models, including ResNet-50 and an earlier hybrid model.
References
[1] J. Chen, K. Li, Q. Deng, K. Li, and P. S. Yu, “Distributed Deep Learning Model for Intelligent Video Surveillance Systems with Edge Computing,” IEEE Trans. Ind. Informatics, pp. 1–9, 2024, doi: 10.1109/TII.2019.2909473.
[2] J. Bernard, “IoT with Cloud Based Distributed Disease Diagnosis System using Deep Belief Networks IoT with Cloud Based Distributed Disease Diagnosis System using Deep Belief Networks,” no. January 2021, 2024, doi: 10.13140/RG.2.2.24891.02082.
[3] J. H. Park et al., “A Comprehensive Survey on Core Technologies and Services for 5G Security: Taxonomies, Issues, and Solutions,” Human-centric Comput. Inf. Sci., vol. 11, 2021, doi: 10.22967/HCIS.2021.11.003.
[4] K. K. Santhosh, D. P. Dogra, and P. P. Roy, “Anomaly Detection in Road Traffic Using Visual Surveillance: A Survey,” ACM Comput. Surv., vol. 53, no. 6, pp. 1–14, 2021, doi: 10.1145/3417989.
[5] J. Zeng, C. Abidin, and M. S. Schäfer, “Research Perspectives on TikTok & Its Legacy Apps,” Int. J. Commun., vol. 15, no. April, pp. 3161–3172, 2021.
[6] A. Harichandran, B. Raphael, and A. Mukherjee, “A hierarchical machine learning framework for the identification of automated construction operations,” J. Inf. Technol. Constr., vol. 26, no. August, pp. 591–623, 2021, doi: 10.36680/j.itcon.2021.031.
[7] “public security video image investigation .” https://www.cloud4u.com/blog/cloud-video-surveillance-storage-everything-you-need-to-know/ (accessed Jun. 26, 2025).
[8] A. Othman and N. A. Nayan, “Public Safety Mobile Broadband System: From Shared Network to Logically Dedicated Approach Leveraging 5G Network Slicing,” IEEE Syst. J., vol. 15, no. 2, pp. 2109–2120, 2021, doi: 10.1109/JSYST.2020.3002247.
[9] D. Samanta et al., “Cipher Block Chaining Support Vector Machine for Secured Decentralized Cloud Enabled Intelligent IoT Architecture,” IEEE Access, vol. 9, pp. 98013–98025, 2021, doi: 10.1109/ACCESS.2021.3095297.
[10] W. Ullah, A. Ullah, I. U. Haq, K. Muhammad, M. Sajjad, and S. W. Baik, “CNN features with bi-directional LSTM for real-time anomaly detection in surveillance networks,” Multimed. Tools Appl., vol. 80, no. 11, pp. 16979–16995, 2021, doi: 10.1007/s11042-020-09406-3.
[11] K. Mershad, H. Dahrouj, H. Sarieddeen, B. Shihada, T. Al-Naffouri, and M. S. Alouini, “Cloud-Enabled High-Altitude Platform Systems: Challenges and Opportunities,” Front. Commun. Networks, vol. 2, no. July, pp. 1–21, 2021, doi: 10.3389/frcmn.2021.716265.
[12] S. Saponara, A. Elhanashi, and A. Gagliardi, “Real-time video fire/smoke detection based on CNN in antifire surveillance systems,” J. Real-Time Image Process., vol. 18, no. 3, pp. 889–900, 2021, doi: 10.1007/s11554-020-01044-0.
[13] S. Park, G. S. Member, H. T. A. E. Kim, S. Lee, H. Joo, and H. Kim, “Survey on Anti-Drone Systems : Components , Designs , and Challenges,” pp. 42635–42659, 2021, doi: 10.1109/ACCESS.2021.3065926.
[14] A. Sunil, M. H. Sheth, E. Shreyas, and Mohana, “Usual and Unusual Human Activity Recognition in Video using Deep Learning and Artificial Intelligence for Security Applications,” 2021 4th Int. Conf. Electr. Comput. Commun. Technol. ICECCT 2021, no. September 2021, 2021, doi: 10.1109/ICECCT52121.2021.9616791.
[15] B. Balusamy, N. Chilamkurti, and S. Kadry, Green Computing in Smart Cities : Simulation and Techniques, no. September. 2020. doi: 10.1007/978-3-030-48141-4.
[16] B. Hamdaoui, M. Alkalbani, T. Znati, and A. Rayes, “Unleashing the Power of Participatory IoT with Blockchains for Increased Safety and Situation Awareness of Smart Cities,” IEEE Netw., vol. 34, no. 2, pp. 202–209, 2020, doi: 10.1109/MNET.001.1900253.
[17] W. Toussaint and A. Y. Ding, “Machine learning systems in the IoT: Trustworthiness trade-offs for edge intelligence,” Proc. - 2020 IEEE 2nd Int. Conf. Cogn. Mach. Intell. CogMI 2020, pp. 177–184, 2020, doi: 10.1109/CogMI50398.2020.00030.
[18] Z. Shao, L. Wang, Z. Wang, W. Du, and W. Wu, “Saliency-Aware Convolution Neural Network for Ship Detection in Surveillance Video,” IEEE Trans. Circuits Syst. Video Technol., vol. 30, no. 3, pp. 781–794, 2020, doi: 10.1109/TCSVT.2019.2897980.
[19] R. Kitchin, “Civil liberties or public health, or civil liberties and public health? Using surveillance technologies to tackle the spread of COVID-19,” Sp. Polity, pp. 1–20, 2020, doi: 10.1080/13562576.2020.1770587.
[20] M. Ammad et al., “A Novel Fog-Based Multi-Level Energy-Efficient Framework for IoT-Enabled Smart Environments,” IEEE Access, vol. 8, pp. 150010–150026, 2020, doi: 10.1109/ACCESS.2020.3010157.
[21] Y. Peng, M. Zhang, F. Yu, J. Xu, and S. Gao, “Digital Twin Hospital Buildings: An Exemplary Case Study through Continuous Lifecycle Integration,” Adv. Civ. Eng., vol. 2020, 2020, doi: 10.1155/2020/8846667.
[22] S. Yadav, “Deep Learning based Safe Social Distancing and Face Mask Detection in Public Areas for COVID-19 Safety Guidelines Adherence,” Int. J. Res. Appl. Sci. Eng. Technol., vol. 8, no. 7, pp. 1368–1375, 2020, doi: 10.22214/ijraset.2020.30560.
[23] P. Henman, “Improving public services using artificial intelligence: possibilities, pitfalls, governance,” Asia Pacific J. Public Adm., vol. 42, no. 4, pp. 209–221, 2020, doi: 10.1080/23276665.2020.1816188.
[24] D. Gupta, S. Bhatt, M. Gupta, and A. Saman, “Since January 2020 Elsevier has created a COVID-19 resource centre with free information in English and Mandarin on the novel coronavirus COVID- 19 . The COVID-19 resource centre is hosted on Elsevier Connect , the company ’ s public news and information ,” no. January, 2020.
[25] S. Ali et al., “Towards Pattern-Based Change Verification Framework for Cloud-Enabled Healthcare Component-Based,” IEEE Access, vol. 8, pp. 148007–148020, 2020, doi: 10.1109/ACCESS.2020.3014671.
[26] A. International, O. Access, P. R. Journal, and V. Sharma, “Multidisciplinary Trends ( IJARMT ) An Innovative Approach to Public Security Video Investigation Using Cloud-Enabled Deep Learning Systems International Journal of Advanced Research and Multidisciplinary Trends ( IJARMT ),” no. 2.
[27] R. Sharma and A. Sungheetha, “An Efficient Dimension Reduction based Fusion of CNN and SVM Model for Detection of Abnormal Incident in Video Surveillance,” J. Soft Comput. Paradig., vol. 3, no. 2, pp. 55–69, 2021, doi: 10.36548/jscp.2021.2.001.
Downloads
Published
Issue
Section
License
Copyright (c) 2026 Pharindra Kumar Sharma, Sonia Chourasiya (Author)
This work is licensed under a Creative Commons Attribution 4.0 International License.
This is an Open Access article distributed under the term's of the Creative Common Attribution 4.0 International License permitting all use, distribution, and reproduction in any medium, provided the work is properly cited.
