Empirical Analysis of Machine Learning Models Used for Motion Detection & Tracking in Videos from An Augmented Statistical Perspective

Authors

  • Shivali Tiwari  Department of Computer Science and Engineering, Tulsiramji Gaikwad-Patil College of Engineering & Technology, Nagpur, Maharashtra, India
  • Prof. Jayant Adhikari  Department of Computer Science and Engineering, Tulsiramji Gaikwad-Patil College of Engineering & Technology, Nagpur, Maharashtra, India

Keywords:

Empirical Analysis, Machine Learning Models, Motion Detection, Tracking, Statistical Perspectives

Abstract

The goal of the current study is to carry out an empirical analysis of several machine learning models used for motion detection and tracking in video streams. The inquiry is conducted from a statistical perspective, and different motion detection and tracking approaches are systematically evaluated and contrasted. The careful assessment of these models' performance characteristics in this study, including measures for prediction accuracy, recall rates, temporal delay, and scalability, distinguishes it from others. This research helps to clarify the advantages and disadvantages of each model by methodically comparing various motion detection and tracking approaches. The empirical findings reported here provide a thorough understanding of the performance of these models in actual video scenarios. The ability of the models to accurately recognise and follow moving objects is demonstrated by the comparison of prediction accuracy and recall. Quantifying the temporal responsiveness of each methodology is accomplished through the evaluation of temporal delay. Additionally, the assessment of scalability measures gauges the models' ability to adapt to the changing complexity of video data samples. This study elucidates the complex interaction between the various machine learning models and their corresponding performance indicators by providing a detailed analysis of the many variables under examination. This empirical investigation improves their understanding of motion detection and tracking in videos and makes it easier to choose the right model for real-world applications. The results highlight the importance of thoroughly evaluating variables for predictive accuracy, recall potential, temporal delay, and scalability when implementing machine learning methods for motion detection and tracking inside video streams.

References

  1. Q. Guo, W. Feng, R. Gao, Y. Liu and S. Wang, "Exploring the Effects of Blur and Deblurring to Visual Object Tracking," in IEEE Transactions on Image Processing, vol. 30, pp. 1812-1824, 2021, doi: 10.1109/TIP.2020.3045630.
  2. X. Wang, J. Tang, B. Luo, Y. Wang, Y. Tian and F. Wu, "Tracking by Joint Local and Global Search: A Target-Aware Attention-Based Approach," in IEEE Transactions on Neural Networks and Learning Systems, vol. 33, no. 11, pp. 6931-6945, Nov. 2022, doi: 10.1109/TNNLS.2021.3083933.
  3. Y. Zheng, Z. Yu, S. Wang and T. Huang, "Spike-Based Motion Estimation for Object Tracking Through Bio-Inspired Unsupervised Learning," in IEEE Transactions on Image Processing, vol. 32, pp. 335-349, 2023, doi: 10.1109/TIP.2022.3228168.
  4. J. Wu, X. Su, Q. Yuan, H. Shen and L. Zhang, "Multivehicle Object Tracking in Satellite Video Enhanced by Slow Features and Motion Features," in IEEE Transactions on Geoscience and Remote Sensing, vol. 60, pp. 1-26, 2022, Art no. 5616426, doi: 10.1109/TGRS.2021.3139121.
  5. Y. Wu, H. Sheng, Y. Zhang, S. Wang, Z. Xiong and W. Ke, "Hybrid Motion Model for Multiple Object Tracking in Mobile Devices," in IEEE Internet of Things Journal, vol. 10, no. 6, pp. 4735-4748, 15 March15, 2023, doi: 10.1109/JIOT.2022.3219627.
  6. H. Nodehi and A. Shahbahrami, "Multi-Metric Re-Identification for Online Multi-Person Tracking," in IEEE Transactions on Circuits and Systems for Video Technology, vol. 32, no. 1, pp. 147-159, Jan. 2022, doi: 10.1109/TCSVT.2021.3059250.
  7. L. Ruan, Y. Guo, D. Yang and Z. Chen, "Deep Siamese Network With Motion Fitting for Object Tracking in Satellite Videos," in IEEE Geoscience and Remote Sensing Letters, vol. 19, pp. 1-5, 2022, Art no. 6508005, doi: 10.1109/LGRS.2022.3158652.
  8. Y. Chen, Y. Tang, Z. Yin, T. Han, B. Zou and H. Feng, "Single Object Tracking in Satellite Videos: A Correlation Filter-Based Dual-Flow Tracker," in IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, vol. 15, pp. 6687-6698, 2022, doi: 10.1109/JSTARS.2022.3185328.
  9. X. Gu, H. Chang, B. Ma and S. Shan, "Motion Feature Aggregation for Video-Based Person Re-Identification," in IEEE Transactions on Image Processing, vol. 31, pp. 3908-3919, 2022, doi: 10.1109/TIP.2022.3175593.
  10. A. V. Savkin and H. Huang, "Bioinspired Bearing Only Motion Camouflage UAV Guidance for Covert Video Surveillance of a Moving Target," in IEEE Systems Journal, vol. 15, no. 4, pp. 5379-5382, Dec. 2021, doi: 10.1109/JSYST.2020.3028577.
  11. D. P. Azari et al., "A Comparison of Expert Ratings and Marker-Less Hand Tracking Along OSATS-Derived Motion Scales," in IEEE Transactions on Human-Machine Systems, vol. 51, no. 1, pp. 22-31, Feb. 2021, doi: 10.1109/THMS.2020.3035763.
  12. P. Zhang, J. Zhao, C. Bo, D. Wang, H. Lu and X. Yang, "Jointly Modeling Motion and Appearance Cues for Robust RGB-T Tracking," in IEEE Transactions on Image Processing, vol. 30, pp. 3335-3347, 2021, doi: 10.1109/TIP.2021.3060862.
  13. W. Zhang, L. Jiao, F. Liu, L. Li, X. Liu and J. Liu, "MBLT: Learning Motion and Background for Vehicle Tracking in Satellite Videos," in IEEE Transactions on Geoscience and Remote Sensing, vol. 60, pp. 1-15, 2022, Art no. 4703315, doi: 10.1109/TGRS.2021.3109028.
  14. F. Gurkan, L. Cerkezi, O. Cirakman and B. Gunsel, "TDIOT: Target-Driven Inference for Deep Video Object Tracking," in IEEE Transactions on Image Processing, vol. 30, pp. 7938-7951, 2021, doi: 10.1109/TIP.2021.3112010.
  15. R. Han, W. Feng, Y. Zhang, J. Zhao and S. Wang, "Multiple Human Association and Tracking From Egocentric and Complementary Top Views," in IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 44, no. 9, pp. 5225-5242, 1 Sept. 2022, doi: 10.1109/TPAMI.2021.3070562.
  16. L. Wang, H. Liu, S. Zhou, W. Tang and G. Hua, "Instance Motion Tendency Learning for Video Panoptic Segmentation," in IEEE Transactions on Image Processing, vol. 32, pp. 764-778, 2023, doi: 10.1109/TIP.2022.3226414.
  17. S. Chen et al., "Vehicle Tracking on Satellite Video Based on Historical Model," in IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, vol. 15, pp. 7784-7796, 2022, doi: 10.1109/JSTARS.2022.3195522.
  18. J. Shao, B. Du, C. Wu, M. Gong and T. Liu, "HRSiam: High-Resolution Siamese Network, Towards Space-Borne Satellite Video Tracking," in IEEE Transactions on Image Processing, vol. 30, pp. 3056-3068, 2021, doi: 10.1109/TIP.2020.3045634.
  19. J. Yang, Z. Pan, Z. Wang, B. Lei and Y. Hu, "SiamMDM: An Adaptive Fusion Network With Dynamic Template for Real-Time Satellite Video Single Object Tracking," in IEEE Transactions on Geoscience and Remote Sensing, vol. 61, pp. 1-19, 2023, Art no. 5608619, doi: 10.1109/TGRS.2023.3271645.
  20. J. Pan, Y. Gu, S. Li, G. Gao and S. Wu, "Intrinsic Satellite Video Decomposition With Motion Target Energy Constraint," in IEEE Transactions on Geoscience and Remote Sensing, vol. 60, pp. 1-13, 2022, Art no. 5633913, doi: 10.1109/TGRS.2022.3220704.
  21. G. Barquero, I. Hupont and C. Fernández Tena, "Rank-Based Verification for Long-Term Face Tracking in Crowded Scenes," in IEEE Transactions on Biometrics, Behavior, and Identity Science, vol. 3, no. 4, pp. 495-505, Oct. 2021, doi: 10.1109/TBIOM.2021.3099568.
  22. F. Han, L. Xie, Y. Yin, H. Zhang, G. Chen and S. Lu, "Video Stabilization for Camera Shoot in Mobile Devices via Inertial-Visual State Tracking," in IEEE Transactions on Mobile Computing, vol. 20, no. 4, pp. 1714-1729, 1 April 2021, doi: 10.1109/TMC.2019.2961313.
  23. Y. Nie, C. Bian and L. Li, "Object Tracking in Satellite Videos Based on Siamese Network With Multidimensional Information-Aware and Temporal Motion Compensation," in IEEE Geoscience and Remote Sensing Letters, vol. 19, pp. 1-5, 2022, Art no. 6517005, doi: 10.1109/LGRS.2022.3211695.
  24. X. Tian, P. Zheng and J. Huang, "Robust Privacy-Preserving Motion Detection and Object Tracking in Encrypted Streaming Video," in IEEE Transactions on Information Forensics and Security, vol. 16, pp. 5381-5396, 2021, doi: 10.1109/TIFS.2021.3128817.
  25. J. Wei, J. Sun, Z. Wu, J. Yang and Z. Wei, "Moving Object Tracking via 3-D Total Variation in Remote-Sensing Videos," in IEEE Geoscience and Remote Sensing Letters, vol. 19, pp. 1-5, 2022, Art no. 3506405, doi: 10.1109/LGRS.2021.3077257.
  26. Shivadekar, S., Kataria, B., Limkar, S. et al. Design of an efficient multimodal engine for preemption and post-treatment recommendations for skin diseases via a deep learning-based hybrid bio-inspired process. Soft Comput (2023).
  27. Shivadekar, Samit, et al. "Deep Learning Based Image Classification of Lungs Radiography for Detecting COVID-19 using a Deep CNN and ResNet 50." International Journal of Intelligent Systems and Applications in Engineering 11.1s (2023): 241-250.
  28. P. Nguyen, S. Shivadekar, S. S. Laya Chukkapalli and M. Halem, "Satellite Data Fusion of Multiple Observed XCO2 using Compressive Sensing and Deep Learning," IGARSS 2020 - 2020 IEEE International Geoscience and Remote Sensing Symposium, Waikoloa, HI, USA, 2020, pp. 2073-2076, doi: 10.1109/IGARSS39084.2020.9323861.
  29. Banait, Satish S., et al. "Reinforcement mSVM: An Efficient Clustering and Classification Approach using reinforcement and supervised Techniques." International Journal of Intelligent Systems and Applications in Engineering 10.1s (2022): 78-89.
  30. Shewale, Yogita, Shailesh Kumar, and Satish Banait. "Machine Learning Based Intrusion Detection in IoT Network Using MLP and LSTM." International Journal of Intelligent Systems and Applications in Engineering 11.7s (2023): 210-223.
  31. Vanjari, Hrishikesh B., Sheetal U. Bhandari, and Mahesh T. Kolte. "Enhancement of Speech for Hearing Aid Applications Integrating Adaptive Compressive Sensing with Noise Estimation Based Adaptive Gain." International Journal of Intelligent Systems and Applications in Engineering 11.7s (2023): 138-157.
  32. Vanjari, Hrishikesh B., and Mahesh T. Kolte. "Comparative Analysis of Speech Enhancement Techniques in Perceptive of Hearing Aid Design." Proceedings of the Third International Conference on Information Management

Downloads

Published

2023-10-30

Issue

Section

Research Articles

How to Cite

[1]
Shivali Tiwari, Prof. Jayant Adhikari "Empirical Analysis of Machine Learning Models Used for Motion Detection & Tracking in Videos from An Augmented Statistical Perspective" International Journal of Scientific Research in Science, Engineering and Technology (IJSRSET), Print ISSN : 2395-1990, Online ISSN : 2394-4099, Volume 10, Issue 5, pp.29-46, September-October-2023.