An Evaluation of OpenCV's Investigation into Hand Gesture Recognition Methods

Kumar Bibhuti B. Singh; Dr. Nikhat Akhtar; Prof. (Dr.) Devendra Agarwal; Susheel Kumar; Dr. Yusuf Perwej

doi:10.32628/IJSRSET25121150

Authors

Kumar Bibhuti B. Singh Assistant Professor, Department of Computer Science & Engineering, Goel Institute of Technology & Management, Lucknow, Uttar Pradesh, India Author
Dr. Nikhat Akhtar Associate Professor, Department of Information Technology, Goel Institute of Technology & Management, Lucknow, Uttar Pradesh, India Author
Prof. (Dr.) Devendra Agarwal Dean (Academics), Goel Institute of Technology & Management, Lucknow, Uttar Pradesh, India Author
Susheel Kumar Assistant Professor, Department of Computer Science & Engineering, Ambalika Institute of Management & Technology, Lucknow, Uttar Pradesh, India Author
Dr. Yusuf Perwej Professor, Department of Computer Science & Engineering, Goel Institute of Technology & Management, Lucknow, Uttar Pradesh, India Author

DOI:

https://doi.org/10.32628/IJSRSET25121150

Keywords:

Hand Gesture Recognition, Convolution Neural Network (CNN), Image Pre-processing, OpenCV, Machine Learning, TensorFlow, American Sign Language (ASL)

Abstract

In order to achieve human-computer interaction (HCI) that is quick, accurate, and user-friendly, processing and intelligence are absolutely necessary. Despite the fact that computers are now capable of comprehending signs and symbols, the notion of identifying symbols that are produced live by a person in front of a camera is still somewhat foreign. The purpose of this work is to examine several methods for hand gesture detection by using the capabilities of OpenCV and TensorFlow, which are two of the most popular libraries in the fields of computer vision and deep learning. In order to perform preprocessing, feature extraction, and the establishment of a strong basis for subsequent research, OpenCV's extensive image processing capabilities are employed. For the purpose of constructing and training deep neural networks that are able to recognize fine-grained features and minor changes in hand motions, TensorFlow is used. Through this integration, it is possible to differentiate and comprehend a predetermined set of motions in a precise and accurate manner, hence revealing the potential for robust hand gesture recognition systems.

Downloads

Download data is not yet available.

References

Huang, D.; Guan, C.; Ang, K.K.; Zhang, H.; Pan, Y. [1] Qinghe Zheng, Xinyu Tian, Shilei Liu, Mingqiang Yang, Hongjun Wang and Jiajie Yang, "Static Hand Gesture Recognition Based on Gaussian Mixture Model and Partial Differential Equation", IAENG International Journal of Computer Science, vol. 45, no. 4, November 2018

Danling Lu, Yuanlong Yu and Huaping Liu, "Gesture Recognition Using Data Glove: An Extreme Learning Machine Method", Proceedings of the 2016 IEEE International Conference on Robotics and Bio. Qingdao, pp. 3-7, 2016

Y. Perwej, “A Literature Review of the Human Body as a Communication Medium using RedTacton”, Communications on Applied Electronics (CAE), ISSN: 2394-4714, Foundation of Computer Science FCS, USA, Volume 9, No.4, Pages 7 – 17, 2016 , DOI: 10.5120/cae2016652161 DOI: https://doi.org/10.5120/cae2016652161

Z. R. Saeed, Z. B. Zainol, B. B. Zaidan and A. H. Alamoodi, "A systematic review on systems-based sensory gloves for sign language pattern recognition: An update from 2017 to 2022", IEEE Access, vol. 10, pp. 123358-123377, 2022 DOI: https://doi.org/10.1109/ACCESS.2022.3219430

S. Wang, A. Wang, M. Ran, L. Liu, Y. Peng, M. Liu, et al., "Hand gesture recognition framework using a lie group based spatio-temporal recurrent network with multiple hand-worn motion sensors", Inf. Sci., vol. 606, pp. 722-741, Aug. 2022 DOI: https://doi.org/10.1016/j.ins.2022.05.085

X. Chu, J. Liu and S. Shimamoto, "A sensor-based hand gesture recognition system for Japanese sign language", Proc. IEEE 3rd Glo. Conf. Life Sci. Technol., pp. 311-312, Mar. 2021 DOI: https://doi.org/10.1109/LifeTech52111.2021.9391981

F. Parwej, "English Sentence Recognition using Artificial Neural Network through Mouse-based Gestures", International Journal of Computer App., vol. 61, no. 17, pp. 33-38, 2013 DOI: https://doi.org/10.5120/10023-4998

Shobhit Kumar Ravi, Shivam Chaturvedi, Dr. Neeta Rastogi, Nikhat Akhtar, Y. Perwej, “A Framework for Voting Behavior Prediction Using Spatial Data”, International Journal of Innovative Research in Computer Science & Technology (IJIRCST), ISSN: 2347-5552, Volume 10, Issue 2, Pages 19-28, 2022, DOI: 10.55524/ijircst.2022.10.2.4 DOI: https://doi.org/10.55524/ijircst.2022.10.2.4

Shubham Mishra, Mrs Versha Verma, Nikhat Akhtar, Shivam Chaturvedi, Y. Perwej, “An Intelligent Motion Detection Using OpenCV” , International Journal of Scientific Research in Science, Engineering and Technology (IJSRSET), Print ISSN: 2395-1990 , Online ISSN : 2394-4099, Volume 9, Issue 2, Pages 51-63, 2022, DOI: 10.32628/IJSRSET22925 DOI: https://doi.org/10.32628/IJSRSET22925

S. Tanaka, A. Okazaki, N. Kato, and K. Fukui, "Spotting fingerspelled words from sign language video by temporally regularized canonical component analysis", Proc. IEEE Int. Conf. Identity Secur. Behav. Anal. (ISBA), pp. 1-7, 2016

Z. Ren, J. Yuan, J. Meng and Z. Zhang, "Robust part-based hand gesture recognition using kinect sensor", IEEE Transactions on Multimedia, vol. 15, no. 5, pp. 11101120, 2013 DOI: https://doi.org/10.1109/TMM.2013.2246148

J. Lee, Y. Lee, E. Lee and S. Hong, "Hand region ex- traction and gesture recognition from video stream with complex background through entropy analysis", Conf Proc IEEE Eng Med Biol Soc, vol. 2, no. 2, pp. 15131516, 2004

Bhavesh Kumar Jaisawal, Y. Perwej, Sanjay Kumar Singh, Susheel Kumar, Jai Pratap Dixit, Niraj Kumar Singh, “An Empirical Investigation of Human Identity Verification Methods” , the International Journal of Scientific Research in Science, Engineering and Technology (IJSRSET), Print ISSN: 2395-1990 , Online ISSN : 2394-4099, Volume 10, Issue 1, Pages 16-38, 2022, DOI: 10.32628/IJSRSET2310012 DOI: https://doi.org/10.32628/IJSRSET2310012

Ryzard S. Choras, "Hand Shape and Hand Gesture Recognition", 2009 IEEE Symposium on Industrial Electronics and Applications (ISIEA 2009), October 4-6, 2009 DOI: https://doi.org/10.1109/ISIEA.2009.5356486

Kajal, Neha Singh, Dr. Nikhat Akhtar, Ms. Sana Rabbani, Y. Perwej, Susheel Kumar, “Using Emerging Deep Convolutional Neural Networks (DCNN) Learning Techniques for Detecting Phony News”, International Journal of Scientific Research in Computer Science, Engineering and Information Technology (IJSRCSEIT), ISSN: 2456-3307, Volume 10, Issue 1, Pages 122-137, 2024, DOI: 10.32628/CSEIT2410113 DOI: https://doi.org/10.32628/CSEIT2410113

Yang, M., & Fu, Y. (2017). CNN based hand gesture recognition for robotic control. In 2017 9th International Conference on Information Technology in Medicine and Education (ITME) (pp. 550-553). IEEE.

Saurabh Adhikari, Tushar Kanti Gangopadhayay, Souvik Pal, Akila, D. ,Mamoona Humayun, Majed Alfayad & Jhanjhi, N. Z. (2023). Novel Machine Learning–Based Hand Gesture Recognition Using HCI on IoT Assisted Cloud Platform. Computer Systems Science and Engineering, 46, 2, 2123-2140. DOI: https://doi.org/10.32604/csse.2023.034431

Djosic, S., Stojanovic, I., Jovanovic, M., Nikolic, T., & Djordjevic, G. L. (2021). Fingerprinting-assisted UWB-based localization technique for complex indoor environments. Expert Systems with Applications, 167, 1, 1–14. DOI: https://doi.org/10.1016/j.eswa.2020.114188

Martendra Pratap Singh, Arzoo Poswal, & Eshu Yadav, (2022). Volume Control Using Gestures. International Journal of Innovative Science and Research Technology, 7, 5, 203-206.

H. Wang, J. Zhang, and X. Liu, "Hand Gesture Recognition Based on Deep Learning and OpenCV," IEEE Access, vol. 8, pp. 77695-77704, 2020.

Y. Yao, M. Wu, and J. Wang, "A Real-Time Hand Gesture Recognition Approach Using Deep Learning and OpenCV," in Proceedings of the 2021 International Conference on Artificial Intelligence and Computer Science (AICS), pp. 135-140.

F. Zhang, X. Wang, and Y. Li, "Hand Gesture Recognition Using Depth Data and Machine Learning Techniques," Journal of Visual Communication and Image Representation, vol. 59, pp. 61-71, Jan. 2019.

Li, Y., et al. "Real-Time Hand Gesture Recognition for Human-Computer Interaction: A Review." IEEE Access, vol. 9, 2021, pp. 29415-29430

Mokhtar M. Hasan, & Pramoud K. Misra. (2011). Brightness Factor Matching For Gesture Recognition System Using Scaled Normalization. International Journal of Computer Science and Information Technology, 3, 2, 35-46. DOI: https://doi.org/10.5121/ijcsit.2011.3203

Asaari, M.S.M., Rosdi, B.A., & Suandi, S.A. (2014). Intelligent biometric group hand tracking (IBGHT) database for visual hand tracking research and development. Multimed. Tools Appl., 70, 1869–1898. DOI: https://doi.org/10.1007/s11042-012-1212-z

Quam, D.L., (2002). Gesture recognition with a DataGlove, IEEE Conference on Aerospace and Electronics. Dayton, OH, USA.

Liou, D.H., Lee, D., & Hsieh, C.C. (2010) A real time hand gesture recognition system using motion history image. In Proceedings of the 2010 2nd International Conference on Signal Processing Systems. Dalian, China. DOI: https://doi.org/10.1109/ICSPS.2010.5555462

Anmol Chauhan, Ms. Sana Rabbani, Prof. (Dr.) Devendra Agarwal, Nikhat Akhtar, Y. Perwej, “Diffusion Dynamics Applied with Novel Methodologies”, International Journal of Innovative Research in Computer Science and Technology (IJIRCST), ISSN (Online): 2347-5552, Volume-12, Issue-4, Pages 52 - 58, 2024, DOI: 10.55524/ijircst.2024.12.4.9 DOI: https://doi.org/10.55524/ijircst.2024.12.4.9

L. Gao, X. Liu, and Q. Zhang, "A Survey of Hand Gesture Recognition Techniques Using Wearable Sensors and Computer Vision Methods," Sensors, vol. 20, no. 19, pp. 5671, Sep. 2020, doi:10.3390/s20195671 DOI: https://doi.org/10.3390/s20195671

Y. Perwej, Majzoob K. Omer, Osama E. Sheta, Hani Ali M. Harb, Mohmed S. Adrees, “The Future of Internet of Things (IoT) and Its Empowering Technology” , International Journal of Engineering Science and Computing (IJESC), ISSN : 2321- 3361, Volume 9, Issue No.3, Pages 20192– 20203, March 2019

H. Chung, Y. Chung and W Tsai, "An efficient hand gesture recognition system based on deep CNN", Proceedings of the 2019 IEEE International Conference on Industrial Technology (ICIT), pp. 853-858, 13–15 February 2019 DOI: https://doi.org/10.1109/ICIT.2019.8755038

Ye, Y., Tian, Y., Huenerfauth, M., & Liu, J. (2018). Recognizing American Sign Language Gestures from Within Continuous Videos. 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2145-214509, IEEE DOI: https://doi.org/10.1109/CVPRW.2018.00280

Apoorva Dwivedi, Dr. Basant Ballabh Dumka, Dr. Nikhat Akhtar, Ms Farah Shan, Y. Perwej, “Tropical Convolutional Neural Networks (TCNNs) Based Methods for Breast Cancer Diagnosis International Journal of Scientific Research in Science and Technology (IJSRST), Print ISSN: 2395-6011, Online ISSN: 2395-602X, Volume 10, Issue 3, Pages 1100 -1116, 2023, DOI: 10.32628/IJSRST523103183 DOI: https://doi.org/10.32628/IJSRST523103183

Y. Perwej, “Recurrent Neural Network Method in Arabic Words Recognition System”, International Journal of Computer Science and Telecommunications (IJCST), Sysbase Solution (Ltd), UK, London, (http://www.ijcst.org) , ISSN 2047-3338, Volume 3, Issue 11, Pages 43-48, 2012

S. Tanaka, A. Okazaki, N. Kato, H. Hino and K. Fukui, "Spotting fingerspelled words from sign language video by temporally regularized canonical component analysis", Proc. IEEE Int. Conf. Identity Secur. Behav. Anal., pp. 1-7, 2016 DOI: https://doi.org/10.1109/ISBA.2016.7477238

Cao Dong, Ming C. Leu and Zhao Zheng Yin, American Sign Language alphabet recognition using Microsoft Kinect, IEEE, June 2015 DOI: https://doi.org/10.1109/CVPRW.2015.7301347

M. Van den Bergh and L. Van Gool, "Combining RGB and ToF cameras for real-time 3D hand gesture interaction", 2011 IEEE workshop on applications of computer vision (WACV), pp. 66-72, 2011 DOI: https://doi.org/10.1109/WACV.2011.5711485

Y. Perwej, Firoj Parwej, Asif Perwej, “Copyright Protection of Digital Images Using Robust Watermarking Based on Joint DLT and DWT ”, International Journal of Scientific & Engineering Research (IJSER), France, ISSN 2229-5518, Volume 3, Issue 6, Pages 1- 9, 2012

Mahmoud AbouGhaly, Y. Perwej, Mumdouh Mirghani Mohamed Hassan, Dr. Nikhat Akhtar, “Smart Sensors and Intelligent Systems: Applications in Engineering Monitoring” , International Journal of Intelligent Systems and Applications in Engineering, SCOPUS, ISSN: 2147-6799, Volume 12, Issue 22s, Pages 720–727, 2024

W. Shang, K. Sohn, D. Almeida and H. Lee, "Understanding and improving convolutional neural networks via concatenated rectified linear units", International Conference on Machine Learning, pp. 2217-2225, 2016

G. Strezoski, D. Stojanovski, I. Dimitrovski and G. Madjarov, "Hand gesture recognition using deep convolutional neural networks", ICT Innovations 2016: Cognitive Functions and Next Generation ICT Systems, pp. 49-58, 2018 DOI: https://doi.org/10.1007/978-3-319-68855-8_5

B. A. Skourt, A. El Hassani and A. Majda, "Mixed-pooling-dropout for convolutional neural network regularization", Journal of King Saud University-Computer and Information Sciences, vol. 34, no. 8, pp. 4756-4762, 2022 DOI: https://doi.org/10.1016/j.jksuci.2021.05.001

Guillaume Plouffe and Ana-Maria Cretu, "Static and Dynamic Hand Gesture Recognition in Depth Data Using Dynamic Time Warping", IEEE Trans. Instru. & Measurement, vol. 65, no. 2, Feb 2016. DOI: https://doi.org/10.1109/TIM.2015.2498560

S. S. Kakkoth and S. Gharge, "Real Time Hand Gesture Recognition & its Applications in Assistive Technologies for Disabled," 2018 Fourth International Conference on Computing Communication Control and Automation (ICCUBEA), Pune, India, 2018, pp. 1-6 DOI: https://doi.org/10.1109/ICCUBEA.2018.8697363

W. J. Wisener, J. D. Rodriguez, A. Ovando, C. Woolford and K. Patel, "A Top-View Hand Gesture Recognition System for IoT Applications," 2023 5th International Conference on Smart Systems and Inventive Technology (ICSSIT), Tirunelveli, India, pp. 430-434, 2023 DOI: https://doi.org/10.1109/ICSSIT55814.2023.10060969