Hand Gesture Recognition Based on Continuous Wave (CW) Radar Using Principal Component Analysis (PCA) and K-Nearest Neighbor (KNN) Methods

Muhammad Khairani Abdul Rahman - Microwave Research Institute, Universiti Teknologi MARA, 40450 Shah Alam, Selangor, Malaysia
Nur Emileen Abdul Rashid - Microwave Research Institute, Universiti Teknologi MARA, 40450 Shah Alam, Selangor, Malaysia
Nor Najwa Ismail - Microwave Research Institute, Universiti Teknologi MARA, 40450 Shah Alam, Selangor, Malaysia
Nor Ayu Zalina Zakaria - School of Electrical Engineering, College of Engineering, Universiti Teknologi MARA, 40450 Shah Alam, Selangor, Malaysia
Zuhani Ismail Khan - Microwave Research Institute, Universiti Teknologi MARA, 40450 Shah Alam, Selangor, Malaysia
Siti Amalina Enche Ab Rahim - School of Electrical Engineering, College of Engineering, Universiti Teknologi MARA, 40450 Shah Alam, Selangor, Malaysia
Farah Nadia Mohd Isa - Microwave Communication & Information System Engineering (MCISE), Department of Electrical & Computer Engineering, Kuliyyah of Engineering, International Islamic University Malaysia (IIUM), 53100, Kuala Lumpur, Malaysia


Citation Format:



DOI: http://dx.doi.org/10.30630/joiv.6.1-2.926

Abstract


Human-computer interaction (HCI) is a field of study studying how people and computers interact. One of the most critical branches of HCI is hand gesture recognition, with most research concentrating on a single direction. A slight change in the angle of hand gestures might cause the motion to be misclassified, thereby degrading the performance of hand gesture detection. Therefore, to improve the accuracy of hand gesture detection, this paper focuses on analyzing hand gestures based on the reflected signals from two directions, which are front and side views. The radar system employed in this paper is equipped with two sets of 24 GHz continuous wave (CW) monostatic radar sensors with a sampling rate of 44.1 kHz. Four different hand gestures, namely close hand, open hand, OK sign, and pointing down, are collected using SignalViewer software. The data is stored as a waveform audio file format (WAV) where one data consists of 20 segments, and the data is then examined by using MATLAB software to be segmented. To evaluate the effectiveness of the classification system, principal component analysis (PCA) and k-nearest neighbor (KNN) are integrated. The PCA findings are depicted in Pareto and 2-D scatter plot for both radar directions. The Leave-One-Out (LOO) method is then used in this analysis to verify the accuracy of the classification method, which is represented in the confusion matrix. At the end of the analysis, the classification results indicated that both angles achieved near-perfect accuracy for most hand gestures.

Keywords


Hand gesture recognition; machine learning; classification; KNN; PCA.

Full Text:

PDF

References


N. Alnaim, M. Abbod, and A. Albar, “Hand Gesture Recognition Using Convolutional Neural Network for People Who Have Experienced a Stroke,†2019 3rd International Symposium on Multidisciplinary Studies and Innovative Technologies (ISMSIT), pp. 1–6, 2019.

W. J. Li, C. Y. Hsieh, L. F. Lin, and W. C. Chu, “Hand gesture recognition for post-stroke rehabilitation using leap motion,†2017 International Conference on Applied System Innovation (ICASI), pp. 386–388, 2017.

Y. Wang, A. Ren, M. Zhou, W. Wang, and X. Yang, “A novel detection and recognition method for continuous hand gesture using FMCW radar,†IEEE Access, vol. 8, pp. 167264–167275, 2020.

C. Zhu and W. Sheng, “Wearable sensor-based hand gesture and daily activity recognition for robot-assisted living,†IEEE Trans. Syst. Man, Cybern. Part ASystems Humans, vol. 41, no. 3, pp. 569–573, 2011.

G. Yuan, X. Liu, Q. Yan, S. Qiao, Z. Wang, and L. Yuan, “Hand Gesture Recognition Using Deep Feature Fusion Network Based on Wearable Sensors,†IEEE Sens. J., vol. 21, no. 1, pp. 539–547, 2020.

A. Moin et al., “A wearable biosensing system with in-sensor adaptive machine learning for hand gesture recognition,†Nat. Electron., vol. 4, no. 1, pp. 54–63, 2021.

F. Chen et al., “WristCam: A Wearable Sensor for Hand Trajectory Gesture Recognition and Intelligent Human-Robot Interaction,†IEEE Sens. J., vol. 19, no. 19, pp. 8441–8451, 2018.

Z. Lu, X. Chen, Q. Li, X. Zhang, and P. Zhou, “A hand gesture recognition framework and wearable gesture-based interaction prototype for mobile devices,†IEEE Trans. Human-Machine Syst., vol. 44, no. 2, pp. 293–299, 2014.

S. Hazra and A. Santra, “Robust Gesture Recognition Using Millimetric-Wave Radar System,†IEEE Sensors Letters, vol. 2, no. 4, pp. 1–4, 2018.

P. Goswami, S. Rao, S. Bharadwaj, and A. Nguyen, “Real-Time Multi-Gesture Recognition using 77 GHz FMCW MIMO Single Chip Radar,†2019 IEEE International Conference on Consumer Electronics (ICCE), pp. 1–4, 2019.

X. Q. Hrqj et al., “Dynamic vision sensor camera based bare hand gesture recognition,†in 2011 IEEE Symposium On Computational Intelligence for Multimedia, Signal and Vision Processing, 2011, pp. 52–59.

G. Chen et al., “A Novel Illumination-Robust Hand Gesture Recognition System with Event-Based Neuromorphic Vision Sensor,†IEEE Trans. Autom. Sci. Eng., vol. 18, no. 2, pp. 508–520, 2021.

S. Zhou et al., “2D human gesture tracking and recognition by the fusion of MEMS inertial and vision sensors,†IEEE Sens. J., vol. 14, no. 4, pp. 1160–1170, 2013.

L. Baraldi, F. Paci, G. Serra, L. Benini, and R. Cucchiara, “Gesture recognition using wearable vision sensors to enhance visitors’ museum experiences,†IEEE Sens. J., vol. 15, no. 5, pp. 2705–2714, 2015.

J. Lee et al., “Live demonstration: Gesture-based remote control using stereo pair of dynamic vision sensors,†in 2012 IEEE International Symposium on Circuits and Systems, 2012, pp. 742–745.

J. H. Lee, P. K. J. Park, C. Shin, H. Ryu, B. C. Kang, and T. Delbruck, “Touchless hand gesture UI with instantaneous responses,†in 2012 19th IEEE International Conference on Image Processing, 2012, pp. 1957–1960.

S. Skaria, A. Al-Hourani, M. Lech, and R. J. Evans, “Hand-Gesture Recognition Using Two-Antenna Doppler Radar with Deep Convolutional Neural Networks,†IEEE Sensors Journal, vol. 19, no. 8, pp. 3041–3048, 2019.

Y. Kim and B. Toomajian, “Hand Gesture Recognition Using Micro-Doppler Signatures with Convolutional Neural Network,†IEEE Access, vol. 4, pp. 7125–7130, 2016.

T. Fan et al., “Wireless Hand Gesture Recognition Based on Continuous-Wave Doppler Radar Sensors,†IEEE Trans. Microw. Theory Tech., vol. 64, no. 11, pp. 4012–4020, 2016.

J. Zhang, J. Tao, and Z. Shi, “Doppler-radar based hand gesture recognition system using convolutional neural networks,†in International Conference in Communications, Signal Processing, and Systems, 2017, pp. 1096–1113.

Y. Kim and B. Toomajian, “Application of Doppler radar for the recognition of hand gestures using optimized deep convolutional neural networks,†in 2017 11th European Conference on Antennas and Propagation (EUCAP), 2017, pp. 1258–1260.

Z. Chen, G. Li, F. Fioranelli, and H. Griffiths, “Dynamic hand gesture classification based on multistatic radar micro-Doppler signatures,†in 2016 CIE International Conference on Radar (RADAR), 2016, pp. 1–4.

M. G. Amin, Z. Zeng, and T. Shan, “Hand gesture recognition based on radar micro-doppler signature envelopes,†in 2019 IEEE Radar Conference (RadarConf), 2019, pp. 1–6.

G. Li, R. Zhang, M. Ritchie, and H. Griffiths, “Sparsity-Driven Micro-Doppler Feature Extraction for Dynamic Hand Gesture Recognition,†IEEE Trans. Aerosp. Electron. Syst., vol. 54, no. 2, pp. 655–665, 2017.

Z. Wang, G. Li, and L. Yang, “Dynamic Hand Gesture Recognition Based on Micro-Doppler Radar Signatures Using Hidden Gauss-Markov Models,†IEEE Geosci. Remote Sens. Lett., vol. 18, no. 2, pp. 291–295, 2020.

C. Zheng, T. Hu, S. Qiao, Y. Sun, J. Huangfu, and L. Ran, “Doppler bio-signal detection based time-domain hand gesture recognition,†in 2013 IEEE Mtt-S International Microwave Workshop Series on Rf and Wireless Technologies for Biomedical and Healthcare Applications (Imws-Bio), 2013, pp. 34–36.

G. Li, R. Zhang, M. Ritchie, and H. Griffiths, “Sparsity-based dynamic hand gesture recognition using micro-Doppler signatures,†in 2017 IEEE Radar Conference (RadarConf), 2017, pp. 0928–0931.

A. Bannon, R. Capraro, and M. Ritchie, “Exploring gesture recognition with low-cost CW radar modules in comparison to FMCW architectures,†2020 IEEE International Radar Conference (RADAR), pp. 744–748, 2020.

S. Skaria, A. Al-Hourani, and R. J. Evans, “Deep-learning methods for hand-gesture recognition using ultra-wideband radar,†IEEE Access, vol. 8, pp. 203580–203590, 2020.

N. A. Zakaria, Z. Ali Shah, and S. Kasim, “Protein Structure Prediction Using Robust Principal Component Analysis and Support Vector Machine,†Int. J. Data Sci., vol. 1, no. 1, pp. 14–17, 2020.

N. S. Sani, I. I. S. Shamsuddin, S. Sahran, A. H. A. Rahman, and E. N. Muzaffar, “Redefining selection of features and classification algorithms for room occupancy detection,†Int. J. Adv. Sci. Eng. Inf. Technol., vol. 8, no. 4–2, pp. 1486–1493, 2018.

Y. Sun, T. Fei, F. Schliep, and N. Pohl, “Gesture Classification with Handcrafted Micro-Doppler Features using a FMCW Radar,†2018 IEEE MTT-S International Conference on Microwaves for Intelligent Mobility (ICMIM), pp. 1–4, 2018.

T. Sakamoto, X. Gao, E. Yavari, A. Rahman, O. Boric-Lubecke, and V. M. Lubecke, “Hand Gesture Recognition Using a Radar Echo I–Q Plot and a Convolutional Neural Network,†IEEE Sensors Letters, vol. 2, no. 3, pp. 1–4, 2018.