A Novel Art Gesture Recognition Model Based on Two Channel Region-Based Convolution Neural Network for Explainable Human-computer Interaction Understanding

Pingping Li1 and Lu Zhao2

  1. School of Fine Arts, Zhengzhou Normal University
    450000 Zhengzhou, China
    910675024@qq.com
  2. School of Fine Arts, Yulin Normal University
    537000 Yulin, China
    zhaoluvip@163.com

Abstract

The application development of hot technology is both an opportunity and a challenge. The vision-based gesture recognition rate is low and real-time performance is poor, so various algorithms need to be studied to improve the accuracy and speed of recognition. In this paper, we propose a novel gesture recognition based on two channel region-based convolution neural network for explainable human-computer interaction understanding. The input gesture image is extracted through two mutually independent channels. The two channels have convolution kernel with different scales, which can extract the features of different scales in the input image, and then carry out feature fusion at the fully connection layer. Finally, it is classified by the softmax classifier. The two-channel convolutional neural network model is proposed to solve the problem of insufficient feature extraction by the convolution kernel. Experimental results of gesture recognition on public data sets NTU and VIVA show that the proposed algorithm can effectively avoid the over-fitting problem of training models, and has higher recognition accuracy and stronger robustness than traditional algorithms.

Key words

explainable human-computer interaction understanding, two channel region-based convolution neural network, gesture recognition, softmax classifier, feature fusion

Digital Object Identifier (DOI)

https://doi.org/10.2298/CSIS220322037L

Publication information

Volume 19, Issue 3 (September 2022)
Year of Publication: 2022
ISSN: 1820-0214 (Print) 2406-1018 (Online)
Publisher: ComSIS Consortium

Full text

DownloadAvailable in PDF
Portable Document Format

How to cite

Li, P., Zhao, L.: A Novel Art Gesture Recognition Model Based on Two Channel Region-Based Convolution Neural Network for Explainable Human-computer Interaction Understanding. Computer Science and Information Systems, Vol. 19, No. 3, 1371-1388. (2022), https://doi.org/10.2298/CSIS220322037L