Hand Gesture Recognition Based on Keypoint Vector

Heru Arwoko, Eko Mulyanto Yuniarno, Mauridhi Hery Purnomo

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

1 Citation (Scopus)

Abstract

Human-computer interaction (HCI) is usually associated with using popular input devices such as a mouse or keyboard. In other cases hand gestures can actually be useful for human-computer interaction when hand gestures are needed to make the game controls more interesting. There are three basic controls as input mouse: move, click, and drag. Hand gestures and hand shape are different for each person. This becomes a problem during automatic recognition. Recent research has proven the success of the Deep Neural Network (DNN) for representation and high accuracy in hand gesture recognition. DNN algorithms can study complex and nonlinear relationships between features by applying multiple layers. This paper proposes hand feature based on the normalized keypoint vector using DNN. The model was trained on 2250 hand datasets which were divided into 3 classes to identify the mouse movement. The network design uses multilayer with neuron sizes (13, 12, 15, 14) with 500 epochs and achieves the best accuracy of 98.5% for normalized features. The important work in this research is the use of keypoint vector from hand gestures as features to be fed to the DNN to achieve good accuracy.

Original languageEnglish
Title of host publicationIES 2022 - 2022 International Electronics Symposium
Subtitle of host publicationEnergy Development for Climate Change Solution and Clean Energy Transition, Proceeding
EditorsAndhik Ampuh Yunanto, Yanuar Risah Prayogi, Putu Agus Mahadi Putra, Hendhi Hermawan, Nailussa'ada Nailussa'ada, Maretha Ruswiansari, Mohamad Ridwan, Farida Gamar, Afifah Dwi Ramadhani, Weny Mistarika Rahmawati, Muhammad Rizani Rusli
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages530-533
Number of pages4
ISBN (Electronic)9781665489713
DOIs
Publication statusPublished - 2022
Event24th International Electronics Symposium, IES 2022 - Surabaya, Indonesia
Duration: 9 Aug 202211 Aug 2022

Publication series

NameIES 2022 - 2022 International Electronics Symposium: Energy Development for Climate Change Solution and Clean Energy Transition, Proceeding

Conference

Conference24th International Electronics Symposium, IES 2022
Country/TerritoryIndonesia
CitySurabaya
Period9/08/2211/08/22

Keywords

  • Deep Neural Network
  • Hand Gesture Recognition
  • Keypoint
  • Normalized Vector

Fingerprint

Dive into the research topics of 'Hand Gesture Recognition Based on Keypoint Vector'. Together they form a unique fingerprint.

Cite this