Multimodal gesture recognition based on choquet integral

K. Hirota; H. A. Vu; P. Q. Le; C. Fatichah; Z. Liu; Y. Tang; M. L. Tangel; Z. Mu; B. Sun; F. Yan; D. Masano; O. Thet; M. Yamaguchi; F. Dong; Y. Yamazaki

doi:10.1109/FUZZY.2011.6007382

Multimodal gesture recognition based on choquet integral

K. Hirota^*
, H. A. Vu
, P. Q. Le
, C. Fatichah
, Z. Liu
, Y. Tang
, M. L. Tangel
, Z. Mu
, B. Sun
, F. Yan
, D. Masano
, O. Thet
, M. Yamaguchi
, F. Dong
, Y. Yamazaki

^*Corresponding author for this work

Department Computational Intelligence and Systems Science
Department of Computational Intelligence and Systems Science, Tokyo Institute of Technology
Dept. of Electrical
Kanto Gakuin University

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

3 Citations (Scopus)

Abstract

A multimodal gesture recognition method is proposed based on Choquet integral by fusing information from camera and 3D accelerometer data. By calculating the optimal fuzzy measures for the camera recognition module and the accelerometer recognition module, the proposal obtains enough recognition rate 92.7% in average for 8 types of gestures by improving the recognition rate approximate 20% compared to that of each module. The proposed method aims to realize the casual communication from humans to robots by integrating nonverbal gesture messages and verbal messages.

Original language	English
Title of host publication	FUZZ 2011 - 2011 IEEE International Conference on Fuzzy Systems - Proceedings
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	772-776
Number of pages	5
ISBN (Print)	9781424473175
DOIs	https://doi.org/10.1109/FUZZY.2011.6007382
Publication status	Published - 2011
Externally published	Yes

Publication series

Name	IEEE International Conference on Fuzzy Systems
ISSN (Print)	1098-7584

Keywords

3D Accelerometer
Choquet Integral
Gesture Recognition
Human-Robot Interaction
Sensor Fusion

Access to Document

10.1109/FUZZY.2011.6007382

Cite this

Hirota, K., Vu, H. A., Le, P. Q., Fatichah, C., Liu, Z., Tang, Y., Tangel, M. L., Mu, Z., Sun, B., Yan, F., Masano, D., Thet, O., Yamaguchi, M., Dong, F., & Yamazaki, Y. (2011). Multimodal gesture recognition based on choquet integral. In FUZZ 2011 - 2011 IEEE International Conference on Fuzzy Systems - Proceedings (pp. 772-776). Article 6007382 (IEEE International Conference on Fuzzy Systems). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/FUZZY.2011.6007382

@inproceedings{aa4e07f840614893b58be8bb40a6f831,

title = "Multimodal gesture recognition based on choquet integral",

abstract = "A multimodal gesture recognition method is proposed based on Choquet integral by fusing information from camera and 3D accelerometer data. By calculating the optimal fuzzy measures for the camera recognition module and the accelerometer recognition module, the proposal obtains enough recognition rate 92.7\% in average for 8 types of gestures by improving the recognition rate approximate 20\% compared to that of each module. The proposed method aims to realize the casual communication from humans to robots by integrating nonverbal gesture messages and verbal messages.",

keywords = "3D Accelerometer, Choquet Integral, Gesture Recognition, Human-Robot Interaction, Sensor Fusion",

author = "K. Hirota and Vu, \{H. A.\} and Le, \{P. Q.\} and C. Fatichah and Z. Liu and Y. Tang and Tangel, \{M. L.\} and Z. Mu and B. Sun and F. Yan and D. Masano and O. Thet and M. Yamaguchi and F. Dong and Y. Yamazaki",

year = "2011",

doi = "10.1109/FUZZY.2011.6007382",

language = "English",

isbn = "9781424473175",

series = "IEEE International Conference on Fuzzy Systems",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "772--776",

booktitle = "FUZZ 2011 - 2011 IEEE International Conference on Fuzzy Systems - Proceedings",

address = "United States",

}

Hirota, K, Vu, HA, Le, PQ, Fatichah, C, Liu, Z, Tang, Y, Tangel, ML, Mu, Z, Sun, B, Yan, F, Masano, D, Thet, O, Yamaguchi, M, Dong, F & Yamazaki, Y 2011, Multimodal gesture recognition based on choquet integral. in FUZZ 2011 - 2011 IEEE International Conference on Fuzzy Systems - Proceedings., 6007382, IEEE International Conference on Fuzzy Systems, Institute of Electrical and Electronics Engineers Inc., pp. 772-776. https://doi.org/10.1109/FUZZY.2011.6007382

Multimodal gesture recognition based on choquet integral. / Hirota, K.; Vu, H. A.; Le, P. Q. et al.
FUZZ 2011 - 2011 IEEE International Conference on Fuzzy Systems - Proceedings. Institute of Electrical and Electronics Engineers Inc., 2011. p. 772-776 6007382 (IEEE International Conference on Fuzzy Systems).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Multimodal gesture recognition based on choquet integral

AU - Hirota, K.

AU - Vu, H. A.

AU - Le, P. Q.

AU - Fatichah, C.

AU - Liu, Z.

AU - Tang, Y.

AU - Tangel, M. L.

AU - Mu, Z.

AU - Sun, B.

AU - Yan, F.

AU - Masano, D.

AU - Thet, O.

AU - Yamaguchi, M.

AU - Dong, F.

AU - Yamazaki, Y.

PY - 2011

Y1 - 2011

N2 - A multimodal gesture recognition method is proposed based on Choquet integral by fusing information from camera and 3D accelerometer data. By calculating the optimal fuzzy measures for the camera recognition module and the accelerometer recognition module, the proposal obtains enough recognition rate 92.7% in average for 8 types of gestures by improving the recognition rate approximate 20% compared to that of each module. The proposed method aims to realize the casual communication from humans to robots by integrating nonverbal gesture messages and verbal messages.

AB - A multimodal gesture recognition method is proposed based on Choquet integral by fusing information from camera and 3D accelerometer data. By calculating the optimal fuzzy measures for the camera recognition module and the accelerometer recognition module, the proposal obtains enough recognition rate 92.7% in average for 8 types of gestures by improving the recognition rate approximate 20% compared to that of each module. The proposed method aims to realize the casual communication from humans to robots by integrating nonverbal gesture messages and verbal messages.

KW - 3D Accelerometer

KW - Choquet Integral

KW - Gesture Recognition

KW - Human-Robot Interaction

KW - Sensor Fusion

UR - https://www.scopus.com/pages/publications/80053078402

U2 - 10.1109/FUZZY.2011.6007382

DO - 10.1109/FUZZY.2011.6007382

M3 - Conference contribution

AN - SCOPUS:80053078402

SN - 9781424473175

T3 - IEEE International Conference on Fuzzy Systems

SP - 772

EP - 776

BT - FUZZ 2011 - 2011 IEEE International Conference on Fuzzy Systems - Proceedings

PB - Institute of Electrical and Electronics Engineers Inc.

ER -

Multimodal gesture recognition based on choquet integral

Abstract

Publication series

Keywords

Access to Document

Other files and links

Fingerprint

Cite this