Multimodal gesture recognition based on choquet integral

K. Hirota; H. A. Vu; P. Q. Le; C. Fatichah; Z. Liu; Y. Tang; M. L. Tangel; Z. Mu; B. Sun; F. Yan; D. Masano; O. Thet; M. Yamaguchi; F. Dong; Y. Yamazaki

doi:10.1109/FUZZY.2011.6007382

Multimodal gesture recognition based on choquet integral

K. Hirota^*, H. A. Vu, P. Q. Le, C. Fatichah, Z. Liu, Y. Tang, M. L. Tangel, Z. Mu, B. Sun, F. Yan, D. Masano, O. Thet, M. Yamaguchi, F. Dong, Y. Yamazaki

^*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

3 Citations (Scopus)

Abstract

A multimodal gesture recognition method is proposed based on Choquet integral by fusing information from camera and 3D accelerometer data. By calculating the optimal fuzzy measures for the camera recognition module and the accelerometer recognition module, the proposal obtains enough recognition rate 92.7% in average for 8 types of gestures by improving the recognition rate approximate 20% compared to that of each module. The proposed method aims to realize the casual communication from humans to robots by integrating nonverbal gesture messages and verbal messages.

Original language	English
Title of host publication	FUZZ 2011 - 2011 IEEE International Conference on Fuzzy Systems - Proceedings
Pages	772-776
Number of pages	5
DOIs	https://doi.org/10.1109/FUZZY.2011.6007382
Publication status	Published - 2011
Externally published	Yes
Event	2011 IEEE International Conference on Fuzzy Systems, FUZZ 2011 - Taipei, Taiwan, Province of China Duration: 27 Jun 2011 → 30 Jun 2011

Publication series

Name	IEEE International Conference on Fuzzy Systems
ISSN (Print)	1098-7584

Conference

Conference	2011 IEEE International Conference on Fuzzy Systems, FUZZ 2011
Country/Territory	Taiwan, Province of China
City	Taipei
Period	27/06/11 → 30/06/11

Keywords

3D Accelerometer
Choquet Integral
Gesture Recognition
Human-Robot Interaction
Sensor Fusion

Access to Document

10.1109/FUZZY.2011.6007382

Cite this

Hirota, K., Vu, H. A., Le, P. Q., Fatichah, C., Liu, Z., Tang, Y., Tangel, M. L., Mu, Z., Sun, B., Yan, F., Masano, D., Thet, O., Yamaguchi, M., Dong, F., & Yamazaki, Y. (2011). Multimodal gesture recognition based on choquet integral. In FUZZ 2011 - 2011 IEEE International Conference on Fuzzy Systems - Proceedings (pp. 772-776). Article 6007382 (IEEE International Conference on Fuzzy Systems). https://doi.org/10.1109/FUZZY.2011.6007382

@inproceedings{aa4e07f840614893b58be8bb40a6f831,

title = "Multimodal gesture recognition based on choquet integral",

abstract = "A multimodal gesture recognition method is proposed based on Choquet integral by fusing information from camera and 3D accelerometer data. By calculating the optimal fuzzy measures for the camera recognition module and the accelerometer recognition module, the proposal obtains enough recognition rate 92.7% in average for 8 types of gestures by improving the recognition rate approximate 20% compared to that of each module. The proposed method aims to realize the casual communication from humans to robots by integrating nonverbal gesture messages and verbal messages.",

keywords = "3D Accelerometer, Choquet Integral, Gesture Recognition, Human-Robot Interaction, Sensor Fusion",

author = "K. Hirota and Vu, {H. A.} and Le, {P. Q.} and C. Fatichah and Z. Liu and Y. Tang and Tangel, {M. L.} and Z. Mu and B. Sun and F. Yan and D. Masano and O. Thet and M. Yamaguchi and F. Dong and Y. Yamazaki",

year = "2011",

doi = "10.1109/FUZZY.2011.6007382",

language = "English",

isbn = "9781424473175",

series = "IEEE International Conference on Fuzzy Systems",

pages = "772--776",

booktitle = "FUZZ 2011 - 2011 IEEE International Conference on Fuzzy Systems - Proceedings",

note = "2011 IEEE International Conference on Fuzzy Systems, FUZZ 2011 ; Conference date: 27-06-2011 Through 30-06-2011",

}

Hirota, K, Vu, HA, Le, PQ, Fatichah, C, Liu, Z, Tang, Y, Tangel, ML, Mu, Z, Sun, B, Yan, F, Masano, D, Thet, O, Yamaguchi, M, Dong, F & Yamazaki, Y 2011, Multimodal gesture recognition based on choquet integral. in FUZZ 2011 - 2011 IEEE International Conference on Fuzzy Systems - Proceedings., 6007382, IEEE International Conference on Fuzzy Systems, pp. 772-776, 2011 IEEE International Conference on Fuzzy Systems, FUZZ 2011, Taipei, Taiwan, Province of China, 27/06/11. https://doi.org/10.1109/FUZZY.2011.6007382

TY - GEN

T1 - Multimodal gesture recognition based on choquet integral

AU - Hirota, K.

AU - Vu, H. A.

AU - Le, P. Q.

AU - Fatichah, C.

AU - Liu, Z.

AU - Tang, Y.

AU - Tangel, M. L.

AU - Mu, Z.

AU - Sun, B.

AU - Yan, F.

AU - Masano, D.

AU - Thet, O.

AU - Yamaguchi, M.

AU - Dong, F.

AU - Yamazaki, Y.

PY - 2011

Y1 - 2011

N2 - A multimodal gesture recognition method is proposed based on Choquet integral by fusing information from camera and 3D accelerometer data. By calculating the optimal fuzzy measures for the camera recognition module and the accelerometer recognition module, the proposal obtains enough recognition rate 92.7% in average for 8 types of gestures by improving the recognition rate approximate 20% compared to that of each module. The proposed method aims to realize the casual communication from humans to robots by integrating nonverbal gesture messages and verbal messages.

AB - A multimodal gesture recognition method is proposed based on Choquet integral by fusing information from camera and 3D accelerometer data. By calculating the optimal fuzzy measures for the camera recognition module and the accelerometer recognition module, the proposal obtains enough recognition rate 92.7% in average for 8 types of gestures by improving the recognition rate approximate 20% compared to that of each module. The proposed method aims to realize the casual communication from humans to robots by integrating nonverbal gesture messages and verbal messages.

KW - 3D Accelerometer

KW - Choquet Integral

KW - Gesture Recognition

KW - Human-Robot Interaction

KW - Sensor Fusion

UR - http://www.scopus.com/inward/record.url?scp=80053078402&partnerID=8YFLogxK

U2 - 10.1109/FUZZY.2011.6007382

DO - 10.1109/FUZZY.2011.6007382

M3 - Conference contribution

AN - SCOPUS:80053078402

SN - 9781424473175

T3 - IEEE International Conference on Fuzzy Systems

SP - 772

EP - 776

BT - FUZZ 2011 - 2011 IEEE International Conference on Fuzzy Systems - Proceedings

T2 - 2011 IEEE International Conference on Fuzzy Systems, FUZZ 2011

Y2 - 27 June 2011 through 30 June 2011

ER -

Multimodal gesture recognition based on choquet integral

Abstract

Publication series

Conference

Keywords

Access to Document

Other files and links

Fingerprint

Cite this