Gesture recognition using combination of acceleration sensor and images for casual communication between robots and humans

Y. Yamazaki; H. A. Vu; P. Q. Le; Z. Liu; C. Fatichah; M. Dai; H. Oikawa; D. Masano; O. Thet; Y. Tang; N. Nagashima; M. L. Tangel; F. Dong; K. Hirota

doi:10.1109/CEC.2010.5586268

Gesture recognition using combination of acceleration sensor and images for casual communication between robots and humans

Y. Yamazaki^*
, H. A. Vu
, P. Q. Le
, Z. Liu
, C. Fatichah
, M. Dai
, H. Oikawa
, D. Masano
, O. Thet
, Y. Tang
, N. Nagashima
, M. L. Tangel
, F. Dong
, K. Hirota

^*Corresponding author for this work

Kanto Gakuin University
Department of Computational Intelligence and Systems Science, Tokyo Institute of Technology

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

13 Citations (Scopus)

Abstract

A fuzzy logic based multi-modal gesture recognition method is proposed, where both camera images and hand motion data (given by a 3D acceleration sensor put on human wrists) are used to notify the emotion of humans to robots in real time. To demonstrate the validity, it is applied to a part of the home party scenario enjoyed by five eye robots and four human participants, where 8 types of human emotional-gestures are successfully recognized by robots. The proposed method aims to realize the casual communication between robots and humans in the mascot robot system that has been developed by authors' group.

Original language	English
Title of host publication	2010 IEEE World Congress on Computational Intelligence, WCCI 2010 - 2010 IEEE Congress on Evolutionary Computation, CEC 2010
Publisher	IEEE Computer Society
ISBN (Print)	9781424469109
DOIs	https://doi.org/10.1109/CEC.2010.5586268
Publication status	Published - 2010
Externally published	Yes

Publication series

Name	2010 IEEE World Congress on Computational Intelligence, WCCI 2010 - 2010 IEEE Congress on Evolutionary Computation, CEC 2010

Access to Document

10.1109/CEC.2010.5586268

Cite this

Yamazaki, Y., Vu, H. A., Le, P. Q., Liu, Z., Fatichah, C., Dai, M., Oikawa, H., Masano, D., Thet, O., Tang, Y., Nagashima, N., Tangel, M. L., Dong, F., & Hirota, K. (2010). Gesture recognition using combination of acceleration sensor and images for casual communication between robots and humans. In 2010 IEEE World Congress on Computational Intelligence, WCCI 2010 - 2010 IEEE Congress on Evolutionary Computation, CEC 2010 Article 5586268 (2010 IEEE World Congress on Computational Intelligence, WCCI 2010 - 2010 IEEE Congress on Evolutionary Computation, CEC 2010). IEEE Computer Society. https://doi.org/10.1109/CEC.2010.5586268

Yamazaki, Y. ; Vu, H. A. ; Le, P. Q. et al. / Gesture recognition using combination of acceleration sensor and images for casual communication between robots and humans. 2010 IEEE World Congress on Computational Intelligence, WCCI 2010 - 2010 IEEE Congress on Evolutionary Computation, CEC 2010. IEEE Computer Society, 2010. (2010 IEEE World Congress on Computational Intelligence, WCCI 2010 - 2010 IEEE Congress on Evolutionary Computation, CEC 2010).

@inproceedings{ca924b0b119240baace98cc9cc5bfa42,

title = "Gesture recognition using combination of acceleration sensor and images for casual communication between robots and humans",

abstract = "A fuzzy logic based multi-modal gesture recognition method is proposed, where both camera images and hand motion data (given by a 3D acceleration sensor put on human wrists) are used to notify the emotion of humans to robots in real time. To demonstrate the validity, it is applied to a part of the home party scenario enjoyed by five eye robots and four human participants, where 8 types of human emotional-gestures are successfully recognized by robots. The proposed method aims to realize the casual communication between robots and humans in the mascot robot system that has been developed by authors' group.",

author = "Y. Yamazaki and Vu, \{H. A.\} and Le, \{P. Q.\} and Z. Liu and C. Fatichah and M. Dai and H. Oikawa and D. Masano and O. Thet and Y. Tang and N. Nagashima and Tangel, \{M. L.\} and F. Dong and K. Hirota",

year = "2010",

doi = "10.1109/CEC.2010.5586268",

language = "English",

isbn = "9781424469109",

series = "2010 IEEE World Congress on Computational Intelligence, WCCI 2010 - 2010 IEEE Congress on Evolutionary Computation, CEC 2010",

publisher = "IEEE Computer Society",

booktitle = "2010 IEEE World Congress on Computational Intelligence, WCCI 2010 - 2010 IEEE Congress on Evolutionary Computation, CEC 2010",

address = "United States",

}

Yamazaki, Y, Vu, HA, Le, PQ, Liu, Z, Fatichah, C, Dai, M, Oikawa, H, Masano, D, Thet, O, Tang, Y, Nagashima, N, Tangel, ML, Dong, F & Hirota, K 2010, Gesture recognition using combination of acceleration sensor and images for casual communication between robots and humans. in 2010 IEEE World Congress on Computational Intelligence, WCCI 2010 - 2010 IEEE Congress on Evolutionary Computation, CEC 2010., 5586268, 2010 IEEE World Congress on Computational Intelligence, WCCI 2010 - 2010 IEEE Congress on Evolutionary Computation, CEC 2010, IEEE Computer Society. https://doi.org/10.1109/CEC.2010.5586268

Gesture recognition using combination of acceleration sensor and images for casual communication between robots and humans. / Yamazaki, Y.; Vu, H. A.; Le, P. Q. et al.
2010 IEEE World Congress on Computational Intelligence, WCCI 2010 - 2010 IEEE Congress on Evolutionary Computation, CEC 2010. IEEE Computer Society, 2010. 5586268 (2010 IEEE World Congress on Computational Intelligence, WCCI 2010 - 2010 IEEE Congress on Evolutionary Computation, CEC 2010).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Gesture recognition using combination of acceleration sensor and images for casual communication between robots and humans

AU - Yamazaki, Y.

AU - Vu, H. A.

AU - Le, P. Q.

AU - Liu, Z.

AU - Fatichah, C.

AU - Dai, M.

AU - Oikawa, H.

AU - Masano, D.

AU - Thet, O.

AU - Tang, Y.

AU - Nagashima, N.

AU - Tangel, M. L.

AU - Dong, F.

AU - Hirota, K.

PY - 2010

Y1 - 2010

N2 - A fuzzy logic based multi-modal gesture recognition method is proposed, where both camera images and hand motion data (given by a 3D acceleration sensor put on human wrists) are used to notify the emotion of humans to robots in real time. To demonstrate the validity, it is applied to a part of the home party scenario enjoyed by five eye robots and four human participants, where 8 types of human emotional-gestures are successfully recognized by robots. The proposed method aims to realize the casual communication between robots and humans in the mascot robot system that has been developed by authors' group.

AB - A fuzzy logic based multi-modal gesture recognition method is proposed, where both camera images and hand motion data (given by a 3D acceleration sensor put on human wrists) are used to notify the emotion of humans to robots in real time. To demonstrate the validity, it is applied to a part of the home party scenario enjoyed by five eye robots and four human participants, where 8 types of human emotional-gestures are successfully recognized by robots. The proposed method aims to realize the casual communication between robots and humans in the mascot robot system that has been developed by authors' group.

UR - https://www.scopus.com/pages/publications/79959412055

U2 - 10.1109/CEC.2010.5586268

DO - 10.1109/CEC.2010.5586268

M3 - Conference contribution

AN - SCOPUS:79959412055

SN - 9781424469109

T3 - 2010 IEEE World Congress on Computational Intelligence, WCCI 2010 - 2010 IEEE Congress on Evolutionary Computation, CEC 2010

BT - 2010 IEEE World Congress on Computational Intelligence, WCCI 2010 - 2010 IEEE Congress on Evolutionary Computation, CEC 2010

PB - IEEE Computer Society

ER -

Yamazaki Y, Vu HA, Le PQ, Liu Z, Fatichah C, Dai M et al. Gesture recognition using combination of acceleration sensor and images for casual communication between robots and humans. In 2010 IEEE World Congress on Computational Intelligence, WCCI 2010 - 2010 IEEE Congress on Evolutionary Computation, CEC 2010. IEEE Computer Society. 2010. 5586268. (2010 IEEE World Congress on Computational Intelligence, WCCI 2010 - 2010 IEEE Congress on Evolutionary Computation, CEC 2010). doi: 10.1109/CEC.2010.5586268

Gesture recognition using combination of acceleration sensor and images for casual communication between robots and humans

Abstract

Publication series

Access to Document

Other files and links

Fingerprint

Cite this