Gesture recognition using combination of acceleration sensor and images for casual communication between robots and humans

Y. Yamazaki; H. A. Vu; P. Q. Le; Z. Liu; C. Fatichah; M. Dai; H. Oikawa; D. Masano; O. Thet; Y. Tang; N. Nagashima; M. L. Tangel; F. Dong; K. Hirota

doi:10.1109/CEC.2010.5586268

Gesture recognition using combination of acceleration sensor and images for casual communication between robots and humans

Y. Yamazaki^*, H. A. Vu, P. Q. Le, Z. Liu, C. Fatichah, M. Dai, H. Oikawa, D. Masano, O. Thet, Y. Tang, N. Nagashima, M. L. Tangel, F. Dong, K. Hirota

^*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

13 Citations (Scopus)

Abstract

A fuzzy logic based multi-modal gesture recognition method is proposed, where both camera images and hand motion data (given by a 3D acceleration sensor put on human wrists) are used to notify the emotion of humans to robots in real time. To demonstrate the validity, it is applied to a part of the home party scenario enjoyed by five eye robots and four human participants, where 8 types of human emotional-gestures are successfully recognized by robots. The proposed method aims to realize the casual communication between robots and humans in the mascot robot system that has been developed by authors' group.

Original language	English
Title of host publication	2010 IEEE World Congress on Computational Intelligence, WCCI 2010 - 2010 IEEE Congress on Evolutionary Computation, CEC 2010
DOIs	https://doi.org/10.1109/CEC.2010.5586268
Publication status	Published - 2010
Externally published	Yes
Event	2010 6th IEEE World Congress on Computational Intelligence, WCCI 2010 - 2010 IEEE Congress on Evolutionary Computation, CEC 2010 - Barcelona, Spain Duration: 18 Jul 2010 → 23 Jul 2010

Publication series

Name	2010 IEEE World Congress on Computational Intelligence, WCCI 2010 - 2010 IEEE Congress on Evolutionary Computation, CEC 2010

Conference

Conference	2010 6th IEEE World Congress on Computational Intelligence, WCCI 2010 - 2010 IEEE Congress on Evolutionary Computation, CEC 2010
Country/Territory	Spain
City	Barcelona
Period	18/07/10 → 23/07/10

Access to Document

10.1109/CEC.2010.5586268

Cite this

Yamazaki, Y., Vu, H. A., Le, P. Q., Liu, Z., Fatichah, C., Dai, M., Oikawa, H., Masano, D., Thet, O., Tang, Y., Nagashima, N., Tangel, M. L., Dong, F., & Hirota, K. (2010). Gesture recognition using combination of acceleration sensor and images for casual communication between robots and humans. In 2010 IEEE World Congress on Computational Intelligence, WCCI 2010 - 2010 IEEE Congress on Evolutionary Computation, CEC 2010 Article 5586268 (2010 IEEE World Congress on Computational Intelligence, WCCI 2010 - 2010 IEEE Congress on Evolutionary Computation, CEC 2010). https://doi.org/10.1109/CEC.2010.5586268

Yamazaki, Y. ; Vu, H. A. ; Le, P. Q. et al. / Gesture recognition using combination of acceleration sensor and images for casual communication between robots and humans. 2010 IEEE World Congress on Computational Intelligence, WCCI 2010 - 2010 IEEE Congress on Evolutionary Computation, CEC 2010. 2010. (2010 IEEE World Congress on Computational Intelligence, WCCI 2010 - 2010 IEEE Congress on Evolutionary Computation, CEC 2010).

@inproceedings{ca924b0b119240baace98cc9cc5bfa42,

title = "Gesture recognition using combination of acceleration sensor and images for casual communication between robots and humans",

abstract = "A fuzzy logic based multi-modal gesture recognition method is proposed, where both camera images and hand motion data (given by a 3D acceleration sensor put on human wrists) are used to notify the emotion of humans to robots in real time. To demonstrate the validity, it is applied to a part of the home party scenario enjoyed by five eye robots and four human participants, where 8 types of human emotional-gestures are successfully recognized by robots. The proposed method aims to realize the casual communication between robots and humans in the mascot robot system that has been developed by authors' group.",

author = "Y. Yamazaki and Vu, {H. A.} and Le, {P. Q.} and Z. Liu and C. Fatichah and M. Dai and H. Oikawa and D. Masano and O. Thet and Y. Tang and N. Nagashima and Tangel, {M. L.} and F. Dong and K. Hirota",

year = "2010",

doi = "10.1109/CEC.2010.5586268",

language = "English",

isbn = "9781424469109",

series = "2010 IEEE World Congress on Computational Intelligence, WCCI 2010 - 2010 IEEE Congress on Evolutionary Computation, CEC 2010",

booktitle = "2010 IEEE World Congress on Computational Intelligence, WCCI 2010 - 2010 IEEE Congress on Evolutionary Computation, CEC 2010",

note = "2010 6th IEEE World Congress on Computational Intelligence, WCCI 2010 - 2010 IEEE Congress on Evolutionary Computation, CEC 2010 ; Conference date: 18-07-2010 Through 23-07-2010",

}

Yamazaki, Y, Vu, HA, Le, PQ, Liu, Z, Fatichah, C, Dai, M, Oikawa, H, Masano, D, Thet, O, Tang, Y, Nagashima, N, Tangel, ML, Dong, F & Hirota, K 2010, Gesture recognition using combination of acceleration sensor and images for casual communication between robots and humans. in 2010 IEEE World Congress on Computational Intelligence, WCCI 2010 - 2010 IEEE Congress on Evolutionary Computation, CEC 2010., 5586268, 2010 IEEE World Congress on Computational Intelligence, WCCI 2010 - 2010 IEEE Congress on Evolutionary Computation, CEC 2010, 2010 6th IEEE World Congress on Computational Intelligence, WCCI 2010 - 2010 IEEE Congress on Evolutionary Computation, CEC 2010, Barcelona, Spain, 18/07/10. https://doi.org/10.1109/CEC.2010.5586268

Gesture recognition using combination of acceleration sensor and images for casual communication between robots and humans. / Yamazaki, Y.; Vu, H. A.; Le, P. Q. et al.
2010 IEEE World Congress on Computational Intelligence, WCCI 2010 - 2010 IEEE Congress on Evolutionary Computation, CEC 2010. 2010. 5586268 (2010 IEEE World Congress on Computational Intelligence, WCCI 2010 - 2010 IEEE Congress on Evolutionary Computation, CEC 2010).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Gesture recognition using combination of acceleration sensor and images for casual communication between robots and humans

AU - Yamazaki, Y.

AU - Vu, H. A.

AU - Le, P. Q.

AU - Liu, Z.

AU - Fatichah, C.

AU - Dai, M.

AU - Oikawa, H.

AU - Masano, D.

AU - Thet, O.

AU - Tang, Y.

AU - Nagashima, N.

AU - Tangel, M. L.

AU - Dong, F.

AU - Hirota, K.

PY - 2010

Y1 - 2010

N2 - A fuzzy logic based multi-modal gesture recognition method is proposed, where both camera images and hand motion data (given by a 3D acceleration sensor put on human wrists) are used to notify the emotion of humans to robots in real time. To demonstrate the validity, it is applied to a part of the home party scenario enjoyed by five eye robots and four human participants, where 8 types of human emotional-gestures are successfully recognized by robots. The proposed method aims to realize the casual communication between robots and humans in the mascot robot system that has been developed by authors' group.

AB - A fuzzy logic based multi-modal gesture recognition method is proposed, where both camera images and hand motion data (given by a 3D acceleration sensor put on human wrists) are used to notify the emotion of humans to robots in real time. To demonstrate the validity, it is applied to a part of the home party scenario enjoyed by five eye robots and four human participants, where 8 types of human emotional-gestures are successfully recognized by robots. The proposed method aims to realize the casual communication between robots and humans in the mascot robot system that has been developed by authors' group.

UR - http://www.scopus.com/inward/record.url?scp=79959412055&partnerID=8YFLogxK

U2 - 10.1109/CEC.2010.5586268

DO - 10.1109/CEC.2010.5586268

M3 - Conference contribution

AN - SCOPUS:79959412055

SN - 9781424469109

T3 - 2010 IEEE World Congress on Computational Intelligence, WCCI 2010 - 2010 IEEE Congress on Evolutionary Computation, CEC 2010

BT - 2010 IEEE World Congress on Computational Intelligence, WCCI 2010 - 2010 IEEE Congress on Evolutionary Computation, CEC 2010

T2 - 2010 6th IEEE World Congress on Computational Intelligence, WCCI 2010 - 2010 IEEE Congress on Evolutionary Computation, CEC 2010

Y2 - 18 July 2010 through 23 July 2010

ER -

Yamazaki Y, Vu HA, Le PQ, Liu Z, Fatichah C, Dai M et al. Gesture recognition using combination of acceleration sensor and images for casual communication between robots and humans. In 2010 IEEE World Congress on Computational Intelligence, WCCI 2010 - 2010 IEEE Congress on Evolutionary Computation, CEC 2010. 2010. 5586268. (2010 IEEE World Congress on Computational Intelligence, WCCI 2010 - 2010 IEEE Congress on Evolutionary Computation, CEC 2010). doi: 10.1109/CEC.2010.5586268

Gesture recognition using combination of acceleration sensor and images for casual communication between robots and humans

Abstract

Publication series

Conference

Access to Document

Other files and links

Fingerprint

Cite this