Grounding new words on the physical world in multi-domain human-robot dialogues

Mikio Nakano*, Naoto Iwahashi, Takayuki Nagai, Taisuke Sumii, Xiang Zuo, Ryo Taguchi, Takashi Nose, Akira Mizutani, Tomoaki Nakamura, Muhanmad Attamim, Hiromi Narimatsu, Kotaro Funakoshi, Yuji Hasegawa

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

10 Citations (Scopus)


This paper summarizes our ongoing project on developing an architecture for a robot that can acquire new words and their meanings while engaging in multidomain dialogues. These two functions are crucial in making conversational service robots work in real tasks in the real world. Household robots and office robots need to be able to work in multiple task domains and they also need to engage in dialogues in multiple domains corresponding to those task domains. Lexical acquisition is necessary because speech understanding cannot be done without enough knowledge on words that are possibly spoken in the task domain. Our architecture is based on a multi-expert model in which multiple domain experts are employed and one of them is selected based on the user utterance and the situation to engage in the control of the dialogue and physical behaviors. We incorporate experts that have an ability to acquire new lexical entries and their meanings grounded on the physical world through spoken interactions. By appropriately selecting those experts, lexical acquisition in multi-domain dialogues becomes possible. An example robotic system based on this architecture that can acquire object names and location names demonstrates the viability of the architecture.

Original languageEnglish
Title of host publicationDialog with Robots - Papers from the AAAI Fall Symposium, Technical Report
PublisherAI Access Foundation
Number of pages6
ISBN (Print)9781577354871
Publication statusPublished - 2010
Externally publishedYes
Event2010 AAAI Fall Symposium - Arlington, United States
Duration: 11 Nov 201013 Nov 2010

Publication series

NameAAAI Fall Symposium - Technical Report


Conference2010 AAAI Fall Symposium
Country/TerritoryUnited States


Dive into the research topics of 'Grounding new words on the physical world in multi-domain human-robot dialogues'. Together they form a unique fingerprint.

Cite this