Design of Interface Module on Service Robot for Identification of Human Voice Direction

Muhammad Attamimi, Gilbert Evan Prabowo, Hendra Kusuma, Ditya Garda Nugraha

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

A domestic service robot (DSR) must have the ability to communicate with humans, such as understanding human instructions and responding appropriately, to interact with them. In this study, an interface module is developed to facilitate the human-robot interaction. The module consists of a camera that acts as an image processing sensor, a microphone array to collect the human voice, a speaker to output the robot voice, and an embedded computer to process the data. In this paper, we assign a task to conduct the interaction between humans and robots using the developed interface module. The assigned task is to detect the source of the sound and move in the direction of the detected sound and validate whether the sound is from a human or not. To do that, first, we estimate the direction of the sound collected from a microphone array. Next, a servo motor controlled by an Arduino Nano is used to direct the robot according to the sound coming. Then, face detection is performed on captured images from the camera to finalize the direction as well as check the human. Thanks to the servo motor, we can move the robot to the final position. To evaluate the interface module, we conducted experiments in an empty room-sized 2 × 2 m^2. The distance between the sound source and the developed module is one meter. Here, the accuracy for speech recognition and the direction of the sound were 85.34 %, 86.66%, respectively. The face detection required a minimum distance of 20 cm from the camera. Moreover, we discovered that the resolution of the coverage direction of the sound is 45 degrees.

Original languageEnglish
Title of host publication2023 International Seminar on Intelligent Technology and Its Applications
Subtitle of host publicationLeveraging Intelligent Systems to Achieve Sustainable Development Goals, ISITIA 2023 - Proceeding
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages222-227
Number of pages6
ISBN (Electronic)9798350313956
DOIs
Publication statusPublished - 2023
Event24th International Seminar on Intelligent Technology and Its Applications, ISITIA 2023 - Hybrid, Surabaya, Indonesia
Duration: 26 Jul 202327 Jul 2023

Publication series

Name2023 International Seminar on Intelligent Technology and Its Applications: Leveraging Intelligent Systems to Achieve Sustainable Development Goals, ISITIA 2023 - Proceeding

Conference

Conference24th International Seminar on Intelligent Technology and Its Applications, ISITIA 2023
Country/TerritoryIndonesia
CityHybrid, Surabaya
Period26/07/2327/07/23

Keywords

  • domestic service robot
  • face detection
  • technological capabilities
  • voice direction

Fingerprint

Dive into the research topics of 'Design of Interface Module on Service Robot for Identification of Human Voice Direction'. Together they form a unique fingerprint.

Cite this