The Development of Mobile Application for Object Recognition Based on Deep Learning to Assist People with Visually Impaired

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

People with visual impairments often rely on tools like a white cane to assist them in their daily activities. They also use their sense of touch, hearing, and smell to navigate their surroundings. However, these tools and senses have limitations. For example, the sense of touch is ineffective for objects at a distance, while hearing and smell cannot identify all types of objects. Navigating new environments, such as unfamiliar outdoor areas, can be challenging and even dangerous for individuals with visual impairments due to the potential for collisions with moving objects. To address these challenges, our research aims to develop a mobile application that utilizes object recognition technology to assist people with visual impairments. The object recognition model is built using the SSD-MobileNet-vl architecture. Our experimental results demonstrate that the model can achieve a confidence level of more than 60% in real-time object detection. Additionally, the model's performance is influenced by the lighting conditions, with brighter conditions yielding better results than darker conditions for detecting moving objects.

Original languageEnglish
Title of host publication2nd International Symposium on Information Technology and Digital Innovation
Subtitle of host publicationCreative Trends in Sustainable Information Technology Design and Innovation, ISITDI 2024
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages222-227
Number of pages6
ISBN (Electronic)9798350389241
DOIs
Publication statusPublished - 2024
Event2nd International Symposium on Information Technology and Digital Innovation, ISITDI 2024 - Hybrid, Bukittinggi, Indonesia
Duration: 24 Jul 202425 Jul 2024

Publication series

Name2nd International Symposium on Information Technology and Digital Innovation: Creative Trends in Sustainable Information Technology Design and Innovation, ISITDI 2024

Conference

Conference2nd International Symposium on Information Technology and Digital Innovation, ISITDI 2024
Country/TerritoryIndonesia
CityHybrid, Bukittinggi
Period24/07/2425/07/24

Keywords

  • assistive technology
  • mobileNet
  • object recognition
  • real-time
  • visual impairment

Fingerprint

Dive into the research topics of 'The Development of Mobile Application for Object Recognition Based on Deep Learning to Assist People with Visually Impaired'. Together they form a unique fingerprint.

Cite this