TY - GEN
T1 - The Development of Mobile Application for Object Recognition Based on Deep Learning to Assist People with Visually Impaired
AU - Sari, Brilianti Puspita
AU - Sholikah, Rizka Wakhidatus
AU - Ginardi, Raden Venantius Hari
N1 - Publisher Copyright:
© 2024 IEEE.
PY - 2024
Y1 - 2024
N2 - People with visual impairments often rely on tools like a white cane to assist them in their daily activities. They also use their sense of touch, hearing, and smell to navigate their surroundings. However, these tools and senses have limitations. For example, the sense of touch is ineffective for objects at a distance, while hearing and smell cannot identify all types of objects. Navigating new environments, such as unfamiliar outdoor areas, can be challenging and even dangerous for individuals with visual impairments due to the potential for collisions with moving objects. To address these challenges, our research aims to develop a mobile application that utilizes object recognition technology to assist people with visual impairments. The object recognition model is built using the SSD-MobileNet-vl architecture. Our experimental results demonstrate that the model can achieve a confidence level of more than 60% in real-time object detection. Additionally, the model's performance is influenced by the lighting conditions, with brighter conditions yielding better results than darker conditions for detecting moving objects.
AB - People with visual impairments often rely on tools like a white cane to assist them in their daily activities. They also use their sense of touch, hearing, and smell to navigate their surroundings. However, these tools and senses have limitations. For example, the sense of touch is ineffective for objects at a distance, while hearing and smell cannot identify all types of objects. Navigating new environments, such as unfamiliar outdoor areas, can be challenging and even dangerous for individuals with visual impairments due to the potential for collisions with moving objects. To address these challenges, our research aims to develop a mobile application that utilizes object recognition technology to assist people with visual impairments. The object recognition model is built using the SSD-MobileNet-vl architecture. Our experimental results demonstrate that the model can achieve a confidence level of more than 60% in real-time object detection. Additionally, the model's performance is influenced by the lighting conditions, with brighter conditions yielding better results than darker conditions for detecting moving objects.
KW - assistive technology
KW - mobileNet
KW - object recognition
KW - real-time
KW - visual impairment
UR - https://www.scopus.com/pages/publications/85216123235
U2 - 10.1109/ISITDI62380.2024.10796984
DO - 10.1109/ISITDI62380.2024.10796984
M3 - Conference contribution
AN - SCOPUS:85216123235
T3 - 2nd International Symposium on Information Technology and Digital Innovation: Creative Trends in Sustainable Information Technology Design and Innovation, ISITDI 2024
SP - 222
EP - 227
BT - 2nd International Symposium on Information Technology and Digital Innovation
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 2nd International Symposium on Information Technology and Digital Innovation, ISITDI 2024
Y2 - 24 July 2024 through 25 July 2024
ER -