TY - GEN
T1 - Path Planning Based on Deep Reinforcement Learning Towards Human-Robot Collaboration
AU - Febrianto, Rokhmat
AU - Muhtadin,
AU - Ketut Eddy Purnama, I.
AU - Purnomo, Mauridhi Hery
N1 - Publisher Copyright:
© 2022 IEEE.
PY - 2022
Y1 - 2022
N2 - Visual navigation is required for many robotics applications, ranging from mobile robotics for movement manipulation to automated driving. One of the visual navigation technologies that are often used is path planning. This method considers a way to find a valid configuration sequence to move from the starting point to the destination point. Deep reinforcement learning (DRL) provides a mapless trainable approach by integrating path planning, localization and image processing in a single module. Therefore the approach can be optimized for a specific environment. However, DRL-based navigation is mostly validated in a simple simulation environment with a size that is not too large. Therefore, we propose a new visual navigation architecture method using deep reinforcement learning. We have designed a realistic simulation framework that resembles a room's state with several models of goods in it. Agents in the simulator will carry out the learning process by applying deep reinforcement learning to path planning with the support of A2C network, LSTM and auxiliary tasks. We evaluated the agent's method in a simulation framework conducted 10 times, and each experiment was carried out in 1000 randomly generated environments. Training takes about 18 hours on a single GPU. The result is that in the broader simulation environment, our method has a success rate of 99.81% in finding the destination of a given image. These results make the proposed method can be applied to a broader environment and this approach can be used towards human-robot collaboration.
AB - Visual navigation is required for many robotics applications, ranging from mobile robotics for movement manipulation to automated driving. One of the visual navigation technologies that are often used is path planning. This method considers a way to find a valid configuration sequence to move from the starting point to the destination point. Deep reinforcement learning (DRL) provides a mapless trainable approach by integrating path planning, localization and image processing in a single module. Therefore the approach can be optimized for a specific environment. However, DRL-based navigation is mostly validated in a simple simulation environment with a size that is not too large. Therefore, we propose a new visual navigation architecture method using deep reinforcement learning. We have designed a realistic simulation framework that resembles a room's state with several models of goods in it. Agents in the simulator will carry out the learning process by applying deep reinforcement learning to path planning with the support of A2C network, LSTM and auxiliary tasks. We evaluated the agent's method in a simulation framework conducted 10 times, and each experiment was carried out in 1000 randomly generated environments. Training takes about 18 hours on a single GPU. The result is that in the broader simulation environment, our method has a success rate of 99.81% in finding the destination of a given image. These results make the proposed method can be applied to a broader environment and this approach can be used towards human-robot collaboration.
KW - Deep reinforcement learning
KW - path planning
KW - vision-based navigation
UR - http://www.scopus.com/inward/record.url?scp=85139693132&partnerID=8YFLogxK
U2 - 10.1109/IES55876.2022.9888708
DO - 10.1109/IES55876.2022.9888708
M3 - Conference contribution
AN - SCOPUS:85139693132
T3 - IES 2022 - 2022 International Electronics Symposium: Energy Development for Climate Change Solution and Clean Energy Transition, Proceeding
SP - 466
EP - 471
BT - IES 2022 - 2022 International Electronics Symposium
A2 - Yunanto, Andhik Ampuh
A2 - Prayogi, Yanuar Risah
A2 - Putra, Putu Agus Mahadi
A2 - Hermawan, Hendhi
A2 - Nailussa'ada, Nailussa'ada
A2 - Ruswiansari, Maretha
A2 - Ridwan, Mohamad
A2 - Gamar, Farida
A2 - Ramadhani, Afifah Dwi
A2 - Rahmawati, Weny Mistarika
A2 - Rusli, Muhammad Rizani
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 24th International Electronics Symposium, IES 2022
Y2 - 9 August 2022 through 11 August 2022
ER -