TY - GEN
T1 - Target Localization for Robotic Arm Grasping Based on Deep Reinforcement Learning
AU - Tang, Xiaoyun
AU - Liu, Tong
AU - Wang, Xuelin
AU - SŁadkowski, Aleksander
AU - Zheng, Jianghua
AU - Baigunchekov, Zhumadil
N1 - Publisher Copyright:
© 2026 IEEE.
PY - 2026
Y1 - 2026
N2 - To address unstable target localization, insufficient end-effector alignment accuracy, and policy convergence difficulties when robotic arms perform grasping tasks in multi-distractor scenarios, this paper proposes a target localization method for robotic arms based on Proximal Policy Optimization (PPO). First, a PyBullet simulation platform is established, and a FAIRINO FR3 robotic arm simulation environment with random distractors is constructed. The target approach process of the robotic arm is modeled as a Markov Decision Process (MDP). Then, to reduce misalignment caused by distractors during target approach, a 10-dimensional state space with end-effector geometric center compensation is designed, and a composite reward function is optimized, including differential distance guidance, pose normal vector constraints, and a distractor false-hovering penalty. Finally, combined with the PPO algorithm using large-batch parallel sampling, the convergence and stability of the policy network are improved. Simulation results show that the proposed policy enables the robotic arm to align with the target object smoothly and stably while effectively reducing misalignment with random distractors, verifying its feasibility in random distractor scenarios.
AB - To address unstable target localization, insufficient end-effector alignment accuracy, and policy convergence difficulties when robotic arms perform grasping tasks in multi-distractor scenarios, this paper proposes a target localization method for robotic arms based on Proximal Policy Optimization (PPO). First, a PyBullet simulation platform is established, and a FAIRINO FR3 robotic arm simulation environment with random distractors is constructed. The target approach process of the robotic arm is modeled as a Markov Decision Process (MDP). Then, to reduce misalignment caused by distractors during target approach, a 10-dimensional state space with end-effector geometric center compensation is designed, and a composite reward function is optimized, including differential distance guidance, pose normal vector constraints, and a distractor false-hovering penalty. Finally, combined with the PPO algorithm using large-batch parallel sampling, the convergence and stability of the policy network are improved. Simulation results show that the proposed policy enables the robotic arm to align with the target object smoothly and stably while effectively reducing misalignment with random distractors, verifying its feasibility in random distractor scenarios.
KW - deep reinforcement learning
KW - PPO algorithm
KW - PyBullet
KW - target localization
UR - https://www.scopus.com/pages/publications/105048967572
U2 - 10.1109/EEI70303.2026.11640700
DO - 10.1109/EEI70303.2026.11640700
M3 - Conference contribution
AN - SCOPUS:105048967572
T3 - 2026 8th International Conference on Electronic Engineering and Informatics, EEI 2026
SP - 707
EP - 710
BT - 2026 8th International Conference on Electronic Engineering and Informatics, EEI 2026
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 8th International Conference on Electronic Engineering and Informatics, EEI 2026
Y2 - 26 June 2026 through 28 June 2026
ER -