Open Access. Powered by Scholars. Published by Universities.®

Engineering Commons

Open Access. Powered by Scholars. Published by Universities.®

PDF

Journal

2024

DRL

Articles 1 - 3 of 3

Full-Text Articles in Engineering

Research On Motion Planning Of Hexapod Robot Based On Drl And Free Gait, Xinpeng Wang, Huiqiao Fu, Guizhou Deng, Kaiqiang Tang, Chunlin Chen, Canghao Liu Feb 2024

Research On Motion Planning Of Hexapod Robot Based On Drl And Free Gait, Xinpeng Wang, Huiqiao Fu, Guizhou Deng, Kaiqiang Tang, Chunlin Chen, Canghao Liu

Journal of System Simulation

Abstract: To improve the passability and the motion performance of the hexapod robot in the unstructured environment, a multi-contact motion planning algorithm based on DRL and free gait planner is proposed. Firstly, the free gait planner obtains the reachable footholds under the target state and outputs the optimal gait sequence. The center of mass motion policy of the hexapod robot in the randomly generated plum blossom pile environment is obtained by using deep reinforcement learning training. To ensure the reachability between adjacent states of the robot in motion, the state transition feasibility model is used to judge the state transition …


Efficiency Optimization Method For Data Sampling In Power Grid Topology Scheduling Simulation, Yingying Zhao, Pusen Dong, Tianchen Zhu, Fan Li, Yun Su, Zhenying Tai, Qingyun Sun, Hang Fan Feb 2024

Efficiency Optimization Method For Data Sampling In Power Grid Topology Scheduling Simulation, Yingying Zhao, Pusen Dong, Tianchen Zhu, Fan Li, Yun Su, Zhenying Tai, Qingyun Sun, Hang Fan

Journal of System Simulation

Abstract: To address the large simulation computational workload and low simulation speed caused by the scale and complexity of the new power system, a simulation acceleration method for topology scheduling based on the distributed and quantization mechanisms is proposed. The parallelization of topology scheduling models is used to increase the scale of data simulation sampling in unit time. The introduced quantization operators accelerate the computation speed of the topology scheduling model operators, reduces the time cost of the every single simulation. Case studies confirm the effectiveness of the topology simulation acceleration, in which the available transfer capacity of the simulated …


Flipper Control Method For Tracked Robot Based On Deep Reinforcement Learning, Hainan Pan, Bailiang Chen, Kaihong Huang, Junkai Ren, Chuang Cheng, Huimin Lu, Hui Zhang Feb 2024

Flipper Control Method For Tracked Robot Based On Deep Reinforcement Learning, Hainan Pan, Bailiang Chen, Kaihong Huang, Junkai Ren, Chuang Cheng, Huimin Lu, Hui Zhang

Journal of System Simulation

Abstract: Tracked robots with flippers have certain terrain adaptation capabilities. To improve the intelligent operation level of robots in complex environments, it is significant to realize the flipper autonomously control. Combining the expert experience in obstacle crossing and optimization indicators, Markov decision process(MDP) modeling of the robot's flipper control problem is carried out and a simulation training environment based on physics simulation engine Pymunk is built. A deep reinforcement learning control algorithm based on dueling double DQN(D3QN) network is proposed for controlling the flippers. With terrain information and robot state as the input and the four flippers' angle as the …