Open Access. Powered by Scholars. Published by Universities.®
Articles 1 - 2 of 2
Full-Text Articles in Engineering
On The Impact Of Gravity Compensation On Reinforcement Learning In Goal-Reaching Tasks For Robotic Manipulators, Jonathan Fugal, Hasan A. Poonawala, Jihye Bae
On The Impact Of Gravity Compensation On Reinforcement Learning In Goal-Reaching Tasks For Robotic Manipulators, Jonathan Fugal, Hasan A. Poonawala, Jihye Bae
Electrical and Computer Engineering Faculty Publications
Advances in machine learning technologies in recent years have facilitated developments in autonomous robotic systems. Designing these autonomous systems typically requires manually specified models of the robotic system and world when using classical control-based strategies, or time consuming and computationally expensive data-driven training when using learning-based strategies. Combination of classical control and learning-based strategies may mitigate both requirements. However, the performance of the combined control system is not obvious given that there are two separate controllers. This paper focuses on one such combination, which uses gravity-compensation together with reinforcement learning (RL). We present a study of the effects of gravity …
A Tutorial On Learning Human Welder's Behavior: Sensing, Modeling, And Control, Y. K. Liu, W. J. Zhang, Yu Ming Zhang
A Tutorial On Learning Human Welder's Behavior: Sensing, Modeling, And Control, Y. K. Liu, W. J. Zhang, Yu Ming Zhang
Electrical and Computer Engineering Faculty Publications
Human welder's experiences and skills are critical for producing quality welds in manual GTAW process. Learning human welder's behavior can help develop next generation intelligent welding machines and train welders faster. In this tutorial paper, various aspects of mechanizing the welder's intelligence are surveyed, including sensing of the weld pool, modeling of the welder's adjustments and this model-based control approach. Specifically, different sensing methods of the weld pool are reviewed and a novel 3D vision-based sensing system developed at University of Kentucky is introduced. Characterization of the weld pool is performed and human intelligent model is constructed, including an extensive …