Engineering Commons^™

On The Impact Of Gravity Compensation On Reinforcement Learning In Goal-Reaching Tasks For Robotic Manipulators, Jonathan Fugal, Hasan A. Poonawala, Jihye Bae

Electrical and Computer Engineering Faculty Publications

Advances in machine learning technologies in recent years have facilitated developments in autonomous robotic systems. Designing these autonomous systems typically requires manually specified models of the robotic system and world when using classical control-based strategies, or time consuming and computationally expensive data-driven training when using learning-based strategies. Combination of classical control and learning-based strategies may mitigate both requirements. However, the performance of the combined control system is not obvious given that there are two separate controllers. This paper focuses on one such combination, which uses gravity-compensation together with reinforcement learning (RL). We present a study of the effects of gravity …

A Tutorial On Learning Human Welder's Behavior: Sensing, Modeling, And Control, Y. K. Liu, W. J. Zhang, Yu Ming Zhang

Electrical and Computer Engineering Faculty Publications

Human welder's experiences and skills are critical for producing quality welds in manual GTAW process. Learning human welder's behavior can help develop next generation intelligent welding machines and train welders faster. In this tutorial paper, various aspects of mechanizing the welder's intelligence are surveyed, including sensing of the weld pool, modeling of the welder's adjustments and this model-based control approach. Specifically, different sensing methods of the weld pool are reviewed and a novel 3D vision-based sensing system developed at University of Kentucky is introduced. Characterization of the weld pool is performed and human intelligent model is constructed, including an extensive …

A Survey Of Electronic Environmental Controllers, Richard S. Gates, Douglas G. Overhults, Larry W. Turner

Biosystems and Agricultural Engineering Faculty Publications

Sixteen commercially available electronic environmental controllers were evaluated. The units were classified according to enclosure type, analog versus microprocessor based control, power supply, sensors, alarms, control relays and triac output, interval timers, outside temperature feedback, and retail price. An assessment of these controllers indicated several critical limitations in the application of this technology.

The use of integrated controllers for animal production has the potential for substantial improvements in production efficiencies. If the limitations observed in the present controller technology, as represented by this sample, are addressed, industry acceptance of the technology can be accelerated. A uniform standard to address this …