Open Access. Powered by Scholars. Published by Universities.®

Engineering Commons

Open Access. Powered by Scholars. Published by Universities.®

Articles 1 - 2 of 2

Full-Text Articles in Engineering

Long Future Frame Prediction Using Optical Flow Informed Deep Neural Networks For Enhancement Of Robotic Teleoperation In High Latency Environments, Md Moniruzzaman, Alexander Rassau, Douglas Chai, Syed M. S. Islam Jan 2023

Long Future Frame Prediction Using Optical Flow Informed Deep Neural Networks For Enhancement Of Robotic Teleoperation In High Latency Environments, Md Moniruzzaman, Alexander Rassau, Douglas Chai, Syed M. S. Islam

Research outputs 2022 to 2026

High latency in teleoperation has a significant negative impact on operator performance. While deep learning has revolutionized many domains recently, it has not previously been applied to teleoperation enhancement. We propose a novel approach to predict video frames deep into the future using neural networks informed by synthetically generated optical flow information. This can be employed in teleoperated robotic systems that rely on video feeds for operator situational awareness. We have used the image-to-image translation technique as a basis for the prediction of future frames. The Pix2Pix conditional generative adversarial network (cGAN) has been selected as a base network. Optical …


Deep Learning Control For Digital Feedback Systems: Improved Performance With Robustness Against Parameter Change, Nuha A. S. Alwan, Zahir M. Hussain Jan 2021

Deep Learning Control For Digital Feedback Systems: Improved Performance With Robustness Against Parameter Change, Nuha A. S. Alwan, Zahir M. Hussain

Research outputs 2014 to 2021

Training data for a deep learning (DL) neural network (NN) controller are obtained from the input and output signals of a conventional digital controller that is designed to provide the suitable control signal to a specified plant within a feedback digital control system. It is found that if the DL controller is sufficiently deep (four hidden layers), it can outperform the conventional controller in terms of settling time of the system output transient response to a unit-step reference signal. That is, the DL controller introduces a damping effect. Moreover, it does not need to be retrained to operate with a …