Engineering Commons^™

Structure-Aware Image Translation-Based Long Future Prediction For Enhancement Of Ground Robotic Vehicle Teleoperation, Md Moniruzzaman, Alexander Rassau, Douglas Chai, Syed M. S. Islam

Research outputs 2022 to 2026

Predicting future frames through image-to-image translation and using these synthetically generated frames for high-speed ground vehicle teleoperation is a new concept to address latency and enhance operational performance. In the immediate previous work, the image quality of the predicted frames was low and a lot of scene detail was lost. To preserve the structural details of objects and improve overall image quality in the predicted frames, several novel ideas are proposed herein. A filter has been designed to remove noise from dense optical flow components resulting from frame rate inconsistencies. The Pix2Pix base network has been modified and a structure-aware …