Open Access. Powered by Scholars. Published by Universities.®

Robotics Commons™

Open Access. Powered by Scholars. Published by Universities.®

Electrical and Computer Engineering

Institution
Keyword
Publication Year
Publication
Publication Type
File Type

Articles 31 - 60 of 285

Full-Text Articles in Robotics

Orbital Maneuvers And Interplanetary Trajectory Design Via Reinforcement Learning, Roberto Cuéllar Rangel Aug 2025

Orbital Maneuvers And Interplanetary Trajectory Design Via Reinforcement Learning, Roberto Cuéllar Rangel

Doctoral Dissertations and Master's Theses

This dissertation investigates the application of reinforcement learning (RL) to the design and optimization of low-thrust spacecraft trajectories, with an emphasis on autonomy, adaptability, and robustness in the presence of system uncertainties and unmodeled perturbations. Classical approaches to low-thrust trajectory design are predominantly grounded in optimal control theory, which relies on the availability of precise dynamical models and often requires problem-specific reformulation and solver tuning. While optimal control methods offer high accuracy under deterministic conditions, their sensitivity to stochastic disturbances and computational limitations in highly nonlinear or uncertain environments pose significant challenges for future autonomous space missions.

To address these …


Low-Level Memory Attacks On Edge Assisted Robotic Applications, William Arnold Aug 2025

Low-Level Memory Attacks On Edge Assisted Robotic Applications, William Arnold

Master of Engineering Theses

This thesis investigates how low-level memory faults can undermine edge-assisted robotic systems that rely on memory optimization. As robots are utilized in real world applications, the ability to operate safely and successfully in mission critical deployment becomes important. To help achieve these goals, developers are increasingly starting to place computation nodes at network edges to meet latency and reliability requirements. Edge nodes, however, are resource-constrained and resources conservation techniques such as Kernel Same-page Merging (KSM) are enabled to deduplicate identical pages across processes or virtual machines. This thesis shows that this optimization technique quietly widens the attack surface and can …


Human Comfort Modeling, Measurement, And Improvement In Human–Robot Collaboration, Yuchen Yan Aug 2025

Human Comfort Modeling, Measurement, And Improvement In Human–Robot Collaboration, Yuchen Yan

All Dissertations

A dissertation is proposed to explore human comfort in human-robot collaboration (HRC) through modeling, prediction, and enhancement methodologies. Human comfort is a crucial yet underexplored factor in HRC, directly influencing task efficiency, trust, and overall collaboration effectiveness. Understanding the influential factors, developing computational models, and refining methods to improve human comfort in HRC are essential steps toward advancing the field of collaborative robotics. To address these challenges, multiple studies have been conducted. A series of experimental studies were performed to investigate how robot motion-based parameters affect human comfort in HRC. These studies examined both analytical comfort modeling approaches and physiological …


Development Of An Embedded Iot Board For Real-Time Floor Estimation Of Autonomous Robots, Carter J. Sorensen Jun 2025

Development Of An Embedded Iot Board For Real-Time Floor Estimation Of Autonomous Robots, Carter J. Sorensen

Electronic Theses and Dissertations

As service robots become more prevalent in multi-story environments such as hospitals, hotels, and laboratories, accurate floor-level detection is critical to ensuring operational reliability. Consider a robot tasked with delivering medical samples in a multi-story laboratory. Without accurate feedback, a robot exiting on the wrong floor could introduce delays, disrupt workflows, or compromise sample integrity. Internet of Things (IoT) technologies offer a way to address these risks by providing real-time error detection and corrective capability. However, current IoT-based floor estimation systems often require invasive modifications to building infrastructure—particularly elevator control panels. These approaches introduce challenges related to cost, liability, backward …


An Advanced Hexacopter For Autonomous Exploration Of Mars: Attitude Control And Navigation Strategies, Laura Sopegno Jun 2025

An Advanced Hexacopter For Autonomous Exploration Of Mars: Attitude Control And Navigation Strategies, Laura Sopegno

Electronic Theses and Dissertations

Mars exploration has recently witnessed major interest within the scientific community. Unmanned robotic platforms offer reliable solutions to acquire and collect data and information from the Red Planet. Particularly, rovers, landers, and orbiters have significantly shaped planetary exploration on the Moon and Mars, contributing significantly to past missions while also highlighting limitations in their capacity to cover diverse terrains over wide ranges. Given current advances in Unmanned Aircraft Systems (UASs), Unmanned Aerial Vehicles (UAVs) offer promising alternatives for future scientific missions.

It is argued that hexacopters, with their relatively compact design and redundancy, present a promising …


Spy Bot, Nathanael Bruce Farris Jun 2025

Spy Bot, Nathanael Bruce Farris

Computer Engineering

This project set out to develop a compact, mobile-controlled robotic platform designed for remote video surveillance and control via a smartphone. Using a Raspberry Pi as the core controller, the robot integrates a Flask-based server, HTML/JavaScript-based user interface, and an infrared-capable camera to provide real-time video streaming and directional control through a web browser. Key design challenges included managing power delivery, integrating motor control with live video, and modernizing web technologies to ensure smooth communication between client and server. The final system demonstrates a responsive and portable proof of concept that highlights the potential for future upgrades, such as night …


A Turtlebot3 Hardware Testbed For Distributed Kalman Filter Localization, Dmitri Dobrynin, Indigo T. Garcia Jun 2025

A Turtlebot3 Hardware Testbed For Distributed Kalman Filter Localization, Dmitri Dobrynin, Indigo T. Garcia

Electrical Engineering

This report presents the preliminary design for a distributed localization framework for a multi-robot system. Many robotics research papers provide simulations of proposed algorithms in regards to formation control and task allocation. However, it is often that these proposals are without hardware experiments, being limited only to simulation. The objective of this framework is to provide a hardware implementation of a distributed Kalman filtering algorithm for multi-agent localization, as well as provide grounds for future multi-agent experiments. The framework is implemented on a swarm of three Turtlebot3 mobile robots. The robots can accurately localize themselves with respect to other agents …


Framework For Multi-Agent Coordination And Distributed Localization In Micro-Uavs, Minwoo Park, Nikolas Tambornini Jun 2025

Framework For Multi-Agent Coordination And Distributed Localization In Micro-Uavs, Minwoo Park, Nikolas Tambornini

Electrical Engineering

Micro-UAVs (unmanned aerial vehicles) due to their inexpensive nature and compact form factor have shown an increase in prevalence throughout a multitude of applications including, but not limited to: search and rescue, military reconnaissance, and agriculture monitoring. However, for a majority of these high impact applications, a swarm of micro-UAVs are required and furthermore mandate that they are able to cooperatively and autonomously coordinate with each other. For long, controlling and communicating between a user and a singular micro-UAV has been a well known and solved problem, however the same can't be said for swarms of micro-UAVs. This project seeks …


Autonomous Mapping Rover, Garrett Jones, Timothy Kyle Chu, Eugenio Caruso Pasos Jun 2025

Autonomous Mapping Rover, Garrett Jones, Timothy Kyle Chu, Eugenio Caruso Pasos

Electrical Engineering

This report details the design, implementation, and evaluation of "Rovero," an autonomous mapping rover developed as a senior project. Rovero integrates state-of-the-art technologies, including ROS2 for communication, SLAM algorithms for mapping, and sensor fusion for accurate navigation. The project aimed to achieve robust autonomous operation in indoor environments, leveraging a combination of LiDAR, IMU, and encoder data for real-time decision-making. Key challenges addressed include path planning, obstacle avoidance, and integration of multiple sensor inputs. Results demonstrate successful mapping capabilities and efficient navigation performance.


Distributed Formation Control Of Nonholonomic Mobile Robots: Safety-Critical Leader-Follower Approach With Obstacle Avoidance And Dynamic Reconfiguration, Kelvin C. Villago Jun 2025

Distributed Formation Control Of Nonholonomic Mobile Robots: Safety-Critical Leader-Follower Approach With Obstacle Avoidance And Dynamic Reconfiguration, Kelvin C. Villago

Master's Theses

Networked control systems for multi-agent robotics have emerged as a critical paradigm for executing complex coordinated tasks in diverse environments. While formation control serves as the backbone of such systems, real-world deployment introduces significant challenges including communication constraints, environmental obstacles, and the need for adaptive reconfiguration. This research addresses these challenges by developing a novel unified framework that seamlessly integrates obstacle avoidance algorithms with dynamic formation reconfiguration capabilities, specifically designed for communication-limited networked control architectures. The proposed framework represents a significant advancement over existing approaches by simultaneously handling both static and dynamic obstacles while maintaining system cohesion under communication constraints. …


Gamified Gait Rehabilitation Via Real-Time Biofeedback And Adaptive Hip-Exoskeleton Control, Mariya Huzaifa Tohfafarosh May 2025

Gamified Gait Rehabilitation Via Real-Time Biofeedback And Adaptive Hip-Exoskeleton Control, Mariya Huzaifa Tohfafarosh

Theses

Gait impairments arise from systemic diseases, age-related degeneration, musculoskeletal dysfunctions, or neurological conditions. While traditional rehabilitation can be effective, they often face challenges such as high costs, inaccessibility, and low patient engagement. To address these challenges, my work introduces a virtual reality-based rehabilitation (VRBR) system, integrating real-time motion and electromyographic (EMG) muscle activation feedback with a gamified virtual environment for enhanced adaptability and engagement. The system includes a custom-designed hip-exoskeleton that provides adaptive spring-like assistance or resistance, supporting both mobility-impaired users and strength training. Assistance levels can be tuned to match the user's progress. Additionally, a custom pressure insole was …


Exploring The Limits Of Multimodal Foundation Models For Visual Temporal Reasoning And Gesture Recognition Tasks, Ziyao Shangguan May 2025

Exploring The Limits Of Multimodal Foundation Models For Visual Temporal Reasoning And Gesture Recognition Tasks, Ziyao Shangguan

Computer Science Theses

Multimodal foundation models (MFMs) have demonstrated impressive capabilities in static vision-language tasks such as image captioning, video summarization, and cross modal retrieval. However, their ability to reason over time—especially in gesture-rich video inputs—remains limited. This thesis investigates the temporal reasoning capabilities of MFMs in the context of gesture understanding, a critical component for enabling more expressive human-robot interaction. Through a preliminary study, we show that prompting-based strategies offer only marginal improvements in temporal reasoning, despite producing accurate frame-by-frame descriptions.

To more rigorously evaluate these limitations, we introduce TOMATO, a benchmark designed to assess visual …


Transfer Learning For Temporal Logic Objectives, Lucas M. Santana Rovira May 2025

Transfer Learning For Temporal Logic Objectives, Lucas M. Santana Rovira

McKelvey School of Engineering Graduate Student Theses & Dissertations

Reinforcement learning algorithms can enable autonomous systems to learn the control skills needed to accomplish a task specified by a linear temporal logic formula. However, they cannot be transferred to a new task, even when the two are very similar. For each new task, the policy must be redesigned from scratch, which is a common limitation of existing reinforcement learning methods for temporal logic tasks. A proposed solution to this problem leverages the similarity between past and new tasks to reuse already learned control skills to accomplish the new task, with minimal or no retraining.

Rather than learning a single …


Low Cost Additive Manufacturing Of Segmented Stator Composite Polymer Permanent Magnet Dc Motors, Ben Goldberg, Jordan Bailey, Connor Hawkins, Colin Haskins, Razvan Voicu Apr 2025

Low Cost Additive Manufacturing Of Segmented Stator Composite Polymer Permanent Magnet Dc Motors, Ben Goldberg, Jordan Bailey, Connor Hawkins, Colin Haskins, Razvan Voicu

Symposium of Student Scholars

This study presents a novel approach to the design, manufacture, and optimization of segmented stators for composite construction axial flux permanent magnet DC motors. Traditional axial flux stator manufacturing is both challenging and expensive, creating a bottleneck in rapid prototyping and innovation. To overcome these limitations, the stator is divided into individually fabricated segments using advanced composite polymer materials and low-cost additive manufacturing techniques. This segmentation not only drastically reduces production complexity and cost but also allows for customized coil geometries that maximize the surface area for improved heat dissipation.

A key innovation of our design is the integration of …


Clinical Use Of Sit2stand Ai Application For Kinematic Analysis In Prosthesis Users., Samerial Brown Apr 2025

Clinical Use Of Sit2stand Ai Application For Kinematic Analysis In Prosthesis Users., Samerial Brown

Posters - 2025

Biomechanical analysis is a tool to evaluate prosthetic and orthotic patient's. These tools offer the clinician capability of understanding the mechanism of injury, gait deviation or prosthesis problem. Video based analysis require expensive hardware, software, and training which sometimes costs $40-100,000.

The recent advent of artificial intelligence (AI) has opened up the possibility of acquiring high speed human motion video analysis using low-cost hardware and open-source machine learning algorithms. Still, free assessments like the Sit2Stand test is a current clinical outcome measure which assesses ability of a patient to stand and sit as fast as possible 5x. The faster the …


Swvl: A Custom Ai-Powered Face Tracking Camera Gimbal, Alexander J. Anderson-Mcleod, Jakub Jerzmanowski, Michael Laitarovsky, Trevor Allison, Jagger Tanner Apr 2025

Swvl: A Custom Ai-Powered Face Tracking Camera Gimbal, Alexander J. Anderson-Mcleod, Jakub Jerzmanowski, Michael Laitarovsky, Trevor Allison, Jagger Tanner

Senior Theses

In response to the growing demand for smarter, more responsive face tracking cameras in the post-pandemic world, our team designed SWVL, a custom AI-powered face tracking gimbal meant to address the limitations commonly encountered by the commercial models currently on the market. These commercially available gimbals come with several issues, such as frequently losing track of the person in the frame and requiring manual resets, which we sought to fix with our implementation. We designed a system with fully custom hardware and software including a 3D printed dual-axis camera gimbal driven by stepper motors, a control PCB based around an …


Integrating Neural Networks For Predictive Torque Control And Obstacle Avoidance In Autonomous Robot, Viswanath Kodali, Harsha Vardhan Borra, Kiran P Feb 2025

Integrating Neural Networks For Predictive Torque Control And Obstacle Avoidance In Autonomous Robot, Viswanath Kodali, Harsha Vardhan Borra, Kiran P

Northeast Journal of Complex Systems (NEJCS)

In the field of robotics, precise motion control and accurate computation of joint forces are critical for ensuring optimal performance. Traditional methods, such as using the Jacobian matrix for joint angle determination and Euler-Lagrange equations for torque computation, are reliable but computationally intensive, making them less suitable for real-time applications. This paper presents an advanced approach to improving the productivity and efficiency of a 3-Degree of Freedom (DOF) robotic arm by utilizing Artificial Neural Network (ANN). The proposed system dynamically predicts joint angles and torque, enabling faster and more efficient motion control.

To address the challenge of obstacle avoidance in …


Advancing Prosthetic Technology: 3d-Printed Robotic Arm With Micro Linear Actuators, Vu Tran, Nathan Reed, Mahdi Yazdanpour Jan 2025

Advancing Prosthetic Technology: 3d-Printed Robotic Arm With Micro Linear Actuators, Vu Tran, Nathan Reed, Mahdi Yazdanpour

Posters-at-the-Capitol

The increasing demand for affordable and accessible prosthetic solutions has driven innovation in the field of robotics. In this project, we present the design and development of a 3D-printed robotic prosthetic arm aimed at addressing the challenges faced by individuals with upper limb amputations. Our prosthetic arm utilizes five micro linear actuators to achieve precise and naturalistic movement. The design of the prosthetic arm prioritizes affordability and accessibility, with a focus on leveraging 3D printing technology to reduce manufacturing costs and enable customization. The use of micro linear actuators offers advantages in terms of compactness, lightweight construction, and efficient power …


Very Large Scale Robotics Path Planning With Centroidal Voronoi Tessellation, Xu (James) Gao Jan 2025

Very Large Scale Robotics Path Planning With Centroidal Voronoi Tessellation, Xu (James) Gao

Theses, Dissertations and Capstones

Swarm robotics, also referred to as very large-scale robotics (VLSR), has emerged as a transformative approach for addressing complex tasks that are infeasible for single-robot systems. Applications range from environmental monitoring and disaster response to large-scale agricultural and industrial operations. However, as the number of robots in a swarm increases, so do the challenges associated with motion control, energy efficiency, and scalability. These challenges necessitate innovative solutions that balance microscopic robot behaviors with macroscopic system-level objectives.

In this thesis, we address these challenges by building upon existing research [40], which introduced novel methods for optimizing swarm robotics systems using macroscopic …


3d Perception, Mapping, And Navigation For Mobile Cobot, Tuan T. Dang Jan 2025

3d Perception, Mapping, And Navigation For Mobile Cobot, Tuan T. Dang

Computer Science and Engineering Dissertations - Archive

Service robots are migrating from tightly controlled factory lines into offices, hospitals, and homes, where they must perceive, remember, and act amid people, clutter, and perpetual change. Humans solve this daily by forming compact, task-relevant “cognitive maps”: we sample just enough sensory detail to guide the moment, stitch those snapshots into a sparse topological scaffold, and continuously refine it as we move. Guided by that insight, this dissertation proposes a biologically inspired mapping framework that turns partial RGB-D observations into a hybrid temporal-spatial memory—locally metric for centimeter-scale navigation yet globally topological for room-to-building navigation. The system first distills raw depth …


Tracking Control Of A String Actuated Soft Trunk Robot Using State-Space Modeling, Jacob Trivisonno Jan 2025

Tracking Control Of A String Actuated Soft Trunk Robot Using State-Space Modeling, Jacob Trivisonno

Open Access Master's Theses

Soft robots, primarily composed of compliant materials, exhibit highly complex and nonlinear dynamics, making precise control a significant challenge. Traditional control methods often struggle with these complexities, requiring more advanced and data-driven methods. In our previous work, “Automatic Control of a Soft Trunk Robot Actuated by Strings” [1], a proportional controller was developed to drive the steady-state tracking error to zero. While this method was effective, it required time-consuming manual tuning and was not easily adaptable to physical modifications of the robot.

To address these limitations, this research implements gain-scheduled feedback control with state-space models calculated through a multiple linear …


Autonomous Landscape Exploration Rover Using Imaging Surface Navigation (Alexis), Noah Jones, Dominic Salupo Jan 2025

Autonomous Landscape Exploration Rover Using Imaging Surface Navigation (Alexis), Noah Jones, Dominic Salupo

Williams Honors College, Honors Research Projects

The objective is to develop a small-form-factor rover prototype that can be used to prove out a novel traversal method for use on extraterrestrial surfaces. The novel traversal method being proposed is LIDAR/CV-enhanced navigation, provided by a detachable flight vehicle that can communicate with the rover. On planets with thin atmospheres, cold gas thrusters or similar may be needed, but for the scope of this project more traditional flight/propulsion methods will be used.


Model Reference Adaptive Control For Mobile Manipulators And Beyond, Srivatsan Srinivasan Dec 2024

Model Reference Adaptive Control For Mobile Manipulators And Beyond, Srivatsan Srinivasan

All Dissertations

In recent years, robotics has expanded into various sectors, including manufacturing, transportation, and household services, making the integration of autonomy a critical area of research. This shift aims to ensure safety and enhance the utility of autonomous systems. Traditionally, robotic applications focused separately on mobility, like automated guided vehicles, and manipulation, such as serial-chain arms in manufacturing. Today, however, we see a merging of these capabilities in the growing field of mobile manipulator robots that combine movement with purposeful interactive functionalities.

A typical mobile manipulator is a robotic arm mounted on a wheeled base. This thesis focuses on advancing control …


Exploring Smart Thermostat, Don P. Dang Dec 2024

Exploring Smart Thermostat, Don P. Dang

2024 Fall Honors Capstone Projects - Archive

This study examines the security, privacy, and compatibility challenges associated with smart thermostats in smart home systems. Smart thermostats, as part of the growing Internet of Things (IoT) ecosystem, face vulnerabilities such as unauthorized access, data breaches, and inconsistent security protocols. Using a mixed-methods approach, this research evaluates encryption techniques, communication protocols (Zigbee, Z-Wave, Wi Fi), and user behaviors that impact system security and efficiency. Key findings indicate that 35% of users are concerned about hacking risks, while 25% express data privacy concerns. Many users lack awareness of security measures, such as firmware updates and password management, which increases vulnerabilities. …


Co-Emulation Of Robotics And Software-Defined Radio Based 5g Wireless Communications., Bhaskara Venkata Raju Garuda Dec 2024

Co-Emulation Of Robotics And Software-Defined Radio Based 5g Wireless Communications., Bhaskara Venkata Raju Garuda

Electronic Theses and Dissertations

The convergence of robotics and 5G wireless communication technologies has opened new avenues for real-time, dynamic robotic applications. This dissertation introduces a novel framework that integrates the Robot Operating System (ROS), Software-Defined Radios (SDRs), and 5G wireless networks to achieve seamless coemulation of robotic systems. The research emphasizes the unique features of 5G, such as ultra-low latency and high throughput, which enable critical applications like remote surgery, industrial automation, and autonomous vehicles. The methodology combines ROS for robotic control, SDRs for programmable communication channels, and 5G testbeds for high-speed, reliable data transmission. The experimental evaluation focuses on both position-based and …


Mechanically Cost-Effective Approach For Bipedal Walking In Robots Using Instantaneous Collision Angle, Smit R. Patel Dec 2024

Mechanically Cost-Effective Approach For Bipedal Walking In Robots Using Instantaneous Collision Angle, Smit R. Patel

UNLV Theses, Dissertations, Professional Papers, and Capstones

Humans, as bipedal locomotors, are effective at reducing the mechanical cost of transport (CoTmech) by adopting movement strategies and gaits that minimize energy expenditure for a given distance. By using different gaits at different speeds, leveraging their long spring-like tendons and muscle elasticity which store and release energy during movement, humans reduce the mechanical effort required for locomotion. Current locomotion solutions offered in bipedal robots, based on legacy walking and running gait models, are not great at energy efficiency unless walking at very low speeds. Additionally, the control system of robots, designed to ensure stability and adaptability, requires substantial resources, …


Model-Based Navigation And Control Of Multirotor Uavs: A Machine Learning Approach, Serhat Sönmez Nov 2024

Model-Based Navigation And Control Of Multirotor Uavs: A Machine Learning Approach, Serhat Sönmez

Electronic Theses and Dissertations

In recent decades, unmanned systems, particularly Unmanned Aerial Vehicles (UAVs), have seen significant advancement and unprecedented growth in military, civilian and public domain applications. Scientists have focused on enhancing UAV navigation and control through cutting-edge technologies and support tools. UAVs find applications in many fields, except military, such as agriculture, infrastructure inspection, wildlife monitoring, search and rescue, emergency response, border protection, to name but a few relevant civilian applications. Given the faster-than-exponential increase of available computational power, learning-based algorithms have emerged as a prominent tool for (real-time) multirotor UAV navigation and control. This dissertation centers around the fusion of conventional …


Design And Implementation Of An Inverted Short Baseline Acoustic Positioning System, Jakob Frabosilio Sep 2024

Design And Implementation Of An Inverted Short Baseline Acoustic Positioning System, Jakob Frabosilio

Master's Theses

This document details the design, implementation, testing, and analysis of an inverted short baseline acoustic positioning system. The system presented here is an above-water, air-based prototype for an underwater acoustic positioning system; it is designed to determine the position of remotely-operated underwater vehicles (ROVs) and autonomous underwater vehicles (AUVs) in the global frame using a method that does not drift over time.

A ground-truth positioning system is constructed using a stacked hexapod platform actuator, which mimics the motion of an AUV and provides the true position of an ultrasonic microphone array. An ultrasonic transmitter sends a pulse of sound towards …


Koopman-Based Modeling For Nonlinear Control Of Multirotor Uavs, Simone Martini Aug 2024

Koopman-Based Modeling For Nonlinear Control Of Multirotor Uavs, Simone Martini

Electronic Theses and Dissertations

This PhD dissertation focuses on adopting the emerging Koopman Operator theory for modeling and nonlinear control of multirotor UAVs, focusing specifically on quadrotors for proof-of-concept demonstration purposes.

The Koopman Operator theory is based on the foundation that nonlinear dynamics in the state space may be represented as a linear evolution of some functions in the state space. Thus, using appropriately defined and possibly nonlinear functions of the state variables, called observables, as a new and maybe infinite set of coordinates that are referred to as lifted space, the original nonlinear dynamics appear to be linear. The implications of this theory …


Using Efficient Vision Transformers To Improve Perception Systems In Autonomous Off-Road Vehicles, Adam S. Pickeral Aug 2024

Using Efficient Vision Transformers To Improve Perception Systems In Autonomous Off-Road Vehicles, Adam S. Pickeral

All Theses

The development of autonomous vehicles has become one of the greatest research endeavors in recent years. These vehicles rely on many complex systems working in tandem to make decisions. For practical use and safety reasons, these systems must not only be accurate, but also be quick to make decisions. In Autonomous Vehicle research, the environment perception system is one of the key com- ponents of development. The environment perception system allows the vehicle to understand its surroundings using cameras, light detection and ranging (LiDAR), and other sensor systems or modalities. Deep learning computer vision algorithms have shown to be the …