Engineering Commons^™

Reinforcement Learning For Strategic Airport Slot Scheduling: Analysis Of State Observations And Reward Designs, Anh Nguyen-Duy, Duc-Thinh Pham, Jian-Yi Lye, Nguyen Binh Duong Ta

Research Collection School Of Computing and Information Systems

Due to the NP-hard nature, the strategic airport slot scheduling problem is calling for exploring sub-optimal approaches, such as heuristics and learning-based approaches. Moreover, the continuous increase in air traffic demand requires approaches that can work well in new scenarios. While heuristics rely on a fixed set of rules, which limits the ability to explore new solutions, Reinforcement Learning offers a versatile framework to automate the search and generalize to unseen scenarios. Finding a suitable state observation and reward structure design is essential in using Reinforcement Learning. In this paper, we investigate the impact of providing the Reinforcement Learning agent …

Harnessing Social Media For Disaster Response: Intelligent Identification Of Reliable Rescue Requests During Hurricanes, Wael Khallouli

Engineering Management & Systems Engineering Theses & Dissertations

Hurricanes pose a significant threat to both human lives and infrastructure. Decision-makers face substantial challenges during such events, as they must act quickly to address victims’ needs. Social media platforms provide a valuable source for quick and real-time information. Recent hurricane events have shown that people turn to social media to call for help when official communication channels, such as 911, are overwhelmed. However, extracting actionable information from the massive number of messages posted on social media is challenging. Furthermore, verifying social media messages posted by the public is a critical concern for disaster response practitioners, making them hesitant to …

Simulation Of Rice Disease Recognition Based On Improved Attention Mechanism Embedded In Pr-Net Model, Yang Lu, Pengfei Liu, Siyuan Xu, Qiwang Liu, Fuqian Gu, Peng Wang

Journal of System Simulation

Abstract: Aiming at the low accuracy of existing CNN models in identifying rice leaf diseases, a hybrid convolutional neural network model PRC-Net (parallel residual with coordinate attention network) combining parallel structure and residual structure is proposed. A parallel structure is introduced to improve the receptive field of convolution, and the residual structure is combined to achieve the complete and continuous transmission of feature information. An improved spatial attention mechanism is embedded into the backbone model PR-Net to enhance the degree of aggregation of lesion feature information at different scales. In order to further improve the accuracy of disease identification and …

Just-In-Time Learning Energy Consumption Predictive Modeling Method In Multi-Condition Production Process, Sheng Wei, Yan Wang, Zhicheng Ji

Journal of System Simulation

Abstract: Aiming at the problem that the global energy consumption prediction model is only suitable for part of the prediction sample and the model is computationally intensive, the idea of just-in-time learning is introduced, and the local weighted partial least squares method combined with the energy consumption model is used to establish a temporary local energy consumption prediction model. The inertia weights of the particle swarm algorithm are improved, considering the effects of particle fitness, number of iterations and population size on the convergence speed and convergence accuracy of the particle swarm algorithm, a nonlinear change adaptive inertia weight strategy …

Thinking Of Aerospace Equipment Systematization Simulation Technology Development, Weimin Bao, Zhenqiang Qi

Journal of System Simulation

Abstract: The aerospace field is flourishing in the new era. Aerospace equipment presents new characteristics such as systematization, new quality, high efficiency and intelligence. Simulation technology plays a more important role in the digital aerospace era as a means of enhancing efficiency and empowerment covering all stages of the entire lifecycle, including project demonstration, research and development, testing, manufacturing, training, and maintenance. The conception of aerospace equipment systematization simulation technology is introduced, the current development status and practices at home and abroad are elaborated, and the future development trends and challenges of aerospace equipment systematization simulation technology are evaluated. Focusing …

Unsupervised Complex Condition Recognition Based On Stochastic Neighborhood Embedding, Lin Huang, Shanjun Liu, Wei Wang, Li Gong

Journal of System Simulation

Abstract: Modern industrial production equipment usually has a complex structure and runs alternately in different working conditions. Accurate working conditions identification based on monitoring data is the basis of health monitoring of the system, but the monitoring data of the system usually has a high dimension and a large data volume. To identify the complex equipment operating conditions, an unsupervised operating condition identification method based on stochastic neighborhood embedding is proposed. The stochastic neighborhood embedding algorithm can simultaneously preserve the local and global structural characteristics of the data, and also calculate the probability similarity of data points in high-dimensional and …

Completion Time Simulation Prediction Method For Aircraft Assembly Process With Batch And Sortie, Changjian Jiang, Hu Fan, Tao Luo, Wen Yuan, Zehao He

Journal of System Simulation

Abstract: Aiming at the product differentiation analysis limitation of traditional discrete event simulation method, a simulation prediction method for aircraft assembly process with batch and sortie is proposed. Around the aircraft sortie number, the formal definition of various basic elements and interactions in the assembly process with batch and sortie is studied, and the construction of station and whole line simulation model is carried out. The simulation promotion framework and execution mechanism supporting the product differentiation analysis are studied. Based on the simulation results, a method for predicting the completion time of sorties based on interval estimation method is proposed. …

Adaptive Pid Control Algorithm Based On Ppo, Zhiyong Zhou, Fei Mo, Kai Zhao, Yunbo Hao, Yufeng Qian

Journal of System Simulation

Abstract: A six-axis robotic arm is built and simulated in a complex control environment with disturbances by using MATLAB physics engine and Python, which provides a trial-and-error environment for the robotic arm training that could not be provided in reality. Proximal policy optimization(PPO) algorithm in reinforcement learning is proposed to improve the traditional PID control algorithm. By introducing the multi-agent idea and on the basis of the different effects of the three parameters of PID on control system and the characteristics of the six-axis robotic arm, the three parameters are separately trained as different intelligent individuals to achieve a new …

Fusing Rotation Angle Coding In Spherical Space For Human Action Recognition, Benyue Su, Bangguo Zhu, Mengjuan Guo, Min Sheng

Journal of System Simulation

Abstract: The existing human action recognition methods focus more on the translation information such as the coordinates and displacements of skeleton structure, and pay less attention to the motion trend of skeleton structure and the rotation information representing the motion direction of joints and bones. A spatio-temporal convolutional neural network method combining the rotation angle coding in spherical space is introduced. The angle information with scale invariance is obtained by mapping the human action in three-dimensional spherical space, and the dynamic angular velocity information is extracted as the angle code to represent the rotation information of joints and bones in …

Design Of Real-Time Simulation & Test Software Based On Windows/Rtx, Yongbo Li, Runmei Tian, Hui Zhang, Shanpeng Guo, Qi Li

Journal of System Simulation

Abstract: Aiming at the limited real-time performance of traditional test software and the low generality of traditional simulation interface software, a real-time simulation software based on Windows/RTX is designed to meet the requirements of unit testing and control system simulation verification of semiphysical simulation software. Through modular design, GUI layer human-computer interface and RTX layer real-time operation program are developed. To ensure the real-time, the lock-free cyclic buffer plus dual-threading technology is used to solve the timeout problem of serial data transmission and reception when the simulation step size is 1 ms under RTX environment. A timeout detection algorithm is …

Cooperative Ant Colony Algorithm Combining Evaluation Reward And Punishment Mechanism And Neighborhood Dynamic Degradation, Yujie Wang, Xiaoming You, Sheng Liu

Journal of System Simulation

Abstract: To address the slow convergence and the tendency to fall into local optimality in solving TSP, a cooperative ant colony algorithm combining evaluation reward and punishment mechanism and neighborhood dynamic degradation (ENCACO) is proposed. The paths are classified into active and abandon paths according to the path evaluation value, and with the path evaluation value as the weight, the different pheromone reward and punishment strategies are adopted for the two types of paths to accelerate the convergence speed of the algorithm. Through the neighborhood dynamic degradation strategy, and the neighborhood radius is used to divide the set of cities …

Construction Of A Virtual Interactive System For Orchards Based On Digital Twin, Hongjun Wang, Junqiang Lin, Xiangjun Zou, Po Zhang, Mingxuan Zhou, Weirui Zou, Yunchao Tang, Lufeng Luo

Journal of System Simulation

Abstract: Aiming at the low visibility, poor real-time, weak adaptability and single interaction mode in orchard planting management system, a six-dimensional model of orchard digital twin system for planting management process is proposed. The system model construction theory and technology system is discussed from four aspects, entity modeling of management elements, dynamic modeling of management process, simulation modeling of management system and optimization modeling of management strategy. Based on the six-dimensional model, supported by the theory and technology system, the virtual interactive system architecture of the orchard based on the digital twin is designed, and the key technologies of the …

Simulation Of Robotic Peg-In-Hole Assembly Strategy Based On Drl, Zilu Zhu, Yongkui Liu, Lin Zhang, Lihui Wang, Tingyu Lin

Journal of System Simulation

Abstract: Aiming at the existing peg-in-hole assembly method problems of dependence on accurate contact state models, difficulties in data acquisition, low sampling efficiency, and poor security, a simulation research method for robot peg-in-hole assembly strategy based on DRL is proposed. A simulation environment of robot peg-in-hole assembly based on ROS-Gazebo is built, and a method of gravity compensation for force/torque sensor based on a least square method is proposed. The reinforcement learning paradigm is employed to model the robot peg-in-hole assembly, and a method based on soft actor-critic(SAC) algorithm is proposed. The communication mechanism between the simulation environment and the …

Dynamic Air Defense Resource Allocation Optimization Based On Improved Differential Evolution Algorithm, Tianyu Luo, Lining Xing, Rui Wang, Ling Wang, Jianmai Shi, Xin Sun

Journal of System Simulation

Abstract: Based on the integrated performance of weapon equipments such as radars, launchers and missiles, a mixed-integer decision model that minimizes the total target intercept value and the probability of survival based on Target-Set, Resource-Set is developed. A new improved differential evolutionary algorithm has been introduced to solve the problem, and the initial solutions is generated by using the reverse learning strategies to ensure the quality of the initial populations. An inspiration rule for the fast repair and reconstruction is designed to work at multi-stage to improve the search capability of the algorithm. The simulation experiment results show the algorithm's …

Research On Operational Protection Area Of Ils Glide Slope, Qingdong Li, Jiaquan Ye, Jian Xu

Journal of System Simulation

Abstract: The scientific protection for the operational protection area of the instrument landing system glide slope is of great significance to ensure the quality of civil aviation navigation space signals, the safety of aircraft approach operations, and the efficiency of airport operations. Combined with the concept evolution of the glide slope operational protection area, a comparative analysis of the delineation of the glide slope operational protection area required by the national civil aviation standards, industry standards, and Annex 10 Volume I of the Convention on International Civil Aviation is carried out. Taking the extra-large aircraft (A380-800) as an example, the …

Air Defense Missile Weapon Target Assignment Based On Multi-Objective Evolutionary Algorithm, Xin Sun, Lining Xing, Rui Wang, Ling Wang, Jianmai Shi, Tianyu Luo

Journal of System Simulation

Abstract: An effective weapon target assignment method can reduce the combat losses and improve the defense effect. A reasonable mathematical model is established for the allocation of air defense resources, aiming at the optimization objectives of maximizing target destruction effectiveness and minimizing radar resource consumption, considering multiple constraints such as the upper limit of radar channels, on the basis of multiobjective evolutionary algorithm based on decomposition (MOEA/D), the probability of crossover and mutation is adaptively adjusted to improve the quality of individuals in the process of population evolution, and a set of optimal solution sets for decision makers is obtained. …

Classification Cooperative Scheduling Of U-Automated Container Terminal Based On Container Markers, Fei Wang, Daofang Chang, Furong Wen

Journal of System Simulation

Abstract: To improve the confusing scheduling of U-shaped yard operations due to improper classification of containers, the classification cooperative scheduling process is proposed, in which the classification cooperative scheduling model is established with the constraints of coordinated operation and efficient independent operation. The container classification principle and the container multiple stacking principle are proposed, the stacking point is selected by the weighted calculation based on the container operation mark to design the penalty mechanism, and the classification cooperative heuristic algorithm solution model is designed. Comparative experiments show that the strategy used in the algorithm is superior,which can reduce the equipment …

Optimal Trajectory Of Full-Duplex Uav Relaying Over Hybrid Probability Channels, Tao Wang, Ji Xiaodong

Journal of System Simulation

Abstract: A fixed-wing UAV being the full-duplex moving relay, and a hybrid probability channel being the source to send data to the destination, through the flight optimal trajectory design. On the basis of ensuring the total data amount of source-destination communication, the energy consumption of the system is minimized. Two optimization problems of runway shape and mixed trajectory are established, which are non-convex and are difficult to get the closed-form solution. The hybrid probability channels gains are replaced by the average channel gains, and the lower bounds of the received data at the UAV and the destination are calculated by …

Arterial Coordination Optimization Method Based On Vehicle Speed Guidance And Inductive Control, Mingjun Deng, Xinxia Hu, Xiang Li, Liping Xu

Journal of System Simulation

Abstract: Arterial signal coordination is usually based on fixed belt speeds and time-of-day statistical flows. Actually, vehicle speeds and traffic flows are fluctuating, which causes to the mismatch between the signal scheme and the actual optimal belt speeds and traffic flow demands, and affects the intersection's traffic efficiency. Based on the vehicle infrastructure cooperation, by applying Maxband model and the maximum green wave bandwidth, the minimum number of arterial vehicle delays, arterial stops and the minor direction delays being the optimization objectives, a multi-objective optimization model for arterial signal coordination is established. Through using an improved multi-objective particle swarm algorithm …

Curriculum Learning-Based Simulation Of Uav Air Combat Under Sparse Rewards, Jingyu Zhu, Hongli Zhang, Minchi Kuang, Heng Shi, Jihong Zhu, Zhi Qiao, Wenqing Zhou

Journal of System Simulation

Abstract: To address the limited exploration capabilities and sparse rewards of conventional reinforcement learning methods in air combat environment, a curriculum learning distributed proximal policy optimization (CLDPPO) reinforcement learning algorithm is proposed. A reward function informed by professional empirical knowledge is integrated, a discrete action space is developed, and a global observation and local value and decision network featuring separated global and local observations is established. A methodology for unmanned aerial vehicles UAVs is presented to acquire combat expertise through a sequence of fundamental courses that progressively intensify in their offensive, defensive, and comprehensive content. The experimental results show that …

Hybrid Flow Shop Scheduling With Limited Buffers Considering Energy Consumption And Transportation, Tingxin Wen, Tingyu Guan

Journal of System Simulation

Abstract: Aiming at the untimely production scheduling and excessive energy consumption during processing, a limited buffer hybrid flow shop scheduling optimization model is constructed. To minimize the makespan and total energy consumption of the workshop, the transport time, generalized energy consumption and buffer capacity being the constraints, and the on/off energy saving strategy applied to reduce the standby energy consumption, the feasibility of the optimization model are verified. A lion swarm optimization algorithm is designed, in which a population initialization method combining random generation and greedy selection is used to improve the initial solution quality and solution efficiency, the lion …

Development And Application Of Simulation Platform For Aquatic Movement Of An Amphibious Armored Vehicle, Mingzhe Chen, Yunzheng Song, Pei Wang, Lei Zhang

Journal of System Simulation

Abstract: In order to design and verify the fire control system(FCS) algorithm of amphibious assault vehicle under heavy wind and wave conditions, a real-time simulation platform is developed. The traditional single rigid body dynamic model can't describe the body-turret-barrel dynamic coupling relationship and it is not suitable for FCS simulation with high dynamic characteristics. Twist-wrench method is used to establish the multiple rigid body dynamic model of vehicle, the buoyancy and the hydrodynamic calculation is carried out according to the body and the moving relationship between visual generated waves, and the hydrodynamic coefficient is obtained by the computational fluid dynamic …

Application Of Driving Simulation Technology In Calibration Of Traffic Simulation Parameters, Shikun Liu, Yi Tang, Yonghong Liu

Journal of System Simulation

Abstract: To address the insufficient accuracy in traffic simulation modeling due to the lack of in-depth consideration of complex driving behaviors, a calibration method for traffic simulation parameters based on driving simulation technology is proposed. The reconstruction and expansion project of Shenzhen Bao'an International Airport Expressway is selected as the case. Using VISSIM simulation software, a comprehensive traffic simulation model of the entire route is constructed, and UC-winRoad software is employed to create the highly realistic driving simulation scenarios. Driving simulation experiments are conducted to extract the typical driving behavior characteristics in complex scenarios. Calibration functions for simulation parameters are …

How Do Preservice Teachers Learn To Teach Integrated Computational Thinking?: Evidence From Planning, Enactment, And Reflection, Rachael Dektor, Samuel Severance, Kip Téllez

Journal of Computer Science Integration

This study examines pre-service teachers’ (PSTs) beliefs and understandings about computational thinking (CT) integration and lesson implementation over time. Utilizing a design-based research approach, 3 PSTs led the co-design of integrated CT lessons with support from researchers and enacted these CT integrated lessons with K-5 students. All PSTs participated in a whole-group CT workshop and engaged in one-on-one lesson design sessions with a researcher. We utilized a grounded theory approach to qualitatively analyze pre-surveys, semi-structured interviews, and video data of three PSTs enacting their lessons. We found that PSTs’ initial beliefs about CT instruction – including the importance of it …

Anonymized Identity Recognition And Classification Using Privacy Preserving Facial Encoding, Manas Sanjay Pakalapati

USF Tampa Graduate Theses and Dissertations

The need for sharing large-scale datasets to train deep neural network models, particularly in healthcare, raises significant data security and privacy concerns. To address these issues, methods such as data encryption or encoding are utilized. These techniques can encrypt the data and make it unreadable to humans, while still retaining its usefulness for training models.

In this study, we investigate various image encoding techniques designed to protect privacy by making images unrecognizable while still retaining their usefulness for model training. Our investigation utilized publicly available facial databases and focused on evaluating the trade-offs inherent in image encoding techniques, with a …

Large-Scale Research Infrastructure Empowers High-Quality Development Of Private Enterprises: Current Situation, Challenges, And Policy Recommendations, Lingling Zhang, Fuqiang Wang, Mingze Zhang, Zexia Li

Bulletin of Chinese Academy of Sciences (Chinese Version)

Private enterprises have become an important source of innovation in China’s economic development. Large-scale research infrastructure, as a crucial strategic support and innovation element for breaking through key technologies, provides a platform for the innovative development of private enterprises. At present, some large-scale research infrastructures in China, such as the China Spallation Neutron Source and the Shanghai Synchrotron Radiation Facility, have begun actively exploring mechanisms to serve private enterprises. These efforts have helped a number of private companies overcome critical technological bottlenecks and achieve original innovations. Nevertheless, in the current process of opening up large-scale research infrastructures to private enterprises …

Bridging Design And Perception: Novel Tools And Technologies For Creating Effective Human-Robot Interactions, Benjamin Dossett

Electronic Theses and Dissertations

This thesis explores human perception of robots through the use of novel tools and technologies. First, the impact of Augmented Reality (AR) data presentation on human perception of robots is investigated. A study conducted with the AR human-robot teaming system found that robot performance significantly influenced participants’ perceptions, overshadowing the impact of matching or mismatching robot confidence feedback. Second, the DU Want to Build-A-Bot platform is presented, which enables participatory robot design and opens the door for novel research of how robot design affects human perception. The Build-A-Bot platform enables the collection of diverse robot designs, facilitating machine learning analysis …

Back To The Future: A Case For The Resurgence Of Approximation Theory For Enabling Data Driven “Intelligence”, Michael Dominic Ciocco

Theses and Dissertations

Artificial Intelligence (AI) has exploded into mainstream consciousness with commercial investments exceeding $90 billion in the last year alone. Inasmuch as consumer-facing applications such ChatGPT offer astounding access to algorithms that were hitherto restricted to academic research labs, public focus of attention on AI has created an avalanche of misinformation. The nexus of investor-driven hype, “surprising” inaccuracies in the answers provided by AI models – now anthropomorphically labeled as “hallucinations”, and impending legislation by well-meaning and concerned governments has resulted in a crisis of confidence in the science of AI. The primary driver for AI’s recent growth is the convergence …

Design And Implementation Of A Vision-Based Deep-Learning Protocol For Kinematic Feature Extraction With Application To Stroke Rehabilitation, Juan Diego Luna Inga

Master's Theses

Stroke is a leading cause of long-term disability, affecting thousands of individuals annually and significantly impairing their mobility, independence, and quality of life. Traditional methods for assessing motor impairments are often costly and invasive, creating substantial barriers to effective rehabilitation. This thesis explores the use of DeepLabCut (DLC), a deep-learning-based pose estimation tool, to extract clinically meaningful kinematic features from video data of stroke survivors with upper-extremity (UE) impairments.

To conduct this investigation, a specialized protocol was developed to tailor DLC for analyzing movements characteristic of UE impairments in stroke survivors. This protocol was validated through comparative analysis using peak …

Accessible Real-Time Eye-Gaze Tracking For Neurocognitive Health Assessments, A Multimodal Web-Based Approach, Daniel C. Tisdale

Master's Theses

We introduce a novel integration of real-time, predictive eye-gaze tracking models into a multimodal dialogue system tailored for remote health assessments. This system is designed to be highly accessible requiring only a conventional webcam for video input along with minimal cursor interaction and utilizes engaging gaze-based tasks that can be performed directly in a web browser. We have crafted dynamic subsystems that capture high-quality data efficiently and maintain quality through instances of user attrition and incomplete calls. Additionally, these subsystems are designed with the foresight to allow for future re-analysis using improved predictive models, as well as enable the creation …