Physical Sciences and Mathematics Commons^™

Simulation And Optimization Of Continuous Motion Control Based On Spiking Reinforcement Learning, Xiaode Liu, Yufei Guo, Yuanpei Chen, Jie Zhou, Yuhan Zhang, Weihang Peng, Zhe Ma

Journal of System Simulation

Abstract: To improve the model robustness for multi-degree-of-freedom continuous motion control, an intelligent motion control algorithm was proposed based on the Actor-Critic reinforcement learning framework and spiking neural networks. This algorithm integrateed the Actor network with spiking population coding and enhanced model training performance by introducing feature transformation methods. The Critic network was used to evaluate the effectiveness of the motion control. The results show that, compared to other reinforcement learning algorithms, the average reward value of this method increases by more than 10%. The simulation results validate the effectiveness of the model in improving multi-degree-of-freedom continuous control performance.

A Novel Joint Training Simulation Evaluation Framework And Its Key Techniques, Rusheng Ju, Dongdong Chen, Yunxiu Zeng, Jiyuan Liu, Sihang Qiu, Peng Zhou

Journal of System Simulation

Abstract: To address the challenges of traditional evaluation systems, such as internal module coupling, lack of reusability, and poor adaptability to multi-domain evaluation needs, a three-tier decoupled technical evaluation framework of "data + service + application" was designed. A strategy was proposed for extracting high-value information from massive audio and video data based on key events, resolving the problem of unstructured evaluation data processing. A design method combining general and dedicated evaluation model templates was proposed, improving the general applicability of the evaluation model. An expert knowledge-driven comprehensive integrated discussion and evaluation environment was constructed using qualitative and …

Csc36000 - Modern Distributed Computing Assignment, Saptarashmi Bandyopadhyay

Open Educational Resources

This assignment covers standard performance metrics for Distributed Systems and the basics of Multiprocessing for CSC36000 - Modern Distributed Computing at the City College of New York CUNY. It is an interactive coding assignment intended to be executed in a Python notebook.

Learn To Fly: Enabling Deep Learning Based Perception And Control In Aerial Robotics, Krishna Muvva

School of Computing: Dissertations, Theses, and Student Research

Uncrewed Aerial Vehicles (UAVs) are increasingly deployed in dynamic, GPS degraded, and cluttered environments, yet their autonomy remains fundamentally constrained by limitations in onboard perception and real-time control. This dissertation addresses these challenges by proposing a unified framework that co-designs deep learning-based perception and model-based control, organized around three core thrusts: Learn to Track, Learn to Localize, and Learn to Evade.

Learn to Track develops dynamic and adaptive perception control mechanisms that optimize CNN inference for target tracking. A control-aware CNN framework dynamically adjusts inference frequency based on UAV motion, reducing latency while maintaining visual lock. An adaptive CNN with …

Optimization Of Multi-Target Interception Scheme Based On Performance Simulation Modeling, Hanwen Liu, Zhimin Zhuo, Xue Yang

Journal of System Simulation

Abstract: The air attack scenarios faced by air defense weapons and equipment show the trend of saturation, diversification and intelligence. It is very important to establish multi-target interception efficiency model and optimize interception scheme according to simulation. The current intercepting efficiency index mainly considers the whole operation process, and can not guide the optimization of the intercepting scheme of specific intercepting rounds. The generation of interception schemes mainly relies on experience and simple mathematical model, which is difficult to cope with the increasingly complex and changeable battlefield environment. Therefore, an interception scheme advantage index that comprehensively considers interception probability and …

Design And Prediction Of Deep Fuzzy Neural Network, Chengbiao Wei, Taoyan Zhao, Jiangtao Cao, Ping Li

Journal of System Simulation

Abstract: A deep fuzzy neural network (DFNN) is proposed to solve the problem that the deep neural network has poor interpretability and the correction of the model is not targeted when dealing with the big data regression prediction problem. The proposed deep fuzzy neural network adopts an adaptive fuzzy Cmeans (AFCM) clustering algorithm in structural learning. The structure of the model, namely the number of rules and the antecedent parameters of the rules, is determined by calculating the introduced validity function. The identification of consequent parameters uses an improved grey wolf optimization (IGWO) algorithm. By replacing the linear decreasing strategy …

Lane Detection In Dark Light Based On Instance Association, Yanji Jiang, Yingyang Zhang, Hao Dong, Xiaoguang Zhang, Meihui Wang

Journal of System Simulation

Abstract: In current research on lane detection, existing algorithms can efficiently detect lane lines under good lighting conditions. However, lane detection in low light still faces the challenge of a high false negative rate. A detection algorithm called Instance Association Net(IANet) is proposed to address this issue by utilizing the structural relationships between lane lines, which is helpful for low light conditions. The algorithm first generates unique masks for different lane lines using features at the starting points of the lane lines and a global feature map, achieving instance-level feature separation of the lane lines. It employs an instance-level attention …

Station Layout Optimization Method And Simulation For Non-Cooperative Target In Angle Of Arrival Positioning, Yida Ning, Jiongqi Wang, Juhui Wei, Zhenzu Bai, Zhangming He

Journal of System Simulation

Abstract: In the context of angle of arrival (AOA) positioning system for non-cooperative target tracking and positioning, accurately determining true location of the target poses a significant challenge. Conventional station deployment indicators like geometric dilution of precision (GDOP) fail to provide effective guidance for optimization station layout. To address the issue, this study introduces a novel indicator for station optimization and evaluation based on factors that influence positioning accuracy within an angle measurement system. These factors encompass angular differencing, baseline intersection angles, and the observer-target line distance. Moreover, this indicator encompasses the challenges associated with data conformity in "air to …

Research On Strong Real-Time Synchronisation Algorithm For Lvc Co-Simulation, Junhui Li, Songtao Sun, Fei Liu

Journal of System Simulation

Abstract: Live, virtual, and constructive(LVC) joint simulation has become a hot research topic of current military simulation; however, existing time management strategies usually fail to meet the needs of strict real-time performance of LVC. A LVC joint simulation synchronization algorithm is proposed that starts with a window sliding-based median smoothing strategy and real time drift rate-based clock compensation strategy for effective node synchronization. A novel hybrid timing strategy is introduced combining long and short cycles implemented in software, which balances precision and efficiency. A simulation catch-up strategy is proposed to address software delays, which combined with the highprecision timing strategy, …

Wingtip Docking Control Of Composite Aircraft Based On Adrc Theory, Chunlei Xie, Hongxia Hu, Weibo Han

Journal of System Simulation

Abstract: The process of wingtip docking in composite aircraft is challenged by significant unsteady vortex aerodynamic disturbances arising from the close-range coupling of wingtips, thereby posing considerable constraints on docking precision and flight safety. This study endeavors to address the intricate task of airborne wingtip docking control amidst wingtip vortex disturbances through a comprehensive investigation of airborne wingtip docking control technology, grounded in the tenets of active disturbance rejection control (ADRC) theory. Initially, a mathematical model encapsulating the dynamics of three-channel attitude/displacement during the docking operation, incorporating both the wingtip docking mechanism and the wingtip vortex model, is established. …

Kill Chain Efficiency Evaluation Model Based On Gray Dematel-Anp, Zejing Zhao, Junliang Shang, Yanpei Qin

Journal of System Simulation

Abstract: In modern conflict scenarios, the kill chain is integral to the comprehensive understanding, orchestration, and execution of military operations. Accurately appraising the efficiency of the kill chain is imperative for gaining insights into battle dynamics and strategically distributing military assets. However, traditional assessments of kill chain efficacy have been hampered by fragmented and isolated indicators that frequently overlook the interplay and influence among various segments of the kill chain. To address these limitations, based on the characteristics of each phase of the kill chain and the OODA loop theory, a new set of performance evaluation indices has been proposed. …

Digital Imaging Simulation Of Complex Scene Of Space-Based Space Small Target, Pengfei Li, Wei Xu, Yongjie Piao, Yinghong Fang, Dunpan Shi

Journal of System Simulation

Abstract: In response to the universal demand for space target detection technology research in space image data sources, this study focuses on the problems of insufficient training data for intelligent algorithms and the use of single data for traditional algorithms, with the goal of generating dynamic digital sequence images of small space targets in complex scenes. A visible light digital imaging simulation system based on a space observation platform is designed. A small target imaging model is proposed, which is based on two-dimensional shape feature point description and imaging analysis model to carry out digital modeling and imaging simulation of …

Algorithm Simulation Of Multi-Targets Track Correlation Based On Spectral Feature, Zhenping Ding, Huidong Guo

Journal of System Simulation

Abstract: In order to solve the problems of multi-targets track correlation in dense scenes, a method of track sequential real-time processing for multi-source track correlation system modeling is proposed. By calculating the absolute and relative position of the spectral features, the unified correlation matrix can be defined based on fuzzy decision theory, and the multi-target track correlation can be realized. Numerical simulations have shown the effectiveness of the track correlation algorithm on the basis of spectral features. Especially, the accuracy of correlation is much larger than that of the nearest-neighbor distance algorithm under the condition of dense target environment …

Optimization Method For Multi Agricultural Machinery Collaborative Operation Based On Genetic Algorithm And A* Algorithm, Yiran Yu, Huicheng Lai, Guxue Gao, Guo Zhang, Wangyinan Peng, Longfei Yang, Junhao Huang

Journal of System Simulation

Abstract: To address the uneven task distribution among multiple agricultural machines (referred to as farm machinery) and the high time cost due to numerous turning points at intersections, this paper proposes a task planning method that combines a pre-heat multi grouped genetic algorithm (PHMGA) with the turn A* algorithm (tA*). PHMGA allocates tasks to each piece of farm machinery based on the known environment, ensuring balanced workload through a cost objective function that considers travel, operation, and turning distances. It also designs various operators and strategies to search for nearoptimal solutions. The tA* algorithm is used to select paths …

Second-Order Cone Optimization Modeling And Simulation For Three-Phase Unbalanced Active Distribution Networks, Yiran Zhao, Yong Xue, Haoxin Tian, Ruixin Zhang, Zhi Zhang, Yanbo Chen

Journal of System Simulation

Abstract: Guided by the carbon peaking and carbon neutrality goals, and propelled by the development of new type power systems, the significance of distribution networks as key energy infrastructure has been increasingly underscored. Amidst the burgeoning rise of distributed photovoltaics, electric vehicles, and novel energy storage technologies, distribution networks are transitioning from passive entities to active systems capable of bidirectional interaction, heralding the advent of active distribution networks with a critical mission. This research tackles the optimal power flow issue in three-phase unbalanced active distribution networks, incorporating inter-phase coupling relationships. By employing dimensionality lifting and rank relaxation, along with the …

Robot Path Planning Based On Improved A-Ddqn Algorithm, Peilong Ni, Pengjun Mao, Ning Wang, Mengjie Yang

Journal of System Simulation

Abstract: An improved A-DDQN algorithm is proposed to address the challenges of reward sparsity and the inability to distinguish sample importance in traditional DQN algorithms during robot path planning. Building on the original DQN, an enhancement is made by incorporating the Double-DQN approach, which updates the predictive Q-value network based on actions selected by the Q network, rather than directly using the predicted Q-values for action selection, thereby mitigating overestimation issues. Secondly, the concept of artificial potential field (APF) is introduced to design specific rewards for each step of the robot's movement, guiding the robot and addressing the problem of …

A Model Combining Self-Attention And Weight Sharing For Human Activity Recognition, Lun Ma, Yue Yang, Daihe Wang, Guisheng Liao, Xing Li

Journal of System Simulation

Abstract: With the prevalence of wearable devices, human activity recognition based on wearable sensor data has garnered significant attention. The central issue in this field is how to extract effective behavioral information from raw sensor data to form corresponding feature vectors. Currently, convolutional neural networks and recurrent neural networks have been widely utilized for feature extraction from multisensory data. However, these networks struggle to globally capture the crucial temporal features inherent of human activity over time. To address this, a multi-CNN-BiLSTM-self attention (Multi-CBSA) model based on self-attention and weight sharing has been proposed, taking into consideration the logical correlations among …

Research On The Truth, Function And Common Principles Of Simulation, Haohua Xu, Bin Xiao, Yunhao Cui

Journal of System Simulation

Abstract: Simulation applications are becoming increasingly widespread and have a greater impact, while the theoretical foundation of simulation is relatively weak. This article provides a new definition of simulation by analyzing the common activities of simulation, which can include both virtual and real simulation forms; referring to Popper's three worlds theory, this paper discusses the objective authenticity of simulation from a philosophical perspective; From a methodological perspective, this paper elaborates on the methodological characteristics of simulation as an indirect cognitive object, revealing its significance in integrating human-machine intelligence and promoting knowledge evolution. It also discusses the common principles of simulation, …

Solving The Vehicle Routing Problem Based On Deep Reinforcement Learning, Ming Jiang, Tao He

Journal of System Simulation

Abstract: The capacitated vehicle routing problem (CVRP) is a well-known combinatorial optimization challenge recognized as NP-hard due to its significant complexity. Building upon existing research, this paper introduces a novel end-to-end deep reinforcement learning approach based on a multi-pointer Transformer to tackle the CVRP. The proposed algorithm employs an invertible residual network in the encoder to encode input features, effectively reducing memory consumption. In the decoder, a multipointer network determines the probability distribution of solutions. To further enhance the performance of CVRP solutions, the algorithm leverages the symmetry in combinatorial optimization by implementing multi-trajectory parallel processing during both training …

Anylogic-Based Platform-Enterprise Collaborative Scheduling Simulation System For Cloud Manufacturing, Linxuan Wang, Yongkui Liu, Lin Zhang, Tingyu Lin, Lihui Wang

Journal of System Simulation

Abstract: Aiming at the lack of research on collaborative scheduling between a cloud manufacturing platform and associated enterprises, as well as the lack of simulation systems to simulate scheduling strategy combinations and to visualize dynamic scheduling processes, a simulation system that supports visualization of cloud manufacturing platform-enterprise collaborative dynamic scheduling processes is designed and developed. System requirements are analyzed in detail, and then a scalable platform-enterprise collaborative scheduling model and system functional architecture based on hierarchical multi-agents is proposed. Combined with a case of supply chain of industrial robots, considering random selection, time optimal strategy in the cloud manufacturing …

Digital Twin Modeling Method For Bulk Cargo Stacks Based On 2d Lidar, Houjun Lu, Yifei Zhu, Yanping Rong, Wanghui Zhang

Journal of System Simulation

Abstract: Due to the characteristics of large equipment, harsh working environment and time-varying shape of the material pile in bulk cargo terminal, there are some disadvantages such as low data accuracy and poor stability when building the storage yard model, which affects the unmanned and intelligent operation control. In this paper, we use two-dimensional laser radar combined with equipment mechanism motion to scan material pile point cloud data, present a digital twin modeling method for bulk storage yard, which includes static scene construction of storage yard and real-time modeling of material pile. Prefabricated models are used for the static scenes …

Control Strategy For Uav Cluster Formation Rendezvous Based On Lde-Maddpg Algorithm, Wei Xiao, Jiabo Gao, Xueliang Ke

Journal of System Simulation

Abstract: To solve the problem of difficulty in UAV cluster formation rendezvous based on MADDPG algorithm, an autonomous collaborative control strategy based on LDE-MADDPG algorithm is proposed. To address the issues of weak generalization, poor scalability, and slow cluster training process of MADDPG algorithm, LDE-MADDPG algorithm was proposed by designing a state feature learning network and a decoupled Critical network. By integrating LDE-MADDPG algorithm with strategy generation elements such as the decoupled reward function, cluster state space, and UAV action space, a control strategy for UAV cluster formation endezvous that can adapt to diverse formations and varying quantities has been …

Research On Real-Time Cgf Maneuvering State Generation Method Based On Random Finite Set, Xiaoyan Zhang, Ge Li, Peng Wang

Journal of System Simulation

Abstract: With the rapid development of sensor networks and other technologies, the acquisition of measurement data in the real physical space has become easier. How to utilize the measurement data from the real battlefield space to improve the accuracy and credibility of CGF simulation is the key issue to realize the CGF simulation combining virtual and real. The method is studied of using real measurement data to generate CGF model maneuvering state data in real time, in order to realize the virtual-real synchronization and real-time mapping between the real battlefield and CGF simulation system, and to provide environmental inputs for …

Benefit Distribution Optimization Model And Simulation For Multi-Mode Operation Of Industrial Software Platforms, Rongyu Guo, Xiaobin Li, Pei Jiang, Chuanjiang Li, Shanhui Liu, Jun Ma

Journal of System Simulation

Abstract: Industrial software service platforms, characterized by low-cost investment, customized services, and rapid application deployment, have been widely adopted in small and medium-sized industrial clusters. The benefit distribution mechanism under multi-mode operation is crucial to the sustainable development of such platforms. To address the current challenges of single-operation models and the difficulty in adapting to diverse service scenarios, this study focuses on two core stakeholders that users and software developers to analyze the core service components and cooperation mechanisms of industrial software service platforms in a multi-mode operational environment. By integrating the function point method, a multi-mode user demand quantification …

Multi-Modal Depth Estimation Using Camera And Mmwave Sensors, Alston D. Devero-Belfon

Student Theses

For accurately estimating the depth of environments with varying lighting conditions, reliable methods are limited. By utilizing wireless sensor technology in conjunction with cameras, a wide range of environments can be visualized, and objects within these environments can be tracked and monitored. Such methods offer cost-effective alternatives and provide a more secure, data-at-rest option for individuals with low vision, while also enhancing machine perception. In this work, we develop such a prototype that utilizes wireless sensors and cameras, which act in sync, enabling us to estimate the depth of objects within varying lighting environments to a level that is recognizable …

Storage Location Optimization In Automated Storage And Retrieval Systems: A Deep Reinforcement Learning Approach, Lingjun Wang, Aldy Gunawan, Pieter Vansteenwegen

Research Collection School Of Computing and Information Systems

This study investigates the optimization of storage location in automated storage and retrieval systems (AS/RS). We introduce an optimization approach based on the Deep Q-Network (DQN) algorithm to enhance warehouse task efficiency and minimize stacker travel during storage and retrieval. To accelerate the algorithm training process, we integrate a prioritized experience replay mechanism. Furthermore, we decouple action selection from value estimation within the DQN framework to address the issue of value overestimation. The proposed model is evaluated against three heuristic methods. The experimental results demonstrate that our approach significantly outperforms these baselines.

Optimizing Hip And Knee Assistance For Walking And Sit-To-Stand Transitions: An Intrinsic Muscle Mechanics Based Predictive Approach, Neethan Ratnakumar

Dissertations

As the global population ages, the demand for wearable assistive technologies continues to rise, driven by their potential to enhance mobility and independence in older adults. Effectively designed controllers for lower-limb exoskeletons to assist sit-to-stand (STS) and walking are crucial for delivering efficient, safe, and comfortable assistance during daily activities. Traditionally, controller optimization involves biomechanical modeling and user-specific customization. Musculoskeletal simulations play a central role in this process by providing insights into human-exoskeleton interaction dynamics, thereby informing and refining control strategies.

This work presents a simulation-driven approach for developing exoskeleton controllers for walking and STS using two distinct methods: optimal …

Intelligent Motion Tracking: A Low-Cost Surveillance Framework Using Soc Devices And Sensor Fusion, Aung Myat Khaung, Nicholas Michael Stiffler

Research from the Berry Summer Thesis Institute, 2025

This thesis presents the design and implementation of a lightweight surveillance system capable of realtime motion detection, object tracking, and behavioral history reconstruction in controlled environments. The system uses System-on-Chip devices such as Raspberry Pi boards equipped with NOIR cameras, monocular cameras, and break-beam sensors that work together to detect and track single or multiple moving objects like colored balls. The prototype is validated in structured settings with the goal of eventual deployment in more dynamic environments, addressing the challenge of reliably tracking visually similar objects with minimal distinguishing features. The architecture integrates computer vision with sensor fusion by combining …

An Envisioned And Efficient Design Of Next Generation Decentralized Iot Bot Detection Model, Ahmed Abdullah Almalki

Doctoral Dissertations

The Industrial Internet of Things (IIoT) and Internet of Medical Things (IoMT) are revolutionizing critical infrastructures, but their expansion has also introduced severe cybersecurity vulnerabilities. Traditional IoT Bot Detection Systems (IBDS) struggle to scale in environments characterized by high-dimensional, large-scale, and redundant network traffic. These challenges hinder the development of reliable cloud-based intrusion detection systems. The limitations of static and rulebased methods in detecting evolving IoT botnet attacks—such as those launched by Mirai and Gafgyt—underscore the need for intelligent, adaptive approaches. To address this, the present study proposes a machine learning and deep learning-driven IoT Botnet Detection Model, validated through …

Scene Generation Method For Maritime Target Recognition Based On Detection Parameters, Yuxuan Run, Dezhen Yang, Yeyang Liu, Wei Deng, Xiangyu Xing, Yi Ren

Journal of System Simulation

Abstract: Traditional scene generation methods for maritime target recognition consider only the effects of different environments on the generated scene data, while overlooking the changes in scene information caused by sensor detection parameters, resulting in a lack of accuracy and authenticity in generated scenes. To address this issue, a detection parameter-based scene generation method for maritime target recognition was proposed. For the task of maritime target recognition, key detection parameters affecting scene generation quality and essential scene features were analyzed. An association relationship modeling method based on Bayesian networks was proposed to construct a mapping relationship model between scene features …