Computer Engineering Commons^™

Full-Body Co-Speech Gesture Generation Based On Spatial-Temporal Enhanced Generation Model, Shuozhe Zhang, Wenfeng Song, Xia Hou, Shuai Li

Journal of System Simulation

Abstract: Full-body co-speech gesture generation significantly enhances the interactivity of virtual digital humans, requiring generated gestures to not only align accurately with speech but also demonstrate realistic full-body dynamics. To address limitations of existing methods—Transformer-based approaches often overlook temporal features of action sequences, while diffusion model-based ones inadequately capture spatial correlations between body parts, a full-body action generation method integrating diffusion models, Mamba, and attention mechanisms is proposed. We introduce the spatial self-attention-temporal state space model (STMamba Layer) as the core of denoising network to extract
inter-part spatial features and intra-part temporal features, thus enhancing action quality and diversity. …

Vrbt: Vr Badminton Training With Multitask Injury Alerts Based On Lightweight 3d Skeletal Reconstruction, Yuning Zhu, Meng Yang, Tianyue Chen, Weiliang Meng

Journal of System Simulation

Abstract: To overcome the limitations of traditional badminton training, a VR training method that integrates multiple models for collaborative simulation is proposed. A "perception-decision- interaction" framework is developed within Unity, featuring diverse training modules powered by a physics engine for realistic trajectory simulation. The system employs a lightweight MHFormer for 3D pose estimation and a novel multi-task model (enhanced injury prediction system, EIPS) that combines random forest and XGBoost to jointly assess injury risk. This approach offers a solution for balancing real-time performance with accuracy in skeleton reconstruction and enables personalized training through dynamic risk assessment.

Military Metaverse: Conceptual Connotation, Construction And Application Framework, Key Issues, Dayong Liu, Zhiming Dong, Jiancheng Gao

Journal of System Simulation

Abstract: Based on the analysis of the concept of the metaverse, the military metaverse concept model is established and compared with virtual-real fusion systems such as the digital twin battlefield, analyzing its core characteristics and construction significance. To accelerate the construction of the military metaverse, an overall logical architecture for the construction and application of the military metaverse is designed, the concept of military metaverse primitives is proposed, and the technical architecture is designed. The main application directions of the military metaverse are analyzed, and the construction stage division and overall thinking are provided. The key issues in construction and …

Virtual-Real Fusion Simulation Technology And Application Research For Industrial Control Systems Cybersecurity Of Process Manufacturing, Xinwei Wang, Jinjiang Wang, Zheng Wang, Laibin Zhang

Journal of System Simulation

Abstract: Aiming at the problem that the industrial control system in the process manufacturing industry lacks an effective attack and defense drill platform when facing network attacks, it is difficult to truly simulate the attack situation, verify the protective measures, and accurately evaluate the impact of attacks on the physical system, an industrial control cybersecurity simulation technology based on virtual-real fusion is proposed to build an efficient attack and defense drill range. The industrial control cybersecurity simulation architecture based on virtual-real fusion is designed, and the consistency analysis of virtual-real fusion data is carried out. At the same time, …

Spatio-Temporal Swin Transformer-Based Flow-Solid Coupling Interaction Sequence Image Prediction Network, Changjun Zou, Zhiyu Ge, Chenxi Zhong

Journal of System Simulation

Abstract: To address limitations in modeling long-term dependencies and multi-scale features in fluidstructure interaction scenarios, a spatiotemporal deep learning model (SwinLSTM) integrating ConvLSTM and Swin Transformer is proposed. The model employs a gated spatiotemporal attention mechanism that dynamically embeds Swin Transformer's window-based multi-head self-attention into ConvLSTM's output gate, enabling adaptive temporal-spatial feature coupling, and designs a multi-level ConvLSTM framework to hierarchically capture complex spatiotemporal correlations. Experiments on a self-built fluid-interaction dataset show that our method achieves the highest PSNR and leading SSIM scores, with superior performance in preserving vortex details and boundary consistency. This work provides an efficient solution …

Pl-Mamba: A 3d Point Cloud Semantic Segmentation Network Based On Bimodal Fusion, He Zhu, Feng Zhou, Mengxiao Zhu, Ju Dai

Journal of System Simulation

Abstract: To enhance the semantic discrimination capability in point cloud semantic segmentation, a 3D point cloud semantic segmentation network named PL-Mamba is proposed, which is centered on the fusion of point cloud (P) and language (L) dual modalities. This method takes PointMamba as the backbone network, leveraging its excellent long-sequence modeling and global perception capabilities. It introduces a language prompt mechanism and uses a pretrained language model BERT to encode the context of category labels, obtaining semantically rich text features. The text information serves as a language guided token and is deeply integrated with point cloud features through cross modal …

Dehpr: A Diffusion-Based End-To-End Hand Pose Reconstruction Network, Guoqiong Liao, Longjie Huang, Qingxin Li, Jiajun Zhang, Kefan Chen

Journal of System Simulation

Abstract: Traditional methods such as convolutional neural networks (CNNs) and Transformers suffer from strong dependence on large-scale annotated data and limited generalization capability when dealing with hand pose reconstruction in complex scenarios. To address these issues, a diffusion-based end-to-end hand pose reconstruction network (DEHPR) is proposed. This method employs a diffusion model to directly generate and refine 3D predictions, thereby reducing spatial uncertainties inherent in 2D-to-3D modeling paradigms. By incorporating an end-to-end framework that reprojects multiple 3D candidate predictions to select optimal joint positions, the approach ultimately produces accurate hand pose estimations. Comprehensive evaluations conducted on HO3D V2, DexYCB, …

Cross-Domain Crowd Counting Model Based On Frequency Domain Enhancement, De Zhang, Zishan Liang, Ningning Liu

Journal of System Simulation

Abstract: Crowd counting takes video surveillance data as input and can be applied to the construction of city digital twin platforms, virtual city modeling and smart city management, etc. However, when there are data domain differences between the application scenario and training scenario, counting performance often significantly decreases. A cross-domain crowd counting model based on frequency domain enhancement is proposed. To alleviate the distribution differences between domains, a frequency domain feature enhancement module and a domain invariant frequency domain adapter module are constructed: the former uses discrete cosine transform to extract key statistical features to enhance spatial representation ability, while …

Research On Real-Time Animatable Human Avatar Generation Via 3d Gaussian Splatting, Yuyou Zhong, Xukun Shen, Yong Hu

Journal of System Simulation

Abstract: Real-time animatable 3D human avatar generation technology hold significant application value in fields such as virtual reality and remote collaboration. To address the limitations of existing methods in detail modeling, real-time performance, and robustness under novel pose driving, an efficient human avatar generation and driving method based on 3D Gaussian splatting (3DGS) is proposed. This method integrates optimized parametric human reconstruction, tri-plane feature encoding, and dynamic offset prediction to achieve efficient modeling from monocular video input. By introducing a skeleton binding and visibility analysis strategy, while designing a multi-scale regularization loss to address the overfitting problem. Simulation experiments demonstrate …

Inverse Kinematics 3d Human Modeling Simulation Based On Multi-View Vision, Guoyu Fang, Yanze Li, Kai Chen, Xiaodong Zhao, Zizhuo Hu, Mingshi Yang, Wanqing Wu, Zichen Wang, Wenkai Guo

Journal of System Simulation

Abstract: In autonomous driving simulation and industrial virtual reality simulation, there is a high demand for accuracy and robustness in 3D human body modeling. However, current joint-based human modeling approaches suffer from issues such as continuous modeling jitter, local distortion, and poor adaptability to occlusion, which degrade model quality and limit the development of practical applications such as intelligent driving and digital factories. To address these challenges, this paper proposes a multi-view vision-based inverse kinematics 3D human modeling method using a vector quantized variational autoencoder(IK-VQ-VAE). By integrating joint training with an automatic variational gradient descent approach, the proposed method achieves …

A Specification-Driven Framework For Self-Supervised Learning In Specialized Vision Domains, Mahmut S. Gokmen

Theses and Dissertations--Computer Science

Self-supervised learning (SSL) has emerged as a principled approach to visual representation learning that derives supervisory signal directly from unlabeled data, enabling foundation models to be trained at scale without manual annotation. Deployments in medical imaging and biometric recognition have demonstrated the potential of this paradigm, yet the assumptions that make SSL effective on natural image benchmarks fail systematically in specialized domains. Generic SSL pipelines encode a tacit assumption that the most informative correspondence is spatial proximity within a single acquisition. In specialized domains this assumption breaks at the level of the data-generating process: the signal that carries domain-specific information …

A Web-Based Wizard-Of-Oz Platform For Collaborative And Reproducible Human-Robot Interaction Research, Sean O'Connor

Honors Theses

The Wizard-of-Oz (WoZ) technique is widely used in Human-Robot Interaction (HRI) research, but two persistent problems limit its effectiveness: existing tools impose technical barriers that exclude non-engineering domain experts (the Accessibility Problem), and the fragmented landscape of robot-specific implementations makes interaction scripts difficult to port across platforms (the Reproducibility Problem- concerning execution consistency and portability, not third-party replication). Through a literature review, I identified three design principles to address both: a hierarchical specification model, an event-driven execution model, and a plugin architecture that decouples experiment logic from robot-specific implementations. I realized these principles in HRIStudio, an open-source, web-based platform providing …

Handwriting Recognition In Vr, Dominique Mosley

EWU Masters Thesis Collection

Virtual Reality (VR) is slowly becoming more popular for more than just entertainment. VR can be found in educational, office, and even healthcare settings to help discover more intuitive ways to teach, collaborate, and treat patients. Outside of the virtual world, these environments typically rely on writing for communicating or note-taking. Currently, VR input forces users to rely on clunky on-screen keyboards which disrupts the user’s immersion and breaks the flow of natural interaction. This thesis explores the potential of VR as a learning platform by combining it with artificial intelligence (AI). It aims to develop a VR-enhanced handwriting practicing …

A Novel Federated Llm Framework For Distributed Traffic Modelling In Intelligent Transportation Systems, Seerat Kaur

Theses and Dissertations (Comprehensive)

Intelligent transportation systems (ITS) depend on accurate traffic prediction to support congestion management, infrastructure planning, and real-time operational decisions. Despite substantial progress in data-driven forecasting, several challenges continue to limit practical deployment: traffic data is distributed across independent regional authorities, making centralized aggregation infeasible, standard federated aggregation strategies ignore traffic-specific characteristics that meaningfully affect model quality, and existing models produce only numerical outputs without interpretable reasoning that urban planners can act upon. This thesis addresses these challenges through four contributions that collectively advance privacy-preserving, explainable, and scalable traffic forecasting.

The first contribution provides a systematic review of 129 peer-reviewed publications, …

Measurement Of Luminous Intensity Distribution For Film And Television Led Light Sources And Its Simulation Research In Game Engines, Jingyi Suo, Baihong Lu, Che Qu

Journal of System Simulation

Abstract: To address the issues of mismatched photometric characteristics between light sources in virtual environments and real-world lighting during film and television lighting design and lighting preview using game engines, a testing solution for measuring the luminous intensity distribution for film and television LED light sources was proposed, building upon existing luminaire light intensity distribution testing systems. Based on the obtained data, a light source calibration process was constructed in the UE5 to correctly simulate the photometric characteristics of light sources in the virtual environment. Simulation results have shown that the calibration process can accurately and efficiently reproduce the …

Improved Pid Search Algorithm For Uav Path Planning In Mountainous Environments, Yi Peng, Yunkui Lei, Qingqing Yang, Hui Li, Jianming Wang

Journal of System Simulation

Abstract: To address the challenges of UAV path planning in mountainous environments, including high computational complexity and suboptimal optimization performance, and the disadvantages of the PIDbased search algorithm, such as low optimization accuracy and slow convergence rate, this paper proposed an improved PID search algorithm (IPSA). The method introduced a good point set to ensure a more uniform population distribution, thereby enhancing population diversity and global search capability. The Q-learning algorithm was employed to adapt PID parameter adjustments, incorporating an exploration rate factor to further improve the algorithm's exploration and computational capabilities. A lens imaging opposition-based learning mechanism was also …

Dynamic Characteristic Simulation And Optimization Of Ground Test System For Airborne Launch Rack, Yuguang Bai, Sheng Zhang, Yushun Cao, Xiaoshi Zhang, Hu Huang

Journal of System Simulation

Abstract: To solve the ground equivalent test problem of the airborne launch system, an optimization method for the dynamic characteristics of the ground launch rack test system based on a multi-variable optimization approach was proposed. Through the discussion on the boundary conditions of the foundation, an effective dynamic simulation model of the ground launch test system was established. By comparing the dynamic characteristics of the launch rack structure in the airborne state and the ground test state, the objectives and constraints of the optimization design were determined. The dynamic characteristics of the ground test system were optimized and designed. …

Optimization Of Dynamic Weapon Target Assignment Considering Random Disturbances, Zhenzu Bai, Yizhi Hou, Zhangming He, Juhui Wei, Haiyin Zhou, Jiongqi Wang

Journal of System Simulation

Abstract: The impact of various random disturbances in the actual command and control environment of unmanned systems on problem modeling and solving of weapon target assignment was considered, and three types of uncertainty disturbance constraints were investigated. A multi-objective dynamic sensor weapon target assignment model was established. By considering the issues of model property changes caused by disturbances and insufficient robustness of the traditional single-operator solving algorithm, a multi-operator constrained multi-objective evolutionary framework based on the deep Q-network was proposed. The algorithm described the convergence, diversity, and feasibility of the population in both the objective and decision spaces. It established …

Fault Diagnosis Method For Photovoltaic Systems Based On Multi-Strategy Fusion, Bin Li, Yuchuo Wang

Journal of System Simulation

Abstract: To address the problem of frequent PV system faults, a multimodal fusion fault diagnosis model based on the optimization of the improved lemming algorithm was proposed. The one-dimensional time series signals of PV currents and voltages were converted into two-dimensional images by Markov transformation field, and the spatial features of the original waveforms were mined by using multiscale CNN (MCCNN); BiGRU was used to extract the temporal dynamic features of the original waveforms, and complementary enhancement of the temporal and spatial features was realized by the feature fusion layer. The improved lemming algorithm was innovatively introduced to adaptively optimize …

Survey Of Cooperative Multi-Agent Path Finding, Jun Xiong, Wenbo Zhang, Zhi Xiong, Feng Zhou, Bo Yang

Journal of System Simulation

Abstract: Cooperative multi-agent path finding (Co-MAPF) has been widely applied in fields such as UAV formation and multi-agent systems, which enhances the overall system efficiency through task collaboration, path planning, and task execution among multiple agents. This paper introduced three main system architectures, namely centralized, distributed, and hybrid, along with their advantages and disadvantages based on the definition of the Co-MAPF problem, categorized, and reviewed mainstream Co-MAPF algorithms, including those based on sampling, search, intelligent optimization, and learning. Furthermore, this paper analyzed the main current challenges faced by Co-MAPF algorithms on the basis of summarizing existing research and outlined the …

Numerical Simulations Of Ship Liquid Tank Sloshing Based On Graph Neural Networks, Wenkang Zhang, Xiaofeng Sun, Yiping Zhong, Yong Yin

Journal of System Simulation

Abstract: To address the high consumption of computational resources in simulating ship liquid tank sloshing using computational fluid dynamics simulation methods, a data-driven numerical simulation model was proposed based on graph neural networks. An encoder-processor-decoder framework was employed in the proposed model. The encoder extracted features of fluid particles from the first five time steps. The processor learnt latent motion patterns of fluid and updated features, and the decoder predicted features of particles at subsequent time steps. The processor incorporated a self-attention mechanism to enable dynamic adjacency weight allocation and emphasize the influence of irregular tank wall regions. Training …

Optimization Of Order Picking And Sorting Coordintion In “Goods-To-Person” System, Liang Ren, Zerong Zhou, Yunfeng Ma

Journal of System Simulation

Abstract: To improve the order picking and sorting collaboration with time windows in the "goods-to-person" system, a mathematical model aiming to minimize the number of sorting batches was established. With the characteristics of this issue considered, a hybrid variable neighborhood search (HVNS) algorithm based on the "classified loading" strategy was proposed for solutions. The numerical experimental results show that the HVNS algorithm can obtain high-quality solutions while shortening the solution time; different order structures have varying effects on the utilization of the loading capacity of sorting automated guided vehicles (AGVs); under the tested experimental conditions, the collaborative operation mode …

Lightweight Assembly Workpiece Detection Algorithm Based On Improved Yolov8, Shuheng Wu, Yongkui Liu, Lin Zhang, Yingying Xiao, Lihui Wang

Journal of System Simulation

Abstract: To address the issues of low recognition accuracy and slow detection speed with existing deep learning-based object detection algorithms for robotic automatic assembly tasks, a lightweight assembly workpiece object detection algorithm based on YOLOv8 was proposed. The PConv was introduced to improve the C2f module, and a new Faster_C2f module was designed to enhance the detection speed of the model. The SIoU loss function was employed to optimize the location prediction accuracy of the CIoU loss function and improve the localization accuracy of small targets. The high-level screening-feature fusion pyramid networks (HS-FPN) structure was used to improve the Neck …

Interoperability Model And Application Of Military Training System For Combination Of Virtuality And Reality, Jianxing Gong, Hai Hu, Haihui Ren, Ruixiang Wu

Journal of System Simulation

Abstract: With the development of AI technology, VR technology, and combat simulation technology, in order to achieve the practical training effect of "how to fight and how to train soldiers", virtual and real training has become a widely popular military training mode. It has become a trend to integrate digital systems, virtual equipment, semi-physical models, physical models, and other heterogeneous systems to carry out training in the same training environment. Therefore, it is necessary to study the interoperability model and application of training systems for the combination of virtuality and reality. This paper proposed the definition of interoperability between virtuality …

Research On Infrared And Visible Light Fusion Method Based On Resnet-50 And Laplacian Filtering, Xiao Wang, Xiangyang Li, Feng Liang, Zhili Zhang

Journal of System Simulation

Abstract: In order to solve the problem that existing infrared and visible light image fusion techniques often suffer from artifacts caused by insufficient contrast, spectral distortion, and high computational complexity, a fusion framework based on ResNet-50 and Laplacian filtering was proposed. ResNet-50 was used to extract shallow and deep features, followed by multi-scale feature fusion. Laplacian filtering was applied to optimize feature information, and an automatic discriminator was introduced to further improve the fusion effect. Simulation results show that, compared with comparison algorithms, the proposed method achieves an average increase of 2.71% and 2.16% in information entropy, 5.98% and …

Analysis Of Optimal Spectral Bands For Thermal Infrared Hyperspectral Image Reconstruction Driven By Physical Simulation Model, Yonghao Yang, Xiaoyu He

Journal of System Simulation

Abstract: To achieve accurate reconstruction of thermal infrared hyperspectral images under limited spectral bands, this paper proposed a reconstruction method based on physical modeling and simulation. Semi-global decomposition algorithm was adopted to invert the thermophysical properties of the scenario based on the physical model of thermal radiation, simulating and generating full-band hyperspectral data. An optimal spectral band selection strategy driven by a physical model was proposed, which integrated the sensitivity of temperature inversion and the separability of material spectra. Experiments were conducted on both simulated and measured datasets to evaluate the performance of material identification, temperature inversion, and spectral …

Research On Pac-Bayes-Based A2c Algorithm For Multi-Objective Reinforcement Learning, Xiang Liu, Qiankun Jin

Journal of System Simulation

Abstract: To address the theoretical challenges of exploration and exploitation trade-offs and uncertainty modeling in multi-objective reinforcement learning (MORL), this study developed a learning framework, MO-PAC, based on PAC-Bayes theory. By introducing a multi-objective stochastic Critic network and a dynamic preference mechanism, the framework extended the conventional A2C architecture, enabling adaptive and efficient approximation of complex Pareto fronts. Experimental results demonstrate that in multi-objective MuJoCo environments, MO-PAC outperforms baseline algorithms, achieving approximately 20% improvement in hypervolume and 60% increase in expected utility, while exhibiting superior convergence efficiency and robustness. It verifies both theoretical value and practical performance advantages in …

Robust Emergency Dispatch Method Considering Dynamic Frequency Security And N-K Contingency, Tao Huang, Zhi Zhang, Yujie Ding, Yanbo Chen, Jing Wang, Wenqian Zhang

Journal of System Simulation

Abstract: To address the risk of system inertia loss and frequency instability caused by grid integration of high-proportioned new energy and unit failures, an N-k robust emergency dispatch method considering dynamic frequency security constraints was proposed. With the consideration of the frequency response characteristics of variable-speed pumped storage, a dynamic frequency response model incorporating variable-speed pumped storage was constructed, and the nadir frequency constraint was established through second-order cone transformation. Information entropy theory was employed to quantify the uncertainty of unit failures, and an uncertainty set considering N-k unit failures was developed. A twostage robust emergency dispatch model considering N-k …

Scheduling Method For Virtual Power Plants Based On Analysis And Forecasting Of Heterogeneous Load Characteristics, Runzhao Zhang, Yanbo Chen, Tao Huang, Haoxin Tian, Tuben Qiang, Zhi Zhang

Journal of System Simulation

Abstract: To improve the electricity supply-demand situation by rationally utilizing demand response resources, a two-layer optimal scheduling model for virtual power plants (VPPs) based on the analysis and forecasting of heterogeneous load characteristics was proposed. With the differences in response characteristics of multi-type loads considered, a demand response model for multi-type loads was constructed by using a customer baseline load (CBL) curve forecasting method that integrated dynamic scenario generation and K-means++ clustering. A two-layer optimal scheduling model for VPPs that incorporated load aggregators and demand response was established. In this model, the upper layer conducted optimal scheduling targeting maximizing the …

Vibration Control Of Offshore Wind Turbine Towers Based On Eddy Current Nonlinear Energy Sink, Xiangxing Yu, Yandong Zhao, Baolin Zhang

Journal of System Simulation

Abstract: To address the issue of tower vibrations induced by wind loads, which can damage the structure of wind turbines, a vibration control method for monopile offshore wind turbine towers based on an eddy current-nonlinear energy sink (EC-NES) was proposed. The dynamic model of monopile offshore wind turbines based on EC-NES was constructed according to the Euler-Lagrange equation, and based on the output response of FAST software, the unknown parameters of the model and the wind loads were identified in terms of parameters. The optimal parameters of EC-NES stiffness and damping were obtained using PSO. The eddy current damper …