Artificial Intelligence and Robotics Commons^™

Material Reconstruction From Single Image Combining Neural Networks With Singular Value Decomposition, Zhiqiang Li, Xukun Shen, Yong Hu, Xueyang Zhou, Yifan Chen

Journal of System Simulation

Abstract: The tabulated BRDFs (bidirectional reflectance distribution function) can realistically reproduce the surface appearance of objects. However, due to their high-dimensional characteristics and the fact that a single planar image contains limited reflectance information and small differences, methods for estimating tabulated BRDFs typically require complex equipment or the capture of multiple images. To address this issue, a method is proposed for reconstructing material properties from a single image by combining neural networks with singular value decomposition. The singular value decomposition is introduced to compress the material into a lower-dimensional space. The task of solving the tabulated BRDFs is simplified to …

Full-Body Co-Speech Gesture Generation Based On Spatial-Temporal Enhanced Generation Model, Shuozhe Zhang, Wenfeng Song, Xia Hou, Shuai Li

Journal of System Simulation

Abstract: Full-body co-speech gesture generation significantly enhances the interactivity of virtual digital humans, requiring generated gestures to not only align accurately with speech but also demonstrate realistic full-body dynamics. To address limitations of existing methods—Transformer-based approaches often overlook temporal features of action sequences, while diffusion model-based ones inadequately capture spatial correlations between body parts, a full-body action generation method integrating diffusion models, Mamba, and attention mechanisms is proposed. We introduce the spatial self-attention-temporal state space model (STMamba Layer) as the core of denoising network to extract
inter-part spatial features and intra-part temporal features, thus enhancing action quality and diversity. …

Vrbt: Vr Badminton Training With Multitask Injury Alerts Based On Lightweight 3d Skeletal Reconstruction, Yuning Zhu, Meng Yang, Tianyue Chen, Weiliang Meng

Journal of System Simulation

Abstract: To overcome the limitations of traditional badminton training, a VR training method that integrates multiple models for collaborative simulation is proposed. A "perception-decision- interaction" framework is developed within Unity, featuring diverse training modules powered by a physics engine for realistic trajectory simulation. The system employs a lightweight MHFormer for 3D pose estimation and a novel multi-task model (enhanced injury prediction system, EIPS) that combines random forest and XGBoost to jointly assess injury risk. This approach offers a solution for balancing real-time performance with accuracy in skeleton reconstruction and enables personalized training through dynamic risk assessment.

Inverse Kinematics 3d Human Modeling Simulation Based On Multi-View Vision, Guoyu Fang, Yanze Li, Kai Chen, Xiaodong Zhao, Zizhuo Hu, Mingshi Yang, Wanqing Wu, Zichen Wang, Wenkai Guo

Journal of System Simulation

Abstract: In autonomous driving simulation and industrial virtual reality simulation, there is a high demand for accuracy and robustness in 3D human body modeling. However, current joint-based human modeling approaches suffer from issues such as continuous modeling jitter, local distortion, and poor adaptability to occlusion, which degrade model quality and limit the development of practical applications such as intelligent driving and digital factories. To address these challenges, this paper proposes a multi-view vision-based inverse kinematics 3D human modeling method using a vector quantized variational autoencoder(IK-VQ-VAE). By integrating joint training with an automatic variational gradient descent approach, the proposed method achieves …

Military Metaverse: Conceptual Connotation, Construction And Application Framework, Key Issues, Dayong Liu, Zhiming Dong, Jiancheng Gao

Journal of System Simulation

Abstract: Based on the analysis of the concept of the metaverse, the military metaverse concept model is established and compared with virtual-real fusion systems such as the digital twin battlefield, analyzing its core characteristics and construction significance. To accelerate the construction of the military metaverse, an overall logical architecture for the construction and application of the military metaverse is designed, the concept of military metaverse primitives is proposed, and the technical architecture is designed. The main application directions of the military metaverse are analyzed, and the construction stage division and overall thinking are provided. The key issues in construction and …

Virtual-Real Fusion Simulation Technology And Application Research For Industrial Control Systems Cybersecurity Of Process Manufacturing, Xinwei Wang, Jinjiang Wang, Zheng Wang, Laibin Zhang

Journal of System Simulation

Abstract: Aiming at the problem that the industrial control system in the process manufacturing industry lacks an effective attack and defense drill platform when facing network attacks, it is difficult to truly simulate the attack situation, verify the protective measures, and accurately evaluate the impact of attacks on the physical system, an industrial control cybersecurity simulation technology based on virtual-real fusion is proposed to build an efficient attack and defense drill range. The industrial control cybersecurity simulation architecture based on virtual-real fusion is designed, and the consistency analysis of virtual-real fusion data is carried out. At the same time, …

Spatio-Temporal Swin Transformer-Based Flow-Solid Coupling Interaction Sequence Image Prediction Network, Changjun Zou, Zhiyu Ge, Chenxi Zhong

Journal of System Simulation

Abstract: To address limitations in modeling long-term dependencies and multi-scale features in fluidstructure interaction scenarios, a spatiotemporal deep learning model (SwinLSTM) integrating ConvLSTM and Swin Transformer is proposed. The model employs a gated spatiotemporal attention mechanism that dynamically embeds Swin Transformer's window-based multi-head self-attention into ConvLSTM's output gate, enabling adaptive temporal-spatial feature coupling, and designs a multi-level ConvLSTM framework to hierarchically capture complex spatiotemporal correlations. Experiments on a self-built fluid-interaction dataset show that our method achieves the highest PSNR and leading SSIM scores, with superior performance in preserving vortex details and boundary consistency. This work provides an efficient solution …

Pl-Mamba: A 3d Point Cloud Semantic Segmentation Network Based On Bimodal Fusion, He Zhu, Feng Zhou, Mengxiao Zhu, Ju Dai

Journal of System Simulation

Abstract: To enhance the semantic discrimination capability in point cloud semantic segmentation, a 3D point cloud semantic segmentation network named PL-Mamba is proposed, which is centered on the fusion of point cloud (P) and language (L) dual modalities. This method takes PointMamba as the backbone network, leveraging its excellent long-sequence modeling and global perception capabilities. It introduces a language prompt mechanism and uses a pretrained language model BERT to encode the context of category labels, obtaining semantically rich text features. The text information serves as a language guided token and is deeply integrated with point cloud features through cross modal …

Dehpr: A Diffusion-Based End-To-End Hand Pose Reconstruction Network, Guoqiong Liao, Longjie Huang, Qingxin Li, Jiajun Zhang, Kefan Chen

Journal of System Simulation

Abstract: Traditional methods such as convolutional neural networks (CNNs) and Transformers suffer from strong dependence on large-scale annotated data and limited generalization capability when dealing with hand pose reconstruction in complex scenarios. To address these issues, a diffusion-based end-to-end hand pose reconstruction network (DEHPR) is proposed. This method employs a diffusion model to directly generate and refine 3D predictions, thereby reducing spatial uncertainties inherent in 2D-to-3D modeling paradigms. By incorporating an end-to-end framework that reprojects multiple 3D candidate predictions to select optimal joint positions, the approach ultimately produces accurate hand pose estimations. Comprehensive evaluations conducted on HO3D V2, DexYCB, …

Cross-Domain Crowd Counting Model Based On Frequency Domain Enhancement, De Zhang, Zishan Liang, Ningning Liu

Journal of System Simulation

Abstract: Crowd counting takes video surveillance data as input and can be applied to the construction of city digital twin platforms, virtual city modeling and smart city management, etc. However, when there are data domain differences between the application scenario and training scenario, counting performance often significantly decreases. A cross-domain crowd counting model based on frequency domain enhancement is proposed. To alleviate the distribution differences between domains, a frequency domain feature enhancement module and a domain invariant frequency domain adapter module are constructed: the former uses discrete cosine transform to extract key statistical features to enhance spatial representation ability, while …

Research On Real-Time Animatable Human Avatar Generation Via 3d Gaussian Splatting, Yuyou Zhong, Xukun Shen, Yong Hu

Journal of System Simulation

Abstract: Real-time animatable 3D human avatar generation technology hold significant application value in fields such as virtual reality and remote collaboration. To address the limitations of existing methods in detail modeling, real-time performance, and robustness under novel pose driving, an efficient human avatar generation and driving method based on 3D Gaussian splatting (3DGS) is proposed. This method integrates optimized parametric human reconstruction, tri-plane feature encoding, and dynamic offset prediction to achieve efficient modeling from monocular video input. By introducing a skeleton binding and visibility analysis strategy, while designing a multi-scale regularization loss to address the overfitting problem. Simulation experiments demonstrate …

A Specification-Driven Framework For Self-Supervised Learning In Specialized Vision Domains, Mahmut S. Gokmen

Theses and Dissertations--Computer Science

Self-supervised learning (SSL) has emerged as a principled approach to visual representation learning that derives supervisory signal directly from unlabeled data, enabling foundation models to be trained at scale without manual annotation. Deployments in medical imaging and biometric recognition have demonstrated the potential of this paradigm, yet the assumptions that make SSL effective on natural image benchmarks fail systematically in specialized domains. Generic SSL pipelines encode a tacit assumption that the most informative correspondence is spatial proximity within a single acquisition. In specialized domains this assumption breaks at the level of the data-generating process: the signal that carries domain-specific information …

Designing Narrative-Based Ai Assistance For Sensemaking In Collaborative Environments: Case Studies In Education And Dementia Care, Dylan Edward Moore

Dartmouth College Ph.D Dissertations

This thesis addresses a gap in the human-computer interaction literature regarding the design, development, and evaluation of narrative-based AI assistance for collaborative, complex problem solving. I explore this design space through three case studies across the domains of education and dementia care. This work encompasses multi-year industry partnerships and longitudinal fieldwork, user-centered design, dataset curation, model training, and system evaluation.

Specifically, the first case study considers a story-based web platform for teaching AI literacy through peer-generated, personalized narrative scaffolding. Learners on the platform showed significant knowledge gains and other learning-related outcomes. To describe the novel design of this system, I …

A Web-Based Wizard-Of-Oz Platform For Collaborative And Reproducible Human-Robot Interaction Research, Sean O'Connor

Honors Theses

The Wizard-of-Oz (WoZ) technique is widely used in Human-Robot Interaction (HRI) research, but two persistent problems limit its effectiveness: existing tools impose technical barriers that exclude non-engineering domain experts (the Accessibility Problem), and the fragmented landscape of robot-specific implementations makes interaction scripts difficult to port across platforms (the Reproducibility Problem- concerning execution consistency and portability, not third-party replication). Through a literature review, I identified three design principles to address both: a hierarchical specification model, an event-driven execution model, and a plugin architecture that decouples experiment logic from robot-specific implementations. I realized these principles in HRIStudio, an open-source, web-based platform providing …

Handwriting Recognition In Vr, Dominique Mosley

EWU Masters Thesis Collection

Virtual Reality (VR) is slowly becoming more popular for more than just entertainment. VR can be found in educational, office, and even healthcare settings to help discover more intuitive ways to teach, collaborate, and treat patients. Outside of the virtual world, these environments typically rely on writing for communicating or note-taking. Currently, VR input forces users to rely on clunky on-screen keyboards which disrupts the user’s immersion and breaks the flow of natural interaction. This thesis explores the potential of VR as a learning platform by combining it with artificial intelligence (AI). It aims to develop a VR-enhanced handwriting practicing …

A Novel Federated Llm Framework For Distributed Traffic Modelling In Intelligent Transportation Systems, Seerat Kaur

Theses and Dissertations (Comprehensive)

Intelligent transportation systems (ITS) depend on accurate traffic prediction to support congestion management, infrastructure planning, and real-time operational decisions. Despite substantial progress in data-driven forecasting, several challenges continue to limit practical deployment: traffic data is distributed across independent regional authorities, making centralized aggregation infeasible, standard federated aggregation strategies ignore traffic-specific characteristics that meaningfully affect model quality, and existing models produce only numerical outputs without interpretable reasoning that urban planners can act upon. This thesis addresses these challenges through four contributions that collectively advance privacy-preserving, explainable, and scalable traffic forecasting.

The first contribution provides a systematic review of 129 peer-reviewed publications, …

Improved Pid Search Algorithm For Uav Path Planning In Mountainous Environments, Yi Peng, Yunkui Lei, Qingqing Yang, Hui Li, Jianming Wang

Journal of System Simulation

Abstract: To address the challenges of UAV path planning in mountainous environments, including high computational complexity and suboptimal optimization performance, and the disadvantages of the PIDbased search algorithm, such as low optimization accuracy and slow convergence rate, this paper proposed an improved PID search algorithm (IPSA). The method introduced a good point set to ensure a more uniform population distribution, thereby enhancing population diversity and global search capability. The Q-learning algorithm was employed to adapt PID parameter adjustments, incorporating an exploration rate factor to further improve the algorithm's exploration and computational capabilities. A lens imaging opposition-based learning mechanism was also …

Dynamic Characteristic Simulation And Optimization Of Ground Test System For Airborne Launch Rack, Yuguang Bai, Sheng Zhang, Yushun Cao, Xiaoshi Zhang, Hu Huang

Journal of System Simulation

Abstract: To solve the ground equivalent test problem of the airborne launch system, an optimization method for the dynamic characteristics of the ground launch rack test system based on a multi-variable optimization approach was proposed. Through the discussion on the boundary conditions of the foundation, an effective dynamic simulation model of the ground launch test system was established. By comparing the dynamic characteristics of the launch rack structure in the airborne state and the ground test state, the objectives and constraints of the optimization design were determined. The dynamic characteristics of the ground test system were optimized and designed. …

Optimization Of Dynamic Weapon Target Assignment Considering Random Disturbances, Zhenzu Bai, Yizhi Hou, Zhangming He, Juhui Wei, Haiyin Zhou, Jiongqi Wang

Journal of System Simulation

Abstract: The impact of various random disturbances in the actual command and control environment of unmanned systems on problem modeling and solving of weapon target assignment was considered, and three types of uncertainty disturbance constraints were investigated. A multi-objective dynamic sensor weapon target assignment model was established. By considering the issues of model property changes caused by disturbances and insufficient robustness of the traditional single-operator solving algorithm, a multi-operator constrained multi-objective evolutionary framework based on the deep Q-network was proposed. The algorithm described the convergence, diversity, and feasibility of the population in both the objective and decision spaces. It established …

Survey Of Cooperative Multi-Agent Path Finding, Jun Xiong, Wenbo Zhang, Zhi Xiong, Feng Zhou, Bo Yang

Journal of System Simulation

Abstract: Cooperative multi-agent path finding (Co-MAPF) has been widely applied in fields such as UAV formation and multi-agent systems, which enhances the overall system efficiency through task collaboration, path planning, and task execution among multiple agents. This paper introduced three main system architectures, namely centralized, distributed, and hybrid, along with their advantages and disadvantages based on the definition of the Co-MAPF problem, categorized, and reviewed mainstream Co-MAPF algorithms, including those based on sampling, search, intelligent optimization, and learning. Furthermore, this paper analyzed the main current challenges faced by Co-MAPF algorithms on the basis of summarizing existing research and outlined the …

Optimization Of Order Picking And Sorting Coordintion In “Goods-To-Person” System, Liang Ren, Zerong Zhou, Yunfeng Ma

Journal of System Simulation

Abstract: To improve the order picking and sorting collaboration with time windows in the "goods-to-person" system, a mathematical model aiming to minimize the number of sorting batches was established. With the characteristics of this issue considered, a hybrid variable neighborhood search (HVNS) algorithm based on the "classified loading" strategy was proposed for solutions. The numerical experimental results show that the HVNS algorithm can obtain high-quality solutions while shortening the solution time; different order structures have varying effects on the utilization of the loading capacity of sorting automated guided vehicles (AGVs); under the tested experimental conditions, the collaborative operation mode …

Interoperability Model And Application Of Military Training System For Combination Of Virtuality And Reality, Jianxing Gong, Hai Hu, Haihui Ren, Ruixiang Wu

Journal of System Simulation

Abstract: With the development of AI technology, VR technology, and combat simulation technology, in order to achieve the practical training effect of "how to fight and how to train soldiers", virtual and real training has become a widely popular military training mode. It has become a trend to integrate digital systems, virtual equipment, semi-physical models, physical models, and other heterogeneous systems to carry out training in the same training environment. Therefore, it is necessary to study the interoperability model and application of training systems for the combination of virtuality and reality. This paper proposed the definition of interoperability between virtuality …

Research On Infrared And Visible Light Fusion Method Based On Resnet-50 And Laplacian Filtering, Xiao Wang, Xiangyang Li, Feng Liang, Zhili Zhang

Journal of System Simulation

Abstract: In order to solve the problem that existing infrared and visible light image fusion techniques often suffer from artifacts caused by insufficient contrast, spectral distortion, and high computational complexity, a fusion framework based on ResNet-50 and Laplacian filtering was proposed. ResNet-50 was used to extract shallow and deep features, followed by multi-scale feature fusion. Laplacian filtering was applied to optimize feature information, and an automatic discriminator was introduced to further improve the fusion effect. Simulation results show that, compared with comparison algorithms, the proposed method achieves an average increase of 2.71% and 2.16% in information entropy, 5.98% and …

Analysis Of Optimal Spectral Bands For Thermal Infrared Hyperspectral Image Reconstruction Driven By Physical Simulation Model, Yonghao Yang, Xiaoyu He

Journal of System Simulation

Abstract: To achieve accurate reconstruction of thermal infrared hyperspectral images under limited spectral bands, this paper proposed a reconstruction method based on physical modeling and simulation. Semi-global decomposition algorithm was adopted to invert the thermophysical properties of the scenario based on the physical model of thermal radiation, simulating and generating full-band hyperspectral data. An optimal spectral band selection strategy driven by a physical model was proposed, which integrated the sensitivity of temperature inversion and the separability of material spectra. Experiments were conducted on both simulated and measured datasets to evaluate the performance of material identification, temperature inversion, and spectral …

Research On Pac-Bayes-Based A2c Algorithm For Multi-Objective Reinforcement Learning, Xiang Liu, Qiankun Jin

Journal of System Simulation

Abstract: To address the theoretical challenges of exploration and exploitation trade-offs and uncertainty modeling in multi-objective reinforcement learning (MORL), this study developed a learning framework, MO-PAC, based on PAC-Bayes theory. By introducing a multi-objective stochastic Critic network and a dynamic preference mechanism, the framework extended the conventional A2C architecture, enabling adaptive and efficient approximation of complex Pareto fronts. Experimental results demonstrate that in multi-objective MuJoCo environments, MO-PAC outperforms baseline algorithms, achieving approximately 20% improvement in hypervolume and 60% increase in expected utility, while exhibiting superior convergence efficiency and robustness. It verifies both theoretical value and practical performance advantages in …

Dual-Channel Supply Chain Network Equilibrium Model Under Retailers’ Risk Aversion, Hongchun Wang, Caifeng Lin, Xinyi He, Haiyue Yin

Journal of System Simulation

Abstract: To study the network equilibrium problem of dual-channel supply chains under the background of retailers' risk aversion, a dual-channel supply chain network equilibrium model including multiple competitive suppliers, manufacturers, retailers, and demand markets was established. The Mean-CVaR method was employed to quantify retailers' risk aversion characteristics, and variational inequalities were utilized to characterize the equilibrium conditions of decision-makers at each tier of the supply chain. The projection contraction algorithm was applied to solve the model and conduct numerical analysis, thereby revealing the impact of retailers' risk aversion behavior on equilibrium outcomes. The simulation results indicate that a higher …

Spatiotemporal Graph Convolution-Based Demand Forecasting And Simulation Analysis For Automotive Parts Supply Chain, Xiaobin Li, Bing Hu, Chao Yin, Bo Li, Jun Ma

Journal of System Simulation

Abstract: To address complex automotive after-sales parts supply network operations with insufficient demand forecasting accuracy, slow response, and low service efficiency, this study proposed a spatiotemporal graph convolution-based method for automotive parts supply chain demand forecasting. Sales network data of the automotive parts sales network was constructed as a heterogeneous graph, integrating node features like parts sales volume and value to build multi-dimensional node dependencies. A node update mechanism of the graph convolutional neural network was designed, combined with long short-term memory neural networks to capture temporal features, using spatiotemporal attention to integrate temporal and spatial features into updated nodes …

A Method Of Heuristic Human-Llm Collaborative Source Search, Yi Chen, Sihang Qiu, Zhengqiu Zhu, Yatai Ji, Yong Zhao, Rusheng Ju

Journal of System Simulation

Abstract: Traditional source search algorithms are prone to local optimization, and source search methods combining crowdsourcing and human-AI collaboration suffer from low cost-efficiency due to human intervention. In this study, we proposed a lightweight human-AI collaboration framework that utilized multi-modal large language models (MLLMs) to achieve visual-language conversion, combined chain-of-thought (CoT) reasoning to optimize decision-making, and constructed a heuristic strategy that incorporated probability distribution filtering and a balance between exploitation and exploration. The effectiveness of the framework was verified by experiments. The human-AI alignment heuristic strategy with large language model adaptation design provides a new idea to reduce manual …

Robust Emergency Dispatch Method Considering Dynamic Frequency Security And N-K Contingency, Tao Huang, Zhi Zhang, Yujie Ding, Yanbo Chen, Jing Wang, Wenqian Zhang

Journal of System Simulation

Abstract: To address the risk of system inertia loss and frequency instability caused by grid integration of high-proportioned new energy and unit failures, an N-k robust emergency dispatch method considering dynamic frequency security constraints was proposed. With the consideration of the frequency response characteristics of variable-speed pumped storage, a dynamic frequency response model incorporating variable-speed pumped storage was constructed, and the nadir frequency constraint was established through second-order cone transformation. Information entropy theory was employed to quantify the uncertainty of unit failures, and an uncertainty set considering N-k unit failures was developed. A twostage robust emergency dispatch model considering N-k …

Scheduling Method For Virtual Power Plants Based On Analysis And Forecasting Of Heterogeneous Load Characteristics, Runzhao Zhang, Yanbo Chen, Tao Huang, Haoxin Tian, Tuben Qiang, Zhi Zhang

Journal of System Simulation

Abstract: To improve the electricity supply-demand situation by rationally utilizing demand response resources, a two-layer optimal scheduling model for virtual power plants (VPPs) based on the analysis and forecasting of heterogeneous load characteristics was proposed. With the differences in response characteristics of multi-type loads considered, a demand response model for multi-type loads was constructed by using a customer baseline load (CBL) curve forecasting method that integrated dynamic scenario generation and K-means++ clustering. A two-layer optimal scheduling model for VPPs that incorporated load aggregators and demand response was established. In this model, the upper layer conducted optimal scheduling targeting maximizing the …