Open Access. Powered by Scholars. Published by Universities.®

Engineering Commons™

Open Access. Powered by Scholars. Published by Universities.®

Artificial Intelligence and Robotics

Institution
Keyword
Publication Year
Publication
Publication Type
File Type

Articles 1261 - 1290 of 5389

Full-Text Articles in Engineering

Real-Time Simulation Method Of Ultra-High-Definition Video Texture, Yangyang Liu, Gangyi Ding, Dapeng Yan, Tong Xue Aug 2023

Real-Time Simulation Method Of Ultra-High-Definition Video Texture, Yangyang Liu, Gangyi Ding, Dapeng Yan, Tong Xue

Journal of System Simulation

Abstract: With the development and promotion of ultra-high-definition video technology, how to quickly simulate ultra-high-definition video texture has gradually become an important research issue. Aiming at the completeness and high efficiency of simulation, a real-time simulation method of ultra-high-definition video texture is proposed to improve the video texture quality and display frequency simultaneously. A fast generation method of video texture based on GPU parallel is designed, which solves the time-consuming problem of decoding and transcoding. An efficient data transmission method based on shared texture is proposed. On the basis of the simulation engine, the real-time simulation system of ultra-high-definition video …


Research On Nested Named Entity Recognition In Missile Field Text, Jingwen Guan, Xiao Song, Xiaoqing Li, Tong Yang, Junhua Zhou Aug 2023

Research On Nested Named Entity Recognition In Missile Field Text, Jingwen Guan, Xiao Song, Xiaoqing Li, Tong Yang, Junhua Zhou

Journal of System Simulation

Abstract: Compared with the text recognition in conventional fields, it is difficult to recognize the large number of nested named entities in professional terms. This is also one of the care challenges in building the knowledge graph in aerospace field. For the named entity recognition technologies, bidirectional long short-term memory network plus conditional random field (BiLSTM-CRF) is often used to identify entities, which is difficult to distinguish the complex relationships such as nesting and intersection of terms in missile field. In order to solve the problem, based on the nested entity labeling of domain text, a nested named entity recognition …


Robot Path Planning By Fusing Particle Swarm Algorithm And Improved Grey Wolf Algorithm, Menglong Cao, Wenbin Zhao, Zhiqiang Chen Aug 2023

Robot Path Planning By Fusing Particle Swarm Algorithm And Improved Grey Wolf Algorithm, Menglong Cao, Wenbin Zhao, Zhiqiang Chen

Journal of System Simulation

Abstract: Aiming at the long paths and slow convergence speed of GWO algorithm in robot path planning, a hybrid PSO-GWO algorithm based on PSO algorithm and the improved GWO algorithm is proposed. By running PSO algorithm for many times, the initial wolf group size and initial fitness value are determined. A nonlinear convergence factor is introduced to balance the exploration and development capabilities of GWO algorithm, and a dynamic inertia weight factor is proposed to ensure the leadership system of alpha wolf and to promote the population communication. Levy flight and greedy strategy are used to effectively avoid the local …


Monitoring Method Research On Passenger Behavior On Escalator Based On Digital Twin, Nan Lü, Qibing Wang, Lu Jiawei, Juntong Chen, Gang Xiao Aug 2023

Monitoring Method Research On Passenger Behavior On Escalator Based On Digital Twin, Nan Lü, Qibing Wang, Lu Jiawei, Juntong Chen, Gang Xiao

Journal of System Simulation

Abstract: In order to solve the problems that the traditional escalator cannot be monitored and analyzed in real time during operation, the management and maintenance only on escalator equipment side, and the lack of monitoring passenger dangerous behavior, a monitoring method of passenger behavior on escalator based on digital twin is proposed. By constructing the digital twin of escalators, a visual interface is designed to map the escalator running status and passenger behavior data. Through passenger video surveillance, the improved OpenPose posture recognition algorithm is used to obtain the key point data of human body. Posture recognition is classified to …


A Compliant Robot Control Based On Extended Social-Force Model For Human-Following And Obstacle Avoidance, Jianwei Peng, Zhelin Liao, Hanchen Yao, Zhiyu Wan, Liqi Zhu, Houde Dai Aug 2023

A Compliant Robot Control Based On Extended Social-Force Model For Human-Following And Obstacle Avoidance, Jianwei Peng, Zhelin Liao, Hanchen Yao, Zhiyu Wan, Liqi Zhu, Houde Dai

Journal of System Simulation

Abstract: Human-robot coexisting is an essential feature of the next generation mobile robot. A compliant robot control strategy based on the extended social-force model for human-following and obstacle avoidance in coexisting-cooperative-cognitive environment is presented. The human-following controller based on impedance control can simultaneously adjust human-robot interaction force and position deviation to carry out the compliant human-following of mobile robots. Considering humanrobot- obstacle interactions, based on the extended social-force model and proxemics, a control strategy for human-friendly compliant human-following and obstacle avoidance is designed to solve the obstacle avoidance problem of robot and ensure the human comfort and improving the social …


Threads, Buckets, And Impact: A Framework For Tool Accelerated Machine Learning Courses, Jonathan Adam Niemirowski Aug 2023

Threads, Buckets, And Impact: A Framework For Tool Accelerated Machine Learning Courses, Jonathan Adam Niemirowski

Doctoral Dissertations

Artificial intelligence and machine learning (ML) have exploded in use, accessibility, and awareness in the past few years, particularly with the release of ChatGPT in late 2022. Advances in end-user ML tools are accelerating the development of ML applications, lowering the technical barrier of entry for users outside of the computer science (CS) community. Access to ML education within STEM is mostly limited to upper-level computer science courses that have deep pre-requisite requirements or to introductory workshops that yield limited ML skills. Despite the critical need for ML education, there is a lack of guidance in instructional design for applied …


Don't Fear The Artificial Intelligence: A Systematic Review Of Machine Learning For Prostate Cancer Detection In Pathology, Aaryn Frewing, Alexander B. Gibson, Richard Robertson, Paul Urie, Dennis Della Corte Aug 2023

Don't Fear The Artificial Intelligence: A Systematic Review Of Machine Learning For Prostate Cancer Detection In Pathology, Aaryn Frewing, Alexander B. Gibson, Richard Robertson, Paul Urie, Dennis Della Corte

Faculty Publications

The adoption of whole slide image (WSI) scanners in clinical practice was accelerated by US Food and Drug Administration approval in 2017, which allowed primary pathologic diagnoses to be made on scanned images. Images in the digital domain allow the application of pathology artificial intelligence (AI), including clinical decision support with algorithms performing specific diagnoses.1,2 These algorithms, if trained properly, could go beyond the ability of human observation to detect and quantify features that are not recognizable by human perception.1,3,4


Autonomous Shipwreck Detection & Mapping, William Ard Aug 2023

Autonomous Shipwreck Detection & Mapping, William Ard

LSU Master's Theses

This thesis presents the development and testing of Bruce, a low-cost hybrid Remote Operated Vehicle (ROV) / Autonomous Underwater Vehicle (AUV) system for the optical survey of marine archaeological sites, as well as a novel sonar image augmentation strategy for semantic segmentation of shipwrecks. This approach takes side-scan sonar and bathymetry data collected using an EdgeTech 2205 AUV sensor integrated with an Harris Iver3, and generates augmented image data to be used for the semantic segmentation of shipwrecks. It is shown that, due to the feature enhancement capabilities of the proposed shipwreck detection strategy, correctly identified areas have a 15% …


Vertical Federated Learning Using Autoencoders With Applications In Electrocardiograms, Wesley William Chorney Aug 2023

Vertical Federated Learning Using Autoencoders With Applications In Electrocardiograms, Wesley William Chorney

Theses and Dissertations

Federated learning is a framework in machine learning that allows for training a model while maintaining data privacy. Moreover, it allows clients with their own data to collaborate in order to build a stronger, shared model. Federated learning is of particular interest to healthcare data, since it is of the utmost importance to respect patient privacy while still building useful diagnostic tools. However, healthcare data can be complicated — data format might differ across providers, leading to unexpected inputs and incompatibility between different providers. For example, electrocardiograms might differ in sampling rate or number of leads used, meaning that a …


Ide-Based Learning Analytics For Assessing Introductory Programming Skill, Phyllis J. Beck Aug 2023

Ide-Based Learning Analytics For Assessing Introductory Programming Skill, Phyllis J. Beck

Theses and Dissertations

Providing a sufficient level of personalized feedback on students' current level of strategic knowledge within the context of the natural programming environment through IDE-based learning analytics would transform learning outcomes for introductory programming students. However, providing sufficient insight into the programming process was previously inaccessible due to the need for more complex and scalable data collection methods and metrics with a wider variety for understanding programming metacognition and the full programming process.

This research developed a custom-built web-based IDE and event compression system to investigate two of the five components of a five-dimensional model of cognition for programming skill estimation …


Controllable Language Generation Using Deep Learning, Rohola Zandie Aug 2023

Controllable Language Generation Using Deep Learning, Rohola Zandie

Electronic Theses and Dissertations

The advent of deep neural networks has sparked a revolution in Artificial Intelligence (AI), notably with the creation of Transformer models like GPT-X and ChatGPT. These models have surpassed previous methods in various Natural Language Processing (NLP) tasks. As the NLP field evolves, there is a need to further understand and question the capabilities of these models. Text generation, a crucial part of NLP, remains an area where our comprehension is limited while being critical in research.

This dissertation focuses on the challenging problem of controlling the general behaviors of language models such as sentiment, topical focus, and logical reasoning. …


Terrain And Adversary-Aware Autonomous Robot Navigation, Aniekan Ufot Inyang Aug 2023

Terrain And Adversary-Aware Autonomous Robot Navigation, Aniekan Ufot Inyang

Electronic Theses and Dissertations

In autonomous robot navigation, the robot is able to understand the environment around it for intelligent navigation. From its world model of this environment, it generates a global plan for navigation from a position to a goal based on different factors. This research aims to implement autonomous robot navigation by learning terrain affordances: traversability (moving quickly) and concealment (staying hidden from an adversary) using the Preference-based Inverse Reward Learning (PbIRL) methodology. The PbIRL methodology reduces the barrier of generating initial demonstration data to learn the terrain affordances by using a human expert’s preferences to learn individual weights over the terrain …


Towards Intelligent Runtime Framework For Distributed Heterogeneous Systems, Polykarpos Thomadakis Aug 2023

Towards Intelligent Runtime Framework For Distributed Heterogeneous Systems, Polykarpos Thomadakis

Computer Science Theses & Dissertations

Scientific applications strive for increased memory and computing performance, requiring massive amounts of data and time to produce results. Applications utilize large-scale, parallel computing platforms with advanced architectures to accommodate their needs. However, developing performance-portable applications for modern, heterogeneous platforms requires lots of effort and expertise in both the application and systems domains. This is more relevant for unstructured applications whose workflow is not statically predictable due to their heavily data-dependent nature. One possible solution for this problem is the introduction of an intelligent Domain-Specific Language (iDSL) that transparently helps to maintain correctness, hides the idiosyncrasies of lowlevel hardware, and …


Towards A Robust Defense: A Multifaceted Approach To The Detection And Mitigation Of Neural Backdoor Attacks Through Feature Space Exploration And Analysis, Liuwan Zhu Aug 2023

Towards A Robust Defense: A Multifaceted Approach To The Detection And Mitigation Of Neural Backdoor Attacks Through Feature Space Exploration And Analysis, Liuwan Zhu

Electrical & Computer Engineering Theses & Dissertations

From voice assistants to self-driving vehicles, machine learning(ML), especially deep learning, revolutionizes the way we work and live, through the wide adoption in a broad range of applications. Unfortunately, this widespread use makes deep learning-based systems a desirable target for cyberattacks, such as generating adversarial examples to fool a deep learning system to make wrong decisions. In particular, many recent studies have revealed that attackers can corrupt the training of a deep learning model, e.g., through data poisoning, or distribute a deep learning model they created with “backdoors” planted, e.g., distributed as part of a software library, so that the …


Generalizable Deep-Learning-Based Wireless Indoor Localization, Ali Owfi Aug 2023

Generalizable Deep-Learning-Based Wireless Indoor Localization, Ali Owfi

All Theses

The growing interest in indoor localization has been driven by its wide range of applications in areas such as smart homes, industrial automation, and healthcare. With the increasing reliance on wireless devices for location-based services, accurate estimation of device positions within indoor environments has become crucial. Deep learning approaches have shown promise in leveraging wireless parameters like Channel State Information (CSI) and Received Signal Strength Indicator (RSSI) to achieve precise localization. However, despite their success in achieving high accuracy, these deep learning models suffer from limited generalizability, making them unsuitable for deployment in new or dynamic environments without retraining. To …


Seek And Classify: End-To-End Joint Multi-Signal Detection And Classification Using Deep Learning, Prashant Subedi Aug 2023

Seek And Classify: End-To-End Joint Multi-Signal Detection And Classification Using Deep Learning, Prashant Subedi

School of Computing: Dissertations, Theses, and Student Research

The rise in the use of wireless communication has led to the problem of spectrum scarcity in licensed bands. The popularity of Internet of Things (IoT) requires innovative solutions that maximize the use of available spectrum to support the increasing number of connected devices. This thesis tackles two significant problems in wireless communication: the need for efficient spectrum sensing techniques and the scarcity of large, diverse raw in-phase (I) and quadrature (Q) datasets.

The ability to detect and classify modulation of the signals efficiently can enable a cognitive radio to monitor the spectrum activity in real time and utilize unused …


Generalization Through Diversity: Improving Unsupervised Environment Design, Wenjun Li, Pradeep Varakantham, Dexun Li Aug 2023

Generalization Through Diversity: Improving Unsupervised Environment Design, Wenjun Li, Pradeep Varakantham, Dexun Li

Research Collection School Of Computing and Information Systems

Agent decision making using Reinforcement Learning (RL) heavily relies on either a model or simulator of the environment (e.g., moving in an 8x8 maze with three rooms, playing Chess on an 8x8 board). Due to this dependence, small changes in the environment (e.g., positions of obstacles in the maze, size of the board) can severely affect the effectiveness of the policy learned by the agent. To that end, existing work has proposed training RL agents on an adaptive curriculum of environments (generated automatically) to improve performance on out-of-distribution (OOD) test scenarios. Specifically, existing research has employed the potential for the …


Learning To Send Reinforcements: Coordinating Multi-Agent Dynamic Police Patrol Dispatching And Rescheduling Via Reinforcement Learning, Waldy Joe, Hoong Chuin Lau Aug 2023

Learning To Send Reinforcements: Coordinating Multi-Agent Dynamic Police Patrol Dispatching And Rescheduling Via Reinforcement Learning, Waldy Joe, Hoong Chuin Lau

Research Collection School Of Computing and Information Systems

We address the problem of coordinating multiple agents in a dynamic police patrol scheduling via a Reinforcement Learning (RL) approach. Our approach utilizes Multi-Agent Value Function Approximation (MAVFA) with a rescheduling heuristic to learn dispatching and rescheduling policies jointly. Often, police operations are divided into multiple sectors for more effective and efficient operations. In a dynamic setting, incidents occur throughout the day across different sectors, disrupting initially-planned patrol schedules. To maximize policing effectiveness, police agents from different sectors cooperate by sending reinforcements to support one another in their incident response and even routine patrol. This poses an interesting research challenge …


Facial Expression Recognition Using Convolutional Neural Networks (Cnns) And Generative Adversarial Networks (Gans) For Data Augmentation And Image Generation, Shekhar Singh Aug 2023

Facial Expression Recognition Using Convolutional Neural Networks (Cnns) And Generative Adversarial Networks (Gans) For Data Augmentation And Image Generation, Shekhar Singh

UNLV Theses, Dissertations, Professional Papers, and Capstones

Facial expressions play a crucial role in human communication, serving as a powerful means to convey emotions. However, classifying facial expressions using artificial intelligence (AI) can be challenging, especially with small datasets and images. Facial Expression Recognition (FER) is an active area of research, with Convolutional Neural Networks (CNNs) being widely employed for classification. In this research, we propose a CNN-based approach for FER that utilizes both original and augmented datasets to enhance classification accuracy. Experimental results on the FER2013 dataset show test accuracies of 63.39% and 64.59% for the original and augmented datasets, respectively, in a seven-class classification task. …


Characterization And Estimation Of Musculoskeletal Pain Using Machine Learning, Boluwatife Faremi Jul 2023

Characterization And Estimation Of Musculoskeletal Pain Using Machine Learning, Boluwatife Faremi

Master's Theses

Traditional scales utilized for recording pain are known to be highly subjective and biased due to inaccuracies in recollecting actual pain intensities. As a result, machine learning (ML) models that are trained using these scores as ground truth are reported to have low performance for objective pain classification because of the huge disparity between what was felt in moments of pain and the scores recorded afterward.

In the present study, two devices were designed for gathering real-time, continuous in-session subjective pain scores and the recording of the autonomic nervous system (ANS) altered endodermal (EDA) activity. 24 participants were recruited to …


Balanced Blended Space: Foundational Human–Ai Dialogues In A Symmetry-Based Mediation Framework, David Smith Jul 2023

Balanced Blended Space: Foundational Human–Ai Dialogues In A Symmetry-Based Mediation Framework, David Smith

Publications and Research

This working paper documents the early development of the Balanced Blended Space (BBS) framework through a series of iterative interactions between a cognitive agent (human researcher) and a computational agent (AI system) conducted in 2023. The work is motivated by the need for a universal theoretical model capable of describing the integration of physical, virtual, and conceptual spaces, particularly in response to increasing fragmentation across contemporary communication systems.

BBS is proposed as a symmetry-based mediation framework in which relationships between domains—such as physical and virtual space, cognition and computation, and multiple sensory modalities—are treated as structurally equivalent and mappable. Central …


A Hierarchical Optimization Approach For Dynamic Pickup And Delivery Problem With Lifo Constraints, Jianhui Du, Zhiqin Zhang, Xu Wang, Hoong Chuin Lau Jul 2023

A Hierarchical Optimization Approach For Dynamic Pickup And Delivery Problem With Lifo Constraints, Jianhui Du, Zhiqin Zhang, Xu Wang, Hoong Chuin Lau

Research Collection School Of Computing and Information Systems

We consider a dynamic pickup and delivery problem (DPDP) where loading and unloading operations must follow a last in first out (LIFO) sequence. A fleet of vehicles will pick up orders in pickup points and deliver them to destinations. The objective is to minimize the total over-time (that is the amount of time that exceeds the committed delivery time) and total travel distance. Given the dynamics of orders and vehicles, this paper proposes a hierarchical optimization approach based on multiple intuitive yet often-neglected strategies, namely what we term as the urgent strategy, hitchhike strategy and packing-bags strategy. These multiple strategies …


Learning Deep Time-Index Models For Time Series Forecasting, Jiale Gerald Woo, Chenghao Liu, Doyen Sahoo, Akshat Kumar, Steven Hoi Jul 2023

Learning Deep Time-Index Models For Time Series Forecasting, Jiale Gerald Woo, Chenghao Liu, Doyen Sahoo, Akshat Kumar, Steven Hoi

Research Collection School Of Computing and Information Systems

Deep learning has been actively applied to time series forecasting, leading to a deluge of new methods, belonging to the class of historicalvalue models. Yet, despite the attractive properties of time-index models, such as being able to model the continuous nature of underlying time series dynamics, little attention has been given to them. Indeed, while naive deep timeindex models are far more expressive than the manually predefined function representations of classical time-index models, they are inadequate for forecasting, being unable to generalize to unseen time steps due to the lack of inductive bias. In this paper, we propose DeepTime, a …


Imitation Improvement Learning For Large-Scale Capacitated Vehicle Routing Problems, The Viet Bui, Tien Mai Jul 2023

Imitation Improvement Learning For Large-Scale Capacitated Vehicle Routing Problems, The Viet Bui, Tien Mai

Research Collection School Of Computing and Information Systems

Recent works using deep reinforcement learning (RL) to solve routing problems such as the capacitated vehicle routing problem (CVRP) have focused on improvement learning-based methods, which involve improving a given solution until it becomes near-optimal. Although adequate solutions can be achieved for small problem instances, their efficiency degrades for large-scale ones. In this work, we propose a newimprovement learning-based framework based on imitation learning where classical heuristics serve as experts to encourage the policy model to mimic and produce similar or better solutions. Moreover, to improve scalability, we propose Clockwise Clustering, a novel augmented framework for decomposing large-scale CVRP into …


System-Characterized Artificial Intelligence Approaches For Cardiac Cellular Systems And Molecular Signature Analysis, Ziqian Wu Jun 2023

System-Characterized Artificial Intelligence Approaches For Cardiac Cellular Systems And Molecular Signature Analysis, Ziqian Wu

Dartmouth College Ph.D Dissertations

The dissertation presents a significant advancement in the field of cardiac cellular systems and molecular signature systems by employing machine learning and generative artificial intelligence techniques. These methodologies are systematically characterized and applied to address critical challenges in these domains. A novel computational model is developed, which combines machine learning tools and multi-physics models. The main objective of this model is to accurately predict complex cellular dynamics, taking into account the intricate interactions within the cardiac cellular system. Furthermore, a comprehensive framework based on generative adversarial networks (GANs) is proposed. This framework is designed to generate synthetic data that faithfully …


Deep Learning Enhancement And Privacy-Preserving Deep Learning: A Data-Centric Approach, Hung S. Nguyen Jun 2023

Deep Learning Enhancement And Privacy-Preserving Deep Learning: A Data-Centric Approach, Hung S. Nguyen

USF Tampa Graduate Theses and Dissertations

Deep Learning and its applications have become attractive to a lot of research recentlybecause of its capability to capture important information from large amounts of data. While most of the work focuses on finding the best model parameters, improving machine learning performance from data perspective still needs more attention. In this work, we propose techniques to enhance the robustness of deep learning classification by tackling data issue. Specifically, our data processing proposals aim to alleviate the impacts of class-imbalanced data and non- IID data in deep learning classification and federated learning scenarios. In addition, data pre-processing strategies such that dimensionality …


Point Cloud Surface Matching Method Based On Precise Matching Of Critical Point, Xiaojuan Ning, Chunxu Li, Jiahao Wang, Jing Tang, Yinghui Wang, Haiyan Jin Jun 2023

Point Cloud Surface Matching Method Based On Precise Matching Of Critical Point, Xiaojuan Ning, Chunxu Li, Jiahao Wang, Jing Tang, Yinghui Wang, Haiyan Jin

Journal of System Simulation

To solve the low matching efficiency and insufficient accuracy of feature-based point cloud surface matching method during critical point matching, a point cloud surface matching method based on the pairing exaction of critical points is proposed.An improved 3D scale-invariant feature transform(3D-SIFT) algorithm based on curvature information is presented to extract the critical points. Fast point feature histograms(FPFH) feature, the angle between the vector from the center to critical points and the principal direction of the model are taken as the constraints to obtain the exact critical point matching point pair set. The initial matching of the model surface is …


Semantic Segmentation Model Based On Adaptive Fusion And Attention Refinement, Yun Wei, Qi Luo, Yingzhi Zhao Jun 2023

Semantic Segmentation Model Based On Adaptive Fusion And Attention Refinement, Yun Wei, Qi Luo, Yingzhi Zhao

Journal of System Simulation

Aiming at the insufficient use of context information and loss of detail information of the existing semantic segmentation, a model based on adaptive fusion and attention refinement is proposed.The model introduces an adaptive fusion module in the process of coding, and solves the insufficient use of context information by fusing each feature map according to the corresponding weight. An attention thinning module is designed in the process of decoding, so that the low-order features and high-order features can guide and optimize each other to solve the loss of detail information.The experimental results show that the average intersection union …


Fault Indicator Configuration Optimization Based On Cooperative Game Particle Swarm Algorithm, Xu Wang, Weidong Ji, Guohui Zhou Jun 2023

Fault Indicator Configuration Optimization Based On Cooperative Game Particle Swarm Algorithm, Xu Wang, Weidong Ji, Guohui Zhou

Journal of System Simulation

In order to balance the reliability and economy of distribution network fault indicator, a multispace cooperative game particle swarm optimization algorithm is proposed. Based on the idea of population space grouping, the population activity space is adaptively divided, the particle game evolution in subspace is achieved, and the game calculation of particle fusion cosine similar reverse strategy is carried out, which well balances the convergence and diversity of the algorithm. The simulation results show that the adaptive multi-space division of population is conducive to jumping out of the local extreme value, and the game calculation integrating cosine similar reverse is …


Ar-Assisted Sign Language Letter Recognition Method Based On Improved Mobilenet Network, Chunhong Liu, Song Wang, Fupan Wang, Wensheng Tang, Yunqiang Pei, Dongsheng Tian, Yadong Wu Jun 2023

Ar-Assisted Sign Language Letter Recognition Method Based On Improved Mobilenet Network, Chunhong Liu, Song Wang, Fupan Wang, Wensheng Tang, Yunqiang Pei, Dongsheng Tian, Yadong Wu

Journal of System Simulation

An AR-assisted sign language letter recognition algorithm MS-MobileNet is proposed for the problems of sign language gestures needing to be standardized and low recognition rate. A multi-scale convolution module is designed to extract the low-level features and enhance the feature extraction ability. ELU activation function is used to retain the negative feature information, which combined with a lightweight MobileNet model for the web to improve the recognition accuracy and real-time performance for mobile AR applications. Test results show that compared with the original model, the recognition accuracy of MS-MobileNet on the datasets ASL-M, NUS-II and Creative Senz3D is improved by …