Open Access. Powered by Scholars. Published by Universities.®

Neural networks

Discipline
Institution
Publication Year
Publication
Publication Type

Articles 1 - 25 of 25

Full-Text Articles in Numerical Analysis and Scientific Computing

Material Reconstruction From Single Image Combining Neural Networks With Singular Value Decomposition, Zhiqiang Li, Xukun Shen, Yong Hu, Xueyang Zhou, Yifan Chen Jan 2026

Material Reconstruction From Single Image Combining Neural Networks With Singular Value Decomposition, Zhiqiang Li, Xukun Shen, Yong Hu, Xueyang Zhou, Yifan Chen

Journal of System Simulation

Abstract: The tabulated BRDFs (bidirectional reflectance distribution function) can realistically reproduce the surface appearance of objects. However, due to their high-dimensional characteristics and the fact that a single planar image contains limited reflectance information and small differences, methods for estimating tabulated BRDFs typically require complex equipment or the capture of multiple images. To address this issue, a method is proposed for reconstructing material properties from a single image by combining neural networks with singular value decomposition. The singular value decomposition is introduced to compress the material into a lower-dimensional space. The task of solving the tabulated BRDFs is simplified to …


Latent Representation Learning For Geospatial Entities, Ween Jiann Lee, Hady Wirawan Lauw Oct 2024

Latent Representation Learning For Geospatial Entities, Ween Jiann Lee, Hady Wirawan Lauw

Research Collection School Of Computing and Information Systems

Representation learning has been instrumental in the success of machine learning, offering compact and performant data representations for diverse downstream tasks. In the spatial domain, it has been pivotal in extracting latent patterns from various data types, including points, polylines, polygons, and networked structures. However, existing approaches often fall short of explicitly capturing both semantic and spatial information, relying on proxies and synthetic features. This article presents GeoNN, a novel graph neural network-based model designed to learn spatially-aware embeddings for geospatial entities. GeoNN leverages edge features generated from geodesic functions, dynamically selecting relevant features based on relative locations. It introduces …


Text-Attributed Graph Representation Learning : Methods, Applications, And Challenges, Ce Zhang, Menglin Yang, Rex Ying, Hady Wirawan Lauw May 2024

Text-Attributed Graph Representation Learning : Methods, Applications, And Challenges, Ce Zhang, Menglin Yang, Rex Ying, Hady Wirawan Lauw

Research Collection School Of Computing and Information Systems

Text documents are usually connected in a graph structure, resulting in an important class of data named text-attributed graph, e.g., paper citation graph and Web page hyperlink graph. On the one hand, Graph Neural Networks (GNNs) consider text in each document as general vertex attribute and do not specifically deal with text data. On the other hand, Pre-trained Language Models (PLMs) and Topic Models (TMs) learn effective document embeddings. However, most models focus on text content in each single document only, ignoring link adjacency across documents. The above two challenges motivate the development of text-attributed graph representation learning, combining GNNs …


Mathematically Rigorous Deep Learning Paradigms For Data-Driven Scientific Modeling, Owen Nicholas Davis Apr 2024

Mathematically Rigorous Deep Learning Paradigms For Data-Driven Scientific Modeling, Owen Nicholas Davis

Mathematics & Statistics ETDs

This dissertation explores the crucial role of data-driven modeling in science and engineering, with a focus on developing surrogate models to accelerate large-scale computational tasks, aiding in both outer-loop functions like uncertainty quantification and expensive inner-loop tasks within broader computational frameworks. Challenges arise with increased problem dimension and sparse, noisy training data, particularly significant when constructing surrogates for very expensive computational models where acquiring sufficient high-fidelity training data is unfeasible. In such scenarios, training surrogates from an ensemble of multifidelity information sources of varying accuracy and cost becomes essential. We emphasize neural network-based modeling paradigms, which are flexible in integrating …


Bayesian Neural Netwok Variational Autoencoder Inverse Mapper (Bnn-Vaim) And Its Application In Compton Form Factors Extraction, Md Fayaz Bin Hossen, Tareq Alghamdi, Manal Almaeen, Yaohang Li Jan 2024

Bayesian Neural Netwok Variational Autoencoder Inverse Mapper (Bnn-Vaim) And Its Application In Compton Form Factors Extraction, Md Fayaz Bin Hossen, Tareq Alghamdi, Manal Almaeen, Yaohang Li

Computer Science Faculty Publications

We extend the Variational Autoencoder Inverse Mapper (VAIM) framework for the inverse problem of extracting Compton Form Factors (CFFs) from deeply virtual exclusive reactions, such as the unpolarized Deeply virtual exclusive scattering (DVCS) cross section. VAIM is an end-to-end deep learning framework to address the solution ambiguity issue in ill-posed inverse problems, which comprises of a forward mapper and a backward mapper to simulate the forward and inverse processes, respectively. In particular, we incorporate Bayesian Neural Network (BNN) into the VAIM architecture (BNN-VAIM) for uncertainty quantification. By sampling the weights and biases distributions of the BNN in the backward mapper …


Crowdtc: Crowd-Powered Learning For Text Classification, Keyu Yang, Yunjun Gao, Lei Liang, Song Bian, Lu Chen, Baihua Zheng Feb 2022

Crowdtc: Crowd-Powered Learning For Text Classification, Keyu Yang, Yunjun Gao, Lei Liang, Song Bian, Lu Chen, Baihua Zheng

Research Collection School Of Computing and Information Systems

Text classification is a fundamental task in content analysis. Nowadays, deep learning has demonstrated promising performance in text classification compared with shallow models. However, almost all the existing models do not take advantage of the wisdom of human beings to help text classification. Human beings are more intelligent and capable than machine learning models in terms of understanding and capturing the implicit semantic information from text. In this article, we try to take guidance from human beings to classify text. We propose Crowd-powered learning for Text Classification (CrowdTC for short). We design and post the questions on a crowdsourcing platform …


Efficient Reinforcement Learning In Resource Allocation Problems Through Permutation Invariant Multi-Task Learning, Desmond Cai, Shiau Hong Lim, Laura Wynter Dec 2021

Efficient Reinforcement Learning In Resource Allocation Problems Through Permutation Invariant Multi-Task Learning, Desmond Cai, Shiau Hong Lim, Laura Wynter

Research Collection School Of Computing and Information Systems

One of the main challenges in real-world reinforcement learning is to learn successfully from limited training samples. We show that in certain settings, the available data can be dramatically increased through a form of multi-task learning, by exploiting an invariance property in the tasks. We provide a theoretical performance bound for the gain in sample efficiency under this setting. This motivates a new approach to multi-task learning, which involves the design of an appropriate neural network architecture and a prioritized task-sampling strategy. We demonstrate empirically the effectiveness of the proposed approach on two real-world sequential resource allocation tasks where this …


Enhancing Project Based Learning With Unsupervised Learning Of Project Reflections, Hua Leong Fwa Sep 2021

Enhancing Project Based Learning With Unsupervised Learning Of Project Reflections, Hua Leong Fwa

Research Collection School Of Computing and Information Systems

Natural Language Processing (NLP) is an area of research and application that uses computers to analyze human text. It has seen wide adoption within several industries but few studies have investigated it for use in evaluating the effectiveness of educational interventions and pedagogies. Pedagogies such as Project based learning (PBL) centers on learners solving an authentic problem or challenge which leads to knowledge creation and higher engagement. PBL also lends itself well in plugging the gap between what is taught in classrooms and applying the knowledge gained to the real working environment. In this study, we seek to investigate how …


A Machine Learning Approach To Understanding Emerging Markets, Namita Balani Jul 2021

A Machine Learning Approach To Understanding Emerging Markets, Namita Balani

Graduate Theses and Dissertations

Logistic providers have learned to efficiently serve their existing customer bases with optimized routes and transportation resource allocation. The problem arises when there is potential for logistics growth in an emerging market with no previous data. The purpose of this work is to use industry data for previously known and well-documented markets to apply data analytic techniques such as machine learning to investigate the uncertainty in a new market. The thesis looks into machine learning techniques to predict miles per stop given historical data. It mainly focuses on Random Forest Regression Analysis, but concludes that additional techniques, such as Polynomial …


Fault Diagnosis For Automobile Coating Equipments Based On Extension Neural Network, Yongwei Ye, Shedong Ren, Lianqiang Ye, Shenhao Ge, Zhiqin Qian Aug 2020

Fault Diagnosis For Automobile Coating Equipments Based On Extension Neural Network, Yongwei Ye, Shedong Ren, Lianqiang Ye, Shenhao Ge, Zhiqin Qian

Journal of System Simulation

Abstract: Aiming at the difficulty in discovering and eliminating the system faults of automobile coating equipments in time, a new method of fault diagnosis based on extension neural network was proposed. The feature of extension theory was used in managing the structured information through qualitative and quantitative description, and it was also combined by the characteristic of parallel construct in neural network. So the extension reasoning process was completed by means of the parallel distributed processing construct of the network. Matter-element input and output models were established according to the equipment monitoring parameters and fault types for the heating system. …


Research On Asymptotic Stability For Markovian Jumping Neural Network With Unknown Transition Probabilities, Lu Yang, Shujuan Yi, Weijian Ren, Jiandong Liu Jun 2020

Research On Asymptotic Stability For Markovian Jumping Neural Network With Unknown Transition Probabilities, Lu Yang, Shujuan Yi, Weijian Ren, Jiandong Liu

Journal of System Simulation

Abstract: The analysis problem of asymptotic stability for a class of uncertain neural networks with Markovian jumping parameters and time delays was addressed. The general representative dynamic stochastic neural network model was established. The considered transition probabilities were assumed to be partially unknown. The parameter uncertainties were considered to be norm-bounded. Based on Lyapunov stability theory, by constructing a suitable Lyapunov-Krasovskii function and using the stochastic analysis method, some sufficient criteria for the stability of discrete Markovian neural networks was derived. Through the Matlab LMI toolbox, solving a set of linear matrix inequalities to test criterion, the new criterion reduced …


Adaptive Loss-Aware Quantization For Multi-Bit Networks, Zhongnan Qu, Zimu Zhou, Yun Cheng, Lothar Thiele Jun 2020

Adaptive Loss-Aware Quantization For Multi-Bit Networks, Zhongnan Qu, Zimu Zhou, Yun Cheng, Lothar Thiele

Research Collection School Of Computing and Information Systems

We investigate the compression of deep neural networks by quantizing their weights and activations into multiple binary bases, known as multi-bit networks (MBNs), which accelerate the inference and reduce the storage for the deployment on low-resource mobile and embedded platforms. We propose Adaptive Loss-aware Quantization (ALQ), a new MBN quantization pipeline that is able to achieve an average bitwidth below one-bit without notable loss in inference accuracy. Unlike previous MBN quantization solutions that train a quantizer by minimizing the error to reconstruct full precision weights, ALQ directly minimizes the quantizationinduced error on the loss function involving neither gradient approximation nor …


Research On Image Description Method Based On Neural Network, Kong Rui, Xie Wei, Lei Tai Apr 2020

Research On Image Description Method Based On Neural Network, Kong Rui, Xie Wei, Lei Tai

Journal of System Simulation

Abstract: The automatic recognition and automatically describing image content is an important research direction to the artificial intelligence to connect the computer vision and the natural language processing. A method of describing the image content is proposed to generate the natural language by using the deep neural network model. The model consists of a convolutional neural network (CNN) and a recurrent neural network (RNN). The CNN is used to extract features of the input image to generate a fixed-length feature vector, which initializes the RNN to generate the sentences. Experimental results on the MSCOCO image description dataset show the syntactic …


Are These Comments Triggering? Predicting Triggers Of Toxicity In Online Discussions, Hind Almerekhi, Haewoon Kwak, Joni Salminen, Bernard J. Jansen Apr 2020

Are These Comments Triggering? Predicting Triggers Of Toxicity In Online Discussions, Hind Almerekhi, Haewoon Kwak, Joni Salminen, Bernard J. Jansen

Research Collection School Of Computing and Information Systems

Understanding the causes or triggers of toxicity adds a new dimension to the prevention of toxic behavior in online discussions. In this research, we define toxicity triggers in online discussions as a non-toxic comment that lead to toxic replies. Then, we build a neural network-based prediction model for toxicity trigger. The prediction model incorporates text-based features and derived features from previous studies that pertain to shifts in sentiment, topic flow, and discussion context. Our findings show that triggers of toxicity contain identifiable features and that incorporating shift features with the discussion context can be detected with a ROC-AUC score of …


Entity-Sensitive Attention And Fusion Network For Entity-Level Multimodal Sentiment Classification, Jianfei Yu, Jing Jiang Jan 2020

Entity-Sensitive Attention And Fusion Network For Entity-Level Multimodal Sentiment Classification, Jianfei Yu, Jing Jiang

Research Collection School Of Computing and Information Systems

Entity-level (aka target-dependent) sentiment analysis of social media posts has recently attracted increasing attention, and its goal is to predict the sentiment orientations over individual target entities mentioned in users' posts. Most existing approaches to this task primarily rely on the textual content, but fail to consider the other important data sources (e.g., images, videos, and user profiles), which can potentially enhance these text-based approaches. Motivated by the observation, we study entity-level multimodal sentiment classification in this article, and aim to explore the usefulness of images for entity-level sentiment detection in social media posts. Specifically, we propose an Entity-Sensitive Attention …


The Fluid Representations Of Networks Estimating Liquid Viscosity, Jan Jaap R. Van Assen, Shin'ya Nishida, Roland W. Fleming May 2019

The Fluid Representations Of Networks Estimating Liquid Viscosity, Jan Jaap R. Van Assen, Shin'ya Nishida, Roland W. Fleming

MODVIS Workshop

No abstract provided.


Depressiongnn: Depression Prediction Using Graph Neural Network On Smartphone And Wearable Sensors, Param Bidja May 2019

Depressiongnn: Depression Prediction Using Graph Neural Network On Smartphone And Wearable Sensors, Param Bidja

Honors Scholar Theses

Depression prediction is a complicated classification problem because depression diagnosis involves many different social, physical, and mental signals. Traditional classification algorithms can only reach an accuracy of no more than 70% given the complexities of depression. However, a novel approach using Graph Neural Networks (GNN) can be used to reach over 80% accuracy, if a graph can represent the depression data set to capture differentiating features. Building such a graph requires 1) the definition of node features, which must be highly correlated with depression, and 2) the definition for edge metrics, which must also be highly correlated with depression. In …


Automatic Short Answer Grading Using Siamese Bidirectional Lstm Based Regression, Arya Prabhudesai, Nguyen Binh Duong Ta Apr 2019

Automatic Short Answer Grading Using Siamese Bidirectional Lstm Based Regression, Arya Prabhudesai, Nguyen Binh Duong Ta

Research Collection School Of Computing and Information Systems

Automatic student assessment plays an important role in education - it provides instant feedback to learners, and at the same time reduces tedious grading workload for instructors. In this paper, we investigate new machine learning techniques for automatic short answer grading (ASAG). The ASAG problem mainly involves assessing short, natural language responses to given questions automatically. While current research in the field has focused either on feature engineering or deep learning, we propose a new approach which combines the advantages of both. More specifically, we propose a Siamese Bidirectional LSTM Neural Network based Regressor in conjunction with handcrafted features for …


Evasive Maneuvers Against Missiles For Unmanned Combat Aerial Vehicle In Autonomous Air Combat, Xizhong Yang, Jianliang Ai Jan 2019

Evasive Maneuvers Against Missiles For Unmanned Combat Aerial Vehicle In Autonomous Air Combat, Xizhong Yang, Jianliang Ai

Journal of System Simulation

Abstract: For UCAV having the capability to deal with autonomous air combat, the flight dynamics model with the overload input and the 3-dimensional proportional navigation guidance model were established. Based on artificial neural network, an evasive maneuver decision was presented for avoiding incoming missiles. The degrees of freedom for UCAV-missile system were reduced by coordinate transformation, which simplified the complicated model as a non-linear model with relatively small amount of input and a single output. After the neural network samples were generated and trained, evasive results could be directly predicted from the relationship of positions between UCAV and missile …


Global Inference For Aspect And Opinion Terms Co-Extraction Based On Multi-Task Neural Networks, Jianfei Yu, Jing Jiang, Rui Xia Jan 2019

Global Inference For Aspect And Opinion Terms Co-Extraction Based On Multi-Task Neural Networks, Jianfei Yu, Jing Jiang, Rui Xia

Research Collection School Of Computing and Information Systems

Extracting aspect terms and opinion terms are two fundamental tasks in opinion mining. The recent success of deep learning has inspired various neural network architectures, which have been shown to achieve highly competitive performance in these two tasks. However, most existing methods fail to explicitly consider the syntactic relations among aspect terms and opinion terms, which may lead to the inconsistencies between the model predictions and the syntactic constraints. To this end, we first apply a multi-task learning framework to implicitly capture the relations between the two tasks, and then propose a global inference method by explicitly modelling several syntactic …


Automatic Slide Generation For Scientific Papers, Athar Sefid, Jian Wu, Prasenjit Mitra, C. Lee Giles Jan 2019

Automatic Slide Generation For Scientific Papers, Athar Sefid, Jian Wu, Prasenjit Mitra, C. Lee Giles

Computer Science Faculty Publications

We describe our approach for automatically generating presentation slides for scientific papers using deep neural networks. Such slides can help authors have a starting point for their slide generation process. Extractive summarization techniques are applied to rank and select important sentences from the original document. Previous work identified important sentences based only on a limited number of features that were extracted from the position and structure of sentences in the paper. Our method extends previous work by (1) extracting a more comprehensive list of surface features, (2) considering semantic or meaning of the sentence, and (3) using context around the …


Online Learning With Nonlinear Models, Doyen Sahoo Dec 2017

Online Learning With Nonlinear Models, Doyen Sahoo

Dissertations and Theses Collection (Open Access)

Recent years have witnessed the success of two broad categories of machine learning algorithms: (i) Online Learning; and (ii) Learning with nonlinear models. Typical machine learning algorithms assume that the entire data is available prior to the training task. This is often not the case in the real world, where data often arrives sequentially in a stream, or is too large to be stored in memory. To address these challenges, Online Learning techniques evolved as a promising solution to having highly scalable and efficient learning methodologies which could learn from data arriving sequentially. Next, as the real world data exhibited …


Deepfacade: A Deep Learning Approach To Facade Parsing, Hantang Liu, Jialiang Zhang, Jianke Zhu, Steven C. H. Hoi Aug 2017

Deepfacade: A Deep Learning Approach To Facade Parsing, Hantang Liu, Jialiang Zhang, Jianke Zhu, Steven C. H. Hoi

Research Collection School Of Computing and Information Systems

The parsing of building facades is a key component to the problem of 3D street scenes reconstruction, which is long desired in computer vision. In this paper, we propose a deep learning based method for segmenting a facade into semantic categories. Man-made structures often present the characteristic of symmetry. Based on this observation, we propose a symmetric regularizer for training the neural network. Our proposed method can make use of both the power of deep neural networks and the structure of man-made architectures. We also propose a method to refine the segmentation results using bounding boxes generated by the Region …


A Structure First Image Inpainting Approach Based On Self-Organizing Map (Som), Bo Chen, Zhaoxia Wang, Ming Bai, Quan Wang, Zhen Sun Dec 2010

A Structure First Image Inpainting Approach Based On Self-Organizing Map (Som), Bo Chen, Zhaoxia Wang, Ming Bai, Quan Wang, Zhen Sun

Research Collection School Of Computing and Information Systems

This paper presents a structure first image inpainting method based on self-organizing map (SOM). SOM is employed to find the useful structure information of the damaged image. The useful structure information which includes relevant edges of the image is used to simulate the structure information of the lost or damaged area in the image. The structure information is described by distinct or indistinct curves in an image in this paper. The obtained target curves separate the damaged area of the image into several parts. As soon as each part of the damaged image is restored respectively, the damaged image is …


Predictive Self-Organizing Networks For Text Categorization, Ah-Hwee Tan Apr 2001

Predictive Self-Organizing Networks For Text Categorization, Ah-Hwee Tan

Research Collection School Of Computing and Information Systems

This paper introduces a class of predictive self-organizing neural networks known as Adaptive Resonance Associative Map (ARAM) for classification of free-text documents. Whereas most sta- tistical approaches to text categorization derive classification knowledge based on training examples alone, ARAM performs supervised learn- ing and integrates user-defined classification knowledge in the form of IF-THEN rules. Through our experiments on the Reuters-21578 news database, we showed that ARAM performed reasonably well in mining categorization knowledge from sparse and high dimensional document feature space. In addition, ARAM predictive accuracy and learning efficiency can be improved by incorporating a set of rules derived from …