Software Engineering Commons^™

A Web-Based Multi-Modal Ai Framework For Intelligent Content Moderation With Constructive Feedback, Marwah Zaid Mohammed Al-Helali, Naveen Palanichamy, Su-Cheng Haw, Subhashini Gopal

Journal of Informatics and Web Engineering

Traditional content moderation systems primarily rely on strict measures that focus on removing offending or inappropriate content without offering users any form of educational feedback or guidance. This lack of constructive interaction often leads to a poor user experience, leaving users frustrated and uninformed regarding the reasons behind content removal. Moreover, such a system fails to encourage long-term positive behavioural changes within online communities, as users do not gain insights on how to improve their conduct. This paper proposes a new constructive Artificial Intelligence (AI) intervention system that integrates a number of AI models in order to conceptualize content moderation …

An Intelligent Tourism Recommender System Using Retrieval-Guided Large Language Models, Wei-Jun Lim, Nabhan D. Salih, Hairulnizam Mahdin, Ammar Alazab

Journal of Informatics and Web Engineering

Travel planning has become more complex nowadays due to the information overload from numerous online platforms causing travelers to be overwhelmed when selecting destinations, accommodations, and activities that match their preferences and constraints. Traditional tourism recommender systems usually provide static and generic suggestions that fail to match users’ needs and cannot understand natural user language. This research develops and evaluates a Generative AI Chatbot for Tourism Recommendations that use Large Language Models (LLMs) to generate personalized travel itineraries through natural language interaction to solve these limitations. The system can process user natural language inputs including travel origin and destination, trip …

Design Of A Cnn–Nlp Based Visual Chatbot For E-Commerce Systems, Sidra Kubra, Salma Jahan Nisha, Nbhan D. Salih, Amalina Ibrahim, Wan Noorshahida Mohd Isa

Journal of Informatics and Web Engineering

E-commerce platforms have limitations to assist interactive and highly personalized experiences using conventional text or voice-based chatbots, particularly in context-aware areas where product discovery and visual identification are necessary. Hence, we propose to integrate an image as a visual-based chatbot. We present a conceptual framework that combines Convolutional Neural Networks (CNN) for image recognition with Natural Language Processing (NLP) for dynamic, context-aware search in a chatbot. The CNN model enables the recognition of products from user-uploaded images, while the NLP component processes and generates appropriate responses to enhance the shopping experience by providing suggestions. This hybrid system will be developed …

Ai-Powered Threat Hunting For Email Phishing Attack Detection Using Natural Language Processing (Nlp), Mohd Azriy Akmalhazim Mohd Nazariee, S Prabha Kumaresan, Alaa Haddad, Mohamed Uvaze Ahamed Ayoobkhan

Journal of Informatics and Web Engineering

Phishing attacks remain as a significant cybersecurity threat, aiming to steal sensitive information by exploiting human vulnerability. Traditional phishing email detection often struggles to keep up with the latest attack strategies developed by the attackers which results in high false positive rates and the limited contextual understanding on the email contents. Therefore, to address these challenges, this research proposes a solution via an AI-powered threat-hunting model integrating Natural Language Processing (NLP) techniques for phishing email detection in English through the development of PhishGuard AI application. The application is developed as a web-based software solution designed to be accessible to both …

Multi-Agent Ai Systems For Detecting Emerging Therapeutic Targets And Intervention Patterns In Neuroplasticity Research, Raza Hasan, Salman Mahmood

Journal of Informatics and Web Engineering

The exponential growth of neuroplasticity research presents profound challenges to the manual synthesis of literature, hindering the identification of emerging therapeutic targets and intervention patterns. While multi-agent Artificial Intelligence (AI) systems have been proposed conceptually to address this, concrete implementations demonstrating end-to-end utility are scarce. This paper details the successful implementation and application of a novel four-agent AI system designed to automate the discovery, extraction, analysis, and validation of patterns in neuroplasticity literature. Our platform consists of four parts: a Literature Discovery Agent (LDA) for corpus gathering, a Concept Extraction Agent (CEA) with a multi-level NLP strategy fallback mechanism for …

Hybrid Sentiment Analysis Model For Customer Feedback Interpretation Using Lexicon, Machine Learning And Deep Learning Techniques, Jou Jia Yi, Lew Sook Ling, Tan Li Tao

Journal of Informatics and Web Engineering

Customer feedback is pivotal in enhancing service quality and user satisfaction across digital platforms. However, traditional sentiment analysis methods often struggle with informal languages, contextual nuances, and aspect-specific opinions. In this paper, a hybrid sentiment analysis framework is proposed, utilizing lexicon-based (VADER), machine learning (Support Vector Machine and Random Forest), and deep learning (BERT) techniques to achieve improved sentiment classification accuracy and interpretability compared to previous studies. The framework incorporates advanced preprocessing techniques, such as emoji normalization, handling of negation, and detection of intensifiers, to better capture emotional information in user-generated content. The objectives of this study are to develop …

An Empirical Evaluation Of Machine Learning Methods And Text Classifiers For Sentiment Analysis Of Online Consumer Reviews, Pei Qin Lo, Sew Lai Ng, Li-Xian Jiao

Journal of Informatics and Web Engineering

This study aims to identify the best predictive model for analysing online product reviews (OPRs) in the electronics industry, with a secondary focus on leveraging unstructured customer feedback to support product improvement. Using a dataset of 9,675 Oppo mobile phone reviews, this study employs three classification models—Random Forest, Support Vector Machine (SVM) and Logistic Regression–paired with Term Frequency-Inverse Document Frequency (TF-IDF) or bidirectional encoder representation transformer (BERT) as the embedding models to analyse customer sentiment and derive actionable insights. The methodology features a comprehensive analysis pipeline that includes text preprocessing with the Natural Language Toolkit (NLTK), feature extraction using) vectorization …

A Conceptual Framework On Development Of Sign Language Chatbot For E-Commerce, Salma Jahan Nisha, Nabhan Salih, Wan-Noorshahida Mohd-Isa

Journal of Informatics and Web Engineering

This study proposes and validates a conceptual framework using a sign language (SL) chatbot in the e-commerce domain to improve accessibility. Currently, the use of SL is a less-explored area in online platforms. It is difficult for any communication-challenged person to interact online for buying products and services, using a chatbot, particularly for people using SL. The objective of this study is to introduce a novel hybrid architecture using SL Recognition with a conversational-based chatbot agent via a custom Application Programming Interface (API) in e-commerce platforms. Our work proposes a combined hybrid chatbot framework model using Convolutional Neural Network (CNN) …

Sentiment-Based Music Recommendation System Using Natural Language Processing For Emotion-Aware Song Suggestions, Yu Bui Xuan, S. Prabha Kumaresan, Naveen Palanichamy, Mohamed Uvaze Ahamed Ayoobkhan

Journal of Informatics and Web Engineering

Music plays a vital role in influencing emotions, mood, and mental health. However, classical music recommendation systems mostly rely on listening to history, genre preference, or popularity, ignoring the listener’s mood. Motivation to go further in this area gave birth to this study, where a new sentiment-based music recommendation system is being designed by incorporating Natural Language Processing (NLP) and Machine Learning (ML) techniques to provide emotion-aware song recommendations. The system collects various audio features such as valence, energy, tempo, and danceability from music distribution platforms such as Spotify, which are well-known indicators for classifying the emotional tone of a …

Sentiment Analysis Of The 2024 General Election Through Twitter Using Long-Short-Term Memory Algorithm, Angga Wahyu W, Haidar Hilmy Andana, Junta Zeniarja, Aris Febriyanto

Journal of Informatics and Web Engineering

This study analyses sentiment related to the 2024 Indonesian Presidential Election using the Long Short-Term Memory (LSTM) algorithm. A total of 2,400 tweets in the Indonesian language were gathered, with approximately 400 tweets sampled per week. In the data preparation, lexicon-based sentiment tagging, oversampling for class balance, and the creation and training of an LSTM model are all included in the study approach. The built model consists of embedding layers, Conv1D, and two LSTM layers. The LSTM model was selected due to its ability to capture long-range contextual dependencies in sequential text data like tweets, facilitated by its gate mechanisms …

Simplifying 3d Printing Using Natural Language Processing, Jared E. Rosenberger

Undergraduate Theses

3D printing is a crucial technology with many applications in different fields. To be able to use this technology to its full extent, expertise in computer aided design (CAD) technology and 3D modeling is required. Many people interested in 3D printing do not have this expertise and thus cannot build custom models, and are consequently forced to buy them instead. Natural language processing (NLP) is one tool that can vastly simplify 3D modeling for those lacking CAD experience. Using NLP, someone can simply dictate what they want to be able to print, and a computer can then build a 3D …

Effect Of Virtual Reality Technology On Computer Science/Engineering Based Laboratories Education – A Case Study, Saeed Salem Al Shebli

Theses

The rapid growth in mobile applications raises critical concerns about the security of apps and users' privacy, especially in permission control. Mobile apps access sensitive information of users, and the current cybersecurity landscape faces a huge challenge in ensuring the least required permissions are granted. This research focuses on designing an advanced permission recommendation system that couples the strengths of Natural Language Processing (NLP) and Machine Learning (ML) in solving most of the existing gaps in permission management, thus guiding which permissions are mostly needed by Android applications.

The research thus follows a multi-classification approach, integrating state-of-the-art ML techniques with …

An Intelligent Academic Advising System For Course Recommendation Using Large Language Models, Malika Maya Iratni

Theses

Academic advising is an important resource for students, especially in higher education, in order to guide them to make the best possible decisions to improve their overall academic performance and overall academic journey. With the increasing number of students joining these institutions each year, traditional advising becomes a time-consuming and inefficient process that can leave students discouraged, and advisors overwhelmed. Therefore, there is a need to develop intelligent advising systems that make use of the recent advancements in technology, to support the advising process, and increase overall student satisfaction. In this work, an academic advising model that uses Recommender Systems …

Improving Automatic Transcription Using Natural Language Processing, Anna Kiefer

Master's Theses

Digital Democracy is a CalMatters and California Polytechnic State University initia-
tive to promote transparency in state government by increasing access to the Califor-
nia legislature. While Digital Democracy is made up of many resources, one founda-
tional step of the project is obtaining accurate, timely transcripts of California Senate
and Assembly hearings. The information extracted from these transcripts provides
crucial data for subsequent steps in the pipeline. In the context of Digital Democracy,
upleveling is when humans verify, correct, and annotate the transcript results after
the legislative hearings have been automatically transcribed. The upleveling process
is done with the …

Sentiment Analysis Using Support Vector Machine And Random Forest, Talha Ahmed Khan, Rehan Sadiq, Zeeshan Shahid, Muhammad Mansoor Alam, Mazliham Bin Mohd Su'ud

Journal of Informatics and Web Engineering

Sentiment analysis, is commonly known as opinion mining, is a vital field in natural language processing (NLP) that claims to find out the sentiment or emotion expressed in a given text. This research paper demonstrates an exhaustive survey of sentiment analysis, focusing on the application of machine learning techniques. Comprehensive parametric literature review has been completed to determine the sentiment analysis using SVM and Random Forest. Additionally, the paper covers preprocessing techniques, feature extraction, model training, evaluation, and challenges encountered in sentiment analysis. The findings of this research contribute to a deeper understanding of sentiment analysis and provide insights into …

A Campus-Based Chatbot System Using Natural Language Processing And Neural Network, Tuan-Jun Goh, Lee-Ying Chong, Siew-Chin Chong, Pey-Yun Goh

Journal of Informatics and Web Engineering

A chatbot is designed to simulate human conversation and provide instant responses to users. Chatbots have gained popularity in providing automated customer support and information retrieval among organisations. Besides, it also acts as a virtual assistant to communicate with users by delivering updated answers based on users' input. Most chatbots still use the traditional rule-based chatbot, which can only respond to pre-defined sentences, making the users unlikely to use the chatbot. This paper aims to design and build a campus chatbot for the Faculty of Information Science & Technology (FIST) of Multimedia University that facilitates the study life of FIST …

Language Models For Rare Disease Information Extraction: Empirical Insights And Model Comparisons, Shashank Gupta

Theses and Dissertations--Computer Science

End-to-end relation extraction (E2ERE) is a crucial task in natural language processing (NLP) that involves identifying and classifying semantic relationships between entities in text. This thesis compares three paradigms for end-to-end relation extraction (E2ERE) in biomedicine, focusing on rare diseases with discontinuous and nested entities. We evaluate Named Entity Recognition (NER) to Relation Extraction (RE) pipelines, sequence-to-sequence models, and generative pre-trained transformer (GPT) models using the RareDis information extraction dataset. Our findings indicate that pipeline models are the most effective, followed closely by sequence-to-sequence models. GPT models, despite having eight times as many parameters, perform worse than sequence-to-sequence models and …

Chatgpt As Metamorphosis Designer For The Future Of Artificial Intelligence (Ai): A Conceptual Investigation, Amarjit Kumar Singh (Library Assistant), Dr. Pankaj Mathur (Deputy Librarian)

Library Philosophy and Practice (e-journal)

Abstract

Purpose: The purpose of this research paper is to explore ChatGPT’s potential as an innovative designer tool for the future development of artificial intelligence. Specifically, this conceptual investigation aims to analyze ChatGPT’s capabilities as a tool for designing and developing near about human intelligent systems for futuristic used and developed in the field of Artificial Intelligence (AI). Also with the helps of this paper, researchers are analyzed the strengths and weaknesses of ChatGPT as a tool, and identify possible areas for improvement in its development and implementation. This investigation focused on the various features and functions of ChatGPT that …

Softskip: Empowering Multi-Modal Dynamic Pruning For Single-Stage Referring Comprehension, Dulanga Weerakoon, Vigneshwaran Subbaraju, Tuan Tran, Archan Misra

Research Collection School Of Computing and Information Systems

Supporting real-time referring expression comprehension (REC) on pervasive devices is an important capability for human-AI collaborative tasks. Model pruning techniques, applied to DNN models, can enable real-time execution even on resource-constrained devices. However, existing pruning strategies are designed principally for uni-modal applications, and suffer a significant loss of accuracy when applied to REC tasks that require fusion of textual and visual inputs. We thus present a multi-modal pruning model, LGMDP, which uses language as a pivot to dynamically and judiciously select the relevant computational blocks that need to be executed. LGMDP also introduces a new SoftSkip mechanism, whereby 'skipped' visual …

Legislative Language For Success, Sanjana Gundala

Master's Theses

Legislative committee meetings are an integral part of the lawmaking process for local and state bills. The testimony presented during these meetings is a large factor in the outcome of the proposed bill. This research uses Natural Language Processing and Machine Learning techniques to analyze testimonies from California Legislative committee meetings from 2015-2016 in order to identify what aspects of a testimony makes it successful. A testimony is considered successful if the alignment of the testimony matches the bill outcome (alignment is "For" and the bill passes or alignment is "Against" and the bill fails). The process of finding what …

Ppmexplorer: Using Information Retrieval, Computer Vision And Transfer Learning Methods To Index And Explore Images Of Pompeii, Cindy Roullet

Graduate Theses and Dissertations

In this dissertation, we present and analyze the technology used in the making of PPMExplorer: Search, Find, and Explore Pompeii. PPMExplorer is a software tool made with data extracted from the Pompei: Pitture e Mosaic (PPM) volumes. PPM is a valuable set of volumes containing 20,000 historical annotated images of the archaeological site of Pompeii, Italy accompanied by extensive captions. We transformed the volumes from paper, to digital, to searchable. PPMExplorer enables archaeologist researchers to conduct and check hypotheses on historical findings. We present a theory that such a concept is possible by leveraging computer generated correlations between artifacts using …

Sentiment Analysis For Software Engineering: How Far Can Pre-Trained Transformer Models Go?, Ting Zhang, Bowen Xu, Thung Ferdian, Stefanus Agus Haryono, David Lo, Lingxiao Jiang

Research Collection School Of Computing and Information Systems

Extensive research has been conducted on sentiment analysis for software engineering (SA4SE). Researchers have invested much effort in developing customized tools (e.g., SentiStrength-SE, SentiCR) to classify the sentiment polarity for Software Engineering (SE) specific contents (e.g., discussions in Stack Overflow and code review comments). Even so, there is still much room for improvement. Recently, pre-trained Transformer-based models (e.g., BERT, XLNet) have brought considerable breakthroughs in the field of natural language processing (NLP). In this work, we conducted a systematic evaluation of five existing SA4SE tools and variants of four state-of-the-art pre-trained Transformer-based models on six SE datasets. Our work is …

Identifying Privacy Policy In Service Terms Using Natural Language Processing, Ange-Thierry Ishimwe

Computer Science and Computer Engineering Undergraduate Honors Theses

Ever since technology (tech) companies realized that people's usage data from their activities on mobile applications to the internet could be sold to advertisers for a profit, it began the Big Data era where tech companies collect as much data as possible from users. One of the benefits of this new era is the creation of new types of jobs such as data scientists, Big Data engineers, etc. However, this new era has also raised one of the hottest topics, which is data privacy. A myriad number of complaints have been raised on data privacy, such as how much access …

Assessing The Quality Of Software Development Tutorials Available On The Web, Manziba A. Nishi

Theses and Dissertations

Both expert and novice software developers frequently access software development resources available on the Web in order to lookup or learn new APIs, tools and techniques. Software quality is affected negatively when developers fail to find high-quality information relevant to their problem. While there is a substantial amount of freely available resources that can be accessed online, some of the available resources contain information that suffers from error proneness, copyright infringement, security concerns, and incompatible versions. Use of such toxic information can have a strong negative effect on developer’s efficacy. This dissertation focuses specifically on software tutorials, aiming to automatically …

Tasknav: Task-Based Navigation Of Software Documentation, Christoph Treude, Mathieu Sicard, Marc Klocke, Martin P. Robillard

Research Collection School Of Computing and Information Systems

To help developers navigate documentation, we introduce Task Nav, a tool that automatically discovers and indexes task descriptions in software documentation. With Task Nav, we conceptualize tasks as specific programming actions that have been described in the documentation. Task Nav presents these extracted task descriptions along with concepts, code elements, and section headers in an auto-complete search interface. Our preliminary evaluation indicates that search results identified through extracted task descriptions are more helpful to developers than those found through other means, and that they help bridge the gap between documentation structure and the information needs of software developers. Video: https://www.youtube.com/watch?v=opnGYmMGnqY.

Consistency Checking Of Natural Language Temporal Requirements Using Answer-Set Programming, Wenbin Li

Theses and Dissertations--Computer Science

Successful software engineering practice requires high quality requirements. Inconsistency is one of the main requirement issues that may prevent software projects from being success. This is particularly onerous when the requirements concern temporal constraints. Manual checking whether temporal requirements are consistent is tedious and error prone when the number of requirements is large. This dissertation addresses the problem of identifying inconsistencies in temporal requirements expressed as natural language text. The goal of this research is to create an efficient, partially automated, approach for checking temporal consistency of natural language requirements and to minimize analysts' workload.

The key contributions of this …