Data Science Commons^™

Evaluating Regularized Logistic Regression And K-Nn On Mnist Under Increasing Random Missingness, Daniel Markwei

Data Science and Data Mining

This paper investigates the effect of random missingness on the performance of regularized multinomial logistic regression and the k-nearest neighbors (k-NN) classifier for handwritten digit recognition on the MNIST dataset. In particular, we study L1-regularized (LASSO) logistic regression and L2-regularized (Ridge) logistic regression alongside k-NN. Varying percentages of random missingness were introduced into the original dataset, and each model was evaluated in terms of its classification performance. The results show that random missingness degrades the performance of all three classifiers. Overall, k-NN consistently achieves higher accuracy than both L1- and L2-regularized logistic regression across all missingness levels; however, its performance …

Solving High-Dimensional Differential Equations Using Recurrent And Residual Neural Network Architectures, Hind Khaled Kolaib

Knowledge Engineering and Data Science

High-dimensional Partial Differential Equations (PDEs) form the foundation of complex process modeling in various scientific and engineering applications, including finance, physics, and optimal control. However, classical numerical methods are adversely affected by the curse of dimensionality, making them inapplicable for large-scale problems. Recently, however, deep learning-based approaches have provided a new toolbox for these high-dimensional PDEs, including methods such as the Deep Backward Stochastic Differential Equation (Deep BSDE) method. Our approach draws on a more sophisticated deep learning backbone, using neural networks (in our case, a Residual Neural Network and a Long Short-Term Memory network (LSTM) integrated into the Deep …

Real-Time Deep Learning Detection Of Toraja Carving Motifs Using Yolo11m For Cultural Heritage Preservation, Herman Herman, Farid Wajdi Mufti, Abdul Rachman Manga, Haidawati Nasir

Knowledge Engineering and Data Science

Toraja carvings are an important part of Indonesia’s cultural heritage, rich in symbolic, aesthetic, and philosophical meaning. However, the identification and preservation of carving motifs still rely on subjective, time-consuming manual processes, limiting scalability and inconsistent knowledge transmission. From a Knowledge Engineering and Cognitive Data Science perspective, this challenge highlights the need for mechanisms that can transform visual cultural artifacts into structured, machine-interpretable knowledge. This study investigates the use of the YOLO11m model as a data-driven approach for modeling cultural knowledge through automated detection of three Toraja carving motifs: pa_tedong, pa_kapu_baka, and pa_manu_londongan using original images collected directly from traditional …

A Predictive Model For Multi- Week Respiratory Risk From Red Tide On Florida’S Gulf Coast., Elmer S. Ochaeta

Computer Science and Engineering Faculty Publications

Florida’s Gulf Coast red tide (Karenia brevis) can put toxins into the air, making people cough, irritating the throat, and worsening asthma or other breathing problems especially when winds blow from the ocean toward the beach. Right now, most public updates don’t really help with the question people actually ask when planning a weekend or vacation: “Will going to or close to the beach be risky in the next few weeks?”.

In this project, I build a weekly early warning system that estimates respiratory risk for specific beaches and predicts that risk 2 to 4 weeks ahead. The study covers …

Computer Vision In Soccer: Yolov11 Analytics Engine For Quantifying Game Strategy, Connor S. Maurer

Data Science Undergraduate Honors Theses

Single-shot object detection capabilities significantly reduce computational overhead for real-time computer vision in sports analytics at 60 FPS. YOLO11’s lightweight CNN gives promising accuracy while meeting the low-latency demand of dynamic soccer matches. As data-driven approaches take over the sport of soccer, efficient player tracking systems become critical for informing coach’s strategies. I prototype the ETL (Extract, Transform, Load) process of data collected from a single- shot detection program and evaluate its viability for estimating player fatigue. YOLO11 detects players, the ball, and other characteristics, with the output transformed by homography to estimate the positions in the real world. These …

Time Series Forecasting With Lstm: An Extensive Content Analysis, Andri Pranolo, Xiaofeng Zhou, Yingchi Mao

Knowledge Engineering and Data Science

This paper presents a comprehensive bibliometric and content review of the trend, architecture, and application of long short-term memory (LSTM) models for time series forecasting. The study aims to provide insights into the overall statistics and distribution of papers focused on LSTM for forecasting. Additionally, the research questions address the most highly cited papers based on LSTM approaches in forecasting, the most productive journals in this field, and identifying trends, gaps, summary tasks and their performance, datasets availability, and future research directions for LSTM in forecasting. This paper is a comprehensive review of LSTM for forecasting from 2017 to 2023 …

Mapping Of Product Sales Potential Based On Brands In The East Kalimantan Region Using Hybrid Analytical Framework, Achmad F O Gaffar Mr, Mulyanto Mulyanto Mr, Arief Bw Putra Mr, Muhammad Taufiq Sumadi Mr, Emmilya Umma Aziza Gaffar

Knowledge Engineering and Data Science

In geographically dispersed markets, operational costs should be reflected in sales planning to support accurate performance evaluation. However, such considerations are often neglected in practice. This study proposes a hybrid analytical framework to map brand-based product sales potential, with and without operational cost consideration, using historical sales data from PT Karya Inti Total Anugerah (PT KITA) in East Kalimantan. The framework integrates spatial, statistical, and machine learning techniques. Principal Component Analysis (PCA) is used to reduce the dimensionality of variables related to travel distance, total sales, and units sold, where travel distance represents the primary contributor to operational costs. K-Means …

Cognitive Eeg Differentiation With Hypnosis-Based Noise Reduction And K-Harmonic Means For Personalized Brainwave Modeling, Ahmad Azhari, Dimas Chaerul Ekty Saputra

Knowledge Engineering and Data Science

This study investigates the integration of hypnosis-based noise reduction and K-Harmonic Means (KHM) clustering for personalized brainwave modeling using Electroencephalography (EEG) data. EEG signals were collected from 100 participants using a Neurosky Mindset sensor at the FP1 (prefrontal) location, with each subject performing nine standardized cognitive tasks such as breathing, memory recall, and mathematical problem-solving. Hypnosis was applied not as a filtering method but as a behavioral protocol to standardize subject conditions and minimize physiological and environmental noise. The EEG signals were sampled at 128 Hz and analyzed using KHM clustering with K=4K = 4K=4, resulting in a Silhouette Score …

Ahp–Python Framework For Multicriteria Modeling Of Rice Production In Asean, Mayang Anglingsari Putri, Risqy Siwi Pradini, Anuraga Jayanegara, Alexander Dimas Yonanta Putra

Knowledge Engineering and Data Science

Rice production is a key indicator of food security and agricultural stability in Southeast Asia, especially among Association of Southeast Asian Nations (ASEAN) countries. Despite shared regional goals, disparities in rice production remain, and previous studies mainly rely on descriptive statistics, lacking structured multicriteria decision-making frameworks and computational tools for cross-country comparisons. This study addresses these gaps by proposing an integrated Analytic Hierarchy Process (AHP)–Python framework to evaluate and rank ASEAN rice production from 2013 to 2022. Three criteria are used: Total Production Volume (K1), Production Growth Trend (K2), and Recent Year Performance (K3), capturing both long-term consistency and short-term …

Stable Numerical Solution Of An Elliptic Pde Inverse Problem Subject To Incomplete Boundary Conditions, Qasim Abd Ali Tayyeh

Knowledge Engineering and Data Science

This study addresses the challenging problem of solving inverse elliptic Partial Differential Equations (PDE) with incomplete boundary data, data available only on a part of the domain boundary. The aim is to develop a robust, effective numerical framework that consistently recovers parameters and/or sources from incomplete, ill-posed data. In the case of a variational problem discretized by the Finite Element Method (FEM) and solved by an adjoint-based optimization strategy, the framework uses Tikhonov regularization. Morozov's Discrepancy Principle is used to determine regularization parameters that achieve the best balance between accuracy and stability. Even with 5% noise in the measurement data, …

Assessing Deep Learning Models And Hyperparameter Optimization For Stable Time-Series Electricity Load Forecasting, Sukma Patrya, Aji Prasetya Wibawa, Aripriharta Aripriharta

Knowledge Engineering and Data Science

Long-term electricity load forecasting plays an important role in ensuring system reliability, optimizing energy management, and making operational plans in face of continuously rising electricity demands. This study suggests a complete deep learning method for univariate forecasting of future electricity loads based on climatology and electricity consumption data for the period between 2019 and 2023. The initial dataset was cleaned, normalized, and partitioned chronologically into train/test datasets. Four train/test split cases (20/80, 40/60, 60/40, 80/20) were considered to explore the impact of different levels of historical data availability on the performance of the suggested framework from data-poor to data-rich situations. …

Classification Of Indonesian Sign Language (Sibi) Using Data Mining Algorithms K-Nearest Neighbor And Random Forest, Muhammad Zaki Wirawan, Achmad Afif, Anik Nur Handayani, Imanuel Hitipeuw, Osamu Fukuda

Knowledge Engineering and Data Science

This study aims to address the communication hallenges faced by the Indonesian deaf community by developing an automatic classification model for Sistem Bahasa Isyarat Indonesia (SIBI) using data mining techniques. The main objective is to identify a practical algorithm for recognizing SIBI hand gestures to enhance accessibility and inclusiveness in digital communication. A comprehensive dataset consisting of 32,850 gesture samples representing SIBI alphabet signs was collected and processed through feature extraction, data cleaning, and normalization using Z-Transform and Min-Max methods. Two classification algorithms, K-Nearest Neighbor (KNN) and Random Forest, were implemented and evaluated using metrics such as accuracy, precision, recall, …

The Impact Of Student Engagement Activities On Future Climate Change Adaptation: The Case Of Student Simulation Models, Bassel Mostafa Elkalaf

Future Journal of Social Science

This paper explores the critical role of student engagement in addressing the growing challenges of climate change, with a focus on the Model United Nations (MUN) as a case study. As climate-related security threats increase globally, educational platforms that prepare youth for effective leadership in climate politics are more essential than ever. MUN, a widely practiced student activity simulating global policy-making, provides a valuable opportunity for students to deepen their understanding of the interconnectedness between climate change, peace, and security. By participating in MUN simulations, students engage in debates, develop innovative solutions, and practice diplomatic skills, all while exploring the …

Debtor Eligibility Prediction Using Deep Learning With Chatbot-Based Testing, Reski Noviania, Enny Itje Sela, Luther Alexander Latumakulita, Steven R. Sentinuwo

Knowledge Engineering and Data Science

Predicting debtor eligibility is essential for effective risk management and minimizing lousy credit risks. However, financial institutions face challenges such as imbalanced data, inefficient feature selection, and limited user accessibility. This study combines Recursive Feature Elimination (RFE) and Deep Learning (DL) to improve prediction accuracy. It integrates a chatbot interface for user-friendly testing. RFE effectively identifies critical features, while the DL model achieves a validation accuracy of 97.62%, surpassing previous studies with less comprehensive methodologies. The chatbot's novel design not only ensures accessibility but also enhances user engagement through flexible input options, such as approximate values, enabling non experts to …

Optimal Strategy For Handling Unbalanced Medical Datasets: Performance Evaluation Of K-Nn Algorithm Using Sampling Techniques, Yulita Salim, Aulia Putri Utami, Abdul Rachman Manga, Huzain Azis, Fadhila Tangguh Admojo

Knowledge Engineering and Data Science

This study addresses the critical role of medical image classification in enhancing healthcare effectiveness and tackling the challenges of imbalanced medical datasets. It focuses on optimizing classification performance by integrating Canny edge detection for segmentation and Hu-moment feature extraction and applying oversampling and undersampling techniques. Five diverse medical datasets were utilized, covering Alzheimer’s and Parkinson’s diseases, COVID-19, brain tumours, and lung cancer. The K-Nearest Neighbors (K-NN) algorithm was implemented to enhance classification accuracy, aiming to develop a more robust framework for medical image analysis. The evaluation, conducted using cross-validation, demonstrated notable improvements in key metrics. Specifically, oversampling significantly enhanced lung …

A Hierarchical Density-Based Spatial Clustering Of Applications With Noise (Hdbscan) Approach For Identifying Potential Villages In Buleleng Regency, Dina Nur Amalina, Achmad Fauzan

Knowledge Engineering and Data Science

Buleleng Regency, located in Bali Province, possesses diverse village potential, including agricultural production and tourist attractions. However, this potential has not been fully optimized. Therefore, it is important to enhance village potential by clustering villages based on their specific characteristics to identify and prioritize those requiring special attention. This approach aims to promote equitable village development and reduce poverty levels. This study clusters villages in Buleleng Regency based on their potential using the Hierarchical Density-Based Spatial Clustering of Applications with Noise (HDBSCAN) method. The data utilized in this study comprises village potential data obtained from the Buleleng Regency Statistics Office …

Manifold Learning And Undersampling Approaches For Imbalanced Class Sentiment Classification, L.M. Risman Dwi Jumansyah, Agus Mohamad Soleh, Utami Dyah Syafitri

Knowledge Engineering and Data Science

Movie reviews are crucial in determining a film's success by influencing audience decisions. Automating sentiment classification is essential for efficient public opinion analysis. However, it faces challenges such as high-dimensional data and imbalanced class distributions. This study addresses these issues by applying manifold learning techniques, Principal Component Analysis (PCA) and Laplacian Eigenmaps (LE) to reduce data complexity and undersampling strategies (Random Undersampling (RUS) and EasyEnsemble) to balance data and improve predictions for both sentiment classes. On reviews of The Raid 2: Berandal, EasyEnsemble achieved the highest average G-Mean of 0.694 using Term Frequency-Inverse Document Frequency (TF IDF) features with a …

Constructing Qur’An Recitation Classification Using Alexnet Algorithm, Harits Ar Rosyid, Dzulkifli Abdullah, Mohammed S. Alqahtani

Knowledge Engineering and Data Science

The growing demands for accurate and efficient methods in the Qur'an recitation classification highlight the limitations of existing models, particularly in assisting the memorization process. This study aims to address these challenges by implementing the AlexNet Convolutional Neural Network architecture, widely recognized for its effectiveness in image classification, to classify the Qur'an recitations using the Mel Frequency Cepstral Coefficient (MFCC) as the feature extraction method. The research involves several stages, including data collection, preprocessing (audio segmentation by verse), data augmentation, feature extraction, and classification using the AlexNet architecture, followed by performance evaluation. Key results demonstrate that the combination of MFCC …

Deep Learning Approach For Dental Anomalies X-Ray Imaging Using Yolov8, Amelia Ritahani Ismail, Md Salim Sadman Taseen

Knowledge Engineering and Data Science

Dental X-ray imaging is a critical diagnostic tool for identifying various dental anomalies. However, manual interpretation is time-consuming, prone to human error, and requires specialized expertise. Deep learning models, particularly object detection frameworks like YOLO, have demonstrated promising results in automating medical image analysis. This study aims to develop and evaluate a YOLOv8-based deep learning model for automated detection and classification of 14 dental anomaly categories, including Caries, Crowns, Fillings, Implants, and Periapical lesions. The proposed approach addresses limitations in previous YOLO versions by leveraging anchor-free detection and enhanced feature extraction for improved accuracy. The model was trained on a …

Classification Of Anxiety Levels Entering The World Of Work In Final Year Students Using The Neighbor Weighted K-Nearest Neighbor Method, Awang Hendrianto Pratomo, Muhammad Fahmi Adam, Dessyanto Boedi Prasetyo

Knowledge Engineering and Data Science

This study evaluates the accuracy of the Neighbor Weighted K-Nearest Neighbor (NWKNN) method in classifying the anxiety levels of final-year students as they prepare to enter the workforce, particularly in cases of unbalanced data distribution. The system was developed using the prototype method, and NWKNN was applied to classify anxiety levels into low, medium, and high categories. Testing using the Confusion Matrix demonstrated strong performance, achieving an accuracy of 94% based on a dataset of 1009 students, with a 90:10 ratio of training to test data. The results indicate that NWKNN effectively provides classification input values, making it a reliable …

Comparative Analysis Of Bpnn And Lvq For Sundanese Character Recognition, Haviluddin Haviluddin, Herman Santoso Pakpahan, Dinda Izmya Nurpadillah, Hario Jati Setyadi, Medi Taruk, Rayner Alfred

Knowledge Engineering and Data Science

The Sundanese script (Aksara Sunda), an essential part of Sundanese cultural heritage, has been used since the 14th century AD. However, recognizing handwritten Sundanese characters remains challenging due to variations in individual writing styles. This study compares the performance of Backpropagation Neural Network (BPNN) and Learning Vector Quantization (LVQ) for recognizing handwritten Sundanese vowel (Swara) characters. A dataset was collected from 15 individuals, each writing seven Sundanese vowel characters, which were then used for training and testing the recognition models. Experimental results show that BPNN outperforms LVQ, achieving a higher classification accuracy (95.23%), lower Mean Squared Error (MSE), and faster …

M3t-Lm: A Multi-Modal Multi-Task Learning Model For Jointly Predicting Patient Length Of Stay And Mortality, Junde Chen, Qing Li, Feng Liu, Yuxin Wen

Engineering Faculty Articles and Research

Ensuring accurate predictions of inpatient length of stay (LoS) and mortality rates is essential for enhancing hospital service efficiency, particularly in light of the constraints posed by limited healthcare resources. Integrative analysis of heterogeneous clinic record data from different sources can hold great promise for improving the prognosis and diagnosis level of LoS and mortality. Currently, most existing studies solely focus on single data modality or tend to single-task learning, i.e., training LoS and mortality tasks separately. This limits the utilization of available multi-modal data and prevents the sharing of feature representations that could capture correlations between different tasks, ultimately …

Exploring Lstm-Based Attention Mechanisms With Pso And Grid Search Under Different Normalization Techniques For Energy Demands Time Series Forecasting, Andri Pranolo, Xiaofeng Zhou, Yingchi Mao, Bambang Widi Pratolo, Aji Prasetya Wibawa, Agung Bella Putra Utama, Abdoul Fatakhou Ba, Abdullahi Uwaisu Muhammad

Knowledge Engineering and Data Science

Advanced analytical approaches are required to accurately forecast the energy sector's rising complexity and volume of time series data. This research aims to forecast the energy demand utilising sophisticated Long Short-Term Memory (LSTM) configurations with Attention mechanisms (Att), Grid search, and Particle Swarm Optimization (PSO). In addition, the study also examines the influence of Min-Max and Z-Score normalization approaches in the preprocessing stage on the accuracy performances of the baselines and the proposed models. PSO and Grid Search techniques are used to select the best hyperparameters for LSTM models, while the attention mechanism selects the important input for the LSTM. …

Hybrid Method For User Review Sentiment Categorization In Chatgpt Application Using N-Gram And Word2vec Features, Husna Luthfiatun Nisa, Atina Ahdika

Knowledge Engineering and Data Science

The rapid development of Artificial Intelligence (AI) has significantly influenced nearly all aspects of life. One AI product widely used by people worldwide is the Chat Generative Pre-Training Transformer (ChatGPT), which can respond to questions conversationally. Although data indicates that the use of ChatGPT in Indonesia is less widespread than in other countries, a Populix survey reveals that half of the respondents have utilized ChatGPT, using AI more than once a month. This indicates its crucial role among the Indonesian population. ChatGPT is not limited to browsers; it is also available as a downloadable application on the Google Play Store. …

Convolutional Neural Network In Motion Detection For Physiotherapy Exercise Movement, Dika Fikri Laistulloh, Anik Nur Handayani, Rosa Andrie Asmara, Phillip Taw

Knowledge Engineering and Data Science

Physiotherapy focuses on movement and optimal utilization of the patient's potential. Exercise Therapy is a physiotherapy procedure that specifically focuses exercises on active and passive movements. Cerebral Palsy (CP) patients are one of the sufferers of motor disorders of the upper extremities. Cerebral Palsy (CP) patients suffer from disorders in motor functions of the upper extremities. Physiotherapy Exercise Movement has 4 categories of movement exercises for the therapy of people with upper extremity body disorders: Elbow flexor strengthening in sitting using free weights, lifting an object up, reaching diagonally in sitting, and reaching from a low surface to a high …

Optimizing Malaria Control: Granular And Cost-Effective Mosquito Habitat Index In Endemic Areas Through Satellite Imagery, Nur Ainun Daulay, Salwa Rizqina Putri, Arie Wahyu Wijayanto, Ika Yuni Wulansari

Knowledge Engineering and Data Science

Malaria, classified as a tropical disease under the Sustainable Development Goals (SDGs) indicator 3.3, remains a significant global health challenge. In this study, by taking advantage of multiple spectral composite indexes of multisource satellite imagery to capture various geospatial features relevant to the suitability of marsh mosquito habitat, we introduced the Mosquito Habitat Suitability Index (MHSI) to assess potential Anopheles mosquito breeding sites in terms of the vegetation density, water bodies, environment temperature, and humidity in any particular areas. The MHSI integrates the publicly accessible granular level of the normalized difference vegetation index, water index, land surface temperature, and moisture …

Docker Optimization Of An Automotive Sector Virtual Server Infrastructure, Leonel Hernandez, Carlos Eduardo Uc Rios

Knowledge Engineering and Data Science

Server virtualization is a powerful strategy for optimizing network infrastructure. It allows multiple virtual servers to run on a single physical server, maximizing resource utilization and improving efficiency. Deploying server virtualization using Docker technology offers a lightweight and flexible approach to optimizing network infrastructure. Docker contains package applications and their dependencies, enabling consistent and efficient deployment across various environments. Specifically, optimizing virtual server infrastructure using Docker Technology in the automotive sector focuses on improving the efficiency and management of the company's virtual server resources. By implementing Docker technology, a container platform that allows the packaging and running of applications in …

Timbre Style Transfer For Musical Instruments Acoustic Guitar And Piano Using The Generator-Discriminator Model, Widean Nagari, Joan Santoso, Esther Irawati Setiawan

Knowledge Engineering and Data Science

Music style transfer is a technique for creating new music by combining the input song's content and the target song's style to have a sound that humans can enjoy. This research is related to timbre style transfer, a branch of music style transfer that focuses on using the generator-discriminator model. This exciting method has been used in various studies in the music style transfer domain to train a machine learning model to change the sound of instruments in a song with the sound of instruments from other songs. This work focuses on finding the best layer configuration in the generator- …

Optimising The Fashion E-Commerce Journey: A Data-Driven Approach To Customer Retention, Hasna Luthfiana Fadhila, Vynska Amalia Permadi, Sylvert Prian Tahalea

Knowledge Engineering and Data Science

A fashion e-commerce company offers a wide range of products from domestic and international brands that are popular with young people. However, there has been an increase in non-organically acquired customers, many of whom do not return to make repeat purchases. This has led to a higher customer churn rate, with a significant proportion of non-organically sourced customers failing to become repeat purchasers. Consequently, a churn analysis and prediction model were developed to address this issue. This paper employs the Recency, Frequency, and Monetary (RFM) framework for churn analysis and prediction. The framework is underpinned by three key dimensions: last …

Random Forest Algorithm To Measure The Air Pollution Standard Index, Ariyono Setiawan, Untung Lestari Wibowo, Ahmad Mubarok, Khoirunnisa Larasati

Knowledge Engineering and Data Science

This study uses the Random Forest algorithm to measure and predict the Air Pollution Standard Index (APSI) at Blimbing Banyuwangi Airport. Air pollution data, including concentrations of O3, CO, NO2, SO2, PM2.5, and PM10, were collected from air monitoring stations at the airport from April 15-30, 2024. APSI measurement followed established formulas by relevant authorities. Data analysis utilized statistical approaches and computational algorithms. The findings reveal that air quality at the airport is generally "Moderate," with occasional "Good" days. The Random Forest algorithm effectively predicts APSI based on existing pollution data. These results provide insights for improving air pollution management …