Open Access. Powered by Scholars. Published by Universities.®

Data Science Commons™

Open Access. Powered by Scholars. Published by Universities.®

3,285 Full-Text Articles 9,398 Authors 1,400,878 Downloads 224 Institutions

All Articles in Data Science

Faceted Search

3,285 full-text articles. Page 150 of 158.

The Diffusion Of Ict For Corruption Detectionin Open Government Data, Darusalam Darusalam, Jamaliah Said, Normah Omar, Marijn Janssen, Kazi Sohag 2019 University Teknologi Mara, Malaysia

The Diffusion Of Ict For Corruption Detectionin Open Government Data, Darusalam Darusalam, Jamaliah Said, Normah Omar, Marijn Janssen, Kazi Sohag

Knowledge Engineering and Data Science

Corruption occurs in many places within the government. To tackle the issue, open data can be used as one of the tools in creating more insight into the government. The premise of this paper is to support the notion that data opening can bring up new ways of fighting corruption. The current paper aimed at investigating how open data can be employed to detect corruption. This open data is trivial due to challenges like information asymmetry among stakeholders, data might only be opened partly, different sources of data need to be combined, and data might not be easy to use, …


Selection Of Marine Security Policyusing Fuzzy-Ahp Topsis Hybrid Approach, Hozairi Hozairi, Buhari Buhari, Heru Lumaksono, Marcus Tukan 2019 Islamic University of Madura, Indonesia

Selection Of Marine Security Policyusing Fuzzy-Ahp Topsis Hybrid Approach, Hozairi Hozairi, Buhari Buhari, Heru Lumaksono, Marcus Tukan

Knowledge Engineering and Data Science

The research was focused on the integration of Fuzzy set theory with Analytic Hierarchy Process (AHP) and Technique for Order Preference by Similarity to Ideal Solution (TOPSIS) to choose the optimum maritime security policy to achieve Indonesia recognition as the world's maritime axis. The method used is AHP with fuzzy based enhancement. Here, the weight of each criterion is calculated to overcome the criticism of the scale of unbalanced rating, uncertainty, and inaccuracy in the pairwise of comparison process. The best recommendation for Indonesian maritime policies is multi task single agency which is greatly infuenced by several factors such as …


Adam Optimization Algorithmfor Wide And Deep Neural Network, Imran Khan Mohd Jais, Amelia Ritahani Ismail 2019 International Islamic University Malaysia

Adam Optimization Algorithmfor Wide And Deep Neural Network, Imran Khan Mohd Jais, Amelia Ritahani Ismail

Knowledge Engineering and Data Science

The objective of this research is to evaluate the effects of Adam when used together with a wide and deep neural network. The dataset used was a diagnostic breast cancer dataset taken from UCI Machine Learning. Then, the dataset was fed into a conventional neural network for a benchmark test. Afterwards, the dataset was fed into the wide and deep neural network with and without Adam. It was found that there were improvements in the result of the wide and deep network with Adam. In conclusion, Adam is able to improve the performance of a wide and deep neural network.


High Dimensional Data Clustering Using Self-Organized Map, Ruth Ema Febrita, Wayan Firdaus Mahmudy, Aji Prasetya Wibawa 2019 Universitas Brawijaya, Indonesia

High Dimensional Data Clustering Using Self-Organized Map, Ruth Ema Febrita, Wayan Firdaus Mahmudy, Aji Prasetya Wibawa

Knowledge Engineering and Data Science

As the population grows and e economic development, houses could be one of basic needs of every family. Therefore, housing investment has promising value in the future. This research implements the Self-Organized Map (SOM) algorithm to cluster house data for providing several house groups based on the various features. K-means is used as the baseline of the proposed approach. SOM has higher silhouette coefficient (0.4367) compared to its comparison (0.236). Thus, this method outperforms k-means in terms of visualizing high-dimensional data cluster. It is also better in the cluster formation and regulating the data distribution.


Crude Palm Oil Prediction Based On Back Propagation Neutral Network Approach, Hijratul Aini, Haviluddin Haviluddin 2019 Mulawarman University, Indonesia

Crude Palm Oil Prediction Based On Back Propagation Neutral Network Approach, Hijratul Aini, Haviluddin Haviluddin

Knowledge Engineering and Data Science

Crude palm oil (CPO) production at PT. Perkebunan Nusantara (PTPN) XIII from January 2015 to January 2018 have been treated. This paper aims to predict CPO production using intelligent algorithms called Backpropagation Neural Network (BPNN). The accuracy of prediction algorithms have been measured by mean square error (MSE). The experiment showed that the best hidden layer architecture (HLA) is 5-10-11-12-13-1 with learning function (LF) of trainlm, activation function (AF) of logsig and purelin, and learning rate (LR) of 0.5. This architecture has a good accuracy with MSE of 0.0643. The results showed that this model can predict CPO production in …


Statistical Machine Learning Methods For Mining Spatial And Temporal Data, Fei Tan 2019 New Jersey Institute of Technology

Statistical Machine Learning Methods For Mining Spatial And Temporal Data, Fei Tan

Dissertations

Spatial and temporal dependencies are ubiquitous properties of data in numerous domains. The popularity of spatial and temporal data mining has thus grown with the increasing prevalence of massive data. The presence of spatial and temporal attributes not only provides complementary useful perspectives, but also poses new challenges to the representation and integration into the learning procedure. In this dissertation, the involved spatial and temporal dependencies are explored with three genres: sample-wise, feature-wise, and target-wise. A family of novel methodologies is developed accordingly for the dependency representation in respective scenarios.

First, dependencies among discrete, continuous and repeated observations are studied …


On Properties Of Distance-Based Entropies On Fullerene Graphs, Modjtaba Ghorbani, Matthias Dehmer, Mina Rajabi-Parsa, Abbe Mowshowitz, Frank Emmert-Streib 2019 Shahid Rajaee Teacher Training University

On Properties Of Distance-Based Entropies On Fullerene Graphs, Modjtaba Ghorbani, Matthias Dehmer, Mina Rajabi-Parsa, Abbe Mowshowitz, Frank Emmert-Streib

Publications and Research

In this paper, we study several distance-based entropy measures on fullerene graphs. These include the topological information content of a graph Ia(G), a degree-based entropy measure, the eccentric-entropy Ifs(G), the Hosoya entropy H(G) and, finally, the radial centric information entropy Hecc. We compare these measures on two infinite classes of fullerene graphs denoted by A12n+4 and B12n+6. We have chosen these measures as they are easily computable and capture meaningful graph properties. To demonstrate the utility of these measures, we investigate the Pearson correlation between them on the fullerene graphs.


Watersheds For Semi-Supervised Classification, Aditya Challa, Sravan Danda, B. S.Daya Sagar, Laurent Najman 2019 Indian Statistical Institute Bangalore

Watersheds For Semi-Supervised Classification, Aditya Challa, Sravan Danda, B. S.Daya Sagar, Laurent Najman

Journal Articles

Watershed technique from mathematical morphology (MM) is one of the most widely used operators for image segmentation. Recently watersheds are adapted to edge weighted graphs, allowing for wider applicability. However, a few questions remain to be answered - How do the boundaries of the watershed operator behave? Which loss function does the watershed operator optimize? How does watershed operator relate with existing ideas from machine learning. In this letter, a framework is developed, which allows one to answer these questions. This is achieved by generalizing the maximum margin principle to maximum margin partition and proposing a generic solution, morphMedian, resulting …


Do Misperceptions Of Peer Drinking Influence Personal Drinking Behavior? Results From A Complete Social Network Of First-Year College Students, Melissa J. Cox, Angelo M. DiBello, Matthew K. Meisel, Miles Q. Ott, Shannon R. Kenney, Melissa A. Clark, Nancy P. Barnett 2019 East Carolina University

Do Misperceptions Of Peer Drinking Influence Personal Drinking Behavior? Results From A Complete Social Network Of First-Year College Students, Melissa J. Cox, Angelo M. Dibello, Matthew K. Meisel, Miles Q. Ott, Shannon R. Kenney, Melissa A. Clark, Nancy P. Barnett

Statistical and Data Sciences: Faculty Publications

This study considered the influence of misperceptions of typical versus self-identified important peers' heavy drinking on personal heavy drinking intentions and frequency utilizing data from a complete social network of college students. The study sample included data from 1,313 students (44% male, 57% White, 15% Hispanic/Latinx) collected during the fall and spring semesters of their freshman year. Students provided perceived heavy drinking frequency for a typical student peer and up to 10 identified important peers. Personal past-month heavy drinking frequency was assessed for all participants at both time points. By comparing actual with perceived heavy drinking frequencies, measures of misperceptions …


Forecasting The Number Of Monthly Active Facebook And Twitter Worldwide Users Using Arma Model, Qasem Abu Al-Haija, Qian Mao, Kamal Al Nasr 2019 Tennessee State University

Forecasting The Number Of Monthly Active Facebook And Twitter Worldwide Users Using Arma Model, Qasem Abu Al-Haija, Qian Mao, Kamal Al Nasr

Computer Science Faculty Research

In this study, an Auto-Regressive Moving Average (ARMA) Model with optimal order has been developed to estimate and forecast the short term future numbers of the monthly active Facebook and Twitter worldwide users. In order to pickup the optimal estimation order, we analyzed the model order vs. the corresponding model error in terms of final prediction error. The simulation results showed that the optimal model order to estimate the given Facebook and Twitter time series are ARMA[5, 5] and ARMA[3, 3], respectively, since they correspond to the minimum acceptable prediction error values. Besides, the optimal models recorded a high-level of …


A Grammar For Reproducible And Painless Extract-Transform-Load Operations On Medium Data, Benjamin S. Baumer 2019 Smith College

A Grammar For Reproducible And Painless Extract-Transform-Load Operations On Medium Data, Benjamin S. Baumer

Statistical and Data Sciences: Faculty Publications

Many interesting datasets available on the Internet are of a medium size—too big to fit into a personal computer’s memory, but not so large that they would not fit comfortably on its hard disk. In the coming years, datasets of this magnitude will inform vital research in a wide array of application domains. However, due to a variety of constraints they are cumbersome to ingest, wrangle, analyze, and share in a reproducible fashion. These obstructions hamper thorough peer-review and thus disrupt the forward progress of science. We propose a predictable and pipeable framework for R (the state-of-the-art statistical computing environment) …


Exploring And Visualizing Household Electricity Consumption Patterns In Singapore: A Geospatial Analytics Approach, Yong Ying TAN, Tin Seong KAM 2019 Singapore Management University

Exploring And Visualizing Household Electricity Consumption Patterns In Singapore: A Geospatial Analytics Approach, Yong Ying Tan, Tin Seong Kam

Research Collection School Of Computing and Information Systems

Despite being a small country-state, electricity consumption in Singa-pore is said to be non-homogeneous, as exploratory data analysis showed that the distributions of electricity consumption differ across and within administrative boundaries and dwelling types. Local indicators of spatial association (LISA) were calculated for public housing postal codes using June 2016 data to discover local clusters of households based on electricity consumption patterns. A detailed walkthrough of the analytical process is outlined to describe the R packages and framework used in the R environment. The LISA results are visualized on three levels: country level, regional level and planning subzone level. At …


Bridge Deck Delamination Segmentation Based On Aerial Thermography Through Regularized Grayscale Morphological Reconstruction And Gradient Statistics, Chongsheng Cheng, Zhexiong Shang, Zhigang Shen 2019 University of Nebraska-Lincoln

Bridge Deck Delamination Segmentation Based On Aerial Thermography Through Regularized Grayscale Morphological Reconstruction And Gradient Statistics, Chongsheng Cheng, Zhexiong Shang, Zhigang Shen

Department of Construction Engineering and Management: Faculty Publications

Environmental and surface texture-induced temperature variation across the bridge deck is a major source of errors in delamination detection through thermography. This type of external noise poises a significant challenge for conventional quantitative methods such as global thresholding and k-means clustering. An iterative top-down approach is proposed for delamination segmentation based on grayscale morphological reconstruction. A weight-decay function was used to regularize the reconstruction for regional maxima extraction. The mean and coefficient of variation of temperature gradient estimated from delamination boundaries were used for discrimination. The proposed approach was tested on a lab experiment and an in-service bridge deck. The …


Streaming Feature Grouping And Selection (Sfgs) For Big Data Classification, Noura Helal Hamad Al Nuaimi 2019 United Arab Emirates University

Streaming Feature Grouping And Selection (Sfgs) For Big Data Classification, Noura Helal Hamad Al Nuaimi

Dissertations

Real-time data has always been an essential element for organizations when the quickness of data delivery is critical to their businesses. Today, organizations understand the importance of real-time data analysis to maintain benefits from their generated data. Real-time data analysis is also known as real-time analytics, streaming analytics, real-time streaming analytics, and event processing. Stream processing is the key to getting results in real-time. It allows us to process the data stream in real-time as it arrives. The concept of streaming data means the data are generated dynamically, and the full stream is unknown or even infinite. This data becomes …


Thermographic Laplacian-Pyramid Filtering To Enhance Delamination Detection In Concrete Structure, Chongsheng Cheng, Ri Na, Zhigang Shen 2019 University of Delaware

Thermographic Laplacian-Pyramid Filtering To Enhance Delamination Detection In Concrete Structure, Chongsheng Cheng, Ri Na, Zhigang Shen

Department of Construction Engineering and Management: Faculty Publications

Despite decades of efforts using thermography to detect delamination in concrete decks, challenges still exist in removing environmental noise from thermal images. The performance of conventional temperature-contrast approaches can be significantly limited by environment-induced non-uniform temperature distribution across imaging spaces. Time-series based methodologies were found robust to spatial temperature non-uniformity but requires extended period to collect data. A new empirical image filtering method is introduced in this paper to enhance the delamination detection using blob detection method that originated from computer vison. The proposed method employs a Laplacian of Gaussian filter to achieve multi-scale detection of abnormal thermal patterns by …


Untapped Potential Of Clinical Text For Opioid Surveillance, Amy L. Olex, Tamas Gal, Majid Afshar, Dmitriy Dligach, Niranjan Karnik, Travis Oakes, Brihat Sharma, Meng Xie, Bridget T. McInnes, Julian Solway, Abel Kho, William Cramer, F. Gerard Moeller 2019 Virginia Commonwealth University

Untapped Potential Of Clinical Text For Opioid Surveillance, Amy L. Olex, Tamas Gal, Majid Afshar, Dmitriy Dligach, Niranjan Karnik, Travis Oakes, Brihat Sharma, Meng Xie, Bridget T. Mcinnes, Julian Solway, Abel Kho, William Cramer, F. Gerard Moeller

Wright Center for Clinical and Translational Research Works

Accurate surveillance is needed to combat the growing opioid epidemic. To investigate the potential volume of missed opioid overdoses, we compare overdose encounters identified by ICD-10-CM codes and an NLP pipeline from two different medical systems. Our results show that the NLP pipeline identified a larger percentage of OOD encounters than ICD-10-CM codes. Thus, incorporating sophisticated NLP techniques into current diagnostic methods has the potential to improve surveillance on the incidence of opioid overdoses.


Radically Simplifying Gated Recurrent Architectures Without Loss Of Performance, Jonathan Boardman, Ying Xie 2019 Kennesaw State University

Radically Simplifying Gated Recurrent Architectures Without Loss Of Performance, Jonathan Boardman, Ying Xie

Published and Grey Literature from PhD Candidates

Long Short-Term Memory (LSTM) units are a family of Recurrent Neural Network (RNN) architectures that have proven incredibly effective at learning from sequence data. They are also extremely complex, making them expensive to train and difficult to understand. A recent trend towards simplification has produced the Gated Recurrent Unit (GRU) and the Minimal Gated Unit (MGU), both of which perform as well as the LSTM (or better) on a variety of tasks. The MGU is one of the simplest gated recurrent architectures at the moment. Our study demonstrates that it is possible to radically simplify the MGU without significant loss …


Knowledge Management Overview Of Feature Selection Problem In High-Dimensional Financial Data: Cooperative Co-Evolution And Map Reduce Perspectives, A. N. M. Bazlur Rashid, Tonmoy Choudhury 2019 Edith Cowan University

Knowledge Management Overview Of Feature Selection Problem In High-Dimensional Financial Data: Cooperative Co-Evolution And Map Reduce Perspectives, A. N. M. Bazlur Rashid, Tonmoy Choudhury

Research outputs 2014 to 2021

The term "big data" characterizes the massive amounts of data generation by the advanced technologies in different domains using 4Vs volume, velocity, variety, and veracity-to indicate the amount of data that can only be processed via computationally intensive analysis, the speed of their creation, the different types of data, and their accuracy. High-dimensional financial data, such as time-series and space-Time data, contain a large number of features (variables) while having a small number of samples, which are used to measure various real-Time business situations for financial organizations. Such datasets are normally noisy, and complex correlations may exist between their features, …


Canadian Hockey Leagues Game-To-Game Performance, Nick R. Riccardi 2019 Syracuse University

Canadian Hockey Leagues Game-To-Game Performance, Nick R. Riccardi

Sport Management - All Scholarship

This study examines game-to-game performance of players across the three Canadian Hockey Leagues (Western Hockey League, Ontario Hockey League, and Quebec Major Junior Hockey League) for the 2017-2018 season. It tests the importance of factors such as rest, travel, weather conditions, and more. Data for this study were collected from each of the three CHL websites and from www.weatherunderground.com. The null hypotheses of different factors affecting performance were tested through regression models using Ordinary Least Squares. The dependent variables, used across different specifications, were on-ice performance variables such as points, goals, and penalty minutes on a per-game basis.


Enrollment And Assessment Of A First-Year College Class Social Network For A Controlled Trial Of The Indirect Effect Of A Brief Motivational Intervention, Nancy P. Barnett, Melissa A. Clark, Shannon R. Kenney, Graham DiGuiseppi, Matthew K. Meisel, Sara Balestrieri, Miles Q. Ott, John Light 2019 Center for Alcohol and Addiction Studies

Enrollment And Assessment Of A First-Year College Class Social Network For A Controlled Trial Of The Indirect Effect Of A Brief Motivational Intervention, Nancy P. Barnett, Melissa A. Clark, Shannon R. Kenney, Graham Diguiseppi, Matthew K. Meisel, Sara Balestrieri, Miles Q. Ott, John Light

Statistical and Data Sciences: Faculty Publications

Heavy drinking and its consequences among college students represent a serious public health problem, and peer social networks are a robust predictor of drinking-related risk behaviors. In a recent trial, we administered a Brief Motivational Intervention (BMI) to a small number of first-year college students to assess the indirect effects of the intervention on peers not receiving the intervention. Objectives: To present the research design, describe the methods used to successfully enroll a high proportion of a first-year college class network, and document participant characteristics. Methods: Prior to study enrollment, we consulted with a student advisory group and campus stakeholders …


Digital Commons powered by bepress