Data Science Commons^™

A Machine Learning Approach To Revenue Generation Within The Professional Hair Care Industry, Alexander K. Sepenu, Linda Eliasen

SMU Data Science Review

The cosmetic and beauty industry continues to grow and evolve to satisfy its patrons. In the United States, the industry is heavily science-driven, innovative, and fast-paced, suggesting that to remain productive and profitable, companies must seek smart alternatives to their current modus operandi or risk losing out on this multi-billion-dollar industry to fierce competition. In this paper, the authors seek to utilize machine learning models such as clustering and regression to improve the efficiency of current sales and customer segmentation models to help HairCo (pseudonym for confidentiality), a professional hair products manufacturer, strategize their marketing and sales efforts for revenue …

Analysis Of The Electric Power Outage Data And Prediction Of Electric Power Outage For Major Metropolitan Areas In Texas Using Machine Learning And Time Series Methods, Renfeng Wang, Venkata Leela 'Mg' Vanga, Zachary B. Zaiken, Jonathan Bennett

SMU Data Science Review

With growing energy usage, power outages affect millions of households. This case study focuses on gathering power outage historical data, modifying the data to attach weather attributes, and gathering ERCOT energy market conditions for Dallas-Fort Worth and Houston metropolitan areas of Texas. The transformed data is then analyzed using machine learning algorithms including, but not limited to, Regression, Random Forests and XGBoost to consider current weather and ERCOT features and predict power outage percentage for locations. The transformed data is also trained using time series models and serially correlated models including Autoregression and Vector Autoregression. This study also focuses on …

Web Page Multiclass Classification, Brian Gaither, Antonio Debouse, Catherine Huang

SMU Data Science Review

As the internet age evolves, the volume of content hosted on the Web is rapidly expanding. With this ever-expanding content, the capability to accurately categorize web pages is a current challenge to serve many use cases. This paper proposes a variation in the approach to text preprocessing pipeline whereby noun phrase extraction is performed first followed by lemmatization, contraction expansion, removing special characters, removing extra white space, lower casing, and removal of stop words. The first step of noun phrase extraction is aimed at reducing the set of terms to those that best describe what the web pages are about …

Anomaly Detection Methods To Improve Supply Chain Data Quality And Operations, Ana E. Glaser, Jake P. Harrison, David Josephs

SMU Data Science Review

Supply chain operations drive the planning, manufacture, and distribution of billions of semiconductors a year, spanning thousands of products across many supply chain configurations. The customizations span from wafer technology to die stacking and chip feature enablement. Data quality drives efficiency in these processes and anomalies in data can be very disruptive, and at times, consequential. Developing preventative measures that automate the detection of anomalies before they reach downstream execution systems would result in significant efficiency gain for the organization. The purpose of this research is to identify an effective, actionable, and computationally efficient approach to highlight anomalies in a …

Adjusting Community Survey Data Benchmarks For External Factors, Allen Miller, Nicole M. Norelli, Robert Slater, Mingyang N. Yu

SMU Data Science Review

Abstract. Using U.S. resident survey data from the National Community Survey in combination with public data from the U.S. Census and additional sources, a Voting Regressor Model was developed to establish fair benchmark values for city performance. These benchmarks were adjusted for characteristics the city cannot easily influence that contribute to confidence in local government, such as population size, demographics, and income. This adjustment allows for a more meaningful comparison and interpretation of survey results among individual cities. Methods explored for the benchmark adjustment included cluster analysis, anomaly detection, and a variety of regression techniques, including random forest, ridge, decision …

Machine Learning And The Network Analysis Of Ethereum Trading Data, Santosh Sivakumar

Dartmouth College Undergraduate Theses

Since their conception, cryptocurrencies have captured the public interest, motivating a growing body of research aimed at exploring blockchain-based transactions. This said, little work has been done to draw conclusions from transaction patterns, particularly in the realm of predicting cryptocurrency price movements. Moreover, research in the cryptocurrency sphere largely focuses on Bitcoin, paying little attention to Ethereum, Bitcoin's second-in-line with respect to market capitalization. In this paper, we construct hourly networks for a year of Ethereum transactions, using computed graph metrics as features in a series of machine learning models. We find that regression-based approaches to predicting Ether prices/price deltas …

Multi-View Scheduling Of Onboard Live Video Analytics To Minimize Frame Processing Latency, Shengzhong Liu, Tianshi Wang, Hongpeng Guo, Xinzhe Fu, Philip David, Maggie Wigness, Archan Misra, Tarek Abdelzaher

Research Collection School Of Computing and Information Systems

This paper presents a real-time multi-view scheduling framework for DNN-based live video analytics at the edge to minimize frame processing latency. The work is motivated by applications where a higher frame rate is important, not to miss actions of interest. Examples include defense, border security, and intruder detection applications where sensors (in this paper, cameras) are deployed to monitor key roads, chokepoints, or passageways to identify events of interest (and intervene in real-time). Supporting a higher frame rate entails lowering frame processing latency. We assume that multiple cameras are deployed with partially overlapping views. Each camera has access to limited …

Innovative Heuristics To Improve The Latent Dirichlet Allocation Methodology For Textual Analysis And A New Modernized Topic Modeling Approach, Jamie T. Zimmerman

Theses and Dissertations

Natural Language Processing is a complex method of data mining the vast trove of documents created and made available every day. Topic modeling seeks to identify the topics within textual corpora with limited human input into the process to speed analysis. Current topic modeling techniques used in Natural Language Processing have limitations in the pre-processing steps. This dissertation studies topic modeling techniques, those limitations in the pre-processing, and introduces new algorithms to gain improvements from existing topic modeling techniques while being competitive with computational complexity. This research introduces four contributions to the field of Natural Language Processing and topic modeling. …

Legislative Language For Success, Sanjana Gundala

Master's Theses

Legislative committee meetings are an integral part of the lawmaking process for local and state bills. The testimony presented during these meetings is a large factor in the outcome of the proposed bill. This research uses Natural Language Processing and Machine Learning techniques to analyze testimonies from California Legislative committee meetings from 2015-2016 in order to identify what aspects of a testimony makes it successful. A testimony is considered successful if the alignment of the testimony matches the bill outcome (alignment is "For" and the bill passes or alignment is "Against" and the bill fails). The process of finding what …

Leveraging Context Patterns For Medical Entity Classification, Garrett Johnston

Computer Science Senior Theses

The ability of patients to understand health-related text is important for optimal health outcomes. A system that can automatically annotate medical entities could help patients better understand health-related text. Such a system would also accelerate manual data annotation for this low-resource domain as well as assist in down- stream medical NLP tasks such as finding textual similarity, identifying conflicting medical advice, and aspect-based sentiment analysis. In this work, we investigate a state-of-the-art entity set expansion model, BootstrapNet, for the task of medical entity classification on a new dataset of medical advice text. We also propose EP SBERT, a simple model …

External Validation Of A Laboratory Prediction Algorithm For The Reduction Of Unnecessary Labs In The Critical Care Setting, Linda T Li, Tongtong Huang, Elmer V Bernstam, Xiaoqian Jiang

Faculty, Staff and Student Publications

BACKGROUND: Unnecessary laboratory tests contribute to iatrogenic harm and are a major source of waste in the health care system. We previously developed a machine learning algorithm to help clinicians identify unnecessary laboratory tests, but it has not been externally validated. In this study, we externally validate our machine learning algorithm.

METHODS: To externally validate the machine learning algorithm that was originally trained on the Medical Information Mart for Intensive Care (MIMIC) III database, we tested the algorithm in a separate institution. We identified and abstracted data for all patients older than 18 years admitted to the intensive care unit …

A Multi-Task Gaussian Process Self-Attention Neural Network For Real-Time Prediction Of The Need For Mechanical Ventilators In Covid-19 Patients, Kai Zhang, Siddharth Karanth, Bela Patel, Robert Murphy, Xiaoqian Jiang

Faculty, Staff and Student Publications

OBJECTIVE: The Coronavirus Disease 2019 (COVID-19) pandemic has overwhelmed the capacity of healthcare resources and posed a challenge for worldwide hospitals. The ability to distinguish potentially deteriorating patients from the rest helps facilitate reasonable allocation of medical resources, such as ventilators, hospital beds, and human resources. The real-time accurate prediction of a patient's risk scores could also help physicians to provide earlier respiratory support for the patient and reduce the risk of mortality.

METHODS: We propose a robust real-time prediction model for the in-hospital COVID-19 patients' probability of requiring mechanical ventilation (MV). The end-to-end neural network model incorporates the Multi-task …

Exploring The Effectiveness Of Multiple-Exemplar Training For Visual Analysis Of Ab-Design Graphs, Verena S. Bethke

Dissertations, Theses, and Capstone Projects

In behavior analysis, data are usually analyzed using visual analysis of the graphed data. There are a wide range of methods used to visually analyze data, from a basic ‘textbook’ style approach to the use of visual aids, decision-rubrics, and computer-based approaches. In the literature, there have been some comparisons of the efficacy of different approaches. Visual analysis as a behavior can be taught using a variety of methods, independent of how the skill itself is to be performed. Teaching methods include lecture, online instruction, and equivalence-based instruction. There is not much research on the teaching of visual analysis specifically, …

A Comparison Of Machine Learning Techniques For Validating Students’ Proficiency In Mathematics, Alexander Avdeev

Dissertations, Theses, and Capstone Projects

A principal goal of this project was to compare several machine learning (ML) algorithms to explore and validate math proficiency classifications based on standardized test scores. The data used in these analyses came from the 6th-grade students’ mathematics assessment records of the New York State Education Department’s Testing Program (NYSTP). Our approach was to test a number of competing machine learning (ML) algorithms for classifying students’ as proficient based on their test scores and other demographic information. Our samples were drawn from the 2016 test-taking cohort of 6th-grade students (N=156,800). Five classifiers including multinominal logistic regression (MLR), XGBoost, Tree-As, Lagrangian …

Symmetry-Inspired Analysis Of Biological Networks, Ian Leifer

Dissertations, Theses, and Capstone Projects

The description of a complex system like gene regulation of a cell or a brain of an animal in terms of the dynamics of each individual element is an insurmountable task due to the complexity of interactions and the scores of associated parameters. Recent decades brought about the description of these systems that employs network models. In such models the entire system is represented by a graph encapsulating a set of independently functioning objects and their interactions. This creates a level of abstraction that makes the analysis of such large scale system possible. Common practice is to draw conclusions about …

Heating Fire Incidents In New York City, Merissa K. Lissade

Dissertations, Theses, and Capstone Projects

If you have ever had the Citizen app downloaded on your smart phone, then you know how many alerts you receive in a day living in New York City (NYC). Citizen is a mobile app that sends real-time safety alerts based on the location of its user. In my experience having the app, I have seen many notifications of fires caused by heaters during the winter. On the morning of January 9^th, 2022, I received a notification of an accidental blaze that took the lives of 17 people from the choking smoke of a 19-story residential building in …

Why, New York City? Gauging The Quality Of Life Through The Thoughts Of Tweeters, Sheryl Williams

Dissertations, Theses, and Capstone Projects

As a resource for social data, Twitter’s platform has been used to measure the quality of life through sentiment analysis. This capstone project explores another methodological technique—querying Twitter data around specific keyword terms to determine dominant topics, word patterns, and sentiment leanings in a geographical area. Focusing on New York City and Los Angeles for comparative analysis, the keyword term “why” will be used to build a Python analysis around topic modeling and sentiment analysis. Using this approach, the analysis reveals social and cultural differences, the overall sentiment of tweets, and subjects of interest to tweeters.

GitHub Repository for all …

Leveraging Single Cell Technologies For The Characterization And Treatment Of Refractory Pancreatic Cancer, Maria Monberg

Dissertations and Theses (Open Access)

Heterogeneity is a hallmark of cancer, and the advent of multimodal single-cell technologies has helped uncover heterogeneity in a high-throughput manner in different cancers across varied contexts at an unprecedented resolution. In an effort to improve precision medicine approaches in pancreatic ductal adenocarcinoma (PDAC), a highly lethal malignancy with a mere 11% 5-year survival rate, this dissertation focuses on first questioning the assumptions of the most basic models used to study PDAC via multimodal single-cell characterization methods at multiple levels of biological organization (scCNVseq and snATACseq for DNA assays, scRNAseq for transcriptomics, and paired protein assays such as multiplexed immunofluorescence …

Effect Of Monetary Policy Rate On Market Interest Rates In Nigeria: A Threshold And Nardl Approach, Oluwafemi E. Awopegba, Joseph O. Afolabi, Lydia T. Adeoye, Godwin O. Akpokodje

CBN Journal of Applied Statistics (JAS)

This study examines the effect of monetary policy rate (MPR) on market interest rates in Nigeria. For parsimony, we develop two indexes called the short-term interest rate (SINT) and Lending interest rate (LINT) to represent deposit and lending rates respectively. The nonlinear autoregressive distributed lag (NARDL) and threshold regression models are adopted. The study uses monthly data from 2002:M1 to 2019:M12. The results of the threshold regression model indicate that the degree of the effect of MPR on SINT and LINT above the estimated threshold of 11 and 13 percent respectively is greater and significant than if MPR were to …

Social Dimension Of Inclusive Growth In Ecowas: Implication For Poverty Reduction, Toriola K. Anu, Goerge O. Emmanuel, Ajayi O. Felix

CBN Journal of Applied Statistics (JAS)

This study investigates the implication of the social dimension of inclusive growth on poverty reduction in Economic Community of West African States (ECOWAS) countries. It specifically examines how social indices of inclusive growth comprising of income inequality, education, and health outcomes affect poverty reduction. The study uses a panel dataset of the six (6) lower-middle income countries in ECOWAS which was analysed via panel Difference Generalised Method of Moment (D-GMM). The results show that GDP per capita exerts significant negative effect on poverty while inequality, education and health outcomes do not show significant effect on poverty. Although, the estimates of …

Effect Of Fdi Inflows On Employment Generation In Selected Ecowas Countries: Heterogeneous Panel Analysis, Timothy A. Aderemi, Olawunmi Omitogun, Bukonla G. Osisanwo

CBN Journal of Applied Statistics (JAS)

The aim of this study is to examine the effect of FDI on employment in ECOWAS sub region between 1990 and 2019. The study utilizes a panel autoregressive distributed lag model to analyse the short run and long run relationship between FDI and employment across ECOWAS sub region. In the short run, the impact of FDI on employment is negative and statistically not significant. Meanwhile, in the long run FDI has a positive and statistically significant impact on employment rate. This implies that FDI has the capacity to generate employment in countries in ECOWAS sub region. Therefore, this study recommends …

Impact Of Covid-19 Pandemic On The Nigeria Stock Market: A Sectoral Stock Prices Analysis, Peter A. Adekunle, Yakubu A. Bello, Udochukwu G. Nwachukwu

CBN Journal of Applied Statistics (JAS)

This study examines the impact of the COVID-19 pandemic on sectoral stock prices in Nigeria stock market using daily data covering from February 28, 2020 to June 26, 2020. Applying the autoregressive distributed lag (ARDL) bounds test, the study finds that COVID-19 pandemic had adverse impact on the stock market indices in the short run. Furthermore, the study documents negative response of sectoral stock prices to the pandemic while the stock prices of the banking sub-sector are the worst hit. Compared to the consumer goods, and industrial subsector indices, the speed of adjustment to long run equilibrium is faster for …

Codem: Conditional Domain Embeddings For Scalable Human Activity Recognition, Abu Zaher Md Faridee, Avijoy Chakma, Zahid Hasan, Nirmalya Roy, Archan Misra

Research Collection School Of Computing and Information Systems

We explore the effect of auxiliary labels in improving the classification accuracy of wearable sensor-based human activity recognition (HAR) systems, which are primarily trained with the supervision of the activity labels (e.g. running, walking, jumping). Supplemental meta-data are often available during the data collection process such as body positions of the wearable sensors, subjects' demographic information (e.g. gender, age), and the type of wearable used (e.g. smartphone, smart-watch). This information, while not directly related to the activity classification task, can nonetheless provide auxiliary supervision and has the potential to significantly improve the HAR accuracy by providing extra guidance on how …

Rhythmedge: Enabling Contactless Heart Rate Estimation On The Edge, Zahid Hasan, Emon Dey, Sreenivasan Ramasamy Ramamurthy, Nirmalya Roy, Archan Misra

Research Collection School Of Computing and Information Systems

The primary contribution of this paper is designing and prototyping a real-time edge computing system, RhythmEdge, that is capable of detecting changes in blood volume from facial videos (Remote Photoplethysmography; rPPG), enabling cardio-vascular health assessment instantly. The benefits of RhythmEdge include non-invasive measurement of cardiovascular activity, real-time system operation, inexpensive sensing components, and computing. RhythmEdge captures a short video of the skin using a camera and extracts rPPG features to estimate the Photoplethysmography (PPG) signal using a multi-task learning framework while offloading the edge computation. In addition, we intelligently apply a transfer learning approach to the multi-task learning framework to …

Representation Learning In Finance, Ajim Uddin

Dissertations

Finance studies often employ heterogeneous datasets from different sources with different structures and frequencies. Some data are noisy, sparse, and unbalanced with missing values; some are unstructured, containing text or networks. Traditional techniques often struggle to combine and effectively extract information from these datasets. This work explores representation learning as a proven machine learning technique in learning informative embedding from complex, noisy, and dynamic financial data. This dissertation proposes novel factorization algorithms and network modeling techniques to learn the local and global representation of data in two specific financial applications: analysts’ earnings forecasts and asset pricing.

Financial analysts’ earnings forecast …

Un-Fair Trojan: Targeted Backdoor Attacks Against Model Fairness, Nicholas Furth

Theses

Machine learning models have been shown to be vulnerable against various backdoor and data poisoning attacks that adversely affect model behavior. Additionally, these attacks have been shown to make unfair predictions with respect to certain protected features. In federated learning, multiple local models contribute to a single global model communicating only using local gradients, the issue of attacks become more prevalent and complex. Previously published works revolve around solving these issues both individually and jointly. However, there has been little study on the effects of attacks against model fairness. Demonstrated in this work, a flexible attack, which we call Un-Fair …

Developing A Natural Language Processing Approach For Analyzing Student Ideas In Calculus-Based Introductory Physics, Jon M. Geiger, Lisa M. Goodhew, Tor Ole B. Odden

Honors Projects

Research characterizing common student ideas about particular physics topics has made a significant impact on university-level physics teaching by providing knowledge that supports instructors to target their instruction and by informing curriculum development. This work utilizes a Natural Language Processing algorithm (Latent Dirichlet Allocation, or LDA) to categorize student ideas, with the goal of significantly expediting the process of categorizing student ideas. We preliminarily test the LDA approach by applying the algorithm to a collection of introductory physics student responses to a conceptual question about circuits, specifically attending to whether it is useful for characterizing conceptual resources, or student ideas …

Text Summarization Towards Scientific Information Extraction, Abigail Keller

College of Computing and Digital Media Dissertations

Despite the exponential growth in scientific textual content, research publications are still the primary means for disseminating vital discoveries to experts within their respective fields. These texts are predominantly written for human consumption resulting in two primary challenges; experts cannot efficiently remain well-informed to leverage the latest discoveries, and applications that rely on valuable insights buried in these texts cannot effectively build upon published results. As a result, scientific progress stalls. Automatic Text Summarization (ATS) and Information Extraction (IE) are two essential fields that address this problem. While the two research topics are often studied independently, this work proposes to …

Tissue-Specific Variations In Transcription Factors Elucidate Complex Immune System Regulation, Hengwei Lu, Yi-Ching Tang, Assaf Gottlieb

Faculty, Staff and Student Publications

Gene expression plays a key role in health and disease. Estimating the genetic components underlying gene expression can thus help understand disease etiology. Polygenic models termed "transcriptome imputation" are used to estimate the genetic component of gene expression, but these models typically consider only the cis regions of the gene. However, these cis-based models miss large variability in expression for multiple genes. Transcription factors (TFs) that regulate gene expression are natural candidates for looking for additional sources of the missing variability. We developed a hypothesis-driven approach to identify second-tier regulation by variability in TFs. Our approach tested two models …

Data Ethics: An Investigation Of Data, Algorithms, And Practice, Gabrialla S. Cockerell

Honors Projects

This paper encompasses an examination of defective data collection, algorithms, and practices that continue to be cycled through society under the illusion that all information is processed uniformly, and technological innovation consistently parallels societal betterment. However, vulnerable communities, typically the impoverished and racially discriminated, get ensnared in these harmful cycles due to their disadvantages. Their hindrances are reflected in their information due to the interconnectedness of data, such as race being highly correlated to wealth, education, and location. However, their information continues to be analyzed with the same measures as populations who are not significantly affected by racial bias. Not …