Data Science Commons^™

A Machine Learning Approach To Revenue Generation Within The Professional Hair Care Industry, Alexander K. Sepenu, Linda Eliasen

SMU Data Science Review

The cosmetic and beauty industry continues to grow and evolve to satisfy its patrons. In the United States, the industry is heavily science-driven, innovative, and fast-paced, suggesting that to remain productive and profitable, companies must seek smart alternatives to their current modus operandi or risk losing out on this multi-billion-dollar industry to fierce competition. In this paper, the authors seek to utilize machine learning models such as clustering and regression to improve the efficiency of current sales and customer segmentation models to help HairCo (pseudonym for confidentiality), a professional hair products manufacturer, strategize their marketing and sales efforts for revenue …

Analysis Of The Electric Power Outage Data And Prediction Of Electric Power Outage For Major Metropolitan Areas In Texas Using Machine Learning And Time Series Methods, Renfeng Wang, Venkata Leela 'Mg' Vanga, Zachary B. Zaiken, Jonathan Bennett

SMU Data Science Review

With growing energy usage, power outages affect millions of households. This case study focuses on gathering power outage historical data, modifying the data to attach weather attributes, and gathering ERCOT energy market conditions for Dallas-Fort Worth and Houston metropolitan areas of Texas. The transformed data is then analyzed using machine learning algorithms including, but not limited to, Regression, Random Forests and XGBoost to consider current weather and ERCOT features and predict power outage percentage for locations. The transformed data is also trained using time series models and serially correlated models including Autoregression and Vector Autoregression. This study also focuses on …

Web Page Multiclass Classification, Brian Gaither, Antonio Debouse, Catherine Huang

SMU Data Science Review

As the internet age evolves, the volume of content hosted on the Web is rapidly expanding. With this ever-expanding content, the capability to accurately categorize web pages is a current challenge to serve many use cases. This paper proposes a variation in the approach to text preprocessing pipeline whereby noun phrase extraction is performed first followed by lemmatization, contraction expansion, removing special characters, removing extra white space, lower casing, and removal of stop words. The first step of noun phrase extraction is aimed at reducing the set of terms to those that best describe what the web pages are about …

Anomaly Detection Methods To Improve Supply Chain Data Quality And Operations, Ana E. Glaser, Jake P. Harrison, David Josephs

SMU Data Science Review

Supply chain operations drive the planning, manufacture, and distribution of billions of semiconductors a year, spanning thousands of products across many supply chain configurations. The customizations span from wafer technology to die stacking and chip feature enablement. Data quality drives efficiency in these processes and anomalies in data can be very disruptive, and at times, consequential. Developing preventative measures that automate the detection of anomalies before they reach downstream execution systems would result in significant efficiency gain for the organization. The purpose of this research is to identify an effective, actionable, and computationally efficient approach to highlight anomalies in a …

Adjusting Community Survey Data Benchmarks For External Factors, Allen Miller, Nicole M. Norelli, Robert Slater, Mingyang N. Yu

SMU Data Science Review

Abstract. Using U.S. resident survey data from the National Community Survey in combination with public data from the U.S. Census and additional sources, a Voting Regressor Model was developed to establish fair benchmark values for city performance. These benchmarks were adjusted for characteristics the city cannot easily influence that contribute to confidence in local government, such as population size, demographics, and income. This adjustment allows for a more meaningful comparison and interpretation of survey results among individual cities. Methods explored for the benchmark adjustment included cluster analysis, anomaly detection, and a variety of regression techniques, including random forest, ridge, decision …

Machine Learning And The Network Analysis Of Ethereum Trading Data, Santosh Sivakumar

Dartmouth College Undergraduate Theses

Since their conception, cryptocurrencies have captured the public interest, motivating a growing body of research aimed at exploring blockchain-based transactions. This said, little work has been done to draw conclusions from transaction patterns, particularly in the realm of predicting cryptocurrency price movements. Moreover, research in the cryptocurrency sphere largely focuses on Bitcoin, paying little attention to Ethereum, Bitcoin's second-in-line with respect to market capitalization. In this paper, we construct hourly networks for a year of Ethereum transactions, using computed graph metrics as features in a series of machine learning models. We find that regression-based approaches to predicting Ether prices/price deltas …

Legislative Language For Success, Sanjana Gundala

Master's Theses

Legislative committee meetings are an integral part of the lawmaking process for local and state bills. The testimony presented during these meetings is a large factor in the outcome of the proposed bill. This research uses Natural Language Processing and Machine Learning techniques to analyze testimonies from California Legislative committee meetings from 2015-2016 in order to identify what aspects of a testimony makes it successful. A testimony is considered successful if the alignment of the testimony matches the bill outcome (alignment is "For" and the bill passes or alignment is "Against" and the bill fails). The process of finding what …

Leveraging Context Patterns For Medical Entity Classification, Garrett Johnston

Computer Science Senior Theses

The ability of patients to understand health-related text is important for optimal health outcomes. A system that can automatically annotate medical entities could help patients better understand health-related text. Such a system would also accelerate manual data annotation for this low-resource domain as well as assist in down- stream medical NLP tasks such as finding textual similarity, identifying conflicting medical advice, and aspect-based sentiment analysis. In this work, we investigate a state-of-the-art entity set expansion model, BootstrapNet, for the task of medical entity classification on a new dataset of medical advice text. We also propose EP SBERT, a simple model …

Leveraging Single Cell Technologies For The Characterization And Treatment Of Refractory Pancreatic Cancer, Maria Monberg

Dissertations and Theses (Open Access)

Heterogeneity is a hallmark of cancer, and the advent of multimodal single-cell technologies has helped uncover heterogeneity in a high-throughput manner in different cancers across varied contexts at an unprecedented resolution. In an effort to improve precision medicine approaches in pancreatic ductal adenocarcinoma (PDAC), a highly lethal malignancy with a mere 11% 5-year survival rate, this dissertation focuses on first questioning the assumptions of the most basic models used to study PDAC via multimodal single-cell characterization methods at multiple levels of biological organization (scCNVseq and snATACseq for DNA assays, scRNAseq for transcriptomics, and paired protein assays such as multiplexed immunofluorescence …

Effect Of Monetary Policy Rate On Market Interest Rates In Nigeria: A Threshold And Nardl Approach, Oluwafemi E. Awopegba, Joseph O. Afolabi, Lydia T. Adeoye, Godwin O. Akpokodje

CBN Journal of Applied Statistics (JAS)

This study examines the effect of monetary policy rate (MPR) on market interest rates in Nigeria. For parsimony, we develop two indexes called the short-term interest rate (SINT) and Lending interest rate (LINT) to represent deposit and lending rates respectively. The nonlinear autoregressive distributed lag (NARDL) and threshold regression models are adopted. The study uses monthly data from 2002:M1 to 2019:M12. The results of the threshold regression model indicate that the degree of the effect of MPR on SINT and LINT above the estimated threshold of 11 and 13 percent respectively is greater and significant than if MPR were to …

Social Dimension Of Inclusive Growth In Ecowas: Implication For Poverty Reduction, Toriola K. Anu, Goerge O. Emmanuel, Ajayi O. Felix

CBN Journal of Applied Statistics (JAS)

This study investigates the implication of the social dimension of inclusive growth on poverty reduction in Economic Community of West African States (ECOWAS) countries. It specifically examines how social indices of inclusive growth comprising of income inequality, education, and health outcomes affect poverty reduction. The study uses a panel dataset of the six (6) lower-middle income countries in ECOWAS which was analysed via panel Difference Generalised Method of Moment (D-GMM). The results show that GDP per capita exerts significant negative effect on poverty while inequality, education and health outcomes do not show significant effect on poverty. Although, the estimates of …

Effect Of Fdi Inflows On Employment Generation In Selected Ecowas Countries: Heterogeneous Panel Analysis, Timothy A. Aderemi, Olawunmi Omitogun, Bukonla G. Osisanwo

CBN Journal of Applied Statistics (JAS)

The aim of this study is to examine the effect of FDI on employment in ECOWAS sub region between 1990 and 2019. The study utilizes a panel autoregressive distributed lag model to analyse the short run and long run relationship between FDI and employment across ECOWAS sub region. In the short run, the impact of FDI on employment is negative and statistically not significant. Meanwhile, in the long run FDI has a positive and statistically significant impact on employment rate. This implies that FDI has the capacity to generate employment in countries in ECOWAS sub region. Therefore, this study recommends …

Impact Of Covid-19 Pandemic On The Nigeria Stock Market: A Sectoral Stock Prices Analysis, Peter A. Adekunle, Yakubu A. Bello, Udochukwu G. Nwachukwu

CBN Journal of Applied Statistics (JAS)

This study examines the impact of the COVID-19 pandemic on sectoral stock prices in Nigeria stock market using daily data covering from February 28, 2020 to June 26, 2020. Applying the autoregressive distributed lag (ARDL) bounds test, the study finds that COVID-19 pandemic had adverse impact on the stock market indices in the short run. Furthermore, the study documents negative response of sectoral stock prices to the pandemic while the stock prices of the banking sub-sector are the worst hit. Compared to the consumer goods, and industrial subsector indices, the speed of adjustment to long run equilibrium is faster for …

External Validation Of A Laboratory Prediction Algorithm For The Reduction Of Unnecessary Labs In The Critical Care Setting

Faculty, Staff and Student Publications

BACKGROUND: Unnecessary laboratory tests contribute to iatrogenic harm and are a major source of waste in the health care system. We previously developed a machine learning algorithm to help clinicians identify unnecessary laboratory tests, but it has not been externally validated. In this study, we externally validate our machine learning algorithm.

METHODS: To externally validate the machine learning algorithm that was originally trained on the Medical Information Mart for Intensive Care (MIMIC) III database, we tested the algorithm in a separate institution. We identified and abstracted data for all patients older than 18 years admitted to the intensive care unit …

Innovative Heuristics To Improve The Latent Dirichlet Allocation Methodology For Textual Analysis And A New Modernized Topic Modeling Approach, Jamie T. Zimmerman

Theses and Dissertations

Natural Language Processing is a complex method of data mining the vast trove of documents created and made available every day. Topic modeling seeks to identify the topics within textual corpora with limited human input into the process to speed analysis. Current topic modeling techniques used in Natural Language Processing have limitations in the pre-processing steps. This dissertation studies topic modeling techniques, those limitations in the pre-processing, and introduces new algorithms to gain improvements from existing topic modeling techniques while being competitive with computational complexity. This research introduces four contributions to the field of Natural Language Processing and topic modeling. …

Rhythmedge: Enabling Contactless Heart Rate Estimation On The Edge, Zahid Hasan, Emon Dey, Sreenivasan Ramasamy Ramamurthy, Nirmalya Roy, Archan Misra

Research Collection School Of Computing and Information Systems

The primary contribution of this paper is designing and prototyping a real-time edge computing system, RhythmEdge, that is capable of detecting changes in blood volume from facial videos (Remote Photoplethysmography; rPPG), enabling cardio-vascular health assessment instantly. The benefits of RhythmEdge include non-invasive measurement of cardiovascular activity, real-time system operation, inexpensive sensing components, and computing. RhythmEdge captures a short video of the skin using a camera and extracts rPPG features to estimate the Photoplethysmography (PPG) signal using a multi-task learning framework while offloading the edge computation. In addition, we intelligently apply a transfer learning approach to the multi-task learning framework to …

Why, New York City? Gauging The Quality Of Life Through The Thoughts Of Tweeters, Sheryl Williams

Dissertations, Theses, and Capstone Projects

As a resource for social data, Twitter’s platform has been used to measure the quality of life through sentiment analysis. This capstone project explores another methodological technique—querying Twitter data around specific keyword terms to determine dominant topics, word patterns, and sentiment leanings in a geographical area. Focusing on New York City and Los Angeles for comparative analysis, the keyword term “why” will be used to build a Python analysis around topic modeling and sentiment analysis. Using this approach, the analysis reveals social and cultural differences, the overall sentiment of tweets, and subjects of interest to tweeters.

GitHub Repository for all …

A Comparison Of Machine Learning Techniques For Validating Students’ Proficiency In Mathematics, Alexander Avdeev

Dissertations, Theses, and Capstone Projects

A principal goal of this project was to compare several machine learning (ML) algorithms to explore and validate math proficiency classifications based on standardized test scores. The data used in these analyses came from the 6th-grade students’ mathematics assessment records of the New York State Education Department’s Testing Program (NYSTP). Our approach was to test a number of competing machine learning (ML) algorithms for classifying students’ as proficient based on their test scores and other demographic information. Our samples were drawn from the 2016 test-taking cohort of 6th-grade students (N=156,800). Five classifiers including multinominal logistic regression (MLR), XGBoost, Tree-As, Lagrangian …

Symmetry-Inspired Analysis Of Biological Networks, Ian Leifer

Dissertations, Theses, and Capstone Projects

The description of a complex system like gene regulation of a cell or a brain of an animal in terms of the dynamics of each individual element is an insurmountable task due to the complexity of interactions and the scores of associated parameters. Recent decades brought about the description of these systems that employs network models. In such models the entire system is represented by a graph encapsulating a set of independently functioning objects and their interactions. This creates a level of abstraction that makes the analysis of such large scale system possible. Common practice is to draw conclusions about …

Heating Fire Incidents In New York City, Merissa K. Lissade

Dissertations, Theses, and Capstone Projects

If you have ever had the Citizen app downloaded on your smart phone, then you know how many alerts you receive in a day living in New York City (NYC). Citizen is a mobile app that sends real-time safety alerts based on the location of its user. In my experience having the app, I have seen many notifications of fires caused by heaters during the winter. On the morning of January 9^th, 2022, I received a notification of an accidental blaze that took the lives of 17 people from the choking smoke of a 19-story residential building in …