Data Science Commons^™

Client Access Feature Engineering For The Homeless Community Of The City Of Portland, Oswaldo Ceballos Jr

altREU Projects

Given the severity of homeless in many cities across the country, the project at hand attempts to assist a service provider organization called Central City Concern (CCC) with their mission of providing services to the community of Portland. These services include housing, recovery, health care, and jobs. With many different types of services available through the works of CCC, there exists an abundance of information and data pertaining to the individuals that interact with the CCC service system. The goal of this project is to perform an exploratory analysis and feature engineer the existing datasets CCC has collected over the …

Teaching Machine Learning For The Physical Sciences: A Summary Of Lessons Learned And Challenges, Viviana Acquaviva

Publications and Research

This paper summarizes some challenges encountered and best practices established in several years of teaching Machine Learning for the Physical Sciences at the undergraduate and graduate level. I discuss motivations for teaching ML to physicists, desirable properties of pedagogical materials, such as accessibility, relevance, and likeness to real-world research problems, and give examples of components of teaching units.

From Mathematics To Medicine: A Practical Primer On Topological Data Analysis (Tda) And The Development Of Related Analytic Tools For The Functional Discovery Of Latent Structure In Fmri Data, Andrew Salch, Adam Regalski, Hassan Abdallah, Raviteja Suryadevara, Michael J. Catanzaro, Vaibhav A. Diwadkar

Mathematics Faculty Research Publications

fMRI is the preeminent method for collecting signals from the human brain in vivo, for using these signals in the service of functional discovery, and relating these discoveries to anatomical structure. Numerous computational and mathematical techniques have been deployed to extract information from the fMRI signal. Yet, the application of Topological Data Analyses (TDA) remain limited to certain sub-areas such as connectomics (that is, with summarized versions of fMRI data). While connectomics is a natural and important area of application of TDA, applications of TDA in the service of extracting structure from the (non-summarized) fMRI data itself are heretofore nonexistent. …

Empirical Fitting Of Periodically Repeating Environmental Data, Pavel Bělík, Andrew Hotchkiss, Brandon Perez, John Zobitz

Spora: A Journal of Biomathematics

We extend and generalize an approach to conduct fitting models of periodically repeating data. Our method first detrends the data from a baseline function and then fits the data to a periodic (trigonometric, polynomial, or piecewise linear) function. The polynomial and piecewise linear functions are developed from assumptions of continuity and differentiability across each time period. We apply this approach to different datasets in the environmental sciences in addition to a synthetic dataset. Overall the polynomial and piecewise linear approaches developed here performed as good (or better) compared to the trigonometric approach when evaluated using statistical measures (R^{2 …}

An Introduction To Calling Bullshit: Learning To Think Outside The Black Box, Jevin D. West, Carl T. Bergstrom

Numeracy

Bergstrom, Carl T. and Jevin D. West. 2020. Calling Bullshit: The Art of Skepticism in a Data-Driven World. (New York: Random House) 336 pp. ISBN 978-0525509202.

While statistical methods receive greater attention, the art of critically evaluating information in everyday life more commonly depends on thinking outside the black box of the algorithm. In this piece we introduce readers to our book and associated online teaching materials—for readers who want to more capably call “bullshit” or to teach their students to do the same.

Attribution Of Responsibility After Failures Within Platform Ecosystems, Brian Dunn, Matthew L. Jensen, Ryan Ralston

Data Analytics & Information Systems Faculty Publications

Increasingly, new hardware and software are embedded within ecosystems that include a platform and modules. Ideally these ecosystems perform reliably. However, if an ambiguously sourced failure occurs within one of these ecosystems, users are left to distribute blame across the various components of the ecosystem. The actual distribution of this blame, however, can be difficult to predict. This study investigates attribution of blame and discontinuance recommendations for ecosystem components after an ambiguously sourced failure. To extend platform ecosystems and attribution theory, we conducted a scenario-based experiment investigating the negative consequences of failure for platform and module components and the contingent …

Fast Multipole Methods For Wave And Charge Source Interactions In Layered Media And Deep Neural Network Algorithms For High-Dimensional Pdes, Wenzhong Zhang

Mathematics Theses and Dissertations

In this dissertation, we develop fast algorithms for large scale numerical computations, including the fast multipole method (FMM) in layered media, and the forward-backward stochastic differential equation (FBSDE) based deep neural network (DNN) algorithms for high-dimensional parabolic partial differential equations (PDEs), addressing the issues of real-world challenging computational problems in various computation scenarios.

We develop the FMM in layered media, by first studying analytical and numerical properties of the Green's functions in layered media for the 2-D and 3-D Helmholtz equation, the linearized Poisson--Boltzmann equation, the Laplace's equation, and the tensor Green's functions for the time-harmonic Maxwell's equations and the …

Enhancing Microbiome Host Disease Prediction With Variational Autoencoders, Celeste Manughian-Peter

Computational and Data Sciences (MS) Theses

Advancements in genetic sequencing methods for microbiomes in recent decades have permitted the collection of taxonomic and functional profiles of microbial communities, accelerating the discovery of the functional aspects of the microbiome and generating an increased interest among clinicians in applying these techniques with patients. This advancement has coincided with software and hardware improvements in the field of machine learning and deep learning. Combined, these advancements implicate further potential for progress in disease diagnosis and treatment in humans. The ability to classify a human microbiome profile into a disease category, and additionally identify the differentiating factors within the profile between …

Ensemble Data Fitting For Bathymetric Models Informed By Nominal Data, Samantha Zambo

Dissertations

Due to the difficulty and expense of collecting bathymetric data, modeling is the primary tool to produce detailed maps of the ocean floor. Current modeling practices typically utilize only one interpolator; the industry standard is splines-in-tension.

In this dissertation we introduce a new nominal-informed ensemble interpolator designed to improve modeling accuracy in regions of sparse data. The method is guided by a priori domain knowledge provided by artificially intelligent classifiers. We recast such geomorphological classifications, such as ‘seamount’ or ‘ridge’, as nominal data which we utilize as foundational shapes in an expanded ordinary least squares regression-based algorithm. To our knowledge …

Multi-Modal Data Fusion, Image Segmentation, And Object Identification Using Unsupervised Machine Learning: Conception, Validation, Applications, And A Basis For Multi-Modal Object Detection And Tracking, Nicholas Lahaye

Computational and Data Sciences (PhD) Dissertations

Remote sensing and instrumentation is constantly improving and increasing in capability. Included within this, is the increase in amount of different instrument types, with various combinations of spatial and spectral resolutions, pointing angles, and various other instrument-specific qualities. While the increase in instruments, and therefore datasets, is a boon for those aiming to study the complexities of the various Earth systems, it can also present a large number of new challenges. With this information in mind, our group has set our aims on combining datasets with different spatial and spectral resolutions in an effective and as-general-as-possible way, with as little …

Exploring Behaviors Of Software Developers And Their Code Through Computational And Statistical Methods, Elia Eiroa Lledo

Computational and Data Sciences (PhD) Dissertations

As Artificial Intelligence (AI) increasingly penetrates all aspects of society, many obstacles emerge. This thesis identifies and discusses the issues facing Computer Vision and significant deficiencies in the Software Development Life-cycle that need to be resolved to facilitate the evolution toward true artificial intelligence. We explicitly review the concepts behind Convolutional Neural Network (CNN) models, the benchmark for computer vision. Chapter 2 highlights the mechanisms that have popularized CNNs while also specifying significant gaps that could garner the model inadequate for future use in safety-critical systems. We put forward two main limitations. Namely, CNNs do not use lack of information …

Take The Lead: Toward A Virtual Video Dance Partner, Ty Farris

Master's Theses

My work focuses on taking a single person as input and predicting the intentional movement of one dance partner based on the other dance partner's movement. Human pose estimation has been applied to dance and computer vision, but many existing applications focus on a single individual or multiple individuals performing. Currently there are very few works that focus specifically on dance couples combined with pose prediction. This thesis is applicable to the entertainment and gaming industry by training people to dance with a virtual dance partner.

Many existing interactive or virtual dance partners require a motion capture system, multiple cameras …

Signal Fingerprinting And Machine Learning Framework For Uav Detection And Identification., Olusiji Oloruntobi Medaiyese

Electronic Theses and Dissertations

Advancement in technology has led to creative and innovative inventions. One such invention includes unmanned aerial vehicles (UAVs). UAVs (also known as drones) are now an intrinsic part of our society because their application is becoming ubiquitous in every industry ranging from transportation and logistics to environmental monitoring among others. With the numerous benign applications of UAVs, their emergence has added a new dimension to privacy and security issues. There are little or no strict regulations on the people that can purchase or own a UAV. For this reason, nefarious actors can take advantage of these aircraft to intrude into …

Multilateration Index., Chip Lynch

Electronic Theses and Dissertations

We present an alternative method for pre-processing and storing point data, particularly for Geospatial points, by storing multilateration distances to fixed points rather than coordinates such as Latitude and Longitude. We explore the use of this data to improve query performance for some distance related queries such as nearest neighbor and query-within-radius (i.e. “find all points in a set P within distance d of query point q”). Further, we discuss the problem of “Network Adequacy” common to medical and communications businesses, to analyze questions such as “are at least 90% of patients living within 50 miles of a covered emergency …

Incorporating The 10th Edition Institute Of Traffic Engineers (Ite) Trip Generation Rates Into Virginia Department Of Transportation Guidelines, Kun Xie, Mecit Cetin, Hong Yang, Xiaomeng Dong

Civil & Environmental Engineering Faculty Publications

The Institute of Transportation Engineers (ITE) released the Trip Generation (TG) 10th edition in 2017, which significantly updated its database, and some of its trip generation rates were substantially lower than those of earlier editions. This study aims to investigate the applicability of the TG 10th edition in various Virginia contexts and to recommend how to incorporate the TG 10th edition into state guidelines. The research team surveyed 31 state transportation agencies to obtain a clear understanding of current practices in the adoption of trip rates and trip estimation approaches. We systematically compared trip rates of TG 9th and 10th …

Manifold Learning With Tensorial Network Laplacians, Scott Sanders

Electronic Theses and Dissertations

The interdisciplinary field of machine learning studies algorithms in which functionality is dependent on data sets. This data is often treated as a matrix, and a variety of mathematical methods have been developed to glean information from this data structure such as matrix decomposition. The Laplacian matrix, for example, is commonly used to reconstruct networks, and the eigenpairs of this matrix are used in matrix decomposition. Moreover, concepts such as SVD matrix factorization are closely connected to manifold learning, a subfield of machine learning that assumes the observed data lie on a low-dimensional manifold embedded in a higher-dimensional space. Since …

Predicting Severity Of Traumatic Brain Injury: A Residual Learning Model From Magnetic Resonance Images, Dacosta Yeboah

Graduate Theses/Dissertations

One of the most significant frontiers for computational scientists is the engineering of human healthcare delivery based on intelligent analysis of health data. In a variety of neurological disorders such as Traumatic Brain Injury (TBI), neuro-imaging information plays a crucial role in the decision-making regarding patient care and as a potential prognostic marker for outcome. TBI is a heterogeneous neurological disorder. Due to the economic burdens of the disorder, sorting out this heterogeneity could provide more insights and better understanding of TBI recovery trajectories, thus improving overall diagnosis and treatment options. Magnetic Resonance Imaging (MRI) is a non-invasive technique that …

Information Systems Business Analytics Curriculum: Competencies From National Infocomm Skills Model And Job Listings, Swapna Gottipati, Venky Shankaranan, Kyong Jin Shim

Research Collection School Of Computing and Information Systems

To the best of our knowledge, no research has examined how to integrate the national skills model with the industry demand for designing business analytics curricula. To answer this question, we took the initial steps of identifying the job roles and skills required by the nation in “Data” domain. We then collected the skills that are required by business analytics job positions listed by industry. Further, we extracted the top tools, technologies, and programming languages (TTP) demanded by the industry for various categories of technical skills. We then combined the analyses to design the curriculum, courses, and content for various …

Applying Deep Learning To The Ice Cream Vendor Problem: An Extension Of The Newsvendor Problem, Gaffar Solihu

Electronic Theses and Dissertations

The Newsvendor problem is a classical supply chain problem used to develop strategies for inventory optimization. The goal of the newsvendor problem is to predict the optimal order quantity of a product to meet an uncertain demand in the future, given that the demand distribution itself is known. The Ice Cream Vendor Problem extends the classical newsvendor problem to an uncertain demand with unknown distribution, albeit a distribution that is known to depend on exogenous features. The goal is thus to estimate the order quantity that minimizes the total cost when demand does not follow any known statistical distribution. The …

Data Science And The Ice-Cream Vendor Problem, Makafui Azasoo

Electronic Theses and Dissertations

Newsvendor problems in Operations Research predict the optimal inventory levels necessary to meet uncertain demands. This thesis examines an extended version of a single period multi-product newsvendor problem known as the ice cream vendor problem. In the ice cream vendor problem, there are two products – ice cream and hot chocolate – which may be substituted for one another if the outside temperature is no too hot or not too cold. In particular, the ice cream vendor problem is a data-driven extension of the conventional newsvendor problem which does not require the assumption of a specific demand distribution, thus allowing …

Contributions To The Teaching And Learning Of Fluid Mechanics, Ashwin Vaidya

Department of Mathematics Faculty Scholarship and Creative Works

This issue showcases a compilation of papers on fluid mechanics (FM) education, covering different sub topics of the subject. The success of the first volume [1] prompted us to consider another follow-up special issue on the topic, which has also been very successful in garnering an impressive variety of submissions.

As a classical branch of science, the beauty and complexity of fluid dynamics cannot be overemphasized. This is an extremely well-studied subject which has now become a significant component of several major scientific disciplines ranging from aerospace engineering, astrophysics, atmospheric science (including climate modeling), biological and biomedical science …

Content Analysis Of Two-Year And Four-Year Data Science Programs In The United States, Elizabeth Milonas, Duo Li, Qiping Zhang

Publications and Research

Data has grown exponentially in the last decade, and this growth has resulted in vast challenges for both business and IT domains (Hassan & Liu, 2019). This growth has given rise to the Data Science field, which has also grown exponentially in the last few years (Hassan & Liu, 2019; Song & Zhu, 2016). The Data Science field has its origins in the statistics and mathematics domain (Cao, 2017b), but is now considered a multidisciplinary field (Aasheim et al., 2015). Data Science warrants knowledge of data analytics, programming, systems, applications, informatics, computing, communication, management, and sociology (Aasheim et al., 2015; …

Using Data Science To Create An Impact On A City Life And To Encourage Students From Underserved Communities To Get Into Stem, Elena Filatova, Deborah Hecht

Publications and Research

In this paper, we introduce a novel methodology for teaching Data Science. Our methodology relies on the outlook of the student body in our college. Our college is an urban, commuter, HSI (Hispanic Serving Institution) school with 34% Hispanic and 29% Black students. 61% of our students come from households with an income of less than $30,000+. Thus, many students in our college come from the communities that are underrepresented in the STEM fields and in the decision-making positions in the government (on the city level, state level, country level). However, in our methodology, we want to flip the situation …

---

Go to article

Using Big Data Analytics To Optimize Practical Large Databases, Po-Chun Lu

Master of Science in Computer Science Theses

Big data analytics is gaining popularity for enterprises in optimizing their business processes ranging from retailers, supply chains, to online shopping stores. Existing practical raw data are far from usable to achieve the goal. Therefore, a good data pre-processing approach is required and is a key step to success. We propose to research on the effectiveness of data pre-processing and the business process based on a real world database. Our methodology involves natural language processing. Our key goal is to study appropriate methods with big data analysis techniques that can handle errors, ambiguity, and repeated descriptions caused by human languages. …

Multi-Modal Self-Supervised Representation Learning For Earth Observation, Pallavi Jain, Bianca Schoen Phelan, Robert J. Ross

Conference papers

Self-Supervised learning (SSL) has reduced the performance gap between supervised and unsupervised learning, due to its ability to learn invariant representations. This is a boon to the domains like Earth Observation (EO), where labelled data availability is scarce but unlabelled data is freely available. While Transfer Learning from generic RGB pre-trained models is still common-place in EO, we argue that, it is essential to have good EO domain specific pre-trained model in order to use with downstream tasks with limited labelled data. Hence, we explored the applicability of SSL with multi-modal satellite imagery for downstream tasks. For this we utilised …

Be Careful! That Is Probably Bullshit! Review Of Calling Bullshit: The Art Of Skepticism In A Data-Driven World By Carl T. Bergstrom And Jevin D. West, James B. Schreiber

Numeracy

Bergstrom, C. T., & West, J. D. 2021. Calling Bullshit: The Art of Skepticism in a Data-Driven World. NY: Random House. 336 pp. ISBN 978-0525509189

The authors provide a journey through the numerical bullshit that surrounds our daily lives. Each chapter has multiple examples of specific types of bullshit that each of us experience on any given day. Most importantly, information on how to identify bullshit and refute it are provided so that reader finishes the book with a set of skills to be a more engaged and critical interpreter of information. The writing has a quick and lively …

A Deep Learning Approach For Forecasting Global Commodities Prices, Ahmed Saied Elberawi, Mohamed Belal Prof.

Future Computing and Informatics Journal

Forecasting future values of time-series data is a critical task in many disciplines including financial planning and decision-making. Researchers and practitioners in statistics apply traditional statistical methods (such as ARMA, ARIMA, ES, and GARCH) for a long time with varying accuracies. Deep learning provides more sophisticated and non-linear approximation that supersede traditional statistical methods in most cases. Deep learning methods require minimal features engineering compared to other methods; it adopts an end-to-end learning methodology. In addition, it can handle a huge amount of data and variables. Financial time series forecasting poses a challenge due to its high volatility and non-stationarity …

Data Quality Dimensions, Metrics, And Improvement Techniques, Menna Ibrahim Gabr Lecturer Assistant, Yehia Mostafa Helmy Prof, Doaa Saad Elzanfaly Assoc. Prof

Future Computing and Informatics Journal

Achieving high level of data quality is considered one of the most important assets for any small, medium and large size organizations. Data quality is the main hype for both practitioners and researchers who deal with traditional or big data. The level of data quality is measured through several quality dimensions. High percentage of the current studies focus on assessing and applying data quality on traditional data. As we are in the era of big data, the attention should be paid to the tremendous volume of generated and processed data in which 80% of all the generated data is unstructured. …

Performance Of Openbci Eeg Binary Intent Classification With Laryngeal Imagery, Nathan George, Samuel Kuhn

Regis University Faculty Publications (comprehensive list)

One of the greatest goals of neuroscience in recent decades has been to rehabilitate individuals who no longer have a functional relationship between their mind and their body. Although neuroscience has produced technologies which allow the brains of paralyzed patients to accomplish tasks such as spell words or control a motorized wheelchair, these technologies utilize parts of the brain which may not be optimal for simultaneous use. For example, if you needed to look at flashing lights to spell words for communication, it would be difficult to simultaneously look at where you are moving. To improve upon this issue, this …

On The Use Of Minimum Penalties In Statistical Learning, Ben Sherwood, Bradley S. Price

Faculty & Staff Scholarship

Modern multivariate machine learning and statistical methodologies estimate parameters of interest while leveraging prior knowledge of the association between outcome variables. The methods that do allow for estimation of relationships do so typically through an error covariance matrix in multivariate regression which does not scale to other types of models. In this article we proposed the MinPEN framework to simultaneously estimate regression coefficients associated with the multivariate regression model and the relationships between outcome variables using mild assumptions. The MinPen framework utilizes a novel penalty based on the minimum function to exploit detected relationships between responses. An iterative algorithm that …