Numerical Analysis and Scientific Computing Commons^™

Rpostgis: Linking R With A Postgis Spatial Database, David Bucklin, Mathieu Basille

The R Journal

With the proliferation of sensors and the ease of data collection from online sources, large datasets have become the norm in many scientific disciplines, and efficient data storage, management, and retrival is imperative for large research projects. Relational databases provide a solution, but in order to be useful, must be able to be linked to analysis and visualization tools, such as R. Here, we present a package intended to facilitate integration of R with the open-source database software PostgreSQL, with a focus on its spatial extension, PostGIS. The package rpostgis (version 1.4.1) provides methods for spatial data handling (vector and …

R Package Imputetestbench To Compare Imputation Methods For Univariate Time Series, Marcus W. Beck, Neeraj Bokde, Gualberto Asencio-Cortés, Kishore Kulat

The R Journal

Missing observations are common in time series data and several methods are available to impute these values prior to analysis. Variation in statistical characteristics of univariate time series can have a profound effect on characteristics of missing observations and, therefore, the accuracy of different imputation methods. The imputeTestbench package can be used to compare the prediction accuracy of different methods as related to the amount and type of missing data for a user-supplied dataset. Missing data are simulated by removing observations completely at random or in blocks of different sizes depending on characteristics of the data. Several imputation algorithms are …

Advanced Bayesian Multilevel Modeling With The R Package Brms, Paul-Christian Bürkner

The R Journal

The brms package allows R users to easily specify a wide range of Bayesian single-level and multilevel models which are fit with the probabilistic programming language Stan behind the scenes. Several response distributions are supported, of which all parameters (e.g., location, scale, and shape) can be predicted. Non-linear relationships may be specified using non-linear predictor terms or semi-parametric approaches such as splines or Gaussian processes. Multivariate models can be fit as well. To make all of these modeling options possible in a multilevel framework, brms provides an intuitive and powerful formula syntax, which extends the well known formula syntax of …

Welfare, Inequality And Poverty Analysis With Rtip: An Approach Based On Stochastic Dominance, Angel Berihuete, Carmen D. Ramos, Miguel A. Sordo

The R Journal

Disparities in economic welfare, inequality and poverty across and within countries are of great interest to sociologists, economists, researchers, social organizations and political scientists. Information about these topics is commonly based on surveys. We present a package called rtip that implements techniques based on stochastic dominance to make unambiguous comparisons, in terms of welfare, poverty and inequality, among income distributions. Besides providing point estimates and confidence intervals for the most commonly used indicators of these characteristics, the package rtip estimates the usual Lorenz curve, the generalized Lorenz curve, the TIP (Three I’s of Poverty) curve and allows to test statistically …

Support Vector Machines For Survival Analysis With R, Césaire J.K. Fouodo, Inke R. König, Claus Weihs, Andreas Ziegler, Marvin N. Wright

The R Journal

This article introduces the R package survivalsvm, implementing support vector machines for survival analysis. Three approaches are available in the package: The regression approach takes censoring into account when formulating the inequality constraints of the support vector problem. In the ranking approach, the inequality constraints set the objective to maximize the concordance index for comparable pairs of observations. The hybrid approach combines the regression and ranking constraints in a single model. We describe survival support vector machines and their implementation, provide examples and compare the prediction performance with the Cox proportional hazards model, random survival forests and gradient boosting using …

Mglm: An R Package For Multivariate Categorical Data Analysis, Juhyun Kim, Yiwen Zhang, Joshua Day, Hua Zhou

The R Journal

Data with multiple responses is ubiquitous in modern applications. However, few tools are available for regression analysis of multivariate counts. The most popular multinomial-logit model has a very restrictive mean-variance structure, limiting its applicability to many data sets. This article introduces an R package MGLM, short for multivariate response generalized linear models, that expands the current tools for regression analysis of polytomous data. Distribution fitting, random number generation, regression, and sparse regression are treated in a unifying framework. The algorithm, usage, and implementation details are discussed.

Cchs: An R Package For Stratified Case-Cohort Studies, Edmund Jones

The R Journal

The cchs package contains a function, also called cchs, for analyzing data from a stratified case-cohort study, as used in epidemiology. For data from this type of study, cchs calculates Estimator III of Borgan et al. (2000), which is a score-unbiased estimator for the regression coefficients in the Cox proportional hazards model. From the user’s point of view, the function is similar to coxph (in the survival package) and other widely used model-fitting functions. Convenient software has not previously been available for Estimator III since it is complicated to calculate. SAS and S-Plus code-fragments for the calculation have been published, …

Small Area Disease Risk Estimation And Visualization Using R, Paula Moraga

The R Journal

Small area disease risk estimation is essential for disease prevention and control. In this paper, we demonstrate how R can be used to obtain disease risk estimates and quantify risk factors using areal data. We explain how to define disease risk models and how to perform Bayesian inference using the INLA package. We also show how to make interactive maps of estimates using the leaflet package to better understand the disease spatial patterns and communicate the results. We show an example of lung cancer risk in Pennsylvania, United States, in year 2002, and demonstrate that R represents an excellent tool …

Semiparametric Generalized Linear Models With The Gldrm Package, Michael J. Wurm, Paul J. Rathouz

The R Journal

This paper introduces a new algorithm to estimate and perform inferences on a recently proposed and developed semiparametric generalized linear model (glm). Rather than selecting a particular parametric exponential family model, such as the Poisson distribution, this semiparametric glm assumes that the response is drawn from the more general exponential tilt family. The regression coefficients and unspecified reference distribution are estimated by maximizing a semiparametric likelihood. The new algorithm incorporates several computational stability and efficiency improvements over the algorithm originally proposed. In particular, the new algorithm performs well for either small or large support for the nonparametric response distribution. The …

Ratingscalereduction Package: Stepwise Rating Scale Item Reduction Without Predictability Loss, Waldemar W. Koczkodaj, Feng Li, Alicja Wolny–Dominiak

The R Journal

This study presents an innovative method for reducing the number of rating scale items without predictability loss. The “area under the receiver operator curve” method (AUC ROC) is used for the stepwise method of reducing items of a rating scale. RatingScaleReduction R package contains the presented implementation. Differential evolution (a metaheuristic for optimization) was applied to one of the analyzed datasets to illustrate that the presented stepwise method can be used with other classifiers to reduce the number of rating scale items (variables). The targeted areas of application are decision making, data mining, machine learning, and psychometrics.

News From The Bioconductor Project, Bioconductor Core Team

The R Journal

The Bioconductor project provides tools for the analysis and comprehension of high-throughput genomic data. Bioconductor 3.7 was released on 1 May, 2018. It is compatible with R 3.5.1 and consists of 1560 software packages, 342 experiment data packages, and 919 up-to-date annotation packages. The release announcement includes descriptions of 98 new software packages and updated NEWS files for many additional packages. Start using Bioconductor by installing the most recent version of R and evaluating the commands

A System For An Accountable Data Analysis Process In R, Jonathan Gelfond, Martin Goros, Brian Hernandez, Alex Bokov

The R Journal

Efficiently producing transparent analyses may be difficult for beginners or tedious for the experienced. This implies a need for computing systems and environments that can efficiently satisfy reproducibility and accountability standards. To this end, we have developed a system, R package, and R Shiny application called adapr (Accountable Data Analysis Process in R) that is built on the principle of accountable units. An accountable unit is a data file (statistic, table or graphic) that can be associated with a provenance, meaning how it was created, when it was created and who created it, and this is similar to the ’verifiable …

Mmpf: Monte-Carlo Methods For Prediction Functions, Zachary M. Jones

The R Journal

Machine learning methods can often learn high-dimensional functions which generalize well but are not human interpretable. The mmpf package marginalizes prediction functions using Monte-Carlo methods, allowing users to investigate the behavior of these learned functions, as on a lower dimensional subset of input features: partial dependence and variations thereof. This makes machine learning methods more useful in situations where accurate prediction is not the only goal, such as in the social sciences where linear models are commonly used because of their interpretability.

Many methods for estimating prediction functions produce estimated functions which are not directly human-interpretable because of their complexity: …

Generalized Additive Model Multiple Imputation By Chained Equations With Package Imputerobust, Daniel Salfran, Martin Spiess

The R Journal

Data analysis, common to all empirical sciences, often requires complete data sets. Unfortunately, real world data collection will usually result in data values not being observed. We present a package for robust multiple imputation (the ImputeRobust package) that allows the use of generalized additive models for location, scale, and shape in the context of chained equations. The paper describes the basics of the imputation technique which builds on a semi-parametric regression model (GAMLSS) and the algorithms and functions provided with the corresponding package. Furthermore, some illustrative examples are provided.

Fhdi: An R Package For Fractional Hot Deck Imputation, Jongho Im, In Ho Cho, Jae Kwang Kim

The R Journal

Fractional hot deck imputation (FHDI), proposed by Kalton and Kish (1984) and investigated by Kim and Fuller (2004), is a tool for handling item nonresponse in survey sampling. In FHDI, each missing item is filled with multiple observed values yielding a single completed data set for subsequent analyses. An R package FHDI is developed to perform FHDI and also the fully efficient fractional imputation (FEFI) method of (Fuller and Kim, 2005) to impute multivariate missing data with arbitrary missing patterns. FHDI substitutes missing items with a few observed values jointly obtained from a set of donors whereas the FEFI uses …

The R Journal (July 2018) 10(1): Complete Issue, The R Foundation

The R Journal

Editorial, John Verzani

Contributed Research Articles

A System for an Accountable Data Analysis Process in R, Jonathan Gelfond, Martin Goros, Brian Hernandez and Alex Bokov

RealVAMS: An R Package for Fitting a Multivariate Value-added Model (VAM), Jennifer Broatch, Jennifer Green, and Andrew Karl

InfoTrad: An R Package for Estimating the Probability of Informed Trading, Duygu Çelik and Murat Tiniç

RatingScaleReduction Package: Stepwise Rating Scale Item Reduction without Predictability Loss, Waldemar W. Koczkodaj, Feng Li, and Alicja Wolny-Dominiak

mmpf: Monte-Carlo Methods for Prediction Functions, Zachary M. Jones

Generalized Additive Model Multiple Imputation by Chained Equations with Package ImputeRobust, Daniel Salfran and …

Deeptravel: A Neural Network Based Travel Time Estimation Model With Auxiliary Supervision, Hanyuan Zhang, Hao Wu, Weiwei Sun, Baihua Zheng

Research Collection School Of Computing and Information Systems

Estimating the travel time of a path is of great importance to smart urban mobility. Existing approaches are either based on estimating the time cost of each road segment or designed heuristically in a non-learning-based way. The former is not able to capture many cross-segment complex factors while the latter fails to utilize the existing abundant temporal labels of the data, i.e., the time stamp of each trajectory point. In this paper, we leverage on new development of deep neural networks and propose a novel auxiliary supervision model, namely DeepTravel, that can automatically and effectively extract different features, as well …

A Survey Of Matrix Completion Methods For Recommendation Systems, Andy Ramlatchan, Mengyun Yang, Quan Liu, Min Li, Jianxin Wang, Yaohang Li

Computer Science Faculty Publications

In recent years, the recommendation systems have become increasingly popular and have been used in a broad variety of applications. Here, we investigate the matrix completion techniques for the recommendation systems that are based on collaborative filtering. The collaborative filtering problem can be viewed as predicting the favorability of a user with respect to new items of commodities. When a rating matrix is constructed with users as rows, items as columns, and entries as ratings, the collaborative filtering problem can then be modeled as a matrix completion problem by filling out the unknown elements in the rating matrix. This article …

Online Deep Learning: Learning Deep Neural Networks On The Fly, Doyen Sahoo, Hong Quang Pham, Jing Lu, Steven C. H. Hoi

Research Collection School Of Computing and Information Systems

Deep Neural Networks (DNNs) are typically trained by backpropagation in a batch setting, requiring the entire training data to be made available prior to the learning task. This is not scalable for many real-world scenarios where new data arrives sequentially in a stream. We aim to address an open challenge of “Online Deep Learning” (ODL) for learning DNNs on the fly in an online setting. Unlike traditional online learning that often optimizes some convex objective function with respect to a shallow model (e.g., a linear/kernel-based hypothesis), ODL is more challenging as the optimization objective is non-convex, and regular DNN with …

Online Active Learning With Expert Advice, Shuji Hao, Peiying Hu, Peilin Zhao, Steven C. H. Hoi, Chunyan Miao

Research Collection School Of Computing and Information Systems

In literature, learning with expert advice methods usually assume that a learner always obtain the true label of every incoming training instance at the end of each trial. However, in many real-world applications, acquiring the true labels of all instances can be both costly and time consuming, especially for large-scale problems. For example, in the social media, data stream usually comes in a high speed and volume, and it is nearly impossible and highly costly to label all of the instances. In this article, we address this problem with active learning with expert advice, where the ground truth of an …

Searching For The X-Factor: Exploring Corpus Subjectivity For Word Embeddings, Maksim Tkachenko, Chong Cher Chia, Hady W. Lauw

Research Collection School Of Computing and Information Systems

We explore the notion of subjectivity, and hypothesize that word embeddings learnt from input corpora of varying levels of subjectivity behave differently on natural language processing tasks such as classifying a sentence by sentiment, subjectivity, or topic. Through systematic comparative analyses, we establish this to be the case indeed. Moreover, based on the discovery of the outsized role that sentiment words play on subjectivity-sensitive tasks such as sentiment classification, we develop a novel word embedding SentiVec which is infused with sentiment information from a lexical resource, and is shown to outperform baselines on such tasks.

Detecting Personal Intake Of Medicine From Twitter, Debanjan Mahata, Jasper Friedrichs, Rajiv Ratn Shah, Jing Jiang

Research Collection School Of Computing and Information Systems

Mining social media messages such as tweets, blogs, and Facebook posts for health and drug related information has received significant interest in pharmacovigilance research. Social media sites (e.g., Twitter), have been used for monitoring drug abuse, adverse reactions to drug usage, and analyzing expression of sentiments related to drugs. Most of these studies are based on aggregated results from a large population rather than specific sets of individuals. In order to conduct studies at an individual level or specific groups of people, identifying posts mentioning intake of medicine by the user is necessary. Toward this objective we develop a classifier …

Modeling Recombination In Solar Cells, Paul Chery

Macalester Journal of Physics and Astronomy

Solar cells are a competitive alternative to nonrenewable energy sources such as fossil fuels. However, the efficiency of these devices is limited by photogenerated carrier recombination. We use a finite difference numerical model to study recombination phenomena in the absorber layer of solar cells including alternate recombination models and the effects of spatial distribution of recombination centers. We compare the effect of using the constant lifetime approximation for recombination to the full Shockley-Read-Hall expression in Silicon solar cells and find that the constant lifetime approximation holds for high defect densities but not for high photon flux densities. Finally, we simulate …

Combination Forecasting Of Stock Index Time Series Based On Cooperative Game Theory, Luo Wei

Journal of System Simulation

Abstract: In view of the characteristics of nonlinear, large amplitude, frequent fluctuations in China's stock market, a prediction method of intelligent composite stock index time series based on the cooperative game is presented. The prediction model of stock index time series is established by using neural network method based on the correlations among the various economic indicators, and the development trend and laws of stock index time series are established by using the improved ARIMA method. The two methods are combined by importing cooperative game method. Simulation results show that the prediction accuracy of the presented method is controlled …

Real-Time Simulator For Spatial Information Networks Based On Analog If Signal Processing, Zeguo Yang, Ma Shang, Diaopeng Huang, Jianhao Hu, Lixiang Liu

Journal of System Simulation

Abstract: To solve the problem of real-time simulation of spatial information network with high dynamic network topology, a real-time simulator based on the IF signal processing is proposed. Compared with traditional channel simulator, it supports both the channel transmission characteristics like channel fading, Doppler shift, noise, and path delay, and the real-time simulation of dynamic network topology changes. The simulator supports 8~128 70 MHz IF (0~20 MHz signal bandwidth) emulated nodes with flexible link type configuration. The maximal fading depth is 100 dB, the maximal Doppler shift is 2 MHz, and the maximal path delay can reach up …

A Lightweight Modeling And Simulation Technical Framework For Complex Systems, Ji Hang, Junhua Zhou, Guoqiang Shi, Tingyu Lin, Junjie Xue

Journal of System Simulation

Abstract: Aiming at the modeling and simulation verification of complex systems, the paper established a lightweight simulation technical framework and a system building method. The simulation technical framework is built based on distributed network communication middleware and has graphic user interface, simulation management and run control modules, it packages effective and lightweight network middleware, object management, event management and time management and it is capable of interoperability and its members have abilities of reusable and combinable. The results show that the framework can supports flexible construction and effective simulation on complex systems.

Temperature Characteristics Of Contact Wire Under Different Driving Intervals, Hongwei Wang, Zhang Kai, Zhiyong Wang, Fengyi Guo, Liu Shuai, Zhang Qiong

Journal of System Simulation

Abstract: To reduce the wear of pantograph and catenary system while decreasing the headway, the temperature field of the contact wire is studied. A simulation model is established by using the COMSOL Multiphysics software. The effectiveness of the model is verified with temperature experiments. Temperature field of the contact wire of freight locomotive and passenger locomotive in different intervals is studied by simulation. The smaller the headway of trains, the higher the temperature value, and the shorter the balance process. Under the constraint of temperature field, the headway of freight locomotive couldn't be less than 180s under long term operation. …

Analysis And Simulation Of Temperature Control For Battery Pole Piece Electromagnetic Heating Roller, Jing Ran, Feng Hua, Yonggeng Wang, Haiping Song, Yanjun Xiao

Journal of System Simulation

Abstract: With the application of electromagnetic heating roller on battery pole piece rolling,the processing technology, quality and efficiency of the battery pole piece are improved. The special heating technology of electromagnetic heating roller which involves multi-physics coupling in the process of conversion makes it difficult to control the heating process and determine the control index. By studying the electromagnetic heating theory, the mathematical model of electromagnetic heating roller is established and the simulation and analysis of the electromagnetic heating roller using MATLAB software and the finite difference method are carried out. The distribution, change rule and influence factors of the …

Modeling & Simulation Technology In Manufacturing, Zhang Lin, Longfei Zhou

Journal of System Simulation

Abstract: With the continuous deepening of the application of information technology in the manufacturing field, the informatization of manufacturing systems is developing from unit digital manufacturing to integration networked manufacturing, and then to the comprehensive digital, networked and intelligent manufacturing. As a comprehensive information technology integrating computer, model theory, and scientific computing, modeling & simulation technology plays an irreplaceable role during the development of manufacturing informatization and is widely applied in all phases of the whole product lifecycle, such as design, manufacturing, testing, maintenance, purchase, sales and other phase. This paper reviews and summarizes the research and application of modeling …

Research On Maturity Evaluation Technology Of Complex Digital Industrial System, Geng Chao, Shiyou Qu, Tingyu Lin, Guoqiang Shi, Yingying Xiao, Wang Mei, Qiudan Ma, Ji Hang

Journal of System Simulation

Abstract: Under the background of a new round of the innovation of science and technology and the revolution of industry, the complex digital industrial system is constantly innovating and shaping. Firstly, the paper established maturity evaluation model of the complex digital industrial system based on system engineering. Then, the paper proposed multi - index maturity analysis method and multi - enterprise maturity synthesis method of the complex digital industrial system. Combined with the digital industrial system of aerospace complex product, an evaluation example is presented. The results show that the maturity evaluation method can be used to standardize and guide …