Numerical Analysis and Scientific Computing Commons^™

Semiparametric Generalized Linear Models With The Gldrm Package, Michael J. Wurm, Paul J. Rathouz

The R Journal

This paper introduces a new algorithm to estimate and perform inferences on a recently proposed and developed semiparametric generalized linear model (glm). Rather than selecting a particular parametric exponential family model, such as the Poisson distribution, this semiparametric glm assumes that the response is drawn from the more general exponential tilt family. The regression coefficients and unspecified reference distribution are estimated by maximizing a semiparametric likelihood. The new algorithm incorporates several computational stability and efficiency improvements over the algorithm originally proposed. In particular, the new algorithm performs well for either small or large support for the nonparametric response distribution. The …

Ratingscalereduction Package: Stepwise Rating Scale Item Reduction Without Predictability Loss, Waldemar W. Koczkodaj, Feng Li, Alicja Wolny–Dominiak

The R Journal

This study presents an innovative method for reducing the number of rating scale items without predictability loss. The “area under the receiver operator curve” method (AUC ROC) is used for the stepwise method of reducing items of a rating scale. RatingScaleReduction R package contains the presented implementation. Differential evolution (a metaheuristic for optimization) was applied to one of the analyzed datasets to illustrate that the presented stepwise method can be used with other classifiers to reduce the number of rating scale items (variables). The targeted areas of application are decision making, data mining, machine learning, and psychometrics.

News From The Bioconductor Project, Bioconductor Core Team

The R Journal

The Bioconductor project provides tools for the analysis and comprehension of high-throughput genomic data. Bioconductor 3.7 was released on 1 May, 2018. It is compatible with R 3.5.1 and consists of 1560 software packages, 342 experiment data packages, and 919 up-to-date annotation packages. The release announcement includes descriptions of 98 new software packages and updated NEWS files for many additional packages. Start using Bioconductor by installing the most recent version of R and evaluating the commands

A System For An Accountable Data Analysis Process In R, Jonathan Gelfond, Martin Goros, Brian Hernandez, Alex Bokov

The R Journal

Efficiently producing transparent analyses may be difficult for beginners or tedious for the experienced. This implies a need for computing systems and environments that can efficiently satisfy reproducibility and accountability standards. To this end, we have developed a system, R package, and R Shiny application called adapr (Accountable Data Analysis Process in R) that is built on the principle of accountable units. An accountable unit is a data file (statistic, table or graphic) that can be associated with a provenance, meaning how it was created, when it was created and who created it, and this is similar to the ’verifiable …

Mmpf: Monte-Carlo Methods For Prediction Functions, Zachary M. Jones

The R Journal

Machine learning methods can often learn high-dimensional functions which generalize well but are not human interpretable. The mmpf package marginalizes prediction functions using Monte-Carlo methods, allowing users to investigate the behavior of these learned functions, as on a lower dimensional subset of input features: partial dependence and variations thereof. This makes machine learning methods more useful in situations where accurate prediction is not the only goal, such as in the social sciences where linear models are commonly used because of their interpretability.

Many methods for estimating prediction functions produce estimated functions which are not directly human-interpretable because of their complexity: …

Generalized Additive Model Multiple Imputation By Chained Equations With Package Imputerobust, Daniel Salfran, Martin Spiess

The R Journal

Data analysis, common to all empirical sciences, often requires complete data sets. Unfortunately, real world data collection will usually result in data values not being observed. We present a package for robust multiple imputation (the ImputeRobust package) that allows the use of generalized additive models for location, scale, and shape in the context of chained equations. The paper describes the basics of the imputation technique which builds on a semi-parametric regression model (GAMLSS) and the algorithms and functions provided with the corresponding package. Furthermore, some illustrative examples are provided.

Fhdi: An R Package For Fractional Hot Deck Imputation, Jongho Im, In Ho Cho, Jae Kwang Kim

The R Journal

Fractional hot deck imputation (FHDI), proposed by Kalton and Kish (1984) and investigated by Kim and Fuller (2004), is a tool for handling item nonresponse in survey sampling. In FHDI, each missing item is filled with multiple observed values yielding a single completed data set for subsequent analyses. An R package FHDI is developed to perform FHDI and also the fully efficient fractional imputation (FEFI) method of (Fuller and Kim, 2005) to impute multivariate missing data with arbitrary missing patterns. FHDI substitutes missing items with a few observed values jointly obtained from a set of donors whereas the FEFI uses …

The R Journal (July 2018) 10(1): Complete Issue, The R Foundation

The R Journal

Editorial, John Verzani

Contributed Research Articles

A System for an Accountable Data Analysis Process in R, Jonathan Gelfond, Martin Goros, Brian Hernandez and Alex Bokov

RealVAMS: An R Package for Fitting a Multivariate Value-added Model (VAM), Jennifer Broatch, Jennifer Green, and Andrew Karl

InfoTrad: An R Package for Estimating the Probability of Informed Trading, Duygu Çelik and Murat Tiniç

RatingScaleReduction Package: Stepwise Rating Scale Item Reduction without Predictability Loss, Waldemar W. Koczkodaj, Feng Li, and Alicja Wolny-Dominiak

mmpf: Monte-Carlo Methods for Prediction Functions, Zachary M. Jones

Generalized Additive Model Multiple Imputation by Chained Equations with Package ImputeRobust, Daniel Salfran and …

Recta: Regulon Identification Based On Comparative Genomics And Transcriptomics Analysis, Xin Chen, Anjun Ma, Adam Mcdermaid, Hanyuan Zhang, Chao Liu, Huansheng Cao, Qin Ma

School of Computing: Faculty Publications

Regulons, which serve as co-regulated gene groups contributing to the transcriptional regulation of microbial genomes, have the potential to aid in understanding of underlying regulatory mechanisms. In this study, we designed a novel computational pipeline, regulon identification based on comparative genomics and transcriptomics analysis (RECTA), for regulon prediction related to the gene regulatory network under certain conditions. To demonstrate the effectiveness of this tool, we implemented RECTA on Lactococcus lactis MG1363 data to elucidate acid-response regulons. A total of 51 regulons were identified, 14 of which have computational-verified significance. Among these 14 regulons, five of them were computationally predicted to …

Multi-Point Vibration Measurement And Mode Magnification Of Civil Structures Using Video-Based Motion Processing, Zhexiong Shang, Zhigang Shen

Department of Construction Engineering and Management: Faculty Publications

Image-based vibration measurement has gained increased attentions in civil and construction communities. A recent video-based motion magnification method was developed to measure and visualize small structure motions. This new approach presents a potential for low-cost vibration measurement and mode shape identification. Pilot studies using this approach on simple rigid body structures were reported. Its validity on complex outdoor structures has not been investigated. In this study, a non-contact video-based approach for multi-point vibration measurement and mode magnification is introduced. The proposed approach can output a full-field vibration map that increases the efficiency of the current structural health monitoring (SHM) practice. …

Expression Of The Microrna-143/145 Cluster Is Decreased In Hepatitis B Virus-Associated Hepatocellular Carcinoma And May Serve As A Biomarker For Tumorigenesis In Patients With Chronic Hepatitis B, Qi Zhao, Xiangfei Sun, Chao Liu, Tao Li, Juan Cui, Chengyong Qin

School of Computing: Faculty Publications

The aims of the present study were to identify the expression profile of microRNA (miR)‑143/145 in hepatitis B virus (HBV)‑associated hepatocellular carcinoma (HCC), explore its association with prognosis and investigate whether the serum miR‑143/145 expression levels may serve as a diagnostic indicator of HBV‑associated HCC. The microRNA (miRNA) chromatin immunoprecipitation dataset was obtained from The Cancer Genome Atlas (TCGA) and the Gene Expression Omnibus databases, and analyzed using the Wilcoxon signed‑rank test. It was observed that the expression of miR‑143 and miR‑145 was decreased 1.5‑fold in HBV‑associated HCC samples compared with non‑tumor tissue in the TCGA and the GSE22058 datasets …

News From The Bioconductor Project, Bioconductor Core Team

The R Journal

The Bioconductor project provides tools for the analysis and comprehension of high throughput genomic data. Bioconductor 3.6 was released on 31 October, 2017. It is compatible with R 3.4.3 and consists of 1473 software packages, 326 experiment data packages, and 911 up-to-date annotation packages. The release announcement includes descriptions of 100 new software packages, and updated NEWS files for many additional packages. Start using Bioconductor by installing the most recent version of R and evaluating the commands

Changes On Cran, Kurt Hornik, Uwe Ligges, Achim Zeileis

The R Journal

In the past 6 months,1244 new packages were added to the CRAN package repository. 19 packages were unarchived, 55 archived and 3 removed. The following shows the growth of the number of active packages in the CRAN package repository

R Teaching Column, Matthias Gehrke, Reed Davis, Norman Matloff, Paul Thompson, Tiffany Chen, Emily Watkins, Laurel Beckett

The R Journal

The revisit package, developed as a collaborative tool for scientists, also serves as a tool for teaching statistics, in a manner that can be highly motivating for students. Using either the included case studies or datasets/code provided by the instructor, students can explore several alternate paths of analysis, such as the effects of including/excluding certain variables, employing different types of statistical methodology and so on. The package includes features that help students follow modern statistical standards and avoid various statistical errors, such as “p-hacking” and lack of attention to outlier data.

Forwards Column, Stella Bollmann, Dianne Cook, Jasmine Dumas, John Fox, Julie Josse, Oliver Keyes, Carolin Strobl, Heather Turner, Rudolf Debelak

The R Journal

Forwards is a task force that was set up by the R Foundation in 2015 to address the under representation of women that has since widened its scope to encompass other under represented groups. The task force is organised as a core team comprising leaders from a number of sub-teams that focus on particular aspects:

An Introduction To Rocker: Docker Containers For R, Carl Boettiger, Dirk Eddelbuettel

The R Journal

We describe the Rocker project, which provides a widely-used suite of Docker images with customized R environments for particular tasks. We discuss how this suite is organized, and how these tools can increase portability, scaling, reproducibility, and convenience of R users and developers.

Openebgm: An R Implementation Of The Gamma-Poisson Shrinker Data Mining Model, Travis Canida, John Ihrie

The R Journal

We introduce the R package openEBGM, an implementation of the Gamma-Poisson Shrinker (GPS) model for identifying unexpected counts in large contingency tables using an empirical Bayes approach. The Empirical Bayes Geometric Mean (EBGM) and quantile scores are obtained from the GPS model estimates. openEBGM provides for the evaluation of counts using a number of different methods, including the model-based disproportionality scores, the relative reporting ratio (RR), and the proportional reporting ratio (PRR). Data squashing for computational efficiency and stratification for confounding variable adjustment are included. Application to adverse event detection is discussed.

Riskregression: Predicting The Risk Of An Event Using Cox Regression Models, Brice Ozenne, Anne Lyngholm Sørensen, Thomas Scheike, Christian Torp-Pedersen, Thomas Alexander Gerds

The R Journal

In the presence of competing risks a prediction of the time-dynamic absolute risk of an event can be based on cause-specific Cox regression models for the event and the competing risks (Benichou and Gail, 1990). We present computationally fast and memory optimized C++functions with an R inter face for predicting the covariate specific absolute risks, their confidence intervals, and their confidence bands based on right censored time to event data. We provide explicit formulas for our implementation of the estimator of the (stratified) baseline hazard function in the presence of tied event times. As a by-product we obtain fast access …

Partial Rank Data With The Hyper2 Package: Likelihood Functions For Generalized Bradley-Terry Models, Robin K. S Hankin

The R Journal

Here I present the hyper2 package for generalized Bradley-Terry models and give examples from two competitive situations: single scull rowing, and the competitive cooking game show Master Chef Australia. A number of natural statistical hypotheses may be tested straightforwardly using the software.

The R Journal (December 2017) 9(2): Complete Issue, The R Foundation

The R Journal

Editorial, Roger Bivand

Contributed Research Articles

anchoredDistr: A Package for the Bayesian Inversion of Geostatistical Parameters with Multi-type and Multi-scale Data, Heather Savoy, Falk Heße, and Yoram Rubin

dGAselID: An R Package for Selecting a Variable Number of Features in High Dimensional Data, Nicolae Teodor Melita and Stefan Holban

Allele Imputation and Haplotype Determination from Databases Composed of Nuclear Families, Nathan Medina-Rodríguez and Ángelo Santana

Visualization of Regression Models Using visreg, Patrick Breheny and Woodrow Burchett

fourierin: An R package to compute Fourier integrals, Guillermo Basulto-Elias, Alicia Carriquiry, Kris De Brabanter, and Daniel J. Nordman

Discrete Time Markov Chains with …

Anomalydetection: Implementation Of Augmented Network Log Anomaly Detection Procedures, Robert J. Gutierrez, Bradley C. Boehmke, Air Force Institute Of Technology, Cade M. Saie, Trevor J. Bihl

The R Journal

As the number of cyber-attacks continues to grow on a daily basis, so does the delay in threat detection. For instance, in 2015, the Office of Personnel Management discovered that approximately 21.5 million individual records of Federal employees and contractors had been stolen. On average, the time between an attack and its discovery is more than 200 days. In the case of the OPM breach, the attack had been going on for almost a year. Currently, cyber analysts inspect numerous potential incidents on a daily basis, but have neither the time nor the resources available to perform such a task. …

The Welchadf Package For Robust Hypothesis Testing In Unbalanced Multivariate Mixed Models With Heteroscedastic And Non-Normal Data, Pablo J. Villacorta

The R Journal

A new R package is presented for dealing with non-normality and variance heterogeneity of sample data when conducting hypothesis tests of main effects and interactions in mixed models. The proposal departs from an existing SAS program which implements Johansen’s general formulation of Welch-James’s statistic with approximate degrees of freedom, which makes it suitable for testing any linear hypothesis concerning cell means in univariate and multivariate mixed model designs when the data pose non-normality and non-homogeneous variance. Improved type I error rate control is obtained using bootstrapping for calculating an empirical critical value, whereas robustness against non-normality is achieved through trimmed …

Mle.Tools: An R Package For Maximum Likelihood Bias Correction, Josmar Mazucheli, André Felipe B. Menezes, Saralees Nadarajah

The R Journal

Recently, Mazucheli (2017) uploaded the package mle.tools to CRAN. It can be used for bias corrections of maximum likelihood estimates through the methodology proposed by Cox and Snell (1968). The main function of the package, coxsnell.bc(), computes the bias corrected maximum likelihood estimates. Although in general, the bias corrected estimators may be expected to have better sampling properties than the uncorrected estimators, analytical expressions from the formula proposed by Cox and Snell (1968) are either tedious or impossible to obtain. The purpose of this paper is twofolded: to introduce the mle.tools package, especially the coxsnell.bc() function; secondly, to compare, for …

Liureg: A Comprehensive R Package For The Liu Estimation Of Linear Regression Model With Collinear Regressors, Muhammad Imdadullah, Muhammad Aslam, Saima Altaf

The R Journal

The Liu regression estimator is now a commonly used alternative to the conventional ordinary least squares estimator that avoids the adverse effects in the situations when there exists a considerable degree of multicollinearity among the regressors. There are only a few software packages available for estimation of the Liu regression coefficients, though with limited methods to estimate the Liu biasing parameter without addressing testing procedures. Our liureg package can be used to estimate the Liu regression coefficients utilizing a range of different existing biasing parameters, to test these coefficients with more than 15 Liu related statistics, and to present different …

Ider: Intrinsic Dimension Estimation With R, Hideitsu Hino

The R Journal

In many data analyses, the dimensionality of the observed data is high while its intrinsic dimension remains quite low. Estimating the intrinsic dimension of an observed dataset is an essential preliminary step for dimensionality reduction, manifold learning, and visualization. This paper introduces an R package, named ider, that implements eight intrinsic dimension estimation methods, including a recently proposed method based on a second-order expansion of a probability mass function and a generalized linear model. The usage of each function in the package is explained with datasets generated using a function that is also included in the package

Carx: An R Package To Estimate Censored Autoregressive Time Series With Exogenous Covariates, Chao Wang, Kung-Sik Chan

The R Journal

We implement in the R package carx a novel and computationally efficient quasi-likelihood method for estimating a censored autoregressive model with exogenous covariates. The proposed quasi-likelihood method reduces to maximum likelihood estimation in absence of censoring. The carx package contains many useful functions for practical data analysis with censored stochastic regression, including functions for outlier detection, model diagnostics, and prediction with censored time series data. We illustrate the capabilities of the carx package with simulations and an elaborate real data analysis.

Furniture For Quantitative Scientists, Tyson S. Barrett, Emily Brignone

The R Journal

A basic understanding of the distributions of study variables and the relationships among them is essential to inform statistical modeling. This understanding is achieved through the computation of summary statistics and exploratory data analysis. Unfortunately, this step tends to be under-emphasized in the research process, in part because of the often tedious nature of thorough exploratory data analysis. The table1() function in the furniture package streamlines much of the exploratory data analysis process, making the computation and communication of summary statistics simple and beautiful while offering significant time-savings to the researcher

Ctmcd: An R Package For Estimating The Parameters Of A Continuous-Time Markov Chain From Discrete-Time Data, Marius Pfeuffer

The R Journal

This article introduces the R package ctmcd, which provides an implementation of methods for the estimation of the parameters of a continuous-time Markov chain given that data are only available on a discrete-time basis. This data consists of partial observations of the state of the chain, which are made without error at discrete times, an issue also known as the embedding problem for Markovchains. The functions provided comprise matrix logarithm based approximations as described in Israel et al. (2001), as well as Kreinin and Sidelnikova (2001), an expectation-maximization algorithm and a Gibbs sampling approach, both introduced by Bladt and …

Discrete Time Markov Chains With R, Giorgio Alfredo Spedicato

The R Journal

The markovchain package aims to provide S4 classes and methods to easily handle Discrete Time Markov Chains (DTMCs), filling the gap with what is currently available in the CRAN repository. In this work, I provide an exhaustive description of the main functions included in the package, as well as hands-on examples.

Fourierin: An R Package To Compute Fourier Integrals, Guillermo Basulto-Elias, Alicia Carriquiry, Kris De Brabanter, Daniel J. Nordman

The R Journal

We present the R package fourierin (Basulto-Elias, 2017) for evaluating functions defined as Fourier-type integrals over a collection of argument values. The integrals are finitely supported with integrands involving continuous functions of one or two variables. As an important application, such Fourier integrals arise in so-called “inversion formulas”, where one seeks to evaluate a probability density at a series of points from a given characteristic function (or vice versa) through Fourier transforms. This paper intends to fill a gap in current R software, where tools for repeated evaluation of functions as Fourier integrals are not directly available. We implement two …