Numerical Analysis and Scientific Computing Commons^™

Time-Series Clustering In R Using The Dtwclust Package, Alexis Sardá-Espinosa

The R Journal

Most clustering strategies have not changed considerably since their initial definition. The common improvements are either related to the distance measure used to assess dissimilarity, or the function used to calculate prototypes. Time-series clustering is no exception, with the Dynamic Time Warping distance being particularly popular in that context. This distance is computationally expensive, so many related optimizations have been developed over the years. Since no single clustering algorithm can be said to perform best on all datasets, different strategies must be tested and compared, so a common infrastructure can be advantageous. In this manuscript, a general overview of shape-based …

Editorial, Norm Matloff

The R Journal

On behalf of the Editorial Board, I am pleased to present Volume 10, Issue 1 of the R Journal. This issue contains 36 contributed articles. The majority of which cover new or newly enhanced packages on CRAN.

Optimization Routines For Enforcing One-To-One Matches In Record Linkage Problems, Diego Moretti, Luca Valentino, Tiziana Tuoto

The R Journal

Record linkage aims at quickly and accurately identifying if two records represent the same real world entity. In many applications, we are interested in restricting the linkage results to "1 to 1" links, that is a single record does not appear more than once in the output. This can be dealt with the transport algorithm. The optimization problem, however, grows quadratically in the size of the input, quickly becoming untreatable for cases with a few thousand records. This paper compares different solutions, provided by some R packages for linear programming solvers. The comparison is done in terms of memory usage …

Robustgasp: Robust Gaussian Stochastic Process Emulation In R, Mengyang Gu, Jesus Palomo, James O. Berger

The R Journal

Gaussian stochastic process (GaSP) emulation is a powerful tool for approximating computationally intensive computer models. However, estimation of parameters in the GaSP emulator is a challenging task. No closed-form estimator is available and many numerical problems arise with standard estimates, e.g., the maximum likelihood estimator. In this package, we implement a marginal posterior mode estimator, for special priors and parameterizations. This estimation method that meets the robust parameter estimation criteria was discussed in Gu et al. (2018); mathematical reasons are provided therein to explain why robust parameter estimation can greatly improve predictive performance of the emulator. In addition, inert inputs …

Mixedsde: A Package To Fit Mixed Stochastic Differential Equations, Charlotte Dion, Simone Hermann, Adeline Samson

The R Journal

Stochastic differential equations (SDEs) are useful to model continuous stochastic processes. When (independent) repeated temporal data are available, variability between the trajectories can be modeled by introducing random effects in the drift of the SDEs. These models are useful to analyze neuronal data, crack length data, pharmacokinetics, financial data, to cite some applications among other. The R package focuses on the estimation of SDEs with linear random effects in the drift. The goal is to estimate the common density of the random effects from repeated discrete observations of the SDE. The package mixedsde proposes three estimation methods: a Bayesian parametric, …

Atable: Create Tables For Clinical Trial Reports, Armin Ströbel

The R Journal

Examining distributions of variables is the first step in the analysis of a clinical trial before more specific modelling can begin. Reporting these results to stakeholders of the trial is an essential part of a statistician’s work. The atable package facilitates these steps by offering easy-to-use but still flexible functions.

Fclust: An R Package For Fuzzy Clustering, Maria Brigida Ferraro, Paolo Giordani, Alessio Serafini

The R Journal

Fuzzy clustering methods discover fuzzy partitions where observations can be softly assigned to more than one cluster. The package fclust is a toolbox for fuzzy clustering in the R programming language. It not only implements the widely used fuzzy k-means (FkM) algorithm, but also many FkM variants. Fuzzy cluster similarity measures, cluster validity indices and cluster visualization tools are also offered. In the current version, all the functions are rewritten in the C++ language allowing their application in large-size problems. Moreover, new fuzzy relational clustering algorithms for partitioning qualitative/mixed data are provided together with an improved version of the so-called …

Mdfs: Multidimensional Feature Selection In R, Radosław Piliszek, Krzysztof Mnich, Szymon Migacz, Paweł Tabaszewski, Andrzej Sułecki, Aneta Polewko-Klim, Witold Rudnicki

The R Journal

Identification of informative variables in an information system is often performed using simple one-dimensional filtering procedures that discard information about interactions between variables. Such an approach may result in removing some relevant variables from consideration. Here we present an R package MDFS (MultiDimensional Feature Selection) that performs identification of informative variables taking into account synergistic interactions between multiple descriptors and the decision variable. MDFS is an implementation of an algorithm based on information theory (Mnich and Rudnicki, 2017). The computational kernel of the package is implemented in C++. A high-performance version implemented in CUDA C is also available. The application …

Connecting R With D3 For Dynamic Graphics, To Explore Multivariate Data With Tours, Michael Kipp, Ursula Laa, Dianne Cook

The R Journal

The tourr package in R has several algorithms and displays for showing multivariate data as a sequence of low-dimensional projections. It can display as a movie but has no capacity for interaction, such as stop/go, change tour type, drop/add variables. The tourrGui package provides these sorts of controls, but the interface is programmed with the dated RGtk2 package. This work explores using custom messages to pass data from R to D3 for viewing, using the Shiny framework. This is an approach that can be generally used for creating all sorts of interactive graphics.

Matching With Clustered Data: The Cmatching Package In R, Massimo Cannas, Bruno Arpino

The R Journal

Matching is a well known technique to balance covariates distribution between treated and control units in non-experimental studies. In many fields, clustered data are a very common occurrence in the analysis of observational data and the clustering can add potentially interesting information. Matching algorithms should be adapted to properly exploit the hierarchical structure. In this article we present the CMatching package implementing matching algorithms for clustered data. The package provides functions for obtaining a matched dataset along with estimates of most common parameters of interest and model-based standard errors. A propensity score matching analysis, relating math proficiency with homework completion …

Identifying And Testing Recursive Vs. Interdependent Links In Simultaneous Equation Models Via The Sire Package, Gianmarco Vacca, Maria Grazia Zoia

The R Journal

Simultaneous equation models (SEMs) are composed of relations which either represent unidirectional links, which entail a causal interpretation, or bidirectional links, due to feedback loops, which lead to the notion of interdependence. The issue is of prominent interest in several respects. Investigating the causal structure of a SEM, on the one hand, brings to light the theoretical assumptions behind the model and, on the other hand, pilots the choice of the befitting estimation method and of which policy to implement. This paper provides an operational method to distinguish causal relations from interdependent ones in SEMs, such as macro-econometric models, models …

Rssampling: A Pioneering Package For Ranked Set Sampling, Busra Sevinc, Bekir Cetintav, Melek Esemen, Selma Gurler

The R Journal

Ranked set sampling (RSS) is an advanced data collection method when the exact measurement of an observation is difficult and/or expensive used in a number of research areas, e.g., environment, bioinformatics, ecology, etc. In this method, random sets are drawn from a population and the units in sets are ranked with a ranking mechanism which is based on a visual inspection or a concomitant variable. Because of the importance of working with a good design and easy analysis, there is a need for a software tool which provides sampling designs and statistical inferences based on RSS and its modifications. This …

Title: Ipwerrory: An R Package For Estimation Of Average Treatment Effect With Misclassified Binary Outcome, Di Shu, Grace Y. Yi

The R Journal

It has been well documented that ignoring measurement error may result in severely biased inference results. In recent years, there has been limited but increasing research on causal inference with measurement error. In the presence of misclassified binary outcome variable, Shu and Yi (2017) considered the inverse probability weighted estimation of the average treatment effect and proposed valid estimation methods to correct for misclassification effects for various settings. To expedite the application of those methods for situations where misclassification in the binary outcome variable is a real concern, we implement correction methods proposed by Shu and Yi (2017) and develop …

Semicomprisks: An R Package For The Analysis Of Independent And Cluster-Correlated Semi-Competing Risks Data, Danilo Alvares, Sebastien Haneuse, Catherine Lee, Kyu Ha Lee

The R Journal

Semi-competing risks refer to the setting where primary scientific interest lies in estimation and inference with respect to a non-terminal event, the occurrence of which is subject to a terminal event. In this paper, we present the R package SemiCompRisks that provides functions to perform the analysis of independent/clustered semi-competing risks data under the illness-death multi-state model. The package allows the user to choose the specification for model components from a range of options giving users substantial flexibility, including: accelerated failure time or proportional hazards regression models; parametric or non-parametric specifications for baseline survival functions; parametric or non-parametric specifications for …

R News, R Core Team

The R Journal

CHANGES IN R 3.6.1

Fixed Point Acceleration In R, Stuart Baumann, Margaryta Klymak

The R Journal

t A fixed point problem is one where we seek a vector, X, for a function, f, such that f(X) = X. The solution of many such problems can be accelerated by using a fixed point acceleration algorithm. With the release of the FixedPoint package there is now a number of algorithms available in R that can be used for accelerating the finding of a fixed point of a function. These algorithms include Newton acceleration, Aitken acceleration and Anderson acceleration as well as epsilon extrapolation methods and minimal polynomial methods. This paper demonstrates the use of fixed point accelerators in …

Nowcasting: An R Package For Predicting Economic Variables Using Dynamic Factor Models, Serge De Valk, Daiane De Mattos, Pedro Ferreira

The R Journal

The nowcasting package provides the tools to make forecasts of monthly or quarterly economic variables using dynamic factor models. The objective is to help the user at each step of the forecasting process, starting with the construction of a database, all the way to the interpretation of the forecasts. The dynamic factor model adopted in this package is based on the articles from Giannone et al. (2008) and Banbura et al. (2011). Although there exist several other dynamic factor model packages available for R, ours provides an environment to easily forecast economic variables and interpret results.

Unival: An Fa-Based R Package For Assessing Essential Unidimensionality Using External Validity Information, Pere J. Ferrando, Urbano Lorenzo-Seva, David Navarro-Gonzalez

The R Journal

The unival package is designed to help researchers decide between unidimensional and correlated-factors solutions in the factor analysis of psychometric measures. The novelty of the approach is its use of external information, in which multiple factor scores and general factor scores are related to relevant external variables or criteria. The unival package’s implementation comes from a series of procedures put forward by Ferrando and Lorenzo-Seva (2019) and new methodological developments proposed in this article. We assess models fitted using unival by means of a simulation study extending the results obtained in the original proposal. Its usefulness is also assessed through …

Optimparallel: An R Package Providing A Parallel Version Of The L-Bfgs-B Optimization Method, Florian Gerber, Reinhard Furrer

The R Journal

The R package optimParallel provides a parallel version of the L-BFGS-B optimization method of optim(). The main function of the package is optimParallel(), which has the same usage and output as optim(). Using optimParallel() can significantly reduce the optimization time, especially when the evaluation time of the objective function is large and no analytical gradient is available. We introduce the R package and illustrate its implementation, which takes advantage of the lexical scoping mechanism of R.

Integration Of Networks And Pathways With Starbiotrek Package, Claudia Cava, Isabella Castiglioni

The R Journal

High-throughput genomic technologies bring to light a comprehensive hallmark of molecular changes of a disease. It is increasingly evident that genes are not isolated from each other and the identification of a gene signature can only partially elucidate the de-regulated biological functions in a disease. The comprehension of how groups of genes (pathways) are related to each other (pathway-cross talk) could explain biological mechanisms causing diseases. Biological pathways are important tools to identify gene interactions and decrease the large number of genes to be studied by partitioning them into smaller groups. Furthermore, recent scientific studies have demonstrated that an integration …

Whats For Dynr: A Package For Linear And Nonlinear Dynamic Modeling In R, Lu Ou, Michael D. Hunter, Sy-Miin Chow

The R Journal

Intensive longitudinal data in the behavioral sciences are often noisy, multivariate in nature, and may involve multiple units undergoing regime switches by showing discontinuities interspersed with continuous dynamics. Despite increasing interest in using linear and nonlinear differential/difference equation models with regime switches, there has been a scarcity of software packages that are fast and freely accessible. We have created an R package called dynr that can handle a broad class of linear and nonlinear discrete- and continuous-time models, with regime-switching properties and linear Gaussian measurement functions, in C, while maintaining simple and easy-to-learn model specification functions in R. We present …

Swgee: An R Package For Analyzing Longitudinal Data With Response Missingness And Covariate Measurement Error, Juan Xiong, Grace Y. Yi

The R Journal

Though longitudinal data often contain missing responses and error-prone covariates, relatively little work has been available to simultaneously correct for the effects of response missingness and covariate measurement error on analysis of longitudinal data. Yi (2008) proposed a simulation based marginal method to adjust for the bias induced by measurement error in covariates as well as by missingness in response. The proposed method focuses on modeling the marginal mean and variance structures, and the missing at random mechanism is assumed. Furthermore, the distribution of covariates are left unspecified. These features make the proposed method applicable to a broad settings. In …

Simcorrmix: Simulation Of Correlated Data With Multiple Variable Types Including Continuous And Count Mixture Distributions, Allison Fialkowski, Hemant Tiwari

The R Journal

The SimCorrMix package generates correlated continuous (normal, non-normal, and mixture), binary, ordinal, and count (regular and zero-inflated, Poisson and Negative Binomial) variables that mimic real-world data sets. Continuous variables are simulated using either Fleishman’s third-order or Headrick’s fifth-order power method transformation. Simulation occurs at the component level for continuous mixture distributions, and the target correlation matrix is specified in terms of correlations with components. However, the package contains functions to approximate expected correlations with continuous mixture variables. There are two simulation pathways which calculate intermediate correlations involving count variables differently, increasing accuracy under a wide range of parameters. The package …

The R Journal (June 2019) 11(1): Complete Issue, The R Foundation

The R Journal

Editorial, Michael J. Kane

Contributed Research Articles

atable: Create Tables for Clinical Trial Reports, Armin Ströbel

Connecting R with D3 for Dynamic Graphics, to Explore Multivariate Data with Tours, Michael Kipp, Ursula Laa, and Dianne Cook

Optimization Routines for Enforcing One-to-One Matches in Record Linkage Problems, Diego Moretti, Luca Valentino, and Tiziana Tuoto

mixedsde: A Package to Fit Mixed Stochastic Differential Equations, Charlotte Dion, Simone Hermann, and Adeline Samson

Indoor Positioning and Fingerprinting: The R Package ipft, Emilio Sansano, Raúl Montoliu, Óscar Belmonte, and Joaquín Torres-Sospedra

RobustGaSP: Robust Gaussian Stochastic Process Emulation in R, Mengyang Gu, Jesus Palomo, and James …

Visualization And Machine Learning Techniques For Nasa’S Em-1 Big Data Problem, Antonio P. Garza Iii, Jose Quinonez, Misael Santana, Nibhrat Lohia

SMU Data Science Review

In this paper, we help NASA solve three Exploration Mission-1 (EM-1) challenges: data storage, computation time, and visualization of complex data. NASA is studying one year of trajectory data to determine available launch opportunities (about 90TBs of data). We improve data storage by introducing a cloud-based solution that provides elasticity and server upgrades. This migration will save $120k in infrastructure costs every four years, and potentially avoid schedule slips. Additionally, it increases computational efficiency by 125%. We further enhance computation via machine learning techniques that use the classic orbital elements to predict valid trajectories. Our machine learning model decreases trajectory …

Improving Vix Futures Forecasts Using Machine Learning Methods, James Hosker, Slobodan Djurdjevic, Hieu Nguyen, Robert Slater

SMU Data Science Review

The problem of forecasting market volatility is a difficult task for most fund managers. Volatility forecasts are used for risk management, alpha (risk) trading, and the reduction of trading friction. Improving the forecasts of future market volatility assists fund managers in adding or reducing risk in their portfolios as well as in increasing hedges to protect their portfolios in anticipation of a market sell-off event. Our analysis compares three existing financial models that forecast future market volatility using the Chicago Board Options Exchange Volatility Index (VIX) to six machine/deep learning supervised regression methods. This analysis determines which models provide best …

The R Journal (December 2018) 10(2): Complete Issue, The R Foundation

The R Journal

Editorial, John Verzani

Contributed Research Articles

stplanr: A Package for Transport Planning, Robin Lovelace and Richard Ellison

The utiml Package: Multi-label Classification in R, Adriano Rivolli and Andre C. P. L. F. de Carvalho

rcss: R Package for Optimal Convex Stochastic Switching, Juri Hinz and Jeremy Yee

nsROC: An R package for Non-Standard ROC Curve Analysis, Sonia Pérez-Fernández, Pablo Martínez-Camblor, Peter Filzmoser, and Norberto Corral

addhaz: Contribution of Chronic Diseases to the Disability Burden Using R, Renata Tiene de Carvalho Yokota, Caspar WN Looman, Wilma Johanna Nusselder, Herman Van Oyen, and Geert Molenberghs

Snowboot: Bootstrap Methods for Network Inference, Yuzhou …

Testfordep: An R Package For Modern Distribution-Free Tests And Visualization Tools For Independence, Jeffrey C. Miecznikowski, En-Shuo Hsu, Yanhua Chen, Albert Vexler

The R Journal

This article introduces testforDEP, a portmanteau R package implementing for the first time several modern tests and visualization tools for independence between two variables. While classical tests for independence are in the base R packages, there have been several recently developed tests for independence that are not available in R. This new package combines the classical tests including Pearson’s product moment correlation coefficient method, Kendall’s τ rank correlation coefficient method and Spearman’s ρ rank correlation coefficient method with modern tests consisting of an empirical likelihood based test, a density-based empirical likelihood ratio test, Kallenberg data-driven test, maximal information coefficient …

Smm: An R Package For Estimation And Simulation Of Discrete-Time Semi-Markov Models, Vlad Stefan Barbu, Caroline Bérard, Dominique Cellier, Mathilde Sautreuil, Nicolas Vergne

The R Journal

Semi-Markov models, independently introduced by Lévy (1954), Smith (1955) and Takacs (1954), are a generalization of the well-known Markov models. For semi-Markov models, sojourn times can be arbitrarily distributed, while sojourn times of Markov models are constrained to be exponentially distributed (in continuous time) or geometrically distributed (in discrete time). The aim of this paper is to present the R package SMM, devoted to the simulation and estimation of discrete-time multi-state semi-Markov and Markov models. For the semi-Markov case we have considered: parametric and non-parametric estimation; with and without censoring at the beginning and/or at the end of sample …

Fica: Fastica Algorithms And Their Improved Variants, Jari Miettinen, Klaus Nordhausen, Sara Taskinen

The R Journal

In independent component analysis (ICA) one searches for mutually independent nongaussian latent variables when the components of the multivariate data are assumed to be linear combinations of them. Arguably, the most popular method to perform ICA is FastICA. There are two classical versions, the deflation-based FastICA where the components are found one by one, and the symmetric FastICA where the components are found simultaneously. These methods have been implemented previously in two R packages, fastICA and ica. We present the R package fICA and compare it to the other packages. Additional features in fICA include optimization of the extraction order …