Numerical Analysis and Scientific Computing Commons^™

Metaplus: An R Package For The Analysis Of Robust Meta-Analysis And Meta-Regression, Ken J. Beath

The R Journal

The metaplus package is described with examples of its use for fitting meta-analysis and meta-regression. For either meta-analysis or meta-regression it is possible to fit one of three models: standard normal random effect, t-distribution random effect or mixture of normal random effects. The latter two models allow for robustness by allowing for a random effect distribution with heavier tails than the normal distribution, and for both robust models the presence of outliers may be tested using the parametric bootstrap. For the mixture of normal random effects model the outlier studies may be identified through their posterior probability of membership in …

Conditional Fractional Gaussian Fields With The Package Fieldsim, Alexandre Brouste, Jacques Istas, Sophie Lambert-Lacroix

The R Journal

We propose an effective and fast method to simulate multidimensional conditional fractional Gaussian fields with the package FieldSim. Our method is valid not only for conditional simulations associated to fractional Brownian fields, but to any Gaussian field and on any (non regular) grid of points.

Progenyclust: An R Package For Progeny Clustering, Chenyue W. Hu, Amina A. Qutub

The R Journal

Identifying the optimal number of clusters is a common problem faced by data scientists in various research fields and industry applications. Though many clustering evaluation techniques have been developed to solve this problem, the recently developed algorithm Progeny Clustering is a much faster alternative and one that is relevant to biomedical applications. In this paper, we introduce an R package progenyClust that implements and extends the original Progeny Clustering algorithm for evaluating clustering stability and identifying the optimal cluster number. We illustrate its applicability using two examples: a simulated test dataset for proof-of-concept, and a cell imaging dataset for demonstrating …

Statmod: Probability Calculations For The Inverse Gaussian Distribution, Göknur Giner, Gordon K. Smyth

The R Journal

The inverse Gaussian distribution (IGD) is a well known and often used probability distribution for which fully reliable numerical algorithms have not been available. We develop fast, reliable basic probability functions (dinvgauss, pinvgauss, qinvgauss and rinvgauss) for the IGD that work for all possible parameter values and which achieve close to full machine accuracy. The most challenging task is to compute quantiles for given cumulative probabilities and we develop a simple but elegant mathematical solution to this problem. We show that Newton’s method for finding the quantiles of a IGD always converges monotonically when started from the mode of the …

Heteroscedastic Censored And Truncated Regression With Crch, Jakob W. Messner, Georg J. Mayr, Achim Zeileis

The R Journal

The crch package provides functions for maximum likelihood estimation of censored or truncated regression models with conditional heteroscedasticity along with suitable standard methods to summarize the fitted models and compute predictions, residuals, etc. The supported distributions include left- or right-censored or truncated Gaussian, logistic, or student-t distributions with potentially different sets of regressors for modeling the conditional location and scale. The models and their R implementation are introduced and illustrated by numerical weather prediction tasks using precipitation data for Innsbruck (Austria).

Stylometry With R: A Package For Computational Text Analysis, Maciej Eder, Jan Rybicki, Mike Kestemont

The R Journal

This software paper describes ‘Stylometry with R’ (stylo), a flexible R package for the high level analysis of writing style in stylometry. Stylometry (computational stylistics) is concerned with the quantitative study of writing style, e.g. authorship verification, an application which has considerable potential in forensic contexts, as well as historical research. In this paper we introduce the possibilities of stylo for computational text analysis, via a number of dummy case studies from English and French literature. We demonstrate how the package is particularly useful in the exploratory statistical analysis of texts, e.g. with respect to authorial writing style. …

Sbtools: A Package Connecting R To Cloud-Based Data For Collaborative Online Research, Luke A. Winslow, Scott Chamberlain, Alison P. Appling, Jordan S. Read

The R Journal

The adoption of high-quality tools for collaboration and reproducibile research such as R and Github is becoming more common in many research fields. While Github and other version management systems are excellent resources, they were originally designed to handle code and scale poorly to large text-based or binary datasets. A number of scientific data repositories are coming online and are often focused on dataset archival and publication. To handle collaborative workflows using large scientific datasets, there is increasing need to connect cloud-based online data storage to R. In this article, we describe how the new R package sbtools enables direct …

Mclust 5: Clustering, Classification And Density Estimation Using Gaussian Finite Mixture Models, Luca Scrucca, Michael Fop, T Brendan Murphy, Adrian E. Raftery

The R Journal

Finite mixture models are being used increasingly to model a wide variety of random phenomena for clustering, classification and density estimation. mclust is a powerful and popular package which allows modelling of data as a Gaussian finite mixture with different covariance structures and different numbers of mixture components, for a variety of purposes of analysis. Recently, version 5 of the package has been made available on CRAN.This updated version adds new covariance structures, dimension reduction capabilities for visualisation, model selection criteria, initialisation strategies for the EM algorithm, and bootstrap-based inference, making it a full-featured R package for data analysis via …

Gender Prediction Methods Based On First Names With Genderizer, Kamil Wais

The R Journal

In recent years, there has been increased interest in methods for gender prediction based on f irst names that employ various open data sources. These methods have applications from bibliometric studies to customizing commercial offers for web users. Analysis of gender disparities in science based on such methods are published in the most prestigious journals, although they could be improved by choosing the most suited prediction method with optimal parameters and performing validation studies using the best data source for a given purpose. There is also a need to monitor and report how well a given prediction method works in …

Cryptrndtest: An R Package For Testing The Cryptographic Randomness, Haydar Demirhan, Nihan Bitirim

The R Journal

n this article, we introduce the R package CryptRndTest that performs eight statistical randomness tests on cryptographic random number sequences. The purpose of the package is to provide software implementing recently proposed cryptographic randomness tests utilizing goodness of-fit tests superior to the usual chi-square test in terms of statistical performance. Most of the tests included in package CryptRndTest are not available in other software packages such as the R package RDieHarder or the C library TestU01. Chi-square, Anderson-Darling, Kolmogorov-Smirnov, and Jarque-Bera goodness-of-fit procedures are provided along with cryptographic randomness tests. CryptRndTest utilizes multiple precision floating numbers for sequences longer than …

Clustering.Sc.Dp: Optimal Clustering With Sequential Constraint By Using Dynamic Programming, Tibor Szkaliczki

The R Journal

The general clustering algorithms do not guarantee optimality because of the hardness of the problem. Polynomial-time methods can find the clustering corresponding to the exact optimum only in special cases. For example, the dynamic programming algorithm can solve the one-dimensional clustering problem, i.e., when the items to be clustered can be characterised by only one scalar number. Optimal one-dimensional clustering is provided by package Ckmeans.1d.dp in R. The paper shows a possible generalisation of the method implemented in this package to multidimensional data: the dynamic programming method can be applied to find the optimum clustering of vectors when only subsequent …

Fwdselect: An R Package For Variable Selection In Regression Models, Marta Sestelo, Nora M. Villanueva, Luis Meira-Machado, Javier Roca-Pardiñas

The R Journal

In multiple regression models, when there are a large number (p) of explanatory variables which may o rmay not be relevant for predicting the response, it is useful to be able to reduce the model. To this end, it is necessary to determine the best subset of q (q p) predictors which will establish the model with the best prediction capacity. FWDselect package introduces a new forward stepwise based selection procedure to select the best model in different regression frameworks (parametric or nonparametric). The developed methodology, which can be equally applied to linear models, generalized linear models or generalized additive …

News From The Bioconductor Project, Bioconductor Team

The R Journal

The Bioconductor project provides tools for the analysis and comprehension of high throughput genomic data. The 1211 software packages available in Bioconductor can be viewed at http://bioconductor.org/packages/. Navigate packages using ‘biocViews’ terms and title search. Each package has an html page with a description, links to vignettes, reference manuals, and usage statistics. Start using Bioconductor version 3.3 by installing R 3.3.1 and evaluating the commands

R Packages To Aid In Handling Web Access Logs, Oliver Keyes, Bob Rudis, Jay Jacobs

The R Journal

Web access logs contain information on HTTP(S) requests and form a key part of both industry and academic explorations of human behaviour on the internet. But the preparation (reading, parsing and manipulation) of that data is just unique enough to make generalized tools unfit for the task, both in programming time and processing time which are compounded when dealing with large data sets common with web access logs. In this paper we explain and demonstrate a series of packages designed to efficiently read in, parse and munge access log data, allowing researchers to handle URLs and IP addresses easily. These …

An Interactive Survey Application For Validating Social Network Analysis Techniques, Mitchell Joblin, Wolfgang Mauerer

The R Journal

Social network analysis is extremely well supported by the R community and is routinely used for studying the relationships between people engaged in collaborative activities. While there has been rapid development of new approaches and metrics in this field, the challenging question of validity (how well insights derived from social networks agree with reality) is often difficult to address. We propose the use of several R packages to generate interactive surveys that are specifically well suited for validating social network analyses. Using our web-based survey application, we were able to validate the results of applying community-detection algorithms to infer the …

Conference Report: User! 2016, Joe Rickert

The R Journal

The 12th international R user conference, useR! 2016, took place at Stanford University, Stanford CA fromJune27throughJune30th. Hosted by the Stanford University Department of Statistics and the Stanford Libraries, the conference took place at the Frances Arrillaga Alumni Center, on the surrounding lawns and in several adjacent buildings. The floor to ceiling windows of the larger conference rooms, the garden locations for coffee and meals and the beautiful weather contributed to making the event a classic California experience.

Schemaonread: A Package For Schema-On-Read In R, Michael J. North

The R Journal

SchemaOnRead is a CRAN package that provides an extensible mechanism for importing a wide range of file types into R as well as support for the emerging schema-on-read paradigm in R. The schema-on-read tools within the package include a single function call that recursively reads folders with text, comma separated value, raster image, R data, HDF5, NetCDF, spreadsheet, Weka, Epi Info, Pajek network, R network, HTML, SPSS, Systat, and Stata files. It also recursively reads folders (e.g., schemaOnRead("folder")), returning a nested list of the contained elements. The provided tools can be used as-is or easily customized to implement tool chains …

Keyplayer: An R Package For Locating Key Players In Social Networks, Weihua An, Yu-Hsin Liu

The R Journal

Interest in social network analysis has exploded in the past few years, partly thanks to the advancements in statistical methods and computing for network analysis. A wide range of the methods for network analysis is already covered by existent R packages. However, no comprehensive packages are available to calculate group centrality scores and to identify key players (i.e., those players who constitute the most central group) in a network. These functionalities are important because, for example, many social and health interventions rely on key players to facilitate the intervention. Identifying key players is challenging because players who are individually the …

Rtableicc: An R Package For Random Generation Of 22k And Rc Contingency Tables, Haydar Demirhan

The R Journal

In this paper, we describe the R package rTableICC that provides an interface for random generation of 2 2 K and R Ccontingency tables constructed over either intraclass-correlated or uncorrelated individuals. Intraclass correlations arise in studies where sampling units include more than one individual and these individuals are correlated. The package implements random generation of contingency tables over individuals with or without intraclass correlations under various sampling plans. The package include two functions for the generation of K 2 2 tables over product-multinomial sampling schemes and that of 2 2 K tables under Poisson or multinomial sampling plans. It also …

Crowdsourced Data Preprocessing With R And Amazon Mechanical Turk, Thomas J. Leeper

The R Journal

This article introduces the use of the Amazon Mechanical Turk (MTurk) crowdsourcing platform as a resource for R users to leverage crowdsourced human intelligence for preprocessing “messy” data into a form easily analyzed within R. The article first describes MTurk and the MTurkR package, then outlines how to use MTurkR to gather and manage crowdsourced data with MTurk using some of the package’s core functionality. Potential applications of MTurkR include construction of manually coded training sets, human transcription and translation, manual data scraping from scanned documents, content analysis, image classification, and the completion of online survey questionnaires, among others. As …

Exploring Interaction Effects In Two-Factor Studies Using The Hiddenf Package In R., Christopher Franck, Jason A. Osborne

The R Journal

In crossed, two-factor studies with one observation per factor-level combination, interaction effects between factors can be hard to detect and can make the choice of a suitable statistical model difficult. This article describes hiddenf, an R package that enables users to quantify and characterize a certain form of interaction in two-factor layouts. When effects of one factor (a) fall into two groups depending on the level of another factor, and (b) are constant within these groups, the interaction pattern is deemed "hidden additivity" because within groups, the effects of the two factors are additive, while between groups the factors …

Gmdh: An R Package For Short Term Forecasting Via Gmdh-Type Neural Network Algorithms, Osman Dag, Ceylan Yozgatligil

The R Journal

Group Method of Data Handling (GMDH)-type neural network algorithms are the heuristic self organization method for the modelling of complex systems. GMDH algorithms are utilized for a variety of purposes, examples include identification of physical laws, the extrapolation of physical fields, pattern recognition, clustering, the approximation of multidimensional processes, forecasting without models, etc. In this study, the R package GMDH is presented to make short term forecasting through GMDH-type neural network algorithms. The GMDH package has options to use different transfer functions (sigmoid, radial basis, polynomial, and tangent functions) simultaneously or separately. Data on cancer death rate of Pennsylvania from …

The R Journal (August 2016) 8(1): Complete Issue, The R Foundation

The R Journal

Editorial, Michael Lawrence

Contributed Research Articles

metaplus: An R Package for the Analysis of Robust Meta-Analysis and Meta-Regression, Ken J. Beath

Gender Prediction Methods Based on First Names with genderizeR, Kamil Wais

Conditional Fractional Gaussian Fields with the Package FieldSim, Alexandre Brouste, Jacques Istas, and Sophie Lambert-Lacroix

rTableICC: An R Package for Random Generation of 22K and RC Contingency Tables, Haydar Demirhan

Maps, Coordinate Reference Systems and Visualising Geographic Data with mapmisc, Patrick E. Brown

Variable Clustering in High-Dimensional Linear Regression: The R Package clere, Loïc Yengo, Julien Jacques, Christophe Biernacki, and Mickael Canouil

Stylometry with R: A Package for …

Ε-Kernel Coresets For Stochastic Points, Haitao Wang, Lingxiao Huang, Jian Li, Jeff Mark Phillips

Computer Science Faculty and Staff Publications

With the dramatic growth in the number of application domains that generate probabilistic, noisy and uncertain data, there has been an increasing interest in designing algorithms for geometric or combinatorial optimization problems over such data. In this paper, we initiate the study of constructing epsilon-kernel coresets for uncertain points. We consider uncertainty in the existential model where each point's location is fixed but only occurs with a certain probability, and the locational model where each point has a probability distribution describing its location. An epsilon-kernel coreset approximates the width of a point set in any direction. We consider approximating the …

Comparison Of Experimental And Theoretical Fully Differential Cross Sections For Single Ionization Of The 2s And 2p States Of Li By O⁸⁺ Ions, Ebrahim Ghanbari-Adivi, Daniel Fischer, Natalia Ferreira, Johannes Goullon, Renate Hubele, Aaron Laforge, Michael Schulz, Don H. Madison

Physics Faculty Research & Creative Works

This paper presents a full three-dimensional (3D) comparison between experiment and theory for 24 MeV O⁸⁺ single ionization of the 2s ground state of lithium and the 2p excited state. Two theoretical approximations are examined: the three-body continuum distorted-wave (3DW) and three-body continuum distorted-wave-eikonal initial state (3DW-EIS). Normally, there is a significant difference between these two approaches and the 3DW-EIS is in much better agreement with experiment. In this case, there is very little difference between the two approaches and both are in very good agreement with experiment. For the excited 2p state, the 3D cross sections would exhibit …

Contact Process With Temporal Disorder, Hatem Barghathi, Thomas Vojta, José A. Hoyos

Physics Faculty Research & Creative Works

We investigate the influence of time-varying environmental noise, i.e., temporal disorder, on the nonequilibrium phase transition of the contact process. Combining a real-time renormalization group, scaling theory, and large scale Monte-Carlo simulations in one and two dimensions, we show that the temporal disorder gives rise to an exotic critical point. At criticality, the effective noise amplitude diverges with increasing time scale, and the probability distribution of the density becomes infinitely broad, even on a logarithmic scale. Moreover, the average density and survival probability decay only logarithmically with time. This infinite-noise critical behavior can be understood as the temporal counterpart of …

An Algorithm For The Machine Calculation Of Minimal Paths, Robert Whitinger

Electronic Theses and Dissertations

Problems involving the minimization of functionals date back to antiquity. The mathematics of the calculus of variations has provided a framework for the analytical solution of a limited class of such problems. This paper describes a numerical approximation technique for obtaining machine solutions to minimal path problems. It is shown that this technique is applicable not only to the common case of finding geodesics on parameterized surfaces in R³, but also to the general case of finding minimal functionals on hypersurfaces in Rⁿ associated with an arbitrary metric.

Singapore In Motion: Insights On Public Transport Service Level Through Farecard And Mobile Data Analytics, Hasan Poonawala, Vinay Kolar, Sebastien Blandin, Laura Wynter, Sambit Sahu

Research Collection School Of Computing and Information Systems

Given the changing dynamics of mobility patterns and rapid growth of cities, transport agencies seek to respond more rapidly to needs of the public with the goal of offering an effective and competitive public transport system. A more data-centric approach for transport planning is part of the evolution of this process. In particular, the vast penetration of mobile phones provides an opportunity to monitor and derive insights on transport usage. Real time and historical analyses of such data can give a detailed understanding of mobility patterns of people and also suggest improvements to current transit systems. On its own, however, …

Unsupervised Multi-Graph Cross-Modal Hashing For Large-Scale Multimedia Retrieval, Liang Xie, Lei Zhu, Guoqi Chen

Research Collection School Of Computing and Information Systems

With the advance of internet and multimedia technologies, large-scale multi-modal representation techniques such as cross-modal hashing, are increasingly demanded for multimedia retrieval. In cross-modal hashing, three essential problems should be seriously considered. The first is that effective cross-modal relationship should be learned from training data with scarce label information. The second is that appropriate weights should be assigned for different modalities to reflect their importance. The last is the scalability of training process which is usually ignored by previous methods. In this paper, we propose Multi-graph Cross-modal Hashing (MGCMH) by comprehensively considering these three points. MGCMH is unsupervised method which …

Probabilistic Robust Route Recovery With Spatio-Temporal Dynamics, Hao Wu, Jiangyun Mao, Weiwei Sun, Baihua Zheng, Hanyuan Zhang, Ziyang Chen, Wei Wang

Research Collection School Of Computing and Information Systems

Vehicle trajectories are one of the most important data in location-based services. The quality of trajectories directly affects the services. However, in the real applications, trajectory data are not always sampled densely. In this paper, we study the problem of recovering the entire route between two distant consecutive locations in a trajectory. Most existing works solve the problem without using those informative historical data or solve it in an empirical way. We claim that a data-driven and probabilistic approach is actually more suitable as long as data sparsity can be well handled. We propose a novel route recovery system in …