Statistical Models Commons^™

Measuring Security: A Challenge For The Generation, Janusz Zalewski, Steven Drager, William Mckeever, Andrew J. Kornecki

Department of Electrical Engineering and Computer Science - Daytona Beach

This paper presents an approach to measuring computer security understood as a system property, in the category of similar properties, such as safety, reliability, dependability, resilience, etc. First, a historical discussion of measurements is presented, beginning with views of Hermann von Helmholtz in his 19th century work “Zählen und Messen”. Then, contemporary approaches related to the principles of measuring software properties are discussed, with emphasis on statistical, physical and software models. A distinction between metrics and measures is made to clarify the concepts. A brief overview of inadequacies of methods and techniques to evaluate computer security is presented, followed by …

Exponentially Weighted Moving Average Charts For Monitoring The Process Generalized Variance, Anna Khamitova

College of Graduate Studies: Theses & Dissertations

The exponentially weighted moving average chart based on the sample generalized variance is studied under the independent multivariate normal model for the vector of quality measurements. The performance of the chart is based on an analysis of the chart's initial and steady-state run length distributions. The three methods that are commonly used to determinate run length distribution, simulation, the integral equation method, and the Markov chain approximation are discussed. The integral equation and Markov chain approaches are analytical methods that require a nu- merical method for determining the probability density and cumulative distribution functions describing the distribution of the sample …

Normal Mixture And Contaminated Model With Nuisance Parameter And Applications, Qian Fan

Theses and Dissertations--Statistics

This paper intend to find the proper hypothesis and test statistic for testing existence of bilaterally contamination when there exists nuisance parameter. The test statistic is based on method of moments estimators. Union-Intersection test is used for testing if the distribution of population can be implemented by a bilaterally contaminated normal model with unknown variance. This paper also developed a hierarchical normal mixture model (HNM) and applied it to birth weight data. EM algorithm is employed for parameter estimation and a singular Bayesian information criterion (sBIC) is applied to choose the number components. We also proposed a singular flexible information …

Scalable Collaborative Filtering Recommendation Algorithms On Apache Spark, Walker Evan Casey

CMC Senior Theses

Collaborative filtering based recommender systems use information about a user's preferences to make personalized predictions about content, such as topics, people, or products, that they might find relevant. As the volume of accessible information and active users on the Internet continues to grow, it becomes increasingly difficult to compute recommendations quickly and accurately over a large dataset. In this study, we will introduce an algorithmic framework built on top of Apache Spark for parallel computation of the neighborhood-based collaborative filtering problem, which allows the algorithm to scale linearly with a growing number of users. We also investigate several different variants …

An Investigation Of Sensitivity Of An F Test In Locating Change Points In Linear Regression, Jing Sun

College of Graduate Studies: Theses & Dissertations

Change point is a statistic phenomenon, which has many direct applications in climatology, bioinformatics, finance, oceanography and medical imaging. In this thesis, we investigate the sensitivity of the F-test for detecting change points in linear regression, using a two-phase linear regression model. it offers an effective method to detect "undocumented" change points using a form of an F-test. Using simulated data, we explore its sensitivity and accuracy with respect t different parameters in the model.

A Bayesian Model Of Fertility Decisions In Relationship To Female Labor Force Participation, Rebecca C. Wardrop

Senior Independent Study Theses

Due to the increasing number of women in the labor force, opportunity costs associated with labor force participation are becoming an important factor in fertility decisions. Further, these decisions are assumed to be dynamic as the opportunity costs change as a woman progresses through her career. A Bayesian statistical model , which allows the distribution of the likelihood of having children to be updated as information is gathered, lends itself to the dynamicity of the decision-making process. A generalized model for fertility decisions in terms of labor force participation is created. I also discuss potentials for implementation and furthering the …

Modelling And Analysis On Noisy Financial Time Series, Jinsong Leng

Research outputs 2014 to 2021

Building the prediction model(s) from the historical time series has attracted many researchers in last few decades. For example, the traders of hedge funds and experts in agriculture are demanding the precise models to make the prediction of the possible trends and cycles. Even though many statistical or machine learning (ML) models have been proposed, however, there are no universal solutions available to resolve such particular prob-lem. In this paper, the powerful forward-backward non-linear filter and wavelet-based denoising method are introduced to remove the high level of noise embedded in financial time series. With the filtered time series, the statistical …

Hierarchical Graphical Bayesian Models In Psychology, Guillermo Campitelli, Guillermo Macbeth

Research outputs 2014 to 2021

The improvement of graphical methods in psychological research can promote their use and a better comprehension of their expressive power. The application of hierarchical Bayesian graphical models has recently become more frequent in psychological research. The aim of this contribution is to introduce suggestions for the improvement of hierarchical Bayesian graphical models in psychology. This novel set of suggestions stems from the description and comparison between two main approaches concerned with the use of plate notation and distribution pictograms. It is concluded that the combination of relevant aspects of both models might improve the use of powerful hierarchical Bayesian graphical …

Adjusted Tornado Probabilities, Holly M. Widen, James B. Elsner, Cameron Amrine, Rizalino B. Cruz, Erik Fraza, Laura Michaels, Loury Migliorelli, Brendan Mulholland, Michael Patterson, Sarah Strazzo, Guang Xing

Publications

Tornado occurrence rates computed from the available reports are biased low relative to the unknown true rates. To correct for this low bias, the authors demonstrate a method to estimate the annual probability of being struck by a tornado that uses the average report density estimated as a function of distance from nearest city/town center. The method is demonstrated on Kansas and then applied to 15 other tornado-prone states from Nebraska to Tennessee. States are ranked according to their adjusted tornado rate and comparisons are made with raw rates published elsewhere. The adjusted rates, expressed as return periods, arestates, including …

Short-Term Inflation Forecasting Models For Nigeria, Sani I. Doguwa, Sarah O. Alade

CBN Journal of Applied Statistics (JAS)

Short-term inflation forecasting is an essential component of the monetary policy projections at the Central Bank of Nigeria. This paper proposes four short-term headline inflation forecasting models using the SARIMA and SARIMAX processes and compares their performance using the pseudo-out-of-sample forecasting procedure over July 2011 to September 2013. According to the results the best forecasting performance is demonstrated by the model based on the all items CPI estimated using the SARIMAX model. This model is, therefore, recommended for use in short-term forecasting of headline inflation in Nigeria. The forecasting performance up to eight months ahead, of the models based on …

An Efficient Two Sample Capture-Recapture Model With High Recaptures, Danjuma Jibasen, Yusuf J. Adams

CBN Journal of Applied Statistics (JAS)

This paper proposed an efficient two sample capture-recapture model (Ma) with high recaptures and compared it with the existing models like the model of no factor effect (Mo), behavioral response model (Mb) and the Petersen model (Ms), using simulated data. We found that the Petersen model provides a better estimate of the population size when the observations follow a hypergeometric distribution and the population is overestimated when recapture is high. It was also found that the proposed model provides a better estimator of the population size than the existing ones when the recapture is high. This model is particularly useful …

Causal Relationship Between Stock Market Index And Exchange Rate: Evidence From Nigeria, Abdulrasheed Zubair

CBN Journal of Applied Statistics (JAS)

This paper uses Johansen’s cointegration to test for the possibility of cointegration and Granger-causality to estimate the causal relationship between stock market index and monetary indicators (exchange rate and M2) before and during the global financial crisis for Nigeria, using monthly data for the period 2001–2011. Results suggest absence of long-run relationship before and during the crisis. The Granger-causality tests show a uni-directional causality running from M2 to ASI before the crisis while during the period of the crisis there is absence of causality between the variables. This suggests that ASI show responsiveness to M2. Thus, absence of the direct …

Investigating Chaos In The Nigerian Asset And Resource Management (Arm) Discovery Fund, Ibiyinka A. Fuwape, Samuel T. Ogunjo

CBN Journal of Applied Statistics (JAS)

This paper investigates chaos in a Nigerian mutual fund, Asset and Resource Management Company Limited (ARM) for a period of eleven years. The existence of chaotic signals in the data was identified by the reconstruction of the phase space of the daily closing price of the fund and the delay time was quantified using mutual information function and the embedding dimension by the false nearest neighbours, where the values were identified to be 15 and 20 respectively. The presence of chaotic signals in the ARM data was further confirmed by the correlation dimension method which yielded a dimension of 2.2 …

Modeling The Nigerian Inflation Rates Using Periodogram And Fourier Series Analysis, Chukwuemeka O. Omekara,, Emmanuel J. Ekpenyong, Micheal P. Ekerete

CBN Journal of Applied Statistics (JAS)

This work considers the application of Periodogram and Fourier Series Analysis to model all-items monthly inflation rates in Nigeria from 2003 to 2011. The main objectives are to identify inflation cycles, fit a suitable model to the data and make forecasts of future values. To achieve these objectives, monthly all-items inflation rates for the period were obtained from the Central Bank of Nigeria (CBN) website. Periodogram and Fourier series methods of analysis are used to analyze the data. Based on the analysis, it was found that inflation cycle within the period was fifty one (51) months, which coincides with the …

Nigerian Stock Index: A Search For Optimal Garch Model Using High Frequency Data, Olaoluwa Simon Yaya

CBN Journal of Applied Statistics (JAS)

This paper attempts to fit the best Generalized Autoregressive Conditional Heteroscedastic (GARCH) model for All Share Index (ASI) of Nigerian Stock Exchange (NSE) returns. A search is made on various GARCH variants specified on the assumptions of stationarity and asymmetry. Fractionally integrated types are also considered to capture the possibility of return series having property of long range dependency. The parameter estimations are carried out on the assumptions of normality and non-normality of GARCH innovations, with models and forecasts evaluated using information criteria and loss functions respectively. Under normality assumption, Hyperbolic GARCH (HYGARCH(1,d,1)) model is selected and Integrated GARCH (IGARCH(1,1)) …

Time Series Modeling Of Nigeria External Reserves, Iheanyichukwu S. Iwueze, Eleazar C. Nwogu, Valentine U. Nlebedim

CBN Journal of Applied Statistics (JAS)

This paper discusses the levels and trend of external reserves in Nigeria. The relevance of this lies in the fact that it could help to monitor the reserves and throw early warning signal about any economic crisis. Monthly data on Nigeria external reserves for the period January 1999 to December, 2008 derived from the 2008 CBN Statistical Bulletin was analyzed using ARIMA model. Results of the analyses show that (i) the data requires logarithmic transformation to stabilize the variance and make the distribution normal (ii) the appropriate model that best describes the pattern in the transformed data is the Autoregressive- …

A Markov Decision Process Approach To Optimal Control Of A Multi-Level Hierarchical Manpower System, Akaninyene U. Udom

CBN Journal of Applied Statistics (JAS)

A recurrent problem in manpower control is how to attain the desired structural configuration in an optimal way, since it is possible to reach a desired structural configuration using different control inputs. The major aim of this paper is to develop a Markov Decision Process for optimal control of a Multi-level Hierarchical Manpower System (MHMS) by promotion and interdepartmental transfers. This is examined under control by intervention and contraction cost Markov Decision Process.

Estimation And Inference For Spatial And Spatio-Temporal Mixed Effects Models, Casey M. Jelsema

Dissertations

One of the most common goals of geostatistical analysis is that of spatial prediction, in other words: filling in the blank areas of the map. There are two popular methods for accomplishing spatial prediction. Either kriging, or Bayesian hierarchical models. Both methods require the inverse of the spatial covariance matrix of the data. As the sample size, n, becomes large, both of these methods become impractical. Reduced rank spatial models (RRSM) allow prediction on massive datasets without compromising the complexity of the spatial process. This dissertation focuses on RRSMs, particularly situations where the data follow non-Gaussian distributions.

The manner in …

Observed Versus Gcm-Generated Local Tropical Cyclone Frequency: Comparisons Using A Spatial Lattice, Sarah Strazzo, Daniel J. Halperin, James Elsner, Tim Larow, Ming Zhao

Publications

Of broad scientific and public interest is the reliability of global climate models (GCMs) to simulate future regional and local tropical cyclone (TC) occurrences. Atmospheric GCMs are now able to generate vortices resembling actual TCs, but questions remain about their fidelity to observed TCs. Here the authors demonstrate a spatial lattice approach for comparing actual with simulated TC occurrences regionally using observed TCs from the International Best Track Archive for Climate Stewardship (IBTrACS) dataset and GCM-generated TCs from the Geophysical Fluid Dynamics Laboratory (GFDL) High Resolution Atmospheric Model (HiRAM) and Florida State University (FSU) Center for Ocean–Atmospheric Prediction Studies (COAPS) …

Data Analysis Using Regression Modeling: Visual Display And Setup Of Simple And Complex Statistical Models, Emil N. Coman, Maria A. Coman, Eugen Iordache, Russell Barbour, Lisa Dierker

Yale Day of Data

We present visual modeling solutions for testing simple and more advanced statistical hypotheses in any research field. All models can be directly specified in analytical software like Mplus or R.

Data analysis in any substantive field can be easily accomplished by translating statistical tests in the intuitive language of regression-based path diagrams with observed and unobserved variables. All models we presented can be directly specified and estimated in analytical software.

Students can particularly benefit from being taught the simple regression modeling setup of the path analytical method, as it empowers them to apply the techniques to any data to test …

Net Reclassification Index: A Misleading Measure Of Prediction Improvement, Margaret Sullivan Pepe, Holly Janes, Kathleen F. Kerr, Bruce M. Psaty

UW Biostatistics Working Paper Series

The evaluation of biomarkers to improve risk prediction is a common theme in modern research. Since its introduction in 2008, the net reclassification index (NRI) (Pencina et al. 2008, Pencina et al. 2011) has gained widespread use as a measure of prediction performance with over 1,200 citations as of June 30, 2013. The NRI is considered by some to be more sensitive to clinically important changes in risk than the traditional change in the AUC (Delta AUC) statistic (Hlatky et al. 2009). Recent statistical research has raised questions, however, about the validity of conclusions based on the NRI. (Hilden and …

Bayesian And Classical Regression Models Inference When The Errors Follow Skewed Distributions, Ebtisam Karim Abdulah

Theses and Dissertations

The Gamma distribution is one of the most popular distributions for reliability and lifetime data and can be used effectively in analyzing positive skewed data. In real life applications, analysts might wish to have distributions for analyzing positive and negative skewed data, therefore, in this century, we have seen a good attention for fitting data using skew distributions, because it allows continuous variations from symmetric to non-symmetric. Some empirical data, especially, finance (prices and returns) and environmental data have peak distributions and involve tail behavior which affects the model assumptions. In this dissertation, we extend two of the symmetric distributions, …

Sensitivity Of Limiting Hurricane Intensity To Sst In The Atlantic From Observations And Gcms, James Elsner, Sarah Strazzo, Thomas H. Jagger, Timothy Larow, Ming Zhao

Publications

No abstract provided.

Frequency, Intensity, And Sensitivity To Sea Surface Temperature Of North Atlantic Tropical Cyclones In Best-Track And Simulated Data, Sarah Strazzo, James B. Elsner, Jill C. Trepanier, Kerry A. Emanuel

Publications

Synthetic hurricane track data generated from a downscaling approach are compared to best-track (observed) data to analyze differences in regional frequency, intensity, and sensitivity of limiting intensity to sea surface temperature (SST). Overall, the spatial distributions of observed and simulated hurricane counts match well, although there are relatively fewer synthetic storms in the eastern quarter of the basin. Additionally, regions of intense synthetic hurricanes tend to coincide with regions of intense observed hurricanes. The sensitivity of limiting hurricane intensity to SST computed from synthetic data is slightly lower than sensitivity computed from observed data (5.561.31 m s21 (standard error, SE) …

Attributing Effects To Interactions, Tyler J. Vanderweele, Eric J. Tchetgen Tchetgen

Harvard University Biostatistics Working Paper Series

A framework is presented which allows an investigator to estimate the portion of the effect of one exposure that is attributable to an interaction with a second exposure. We show that when the two exposures are independent, the total effect of one exposure can be decomposed into a conditional effect of that exposure and a component due to interaction. The decomposition applies on difference or ratio scales. We discuss how the components can be estimated using standard regression models, and how these components can be used to evaluate the proportion of the total effect of the primary exposure attributable to …

Stochastic Dea With A Perfect Object And Its Application To Analysis Of Environmental Efficiency, Alexander Vaninsky

Publications and Research

The paper introduces stochastic DEA with a Perfect Object (SDEA PO). The Perfect Object (PO) is a virtual Decision Making Unit (DMU) that has the smallest inputs and greatest outputs. Including the PO in a collection of actual objects yields an explicit formula of the efficiency index. Given the distributions of DEA inputs and outputs, this formula allows us to derive the probability distribution of the efficiency score, to find its mathematical expectation, and to deliver common (group–related) and partial (object-related) efficiency components. We apply this approach to a prospective analysis of environmental efficiency of the major national and regional …

Statistical Inference For Data Adaptive Target Parameters, Mark J. Van Der Laan, Alan E. Hubbard, Sara Kherad Pajouh

U.C. Berkeley Division of Biostatistics Working Paper Series

Consider one observes n i.i.d. copies of a random variable with a probability distribution that is known to be an element of a particular statistical model. In order to define our statistical target we partition the sample in V equal size sub-samples, and use this partitioning to define V splits in estimation-sample (one of the V subsamples) and corresponding complementary parameter-generating sample that is used to generate a target parameter. For each of the V parameter-generating samples, we apply an algorithm that maps the sample in a target parameter mapping which represent the statistical target parameter generated by that parameter-generating …

A Robust Estimate For The Bifurcating Autoregressive Model With Application To Cell Lineage Data, Tamer M. E. Elbayoumi

Dissertations

The bifurcating autoregressive model (BAR) is commonly used to model binary tree data. One application for this model relates to cell lineage data in biology. The purpose of studying the cell lineage process is to know whether the observed correlations between related cells are due to similarities in the environmental, inherited effects, or a combination of both of them. Because outliers in this kind of data are quite common, the need for a robust estimation procedure is necessary. A weighted L1 (WL1) estimate for estimating the parameters of the BAR model is considered. When the weights are constant, the estimate …

Iterative Statistical Verification Of Probabilistic Plans, Colin M. Potts

Lawrence University Honors Projects

Artificial intelligence seeks to create intelligent agents. An agent can be anything: an autopilot, a self-driving car, a robot, a person, or even an anti-virus system. While the current state-of-the-art may not achieve intelligence (a rather dubious thing to quantify) it certainly achieves a sense of autonomy. A key aspect of an autonomous system is its ability to maintain and guarantee safety—defined as avoiding some set of undesired outcomes. The piece of software responsible for this is called a planner, which is essentially an automated problem solver. An advantage computer planners have over humans is their ability to consider and …

Targeted Maximum Likelihood Estimation For Dynamic And Static Longitudinal Marginal Structural Working Models, Maya L. Petersen, Joshua Schwab, Susan Gruber, Nello Blaser, Michael Schomaker, Mark J. Van Der Laan

U.C. Berkeley Division of Biostatistics Working Paper Series

This paper describes a targeted maximum likelihood estimator (TMLE) for the parameters of longitudinal static and dynamic marginal structural models. We consider a longitudinal data structure consisting of baseline covariates, time-dependent intervention nodes, intermediate time-dependent covariates, and a possibly time dependent outcome. The intervention nodes at each time point can include a binary treatment as well as a right-censoring indicator. Given a class of dynamic or static interventions, a marginal structural model is used to model the mean of the intervention specific counterfactual outcome as a function of the intervention, time point, and possibly a subset of baseline covariates. Because …