Open Access. Powered by Scholars. Published by Universities.®

Physical Sciences and Mathematics Commons

Open Access. Powered by Scholars. Published by Universities.®

City University of New York (CUNY)

Mathematics

Orthogonal regression

Publication Year

Articles 1 - 6 of 6

Full-Text Articles in Physical Sciences and Mathematics

Generalized Least-Powers Regressions I: Bivariate Regressions, Nataniel Greene Nov 2016

Generalized Least-Powers Regressions I: Bivariate Regressions, Nataniel Greene

Publications and Research

The bivariate theory of generalized least-squares is extended here to least-powers. The bivariate generalized least-powers problem of order p seeks a line which minimizes the average generalized mean of the absolute pth power deviations between the data and the line. Least-squares regressions utilize second order moments of the data to construct the regression line whereas least-powers regressions use moments of order p to construct the line. The focus is on even values of p, since this case admits analytic solution methods for the regression coefficients. A numerical example shows generalized least-powers methods performing comparably to generalized least-squares methods, …


Generalized Least-Squares Regressions V: Multiple Variables, Nataniel Greene Mar 2015

Generalized Least-Squares Regressions V: Multiple Variables, Nataniel Greene

Publications and Research

The multivariate theory of generalized least-squares is formulated here using the notion of generalized means. The multivariate generalized least-squares problem seeks an m dimensional hyperplane which minimizes the average generalized mean of the square deviations between the data and the hyperplane in m + 1 variables. The numerical examples presented suggest that a multivariate generalized least-squares method can be preferable to ordinary least-squares especially in situations where the data are ill- conditioned.


Generalized Least-Squares Regressions Iv: Theory And Classification Using Generalized Means, Nataniel Greene Sep 2014

Generalized Least-Squares Regressions Iv: Theory And Classification Using Generalized Means, Nataniel Greene

Publications and Research

The theory of generalized least-squares is reformulated here using the notion of generalized means. The generalized least-squares problem seeks a line which minimizes the average generalized mean of the square deviations in x and y. The notion of a generalized mean is equivalent to the generating function concept of the previous papers but allows for a more robust understanding and has an already existing literature. Generalized means are applied to the task of constructing more examples, simplifying the theory, and further classifying generalized least-squares regressions.


Generalized Least-Squares Regressions Iii: Further Theory And Classification, Nataniel Greene Jan 2014

Generalized Least-Squares Regressions Iii: Further Theory And Classification, Nataniel Greene

Publications and Research

This paper continues the work of this series with two results. The first is an exponential equivalence theorem which states that every generalized least-squares regression line can be generated by an equivalent exponential regression. It follows that every generalized least-squares line has an effective normalized exponential parameter between 0 and 1 which classifies the line on the spectrum between ordinary least-squares and the extremal line for a given set of data. The second result is the presentation of fundamental formulas for the generalized least-squares slope and y-intercept.


Generalized Least-Squares Regressions I: Efficient Derivations, Nataniel Greene Jan 2013

Generalized Least-Squares Regressions I: Efficient Derivations, Nataniel Greene

Publications and Research

Ordinary least-squares regression suffers from a fundamental lack of symmetry: the regression line of y given x and the regression line of x given y are not inverses of each other. Alternative symmetric regression methods have been developed to address this concern, notably: orthogonal regression and geometric mean regression. This paper presents in detail a variety of least squares regression methods which may not have been known or fully explicated. The derivation of each method is made efficient through the use of Ehrenberg's formula for the ordinary least-squares error and through the extraction of a weight function g(b) which characterizes …


Generalized Least-Squares Regressions Ii: Theory And Classification, Nataniel Greene Jan 2013

Generalized Least-Squares Regressions Ii: Theory And Classification, Nataniel Greene

Publications and Research

In the first paper of this series, a variety of known and new symmetric and weighted least-squares regression methods were presented with efficient derivations. This paper continues and generalizes the previous work with a theory for deriving, analyzing, and classifying all symmetric and weighted least-squares regression methods.