Tests for Differences Between Least Squares and Robust Regression Parameter Estimates and Related Topics


Book Description

At the present time there is no well accepted test for comparing least squares and robust linear regression coefficient estimates. To fill this gap we propose and demonstrate the efficacy of two Wald-like statistical tests for the above purposes, using for robust regression the class of MM-estimators. The tests are designed to detect significant differences between least squares and robust estimates due to both inefficiency of least squares under fat-tailed non-normality and significantly larger biases of least squares relative to robust regression coefficient estimators under bias inducing distributions. The asymptotic normality of the test statistics is established and the finite sample level and power of the tests are evaluated by Monte Carlo, with the latter yielding promising results. The first part of our research focuses on the LS and robust regression slope estimators, both of which are consistent under skewed error distributions. A second part of the research focuses on intercept estimation, in which case there is a need to adjust for some bias in the robust MM-intercept estimator under skewed error distributions. An interesting by-product of our research is that use of the slowly re-descending Tukey bisquare loss function leads to better test performance than the rapidly re-descending min-max bias optimal loss function.




Modern Methods for Robust Regression


Book Description

Modern Methods for Robust Regression offers a brief but in-depth treatment of various methods for detecting and properly handling influential cases in regression analysis. This volume, geared toward both future and practicing social scientists, is unique in that it takes an applied approach and offers readers empirical examples to illustrate key concepts. It is ideal for readers who are interested in the issues related to outliers and influential cases. Key Features Defines key terms necessary to understanding the robustness of an estimator: Because they form the basis of robust regression techniques, the book also deals with various measures of location and scale. Addresses the robustness of validity and efficiency: After having described the robustness of validity for an estimator, the author discusses its efficiency. Focuses on the impact of outliers: The book compares the robustness of a wide variety of estimators that attempt to limit the influence of unusual observations. Gives an overview of some traditional techniques: Both formal statistical tests and graphical methods detect influential cases in the general linear model. Offers a Web appendix: This volume provides readers with the data and the R code for the examples used in the book. Intended Audience This is an excellent text for intermediate and advanced Quantitative Methods and Statistics courses offered at the graduate level across the social sciences.




Alternative Methods of Regression


Book Description

Of related interest. Nonlinear Regression Analysis and its Applications Douglas M. Bates and Donald G. Watts ".an extraordinary presentation of concepts and methods concerning the use and analysis of nonlinear regression models.highly recommend[ed].for anyone needing to use and/or understand issues concerning the analysis of nonlinear regression models." --Technometrics This book provides a balance between theory and practice supported by extensive displays of instructive geometrical constructs. Numerous in-depth case studies illustrate the use of nonlinear regression analysis--with all data sets real. Topics include: multi-response parameter estimation; models defined by systems of differential equations; and improved methods for presenting inferential results of nonlinear analysis. 1988 (0-471-81643-4) 365 pp. Nonlinear Regression G. A. F. Seber and C. J. Wild ".[a] comprehensive and scholarly work.impressively thorough with attention given to every aspect of the modeling process." --Short Book Reviews of the International Statistical Institute In this introduction to nonlinear modeling, the authors examine a wide range of estimation techniques including least squares, quasi-likelihood, and Bayesian methods, and discuss some of the problems associated with estimation. The book presents new and important material relating to the concept of curvature and its growing role in statistical inference. It also covers three useful classes of models --growth, compartmental, and multiphase --and emphasizes the limitations involved in fitting these models. Packed with examples and graphs, it offers statisticians, statistical consultants, and statistically oriented research scientists up-to-date access to their fields. 1989 (0-471-61760-1) 768 pp. Mathematical Programming in Statistics T. S. Arthanari and Yadolah Dodge "The authors have achieved their stated intention.in an outstanding and useful manner for both students and researchers.Contains a superb synthesis of references linked to the special topics and formulations by a succinct set of bibliographical notes.Should be in the hands of all system analysts and computer system architects." --Computing Reviews This unique book brings together most of the available results on applications of mathematical programming in statistics, and also develops the necessary statistical and programming theory and methods. 1981 (0-471-08073-X) 413 pp.




Robustness in Statistics


Book Description

Robustness in Statistics contains the proceedings of a Workshop on Robustness in Statistics held on April 11-12, 1978, at the Army Research Office in Research Triangle Park, North Carolina. The papers review the state of the art in statistical robustness and cover topics ranging from robust estimation to the robustness of residual displays and robust smoothing. The application of robust regression to trajectory data reduction is also discussed. Comprised of 14 chapters, this book begins with an introduction to robust estimation, paying particular attention to iteration schemes and error structure of estimators. Sensitivity and influence curves as well as their connection with jackknife estimates are described. The reader is then introduced to a simple analog of trimmed means that can be used for studying residuals from a robust point-of-view; a class of robust estimators (called P-estimators) based on the location and scale-invariant Pitman estimators of location; and robust estimation in the presence of outliers. Subsequent chapters deal with robust regression and its use to reduce trajectory data; tests for censoring of extreme values, especially when population distributions are incompletely defined; and robust estimation for time series autoregressions. This monograph should be of interest to mathematicians and statisticians.




Introduction to Robust Estimation and Hypothesis Testing


Book Description

"This book focuses on the practical aspects of modern and robust statistical methods. The increased accuracy and power of modern methods, versus conventional approaches to the analysis of variance (ANOVA) and regression, is remarkable. Through a combination of theoretical developments, improved and more flexible statistical methods, and the power of the computer, it is now possible to address problems with standard methods that seemed insurmountable only a few years ago"--




Introduction to Robust Estimation and Hypothesis Testing


Book Description

Introduction to Robust Estimating and Hypothesis Testing, Fifth Edition is a useful ‘how-to’ on the application of robust methods utilizing easy-to-use software. This trusted resource provides an overview of modern robust methods, including improved techniques for dealing with outliers, skewed distribution curvature, and heteroscedasticity that can provide substantial gains in power. Coverage includes techniques for comparing groups and measuring effect size, current methods for comparing quantiles, and expanded regression methods for both parametric and nonparametric techniques. The practical importance of these varied methods is illustrated using data from real world studies. Over 1700 R functions are included to support comprehension and practice. Includes the latest developments in robust regression Provides many new, improved and accessible R functions Offers comprehensive coverage of ANOVA and ANCOVA methods




Robust Statistical Procedures


Book Description

Here is a brief, well-organized, and easy-to-follow introduction and overview of robust statistics. Huber focuses primarily on the important and clearly understood case of distribution robustness, where the shape of the true underlying distribution deviates slightly from the assumed model (usually the Gaussian law). An additional chapter on recent developments in robustness has been added and the reference list has been expanded and updated from the 1977 edition.




Robust Estimation and Testing


Book Description

An introduction to the theory and methods of robust statistics, providing students with practical methods for carrying out robust procedures in a variety of statistical contexts and explaining the advantages of these procedures. In addition, the text develops techniques and concepts likely to be useful in the future analysis of new statistical models and procedures. Emphasizing the concepts of breakdown point and influence functon of an estimator, it demonstrates the technique of expressing an estimator as a descriptive measure from which its influence function can be derived and then used to explore the efficiency and robustness properties of the estimator. Mathematical techniques are complemented by computational algorithms and Minitab macros for finding bootstrap and influence function estimates of standard errors of the estimators, robust confidence intervals, robust regression estimates and their standard errors. Includes examples and problems.




Transformation and Weighting in Regression


Book Description

This monograph provides a careful review of the major statistical techniques used to analyze regression data with nonconstant variability and skewness. The authors have developed statistical techniques--such as formal fitting methods and less formal graphical techniques-- that can be applied to many problems across a range of disciplines, including pharmacokinetics, econometrics, biochemical assays, and fisheries research. While the main focus of the book in on data transformation and weighting, it also draws upon ideas from diverse fields such as influence diagnostics, robustness, bootstrapping, nonparametric data smoothing, quasi-likelihood methods, errors-in-variables, and random coefficients. The authors discuss the computation of estimates and give numerous examples using real data. The book also includes an extensive treatment of estimating variance functions in regression.




Imperative of Economic Growth in the Eurozone: Competitiveness, Capital Flows and Structural Reforms


Book Description

European economic recovery appears to be taking hold. So is the European crisis over? The acute phase of the crisis passed, however a number of medium and long term issues remain. The policies of “internal devaluations” are working, albeit slowly, to restore competitiveness in the countries most affected by the crisis. However, growth remains at best sluggish. The medium and long term outlook remains highly uncertain, fomenting social tensions and endangering political stability. The restoration of economic dynamism is increasingly perceived as the answer to the question of the “European” future – economically, politically and socially. There is a broad consensus that dynamic structural reforms and the restoration of competitiveness at the level of the global economy are key answers to current European challenges. However, whatever the form these may take, the transfer of resources is implicit (and seemingly necessary), to underpin the current structure of eurozone. This indeed raises the question of governance – both fiscal and monetary. After all, the provision of resources implies an allocation – and it is hard to imagine that resources will be provided to the common pool unless the providers have some say with respect to allocation. And that requires some form of common (i.e. centralized) decision-making procedures, in all likelihood exceeding the common understanding of the acquis communautaire as it exists today – i.e. some form of the effective political arrangement. In this context, the basic idea which connects all contributions in this volume is the analysis of the problems which affected the Eurozone in the past decade and the challenges and dilemmas the Eurozone will face in the coming years.