Consistency of an Information Criterion for High-Dimensional Multivariate Regression


Book Description

This is the first book on an evaluation of (weak) consistency of an information criterion for variable selection in high-dimensional multivariate linear regression models by using the high-dimensional asymptotic framework. It is an asymptotic framework such that the sample size n and the dimension of response variables vector p are approaching ∞ simultaneously under a condition that p/n goes to a constant included in [0,1).Most statistical textbooks evaluate consistency of an information criterion by using the large-sample asymptotic framework such that n goes to ∞ under the fixed p. The evaluation of consistency of an information criterion from the high-dimensional asymptotic framework provides new knowledge to us, e.g., Akaike's information criterion (AIC) sometimes becomes consistent under the high-dimensional asymptotic framework although it never has a consistency under the large-sample asymptotic framework; and Bayesian information criterion (BIC) sometimes becomes inconsistent under the high-dimensional asymptotic framework although it is always consistent under the large-sample asymptotic framework. The knowledge may help to choose an information criterion to be used for high-dimensional data analysis, which has been attracting the attention of many researchers.




Recent Developments in Multivariate and Random Matrix Analysis


Book Description

This volume is a tribute to Professor Dietrich von Rosen on the occasion of his 65th birthday. It contains a collection of twenty original papers. The contents of the papers evolve around multivariate analysis and random matrices with topics such as high-dimensional analysis, goodness-of-fit measures, variable selection and information criteria, inference of covariance structures, the Wishart distribution and growth curve models.




Intelligent Decision Technologies


Book Description

This book contains selected papers from the KES-IDT-2021 conference, being held as a virtual conference in June 14–16, 2021. The KES-IDT is an interdisciplinary conference with opportunities for the presentation of new research results and discussion about them under the common title "Intelligent Decision Technologies". The conference has been creating for years a platform for knowledge transfer and the generation of new ideas in the field of intelligent decision making. The range of topics discussed during the conference covered methods of classification, prediction, data analysis, big data, decision support, knowledge engineering, modeling, social networks and many more in areas such as finance, economy, management and transportation. The discussed topics covered also decision making for problems regarding the electric vehicle industry. The book contains also several sections devoted to specific topics, such as Advances in intelligent data processing and its applications Multi-criteria decision analysis methods Knowledge engineering in large-scale systems High-dimensional data analysis Spatial data analysis and sparse estimation Innovative technologies and applications in computer intelligence Intelligent diagnosis and monitoring of systems Decision making theory for economics.




Multivariate Reduced-Rank Regression


Book Description

This book provides an account of multivariate reduced-rank regression, a tool of multivariate analysis that enjoys a broad array of applications. In addition to a historical review of the topic, its connection to other widely used statistical methods, such as multivariate analysis of variance (MANOVA), discriminant analysis, principal components, canonical correlation analysis, and errors-in-variables models, is also discussed. This new edition incorporates Big Data methodology and its applications, as well as high-dimensional reduced-rank regression, generalized reduced-rank regression with complex data, and sparse and low-rank regression methods. Each chapter contains developments of basic theoretical results, as well as details on computational procedures, illustrated with numerical examples drawn from disciplines such as biochemistry, genetics, marketing, and finance. This book is designed for advanced students, practitioners, and researchers, who may deal with moderate and high-dimensional multivariate data. Because regression is one of the most popular statistical methods, the multivariate regression analysis tools described should provide a natural way of looking at large (both cross-sectional and chronological) data sets. This book can be assigned in seminar-type courses taken by advanced graduate students in statistics, machine learning, econometrics, business, and engineering.




Analysis of Multivariate and High-Dimensional Data


Book Description

This modern approach integrates classical and contemporary methods, fusing theory and practice and bridging the gap to statistical learning.




Statistical Analysis for High-Dimensional Data


Book Description

This book features research contributions from The Abel Symposium on Statistical Analysis for High Dimensional Data, held in Nyvågar, Lofoten, Norway, in May 2014. The focus of the symposium was on statistical and machine learning methodologies specifically developed for inference in “big data” situations, with particular reference to genomic applications. The contributors, who are among the most prominent researchers on the theory of statistics for high dimensional inference, present new theories and methods, as well as challenging applications and computational solutions. Specific themes include, among others, variable selection and screening, penalised regression, sparsity, thresholding, low dimensional structures, computational challenges, non-convex situations, learning graphical models, sparse covariance and precision matrices, semi- and non-parametric formulations, multiple testing, classification, factor models, clustering, and preselection. Highlighting cutting-edge research and casting light on future research directions, the contributions will benefit graduate students and researchers in computational biology, statistics and the machine learning community.




Multivariate Statistics


Book Description

A comprehensive examination of high-dimensional analysis of multivariate methods and their real-world applications Multivariate Statistics: High-Dimensional and Large-Sample Approximations is the first book of its kind to explore how classical multivariate methods can be revised and used in place of conventional statistical tools. Written by prominent researchers in the field, the book focuses on high-dimensional and large-scale approximations and details the many basic multivariate methods used to achieve high levels of accuracy. The authors begin with a fundamental presentation of the basic tools and exact distributional results of multivariate statistics, and, in addition, the derivations of most distributional results are provided. Statistical methods for high-dimensional data, such as curve data, spectra, images, and DNA microarrays, are discussed. Bootstrap approximations from a methodological point of view, theoretical accuracies in MANOVA tests, and model selection criteria are also presented. Subsequent chapters feature additional topical coverage including: High-dimensional approximations of various statistics High-dimensional statistical methods Approximations with computable error bound Selection of variables based on model selection approach Statistics with error bounds and their appearance in discriminant analysis, growth curve models, generalized linear models, profile analysis, and multiple comparison Each chapter provides real-world applications and thorough analyses of the real data. In addition, approximation formulas found throughout the book are a useful tool for both practical and theoretical statisticians, and basic results on exact distributions in multivariate analysis are included in a comprehensive, yet accessible, format. Multivariate Statistics is an excellent book for courses on probability theory in statistics at the graduate level. It is also an essential reference for both practical and theoretical statisticians who are interested in multivariate analysis and who would benefit from learning the applications of analytical probabilistic methods in statistics.




Probabilistic Finite Element Model Updating Using Bayesian Statistics


Book Description

Probabilistic Finite Element Model Updating Using Bayesian Statistics: Applications to Aeronautical and Mechanical Engineering Tshilidzi Marwala and Ilyes Boulkaibet, University of Johannesburg, South Africa Sondipon Adhikari, Swansea University, UK Covers the probabilistic finite element model based on Bayesian statistics with applications to aeronautical and mechanical engineering Finite element models are used widely to model the dynamic behaviour of many systems including in electrical, aerospace and mechanical engineering. The book covers probabilistic finite element model updating, achieved using Bayesian statistics. The Bayesian framework is employed to estimate the probabilistic finite element models which take into account of the uncertainties in the measurements and the modelling procedure. The Bayesian formulation achieves this by formulating the finite element model as the posterior distribution of the model given the measured data within the context of computational statistics and applies these in aeronautical and mechanical engineering. Probabilistic Finite Element Model Updating Using Bayesian Statistics contains simple explanations of computational statistical techniques such as Metropolis-Hastings Algorithm, Slice sampling, Markov Chain Monte Carlo method, hybrid Monte Carlo as well as Shadow Hybrid Monte Carlo and their relevance in engineering. Key features: Contains several contributions in the area of model updating using Bayesian techniques which are useful for graduate students. Explains in detail the use of Bayesian techniques to quantify uncertainties in mechanical structures as well as the use of Markov Chain Monte Carlo techniques to evaluate the Bayesian formulations. The book is essential reading for researchers, practitioners and students in mechanical and aerospace engineering.




Martingale Limit Theory and Its Application


Book Description

Martingale Limit Theory and Its Application discusses the asymptotic properties of martingales, particularly as regards key prototype of probabilistic behavior that has wide applications. The book explains the thesis that martingale theory is central to probability theory, and also examines the relationships between martingales and processes embeddable in or approximated by Brownian motion. The text reviews the martingale convergence theorem, the classical limit theory and analogs, and the martingale limit theorems viewed as the rate of convergence results in the martingale convergence theorem. The book explains the square function inequalities, weak law of large numbers, as well as the strong law of large numbers. The text discusses the reverse martingales, martingale tail sums, the invariance principles in the central limit theorem, and also the law of the iterated logarithm. The book investigates the limit theory for stationary processes via corresponding results for approximating martingales and the estimation of parameters from stochastic processes. The text can be profitably used as a reference for mathematicians, advanced students, and professors of higher mathematics or statistics.




Econometrics


Book Description

The most authoritative and up-to-date core econometrics textbook available Econometrics is the quantitative language of economic theory, analysis, and empirical work, and it has become a cornerstone of graduate economics programs. Econometrics provides graduate and PhD students with an essential introduction to this foundational subject in economics and serves as an invaluable reference for researchers and practitioners. This comprehensive textbook teaches fundamental concepts, emphasizes modern, real-world applications, and gives students an intuitive understanding of econometrics. Covers the full breadth of econometric theory and methods with mathematical rigor while emphasizing intuitive explanations that are accessible to students of all backgrounds Draws on integrated, research-level datasets, provided on an accompanying website Discusses linear econometrics, time series, panel data, nonparametric methods, nonlinear econometric models, and modern machine learning Features hundreds of exercises that enable students to learn by doing Includes in-depth appendices on matrix algebra and useful inequalities and a wealth of real-world examples Can serve as a core textbook for a first-year PhD course in econometrics and as a follow-up to Bruce E. Hansen’s Probability and Statistics for Economists