Bilinear and Trilinear Regression Models with Structured Covariance Matrices


Book Description

This thesis focuses on the problem of estimating parameters in bilinear and trilinear regression models in which random errors are normally distributed. In these models the covariance matrix has a Kronecker product structure and some factor matrices may be linearly structured. The interest of considering various structures for the covariance matrices in different statistical models is partly driven by the idea that altering the covariance structure of a parametric model alters the variances of the model’s estimated mean parameters. Firstly, the extended growth curve model with a linearly structured covariance matrix is considered. The main theme is to find explicit estimators for the mean and for the linearly structured covariance matrix. We show how to decompose the residual space, the orthogonal complement to the mean space, into appropriate orthogonal subspaces and how to derive explicit estimators of the covariance matrix from the sum of squared residuals obtained by projecting observations on those subspaces. Also an explicit estimator of the mean is derived and some properties of the proposed estimators are studied. Secondly, we study a bilinear regression model with matrix normally distributed random errors. For those models, the dispersion matrix follows a Kronecker product structure and it can be used, for example, to model data with spatio-temporal relationships. The aim is to estimate the parameters of the model when, in addition, one covariance matrix is assumed to be linearly structured. On the basis of n independent observations from a matrix normal distribution, estimating equations, a flip-flop relation, are established. At last, the models based on normally distributed random third order tensors are studied. These models are useful in analyzing 3-dimensional data arrays. In some studies the analysis is done using the tensor normal model, where the focus is on the estimation of the variance-covariance matrix which has a Kronecker structure. Little attention is paid to the structure of the mean, however, there is a potential to improve the analysis by assuming a structured mean. We formally introduce a 2-fold growth curve model by assuming a trilinear structure for the mean in the tensor normal model and propose an estimation algorithm for parameters. Also some extensions are discussed.




Comprehensive Chemometrics


Book Description

Designed to serve as the first point of reference on the subject, Comprehensive Chemometrics presents an integrated summary of the present state of chemical and biochemical data analysis and manipulation. The work covers all major areas ranging from statistics to data acquisition, analysis, and applications. This major reference work provides broad-ranging, validated summaries of the major topics in chemometrics—with chapter introductions and advanced reviews for each area. The level of material is appropriate for graduate students as well as active researchers seeking a ready reference on obtaining and analyzing scientific data. Features the contributions of leading experts from 21 countries, under the guidance of the Editors-in-Chief and a team of specialist Section Editors: L. Buydens; D. Coomans; P. Van Espen; A. De Juan; J.H. Kalivas; B.K. Lavine; R. Leardi; R. Phan-Tan-Luu; L.A. Sarabia; and J. Trygg Examines the merits and limitations of each technique through practical examples and extensive visuals: 368 tables and more than 1,300 illustrations (750 in full color) Integrates coverage of chemical and biological methods, allowing readers to consider and test a range of techniques Consists of 2,200 pages and more than 90 review articles, making it the most comprehensive work of its kind Offers print and online purchase options, the latter of which delivers flexibility, accessibility, and usability through the search tools and other productivity-enhancing features of ScienceDirect




Generalized Principal Component Analysis


Book Description

This book provides a comprehensive introduction to the latest advances in the mathematical theory and computational tools for modeling high-dimensional data drawn from one or multiple low-dimensional subspaces (or manifolds) and potentially corrupted by noise, gross errors, or outliers. This challenging task requires the development of new algebraic, geometric, statistical, and computational methods for efficient and robust estimation and segmentation of one or multiple subspaces. The book also presents interesting real-world applications of these new methods in image processing, image and video segmentation, face recognition and clustering, and hybrid system identification etc. This book is intended to serve as a textbook for graduate students and beginning researchers in data science, machine learning, computer vision, image and signal processing, and systems theory. It contains ample illustrations, examples, and exercises and is made largely self-contained with three Appendices which survey basic concepts and principles from statistics, optimization, and algebraic-geometry used in this book. René Vidal is a Professor of Biomedical Engineering and Director of the Vision Dynamics and Learning Lab at The Johns Hopkins University. Yi Ma is Executive Dean and Professor at the School of Information Science and Technology at ShanghaiTech University. S. Shankar Sastry is Dean of the College of Engineering, Professor of Electrical Engineering and Computer Science and Professor of Bioengineering at the University of California, Berkeley.




Multiple View Geometry in Computer Vision


Book Description

A basic problem in computer vision is to understand the structure of a real world scene given several images of it. Techniques for solving this problem are taken from projective geometry and photogrammetry. Here, the authors cover the geometric principles and their algebraic representation in terms of camera projection matrices, the fundamental matrix and the trifocal tensor. The theory and methods of computation of these entities are discussed with real examples, as is their use in the reconstruction of scenes from multiple images. The new edition features an extended introduction covering the key ideas in the book (which itself has been updated with additional examples and appendices) and significant new results which have appeared since the first edition. Comprehensive background material is provided, so readers familiar with linear algebra and basic numerical methods can understand the projective geometry and estimation algorithms presented, and implement the algorithms directly from the book.




Physics Briefs


Book Description




Accurate Visual Metrology from Single and Multiple Uncalibrated Images


Book Description

Accurate Visual Metrology from Single and Multiple Uncalibrated Images presents novel techniques for constructing three-dimensional models from bi-dimensional images using virtual reality tools. Antonio Criminisi develops the mathematical theory of computing world measurements from single images, and builds up a hierarchy of novel, flexible techniques to make measurements and reconstruct three-dimensional scenes from uncalibrated images, paying particular attention to the accuracy of the reconstruction. This book includes examples of interesting viable applications (eg. Forensic Science, History of Art, Virtual Reality, Architectural and indoor measurements), presented in a simple way, accompanied by pictures, diagrams and plenty of worked examples to help the reader understand and implement the algorithms.




Nonnegative Matrix and Tensor Factorizations


Book Description

This book provides a broad survey of models and efficient algorithms for Nonnegative Matrix Factorization (NMF). This includes NMF’s various extensions and modifications, especially Nonnegative Tensor Factorizations (NTF) and Nonnegative Tucker Decompositions (NTD). NMF/NTF and their extensions are increasingly used as tools in signal and image processing, and data analysis, having garnered interest due to their capability to provide new insights and relevant information about the complex latent relationships in experimental data sets. It is suggested that NMF can provide meaningful components with physical interpretations; for example, in bioinformatics, NMF and its extensions have been successfully applied to gene expression, sequence analysis, the functional characterization of genes, clustering and text mining. As such, the authors focus on the algorithms that are most useful in practice, looking at the fastest, most robust, and suitable for large-scale models. Key features: Acts as a single source reference guide to NMF, collating information that is widely dispersed in current literature, including the authors’ own recently developed techniques in the subject area. Uses generalized cost functions such as Bregman, Alpha and Beta divergences, to present practical implementations of several types of robust algorithms, in particular Multiplicative, Alternating Least Squares, Projected Gradient and Quasi Newton algorithms. Provides a comparative analysis of the different methods in order to identify approximation error and complexity. Includes pseudo codes and optimized MATLAB source codes for almost all algorithms presented in the book. The increasing interest in nonnegative matrix and tensor factorizations, as well as decompositions and sparse representation of data, will ensure that this book is essential reading for engineers, scientists, researchers, industry practitioners and graduate students across signal and image processing; neuroscience; data mining and data analysis; computer science; bioinformatics; speech processing; biomedical engineering; and multimedia.




The Handbook of Organic Compounds, Three-Volume Set


Book Description

The Handbook of Organic Compounds: NIR, IR, Raman, and UV-Vis Spectra Featuring Polymers and Surfactants represents a compendium of practical spectroscopic methodology, comprehensive reviews, and basic information for organic materials, surfactants, and polymer spectra covering the Ultraviolet, Visible, Near Infrared, Infrared, Raman and Dielectric measurement techniques. This set represents a complementary organic compound handbook to the Nyquist inorganic handbook, published in 1996. This set comprises the first comprehensive multi-volume handbook to provide basic coverage for UV-Vis, 4th overtone NIR, 3rd overtone NIR, NIR, Infrared, Raman spectra, and Dielectric data for common organic compounds, polymers, surfactants, contaminants, and inorganic materials commonly encountered in the laboratory. The text includes a description and reviews of interpretive and chemometric techniques used for spectral data analysis. The spectra included within the atlas are useful for identification purposes as well as pedagogical for the instruction of the various interpretive and data processing methods discussed. This work is designed to be of help to students and vibrational spectroscopists in their efforts of daily spectral interpretation and data processing of organic spectra, polymers, and surfactants. All spectra are presented in wavenumber and transmittance, with the addition of ultraviolet, visible, 4th overtone NIR, 3rd overtone NIR, and NIR spectra also represented in nanometers and absorbance space. In addition, some Horizontal infrared ATR spectra are presented in wavenumber and absorbance space. All spectra are shown with essential peaks labeled in their respective units. The material in this handbook was contributed to by several individuals, and comments were received from a variety of prominent workers in the field of molecular spectroscopy. This type of handbookproject is a daunting task. This Handbook can provide a valuable reference for the daily activities of students and professionals working in modern molecular spectroscopy laboratories. * Indices for UV-Vis, fourth overtone NIR, third overtone NIR, NIR, IR, raman, and dielectric spectra* Unique detailed correlation charts for each of these spectral regions* Indices of spectra by alphabetical order, chemical class, and chemical formula* Cross referencing of common compounds for all spectral regions * Literature reviews of historical and most useful references in the field* Research oriented for those using molecular spectroscopy on a routine basis for interpretation, qualitative and quantitative analysis * An emphasis on near infrared and infrared spectral regions




Signal Processing Advances in Wireless and Mobile Communications: Trends in single-user and multi-user systems


Book Description

This is the second in a two-volume set that captures major recent advances in signal processing (SP) tools, as they apply to wireless and mobile communication systems. The set brings together contributions by leaders in the field worldwide, and covers an exceptionally wide range of technologies and methodologies, including noise and interference cancellation, modem design, mobile Internet services, next-generation audio/video broadcasting, cellular telephony, and wireless multimedia networks. Volume II focuses on single- and multi-user communication systems. Volume II presents valuable new signal processing work on blind synchronization with single- and multi-sensor arrays, space-time transmit-receive diversity combining systems, time-varying channel modeling, signal separation with constant modulus constraints and parallel factor analysis tools. Volume II also presents important advances in multiuser systems, notably modern methods for canceling multiuser interference and mitigating multipath effects in CDMA and multicarrier systems at the physical layer, as well as signal processing issues at the network layer.




Chemometrics in Chromatography


Book Description

Chemometrics uses advanced mathematical and statistical algorithms to provide maximum chemical information by analyzing chemical data, and obtain knowledge of chemical systems. Chemometrics significantly extends the possibilities of chromatography and with the technological advances of the personal computer and continuous development of open-source software, many laboratories are interested in incorporating chemometrics into their chromatographic methods. This book is an up-to-date reference that presents the most important information about each area of chemometrics used in chromatography, demonstrating its effective use when applied to a chromatographic separation.