Ridge Functions and Applications in Neural Networks


Book Description

Recent years have witnessed a growth of interest in the special functions called ridge functions. These functions appear in various fields and under various guises. They appear in partial differential equations (where they are called plane waves), in computerized tomography, and in statistics. Ridge functions are also the underpinnings of many central models in neural network theory. In this book various approximation theoretic properties of ridge functions are described. This book also describes properties of generalized ridge functions, and their relation to linear superpositions and Kolmogorov's famous superposition theorem. In the final part of the book, a single and two hidden layer neural networks are discussed. The results obtained in this part are based on properties of ordinary and generalized ridge functions. Novel aspects of the universal approximation property of feedforward neural networks are revealed. This book will be of interest to advanced graduate students and researchers working in functional analysis, approximation theory, and the theory of real functions, and will be of particular interest to those wishing to learn more about neural network theory and applications and other areas where ridge functions are used.




Ridge Functions


Book Description

Presents the state of the art in the theory of ridge functions, providing a solid theoretical foundation.




Radial Basis Function Neural Networks with Sequential Learning


Book Description

A review of radial basis founction (RBF) neural networks. A novel sequential learning algorithm for minimal resource allocation neural networks (MRAN). MRAN for function approximation & pattern classification problems; MRAN for nonlinear dynamic systems; MRAN for communication channel equalization; Concluding remarks; A outline source code for MRAN in MATLAB; Bibliography; Index.




Machine Learning for the Physical Sciences


Book Description

Machine learning is an exciting topic with a myriad of applications. However, most textbooks are targeted towards computer science students. This, however, creates a complication for scientists across the physical sciences that also want to understand the main concepts of machine learning and look ahead to applica- tions and advancements in their fields. This textbook bridges this gap, providing an introduction to the mathematical foundations for the main algorithms used in machine learning for those from the physical sciences, without a formal background in computer science. It demon- strates how machine learning can be used to solve problems in physics and engineering, targeting senior undergraduate and graduate students in physics and electrical engineering, alongside advanced researchers. Key Features: Includes detailed algorithms Supplemented by codes in Julia: a high-performing language and one that is easy to read for those in the natural sciences All algorithms are presented with a good mathematical background




Recent Advances in Harmonic Analysis and Applications


Book Description

Recent Advances in Harmonic Analysis and Applications features selected contributions from the AMS conference which took place at Georgia Southern University, Statesboro in 2011 in honor of Professor Konstantin Oskolkov's 65th birthday. The contributions are based on two special sessions, namely "Harmonic Analysis and Applications" and "Sparse Data Representations and Applications." Topics covered range from Banach space geometry to classical harmonic analysis and partial differential equations. Survey and expository articles by leading experts in their corresponding fields are included, and the volume also features selected high quality papers exploring new results and trends in Muckenhoupt-Sawyer theory, orthogonal polynomials, trigonometric series, approximation theory, Bellman functions and applications in differential equations. Graduate students and researchers in analysis will be particularly interested in the articles which emphasize remarkable connections between analysis and analytic number theory. The readers will learn about recent mathematical developments and directions for future work in the unexpected and surprising interaction between abstract problems in additive number theory and experimentally discovered optical phenomena in physics. This book will be useful for number theorists, harmonic analysts, algorithmists in multi-dimensional signal processing and experts in physics and partial differential equations.




Theory of Ridge Regression Estimation with Applications


Book Description

A guide to the systematic analytical results for ridge, LASSO, preliminary test, and Stein-type estimators with applications Theory of Ridge Regression Estimation with Applications offers a comprehensive guide to the theory and methods of estimation. Ridge regression and LASSO are at the center of all penalty estimators in a range of standard models that are used in many applied statistical analyses. Written by noted experts in the field, the book contains a thorough introduction to penalty and shrinkage estimation and explores the role that ridge, LASSO, and logistic regression play in the computer intensive area of neural network and big data analysis. Designed to be accessible, the book presents detailed coverage of the basic terminology related to various models such as the location and simple linear models, normal and rank theory-based ridge, LASSO, preliminary test and Stein-type estimators. The authors also include problem sets to enhance learning. This book is a volume in the Wiley Series in Probability and Statistics series that provides essential and invaluable reading for all statisticians. This important resource: Offers theoretical coverage and computer-intensive applications of the procedures presented Contains solutions and alternate methods for prediction accuracy and selecting model procedures Presents the first book to focus on ridge regression and unifies past research with current methodology Uses R throughout the text and includes a companion website containing convenient data sets Written for graduate students, practitioners, and researchers in various fields of science, Theory of Ridge Regression Estimation with Applications is an authoritative guide to the theory and methodology of statistical estimation.




Multivariate Splines


Book Description

Subject of multivariate splines presented from an elementary point of view; includes many open problems.




Neural Networks and Soft Computing


Book Description

This volume presents new trends and developments in soft computing techniques. Topics include: neural networks, fuzzy systems, evolutionary computation, knowledge discovery, rough sets, and hybrid methods. It also covers various applications of soft computing techniques in economics, mechanics, medicine, automatics and image processing. The book contains contributions from internationally recognized scientists, such as Zadeh, Bubnicki, Pawlak, Amari, Batyrshin, Hirota, Koczy, Kosinski, Novák, S.-Y. Lee, Pedrycz, Raudys, Setiono, Sincak, Strumillo, Takagi, Usui, Wilamowski and Zurada. An excellent overview of soft computing methods and their applications.




Bimonoidal Categories, $E_n$-Monoidal Categories, and Algebraic $K$-Theory


Book Description

Bimonoidal categories are categorical analogues of rings without additive inverses. They have been actively studied in category theory, homotopy theory, and algebraic $K$-theory since around 1970. There is an abundance of new applications and questions of bimonoidal categories in mathematics and other sciences. The three books published by the AMS in the Mathematical Surveys and Monographs series under the general title Bimonoidal Categories, $E_n$-Monoidal Categories, and Algebraic $K$-Theory (Volume I: Symmetric Bimonoidal Categories and Monoidal Bicategories?this book, Volume II: Braided Bimonoidal Categories with Applications, and Volume III: From Categories to Structured Ring Spectra) provide a unified treatment of bimonoidal and higher ring-like categories, their connection with algebraic $K$-theory and homotopy theory, and applications to quantum groups and topological quantum computation. With ample background material, extensive coverage, detailed presentation of both well-known and new theorems, and a list of open questions, this work is a user-friendly resource for beginners and experts alike. Part 1 of this book proves in detail Laplaza's two coherence theorems and May's strictification theorem of symmetric bimonoidal categories, as well as their bimonoidal analogues. This part includes detailed corrections to several inaccurate statements and proofs found in the literature. Part 2 proves Baez's Conjecture on the existence of a bi-initial object in a 2-category of symmetric bimonoidal categories. The next main theorem states that a matrix construction, involving the matrix product and the matrix tensor product, sends a symmetric bimonoidal category with invertible distributivity morphisms to a symmetric monoidal bicategory, with no strict structure morphisms in general.




Bimonoidal Categories, $E_n$-Monoidal Categories, and Algebraic $K$-Theory


Book Description

Bimonoidal categories are categorical analogues of rings without additive inverses. They have been actively studied in category theory, homotopy theory, and algebraic $K$-theory since around 1970. There is an abundance of new applications and questions of bimonoidal categories in mathematics and other sciences. The three books published by the AMS in the Mathematical Surveys and Monographs series under the title Bimonoidal Categories, $E_n$-Monoidal Categories, and Algebraic $K$-Theory (Volume I: Symmetric Bimonoidal Categories and Monoidal Bicategories, Volume II: Braided Bimonoidal Categories with Applications, and Volume III: From Categories to Structured Ring Spectra?this book) provide a unified treatment of bimonoidal and higher ring-like categories, their connection with algebraic $K$-theory and homotopy theory, and applications to quantum groups and topological quantum computation. With ample background material, extensive coverage, detailed presentation of both well-known and new theorems, and a list of open questions, this work is a user-friendly resource for beginners and experts alike. Part 1 of this book is a detailed study of enriched monoidal categories, pointed diagram categories, and enriched multicategories. Using this machinery, Part 2 discusses the rich interconnection between the higher ring-like categories, homotopy theory, and algebraic $K$-theory. Starting with a chapter on homotopy theory background, the first half of Part 2 constructs the Segal $K$-theory functor and the Elmendorf-Mandell $K$-theory multifunctor from permutative categories to symmetric spectra. For the latter, the detailed treatment here includes identification and correction of some subtle errors concerning its extended domain. The second half applies the $K$-theory multifunctor to small ring, bipermutative, braided ring, and $E_n$-monoidal categories to obtain, respectively, strict ring, $E_{infty}$-, $E_2$-, and $E_n$-symmetric spectra.