Information Theory and Coding - Solved Problems


Book Description

This book is offers a comprehensive overview of information theory and error control coding, using a different approach then in existed literature. The chapters are organized according to the Shannon system model, where one block affects the others. A relatively brief theoretical introduction is provided at the beginning of every chapter, including a few additional examples and explanations, but without any proofs. And a short overview of some aspects of abstract algebra is given at the end of the corresponding chapters. The characteristic complex examples with a lot of illustrations and tables are chosen to provide detailed insights into the nature of the problem. Some limiting cases are presented to illustrate the connections with the theoretical bounds. The numerical values are carefully selected to provide in-depth explanations of the described algorithms. Although the examples in the different chapters can be considered separately, they are mutually connected and the conclusions for one considered problem relate to the others in the book.




Information Geometry


Book Description

The book provides a comprehensive introduction and a novel mathematical foundation of the field of information geometry with complete proofs and detailed background material on measure theory, Riemannian geometry and Banach space theory. Parametrised measure models are defined as fundamental geometric objects, which can be both finite or infinite dimensional. Based on these models, canonical tensor fields are introduced and further studied, including the Fisher metric and the Amari-Chentsov tensor, and embeddings of statistical manifolds are investigated. This novel foundation then leads to application highlights, such as generalizations and extensions of the classical uniqueness result of Chentsov or the Cramér-Rao inequality. Additionally, several new application fields of information geometry are highlighted, for instance hierarchical and graphical models, complexity theory, population genetics, or Markov Chain Monte Carlo. The book will be of interest to mathematicians who are interested in geometry, information theory, or the foundations of statistics, to statisticians as well as to scientists interested in the mathematical foundations of complex systems.




Unsolved Problems in Mathematical Systems and Control Theory


Book Description

This book provides clear presentations of more than sixty important unsolved problems in mathematical systems and control theory. Each of the problems included here is proposed by a leading expert and set forth in an accessible manner. Covering a wide range of areas, the book will be an ideal reference for anyone interested in the latest developments in the field, including specialists in applied mathematics, engineering, and computer science. The book consists of ten parts representing various problem areas, and each chapter sets forth a different problem presented by a researcher in the particular area and in the same way: description of the problem, motivation and history, available results, and bibliography. It aims not only to encourage work on the included problems but also to suggest new ones and generate fresh research. The reader will be able to submit solutions for possible inclusion on an online version of the book to be updated quarterly on the Princeton University Press website, and thus also be able to access solutions, updated information, and partial solutions as they are developed.




Control Theory for Physicists


Book Description

Bridging the basics to recent research advances, this is the ideal learning and reference work for physicists studying control theory.







Differential Equations and Control Theory


Book Description

This work presents the proceedings from the International Conference on Differential Equations and Control Theory, held recently in Wuhan, China. It provides an overview of current developments in a range of topics including dynamical systems, optimal control theory, stochastic control, chaos, fractals, wavelets and ordinary, partial, functional and stochastic differential equations.




Feedback Control Theory


Book Description

An excellent introduction to feedback control system design, this book offers a theoretical approach that captures the essential issues and can be applied to a wide range of practical problems. Its explorations of recent developments in the field emphasize the relationship of new procedures to classical control theory, with a focus on single input and output systems that keeps concepts accessible to students with limited backgrounds. The text is geared toward a single-semester senior course or a graduate-level class for students of electrical engineering. The opening chapters constitute a basic treatment of feedback design. Topics include a detailed formulation of the control design program, the fundamental issue of performance/stability robustness tradeoff, and the graphical design technique of loopshaping. Subsequent chapters extend the discussion of the loopshaping technique and connect it with notions of optimality. Concluding chapters examine controller design via optimization, offering a mathematical approach that is useful for multivariable systems.




Reliability Criteria in Information Theory and in Statistical Hypothesis Testing


Book Description

This monograph briefly formulates fundamental notions and results of Shannon theory on reliable transmission via coding and gives a survey of results obtained in last two-three decades by the authors.