Elements of Information Theory


Book Description

The latest edition of this classic is updated with new problem sets and material The Second Edition of this fundamental textbook maintains the book's tradition of clear, thought-provoking instruction. Readers are provided once again with an instructive mix of mathematics, physics, statistics, and information theory. All the essential topics in information theory are covered in detail, including entropy, data compression, channel capacity, rate distortion, network information theory, and hypothesis testing. The authors provide readers with a solid understanding of the underlying theory and applications. Problem sets and a telegraphic summary at the end of each chapter further assist readers. The historical notes that follow each chapter recap the main points. The Second Edition features: * Chapters reorganized to improve teaching * 200 new problems * New material on source coding, portfolio theory, and feedback capacity * Updated references Now current and enhanced, the Second Edition of Elements of Information Theory remains the ideal textbook for upper-level undergraduate and graduate courses in electrical engineering, statistics, and telecommunications.




Mathematical Analysis


Book Description

This volume contains three articles: "Asymptotic methods in the theory of ordinary differential equations" b'y V. F. Butuzov, A. B. Vasil'eva, and M. V. Fedoryuk, "The theory of best ap proximation in Dormed linear spaces" by A. L. Garkavi, and "Dy namical systems with invariant measure" by A. 'VI. Vershik and S. A. Yuzvinskii. The first article surveys the literature on linear and non linear singular asymptotic problems, in particular, differential equations with a small parameter. The period covered by the survey is primarily 1962-1967. The second article is devoted to the problem of existence, characterization, and uniqueness of best approximations in Banach spaces. One of the chapters also deals with the problem of the convergence of positive operators, inasmuch as the ideas and methods of this theory are close to those of the theory of best ap proximation. The survey covers the literature of the decade 1958-1967. The third article is devoted to a comparatively new and rapid ly growing branch of mathematics which is closely related to many classical and modern mathematical disciplines. A survey is given of results in entropy theory, classical dynamic systems, ergodic theorems, etc. The results surveyed were primarily published during the period 1956-1967.




Information Theory and Network Coding


Book Description

This book is an evolution from my book A First Course in Information Theory published in 2002 when network coding was still at its infancy. The last few years have witnessed the rapid development of network coding into a research ?eld of its own in information science. With its root in infor- tion theory, network coding has not only brought about a paradigm shift in network communications at large, but also had signi?cant in?uence on such speci?c research ?elds as coding theory, networking, switching, wireless c- munications,distributeddatastorage,cryptography,andoptimizationtheory. While new applications of network coding keep emerging, the fundamental - sults that lay the foundation of the subject are more or less mature. One of the main goals of this book therefore is to present these results in a unifying and coherent manner. While the previous book focused only on information theory for discrete random variables, the current book contains two new chapters on information theory for continuous random variables, namely the chapter on di?erential entropy and the chapter on continuous-valued channels. With these topics included, the book becomes more comprehensive and is more suitable to be used as a textbook for a course in an electrical engineering department.




Estimation and Control over Communication Networks


Book Description

This book presents a systematic theory of estimation and control over communication networks. It develops a theory that utilizes communications, control, information and dynamical systems theory motivated and applied to advanced networking scenarios. The book establishes theoretically rich and practically important connections among modern control theory, Shannon information theory, and entropy theory of dynamical systems originated in the work of Kolmogorov. This self-contained monograph covers the latest achievements in the area. It contains many real-world applications and the presentation is accessible.




Coding for Optical Channels


Book Description

In order to adapt to the ever-increasing demands of telecommunication needs, today’s network operators are implementing 100 Gb/s per dense wavelength division multiplexing (DWDM) channel transmission. At those data rates, the performance of fiberoptic communication systems is degraded significantly due to intra- and inter-channel fiber nonlinearities, polarization-mode dispersion (PMD), and chromatic dispersion. In order to deal with those channel impairments, novel advanced techniques in modulation and detection, coding and signal processing are needed. This unique book represents a coherent and comprehensive introduction to the fundamentals of optical communications, signal processing and coding for optical channels. It is the first to integrate the fundamentals of coding theory with the fundamentals of optical communication.




Geometry of Isotropic Convex Bodies


Book Description

The study of high-dimensional convex bodies from a geometric and analytic point of view, with an emphasis on the dependence of various parameters on the dimension stands at the intersection of classical convex geometry and the local theory of Banach spaces. It is also closely linked to many other fields, such as probability theory, partial differential equations, Riemannian geometry, harmonic analysis and combinatorics. It is now understood that the convexity assumption forces most of the volume of a high-dimensional convex body to be concentrated in some canonical way and the main question is whether, under some natural normalization, the answer to many fundamental questions should be independent of the dimension. The aim of this book is to introduce a number of well-known questions regarding the distribution of volume in high-dimensional convex bodies, which are exactly of this nature: among them are the slicing problem, the thin shell conjecture and the Kannan-Lovász-Simonovits conjecture. This book provides a self-contained and up to date account of the progress that has been made in the last fifteen years.




Graphs and Questionnaires


Book Description

Graphs and Questionnaires