Extremes and Related Properties of Random Sequences and Processes


Book Description

Classical Extreme Value Theory-the asymptotic distributional theory for maxima of independent, identically distributed random variables-may be regarded as roughly half a century old, even though its roots reach further back into mathematical antiquity. During this period of time it has found significant application-exemplified best perhaps by the book Statistics of Extremes by E. J. Gumbel-as well as a rather complete theoretical development. More recently, beginning with the work of G. S. Watson, S. M. Berman, R. M. Loynes, and H. Cramer, there has been a developing interest in the extension of the theory to include, first, dependent sequences and then continuous parameter stationary processes. The early activity proceeded in two directions-the extension of general theory to certain dependent sequences (e.g., Watson and Loynes), and the beginning of a detailed theory for stationary sequences (Berman) and continuous parameter processes (Cramer) in the normal case. In recent years both lines of development have been actively pursued.




Stationary Sequences and Random Fields


Book Description

This book has a dual purpose. One of these is to present material which selec tively will be appropriate for a quarter or semester course in time series analysis and which will cover both the finite parameter and spectral approach. The second object is the presentation of topics of current research interest and some open questions. I mention these now. In particular, there is a discussion in Chapter III of the types of limit theorems that will imply asymptotic nor mality for covariance estimates and smoothings of the periodogram. This dis cussion allows one to get results on the asymptotic distribution of finite para meter estimates that are broader than those usually given in the literature in Chapter IV. A derivation of the asymptotic distribution for spectral (second order) estimates is given under an assumption of strong mixing in Chapter V. A discussion of higher order cumulant spectra and their large sample properties under appropriate moment conditions follows in Chapter VI. Probability density, conditional probability density and regression estimates are considered in Chapter VII under conditions of short range dependence. Chapter VIII deals with a number of topics. At first estimates for the structure function of a large class of non-Gaussian linear processes are constructed. One can determine much more about this structure or transfer function in the non-Gaussian case than one can for Gaussian processes. In particular, one can determine almost all the phase information.




Random Processes for Engineers


Book Description

This engaging introduction to random processes provides students with the critical tools needed to design and evaluate engineering systems that must operate reliably in uncertain environments. A brief review of probability theory and real analysis of deterministic functions sets the stage for understanding random processes, whilst the underlying measure theoretic notions are explained in an intuitive, straightforward style. Students will learn to manage the complexity of randomness through the use of simple classes of random processes, statistical means and correlations, asymptotic analysis, sampling, and effective algorithms. Key topics covered include: • Calculus of random processes in linear systems • Kalman and Wiener filtering • Hidden Markov models for statistical inference • The estimation maximization (EM) algorithm • An introduction to martingales and concentration inequalities. Understanding of the key concepts is reinforced through over 100 worked examples and 300 thoroughly tested homework problems (half of which are solved in detail at the end of the book).




Lectures on Probability Theory and Mathematical Statistics - 3rd Edition


Book Description

The book is a collection of 80 short and self-contained lectures covering most of the topics that are usually taught in intermediate courses in probability theory and mathematical statistics. There are hundreds of examples, solved exercises and detailed derivations of important results. The step-by-step approach makes the book easy to understand and ideal for self-study. One of the main aims of the book is to be a time saver: it contains several results and proofs, especially on probability distributions, that are hard to find in standard references and are scattered here and there in more specialistic books. The topics covered by the book are as follows. PART 1 - MATHEMATICAL TOOLS: set theory, permutations, combinations, partitions, sequences and limits, review of differentiation and integration rules, the Gamma and Beta functions. PART 2 - FUNDAMENTALS OF PROBABILITY: events, probability, independence, conditional probability, Bayes' rule, random variables and random vectors, expected value, variance, covariance, correlation, covariance matrix, conditional distributions and conditional expectation, independent variables, indicator functions. PART 3 - ADDITIONAL TOPICS IN PROBABILITY THEORY: probabilistic inequalities, construction of probability distributions, transformations of probability distributions, moments and cross-moments, moment generating functions, characteristic functions. PART 4 - PROBABILITY DISTRIBUTIONS: Bernoulli, binomial, Poisson, uniform, exponential, normal, Chi-square, Gamma, Student's t, F, multinomial, multivariate normal, multivariate Student's t, Wishart. PART 5 - MORE DETAILS ABOUT THE NORMAL DISTRIBUTION: linear combinations, quadratic forms, partitions. PART 6 - ASYMPTOTIC THEORY: sequences of random vectors and random variables, pointwise convergence, almost sure convergence, convergence in probability, mean-square convergence, convergence in distribution, relations between modes of convergence, Laws of Large Numbers, Central Limit Theorems, Continuous Mapping Theorem, Slutsky's Theorem. PART 7 - FUNDAMENTALS OF STATISTICS: statistical inference, point estimation, set estimation, hypothesis testing, statistical inferences about the mean, statistical inferences about the variance.




Stochastic-Process Limits


Book Description

From the reviews: "The material is self-contained, but it is technical and a solid foundation in probability and queuing theory is beneficial to prospective readers. [... It] is intended to be accessible to those with less background. This book is a must to researchers and graduate students interested in these areas." ISI Short Book Reviews




Topics in Advanced Econometrics


Book Description

For sometime now, I felt that the evolution of the literature of econo metrics had mandated a higher level of mathematical proficiency. This is particularly evident beyond the level of the general linear model (GLM) and the general linear structural econometric model (GLSEM). The problems one encounters in nonlinear econometrics are not easily amenable to treatment by the analytical methods one typically acquires, when one learns about probability and inference through the use of den sity functions. Even in standard traditional topics, one is often compelled to resort to heuristics; for example, it is difficult to prove central limit theorems for nonidentically distributed or martingale sequences, solely by the use of characteristic functions. Yet such proofs are essential, even in only moderately sophisticated classroom exposition. Unfortunately, relatively few students enter a graduate economics de partment ready to tackle probability theory in measure theoretic terms. The present volume has grown out of the need to lay the foundation for such discussions. The motivating forces were, chiefly, (a) the frustration one encounters in attempting to communicate certain concepts to stu dents wholly in analytic terms; and (b) the unwillingness of the typical student to sit through several courses in mathematics departments, in order to acquire the requisite background.




Introduction to Probability, Statistics, and Random Processes


Book Description

The book covers basic concepts such as random experiments, probability axioms, conditional probability, and counting methods, single and multiple random variables (discrete, continuous, and mixed), as well as moment-generating functions, characteristic functions, random vectors, and inequalities; limit theorems and convergence; introduction to Bayesian and classical statistics; random processes including processing of random signals, Poisson processes, discrete-time and continuous-time Markov chains, and Brownian motion; simulation using MATLAB and R.




Probability


Book Description

This classic introduction to probability theory for beginning graduate students covers laws of large numbers, central limit theorems, random walks, martingales, Markov chains, ergodic theorems, and Brownian motion. It is a comprehensive treatment concentrating on the results that are the most useful for applications. Its philosophy is that the best way to learn probability is to see it in action, so there are 200 examples and 450 problems. The fourth edition begins with a short chapter on measure theory to orient readers new to the subject.




The Laws of Large Numbers


Book Description

The Law of Large Numbers deals with three types of law of large numbers according to the following convergences: stochastic, mean, and convergence with probability 1. The book also investigates the rate of convergence and the laws of the iterated logarithm. It reviews measure theory, probability theory, stochastic processes, ergodic theory, orthogonal series, Huber spaces, Banach spaces, as well as the special concepts and general theorems of the laws of large numbers. The text discusses the laws of large numbers of different classes of stochastic processes, such as independent random variables, orthogonal random variables, stationary sequences, symmetrically dependent random variables and their generalizations, and also Markov chains. It presents other laws of large numbers for subsequences of sequences of random variables, including some general laws of large numbers which are not related to any concrete class of stochastic processes. The text cites applications of the theorems, as in numbers theory, statistics, and information theory. The text is suitable for mathematicians, economists, scientists, statisticians, or researchers involved with the probability and relative frequency of large numbers.