Mean-Field-Type Games for Engineers


Book Description

The contents of this book comprise an appropriate background to start working and doing research on mean-field-type control and game theory. To make the exposition and explanation even easier, we first study the deterministic optimal control and differential linear-quadratic games. Then, we progressively add complexity step-by-step and little-by-little to the problem settings until we finally study and analyze mean-field-type control and game problems incorporating several stochastic processes, e.g., Brownian motions, Poisson jumps, and random coefficients. We go beyond the Nash equilibrium, which provides a solution for non- cooperative games, by analyzing other game-theoretical concepts such as the Berge, Stackelberg, adversarial/robust, and co-opetitive equilibria. For the mean-field-type game analysis, we provide several numerical examples using a Matlab-based user-friendly toolbox that is available for the free use to the readers of this book. We present several engineering applications in both continuous and discrete time. Among these applications we find the following: water distribution systems, micro-grid energy storage, stirred tank reactor, mechanism design for evolutionary dynamics, multi-level building evacuation problem, and the COVID-19 propagation control. Julian Barreiro-Gomez Hamidou Tembine With such a demand from engineering audiences, this book is very timely and provides a thorough study of mean-field-type game theory. The strenuous protagonist of this book is to bridge between the theoretical findings and engineering solutions. The book introduces the basics first, and then mathematical frameworks are elaborately explained. The engineering application examples are shown in detail, and the popular learning approaches are also investigated. Those advantageous characteristics will make this book a comprehensive handbook of many engineering fields for many years, and I will buy one when it gets published. Zhu Han




Mean Field Games and Mean Field Type Control Theory


Book Description

​Mean field games and Mean field type control introduce new problems in Control Theory. The terminology “games” may be confusing. In fact they are control problems, in the sense that one is interested in a single decision maker, whom we can call the representative agent. However, these problems are not standard, since both the evolution of the state and the objective functional is influenced but terms which are not directly related to the state or the control of the decision maker. They are however, indirectly related to him, in the sense that they model a very large community of agents similar to the representative agent. All the agents behave similarly and impact the representative agent. However, because of the large number an aggregation effect takes place. The interesting consequence is that the impact of the community can be modeled by a mean field term, but when this is done, the problem is reduced to a control problem. ​




Probabilistic Theory of Mean Field Games with Applications I


Book Description

This two-volume book offers a comprehensive treatment of the probabilistic approach to mean field game models and their applications. The book is self-contained in nature and includes original material and applications with explicit examples throughout, including numerical solutions. Volume I of the book is entirely devoted to the theory of mean field games without a common noise. The first half of the volume provides a self-contained introduction to mean field games, starting from concrete illustrations of games with a finite number of players, and ending with ready-for-use solvability results. Readers are provided with the tools necessary for the solution of forward-backward stochastic differential equations of the McKean-Vlasov type at the core of the probabilistic approach. The second half of this volume focuses on the main principles of analysis on the Wasserstein space. It includes Lions' approach to the Wasserstein differential calculus, and the applications of its results to the analysis of stochastic mean field control problems. Together, both Volume I and Volume II will greatly benefit mathematical graduate students and researchers interested in mean field games. The authors provide a detailed road map through the book allowing different access points for different readers and building up the level of technical detail. The accessible approach and overview will allow interested researchers in the applied sciences to obtain a clear overview of the state of the art in mean field games.




Feedback Systems


Book Description

The essential introduction to the principles and applications of feedback systems—now fully revised and expanded This textbook covers the mathematics needed to model, analyze, and design feedback systems. Now more user-friendly than ever, this revised and expanded edition of Feedback Systems is a one-volume resource for students and researchers in mathematics and engineering. It has applications across a range of disciplines that utilize feedback in physical, biological, information, and economic systems. Karl Åström and Richard Murray use techniques from physics, computer science, and operations research to introduce control-oriented modeling. They begin with state space tools for analysis and design, including stability of solutions, Lyapunov functions, reachability, state feedback observability, and estimators. The matrix exponential plays a central role in the analysis of linear control systems, allowing a concise development of many of the key concepts for this class of models. Åström and Murray then develop and explain tools in the frequency domain, including transfer functions, Nyquist analysis, PID control, frequency domain design, and robustness. Features a new chapter on design principles and tools, illustrating the types of problems that can be solved using feedback Includes a new chapter on fundamental limits and new material on the Routh-Hurwitz criterion and root locus plots Provides exercises at the end of every chapter Comes with an electronic solutions manual An ideal textbook for undergraduate and graduate students Indispensable for researchers seeking a self-contained resource on control theory




Probabilistic Theory of Mean Field Games with Applications II


Book Description

This two-volume book offers a comprehensive treatment of the probabilistic approach to mean field game models and their applications. The book is self-contained in nature and includes original material and applications with explicit examples throughout, including numerical solutions. Volume II tackles the analysis of mean field games in which the players are affected by a common source of noise. The first part of the volume introduces and studies the concepts of weak and strong equilibria, and establishes general solvability results. The second part is devoted to the study of the master equation, a partial differential equation satisfied by the value function of the game over the space of probability measures. Existence of viscosity and classical solutions are proven and used to study asymptotics of games with finitely many players. Together, both Volume I and Volume II will greatly benefit mathematical graduate students and researchers interested in mean field games. The authors provide a detailed road map through the book allowing different access points for different readers and building up the level of technical detail. The accessible approach and overview will allow interested researchers in the applied sciences to obtain a clear overview of the state of the art in mean field games.




Mean Field Games


Book Description

This volume provides an introduction to the theory of Mean Field Games, suggested by J.-M. Lasry and P.-L. Lions in 2006 as a mean-field model for Nash equilibria in the strategic interaction of a large number of agents. Besides giving an accessible presentation of the main features of mean-field game theory, the volume offers an overview of recent developments which explore several important directions: from partial differential equations to stochastic analysis, from the calculus of variations to modeling and aspects related to numerical methods. Arising from the CIME Summer School "Mean Field Games" held in Cetraro in 2019, this book collects together lecture notes prepared by Y. Achdou (with M. Laurière), P. Cardaliaguet, F. Delarue, A. Porretta and F. Santambrogio. These notes will be valuable for researchers and advanced graduate students who wish to approach this theory and explore its connections with several different fields in mathematics.




Random Processes for Engineers


Book Description

This engaging introduction to random processes provides students with the critical tools needed to design and evaluate engineering systems that must operate reliably in uncertain environments. A brief review of probability theory and real analysis of deterministic functions sets the stage for understanding random processes, whilst the underlying measure theoretic notions are explained in an intuitive, straightforward style. Students will learn to manage the complexity of randomness through the use of simple classes of random processes, statistical means and correlations, asymptotic analysis, sampling, and effective algorithms. Key topics covered include: • Calculus of random processes in linear systems • Kalman and Wiener filtering • Hidden Markov models for statistical inference • The estimation maximization (EM) algorithm • An introduction to martingales and concentration inequalities. Understanding of the key concepts is reinforced through over 100 worked examples and 300 thoroughly tested homework problems (half of which are solved in detail at the end of the book).




Mean Field Game and its Applications in Wireless Networks


Book Description

This book covers the basic theory of mean field game (MFG) and its applications in wireless networks. It starts with an overview of the current and future state-of-the-art in 5G and 6G wireless networks. Then, a tutorial is presented for MFG, mean-field-type game (MFTG), and prerequisite fields of study such as optimal control theory and differential games. This book also includes a literature survey of MFG-based research in wireless network technologies such as ultra-dense networks (UDNs), device-to-device (D2D) communications, internet-of-things (IoT), unmanned aerial vehicles (UAVs), and mobile edge networks (MENs). Several applications of MFG and MFTG in UDNs, social networks, and multi-access edge computing networks (MECNs) are introduced as well. Applications of MFG covered in this book are divided in three parts. The first part covers three single-population MFG research works or case studies in UDNs including ultra-dense D2D networks, ultra-dense UAV networks, and dense-user MECNs. The second part centers on a multiple-population MFG (MPMFG) modeling of belief and opinion evolution in social networks. It focuses on a recently developed MPMFG framework and its application in analyzing the behavior of users in a multiple-population social network. Finally, the last part concentrates on an MFTG approach to computation offloading in MECN. The computation offloading algorithms are designed for energy- and time-efficient offloading of computation-intensive tasks in an MECN. This book targets advanced-level students, professors, researchers, scientists, and engineers in the fields of communications and networks. Industry managers and government employees working in these same fields will also find this book useful.




Programming Game AI by Example


Book Description

This book describes in detail many of the AI techniques used in modern computer games, explicity shows how to implement these practical techniques within the framework of several game developers with a practical foundation to game AI.




Stochastic Games and Applications


Book Description

This volume is based on lectures given at the NATO Advanced Study Institute on "Stochastic Games and Applications," which took place at Stony Brook, NY, USA, July 1999. It gives the editors great pleasure to present it on the occasion of L.S. Shapley's eightieth birthday, and on the fiftieth "birthday" of his seminal paper "Stochastic Games," with which this volume opens. We wish to thank NATO for the grant that made the Institute and this volume possible, and the Center for Game Theory in Economics of the State University of New York at Stony Brook for hosting this event. We also wish to thank the Hebrew University of Jerusalem, Israel, for providing continuing financial support, without which this project would never have been completed. In particular, we are grateful to our editorial assistant Mike Borns, whose work has been indispensable. We also would like to acknowledge the support of the Ecole Poly tech nique, Paris, and the Israel Science Foundation. March 2003 Abraham Neyman and Sylvain Sorin ix STOCHASTIC GAMES L.S. SHAPLEY University of California at Los Angeles Los Angeles, USA 1. Introduction In a stochastic game the play proceeds by steps from position to position, according to transition probabilities controlled jointly by the two players.