Artificial Intelligence and Causal Inference


Book Description

Artificial Intelligence and Causal Inference address the recent development of relationships between artificial intelligence (AI) and causal inference. Despite significant progress in AI, a great challenge in AI development we are still facing is to understand mechanism underlying intelligence, including reasoning, planning and imagination. Understanding, transfer and generalization are major principles that give rise intelligence. One of a key component for understanding is causal inference. Causal inference includes intervention, domain shift learning, temporal structure and counterfactual thinking as major concepts to understand causation and reasoning. Unfortunately, these essential components of the causality are often overlooked by machine learning, which leads to some failure of the deep learning. AI and causal inference involve (1) using AI techniques as major tools for causal analysis and (2) applying the causal concepts and causal analysis methods to solving AI problems. The purpose of this book is to fill the gap between the AI and modern causal analysis for further facilitating the AI revolution. This book is ideal for graduate students and researchers in AI, data science, causal inference, statistics, genomics, bioinformatics and precision medicine. Key Features: Cover three types of neural networks, formulate deep learning as an optimal control problem and use Pontryagin’s Maximum Principle for network training. Deep learning for nonlinear mediation and instrumental variable causal analysis. Construction of causal networks is formulated as a continuous optimization problem. Transformer and attention are used to encode-decode graphics. RL is used to infer large causal networks. Use VAE, GAN, neural differential equations, recurrent neural network (RNN) and RL to estimate counterfactual outcomes. AI-based methods for estimation of individualized treatment effect in the presence of network interference.




Causality, Correlation And Artificial Intelligence For Rational Decision Making


Book Description

Causality has been a subject of study for a long time. Often causality is confused with correlation. Human intuition has evolved such that it has learned to identify causality through correlation. In this book, four main themes are considered and these are causality, correlation, artificial intelligence and decision making. A correlation machine is defined and built using multi-layer perceptron network, principal component analysis, Gaussian Mixture models, genetic algorithms, expectation maximization technique, simulated annealing and particle swarm optimization. Furthermore, a causal machine is defined and built using multi-layer perceptron, radial basis function, Bayesian statistics and Hybrid Monte Carlo methods. Both these machines are used to build a Granger non-linear causality model. In addition, the Neyman-Rubin, Pearl and Granger causal models are studied and are unified. The automatic relevance determination is also applied to extend Granger causality framework to the non-linear domain. The concept of rational decision making is studied, and the theory of flexibly-bounded rationality is used to extend the theory of bounded rationality within the principle of the indivisibility of rationality. The theory of the marginalization of irrationality for decision making is also introduced to deal with satisficing within irrational conditions. The methods proposed are applied in biomedical engineering, condition monitoring and for modelling interstate conflict.




The Book of Why


Book Description

A Turing Award-winning computer scientist and statistician shows how understanding causality has revolutionized science and will revolutionize artificial intelligence "Correlation is not causation." This mantra, chanted by scientists for more than a century, has led to a virtual prohibition on causal talk. Today, that taboo is dead. The causal revolution, instigated by Judea Pearl and his colleagues, has cut through a century of confusion and established causality -- the study of cause and effect -- on a firm scientific basis. His work explains how we can know easy things, like whether it was rain or a sprinkler that made a sidewalk wet; and how to answer hard questions, like whether a drug cured an illness. Pearl's work enables us to know not just whether one thing causes another: it lets us explore the world that is and the worlds that could have been. It shows us the essence of human thought and key to artificial intelligence. Anyone who wants to understand either needs The Book of Why.




Cause Effect Pairs in Machine Learning


Book Description

This book presents ground-breaking advances in the domain of causal structure learning. The problem of distinguishing cause from effect (“Does altitude cause a change in atmospheric pressure, or vice versa?”) is here cast as a binary classification problem, to be tackled by machine learning algorithms. Based on the results of the ChaLearn Cause-Effect Pairs Challenge, this book reveals that the joint distribution of two variables can be scrutinized by machine learning algorithms to reveal the possible existence of a “causal mechanism”, in the sense that the values of one variable may have been generated from the values of the other. This book provides both tutorial material on the state-of-the-art on cause-effect pairs and exposes the reader to more advanced material, with a collection of selected papers. Supplemental material includes videos, slides, and code which can be found on the workshop website. Discovering causal relationships from observational data will become increasingly important in data science with the increasing amount of available data, as a means of detecting potential triggers in epidemiology, social sciences, economy, biology, medicine, and other sciences.




Causality


Book Description

Causality offers the first comprehensive coverage of causal analysis in many sciences, including recent advances using graphical methods. Pearl presents a unified account of the probabilistic, manipulative, counterfactual and structural approaches to causation, and devises simple mathematical tools for analyzing the relationships between causal connections, statistical associations, actions and observations. The book will open the way for including causal analysis in the standard curriculum of statistics, artificial intelligence ...




Elements of Causal Inference


Book Description

A concise and self-contained introduction to causal inference, increasingly important in data science and machine learning. The mathematization of causality is a relatively recent development, and has become increasingly important in data science and machine learning. This book offers a self-contained and concise introduction to causal models and how to learn them from data. After explaining the need for causal models and discussing some of the principles underlying causal inference, the book teaches readers how to use causal models: how to compute intervention distributions, how to infer causal models from observational and interventional data, and how causal ideas could be exploited for classical machine learning problems. All of these topics are discussed first in terms of two variables and then in the more general multivariate case. The bivariate case turns out to be a particularly hard problem for causal learning because there are no conditional independences as used by classical methods for solving multivariate cases. The authors consider analyzing statistical asymmetries between cause and effect to be highly instructive, and they report on their decade of intensive research into this problem. The book is accessible to readers with a background in machine learning or statistics, and can be used in graduate courses or as a reference for researchers. The text includes code snippets that can be copied and pasted, exercises, and an appendix with a summary of the most important technical concepts.




The Art of Causal Conjecture


Book Description

In The Art of Causal Conjecture, Glenn Shafer lays out a new mathematical and philosophical foundation for probability and uses it to explain concepts of causality used in statistics, artificial intelligence, and philosophy. The various disciplines that use causal reasoning differ in the relative weight they put on security and precision of knowledge as opposed to timeliness of action. The natural and social sciences seek high levels of certainty in the identification of causes and high levels of precision in the measurement of their effects. The practical sciences -- medicine, business, engineering, and artificial intelligence -- must act on causal conjectures based on more limited knowledge. Shafer's understanding of causality contributes to both of these uses of causal reasoning. His language for causal explanation can guide statistical investigation in the natural and social sciences, and it can also be used to formulate assumptions of causal uniformity needed for decision making in the practical sciences. Causal ideas permeate the use of probability and statistics in all branches of industry, commerce, government, and science. The Art of Causal Conjecture shows that causal ideas can be equally important in theory. It does not challenge the maxim that causation cannot be proven from statistics alone, but by bringing causal ideas into the foundations of probability, it allows causal conjectures to be more clearly quantified, debated, and confronted by statistical evidence.




An Introduction to Causal Inference


Book Description

This paper summarizes recent advances in causal inference and underscores the paradigmatic shifts that must be undertaken in moving from traditional statistical analysis to causal analysis of multivariate data. Special emphasis is placed on the assumptions that underly all causal inferences, the languages used in formulating those assumptions, the conditional nature of all causal and counterfactual claims, and the methods that have been developed for the assessment of such claims. These advances are illustrated using a general theory of causation based on the Structural Causal Model (SCM) described in Pearl (2000a), which subsumes and unifies other approaches to causation, and provides a coherent mathematical foundation for the analysis of causes and counterfactuals. In particular, the paper surveys the development of mathematical tools for inferring (from a combination of data and assumptions) answers to three types of causal queries: (1) queries about the effects of potential interventions, (also called "causal effects" or "policy evaluation") (2) queries about probabilities of counterfactuals, (including assessment of "regret," "attribution" or "causes of effects") and (3) queries about direct and indirect effects (also known as "mediation"). Finally, the paper defines the formal and conceptual relationships between the structural and potential-outcome frameworks and presents tools for a symbiotic analysis that uses the strong features of both. The tools are demonstrated in the analyses of mediation, causes of effects, and probabilities of causation. -- p. 1.




A Logical Theory of Causality


Book Description

A general formal theory of causal reasoning as a logical study of causal models, reasoning, and inference. In this book, Alexander Bochman presents a general formal theory of causal reasoning as a logical study of causal models, reasoning, and inference, basing it on a supposition that causal reasoning is not a competitor of logical reasoning but its complement for situations lacking logically sufficient data or knowledge. Bochman also explores the relationship of this theory with the popular structural equation approach to causality proposed by Judea Pearl and explores several applications ranging from artificial intelligence to legal theory, including abduction, counterfactuals, actual and proximate causality, dynamic causal models, and reasoning about action and change in artificial intelligence. As logical preparation, before introducing causal concepts, Bochman describes an alternative, situation-based semantics for classical logic that provides a better understanding of what can be captured by purely logical means. He then presents another prerequisite, outlining those parts of a general theory of nonmonotonic reasoning that are relevant to his own theory. These two components provide a logical background for the main, two-tier formalism of the causal calculus that serves as the formal basis of his theory. He presents the main causal formalism of the book as a natural generalization of classical logic that allows for causal reasoning. This provides a formal background for subsequent chapters. Finally, Bochman presents a generalization of causal reasoning to dynamic domains.




The Economics of Artificial Intelligence


Book Description

A timely investigation of the potential economic effects, both realized and unrealized, of artificial intelligence within the United States healthcare system. In sweeping conversations about the impact of artificial intelligence on many sectors of the economy, healthcare has received relatively little attention. Yet it seems unlikely that an industry that represents nearly one-fifth of the economy could escape the efficiency and cost-driven disruptions of AI. The Economics of Artificial Intelligence: Health Care Challenges brings together contributions from health economists, physicians, philosophers, and scholars in law, public health, and machine learning to identify the primary barriers to entry of AI in the healthcare sector. Across original papers and in wide-ranging responses, the contributors analyze barriers of four types: incentives, management, data availability, and regulation. They also suggest that AI has the potential to improve outcomes and lower costs. Understanding both the benefits of and barriers to AI adoption is essential for designing policies that will affect the evolution of the healthcare system.