Neural Networks for Knowledge Representation and Inference


Book Description

The second published collection based on a conference sponsored by the Metroplex Institute for Neural Dynamics -- the first is Motivation, Emotion, and Goal Direction in Neural Networks (LEA, 1992) -- this book addresses the controversy between symbolicist artificial intelligence and neural network theory. A particular issue is how well neural networks -- well established for statistical pattern matching -- can perform the higher cognitive functions that are more often associated with symbolic approaches. This controversy has a long history, but recently erupted with arguments against the abilities of renewed neural network developments. More broadly than other attempts, the diverse contributions presented here not only address the theory and implementation of artificial neural networks for higher cognitive functions, but also critique the history of assumed epistemologies -- both neural networks and AI -- and include several neurobiological studies of human cognition as a real system to guide the further development of artificial ones. Organized into four major sections, this volume: * outlines the history of the AI/neural network controversy, the strengths and weaknesses of both approaches, and shows the various capabilities such as generalization and discreetness as being along a broad but common continuum; * introduces several explicit, theoretical structures demonstrating the functional equivalences of neurocomputing with the staple objects of computer science and AI, such as sets and graphs; * shows variants on these types of networks that are applied in a variety of spheres, including reasoning from a geographic database, legal decision making, story comprehension, and performing arithmetic operations; * discusses knowledge representation process in living organisms, including evidence from experimental psychology, behavioral neurobiology, and electroencephalographic responses to sensory stimuli.




Neural Networks for Knowledge Representation and Inference


Book Description

The second published collection based on a conference sponsored by the Metroplex Institute for Neural Dynamics -- the first is Motivation, Emotion, and Goal Direction in Neural Networks (LEA, 1992) -- this book addresses the controversy between symbolicist artificial intelligence and neural network theory. A particular issue is how well neural networks -- well established for statistical pattern matching -- can perform the higher cognitive functions that are more often associated with symbolic approaches. This controversy has a long history, but recently erupted with arguments against the abilities of renewed neural network developments. More broadly than other attempts, the diverse contributions presented here not only address the theory and implementation of artificial neural networks for higher cognitive functions, but also critique the history of assumed epistemologies -- both neural networks and AI -- and include several neurobiological studies of human cognition as a real system to guide the further development of artificial ones. Organized into four major sections, this volume: * outlines the history of the AI/neural network controversy, the strengths and weaknesses of both approaches, and shows the various capabilities such as generalization and discreetness as being along a broad but common continuum; * introduces several explicit, theoretical structures demonstrating the functional equivalences of neurocomputing with the staple objects of computer science and AI, such as sets and graphs; * shows variants on these types of networks that are applied in a variety of spheres, including reasoning from a geographic database, legal decision making, story comprehension, and performing arithmetic operations; * discusses knowledge representation process in living organisms, including evidence from experimental psychology, behavioral neurobiology, and electroencephalographic responses to sensory stimuli.




Knowledge Graphs for eXplainable Artificial Intelligence: Foundations, Applications and Challenges


Book Description

The latest advances in Artificial Intelligence and (deep) Machine Learning in particular revealed a major drawback of modern intelligent systems, namely the inability to explain their decisions in a way that humans can easily understand. While eXplainable AI rapidly became an active area of research in response to this need for improved understandability and trustworthiness, the field of Knowledge Representation and Reasoning (KRR) has on the other hand a long-standing tradition in managing information in a symbolic, human-understandable form. This book provides the first comprehensive collection of research contributions on the role of knowledge graphs for eXplainable AI (KG4XAI), and the papers included here present academic and industrial research focused on the theory, methods and implementations of AI systems that use structured knowledge to generate reliable explanations. Introductory material on knowledge graphs is included for those readers with only a minimal background in the field, as well as specific chapters devoted to advanced methods, applications and case-studies that use knowledge graphs as a part of knowledge-based, explainable systems (KBX-systems). The final chapters explore current challenges and future research directions in the area of knowledge graphs for eXplainable AI. The book not only provides a scholarly, state-of-the-art overview of research in this subject area, but also fosters the hybrid combination of symbolic and subsymbolic AI methods, and will be of interest to all those working in the field.




Knowledge-based Neurocomputing


Book Description

Looking at ways to encode prior knowledge and to extract, refine, and revise knowledge within a neurocomputing system.Neurocomputing methods are loosely based on a model of the brain as a network of simple interconnected processing elements corresponding to neurons. These methods derive their power from the collective processing of artificial neurons, the chief advantage being that such systems can learn and adapt to a changing environment. In knowledge-based neurocomputing, the emphasis is on the use and representation of knowledge about an application. Explicit modeling of the knowledge represented by such a system remains a major research topic. The reason is that humans find it difficult to interpret the numeric representation of a neural network.The key assumption of knowledge-based neurocomputing is that knowledge is obtainable from, or can be represented by, a neurocomputing system in a form that humans can understand. That is, the knowledge embedded in the neurocomputing system can also be represented in a symbolic or well-structured form, such as Boolean functions, automata, rules, or other familiar ways. The focus of knowledge-based computing is on methods to encode prior knowledge and to extract, refine, and revise knowledge within a neurocomputing system.ContributorsC. Aldrich, J. Cervenka, I. Cloete, R.A. Cozzio, R. Drossu, J. Fletcher, C.L. Giles, F.S. Gouws, M. Hilario, M. Ishikawa, A. Lozowski, Z. Obradovic, C.W. Omlin, M. Riedmiller, P. Romero, G.P.J. Schmitz, J. Sima, A. Sperduti, M. Spott, J. Weisbrod, J.M. Zurada




Knowledge Representation and Reasoning with Deep Neural Networks


Book Description

Knowledge representation and reasoning is one of the central challenges of artificial intelligence, and has important implications in many fields including natural language understanding and robotics. Representing knowledge with symbols, and reasoning via search and logic has been the dominant paradigm for many decades. In this work, we use deep neural networks to learn to both represent symbols and perform reasoning end-to-end from data. By learning powerful non-linear models, our approach generalizes to massive amounts of knowledge and works well with messy real-world data using minimal human effort. First, we show that recurrent neural networks with an attention mechanism achieve state-of-the-art reasoning on a large structured knowledge graph. Next, we develop Neural Programmer, a neural network augmented with discrete operations that can be learned to induce latent programs with backpropagation. We apply Neural Programmer to induce short programs on two datasets: a synthetic dataset requiring arithmetic and logic reasoning, and a natural language question answering dataset that requires reasoning on semi-structured Wikipedia tables. We present what is to our awareness the first weakly supervised, end-to-end neural network model to induce such programs on a real-world dataset. Unlike previous learning approaches to program induction, the model does not require domain-specific grammars, rules, or annotations. Finally, we discuss methods to scale Neural Programmer training to large databases.




Artificial Intelligence and Knowledge Processing


Book Description

Artificial Intelligence and Knowledge Processing play a vital role in various automation industries and their functioning in converting traditional industries to AI-based factories. This book acts as a guide and blends the basics of Artificial Intelligence in various domains, which include Machine Learning, Deep Learning, Artificial Neural Networks, and Expert Systems, and extends their application in all sectors. Artificial Intelligence and Knowledge Processing: Improved Decision-Making and Prediction, discusses the designing of new AI algorithms used to convert general applications to AI-based applications. It highlights different Machine Learning and Deep Learning models for various applications used in healthcare and wellness, agriculture, and automobiles. The book offers an overview of the rapidly growing and developing field of AI applications, along with Knowledge of Engineering, and Business Analytics. Real-time case studies are included across several different fields such as Image Processing, Text Mining, Healthcare, Finance, Digital Marketing, and HR Analytics. The book also introduces a statistical background and probabilistic framework to enhance the understanding of continuous distributions. Topics such as Ensemble Models, Deep Learning Models, Artificial Neural Networks, Expert Systems, and Decision-Based Systems round out the offerings of this book. This multi-contributed book is a valuable source for researchers, academics, technologists, industrialists, practitioners, and all those who wish to explore the applications of AI, Knowledge Processing, Deep Learning, and Machine Learning.




Neural-Symbolic Cognitive Reasoning


Book Description

This book explores why, regarding practical reasoning, humans are sometimes still faster than artificial intelligence systems. It is the first to offer a self-contained presentation of neural network models for many computer science logics.




Foundations of Neural Networks, Fuzzy Systems, and Knowledge Engineering


Book Description

Combines the study of neural networks and fuzzy systems with symbolic artificial intelligence (AI) methods to build comprehensive AI systems. Describes major AI problems (pattern recognition, speech recognition, prediction, decision-making, game-playing) and provides illustrative examples. Includes applications in engineering, business and finance.




Neural Architectures for Database Query Processing, Syntax Analysis, Knowledge Representation, and Inference


Book Description

Artificial neural networks (ANN), due to their inherent parallelism, potential for fault tolerance, and adaptation through learning, offer an attractive computational paradigm for a variety of applications in computer science and engineering, artificial intelligence, robotics, and cognitive modeling. Despite the success in the application of ANN to a broad range of numeric tasks in pattern classification, control, function approximation, and system identification, the integration of ANN and symbolic computing is only beginning to be explored. This dissertation explores to integrate ANN and some essential symbolic computations for content-based associative symbolic processing.




Knowledge-Based Systems


Book Description

A knowledge-based system (KBS) is a system that uses artificial intelligence techniques in problem-solving processes to support human decision-making, learning, and action. Ideal for advanced-undergraduate and graduate students, as well as business professionals, this text is designed to help users develop an appreciation of KBS and their architecture and understand a broad variety of knowledge-based techniques for decision support and planning. It assumes basic computer science skills and a math background that includes set theory, relations, elementary probability, and introductory concepts of artificial intelligence. Each of the 12 chapters is designed to be modular, providing instructors with the flexibility to model the book to their own course needs. Exercises are incorporated throughout the text to highlight certain aspects of the material presented and to simulate thought and discussion. A comprehensive text and resource, Knowledge-Based Systems provides access to the most current information in KBS and new artificial intelligences, as well as neural networks, fuzzy logic, genetic algorithms, and soft systems.