Integration of World Knowledge for Natural Language Understanding


Book Description

This book concerns non-linguistic knowledge required to perform computational natural language understanding (NLU). The main objective of the book is to show that inference-based NLU has the potential for practical large scale applications. First, an introduction to research areas relevant for NLU is given. We review approaches to linguistic meaning, explore knowledge resources, describe semantic parsers, and compare two main forms of inference: deduction and abduction. In the main part of the book, we propose an integrative knowledge base combining lexical-semantic, ontological, and distributional knowledge. A particular attention is payed to ensuring its consistency. We then design a reasoning procedure able to make use of the large scale knowledge base. We experiment both with a deduction-based NLU system and with an abductive reasoner. For evaluation, we use three different NLU tasks: recognizing textual entailment, semantic role labeling, and interpretation of noun dependencies.




Pragmatics and Natural Language Understanding


Book Description

This book differs from other introductions to pragmatics in approaching the problems of interpreting language use in terms of interpersonal modelling of beliefs and intentions. It is intended to make issues involved in language understanding, such as speech, text, and discourse, accessible to the widest group possible -- not just specialists in linguistics or communication theorists -- but all scholars and researchers whose enterprises depend on having a useful model of how communicative agents understand utterances and expect their own utterances to be understood. Based on feedback from readers over the past seven years, explanations in every chapter have been improved and updated in this thoroughly revised version of the original text published in 1989. The most extensive revisions concern the relevance of technical notions of mutual and normal belief, and the futility of using the notion 'null context' to describe meaning. In addition, the discussion of implicature now includes an extended explication of "Grice's Cooperative Principle" which attempts to put it in the context of his theory of meaning and rationality, and to preclude misinterpretations which it has suffered over the past 20 years. The revised chapter exploits the notion of normal belief to improve the account of conversational implicature.




Linguistics for the Age of AI


Book Description

A human-inspired, linguistically sophisticated model of language understanding for intelligent agent systems. One of the original goals of artificial intelligence research was to endow intelligent agents with human-level natural language capabilities. Recent AI research, however, has focused on applying statistical and machine learning approaches to big data rather than attempting to model what people do and how they do it. In this book, Marjorie McShane and Sergei Nirenburg return to the original goal of recreating human-level intelligence in a machine. They present a human-inspired, linguistically sophisticated model of language understanding for intelligent agent systems that emphasizes meaning--the deep, context-sensitive meaning that a person derives from spoken or written language.




Natural Language Understanding


Book Description

From a leading authority in artificial intelligence, this book delivers a synthesis of the major modern techniques and the most current research in natural language processing. The approach is unique in its coverage of semantic interpretation and discourse alongside the foundational material in syntactic processing.




Natural Language Processing in Artificial Intelligence


Book Description

This volume focuses on natural language processing, artificial intelligence, and allied areas. Natural language processing enables communication between people and computers and automatic translation to facilitate easy interaction with others around the world. This book discusses theoretical work and advanced applications, approaches, and techniques for computational models of information and how it is presented by language (artificial, human, or natural) in other ways. It looks at intelligent natural language processing and related models of thought, mental states, reasoning, and other cognitive processes. It explores the difficult problems and challenges related to partiality, underspecification, and context-dependency, which are signature features of information in nature and natural languages. Key features: Addresses the functional frameworks and workflow that are trending in NLP and AI Looks at the latest technologies and the major challenges, issues, and advances in NLP and AI Explores an intelligent field monitoring and automated system through AI with NLP and its implications for the real world Discusses data acquisition and presents a real-time case study with illustrations related to data-intensive technologies in AI and NLP.




Understanding Language Understanding


Book Description

This book highlights cutting-edge research relevant to the building of a computational model of reading comprehension, as in the processing and understanding of a natural language text or story. The book takes an interdisciplinary approach to the study of reading, with contributions from computer science, psychology, and philosophy. Contributors cover the theoretical and psychological foundations of the research in discussions of what it means to understand a text, how one builds a computational model, and related issues in knowledge representation and reasoning. The book also addresses some of the broader issues that a natural language system must deal with, such as reading in context, linguistic novelty, and information extraction.




Applied Natural Language Processing in the Enterprise


Book Description

NLP has exploded in popularity over the last few years. But while Google, Facebook, OpenAI, and others continue to release larger language models, many teams still struggle with building NLP applications that live up to the hype. This hands-on guide helps you get up to speed on the latest and most promising trends in NLP. With a basic understanding of machine learning and some Python experience, you'll learn how to build, train, and deploy models for real-world applications in your organization. Authors Ankur Patel and Ajay Uppili Arasanipalai guide you through the process using code and examples that highlight the best practices in modern NLP. Use state-of-the-art NLP models such as BERT and GPT-3 to solve NLP tasks such as named entity recognition, text classification, semantic search, and reading comprehension Train NLP models with performance comparable or superior to that of out-of-the-box systems Learn about Transformer architecture and modern tricks like transfer learning that have taken the NLP world by storm Become familiar with the tools of the trade, including spaCy, Hugging Face, and fast.ai Build core parts of the NLP pipeline--including tokenizers, embeddings, and language models--from scratch using Python and PyTorch Take your models out of Jupyter notebooks and learn how to deploy, monitor, and maintain them in production




Natural Language Understanding in a Semantic Web Context


Book Description

This book serves as a starting point for Semantic Web (SW) students and researchers interested in discovering what Natural Language Processing (NLP) has to offer. NLP can effectively help uncover the large portions of data held as unstructured text in natural language, thus augmenting the real content of the Semantic Web in a significant and lasting way. The book covers the basics of NLP, with a focus on Natural Language Understanding (NLU), referring to semantic processing, information extraction and knowledge acquisition, which are seen as the key links between the SW and NLP communities. Major emphasis is placed on mining sentences in search of entities and relations. In the course of this “quest", challenges will be encountered for various text analysis tasks, including part-of-speech tagging, parsing, semantic disambiguation, named entity recognition and relation extraction. Standard algorithms associated with these tasks are presented to provide an understanding of the fundamental concepts. Furthermore, the importance of experimental design and result analysis is emphasized, and accordingly, most chapters include small experiments on corpus data with quantitative and qualitative analysis of the results. This book is divided into four parts. Part I “Searching for Entities in Text” is dedicated to the search for entities in textual data. Next, Part II “Working with Corpora” investigates corpora as valuable resources for NLP work. In turn, Part III “Semantic Grounding and Relatedness” focuses on the process of linking surface forms found in text to entities in resources. Finally, Part IV “Knowledge Acquisition” delves into the world of relations and relation extraction. The book also includes three appendices: “A Look into the Semantic Web” gives a brief overview of the Semantic Web and is intended to bring readers less familiar with the Semantic Web up to speed, so that they too can fully benefit from the material of this book. “NLP Tools and Platforms” provides information about NLP platforms and tools, while “Relation Lists” gathers lists of relations under different categories, showing how relations can be varied and serve different purposes. And finally, the book includes a glossary of over 200 terms commonly used in NLP. The book offers a valuable resource for graduate students specializing in SW technologies and professionals looking for new tools to improve the applicability of SW techniques in everyday life – or, in short, everyone looking to learn about NLP in order to expand his or her horizons. It provides a wealth of information for readers new to both fields, helping them understand the underlying principles and the challenges they may encounter.




Natural Language Processing in Action


Book Description

Summary Natural Language Processing in Action is your guide to creating machines that understand human language using the power of Python with its ecosystem of packages dedicated to NLP and AI. Purchase of the print book includes a free eBook in PDF, Kindle, and ePub formats from Manning Publications. About the Technology Recent advances in deep learning empower applications to understand text and speech with extreme accuracy. The result? Chatbots that can imitate real people, meaningful resume-to-job matches, superb predictive search, and automatically generated document summaries—all at a low cost. New techniques, along with accessible tools like Keras and TensorFlow, make professional-quality NLP easier than ever before. About the Book Natural Language Processing in Action is your guide to building machines that can read and interpret human language. In it, you'll use readily available Python packages to capture the meaning in text and react accordingly. The book expands traditional NLP approaches to include neural networks, modern deep learning algorithms, and generative techniques as you tackle real-world problems like extracting dates and names, composing text, and answering free-form questions. What's inside Some sentences in this book were written by NLP! Can you guess which ones? Working with Keras, TensorFlow, gensim, and scikit-learn Rule-based and data-based NLP Scalable pipelines About the Reader This book requires a basic understanding of deep learning and intermediate Python skills. About the Author Hobson Lane, Cole Howard, and Hannes Max Hapke are experienced NLP engineers who use these techniques in production. Table of Contents PART 1 - WORDY MACHINES Packets of thought (NLP overview) Build your vocabulary (word tokenization) Math with words (TF-IDF vectors) Finding meaning in word counts (semantic analysis) PART 2 - DEEPER LEARNING (NEURAL NETWORKS) Baby steps with neural networks (perceptrons and backpropagation) Reasoning with word vectors (Word2vec) Getting words in order with convolutional neural networks (CNNs) Loopy (recurrent) neural networks (RNNs) Improving retention with long short-term memory networks Sequence-to-sequence models and attention PART 3 - GETTING REAL (REAL-WORLD NLP CHALLENGES) Information extraction (named entity extraction and question answering) Getting chatty (dialog engines) Scaling up (optimization, parallelization, and batch processing)




Ways of Worldmaking


Book Description

Provides a workable notion of the kinds of skills and capacities that are central for those who work in the arts.