Machine Learning of Heuristics


Book Description

First, a method of representing heuristics as production rules is developed which facilitates dynamic manipulation of the heuristics by the program embodying them. This representation technique permits separation of the heuristics from the program proper, provides clear identification of individual heuristics, is compatible with generalization schemes, and expedites the process of obtaining decisions from the system. Second, procedures are developed which permit a problem-solving program employing heuristics in production rule form to learn to improve its performance by evaluating and modifying existing heuristics and hypothesizing new ones, either during a special training process or during normal program operation. Third, the abovementioned representation and learning techniques are reformulated in the light of existing stimulus-response theories of learning, and five different S-R models of human heuristic learning in problem-solving environments are constructed and examined in detail. Experimental designs for testing these information processing models are also proposed and discussed. Finally, the feasibility of using the aforementioned representation and learning techniques in a complex problem-solving situation is demonstrated by applying these techniques to the problem of making the bet decision in draw poker. This application, involving the construction of a computer program, demonstrates that few production rules or training trials are needed to produce a thorough and effective set of heuristics for draw poker. (Author).




Machine Learning


Book Description

The ability to learn is one of the most fundamental attributes of intelligent behavior. Consequently, progress in the theory and computer modeling of learn ing processes is of great significance to fields concerned with understanding in telligence. Such fields include cognitive science, artificial intelligence, infor mation science, pattern recognition, psychology, education, epistemology, philosophy, and related disciplines. The recent observance of the silver anniversary of artificial intelligence has been heralded by a surge of interest in machine learning-both in building models of human learning and in understanding how machines might be endowed with the ability to learn. This renewed interest has spawned many new research projects and resulted in an increase in related scientific activities. In the summer of 1980, the First Machine Learning Workshop was held at Carnegie-Mellon University in Pittsburgh. In the same year, three consecutive issues of the Inter national Journal of Policy Analysis and Information Systems were specially devoted to machine learning (No. 2, 3 and 4, 1980). In the spring of 1981, a special issue of the SIGART Newsletter No. 76 reviewed current research projects in the field. . This book contains tutorial overviews and research papers representative of contemporary trends in the area of machine learning as viewed from an artificial intelligence perspective. As the first available text on this subject, it is intended to fulfill several needs.




Heuristic Search


Book Description

Search has been vital to artificial intelligence from the very beginning as a core technique in problem solving. The authors present a thorough overview of heuristic search with a balance of discussion between theoretical analysis and efficient implementation and application to real-world problems. Current developments in search such as pattern databases and search with efficient use of external memory and parallel processing units on main boards and graphics cards are detailed. Heuristic search as a problem solving tool is demonstrated in applications for puzzle solving, game playing, constraint satisfaction and machine learning. While no previous familiarity with heuristic search is necessary the reader should have a basic knowledge of algorithms, data structures, and calculus. Real-world case studies and chapter ending exercises help to create a full and realized picture of how search fits into the world of artificial intelligence and the one around us. - Provides real-world success stories and case studies for heuristic search algorithms - Includes many AI developments not yet covered in textbooks such as pattern databases, symbolic search, and parallel processing units




Learning Deep Architectures for AI


Book Description

Theoretical results suggest that in order to learn the kind of complicated functions that can represent high-level abstractions (e.g. in vision, language, and other AI-level tasks), one may need deep architectures. Deep architectures are composed of multiple levels of non-linear operations, such as in neural nets with many hidden layers or in complicated propositional formulae re-using many sub-formulae. Searching the parameter space of deep architectures is a difficult task, but learning algorithms such as those for Deep Belief Networks have recently been proposed to tackle this problem with notable success, beating the state-of-the-art in certain areas. This paper discusses the motivations and principles regarding learning algorithms for deep architectures, in particular those exploiting as building blocks unsupervised learning of single-layer models such as Restricted Boltzmann Machines, used to construct deeper models such as Deep Belief Networks.




Metaheuristics in Machine Learning: Theory and Applications


Book Description

This book is a collection of the most recent approaches that combine metaheuristics and machine learning. Some of the methods considered in this book are evolutionary, swarm, machine learning, and deep learning. The chapters were classified based on the content; then, the sections are thematic. Different applications and implementations are included; in this sense, the book provides theory and practical content with novel machine learning and metaheuristic algorithms. The chapters were compiled using a scientific perspective. Accordingly, the book is primarily intended for undergraduate and postgraduate students of Science, Engineering, and Computational Mathematics and is useful in courses on Artificial Intelligence, Advanced Machine Learning, among others. Likewise, the book is useful for research from the evolutionary computation, artificial intelligence, and image processing communities.




Artificial Intelligence and Heuristics for Smart Energy Efficiency in Smart Cities


Book Description

This book emphasizes the role of micro-grid systems and connected networks for the strategic storage of energy through the use of information and communication techniques, big data, the cloud, and meta-heuristics to support the greed for artificial intelligence techniques in data and the implementation of global strategies to meet the challenges of the city in the broad sense. The intelligent management of renewable energy in the context of the energy transition requires the use of techniques and tools based on artificial intelligence (AI) to overcome the challenges of the intermittence of resources and the cost of energy. The advent of the smart city makes an increased call for the integration of artificial intelligence and heuristics to meet the challenge of the increasing migration of populations to the city, in order to ensure food, energy, and environmental security of the citizen of the city and his well-being. This book is intended for policymakers, academics, practitioners, and students. Several real cases are exposed throughout the book to illustrate the concepts and methods of the networks and systems presented. This book proposes the development of new technological innovations—mainly ICT—the concept of “Smart City” appears as a means of achieving more efficient and sustainable cities. The overall goal of the book is to develop a comprehensive framework to help public and private stakeholders make informed decisions on smart city investment strategies and develop skills for assessment and prioritization, including resolution of difficulties with deployment and reproducibility.




Mathematical Software – ICMS 2020


Book Description

This book constitutes the proceedings of the 7th International Conference on Mathematical Software, ICMS 2020, held in Braunschweig, Germany, in July 2020. The 48 papers included in this volume were carefully reviewed and selected from 58 submissions. The program of the 2020 meeting consisted of 20 topical sessions, each of which providing an overview of the challenges, achievements and progress in a environment of mathematical software research, development and use.




Classification in the Wild


Book Description

Rules for building formal models that use fast-and-frugal heuristics, extending the psychological study of classification to the real world of uncertainty. This book focuses on classification--allocating objects into categories--"in the wild," in real-world situations and far from the certainty of the lab. In the wild, unlike in typical psychological experiments, the future is not knowable and uncertainty cannot be meaningfully reduced to probability. Connecting the science of heuristics with machine learning, the book shows how to create formal models using classification rules that are simple, fast, and transparent and that can be as accurate as mathematically sophisticated algorithms developed for machine learning.




Ensemble Methods


Book Description

An up-to-date, self-contained introduction to a state-of-the-art machine learning approach, Ensemble Methods: Foundations and Algorithms shows how these accurate methods are used in real-world tasks. It gives you the necessary groundwork to carry out further research in this evolving field. After presenting background and terminology, the book covers the main algorithms and theories, including Boosting, Bagging, Random Forest, averaging and voting schemes, the Stacking method, mixture of experts, and diversity measures. It also discusses multiclass extension, noise tolerance, error-ambiguity and bias-variance decompositions, and recent progress in information theoretic diversity. Moving on to more advanced topics, the author explains how to achieve better performance through ensemble pruning and how to generate better clustering results by combining multiple clusterings. In addition, he describes developments of ensemble methods in semi-supervised learning, active learning, cost-sensitive learning, class-imbalance learning, and comprehensibility enhancement.




Data Mining: A Heuristic Approach


Book Description

Real life problems are known to be messy, dynamic and multi-objective, and involve high levels of uncertainty and constraints. Because traditional problem-solving methods are no longer capable of handling this level of complexity, heuristic search methods have attracted increasing attention in recent years for solving such problems. Inspired by nature, biology, statistical mechanics, physics and neuroscience, heuristics techniques are used to solve many problems where traditional methods have failed. Data Mining: A Heuristic Approach will be a repository for the applications of these techniques in the area of data mining.