Robotics, Vision and Control


Book Description

The author has maintained two open-source MATLAB Toolboxes for more than 10 years: one for robotics and one for vision. The key strength of the Toolboxes provide a set of tools that allow the user to work with real problems, not trivial examples. For the student the book makes the algorithms accessible, the Toolbox code can be read to gain understanding, and the examples illustrate how it can be used —instant gratification in just a couple of lines of MATLAB code. The code can also be the starting point for new work, for researchers or students, by writing programs based on Toolbox functions, or modifying the Toolbox code itself. The purpose of this book is to expand on the tutorial material provided with the toolboxes, add many more examples, and to weave this into a narrative that covers robotics and computer vision separately and together. The author shows how complex problems can be decomposed and solved using just a few simple lines of code, and hopefully to inspire up and coming researchers. The topics covered are guided by the real problems observed over many years as a practitioner of both robotics and computer vision. It is written in a light but informative style, it is easy to read and absorb, and includes a lot of Matlab examples and figures. The book is a real walk through the fundamentals of robot kinematics, dynamics and joint level control, then camera models, image processing, feature extraction and epipolar geometry, and bring it all together in a visual servo system. Additional material is provided at http://www.petercorke.com/RVC




Visual Servoing: Real-time Control Of Robot Manipulators Based On Visual Sensory Feedback


Book Description

This book treats visual feedback control of mechanical systems, mostly robot manipulators. It not only deals with image processing techniques and robot control schemes but also covers the latest investigation of the design of the visual servo mechanism based on modern linear and nonlinear control theory, the adaptive control scheme, fuzzy logic, and neural networks. New concepts for utilizing visual sensory information for real-time manipulator control are derived and the performances are evaluated through simulations and/or experiments.The contributors to this book are robotics specialists from all over the world. The book gives a practical perspective on visual servoing to researchers, engineers, and students working in this area.




Visual Control of Robots


Book Description




Robot Vision


Book Description

Over the past five years robot vision has emerged as a subject area with its own identity. A text based on the proceedings of the Symposium on Computer Vision and Sensor-based Robots held at the General Motors Research Laboratories, Warren, Michigan in 1978, was published by Plenum Press in 1979. This book, edited by George G. Dodd and Lothar Rosso!, probably represented the first identifiable book covering some aspects of robot vision. The subject of robot vision and sensory controls (RoViSeC) occupied an entire international conference held in the Hilton Hotel in Stratford, England in May 1981. This was followed by a second RoViSeC held in Stuttgart, Germany in November 1982. The large attendance at the Stratford conference and the obvious interest in the subject of robot vision at international robot meetings, provides the stimulus for this current collection of papers. Users and researchers entering the field of robot vision for the first time will encounter a bewildering array of publications on all aspects of computer vision of which robot vision forms a part. It is the grey area dividing the different aspects of computer vision which is not easy to identify. Even those involved in research sometimes find difficulty in separating the essential differences between vision for automated inspection and vision for robot applications. Both of these are to some extent applications of pattern recognition with the underlying philosophy of each defining the techniques used.




The Confluence of Vision and Control


Book Description

The collection of articles presented here, emerged from the Block Island Workshop on Vision and Control that brought together pioneering researchers from around the world. Discussions of new theoretical developments and the empirical validation of techniques and applications, are recorded in this book. Over recent years, robotics, computer vision and control theory researchers have addressed theoretical issues of: real-time vision, visual tracking, the active focus of attention and vision-based control of motion. At the same time, these theoretical insights have been used in applications such as: vision-based autonomous driving, vision-based grasping, human-computer interfaces, control of MEMS systems and medical image processing. From this book the reader will gain an overview of the latest thinking in vision and control, as well as an introduction to many of the techniques used in this area.




Visual Servoing in Robotics


Book Description

Visual servoing is a well-known approach to guide robots using visual information. Image processing, robotics, and control theory are combined in order to control the motion of a robot depending on the visual information extracted from the images captured by one or several cameras. With respect to vision issues, a number of issues are currently being addressed by ongoing research, such as the use of different types of image features (or different types of cameras such as RGBD cameras), image processing at high velocity, and convergence properties. As shown in this book, the use of new control schemes allows the system to behave more robustly, efficiently, or compliantly, with fewer delays. Related issues such as optimal and robust approaches, direct control, path tracking, or sensor fusion are also addressed. Additionally, we can currently find visual servoing systems being applied in a number of different domains. This book considers various aspects of visual servoing systems, such as the design of new strategies for their application to parallel robots, mobile manipulators, teleoperation, and the application of this type of control system in new areas.




Multi-View Geometry Based Visual Perception and Control of Robotic Systems


Book Description

This book describes visual perception and control methods for robotic systems that need to interact with the environment. Multiple view geometry is utilized to extract low-dimensional geometric information from abundant and high-dimensional image information, making it convenient to develop general solutions for robot perception and control tasks. In this book, multiple view geometry is used for geometric modeling and scaled pose estimation. Then Lyapunov methods are applied to design stabilizing control laws in the presence of model uncertainties and multiple constraints.




Aerial Manipulation


Book Description

This text is a thorough treatment of the rapidly growing area of aerial manipulation. It details all the design steps required for the modeling and control of unmanned aerial vehicles (UAV) equipped with robotic manipulators. Starting with the physical basics of rigid-body kinematics, the book gives an in-depth presentation of local and global coordinates, together with the representation of orientation and motion in fixed- and moving-coordinate systems. Coverage of the kinematics and dynamics of unmanned aerial vehicles is developed in a succession of popular UAV configurations for multirotor systems. Such an arrangement, supported by frequent examples and end-of-chapter exercises, leads the reader from simple to more complex UAV configurations. Propulsion-system aerodynamics, essential in UAV design, is analyzed through blade-element and momentum theories, analysis which is followed by a description of drag and ground-aerodynamic effects. The central part of the book is dedicated to aerial-manipulator kinematics, dynamics, and control. Based on foundations laid in the opening chapters, this portion of the book is a structured presentation of Newton–Euler dynamic modeling that results in forward and backward equations in both fixed- and moving-coordinate systems. The Lagrange–Euler approach is applied to expand the model further, providing formalisms to model the variable moment of inertia later used to analyze the dynamics of aerial manipulators in contact with the environment. Using knowledge from sensor data, insights are presented into the ways in which linear, robust, and adaptive control techniques can be applied in aerial manipulation so as to tackle the real-world problems faced by scholars and engineers in the design and implementation of aerial robotics systems. The book is completed by path and trajectory planning with vision-based examples for tracking and manipulation.




Dynamics and Control of Robotic Systems


Book Description

A comprehensive review of the principles and dynamics of robotic systems Dynamics and Control of Robotic Systems offers a systematic and thorough theoretical background for the study of the dynamics and control of robotic systems. The authors—noted experts in the field—highlight the underlying principles of dynamics and control that can be employed in a variety of contemporary applications. The book contains a detailed presentation of the precepts of robotics and provides methodologies that are relevant to realistic robotic systems. The robotic systems represented include wide range examples from classical industrial manipulators, humanoid robots to robotic surgical assistants, space vehicles, and computer controlled milling machines. The book puts the emphasis on the systematic application of the underlying principles and show how the computational and analytical tools such as MATLAB, Mathematica, and Maple enable students to focus on robotics’ principles and theory. Dynamics and Control of Robotic Systems contains an extensive collection of examples and problems and: Puts the focus on the fundamentals of kinematics and dynamics as applied to robotic systems Presents the techniques of analytical mechanics of robotics Includes a review of advanced topics such as the recursive order N formulation Contains a wide array of design and analysis problems for robotic systems Written for students of robotics, Dynamics and Control of Robotic Systems offers a comprehensive review of the underlying principles and methods of the science of robotics.




Visual Servoing


Book Description

The goal of this book is to introduce the visional application by excellent researchers in the world currently and offer the knowledge that can also be applied to another field widely. This book collects the main studies about machine vision currently in the world, and has a powerful persuasion in the applications employed in the machine vision. The contents, which demonstrate that the machine vision theory, are realized in different field. For the beginner, it is easy to understand the development in the vision servoing. For engineer, professor and researcher, they can study and learn the chapters, and then employ another application method.