Multi-View Geometry Based Visual Perception and Control of Robotic Systems


Book Description

This book describes visual perception and control methods for robotic systems that need to interact with the environment. Multiple view geometry is utilized to extract low-dimensional geometric information from abundant and high-dimensional image information, making it convenient to develop general solutions for robot perception and control tasks. In this book, multiple view geometry is used for geometric modeling and scaled pose estimation. Then Lyapunov methods are applied to design stabilizing control laws in the presence of model uncertainties and multiple constraints.




Multi-view Geometry Based Visual Perception and Control of Robotic Systems


Book Description

This book describes visual perception and control methods for robotic systems that need to interact with the environment. Multiple view geometry is utilized to extract low-dimensional geometric information from abundant and high-dimensional image information, making it convenient to develop general solutions for robot perception and control tasks. In this book, multiple view geometry is used for geometric modeling and scaled pose estimation. Then Lyapunov methods are applied to design stabilizing control laws in the presence of model uncertainties and multiple constraints.




Active Sensor Planning for Multiview Vision Tasks


Book Description

This unique book explores the important issues in studying for active visual perception. The book’s eleven chapters draw on recent important work in robot vision over ten years, particularly in the use of new concepts. Implementation examples are provided with theoretical methods for testing in a real robot system. With these optimal sensor planning strategies, this book will give the robot vision system the adaptability needed in many practical applications.




Visual Perception and Robotic Manipulation


Book Description

This book moves toward the realization of domestic robots by presenting an integrated view of computer vision and robotics, covering fundamental topics including optimal sensor design, visual servo-ing, 3D object modelling and recognition, and multi-cue tracking, emphasizing robustness throughout. Covering theory and implementation, experimental results and comprehensive multimedia support including video clips, VRML data, C++ code and lecture slides, this book is a practical reference for roboticists and a valuable teaching resource.




Robotics, Vision and Control


Book Description

The author has maintained two open-source MATLAB Toolboxes for more than 10 years: one for robotics and one for vision. The key strength of the Toolboxes provide a set of tools that allow the user to work with real problems, not trivial examples. For the student the book makes the algorithms accessible, the Toolbox code can be read to gain understanding, and the examples illustrate how it can be used —instant gratification in just a couple of lines of MATLAB code. The code can also be the starting point for new work, for researchers or students, by writing programs based on Toolbox functions, or modifying the Toolbox code itself. The purpose of this book is to expand on the tutorial material provided with the toolboxes, add many more examples, and to weave this into a narrative that covers robotics and computer vision separately and together. The author shows how complex problems can be decomposed and solved using just a few simple lines of code, and hopefully to inspire up and coming researchers. The topics covered are guided by the real problems observed over many years as a practitioner of both robotics and computer vision. It is written in a light but informative style, it is easy to read and absorb, and includes a lot of Matlab examples and figures. The book is a real walk through the fundamentals of robot kinematics, dynamics and joint level control, then camera models, image processing, feature extraction and epipolar geometry, and bring it all together in a visual servo system. Additional material is provided at http://www.petercorke.com/RVC




Distributed Consensus with Visual Perception in Multi-Robot Systems


Book Description

This monograph introduces novel responses to the different problems that arise when multiple robots need to execute a task in cooperation, each robot in the team having a monocular camera as its primary input sensor. Its central proposition is that a consistent perception of the world is crucial for the good development of any multi-robot application. The text focuses on the high-level problem of cooperative perception by a multi-robot system: the idea that, depending on what each robot sees and its current situation, it will need to communicate these things to its fellows whenever possible to share what it has found and keep updated by them in its turn. However, in any realistic scenario, distributed solutions to this problem are not trivial and need to be addressed from as many angles as possible. Distributed Consensus with Visual Perception in Multi-Robot Systems covers a variety of related topics such as: • distributed consensus algorithms; • data association and robustness problems; • convergence speed; and • cooperative mapping. The book first puts forward algorithmic solutions to these problems and then supports them with empirical validations working with real images. It provides the reader with a deeper understanding of the problems associated to the perception of the world by a team of cooperating robots with onboard cameras. Academic researchers and graduate students working with multi-robot systems, or investigating problems of distributed control or computer vision and cooperative perception will find this book of material assistance with their studies.




Multiple View Geometry in Computer Vision


Book Description

A basic problem in computer vision is to understand the structure of a real world scene given several images of it. Techniques for solving this problem are taken from projective geometry and photogrammetry. Here, the authors cover the geometric principles and their algebraic representation in terms of camera projection matrices, the fundamental matrix and the trifocal tensor. The theory and methods of computation of these entities are discussed with real examples, as is their use in the reconstruction of scenes from multiple images. The new edition features an extended introduction covering the key ideas in the book (which itself has been updated with additional examples and appendices) and significant new results which have appeared since the first edition. Comprehensive background material is provided, so readers familiar with linear algebra and basic numerical methods can understand the projective geometry and estimation algorithms presented, and implement the algorithms directly from the book.




Progress in Pattern Recognition, Image Analysis, Computer Vision, and Applications


Book Description

This book constitutes the refereed proceedings of the 14th Iberoamerican Congress on Pattern Recognition, CIARP 2009, held in Guadalajara, Mexico, in November 2009. The 64 revised full papers presented together with 44 posters were carefully reviewed and selected from 187 submissions. The papers are organized in topical sections on image coding, processing and analysis; segmentation, analysis of shape and texture; geometric image processing and analysis; analysis of signal, speech and language; document processing and recognition; feature extraction, clustering and classification; statistical pattern recognition; neural networks for pattern recognition; computer vision; video segmentation and tracking; robot vision; intelligent remote sensing, imagery research and discovery techniques; intelligent computing for remote sensing imagery; as well as intelligent fusion and classification techniques.




Knowledge-Based Vision-Guided Robots


Book Description

Many robotics researchers consider high-level vision algorithms (computational) too expensive for use in robot guidance. This book introduces the reader to an alternative approach to perception for autonomous, mobile robots. It explores how to apply methods of high-level computer vision and fuzzy logic to the guidance and control of the mobile robot. The book introduces a knowledge-based approach to vision modeling for robot guidance, where advantage is taken of constraints of the robot's physical structure, the tasks it performs, and the environments it works in. This facilitates high-level computer vision algorithms such as object recognition at a speed that is sufficient for real-time navigation. The texts presents algorithms that exploit these constraints at all levels of vision, from image processing to model construction and matching, as well as shape recovery. These algorithms are demonstrated in the navigation of a wheeled mobile robot.




Control of Multiple Robots Using Vision Sensors


Book Description

This monograph introduces novel methods for the control and navigation of mobile robots using multiple-1-d-view models obtained from omni-directional cameras. This approach overcomes field-of-view and robustness limitations, simultaneously enhancing accuracy and simplifying application on real platforms. The authors also address coordinated motion tasks for multiple robots, exploring different system architectures, particularly the use of multiple aerial cameras in driving robot formations on the ground. Again, this has benefits of simplicity, scalability and flexibility. Coverage includes details of: a method for visual robot homing based on a memory of omni-directional images; a novel vision-based pose stabilization methodology for non-holonomic ground robots based on sinusoidal-varying control inputs; an algorithm to recover a generic motion between two 1-d views and which does not require a third view; a novel multi-robot setup where multiple camera-carrying unmanned aerial vehicles are used to observe and control a formation of ground mobile robots; and three coordinate-free methods for decentralized mobile robot formation stabilization. The performance of the different methods is evaluated both in simulation and experimentally with real robotic platforms and vision sensors. Control of Multiple Robots Using Vision Sensors will serve both academic researchers studying visual control of single and multiple robots and robotics engineers seeking to design control systems based on visual sensors.