An Onboard Vision System for Unmanned Aerial Vehicle Guidance


Book Description

The viability of small Unmanned Aerial Vehicles (UAVs) as a stable platform for specific application use has been significantly advanced in recent years. Initial focus of lightweight UAV development was to create a craft capable of stable and controllable flight. This is largely a solved problem. Currently, the field has progressed to the point that unmanned aircraft can be carried in a backpack, launched by hand, weigh only a few pounds and be capable of navigating through unrestricted airspace.




Vision Guidance Controller for an Unmanned Aerial Vehicle


Book Description

The use of Unmanned Aerial Vehicles (UAVs) in modern military operations for reconnaissance and other missions continues to grow. UAV systems using remote control guidance are limited in range and subject to Electronic Warfare concerns. Guidance Systems using only Global Positioning Service (GPS) or an Inertial Navigation System (INS) are limited to a pre-programmed route of flight. A vision guidance system that can control the UAV over an arbitrary course is not subject to these limitations. This thesis uses classical control methods to develop and test an autonomous vision controller for the FOG-R UAV (FROG). First, a computer model of the camera output for a flight that tracks a river is made to develop the controller and to test it in nonlinear simulation. Finally, the complete system is flight tested on the FROG UAV. The design and test equipment include a highly modified FOG-R UAV from the U.S. Army, the MATRIXx Product Family of software tools developed by Integrated Systems, Inc., and a Ground Station built at NPS from commercially available computer and communication equipment.




Development and Implementation of New Control Law for Vision Based Target Tracking System Onboard Small Unmanned Aerial Vehicles


Book Description

A new control law is being developed and implemented for the Vision Based Target Tracking (VBTT) system onboard a small unmanned aerial vehicle (SUAV). The new control law allows for coordinated SUAV guidance and vision-based target tracking of stationary and moving targets in the presence of atmospheric disturbances and measurements noise. The new control law is tested for its performance and stability in both the theoretical 6DOF simulation and the Hardware-in-the-Loop (HIL) simulation. Principal results show that realistic measures of performance of the control law are continuous and exhibit predictable degradation of performance with increase of target speed. The results are encouraging and comparable among theoretical predictions, actual hardware simulation results, and initial flight testing. The control law development, implementation, and trial processes and procedures are also examined and categorically documented in this thesis as future reference on the subject development, as well as for better knowledge retention, continuation and proliferation of the VBTT system.




Selected papers from the 2nd International Symposium on UAVs, Reno, U.S.A. June 8-10, 2009


Book Description

In the last decade, signi?cant changes have occurred in the ?eld of vehicle motion planning, and for UAVs in particular. UAV motion planning is especially dif?cult due to several complexities not considered by earlier planning strategies: the - creased importance of differential constraints, atmospheric turbulence which makes it impossible to follow a pre-computed plan precisely, uncertainty in the vehicle state, and limited knowledge about the environment due to limited sensor capabilities. These differences have motivated the increased use of feedback and other control engineering techniques for motion planning. The lack of exact algorithms for these problems and dif?culty inherent in characterizing approximation algorithms makes it impractical to determine algorithm time complexity, completeness, and even soundness. This gap has not yet been addressed by statistical characterization of experimental performance of algorithms and benchmarking. Because of this overall lack of knowledge, it is dif?cult to design a guidance system, let alone choose the algorithm. Throughout this paper we keep in mind some of the general characteristics and requirements pertaining to UAVs. A UAV is typically modeled as having velocity and acceleration constraints (and potentially the higher-order differential constraints associated with the equations of motion), and the objective is to guide the vehicle towards a goal through an obstacle ?eld. A UAV guidance problem is typically characterized by a three-dimensional problem space, limited information about the environment, on-board sensors with limited range, speed and acceleration constraints, and uncertainty in vehicle state and sensor data.




Small Unmanned Aircraft


Book Description

Autonomous unmanned air vehicles (UAVs) are critical to current and future military, civil, and commercial operations. Despite their importance, no previous textbook has accessibly introduced UAVs to students in the engineering, computer, and science disciplines--until now. Small Unmanned Aircraft provides a concise but comprehensive description of the key concepts and technologies underlying the dynamics, control, and guidance of fixed-wing unmanned aircraft, and enables all students with an introductory-level background in controls or robotics to enter this exciting and important area. The authors explore the essential underlying physics and sensors of UAV problems, including low-level autopilot for stability and higher-level autopilot functions of path planning. The textbook leads the student from rigid-body dynamics through aerodynamics, stability augmentation, and state estimation using onboard sensors, to maneuvering through obstacles. To facilitate understanding, the authors have replaced traditional homework assignments with a simulation project using the MATLAB/Simulink environment. Students begin by modeling rigid-body dynamics, then add aerodynamics and sensor models. They develop low-level autopilot code, extended Kalman filters for state estimation, path-following routines, and high-level path-planning algorithms. The final chapter of the book focuses on UAV guidance using machine vision. Designed for advanced undergraduate or graduate students in engineering or the sciences, this book offers a bridge to the aerodynamics and control of UAV flight.




Imaging and Sensing for Unmanned Aircraft Systems


Book Description

This two-volume book set explores how sensors and computer vision technologies are used for the navigation, control, stability, reliability, guidance, fault detection, self-maintenance, strategic re-planning and reconfiguration of unmanned aircraft systems (UAS). Volume 1 concentrates on UAS control and performance methodologies including Computer Vision and Data Storage, Integrated Optical Flow for Detection and Avoidance Systems, Navigation and Intelligence, Modeling and Simulation, Multisensor Data Fusion, Vision in Micro-Aerial Vehicles (MAVs), Computer Vision in UAV using ROS, Security Aspects of UAV and Robot Operating System, Vision in Indoor and Outdoor Drones, Sensors and Computer Vision, and Small UAV for Persistent Surveillance. Volume 2 focuses on UAS deployment and applications including UAV-CPSs as a Testbed for New Technologies and a Primer to Industry 5.0, Human-Machine Interface Design, Open Source Software (OSS) and Hardware (OSH), Image Transmission in MIMO-OSTBC System, Image Database, Communications Requirements, Video Streaming, and Communications Links, Multispectral vs Hyperspectral Imaging, Aerial Imaging and Reconstruction of Infrastructures, Deep Learning as an Alternative to Super Resolution Imaging, and Quality of Experience (QoE) and Quality of Service (QoS).




Imaging and Sensing for Unmanned Aircraft Systems


Book Description

This two-volume book set explores how sensors and computer vision technologies are used for the navigation, control, stability, reliability, guidance, fault detection, self-maintenance, strategic re-planning and reconfiguration of unmanned aircraft systems (UAS). Volume 1 concentrates on UAS control and performance methodologies including Computer Vision and Data Storage, Integrated Optical Flow for Detection and Avoidance Systems, Navigation and Intelligence, Modeling and Simulation, Multisensor Data Fusion, Vision in Micro-Aerial Vehicles (MAVs), Computer Vision in UAV using ROS, Security Aspects of UAV and Robot Operating System, Vision in Indoor and Outdoor Drones, Sensors and Computer Vision, and Small UAV for Persistent Surveillance. Volume 2 focuses on UAS deployment and applications including UAV-CPSs as a Testbed for New Technologies and a Primer to Industry 5.0, Human-Machine Interface Design, Open Source Software (OSS) and Hardware (OSH), Image Transmission in MIMO-OSTBC System, Image Database, Communications Requirements, Video Streaming, and Communications Links, Multispectral vs Hyperspectral Imaging, Aerial Imaging and Reconstruction of Infrastructures, Deep Learning as an Alternative to Super Resolution Imaging, and Quality of Experience (QoE) and Quality of Service (QoS).




A Gimbal-supported, Mono Camera, Relative Position Measurement System of a Visually Distinct Object for UAV Guidance


Book Description

This thesis describes a vision-based system for measuring distance and bearing between an unmanned aerial vehicle (UAV) and a ground object. The system is built of a single camera, mounted on a gimbal, which stabilizes camera attitude. The novelty of this system is that it uses a single camera and tracks a single object on the ground, hence requiring less equipment compared to other types of vision-based navigation systems. Vision system data estimates are fed into the controller to stabilize aircraft on a circular orbit and to maintain fully automated flight, without GPS data. The system can be used as a backup in the case of GPS signal loss. In that case, the UAV will orbit a target until the signal is restored or manual input is received. We describe the hardware chosen to solve this problem and the image-processing and rectification algorithms that determine the position of the target. The position data is used to control the autopilot which was optimized for circling the target. The real flight test results for the system, installed on a fixed-wing UAV, are presented.




Hardware in the Loop Implementation of Adaptive Vision Based Guidance Law for Ground Target Tracking


Book Description

An adaptive guidance law of a Vision Based Target Tracking (VBTT) system was previously developed and implemented onboard a Small Unmanned Aerial Vehicle (SUAV) in order to track a ground target moving with a constant velocity. This work extends previous results by considering scenarios where the variation of target velocity, in both magnitude and direction, is used to excite the feedback control law for further robustness analysis. This provides essential insight on the sensitivity of the performance criteria indicated by the range holding capability, navigation error and the convergence speed of the guidance law. In addition, this thesis addresses the robustness of the SUAV guidance law to the generalized time delay in feedback due to, for example, data processing or communications lag. This thesis also extends the previously obtained results by introducing a multi-criteria optimization technique. The results obtained are first based on the numerical simulations implemented in SIMULINK and then in high fidelity HIL simulation environment with Piccolo Plus AP in the control loop. Initial steps in developing Vision Based HIL environment incorporating TASE gimbal, Piccolo Plus AP, Pan-Tilt unit and image processing software are presented. The work also includes motivation for the development, an overview of the existing technologies, and initial implementation of low-level driving mechanism (drivers) for the realistic representation of the real-world environment.




Guidance of Unmanned Aerial Vehicles


Book Description

Written by an expert with more than 30 years of experience, Guidance of Unmanned Aerial Vehicles contains new analytical results, taken from the author's research, which can be used for analysis and design of unmanned aerial vehicles guidance and control systems. This book progresses from a clear elucidation of guidance laws and unmanned aerial veh