Embedded Computer Vision


Book Description

As a graduate student at Ohio State in the mid-1970s, I inherited a unique c- puter vision laboratory from the doctoral research of previous students. They had designed and built an early frame-grabber to deliver digitized color video from a (very large) electronic video camera on a tripod to a mini-computer (sic) with a (huge!) disk drive—about the size of four washing machines. They had also - signed a binary image array processor and programming language, complete with a user’s guide, to facilitate designing software for this one-of-a-kindprocessor. The overall system enabled programmable real-time image processing at video rate for many operations. I had the whole lab to myself. I designed software that detected an object in the eldofview,trackeditsmovementsinrealtime,anddisplayedarunningdescription of the events in English. For example: “An object has appeared in the upper right corner...Itismovingdownandtotheleft...Nowtheobjectisgettingcloser...The object moved out of sight to the left”—about like that. The algorithms were simple, relying on a suf cient image intensity difference to separate the object from the background (a plain wall). From computer vision papers I had read, I knew that vision in general imaging conditions is much more sophisticated. But it worked, it was great fun, and I was hooked.




Embedded Vision


Book Description

An introductory guide for anyone who is interested in designing machines that have vision-enabled, embedded products, this book covers topics encountered in hardware architecture, software algorithms, applications, advancements in processors and sensors. --




Advances in Embedded Computer Vision


Book Description

This illuminating collection offers a fresh look at the very latest advances in the field of embedded computer vision. Emerging areas covered by this comprehensive text/reference include the embedded realization of 3D vision technologies for a variety of applications, such as stereo cameras on mobile devices. Recent trends towards the development of small unmanned aerial vehicles (UAVs) with embedded image and video processing algorithms are also examined. Topics and features: discusses in detail three major success stories – the development of the optical mouse, vision for consumer robotics, and vision for automotive safety; reviews state-of-the-art research on embedded 3D vision, UAVs, automotive vision, mobile vision apps, and augmented reality; examines the potential of embedded computer vision in such cutting-edge areas as the Internet of Things, the mining of large data streams, and in computational sensing; describes historical successes, current implementations, and future challenges.




Computer Vision Metrics


Book Description

Computer Vision Metrics provides an extensive survey and analysis of over 100 current and historical feature description and machine vision methods, with a detailed taxonomy for local, regional and global features. This book provides necessary background to develop intuition about why interest point detectors and feature descriptors actually work, how they are designed, with observations about tuning the methods for achieving robustness and invariance targets for specific applications. The survey is broader than it is deep, with over 540 references provided to dig deeper. The taxonomy includes search methods, spectra components, descriptor representation, shape, distance functions, accuracy, efficiency, robustness and invariance attributes, and more. Rather than providing ‘how-to’ source code examples and shortcuts, this book provides a counterpoint discussion to the many fine opencv community source code resources available for hands-on practitioners.




Machine Vision Algorithms and Applications


Book Description

The second edition of this successful machine vision textbook is completely updated, revised and expanded by 35% to reflect the developments of recent years in the fields of image acquisition, machine vision algorithms and applications. The new content includes, but is not limited to, a discussion of new camera and image acquisition interfaces, 3D sensors and technologies, 3D reconstruction, 3D object recognition and state-of-the-art classification algorithms. The authors retain their balanced approach with sufficient coverage of the theory and a strong focus on applications. All examples are based on the latest version of the machine vision software HALCON 13.




Design for Embedded Image Processing on FPGAs


Book Description

Dr Donald Bailey starts with introductory material considering the problem of embedded image processing, and how some of the issues may be solved using parallel hardware solutions. Field programmable gate arrays (FPGAs) are introduced as a technology that provides flexible, fine-grained hardware that can readily exploit parallelism within many image processing algorithms. A brief review of FPGA programming languages provides the link between a software mindset normally associated with image processing algorithms, and the hardware mindset required for efficient utilization of a parallel hardware design. The design process for implementing an image processing algorithm on an FPGA is compared with that for a conventional software implementation, with the key differences highlighted. Particular attention is given to the techniques for mapping an algorithm onto an FPGA implementation, considering timing, memory bandwidth and resource constraints, and efficient hardware computational techniques. Extensive coverage is given of a range of low and intermediate level image processing operations, discussing efficient implementations and how these may vary according to the application. The techniques are illustrated with several example applications or case studies from projects or applications he has been involved with. Issues such as interfacing between the FPGA and peripheral devices are covered briefly, as is designing the system in such a way that it can be more readily debugged and tuned. Provides a bridge between algorithms and hardware Demonstrates how to avoid many of the potential pitfalls Offers practical recommendations and solutions Illustrates several real-world applications and case studies Allows those with software backgrounds to understand efficient hardware implementation Design for Embedded Image Processing on FPGAs is ideal for researchers and engineers in the vision or image processing industry, who are looking at smart sensors, machine vision, and robotic vision, as well as FPGA developers and application engineers. The book can also be used by graduate students studying imaging systems, computer engineering, digital design, circuit design, or computer science. It can also be used as supplementary text for courses in advanced digital design, algorithm and hardware implementation, and digital signal processing and applications. Companion website for the book: www.wiley.com/go/bailey/fpga




Advances in Embedded Computer Vision


Book Description

This illuminating collection offers a fresh look at the very latest advances in the field of embedded computer vision. Emerging areas covered by this comprehensive text/reference include the embedded realization of 3D vision technologies for a variety of applications, such as stereo cameras on mobile devices. Recent trends towards the development of small unmanned aerial vehicles (UAVs) with embedded image and video processing algorithms are also examined. Topics and features: discusses in detail three major success stories – the development of the optical mouse, vision for consumer robotics, and vision for automotive safety; reviews state-of-the-art research on embedded 3D vision, UAVs, automotive vision, mobile vision apps, and augmented reality; examines the potential of embedded computer vision in such cutting-edge areas as the Internet of Things, the mining of large data streams, and in computational sensing; describes historical successes, current implementations, and future challenges.




Vision Chips


Book Description

This chapter presents a set of introductory material, which in addition to providing a general view on the topic, highlights the importance of research in this area. It also presents a short history of the design of smart vision sensors, and points out some of the fundamental issues in the design of such sensors. 1. 1 A General Overview Machine vision is one of the main branches of artificial intelligence. The richness of information present in images makes them the first choice as an input to an artificial system which tries to interact with its environment. A large proportion of the brain of many advanced species is dedicated to visual information processing, which illustrates the importance of visual information in biological systems. Biological visual systems have evolved over millions of years, and each specie has developed a specialized visual system tailored for the essential tasks of survival, such as catching a prey, or escaping a predator. Implementing electronic hardware for image processing, therefore, may benefit from the underlying fundamental aspects of biological vision, though in no respect should this be regarded as a solid framework for electronic vision systems. Traditionally, computer vision algorithms are performed on images captured by conventional cameras, and processing is accomplished by means of general purpose digital computers. More advanced systems utilize dedicated hardware to speed up the processing stage.




TinyML


Book Description

Deep learning networks are getting smaller. Much smaller. The Google Assistant team can detect words with a model just 14 kilobytes in size—small enough to run on a microcontroller. With this practical book you’ll enter the field of TinyML, where deep learning and embedded systems combine to make astounding things possible with tiny devices. Pete Warden and Daniel Situnayake explain how you can train models small enough to fit into any environment. Ideal for software and hardware developers who want to build embedded systems using machine learning, this guide walks you through creating a series of TinyML projects, step-by-step. No machine learning or microcontroller experience is necessary. Build a speech recognizer, a camera that detects people, and a magic wand that responds to gestures Work with Arduino and ultra-low-power microcontrollers Learn the essentials of ML and how to train your own models Train models to understand audio, image, and accelerometer data Explore TensorFlow Lite for Microcontrollers, Google’s toolkit for TinyML Debug applications and provide safeguards for privacy and security Optimize latency, energy usage, and model and binary size




Computer Vision Metrics


Book Description

Based on the successful 2014 book published by Apress, this textbook edition is expanded to provide a comprehensive history and state-of-the-art survey for fundamental computer vision methods and deep learning. With over 800 essential references, as well as chapter-by-chapter learning assignments, both students and researchers can dig deeper into core computer vision topics and deep learning architectures. The survey covers everything from feature descriptors, regional and global feature metrics, feature learning architectures, deep learning, neuroscience of vision, neural networks, and detailed example architectures to illustrate computer vision hardware and software optimization methods. To complement the survey, the textbook includes useful analyses which provide insight into the goals of various methods, why they work, and how they may be optimized. The text delivers an essential survey and a valuable taxonomy, thus providing a key learning tool for students, researchers and engineers, to supplement the many effective hands-on resources and open source projects, such as OpenCV and other imaging and deep learning tools.