Probabilistic modeling for sensor fusion with inertial measurements


Book Description

In recent years, inertial sensors have undergone major developments. The quality of their measurements has improved while their cost has decreased, leading to an increase in availability. They can be found in stand-alone sensor units, so-called inertial measurement units, but are nowadays also present in for instance any modern smartphone, in Wii controllers and in virtual reality headsets. The term inertial sensor refers to the combination of accelerometers and gyroscopes. These measure the external specific force and the angular velocity, respectively. Integration of their measurements provides information about the sensor's position and orientation. However, the position and orientation estimates obtained by simple integration suffer from drift and are therefore only accurate on a short time scale. In order to improve these estimates, we combine the inertial sensors with additional sensors and models. To combine these different sources of information, also called sensor fusion, we make use of probabilistic models to take the uncertainty of the different sources of information into account. The first contribution of this thesis is a tutorial paper that describes the signal processing foundations underlying position and orientation estimation using inertial sensors. In a second contribution, we use data from multiple inertial sensors placed on the human body to estimate the body's pose. A biomechanical model encodes the knowledge about how the different body segments are connected to each other. We also show how the structure inherent to this problem can be exploited. This opens up for processing long data sets and for solving the problem in a distributed manner. Inertial sensors can also be combined with time of arrival measurements from an ultrawideband (UWB) system. We focus both on calibration of the UWB setup and on sensor fusion of the inertial and UWB measurements. The UWB measurements are modeled by a tailored heavy-tailed asymmetric distribution. This distribution naturally handles the possibility of measurement delays due to multipath and non-line-of-sight conditions while not allowing for the possibility of measurements arriving early, i.e. traveling faster than the speed of light. Finally, inertial sensors can be combined with magnetometers. We derive an algorithm that can calibrate a magnetometer for the presence of metallic objects attached to the sensor. Furthermore, the presence of metallic objects in the environment can be exploited by using them as a source of position information. We present a method to build maps of the indoor magnetic field and experimentally show that if a map of the magnetic field is available, accurate position estimates can be obtained by combining inertial and magnetometer measurements.







Robust Human Motion Tracking Using Wireless and Inertial Sensors


Book Description

Recently, miniature inertial measurement units (IMUs) have been deployed as wearable devices to monitor human motion in an ambulatory fashion. This thesis presents a robust human motion tracking algorithm using the IMU and radio-based wireless sensors, such as the Bluetooth Low Energy (BLE) and ultra-wideband (UWB). First, a novel indoor localization method using the BLE and IMU is proposed. The BLE trilateration residue is deployed to adaptively weight the estimates from these sensor modalities. Second, a robust sensor fusion algorithm is developed to accurately track the location and capture the lower body motion by integrating the estimates from the UWB system and IMUs, but also taking advantage of the estimated height and velocity obtained from an aiding lower body biomechanical model. The experimental results show that the proposed algorithms can maintain high accuracy for tracking the location of a sensor/subject in the presence of the BLE/UWB outliers and signal outages.




Statistical Sensor Fusion


Book Description




Antenna and Sensor Technologies in Modern Medical Applications


Book Description

A guide to the theory and recent development in the medical use of antenna technology Antenna and Sensor Technologies in Modern Medical Applications offers a comprehensive review of the theoretical background, design, and the latest developments in the application of antenna technology. Written by two experts in the field, the book presents the most recent research in the burgeoning field of wireless medical telemetry and sensing that covers both wearable and implantable antenna and sensor technologies. The authors review the integrated devices that include various types of sensors wired within a wearable garment that can be paired with external devices. The text covers important developments in sensor-integrated clothing that are synonymous with athletic apparel with built-in electronics. Information on implantable devices is also covered. The book explores technologies that utilize both inductive coupling and far field propagation. These include minimally invasive microwave ablation antennas, wireless targeted drug delivery, and much more. This important book: Covers recent developments in wireless medical telemetry Reviews the theory and design of in vitro/in vivo testing Explores emerging technologies in 2D and 3D printing of antenna/sensor fabrication Includes a chapter with an annotated list of the most comprehensive and important references in the field Written for students of engineering and antenna and sensor engineers, Antenna and Sensor Technologies in Modern Medical Applications is an essential guide to understanding human body interaction with antennas and sensors.




Time-of-Flight and Depth Imaging. Sensors, Algorithms and Applications


Book Description

Cameras for 3D depth imaging, using either time-of-flight (ToF) or structured light sensors, have received a lot of attention recently and have been improved considerably over the last few years. The present techniques make full-range 3D data available at video frame rates, and thus pave the way for a much broader application of 3D vision systems. A series of workshops have closely followed the developments within ToF imaging over the years. Today, depth imaging workshops can be found at every major computer vision conference. The papers presented in this volume stem from a seminar on Time-of-Flight Imaging held at Schloss Dagstuhl in October 2012. They cover all aspects of ToF depth imaging, from sensors and basic foundations, to algorithms for low level processing, to important applications that exploit depth imaging. In addition, this book contains the proceedings of a workshop on Imaging New Modalities, which was held at the German Conference on Pattern Recognition in Saarbrücken, Germany, in September 2013. A state-of-the-art report on the Kinect sensor and its applications is followed by two reports on local and global ToF motion compensation and a novel depth capture system using a plenoptic multi-lens multi-focus camera sensor.




Inertial and Magnetic Tracking of Limb Segment Orientation for Inserting Humans Into Synthetic Environments


Book Description

Current motion tracking technologies fail to provide accurate wide area tracking of multiple users without interference and occlusion problems. This research proposes to overcome current limitations using nine-axis magnetic/ angular/rate/gravity (MARG) sensors combined with a quaternion-based complementary filter algorithm capable of continuously correcting for drift and following angular motion through all orientations without singularities. Primarily, this research involves the development of a prototype tracking system to demonstrate the feasibility of MARG sensor body motion tracking Mathematical analysis and computer simulation are used to validate the correctness of the complementary filter algorithm The implemented human body model utilizes the world-coordinate reference frame orientation data provided in quaternion form by the complementary filter and orients each limb segment independently. Calibration of the model and the inertial sensors is accomplished using simple but effective algorithms. Physical experiments demonstrate the utility of the proposed system by tracking of human limbs in real-time using multiple MARG sensors. The system is "sourceless" and does not suffer from range restrictions and interference problems. This new technology overcomes the limitations of motion tracking technologies currently in use. It has the potential to provide wide area tracking of multiple users in virtual environment and augmented reality applications.




Human Motion Analysis with Wearable Inertial Sensors


Book Description

High-resolution, quantitative data obtained by a human motion capture system can be used to better understand the cause of many diseases for effective treatments. Talking about the daily care of the aging population, two issues are critical. One is to continuously track motions and position of aging people when they are at home, inside a building or in the unknown environment; the other is to monitor their health status in real time when they are in the free-living environment. Continuous monitoring of human movement in their natural living environment potentially provide more valuable feedback than these in laboratory settings. However, it has been extremely challenging to go beyond laboratory and obtain accurate measurements of human physical activity in free-living environments. Commercial motion capture systems produce excellent in-studio capture and reconstructions, but offer no comparable solution for acquisition in everyday environments. Therefore in this dissertation, a wearable human motion analysis system is developed for continuously tracking human motions, monitoring health status, positioning human location and recording the itinerary. In this dissertation, two systems are developed for seeking aforementioned two goals: tracking human body motions and positioning a human. Firstly, an inertial-based human body motion tracking system with our developed inertial measurement unit (IMU) is introduced. By arbitrarily attaching a wearable IMU to each segment, segment motions can be measured and translated into inertial data by IMUs. A human model can be reconstructed in real time based on the inertial data by applying high efficient twists and exponential maps techniques. Secondly, for validating the feasibility of developed tracking system in the practical application, model-based quantification approaches for resting tremor and lower extremity bradykinesia in Parkinson's disease are proposed. By estimating all involved joint angles in PD symptoms based on reconstructed human model, angle characteristics with corresponding medical ratings are employed for training a HMM classifier for quantification. Besides, a pedestrian positioning system is developed for tracking user's itinerary and positioning in the global frame. Corresponding tests have been carried out to assess the performance of each system.




Wearable Sensor System for Human Localization and Motion Capture


Book Description

Recent advances in MEMS wearable inertial/magnetic sensors and mobile computing have fostered a dramatic growth of interest for ambulatory human motion capture (MoCap). Compared to traditional optical MoCap systems such as the optical systems, inertial (i.e. accelerometer and gyroscope) and magnetic sensors do not require external fixtures such as cameras. Hence, they do not have in-the-lab measurement limitations and thus are ideal for ambulatory applications. However, due to the manufacturing process of MEMS sensors, existing wearable MoCap systems suffer from drift error and accuracy degradation over time caused by time-varying bias. The goal of this research is to develop algorithms based on multi-sensor fusion and machine learning techniques for precise tracking of human motion and location using wearable inertial sensors integrated with absolute localization technologies. The main focus of this research is on true ambulatory applications in active sports (e.g., skiing) and entertainment (e.g., gaming and filmmaking), and health-status monitoring. For active sports and entertainment applications, a novel sensor fusion algorithm is developed to fuse inertial data with magnetic field information and provide drift-free estimation of human body segment orientation. This concept is further extended to provide ubiquitous indoor/outdoor localization by fusing wearable inertial/magnetic sensors with global navigation satellite system (GNSS), barometric pressure sensor and ultra-wideband (UWB) localization technology. For health applications, this research is focused on longitudinal tracking of walking speed as a fundamental indicator of human well-being. A regression model is developed to map inertial information from a single waist or ankle-worn sensor to walking speed. This approach is further developed to estimate walking speed using a wrist-worn device (e.g., a smartwatch) by extracting the arm swing motion intensity and frequency by combining sensor fusion and principal component analysis.