Hybrid Deep Learning: how Combining Data-driven and Model-based Approaches Solves Inverse Problems in Computed Tomography and Beyond


Book Description

Artificial neural networks from the field of deep learning are increasingly becoming the state of the art in more and more applications. Their success is based on learning complex relationships in a system purely from data. For this, the data-driven networks often require hundreds of thousands of reference examples. They are contrasted by model-based approaches that use mathematical methods to describe the processes in a system. They work without large amounts of data but often cannot cover all the nuances of an application. In inverse problems, model-based approaches have been the standard so far. Here, the necessary amount of data to use purely data-driven deep learning is usually unavailable. In addition, requirements are placed on the model properties that cannot always be proven for classical neural networks. Hybrid deep learning models that combine data-driven and model-based approaches can solve these challenges. In recent years, their research has steadily gained importance. In this thesis, several hybrid deep learning approaches for solving inverse problems are presented and further developed. These include the deep image prior (DIP) and conditional invertible neural networks (CINN). The reconstruction problem in computed tomography (CT) serves as a central example to compare the models with each other, as well as to reveal their strengths and weaknesses. This is done in particular concerning the unique challenges in inverse problems, such as lack of data and ill-posedness. For this purpose, a realistic medical CT dataset is presented and used. The performed comparison for medical and industrial data clearly shows that the hybrid approaches are superior to the classical, model-based methods in many areas. Countless applications from inverse problems can thus already benefit from hybrid deep learning approaches.




Advances in Hybridization of Intelligent Methods


Book Description

This book presents recent research on the hybridization of intelligent methods, which refers to combining methods to solve complex problems. It discusses hybrid approaches covering different areas of intelligent methods and technologies, such as neural networks, swarm intelligence, machine learning, reinforcement learning, deep learning, agent-based approaches, knowledge-based system and image processing. The book includes extended and revised versions of invited papers presented at the 6th International Workshop on Combinations of Intelligent Methods and Applications (CIMA 2016), held in The Hague, Holland, in August 2016. The book is intended for researchers and practitioners from academia and industry interested in using hybrid methods for solving complex problems.




The Combination of Data-Driven Machine Learning Approaches and Prior Knowledge for Robust Medical Image Processing and Analysis


Book Description

With the availability of big image datasets and state-of-the-art computing hardware, data-driven machine learning approaches, particularly deep learning, have been used in numerous medical image (CT-scans, MRI, PET, SPECT, etc..) computing tasks, ranging from image reconstruction, super-resolution, segmentation, registration all the way to disease classification and survival prediction. However, training such high-precision approaches often require large amounts of data to be collected and labelled and high-capacity graphics processing units (GPUs) installed, which are resource intensive and hence not always practical. Other hurdles such as the generalization ability to unseen new data and difficulty to interpret and explain can prevent their deployment to those clinical applications which deem such abilities imperative.




Deep Learning for Biomedical Image Reconstruction


Book Description

Discover the power of deep neural networks for image reconstruction with this state-of-the-art review of modern theories and applications. The background theory of deep learning is introduced step-by-step, and by incorporating modeling fundamentals this book explains how to implement deep learning in a variety of modalities, including X-ray, CT, MRI and others. Real-world examples demonstrate an interdisciplinary approach to medical image reconstruction processes, featuring numerous imaging applications. Recent clinical studies and innovative research activity in generative models and mathematical theory will inspire the reader towards new frontiers. This book is ideal for graduate students in Electrical or Biomedical Engineering or Medical Physics.




Learning Robust Data-driven Methods for Inverse Problems and Change Detection


Book Description

The field of image reconstruction and inverse problems in imaging have been revolutionized by the introduction of methods which learn to solve inverse problems. This thesis investigates a variety of methods for learning to solve inverse problems by leveraging data: first by exploring the online sparse linear bandit setting, and then by investigating modern methods for leveraging training data to learn to solve inverse problems. In addition, this thesis explores a multi-model method of leveraging human descriptions of change in time series of images to regularize a graph-cut-based change-point detection method. Recent research into learning to solve inverse problems has been dominated by "unrolled optimization" approaches, which unroll a fixed number of iterations of an iterative optimization algorithm, replacing one or more elements of that algorithm with a neural network. These methods have several attractive properties: they can leverage even limited training data to learn accurate reconstructions, they tend to have lower runtime and require fewer iterations than more standard methods which leverage non-learned regularizers, and they are simple to implement and understand. However, learned iterative methods, like most learned inverse problem solvers, are sensitive to small changes in the data measurement model; they are uninterpretable, suffering reduced reconstruction quality if run for more or fewer iterations than were used at train time; and they are limited by memory and numerical constraints to small numbers of iterations, potentially lowering the ceiling for best available reconstruction quality using these methods. This thesis proposes an alternative architecture design based on a Neumann series, which is attractive from a practical perspective for its sample complexity performance and ease to train compared to methods based on unrolled iterative optimization. In addition, this thesis proposes and tests two techniques to adapt arbitrary trained inverse problem solvers to different measurement models, enabling deployment of a single learned model on a variety of forward models without sacrificing performance or requiring potentially-costly new data. Finally, this thesis demonstrates how to train iterative solvers that are unrolled for an arbitrary number of iterations. The proposed technique for the first time permits deep iterative solvers that admit practical convergence guarantees, while allowing flexibility in trading off computation for performance.




Data-driven Sparse Computational Imaging with Deep Learning


Book Description

Typically, inverse imaging problems deal with the reconstruction of images from the sensor measurements where sensors can take form of any imaging modality like camera, radar, hyperspectral or medical imaging systems. In an ideal scenario, we can reconstruct the images via applying an inversion procedure from these sensors’ measurements, but practical applications have several challenges: the measurement acquisition process is heavily corrupted by the noise, the forward model is not exactly known, and non-linearities or unknown physics of the data acquisition play roles. Hence, perfect inverse function is not exactly known for immaculate image reconstruction. To this end, in this dissertation, I propose an automatic sensing and reconstruction scheme based on deep learning within the compressive sensing (CS) framework to solve the computational imaging problems. Here, I develop a data-driven approach to learn both the measurement matrix and the inverse reconstruction scheme for a given class of signals, such as images. This approach paves the way for end-to-end learning and reconstruction of signals with the aid of cascaded fully connected and multistage convolutional layers with a weighted loss function in an adversarial learning framework. I also propose to extend our analysis to introduce data driven models to directly classify from compressed measurements through joint reconstruction and classification. I develop constrained measurement learning framework and demonstrate higher performance of the proposed approach in the field of typical image reconstruction and hyperspectral image classification tasks. Finally, I also propose a single data driven network that can take and reconstruct images at multiple rates of signal acquisition. In summary, this dissertation proposes novel methods on the data driven measurement acquisition for sparse signal reconstruction and classification, learning measurements for given constraints underlying the requirement of the hardware for different applications, and producing a common data driven platform for learning measurements to reconstruct signals at multiple rates. This dissertation opens the path to the learned sensing systems. The future research can use these proposed data driven approaches as the pivotal factors to accomplish task-specific smart sensors in several real-world applications.







Deep Learning in Healthcare


Book Description

This book provides a comprehensive overview of deep learning (DL) in medical and healthcare applications, including the fundamentals and current advances in medical image analysis, state-of-the-art DL methods for medical image analysis and real-world, deep learning-based clinical computer-aided diagnosis systems. Deep learning (DL) is one of the key techniques of artificial intelligence (AI) and today plays an important role in numerous academic and industrial areas. DL involves using a neural network with many layers (deep structure) between input and output, and its main advantage of is that it can automatically learn data-driven, highly representative and hierarchical features and perform feature extraction and classification on one network. DL can be used to model or simulate an intelligent system or process using annotated training data. Recently, DL has become widely used in medical applications, such as anatomic modelling, tumour detection, disease classification, computer-aided diagnosis and surgical planning. This book is intended for computer science and engineering students and researchers, medical professionals and anyone interested using DL techniques.




Deep Learning for Medical Applications with Unique Data


Book Description

Deep Learning for Medical Applications with Unique Data informs readers about the most recent deep learning-based medical applications in which only unique data gathered in real cases are used. The book provides examples of how deep learning can be used in different problem areas and frameworks in both clinical and research settings, including medical image analysis, medical image registration, time series analysis, medical data synthesis, drug discovery, and pre-processing operations. The volume discusses not only positive findings, but also negative ones obtained by deep learning techniques, including the use of newly developed deep learning techniques rarely reported in the existing literature. The book excludes research works with ready data sets and includes only unique data use to better understand the state of deep learning in real-world cases, along with the feedback and user experiences from physicians and medical staff for applied deep learning-based solutions. Other applications presented in the book include hybrid solutions with deep learning support, disease diagnosis with deep learning focusing on rare diseases and cancer, patient care and treatment, genomics research, as well as research on robotics and autonomous systems. - Introduces deep learning, demonstrating concepts for a wide variety of medical applications using unique data, excluding research with ready datasets - Encompasses a wide variety of biomedical applications, including unsupervised learning, natural language processing, pattern recognition, image and video processing and disease diagnosis - Provides a robust set of methods that will help readers appropriately and judiciously use the most suitable deep learning techniques for their applications




Machine Learning Refined


Book Description

An intuitive approach to machine learning covering key concepts, real-world applications, and practical Python coding exercises.