The high dynamic range imaging pipeline


Book Description

Techniques for high dynamic range (HDR) imaging make it possible to capture and store an increased range of luminances and colors as compared to what can be achieved with a conventional camera. This high amount of image information can be used in a wide range of applications, such as HDR displays, image-based lighting, tone-mapping, computer vision, and post-processing operations. HDR imaging has been an important concept in research and development for many years. Within the last couple of years it has also reached the consumer market, e.g. with TV displays that are capable of reproducing an increased dynamic range and peak luminance. This thesis presents a set of technical contributions within the field of HDR imaging. First, the area of HDR video tone-mapping is thoroughly reviewed, evaluated and developed upon. A subjective comparison experiment of existing methods is performed, followed by the development of novel techniques that overcome many of the problems evidenced by the evaluation. Second, a largescale objective comparison is presented, which evaluates existing techniques that are involved in HDR video distribution. From the results, a first open-source HDR video codec solution, Luma HDRv, is built using the best performing techniques. Third, a machine learning method is proposed for the purpose of reconstructing an HDR image from one single-exposure low dynamic range (LDR) image. The method is trained on a large set of HDR images, using recent advances in deep learning, and the results increase the quality and performance significantly as compared to existing algorithms. The areas for which contributions are presented can be closely inter-linked in the HDR imaging pipeline. Here, the thesis work helps in promoting efficient and high-quality HDR video distribution and display, as well as robust HDR image reconstruction from a single conventional LDR image.




High Dynamic Range Video


Book Description

At the time of rapid technological progress and uptake of High Dynamic Range (HDR) video content in numerous sectors, this book provides an overview of the key supporting technologies, discusses the effectiveness of various techniques, reviews the initial standardization efforts and explores new research directions in all aspects involved in HDR video systems. Topics addressed include content acquisition and production, tone mapping and inverse tone mapping operators, coding, quality of experience, and display technologies. This book also explores a number of applications using HDR video technologies in the automotive industry, medical imaging, spacecraft imaging, driving simulation and watermarking. By covering general to advanced topics, along with a broad and deep analysis, this book is suitable for both the researcher new or familiar to the area. With this book the reader will: - Gain a broad understanding of all the elements in the HDR video processing chain - Learn the most recent results of ongoing research - Understand the challenges and perspectives for HDR video technologies - Covers a broad range of topics encompassing the whole processing chain in HDR video systems, from acquisition to display - Provides a comprehensive overview of this fast emerging topic - Presents upcoming applications taking advantages of HDR




High Dynamic Range Video


Book Description

High Dynamic Range Video: Concepts, Technologies and Applications gives an introduction to a full range of topics within the end-to-end HDR video pipeline, covering the issues around capturing HDR and stereo HDR video, such as ghosting and use of legacy LDR systems, how HDR video can be manipulated, including real-time mixing, the very latest designs for HDR displays, HDR video on mobile devices, and the applications of HDR video. With this book, the reader will gain an overview of the current state-of-the art of HDR video, learn the potential of HDR video to provide a step change to a wide range of imaging applications, and attain the knowledge needed to introduce HDR video in their own applications. - Written by experts who have been actively researching High Dynamic Range Video - Covers a full range of topics within the end-to-end HDR video pipeline - Provides applications that demonstrate how HDR video can be applied




High Dynamic Range Imaging


Book Description

High Dynamic Range Imaging, Second Edition, is an essential resource for anyone working with images, whether it is for computer graphics, film, video, photography, or lighting design. It describes HDRI technology in its entirety and covers a wide-range of topics, from capture devices to tone reproduction and image-based lighting. The techniques described enable students to produce images that have a dynamic range much closer to that found in the real world, leading to an unparalleled visual experience. This revised edition includes new chapters on High Dynamic Range Video Encoding, High Dynamic Range Image Encoding, and High Dynamic Range Display Devices. All existing chapters have been updated to reflect the current state-of-the-art technology. As both an introduction to the field and an authoritative technical reference, this book is essential for anyone working with images, whether in computer graphics, film, video, photography, or lighting design. - New material includes chapters on High Dynamic Range Video Encoding, High Dynamic Range Image Encoding, and High Dynammic Range Display Devices - Written by the inventors and initial implementors of High Dynamic Range Imaging - Covers the basic concepts (including just enough about human vision to explain why HDR images are necessary), image capture, image encoding, file formats, display techniques, tone mapping for lower dynamic range display, and the use of HDR images and calculations in 3D rendering - Range and depth of coverage is good for the knowledgeable researcher as well as those who are just starting to learn about High Dynamic Range imaging - The prior edition of this book included a DVD-ROM. Files from the DVD-ROM can be accessed at: http://www.erikreinhard.com/hdr_2nd/index.html




Advanced High Dynamic Range Imaging


Book Description

Imaging techniques seek to simulate the array of light that reaches our eyes to provide the illusion of sensing scenes directly. Both photography and computer graphics deal with the generation of images. Both disciplines have to cope with the high dynamic range in the energy of visible light that human eyes can sense. Traditionally photography and computer graphics took different approaches to the high dynamic range problem. Work over the last ten years though has unified these disciplines and created powerful new tools for the creation of complex, compelling and realistic images. This book provides a practical introduction to the emerging new discipline of high dynamic range imaging that combines photography and computer graphics. By providing detailed equations and code, the book gives the reader the tools needed to experiment with new techniques for creating compelling images. A supplemental website contains downloads and additional information.




High Dynamic Range Video


Book Description

As new displays and cameras offer enhanced color capabilities, there is a need to extend the precision of digital content. High Dynamic Range (HDR) imaging encodes images and video with higher than normal 8 bit-per-color-channel precision, enabling representation of the complete color gamut and the full visible range of luminance.However, to realize transition from the traditional toHDRimaging, it is necessary to develop imaging algorithms that work with the high-precision data. Tomake such algorithms effective and feasible in practice, it is necessary to take advantage of the limitations of the human visual system by aligning the data shortcomings to those of the human eye, thus limiting storage and processing precision. Therefore, human visual perception is the key component of the solutions we discuss in this book. This book presents a complete pipeline forHDR image and video processing fromacquisition, through compression and quality evaluation, to display. At the HDR image and video acquisition stage specialized HDR sensors or multi-exposure techniques suitable for traditional cameras are discussed. Then, we present a practical solution for pixel values calibration in terms of photometric or radiometric quantities, which are required in some technically oriented applications. Also, we cover the problem of efficient image and video compression and encoding either for storage or transmission purposes, including the aspect of backward compatibility with existing formats. Finally, we review existing HDR display technologies and the associated problems of image contrast and brightness adjustment. For this purpose tone mapping is employed to accommodate HDR content to LDR devices. Conversely, the so-called inverse tone mapping is required to upgrade LDR content for displaying on HDR devices. We overview HDR-enabled image and video quality metrics, which are needed to verify algorithms at all stages of the pipeline. Additionally, we cover successful examples of the HDR technology applications, in particular, in computer graphics and computer vision. The goal of this book is to present all discussed components of the HDR pipeline with the main focus on video. For some pipeline stages HDR video solutions are either not well established or do not exist at all, in which case we describe techniques for single HDR images. In such cases we attempt to select the techniques, which can be extended into temporal domain. Whenever needed, relevant background information on human perception is given, which enables better understanding of the design choices behind the discussed algorithms and HDR equipment. Table of Contents: Introduction / Representation of an HDR Image / HDR Image and Video Acquisition / HDR Image Quality / HDR Image, Video, and Texture Compression / Tone Reproduction / HDR Display Devices / LDR2HDR: Recovering Dynamic Range in Legacy Content / HDRI in Computer Graphics / Software




Computational Science – ICCS 2008


Book Description

The three-volume set LNCS 5101-5103 constitutes the refereed proceedings of the 8th International Conference on Computational Science, ICCS 2008, held in Krakow, Poland in June 2008. The 167 revised papers of the main conference track presented together with the abstracts of 7 keynote talks and the 100 revised papers from 14 workshops were carefully reviewed and selected for inclusion in the three volumes. The main conference track was divided into approximately 20 parallel sessions addressing topics such as e-science applications and systems, scheduling and load balancing, software services and tools, new hardware and its applications, computer networks, simulation of complex systems, image processing and visualization, optimization techniques, numerical linear algebra, and numerical algorithms. The second volume contains workshop papers related to various computational research areas, e.g.: computer graphics and geometric modeling, simulation of multiphysics multiscale systems, computational chemistry and its applications, computational finance and business intelligence, physical, biological and social networks, geocomputation, and teaching computational science. The third volume is mostly related to computer science topics such as bioinformatics' challenges to computer science, tools for program development and analysis in computational science, software engineering for large-scale computing, collaborative and cooperative environments, applications of workflows in computational science, as well as intelligent agents and evolvable systems.




The HDRI Handbook 2.0


Book Description

! BONUS DVD ONLY WITH THE PRINT EDITION (NOT AVAILABLE WITH eBOOKS) ! In 2007, The HDRI Handbook was the first book to present this revolutionary new field to a larger audience. These days HDRI is a fully mature technology available to everyone. Real estate and landscape photographers have adopted it as part of their regular workflow, it has become one of the hottest trends for ambitious amateurs and creative professionals alike, and the modern movie industry would be completely dysfunctional without it. Now The HDRI Handbook 2.0 redefines its own gold standard. It has been completely rewritten and is packed with practical hints and tips, background knowledge, reference tools, breathtaking artist portfolios, and inspiring interviews. The book includes dozens of new step-by-step tutorials. Beginners will get a methodically solid introduction and advanced readers will be able to refine their technique to perfection. Topics include:- Understanding the foundation of HDRI- HDR software comparisons and evaluations- Capturing HDR images: today and tomorrow- Tonemapping for creating superior prints- HDR image processing and compositing- Shooting and stitching HDR panoramas- Image-based lighting and CG rendering 2.0 updates include:- New cameras, sensors, and HDR beamsplitter rigs- Open Camera Controller for endless auto-bracketing- Correct RAW pre-processing and ghost removal- Dozens of practical, easy-to-follow tutorials- A structured approach to tonemapping, inspired by Ansel Adams- Set etiquette and tips for capturing HDR panos for visual effects- Seven artist spotlights showing unique perspectives on HDRI- Seven crossword puzzles: a fun way to test yourself ! BONUS DVD ONLY WITH THE PRINT EDITION (NOT AVAILABLE WITH eBOOKS) !




High-Dynamic-Range (HDR) Vision


Book Description

This first comprehensive account of high-dynamic-range (HDR) vision focuses on HDR real-time, high-speed digital video recording and also systematically presents HDR video transmission and display. While the book conveys the overall picture of HDR vision, specific knowledge of microelectronics and image processing is not required. In this book, experts share their knowledge in this rapidly evolving art related to the single most powerful of our senses.




Computational Photography


Book Description

The introduction and recent advancements of computational photography have revolutionized the imaging industry. Computational photography is a combination of imaging techniques at the intersection of various fields such as optics, computer vision, and computer graphics. These methods enhance the capabilities of traditional digital photography by applying computational techniques both during and after the capturing process. This thesis targets two major subjects in this field: High Dynamic Range (HDR) image reconstruction and Light Field (LF) compressive capturing, compression, and real-time rendering. The first part of the thesis focuses on the HDR images that concurrently contain detailed information from the very dark shadows to the brightest areas in the scenes. One of the main contributions presented in this thesis is the development of a unified reconstruction algorithm for spatially variant exposures in a single image. This method is based on a camera noise model, and it simultaneously resamples, reconstructs, denoises, and demosaics the image while extending its dynamic range. Furthermore, the HDR reconstruction algorithm is extended to adapt to the local features of the image, as well as the noise statistics, to preserve the high-frequency edges during reconstruction. In the second part of this thesis, the research focus shifts to the acquisition, encoding, reconstruction, and rendering of light field images and videos in a real-time setting. Unlike traditional integral photography, a light field captures the information of the dynamic environment from all angles, all points in space, and all spectral wavelength and time. This thesis employs sparse representation to provide an end-to-end solution to the problem of encoding, real-time reconstruction, and rendering of high dimensional light field video data sets. These solutions are applied on various types of data sets, such as light fields captured with multi-camera systems or hand-held cameras equipped with micro-lens arrays, and spherical light fields. Finally, sparse representation of light fields was utilized for developing a single sensor light field video camera equipped with a color-coded mask. A new compressive sensing model is presented that is suitable for dynamic scenes with temporal coherency and is capable of reconstructing high-resolution light field videos.