Signal Processing: Image Communications, Vol. 29, No. 2, 2014
J. Kronander, S. Gustavson, G. Bonnet, A. Ynnerman, J. Unger
C-Research, Media and Information Technology, Linköping University
SpheronVR AG
Figure: An example layout of a multi-sensor camera system with a beamsplitter projecting the incident light onto three sensors. Our reconstruction algorithm fuses differently exposed low dynamic range images to high quality HDR-images.
Abstract:
One of the most successful methods for modern high quality HDR-video capture is to use camera setups with multiple sensors imaging the scene through a common optical system. However, such systems pose several challenges for HDR reconstruction algorithms. Previous reconstruction techniques have considered debayering, denoising, resampling (alignment) and exposure fusion as separate problems. We instead present a unifying approach, performing HDR assembly directly from raw sensor data. Our framework includes a camera noise model adapted to HDR video and an algorithm for spatially adaptive HDR reconstruction based on fitting local polynomial approximations to observed sensor data. The method is easy to implement and allows reconstruction to an arbitrary resolution and output mapping. We present an implementation in CUDA and show real-time performance for an experimental 4 Mpixel multi-sensor HDR video system. We further show that our algorithm has clear advantages over existing methods, both in terms of exibility and reconstruction quality.
Keywords: HDR Video Capture, HDR Reconstruction, Local Polynomial Approximation, Camera Noise
Documents:
Paper: A Unified Framework for Multi-Sensor HDR Video Reconstruction (.pdf) (14.2MB)
Bibtex
@article{Kronander:13:SPIC,
author = {Joel Kronander and Stefan Gustavson and Gerhard Bonnet and Anders Ynnerman and Jonas Unger},
title = {A Unified Framework for Multi-Sensor {HDR}-video Reconstruction},
journal = {{Signal Processing: Image Communications}}, Volume = {29}, Number = {2}, Publisher = {Elsevier}, year = {2014} }
|
Jonas Unger 2019 |