Authors
Clement Fredembach, Sabine Süsstrunk
Abstract
Current digital camera sensors are inherently sensitive to the near-infrared part of the spectrum. To prevent the near-IR contamination of images, an IR blocking filter (hot mirror) is placed in front of the sensor. In this work, we start by replacing the camera’s hot mirror by a piece of clear glass, thus making the camera sensitive to both visible and near-IR light. Using a pair of lens-mounted filters, we explore the differences in operating the camera to take visible and near-IR images of a given scene.
Our aim is to enhance the visible images using near-IR information. To do so, we first discuss the physical causes of differences between visible and near-IR natural images, and remark that these causes are not correlated with a particular colour, but with atmospheric conditions and surface characteristics. We then investigate image enhancement by considering the near-IR channel as either colour, luminance, or frequency counterpart to the visible image and conclude that using information from two different colour encodings, depending on the image content, produces vivid, contrasted images that are pleasing to the observers.
Reference
C. Fredembach and S. Susstrunk, Colouring the near infrared, Proceedings of the IS&T/SID 16th Color Imaging Conference, pp. 176-182, 2008.
[detailed record] [bibtex]
Code and Data
Here you can find (some of) the near-infrared and colour images that were used in this work. In addition, coloured near-infared images that were used for psychophysical experiments are available here.
The colour and NIR images are full resolution tiff images obtained by converting the raw files from our modified Canon 300D camera (custom white balance was used for all images). The enhanced images are provided for visual comparison and are a slightly reduced resolution (mainly to avoid manipulating 20+ Mbs images all the time). Also note that the downloads can be quite large
As usual, if you use these images in research and publications, please put a reference to this paper. Thank you!
Comments and remarks
Clement Fredembach