[X] My Assistant

[SteveM]

Looking at some of the deep shadows in the recent imagery from home plate, I came to think that some of the techniques used to extend the dynamic range of photographs are (in principle) applicable to rover photography.

The technique used is to take a series of photographs with the same orientation with continually changing exposure times -- generally doubling exposure time over a range of ten exposures until you have ten images. At one extreme the image is so underexposed that only the brightest specular reflections are recorded, at the other end almost everything is overexposed, but even objects in deep shadows are visible. These images are then post processed to convert them to a single high dynamic range image, encoded in one of the HDR formats that are about, and these high dynamic range images can be examined to show detail in the brightest and darkest regions. (Obviously, with MER this would have to be done separately for each spectral filter used).

This kind of thing is not applicable to orbiter missions, where the object and camera are moving, but in principle it could be done for the present and planned rover missions (e.g., MER, MSL). The only way that seems practical to do this with MER would require changing the photo software, processing the images onboard, and sending the encoded high dynamic range image to earth. Some questions for the Pancam people:
1) How would the MER cameras react to the required extreme under/over exposure?
2) I know there have been software rewrites during the mission but is it possible to change the on-board photo processing software in this way?
3) If it were, would the discontinuity in the image series (even if it is an improvement) cause problems for the scientific value of the images?
4) Is there any thought of using high dynamic range images for later surface missions such as MSL?

Steve

[slinted]

The img files can be found in the MER Analyst Notebook. Under search, look for RAD files. If you're using windows, Bjorn's img2png program will help make displayable images (using the -r flag to apply the scaling factors) from the img files.

As has already been mentioned, the 12 bit range allows almost every detail on the surface to be captured in a single exposure. On Mars, I think only direct solar, or bright sky, imaging would create a greater than 1000:1 range. The occasional specular reflection bleeds out the pixels, but that has more to do with how the autoexposure works than what the ccd could actually handle. Areas under shadows have good visible detail but it's hard to tell that from looking at the raw jpgs.

The problem of seeing the detail in shadow still remains even if there is useable data in those areas. The other half of the HDR research might end up being much more important for Mars imaging than multi-exposure photography. Since computer displays and TVs only have a dynamic range of 1:100, the issue of how best to compress the photographic range into the display range is a significant challenge. Since HDR images often have a vastly wider range than the display device, research into intelligent tone mapping has gone hand in hand with the methods for capturing HDR images. Retinex, iCAM and several other techniques attempt to preserve visible detail while compressing the range for display or print. Even smaller range images, like Pancam, could benefit from some smart tone mapping.