Preview Panoramas, Creating colour panoramas from navcams and pancam thumbnails |
Preview Panoramas, Creating colour panoramas from navcams and pancam thumbnails |
Oct 4 2006, 10:11 PM
Post
#1
|
|||
Senior Member Group: Moderator Posts: 2262 Joined: 9-February 04 From: Melbourne - Oz Member No.: 16 |
A preview of the Duck Bay panorama.
Nice job - this is hand coloured, right? I don't think so. It looks like James assembled this one from the tracking site thumbnails. I'm glad to have that preview btw James. I look forward to the official release next Friday.. Nico but from the lens geometry it does look like a colorized sol952 navcam panorama Very good job on the colorization. kudos, James ! I'd say the opposite Bernhard, Navcam needs less frames to cover that area... Nico I see - he took the navcam pan as the red channel (it's response is dominated by IR/red, and resolution will be much sharper than L2 thumbs). Then he used the L7's and L5's that are down and the L7 and L5 thumbs for the remaining areas, scaled to navcam resolution. I assume he blacked out portions of the navcam that are not covered by L5/7 - that's why we see 16 degree blocks. Is that it, James? Your all on the right track but not quite there. To make this I took the thumbnails (64x64 each) from the tracking site and used the tracking data to create a Hugin pan file. (Note the rover quaternian appears a little off in the database at the moment so the horizon isn't flat.) Then I ran my normal image matching / colouring software on the pan/images to create a full colour mini panorama. This however has a much lower resolution than the existing navcams, so the next step is to use the pan as a colour layer over the navcam pan (also made using the tracking data so the two match in geometry.) Then as Fred says, I cut out (poorly, must try harder next time.) just the coloured region from the navcam pan to retain the 'feel' of a pancam pan. The good news is most of this happens automatically in my software, so you can all expect prompt 'preview' panoramas in the future before the full images are even downlinked from the rover. James -------------------- |
||
|
|||
Oct 5 2006, 12:34 AM
Post
#2
|
|
Senior Member Group: Members Posts: 4246 Joined: 17-January 05 Member No.: 152 |
Very nice, James. So do I understand correctly that you take the luminance values from the navcam pan, and the hue and saturation values from the scaled up thumbnail pan?
Do you think it would be any improvement to instead do as I originally wrote, namely taking navcam as the red channel, L5 thumbs as green and L7 thumbs as blue (or whatever combination you prefer)? I'm just thinking that these pans are always dominated by the red channel, of course, so could this approach improve the "colour resolution"? Or would this be equivalent to what you're doing? What's interesting is that if you just tried to superimpose a set of pancams onto a navcam, I think you'd have trouble getting the alignment right since the navcams contain considerable geometrical distortion. Is this accounted for in your approach in generating the projected navcam pan? Or is it negligible at the resolution of the thumbnails anyway? I suppose Michael Howard has sorted all this out with his pancam/navcam combos. |
|
|
Oct 5 2006, 01:12 AM
Post
#3
|
|
Senior Member Group: Moderator Posts: 3431 Joined: 11-August 04 From: USA Member No.: 98 |
I suppose Michael Howard has sorted all this out with his pancam/navcam combos. Not really. Currently I just match up the Pancams to the Navcams visually. But any distortion in the Navcam optics seems to me to be almost a non-issue, although I admit I haven't looked at it really carefully. The bigger problem seem to be that the Pancams are situated differently on the camera mast from the Navcams, and face a slightly different direction (they have a 1 degree 'toe-in' which the Navcams do not). By the way, on the a,b,c parameters for the Navcam camera model, I don't know what other folks use but I'm using a=b=c=0. |
|
|
Oct 5 2006, 01:23 AM
Post
#4
|
||
Senior Member Group: Moderator Posts: 2262 Joined: 9-February 04 From: Melbourne - Oz Member No.: 16 |
Very nice, James. So do I understand correctly that you take the luminance values from the navcam pan, and the hue and saturation values from the scaled up thumbnail pan? That's right, similar to what other have done colouring MI's using pancam images. Do you think it would be any improvement to instead do as I originally wrote, namely taking navcam as the red channel, L5 thumbs as green and L7 thumbs as blue (or whatever combination you prefer)? I'm just thinking that these pans are always dominated by the red channel, of course, so could this approach improve the "colour resolution"? Or would this be equivalent to what you're doing? I don't think that really improves things, your not really gaining any colour resolution as the green and blue channels that make the colour are still at the lower resolution. And you end up effectively loosing spacial resolution as now two channels containing the low resolution data dominate over the higher red channel. Another issue is simplicity for me. I have some quite sophisicated routines that i've developed over the last year for making nice colour pans that work on individual pancam pointings (plus knowledge of how they fit together) not on the whole pan. So just adding the green and blue to a red navcam results in some serious colour gradients. Here is a simple attempt at this showing the problems, What's interesting is that if you just tried to superimpose a set of pancams onto a navcam, I think you'd have trouble getting the alignment right since the navcams contain considerable geometrical distortion. Is this accounted for in your approach in generating the projected navcam pan? Or is it negligible at the resolution of the thumbnails anyway? I suppose Michael Howard has sorted all this out with his pancam/navcam combos. The navcams arn't that bad. I didn't take any into account doing this. I think the biggest problem is that the navcam isn't in the same position as the pancam so at close range you end up with a small stereo effect. It's more evident in the 'navcams in red channel' attempt in this post (another problem with it!), in fact that image may work as an anaglyph! (Probably the wrong way around, left pancam is to the left of the left navcam so the pancams should be red (i think), you'll have to turn the glasses around. I don't have my glasses to check) EDIT: Cross post with Mike - glad we agree James -------------------- |
|
|
||
Oct 5 2006, 01:28 AM
Post
#5
|
|
Interplanetary Dumpster Diver Group: Admin Posts: 4404 Joined: 17-February 04 From: Powell, TN Member No.: 33 |
The thing to do would be to use the thumbs to creat a color image, and then overlay the color image over the Navcam image, which could serve as the greyscale data. I have don e this many times with other data. It can be manipulated to avoid slight parallax. Edit: Looking up the thread, I can see that this is what you originally did. One suggestion...play with saturation levels...because the NAVCAM images the RGB data from pancam don't match entirely, the saturation levels require tweaking to look like Pancam color panoramas.
-------------------- |
|
|
Oct 5 2006, 01:29 AM
Post
#6
|
|
Senior Member Group: Moderator Posts: 2262 Joined: 9-February 04 From: Melbourne - Oz Member No.: 16 |
By the way, on the a,b,c parameters for the Navcam camera model, I don't know what other folks use but I'm using a=b=c=0. I generally use a=b=c=0 but I often optimise for d & e (x & y shift) when doing manual stitching. I couldn't tell you if these come out similar each time or what values thay take however. James -------------------- |
|
|
Oct 5 2006, 01:31 AM
Post
#7
|
|
Senior Member Group: Moderator Posts: 2262 Joined: 9-February 04 From: Melbourne - Oz Member No.: 16 |
The thing to do would be to use the thumbs to creat a color image, and then overlay the color image over the Navcam image, which could serve as the greyscale data. I have don e this many times with other data. It can be manipulated to avoid slight paralax. That's what I'm doing Ted, see the first post. -------------------- |
|
|
Oct 5 2006, 01:33 AM
Post
#8
|
|
Interplanetary Dumpster Diver Group: Admin Posts: 4404 Joined: 17-February 04 From: Powell, TN Member No.: 33 |
That's what I'm doing Ted, see the first post. Looks like my reply and edit crossed with your reply. Sorry. -------------------- |
|
|
Oct 5 2006, 01:39 AM
Post
#9
|
|
Senior Member Group: Moderator Posts: 2262 Joined: 9-February 04 From: Melbourne - Oz Member No.: 16 |
No worries Ted.
Good point about the saturation - I had played with it, but will do some more. I have a few tricks to try out. James -------------------- |
|
|
Oct 5 2006, 08:35 AM
Post
#10
|
|
Senior Member Group: Members Posts: 1870 Joined: 20-February 05 Member No.: 174 |
If you composite RGB images at different resolutions together, you not only "muddy" the final resolution, but will get color fringing on sharp, high contrast edges. Ideally, you might have low rez long and short wave frames, combined with a high rez middle-wavelength frame degraded to the same pixel count for color information, and then combine that with the full resolution middle-wavelength data as brightness info to get a full color image.
In early mission images when the links wern't all up and calibrated and the daily data rates were low, They'd transmit (at least from Opportunity) two bands at low resolution and high compression and one band at high resolution and not as severe (though still not low) compression, and you could play smart tricks with that data. |
|
|
Oct 5 2006, 02:22 PM
Post
#11
|
|
Interplanetary Dumpster Diver Group: Admin Posts: 4404 Joined: 17-February 04 From: Powell, TN Member No.: 33 |
That depends on how much color variation there is in the image. Also, if you are simply trying to create a nice picture, you can manually remove fringing, although it takes forever. The biggest problems are caused by illumination angle changes, as well as the fact that if the grayscale data is from either R, G, or B, or in this case is panchromatic while the RGB data is narrowband, you can get some awkward looking areas.
With these thumbnails, the fringing would be a big issue, but with, for example, Galileo data, when the smaller color frames were 2x2 bins, it wasn't much of a problem except with Europa and sometimes Io. -------------------- |
|
|
Oct 9 2006, 07:51 PM
Post
#12
|
|
Chief Assistant Group: Admin Posts: 1409 Joined: 5-January 05 From: Ierapetra, Greece Member No.: 136 |
question by 'micvoo' on colorizing moved to new thread to keep this one on topic;
http://www.unmannedspaceflight.com/index.php?showtopic=3328 -------------------- photographer, space imagery enthusiast, proud father and partner, and geek.
http://500px.com/sacred-photons & |
|
|
Lo-Fi Version | Time is now: 28th April 2024 - 09:33 PM |
RULES AND GUIDELINES Please read the Forum Rules and Guidelines before posting. IMAGE COPYRIGHT |
OPINIONS AND MODERATION Opinions expressed on UnmannedSpaceflight.com are those of the individual posters and do not necessarily reflect the opinions of UnmannedSpaceflight.com or The Planetary Society. The all-volunteer UnmannedSpaceflight.com moderation team is wholly independent of The Planetary Society. The Planetary Society has no influence over decisions made by the UnmannedSpaceflight.com moderators. |
SUPPORT THE FORUM Unmannedspaceflight.com is funded by the Planetary Society. Please consider supporting our work and many other projects by donating to the Society or becoming a member. |