IPB

Welcome Guest ( Log In | Register )

Super-resolution challenge, Help requested by the science team
john_s
post Nov 1 2008, 12:16 AM
Post #1


Member
***

Group: Members
Posts: 696
Joined: 3-December 04
From: Boulder, Colorado, USA
Member No.: 117



Greetings:

Here's another chance to maybe help out the New Horizons science team! We are planning the Pluto imaging sequence, and are considering the best strategy for squeezing the maximum resolution out of our images, including "super resolution" techniques, particularly for the side of Pluto that faces away from us at close approach, which we will see with a disk diameter of only about 120 pixels in our high-resolution camera LORRI. As some members of this forum have done impressive work with super-resolution processing of MER images, maybe you can try your hand with some synthetic "Pluto" images to see what the potential is? This may be more challenging than for MER, because our PSF is relatively broad, about 2 pixels wide.

We want to know how many images to take of a given face of Pluto to get maximum benefit from super resolution techniques, if indeed they are useful at all.

I plan to generate a bunch of synthetic images with slightly different pixel positioning and smear, and with realistic noise levels, and then make them available for experiments to see how well they can be combined and sharpened to improve the resolution.

If you are interested in giving this a shot, let me know. Also let me know if you can work with 12-bit or 16-bit images, and if so what format is most convenient. I can easily make 16-bit FITS files, for instance. It may be that 8-bit PNGs will be adequate, too.

Thanks,
John.
Go to the top of the page
 
+Quote Post
 
Start new topic
Replies
Fran Ontanaya
post Nov 13 2008, 09:54 AM
Post #2


Member
***

Group: Members
Posts: 293
Joined: 22-September 08
From: Spain
Member No.: 4350



I had to try. smile.gif



2x
I used 5 images plus one to reduce noise. Mostly was about scaling up without interpolation, aligning the images, do some blending and several steps of gaussian blur and unsharp mask before scaling down --all very empirical. A real pro should be able to do better. tongue.gif
Go to the top of the page
 
+Quote Post
tedstryk
post Nov 13 2008, 01:07 PM
Post #3


Interplanetary Dumpster Diver
****

Group: Admin
Posts: 4404
Joined: 17-February 04
From: Powell, TN
Member No.: 33



Here is my take. I have versions with 4 frames, 6 frames, and 12. First, I deconvoluted the images to combat the broad PSF. I then blew the images up to 5x and sharpened them based on the new artificial point spread the enlargement created. I selectively stacked them, weighting them based on quality (I could probably do a bit better, but I was trying to hurry). After merging the image, I applied a light round of deconvolution based on a 4 pixel PSF and then reduced the images to 1.9x. A slight bit of sharpening was applied at this point.

4 Frames
Attached Image

6 Frames
Attached Image

12 Frames
Attached Image


--------------------
Go to the top of the page
 
+Quote Post
tedstryk
post Nov 14 2008, 05:00 AM
Post #4


Interplanetary Dumpster Diver
****

Group: Admin
Posts: 4404
Joined: 17-February 04
From: Powell, TN
Member No.: 33



Here is a view of Triton when it was 120 pixels across (shown here at about 2.5x). The inset shows two apparent plumes visible near the bottom of the terminator.

Attached Image


Now that I have worked on the Ganymede stack, might I ask if the image used is the NH frame from the same angle or generated from something else? The reason I ask is that the detail cutoff seems a bit odd compared to the Triton set and other real sets I have worked on. Namely, the technique does much better with high contrast details than low contrast details for obvious reasons. With the Ganymede images, the cutoff seems even. If it is from the lone NH frame, the reason is simple - I am smacking into the resolution limit of the image.


--------------------
Go to the top of the page
 
+Quote Post

Posts in this topic
- john_s   Super-resolution challenge   Nov 1 2008, 12:16 AM
- - tedstryk   I am definitely interested. I will say this. Alt...   Nov 1 2008, 02:33 AM
|- - john_s   Cool! Tell me your preferred image format. J...   Nov 1 2008, 03:25 AM
|- - tedstryk   QUOTE (john_s @ Nov 1 2008, 04:25 AM) Coo...   Nov 1 2008, 12:47 PM
|- - john_s   So do you prefer TIFF files? If so, I have to fig...   Nov 1 2008, 03:00 PM
|- - tedstryk   QUOTE (john_s @ Nov 1 2008, 03:00 PM) So ...   Nov 1 2008, 03:04 PM
|- - john_s   Great, here's a file with 6 simulated images o...   Nov 1 2008, 04:19 PM
|- - john_s   And here's the other six... John.   Nov 1 2008, 04:27 PM
||- - john_s   Oops, there's a bug in those image sets- they ...   Nov 1 2008, 06:46 PM
||- - tedstryk   As far as stacking goes, these might be interestin...   Nov 1 2008, 06:58 PM
|- - siravan   QUOTE (john_s @ Nov 1 2008, 11:19 AM) Gre...   Nov 2 2008, 10:07 PM
|- - john_s   OK, here's a new and improved set of six FITS ...   Nov 3 2008, 09:10 PM
|- - john_s   Not sure why those two ZIP files ended up in the s...   Nov 3 2008, 09:15 PM
|- - john_s   And the rest of the images in PNG format...   Nov 3 2008, 09:19 PM
|- - john_s   By the way, the PSF in these simulations (not coun...   Nov 3 2008, 09:24 PM
|- - ugordan   Here's a flicker gif between a single frame an...   Nov 3 2008, 11:11 PM
|- - john_s   Nice! It looks like you did some sharpening- ...   Nov 4 2008, 12:14 AM
|- - ugordan   I used the Smart Sharpen filter in Photoshop, usin...   Nov 4 2008, 08:40 AM
- - siravan   Here is the effect of subpixel shift-and-add on th...   Nov 8 2008, 09:59 PM
|- - john_s   Thanks to both ugordan and siravan for those image...   Nov 10 2008, 08:41 PM
- - Fran Ontanaya   I had to try. 2x I used 5 images plus one to ...   Nov 13 2008, 09:54 AM
|- - tedstryk   Here is my take. I have versions with 4 frames, 6...   Nov 13 2008, 01:07 PM
|- - tedstryk   Here is a view of Triton when it was 120 pixels ac...   Nov 14 2008, 05:00 AM
- - john_s   This is a synthetic image using a Galileo photomos...   Nov 15 2008, 04:22 PM
|- - tedstryk   QUOTE (john_s @ Nov 15 2008, 04:22 PM) Th...   Nov 20 2008, 01:34 PM
- - Andrei   I'll take the challenge...I only hope that I...   Nov 19 2008, 01:23 PM
- - S_Walker   Sorry I'm late to this test, just joined the s...   Oct 16 2009, 04:43 PM
- - S_Walker   Next is all 12 images resized 2x, aligned and driz...   Oct 16 2009, 04:45 PM
- - S_Walker   My final version upsamples all 12 images, align th...   Oct 16 2009, 04:51 PM


Reply to this topicStart new topic

 



RSS Lo-Fi Version Time is now: 29th March 2024 - 11:19 AM
RULES AND GUIDELINES
Please read the Forum Rules and Guidelines before posting.

IMAGE COPYRIGHT
Images posted on UnmannedSpaceflight.com may be copyrighted. Do not reproduce without permission. Read here for further information on space images and copyright.

OPINIONS AND MODERATION
Opinions expressed on UnmannedSpaceflight.com are those of the individual posters and do not necessarily reflect the opinions of UnmannedSpaceflight.com or The Planetary Society. The all-volunteer UnmannedSpaceflight.com moderation team is wholly independent of The Planetary Society. The Planetary Society has no influence over decisions made by the UnmannedSpaceflight.com moderators.
SUPPORT THE FORUM
Unmannedspaceflight.com is funded by the Planetary Society. Please consider supporting our work and many other projects by donating to the Society or becoming a member.