High-Res DEMs from single HiRISE images, First results of new "Shape from Shading" algorithm |
High-Res DEMs from single HiRISE images, First results of new "Shape from Shading" algorithm |
Jan 16 2010, 03:30 PM
Post
#1
|
|
Member Group: Members Posts: 713 Joined: 30-March 05 Member No.: 223 |
Hi all,
Here the long overdue continuation of the "Alien Landscapes" series. This time based on 3D DEMs generated with "Shape from Shading" from single HiRISE images. Enjoy Click on Images for larger version. Detail views from PSP_002172_1410 (large gully system) Detail view of Gullies from PSP_001376_1675 Detail of gully system in PSP_002022_1455 Dune Views from PSP_004339_1890 Detail from PSP_001834_1605 Here is some background info on the making of the images: "Shape from Shading" (SFS) i.e. the possibility to extract shape information from a single image has always been a fascinating topic for me. Now I found the time to implement a prototype for a new SFS algorithm based on some ideas that I've been thinking about for a long time. The problem with existing SFS approaches (see here for a survey is that they either tend to over-smooth the details (due to the regularization constraint) or suffer from excessive noise in the high-frequency components of the reconstructed surface. Another problem is the large demand on CPU ressources which would make them very challenging to apply to large scale input data, such as HiRISE orbiter images. So for a long time I was rather sceptical as to the potential of SFS and it was my impression that Methods based on multiple images (stereo) must be far superior to single-image SFS. However, after a long time of experimenting, combining existing approaches with some new ideas, I got the following quite promising first results that I'd like to share: All of the images were generated from a single HiRISE image (no depth information was used from stereo or laser altimeter data). Also, no texturing or additional coloring/shading was applied when rendering the surface. Every detail visible is real 3D down to the pixel-level... For rendering I used a very simple model based on lambertian reflection with gouraud shading. The resolution of the images is still moderate: that is downsampled details crops in the order of 0.5-1 Megapixels. However, despite the heavy math machinery that drives the core of the algoritm (several systems of equations with millions of unknowns) the processing time is still moderate (about 15 Minutes per med-res image, using about 2 Gigs main mem) such that the application to full-res HiRISE images should be possible The following image shows an example to illustrate the general principle (click to enlarge). On the left hand side the 2D input image (simple noisy JPEG from the Web with unknwon light source direction). On the right hand side shows the recovered 3D surface re-lighted under a different light source direction. Note that one problem of the current implementation of the algorithm is it's vulnerability to notable distortions in the low frequency components (i.e. large scale variations) of the generated surface. However I'm confident that this can be overcome by an improved version or by adding the large-scale depth information from stereo-based DEMs or altimeter data (MOLA) where available. |
|
|
Jan 19 2010, 11:05 PM
Post
#2
|
|||
IMG to PNG GOD Group: Moderator Posts: 2254 Joined: 19-February 04 From: Near fire and ice Member No.: 38 |
There are lots and lots of things I'd be interested in testing but I'm posting just a single image to test if it's not too much trouble. What I'm posting here has been carefully selected to ensure I shouldn't have to post more stuff to test, at least not in the near term (although testing how the SFS software performs with the sun almost directly overhead would be interesting as well, my stereomatcher performs poorly in that case for obvious reasons).
This is a Cassini image of Rhea with the Tirawa impact basin partially visible in the upper right quadrant: I would be very interested in seeing a DEM from this image. What would be most interesting, if possible, would be a 1024x1024 pixel 16 bit grayscale DEM as a tiff or png file. If this is possible I'll attempt to merge it into my global DEM of Rhea that I made using stereo pairs. That would combine the best of both worlds and I would post the results here. Otherwise some test renders would be nice. This is a portion of my DEM of Rhea showing most of the image above (it's slightly cropped): Here black represents -6.320 km and white 6.176 km relative to an ellipsoid. Unlike the Cassini image above, this 'image' is in simple cylindrical projection and covers longitude 150.25 to 187.875 degrees and latitude 8.625 to 41.625 degrees (including the black stuff surrounding the DEM). |
||
|
|||
Lo-Fi Version | Time is now: 26th September 2024 - 08:38 PM |
RULES AND GUIDELINES Please read the Forum Rules and Guidelines before posting. IMAGE COPYRIGHT |
OPINIONS AND MODERATION Opinions expressed on UnmannedSpaceflight.com are those of the individual posters and do not necessarily reflect the opinions of UnmannedSpaceflight.com or The Planetary Society. The all-volunteer UnmannedSpaceflight.com moderation team is wholly independent of The Planetary Society. The Planetary Society has no influence over decisions made by the UnmannedSpaceflight.com moderators. |
SUPPORT THE FORUM Unmannedspaceflight.com is funded by the Planetary Society. Please consider supporting our work and many other projects by donating to the Society or becoming a member. |