Perseverance Imagery, technical discussion of processing, cameras, etc. |
Perseverance Imagery, technical discussion of processing, cameras, etc. |
Feb 22 2021, 02:26 AM
Post
#1
|
||
Member Group: Members Posts: 219 Joined: 14-November 11 From: Washington, DC Member No.: 6237 |
Putting this here, for reference as the payload of the JSON feed link for Perseverence raws (see source in other thread here)
https://mars.nasa.gov/rss/api/?feed=raw_ima...;&extended= Looks like there's a ton of good data in addition to just the (PNG! Bayer color separated!) images This is for the first image shown on the page at the moment. CODE "images": [ { "extended": { "mastAz":"UNK", "mastEl":"UNK", "sclk":"667129493.453", "scaleFactor":"4", "xyz":"(0.0,0.0,0.0)", "subframeRect":"(1,1,1280,960)", "dimension":"(1280,960)" }, "sol":2, "attitude":"(0.415617,-0.00408664,-0.00947025,0.909481)", "image_files": { "medium":"https://mars.nasa.gov/mars2020-raw-images/pub/ods/surface/sol/00002/ids/edr/browse/rcam/RRB_0002_0667129492_604ECM_N0010052AUT_04096_00_2I3J01_800.jpg", "small":"https://mars.nasa.gov/mars2020-raw-images/pub/ods/surface/sol/00002/ids/edr/browse/rcam/RRB_0002_0667129492_604ECM_N0010052AUT_04096_00_2I3J01_320.jpg", "full_res":"https://mars.nasa.gov/mars2020-raw-images/pub/ods/surface/sol/00002/ids/edr/browse/rcam/RRB_0002_0667129492_604ECM_N0010052AUT_04096_00_2I3J01.png", "large":"https://mars.nasa.gov/mars2020-raw-images/pub/ods/surface/sol/00002/ids/edr/browse/rcam/RRB_0002_0667129492_604ECM_N0010052AUT_04096_00_2I3J01_1200.jpg" }, "imageid":"RRB_0002_0667129492_604ECM_N0010052AUT_04096_00_2I3J01", "camera": { "filter_name":"UNK", "camera_vector":"(-0.7838279435884001,0.600143487448691,0.15950407306054173)", "camera_model_component_list":"2.0;0.0;(46.176,2.97867,720.521);(-0.701049,0.00940617,0.713051);(8.39e-06,0.0168764,-0.00743155);(-0.00878744,-0.00869157,-0.00676256);(-1.05782,-0.466472,-0.724517);(-0.702572,0.0113481,0.711523);(-448.981,-528.002,453.359)", "camera_position":"(-1.05782,-0.466472,-0.724517)", "instrument":"REAR_HAZCAM_RIGHT", "camera_model_type":"CAHVORE" }, "caption":"NASA's Mars Perseverance rover acquired this image of the area in back of it using its onboard Rear Right Hazard Avoidance Camera. \n\n This image was acquired on Feb. 21, 2021 (Sol 2) at the local mean solar time of 15:37:11.", "sample_type":"Full", "date_taken_mars":"Sol-00002M15:37:11.985", "credit":"NASA/JPL-Caltech", "date_taken_utc":"2021-02-21T02:16:26Z", "json_link":"https://mars.nasa.gov/rss/api/?feed=raw_images&category=mars2020&feedtype=json&id=RRB_0002_0667129492_604ECM_N0010052AUT_04096_00_2I3J01", "link":"https://mars.nasa.gov/mars2020/multimedia/raw-images/?id=RRB_0002_0667129492_604ECM_N0010052AUT_04096_00_2I3J01", "drive":"52", "title":"Mars Perseverance Sol 2: Rear Right Hazard Avoidance Camera (Hazcam)", "site":1, "date_received":"2021-02-21T23:12:58Z" }, (with syntax color): Here's hoping that one of you skilled characters can make good use... |
|
|
||
Feb 24 2021, 05:01 AM
Post
#2
|
|
Newbie Group: Members Posts: 6 Joined: 6-August 12 Member No.: 6475 |
Okay, I hope this is the right forum for this question - one of the things I really like about both rovers having the ability to take stereo imagery is the ability to see stuff in 3D. Is there a utility out there that lets us view images in 3D using a VR headset? I've briefly searched around but haven't seen much. Anaglyphs are cool and everything but it leaves a bit to be desired.
|
|
|
Feb 24 2021, 01:44 PM
Post
#3
|
|
Junior Member Group: Members Posts: 36 Joined: 28-May 08 Member No.: 4152 |
Okay, I hope this is the right forum for this question - one of the things I really like about both rovers having the ability to take stereo imagery is the ability to see stuff in 3D. Is there a utility out there that lets us view images in 3D using a VR headset? I've briefly searched around but haven't seen much. Anaglyphs are cool and everything but it leaves a bit to be desired. Stereo imagery viewed in a VR headset is a bit underwhelming - reconstructing geometry using photogrammetry to create a fully 3D representation of a landscape is much more interesting. I did this with some Curiosity imagery a few years ago, with fascinating results. If you have a SteamVR capable VR headset, you can have a look here: https://steamcommunity.com/sharedfiles/file...s/?id=928142301 - I typed up some fairly detailed notes in the description which will broadly apply to Perseverance imagery. (Full disclosure: I work for Valve, creators of SteamVR. The Mars stuff was a fun personal project which turned into something a bit larger...) Getting right back on topic for this thread - some notes on photogrammetry involving Perseverance imagery! Some decent camera parameters* to start with in Agisoft Metashape (formerly PhotoScan): Navcam Camera type: Fisheye Pixel size (mm): 0.0255 x 0.0255 (for 1280x960 images) Focal length (mm) 19.1 Hazcam Camera type: Fisheye Pixel size (mm): 0.0255 x 0.0255 (for 1280x960 images) Focal length (mm) 14 Using separate calibration profiles for left and right cameras may make sense - stuff worked better for Curiosity's navcams when I did this. (They're beautifully hand-made one-off scientific instruments, after all.) Metashape will further refine camera parameters once given these reasonable starting points. It's all looking like really exciting data to play around with - navcam imagery in high-resolution, full colour after a bit of processing. I'm starting to figure out debayering stuff - I'm sure that this thread will come in great use! * derived from The Mars 2020 Engineering Cameras and Microphone on the Perseverance Rover: A Next-Generation Imaging System for Mars Exploration : Table 2, Perseverance Navcam, Hazcam, and Cachecam characteristics |
|
|
Feb 24 2021, 04:22 PM
Post
#4
|
|
Newbie Group: Members Posts: 6 Joined: 6-August 12 Member No.: 6475 |
Great! Thanks for the answer. I have an Index, so I'll check that out!
Edit: Just tried it - that's awesome! Gives a great sense of scale to the rover, and I liked all the point of interest spots. I'm surprised there isn't more stuff out there like this, it would be a fantastic educational tool and it's just fun to stand or sit around in for awhile. Stereo imagery viewed in a VR headset is a bit underwhelming - reconstructing geometry using photogrammetry to create a fully 3D representation of a landscape is much more interesting.
I did this with some Curiosity imagery a few years ago, with fascinating results. If you have a SteamVR capable VR headset, you can have a look here: https://steamcommunity.com/sharedfiles/file...s/?id=928142301 - I typed up some fairly detailed notes in the description which will broadly apply to Perseverance imagery. (Full disclosure: I work for Valve, creators of SteamVR. The Mars stuff was a fun personal project which turned into something a bit larger...) Getting right back on topic for this thread - some notes on photogrammetry involving Perseverance imagery! Some decent camera parameters* to start with in Agisoft Metashape (formerly PhotoScan): Navcam Camera type: Fisheye Pixel size (mm): 0.0255 x 0.0255 (for 1280x960 images) Focal length (mm) 19.1 Hazcam Camera type: Fisheye Pixel size (mm): 0.0255 x 0.0255 (for 1280x960 images) Focal length (mm) 14 Using separate calibration profiles for left and right cameras may make sense - stuff worked better for Curiosity's navcams when I did this. (They're beautifully hand-made one-off scientific instruments, after all.) Metashape will further refine camera parameters once given these reasonable starting points. It's all looking like really exciting data to play around with - navcam imagery in high-resolution, full colour after a bit of processing. I'm starting to figure out debayering stuff - I'm sure that this thread will come in great use! * derived from The Mars 2020 Engineering Cameras and Microphone on the Perseverance Rover: A Next-Generation Imaging System for Mars Exploration : Table 2, Perseverance Navcam, Hazcam, and Cachecam characteristics |
|
|
Lo-Fi Version | Time is now: 5th June 2024 - 12:15 AM |
RULES AND GUIDELINES Please read the Forum Rules and Guidelines before posting. IMAGE COPYRIGHT |
OPINIONS AND MODERATION Opinions expressed on UnmannedSpaceflight.com are those of the individual posters and do not necessarily reflect the opinions of UnmannedSpaceflight.com or The Planetary Society. The all-volunteer UnmannedSpaceflight.com moderation team is wholly independent of The Planetary Society. The Planetary Society has no influence over decisions made by the UnmannedSpaceflight.com moderators. |
SUPPORT THE FORUM Unmannedspaceflight.com is funded by the Planetary Society. Please consider supporting our work and many other projects by donating to the Society or becoming a member. |