Curiosity Image Retrieval Tools, scripts and software |
Curiosity Image Retrieval Tools, scripts and software |
Aug 16 2012, 08:17 PM
Post
#91
|
|
Member Group: Members Posts: 646 Joined: 23-December 05 From: Forest of Dean Member No.: 617 |
Since that requires a lot of analysis and input by people, the first thing that comes to mind is some kind of photo-tagging system a la flickr. It's a lot of work to come up with meaningful and comprehensive tags, so crowdsourcing would be the way to go? Of course then there's the issue of consistency, etc. An early science crowdsourcing experiment/project tackled crater-counting on Mars... ( https://en.wikipedia.org/wiki/Clickworkers#...Martian_craters ) Galaxy Quest tackles the consistency problem with a tutorial and tests that must be passed before a volunteer can tackle real data: http://www.galaxyzoo.org/how_to_take_part . -------------------- --
Viva software libre! |
|
|
Aug 16 2012, 08:34 PM
Post
#92
|
|
Administrator Group: Admin Posts: 5172 Joined: 4-August 05 From: Pasadena, CA, USA, Earth Member No.: 454 |
Perhaps obvious, but this would be another area where metadata would be useful. Surely the data exists to tie the MSSS rawids to timecode, observation ID, observation description, et cetra; we just don't have access to it. Yes, indeed. I'm trying not to be a pest; I may try again to bring up metadata next week. The overhaul of the page design and the much faster posting of images are two major improvements made this week; I don't want to be too demanding Ludo, she says the technical people are looking in to the whitespace problem. -------------------- My website - My Patreon - @elakdawalla on Twitter - Please support unmannedspaceflight.com by donating here.
|
|
|
Aug 16 2012, 08:41 PM
Post
#93
|
|
Junior Member Group: Members Posts: 43 Joined: 7-August 12 From: The Netherlands Member No.: 6493 |
Hi all,
In part due to the huge sol=0 page (currently 250.000+ lines) and in part through bugs/issues I created, my app currently is "intermitted".... I'm working on it! The good news is: As soon as I have the performance issues fixed, I'll have image release dates in the app as well, including sorting. Which means you can easily see what's new. Grz, Ludo. |
|
|
Aug 16 2012, 11:22 PM
Post
#94
|
|
Junior Member Group: Members Posts: 43 Joined: 7-August 12 From: The Netherlands Member No.: 6493 |
Ok, definitely not happy with the performance (and degradation thereof if something goes wrong) but at least it works again. New features:
|
|
|
Aug 17 2012, 03:59 AM
Post
#95
|
|
Newbie Group: Members Posts: 11 Joined: 12-August 12 Member No.: 6550 |
First post. Here's a small script I wrote to automatically process left and right full frame Navcam image pairs into SBS stereoscopic images. Thanks go to jmknapp for his image list service, http://curiositymsl.com. I originally intended to automate the full process, from downloading the images to creating the final SBS output, but then I realized that I may want to process the images a bit before the final step. I use the free StereoPhoto Maker to create the final images. It's a windows app which is why I chose to write this in AutoIt (also free).
BTW, the images are PHENOMENAL when viewed with the Sony HMZ-T1. I purchased this hardware a few months ago in anticipation of this mission (and other 3D applications), and I've been extremely pleased with the quality of the high contrast dual OLED displays, which present a ghost-free stereo image. CODE #include <file.au3> ; for _filereadtoarray
#include <Array.au3> ; for _arraydisplay ; 20120816, version 0.1 ; This script processes all full frame Navcam images using jmknapp's http://curiositymsl.com, downloads only full frame LR pairs (if not downloaded already) and creates a StereoPhoto script file ; (todo) Also process Mastcam images ; 3d_mars ; prompt user for sol number to retrieve, $sol Local $sol = InputBox("Sol Number", "Input Sol Number:") If @error Then Exit ; create temp file for listing all URLs for a given sol ; example: c:\users\username\appdata\local\temp\URLs_sol_1.txt $URL_list_file=@TempDir & "\URLs_sol_" & $sol & ".txt" ; download image URL list to text file ; InetGet option syntax: URL, filename, 1=force reload, 0=wait for download InetGet("http://curiositymsl.com/cgi-bin/getfiles.cgi?sol=" & $sol, $URL_list_file,1,0) ; read URL list and import to array ; note: $allURLs[0] contains the number of records read into the array. Local $allURLs If Not _FileReadToArray($URL_list_file, $allURLs) Then MsgBox(4096, "Error", " Error importing from file to Array error:" & @error) Exit EndIf ; search for Navcam full frames (*EDR_F*) insert into new array $allframes ; Navcam full frame example URLs: ; http://mars.jpl.nasa.gov/msl-raw-images/pr...AUT_04096M_.JPG ; http://mars.jpl.nasa.gov/msl-raw-images/pr...AUT_04096M_.JPG ; declare large array instead of resizing array multiple times, uses very little RAM Local $allframes[9999]=[0] $x = 1 For $URL in $allURLs ;check for Navcam full frame If StringInStr($URL,"EDR_F") Then $allframes[$x]=$URL $x += 1 EndIf Next ;record total number of frames $allframes[0]=$x - 1 ; read allframes to find matching left/right pairs ; insert into new arrays $leftframe_Nav, $rightframe_Nav Local $leftframe_Nav[9999]=[0] Local $rightframe_Nav[9999]=[0] Local $leftframe_counter = 0 Local $rightframe_counter = 0 For $x = 1 to $allframes[0] If StringInStr($allframes[$x],"NLA_") Then ;left frame found, store in $leftframe_Nav array $leftframe_counter += 1 $leftframe_Nav[$leftframe_counter]=$allframes[$x] $leftframe_Nav[0]=$leftframe_counter ElseIf StringInStr($allframes[$x],"NRA_") Then ;right frame found, store in $rightframe_Nav array $rightframe_counter += 1 $rightframe_Nav[$rightframe_counter]=$allframes[$x] $rightframe_Nav[0]=$rightframe_counter EndIf Next ; if no left full frames then abort and exit If $leftframe_counter == 0 Then MsgBox(0, "", "No Navcam full frames found") Exit EndIf ;choose path and file name for images and generated StereoPhoto Maker script file Local $MyDocsFolder = "::{450D8FBA-AD25-11D0-98A8-0800361B1103}" Local $StereoPhoto_script_file = FileSaveDialog("Choose a path and filename for images and StereoPhoto Maker script file:", $MyDocsFolder, "Text Files (*.txt)", 2, "navcam_sbs_sol_" & $sol & ".txt") ; option 2 = dialog remains until valid path/file selected If @error Then MsgBox(4096, "", "Save cancelled.") EndIf ; using lists of left and right frames, find matches and save output Local $right_matching_frame_number[9999]=[0] Local $StereoPhoto_script_lines[9999]=[0] Local $URL_left_temp, $left_image_file_name, $URL_right_temp, $right_image_file_name, $left_image_full_path, $right_image_full_path For $x = 1 to $leftframe_Nav[0] ;extract frame number $leftframe_image_number=StringMid($leftframe_Nav[$x],StringInStr($leftframe_Nav[$x],"NLA_")+4,9) ; returns -1 if no match found $right_matching_frame_number[$x] = _ArraySearch($rightframe_Nav, $leftframe_image_number, 0, 0, 0, 1) ; download left and right images If $right_matching_frame_number[$x] <> -1 Then ; find the file names $URL_left_temp = StringSplit($leftframe_Nav[$x], "/") $left_image_file_name = $URL_left_temp[UBound($URL_left_temp)-1] $URL_right_temp = StringSplit($rightframe_Nav[$right_matching_frame_number[$x]], "/") $right_image_file_name = $URL_right_temp[UBound($URL_right_temp)-1] ; create full path names $left_image_full_path=@WorkingDir & "\" & $left_image_file_name $right_image_full_path=@WorkingDir & "\" & $right_image_file_name ; build array for StereoPhoto Maker script file $StereoPhoto_script_lines[$x]="21,0,0,0,0," & $left_image_full_path & "," & $right_image_full_path & ",," ; download the images ; if the file already exists don't download it again If Not FileExists($left_image_full_path) Then InetGet($leftframe_Nav[$x],$left_image_full_path,1,0) EndIf If Not FileExists($right_image_full_path) Then InetGet($rightframe_Nav[$right_matching_frame_number[$x]],$right_image_full_path,1,0) EndIf EndIf Next ; write StereoPhoto Maker script file Local $hFile = FileOpen($StereoPhoto_script_file, 2) ; 2 = erase previous _FileWriteFromArray($StereoPhoto_script_file, $StereoPhoto_script_lines, 1) ; 1 = index to start FileClose($hFile) ; open StereoPhoto Maker, select File menu, select multi conversion from list... |
|
|
Aug 17 2012, 01:36 PM
Post
#96
|
|
Senior Member Group: Members Posts: 1465 Joined: 9-February 04 From: Columbus OH USA Member No.: 13 |
First post. Here's a small script I wrote to automatically process left and right full frame Navcam image pairs into SBS stereoscopic images. I had to look up what SBS stereo is (but hey, I can't even find my red-blue glasses to see some of the probably amazing anaglyph efforts here). So I take it that you need to have some expensive headgear like the Sony you mentioned to view them ($800) or at least shutter glasses and a special monitor? I wonder what the cheapest entry point is. -------------------- |
|
|
Aug 17 2012, 01:41 PM
Post
#97
|
|
Senior Member Group: Members Posts: 1465 Joined: 9-February 04 From: Columbus OH USA Member No.: 13 |
Some updates to my raw image listing app:
1) results selectable by camera (MASTCAM,NAVCAM,CHEMCAM,HAZCAM,MAHLI,MARDI) 2) number of items per page selectable (20, 50, 100) 3) thumbnail size selectable (small,large) 4) removed "lag" column 5) added columns for sol number and LMST of observation Note that all parameters selected appear in the url, so if you have a particular kind of search you like, you can just bookmark it to return to it. Probably about it for now. I might put in a selection for sol number. Happy raw image harvesting! -------------------- |
|
|
Aug 17 2012, 02:07 PM
Post
#98
|
|
Senior Member Group: Members Posts: 4246 Joined: 17-January 05 Member No.: 152 |
So I take it that you need to have some expensive headgear Not at all! Using StereoPhoto Maker that 3d_mars linked to, you can view side-by-side images without any special hardware or glasses at all. StereoPhoto Maker displays the L and R images side by side, but only displaying a vertical strip wide enough to merge by crossing (or diverging) your eyes. You can then easily pan to see the entire image.
|
|
|
Aug 17 2012, 02:40 PM
Post
#99
|
|
Newbie Group: Members Posts: 11 Joined: 12-August 12 Member No.: 6550 |
I had to look up what SBS stereo is (but hey, I can't even find my red-blue glasses to see some of the probably amazing anaglyph efforts here). So I take it that you need to have some expensive headgear like the Sony you mentioned to view them ($800) or at least shutter glasses and a special monitor? I wonder what the cheapest entry point is. I mentioned the hardware as an aside and I don't want to diverge too much from the main purpose of this thread, so allow me to just say that any effort you put into viewing these images in 3D will be worth it, trust me. The Mars landscape comes to life in 3D, and with MSL we have many different 3D image sources. Thank you again MSSS! |
|
|
Aug 17 2012, 02:41 PM
Post
#100
|
|
Senior Member Group: Members Posts: 4246 Joined: 17-January 05 Member No.: 152 |
Note that all parameters selected appear in the url, so if you have a particular kind of search you like, you can just bookmark it to return to it. This is now nearly perfect, Joe! I have one suggestion. Perhaps you could make the names in the "name" column link to the same full-size image as the thumbs do. That way the names would change colour after the image was viewed, so we could easily tell which images we've seen before, or up to what time we've viewed in the default "released" sort when we check in in the morning. |
|
|
Aug 17 2012, 03:15 PM
Post
#101
|
|
Junior Member Group: Members Posts: 59 Joined: 4-July 08 Member No.: 4251 |
Some updates to my raw image listing app Jim, I just wanted to thank you again for this. It's an absolutely fantastic service to the community. Every morning brings new joy, and your simple interface makes it so much easier to experience. |
|
|
Aug 17 2012, 03:21 PM
Post
#102
|
|
Senior Member Group: Members Posts: 2511 Joined: 13-September 05 Member No.: 497 |
The Mars landscape comes to life in 3D, and with MSL we have many different 3D image sources. Thank you again MSSS! We appreciate the thanks but we didn't build the engineering cameras. 3D with Mastcam will be tough because of the different focal lengths. The best 3D source will likely be from MAHLI, since we can move the viewpoint around with the arm. I've been using StereoPhoto Maker to output images in MPO format for display on an LG 3D television. This is definitely a nice technology that didn't exist back on MER. -------------------- Disclaimer: This post is based on public information only. Any opinions are my own.
|
|
|
Aug 17 2012, 04:41 PM
Post
#103
|
|
Administrator Group: Admin Posts: 5172 Joined: 4-August 05 From: Pasadena, CA, USA, Earth Member No.: 454 |
I started a new thread to discuss 3D display technology; I hope people will share their experiences/recommendations over there.
-------------------- My website - My Patreon - @elakdawalla on Twitter - Please support unmannedspaceflight.com by donating here.
|
|
|
Aug 17 2012, 06:34 PM
Post
#104
|
|
Senior Member Group: Members Posts: 1465 Joined: 9-February 04 From: Columbus OH USA Member No.: 13 |
This is now nearly perfect, Joe! I have one suggestion. Perhaps you could make the names in the "name" column link to the same full-size image as the thumbs do. That way the names would change colour after the image was viewed, so we could easily tell which images we've seen before, or up to what time we've viewed in the default "released" sort when we check in in the morning. In general I'm trying to resist the urge for more bells and whistles since as ChrisC notes, simplicity is a virtue--but your suggestion actually makes makes the interface simpler. Done! As Thoreau said, "simplify, simplify, simplify!" -------------------- |
|
|
Aug 18 2012, 12:09 AM
Post
#105
|
|
Member Group: Members Posts: 866 Joined: 15-March 05 From: Santa Cruz, CA Member No.: 196 |
nice work! this is a very handy and fun browser to poke around with, i fear if the word gets out it will be overloaded much too soon!!
i was wondering what sorting by 'thumbnail' could possibly mean. of course it means: "Unknown column 'thumbnail' in 'order clause'" |
|
|
Lo-Fi Version | Time is now: 27th April 2024 - 07:09 AM |
RULES AND GUIDELINES Please read the Forum Rules and Guidelines before posting. IMAGE COPYRIGHT |
OPINIONS AND MODERATION Opinions expressed on UnmannedSpaceflight.com are those of the individual posters and do not necessarily reflect the opinions of UnmannedSpaceflight.com or The Planetary Society. The all-volunteer UnmannedSpaceflight.com moderation team is wholly independent of The Planetary Society. The Planetary Society has no influence over decisions made by the UnmannedSpaceflight.com moderators. |
SUPPORT THE FORUM Unmannedspaceflight.com is funded by the Planetary Society. Please consider supporting our work and many other projects by donating to the Society or becoming a member. |