IPB

Welcome Guest ( Log In | Register )

25 Pages V  « < 5 6 7 8 9 > »   
Reply to this topicStart new topic
Curiosity Image Retrieval Tools, scripts and software
imipak
post Aug 16 2012, 08:17 PM
Post #91


Member
***

Group: Members
Posts: 646
Joined: 23-December 05
From: Forest of Dean
Member No.: 617



QUOTE (jmknapp @ Aug 16 2012, 10:21 AM) *
Since that requires a lot of analysis and input by people, the first thing that comes to mind is some kind of photo-tagging system a la flickr. It's a lot of work to come up with meaningful and comprehensive tags, so crowdsourcing would be the way to go? Of course then there's the issue of consistency, etc.


An early science crowdsourcing experiment/project tackled crater-counting on Mars... ( https://en.wikipedia.org/wiki/Clickworkers#...Martian_craters )

Galaxy Quest tackles the consistency problem with a tutorial and tests that must be passed before a volunteer can tackle real data: http://www.galaxyzoo.org/how_to_take_part .


--------------------
--
Viva software libre!
Go to the top of the page
 
+Quote Post
elakdawalla
post Aug 16 2012, 08:34 PM
Post #92


Administrator
****

Group: Admin
Posts: 5172
Joined: 4-August 05
From: Pasadena, CA, USA, Earth
Member No.: 454



QUOTE (mhoward @ Aug 16 2012, 01:05 PM) *
Perhaps obvious, but this would be another area where metadata would be useful. Surely the data exists to tie the MSSS rawids to timecode, observation ID, observation description, et cetra; we just don't have access to it.

Yes, indeed. I'm trying not to be a pest; I may try again to bring up metadata next week. The overhaul of the page design and the much faster posting of images are two major improvements made this week; I don't want to be too demanding smile.gif

Ludo, she says the technical people are looking in to the whitespace problem.


--------------------
My website - My Patreon - @elakdawalla on Twitter - Please support unmannedspaceflight.com by donating here.
Go to the top of the page
 
+Quote Post
Stellingwerff
post Aug 16 2012, 08:41 PM
Post #93


Junior Member
**

Group: Members
Posts: 43
Joined: 7-August 12
From: The Netherlands
Member No.: 6493



Hi all,

In part due to the huge sol=0 page (currently 250.000+ lines) and in part through bugs/issues I created, my app currently is "intermitted".... I'm working on it!

The good news is: As soon as I have the performance issues fixed, I'll have image release dates in the app as well, including sorting. Which means you can easily see what's new.

Grz,
Ludo.
Go to the top of the page
 
+Quote Post
Stellingwerff
post Aug 16 2012, 11:22 PM
Post #94


Junior Member
**

Group: Members
Posts: 43
Joined: 7-August 12
From: The Netherlands
Member No.: 6493




Ok, definitely not happy with the performance (and degradation thereof if something goes wrong) but at least it works again.

New features:
  • New image filter (<24 hours ago released)
  • Show and sort by release date
  • Show date in local timezone or UTC


Go to the top of the page
 
+Quote Post
3d_mars
post Aug 17 2012, 03:59 AM
Post #95


Newbie
*

Group: Members
Posts: 11
Joined: 12-August 12
Member No.: 6550



First post. Here's a small script I wrote to automatically process left and right full frame Navcam image pairs into SBS stereoscopic images. Thanks go to jmknapp for his image list service, http://curiositymsl.com. I originally intended to automate the full process, from downloading the images to creating the final SBS output, but then I realized that I may want to process the images a bit before the final step. I use the free StereoPhoto Maker to create the final images. It's a windows app which is why I chose to write this in AutoIt (also free).

BTW, the images are PHENOMENAL when viewed with the Sony HMZ-T1. I purchased this hardware a few months ago in anticipation of this mission (and other 3D applications), and I've been extremely pleased with the quality of the high contrast dual OLED displays, which present a ghost-free stereo image.

CODE
#include <file.au3> ; for _filereadtoarray
#include <Array.au3> ; for _arraydisplay

; 20120816, version 0.1
; This script processes all full frame Navcam images using jmknapp's http://curiositymsl.com, downloads only full frame LR pairs
(if not downloaded already) and creates a StereoPhoto script file
; (todo) Also process Mastcam images
; 3d_mars


; prompt user for sol number to retrieve, $sol
Local $sol = InputBox("Sol Number", "Input Sol Number:")
If @error Then Exit

; create temp file for listing all URLs for a given sol
; example: c:\users\username\appdata\local\temp\URLs_sol_1.txt
$URL_list_file=@TempDir & "\URLs_sol_" & $sol & ".txt"

; download image URL list to text file
; InetGet option syntax: URL, filename, 1=force reload, 0=wait for download
InetGet("http://curiositymsl.com/cgi-bin/getfiles.cgi?sol=" & $sol, $URL_list_file,1,0)

; read URL list and import to array
; note: $allURLs[0] contains the number of records read into the array.
Local $allURLs
If Not _FileReadToArray($URL_list_file, $allURLs) Then
MsgBox(4096, "Error", " Error importing from file to Array error:" & @error)
Exit
EndIf

; search for Navcam full frames (*EDR_F*) insert into new array $allframes
; Navcam full frame example URLs:
; http://mars.jpl.nasa.gov/msl-raw-images/pr...AUT_04096M_.JPG
; http://mars.jpl.nasa.gov/msl-raw-images/pr...AUT_04096M_.JPG

; declare large array instead of resizing array multiple times, uses very little RAM
Local $allframes[9999]=[0]
$x = 1
For $URL in $allURLs
;check for Navcam full frame
If StringInStr($URL,"EDR_F") Then
$allframes[$x]=$URL
$x += 1
EndIf
Next

;record total number of frames
$allframes[0]=$x - 1

; read allframes to find matching left/right pairs
; insert into new arrays $leftframe_Nav, $rightframe_Nav

Local $leftframe_Nav[9999]=[0]
Local $rightframe_Nav[9999]=[0]
Local $leftframe_counter = 0
Local $rightframe_counter = 0

For $x = 1 to $allframes[0]
If StringInStr($allframes[$x],"NLA_") Then
;left frame found, store in $leftframe_Nav array
$leftframe_counter += 1
$leftframe_Nav[$leftframe_counter]=$allframes[$x]
$leftframe_Nav[0]=$leftframe_counter
ElseIf StringInStr($allframes[$x],"NRA_") Then
;right frame found, store in $rightframe_Nav array
$rightframe_counter += 1
$rightframe_Nav[$rightframe_counter]=$allframes[$x]
$rightframe_Nav[0]=$rightframe_counter
EndIf
Next

; if no left full frames then abort and exit
If $leftframe_counter == 0 Then
MsgBox(0, "", "No Navcam full frames found")
Exit
EndIf

;choose path and file name for images and generated StereoPhoto Maker script file
Local $MyDocsFolder = "::{450D8FBA-AD25-11D0-98A8-0800361B1103}"
Local $StereoPhoto_script_file = FileSaveDialog("Choose a path and filename for images and StereoPhoto Maker script file:", $MyDocsFolder,
"Text Files (*.txt)", 2, "navcam_sbs_sol_" & $sol & ".txt")
; option 2 = dialog remains until valid path/file selected

If @error Then
MsgBox(4096, "", "Save cancelled.")
EndIf

; using lists of left and right frames, find matches and save output
Local $right_matching_frame_number[9999]=[0]
Local $StereoPhoto_script_lines[9999]=[0]
Local $URL_left_temp, $left_image_file_name, $URL_right_temp, $right_image_file_name, $left_image_full_path, $right_image_full_path
For $x = 1 to $leftframe_Nav[0]
;extract frame number
$leftframe_image_number=StringMid($leftframe_Nav[$x],StringInStr($leftframe_Nav[$x],"NLA_")+4,9)
; returns -1 if no match found
$right_matching_frame_number[$x] = _ArraySearch($rightframe_Nav, $leftframe_image_number, 0, 0, 0, 1)

; download left and right images
If $right_matching_frame_number[$x] <> -1 Then

; find the file names
$URL_left_temp = StringSplit($leftframe_Nav[$x], "/")
$left_image_file_name = $URL_left_temp[UBound($URL_left_temp)-1]
$URL_right_temp = StringSplit($rightframe_Nav[$right_matching_frame_number[$x]], "/")
$right_image_file_name = $URL_right_temp[UBound($URL_right_temp)-1]

; create full path names
$left_image_full_path=@WorkingDir & "\" & $left_image_file_name
$right_image_full_path=@WorkingDir & "\" & $right_image_file_name

; build array for StereoPhoto Maker script file
$StereoPhoto_script_lines[$x]="21,0,0,0,0," & $left_image_full_path & "," & $right_image_full_path & ",,"

; download the images
; if the file already exists don't download it again
If Not FileExists($left_image_full_path) Then
InetGet($leftframe_Nav[$x],$left_image_full_path,1,0)
EndIf
If Not FileExists($right_image_full_path) Then
InetGet($rightframe_Nav[$right_matching_frame_number[$x]],$right_image_full_path,1,0)
EndIf

EndIf

Next


; write StereoPhoto Maker script file
Local $hFile = FileOpen($StereoPhoto_script_file, 2) ; 2 = erase previous
_FileWriteFromArray($StereoPhoto_script_file, $StereoPhoto_script_lines, 1) ; 1 = index to start
FileClose($hFile)


; open StereoPhoto Maker, select File menu, select multi conversion from list...
Go to the top of the page
 
+Quote Post
jmknapp
post Aug 17 2012, 01:36 PM
Post #96


Senior Member
****

Group: Members
Posts: 1465
Joined: 9-February 04
From: Columbus OH USA
Member No.: 13



QUOTE (3d_mars @ Aug 16 2012, 10:59 PM) *
First post. Here's a small script I wrote to automatically process left and right full frame Navcam image pairs into SBS stereoscopic images.


I had to look up what SBS stereo is (but hey, I can't even find my red-blue glasses to see some of the probably amazing anaglyph efforts here). So I take it that you need to have some expensive headgear like the Sony you mentioned to view them ($800) or at least shutter glasses and a special monitor? I wonder what the cheapest entry point is.


--------------------
Go to the top of the page
 
+Quote Post
jmknapp
post Aug 17 2012, 01:41 PM
Post #97


Senior Member
****

Group: Members
Posts: 1465
Joined: 9-February 04
From: Columbus OH USA
Member No.: 13



Some updates to my raw image listing app:

1) results selectable by camera (MASTCAM,NAVCAM,CHEMCAM,HAZCAM,MAHLI,MARDI)
2) number of items per page selectable (20, 50, 100)
3) thumbnail size selectable (small,large)
4) removed "lag" column
5) added columns for sol number and LMST of observation

Note that all parameters selected appear in the url, so if you have a particular kind of search you like, you can just bookmark it to return to it.

Probably about it for now. I might put in a selection for sol number. Happy raw image harvesting!


--------------------
Go to the top of the page
 
+Quote Post
fredk
post Aug 17 2012, 02:07 PM
Post #98


Senior Member
****

Group: Members
Posts: 4246
Joined: 17-January 05
Member No.: 152



QUOTE (jmknapp @ Aug 17 2012, 02:36 PM) *
So I take it that you need to have some expensive headgear
Not at all! Using StereoPhoto Maker that 3d_mars linked to, you can view side-by-side images without any special hardware or glasses at all. StereoPhoto Maker displays the L and R images side by side, but only displaying a vertical strip wide enough to merge by crossing (or diverging) your eyes. You can then easily pan to see the entire image.
Go to the top of the page
 
+Quote Post
3d_mars
post Aug 17 2012, 02:40 PM
Post #99


Newbie
*

Group: Members
Posts: 11
Joined: 12-August 12
Member No.: 6550



QUOTE (jmknapp @ Aug 17 2012, 05:36 AM) *
I had to look up what SBS stereo is (but hey, I can't even find my red-blue glasses to see some of the probably amazing anaglyph efforts here). So I take it that you need to have some expensive headgear like the Sony you mentioned to view them ($800) or at least shutter glasses and a special monitor? I wonder what the cheapest entry point is.

I mentioned the hardware as an aside and I don't want to diverge too much from the main purpose of this thread, so allow me to just say that any effort you put into viewing these images in 3D will be worth it, trust me. The Mars landscape comes to life in 3D, and with MSL we have many different 3D image sources. Thank you again MSSS!
Go to the top of the page
 
+Quote Post
fredk
post Aug 17 2012, 02:41 PM
Post #100


Senior Member
****

Group: Members
Posts: 4246
Joined: 17-January 05
Member No.: 152



QUOTE (jmknapp @ Aug 17 2012, 02:41 PM) *
Note that all parameters selected appear in the url, so if you have a particular kind of search you like, you can just bookmark it to return to it.

This is now nearly perfect, Joe! I have one suggestion. Perhaps you could make the names in the "name" column link to the same full-size image as the thumbs do. That way the names would change colour after the image was viewed, so we could easily tell which images we've seen before, or up to what time we've viewed in the default "released" sort when we check in in the morning.
Go to the top of the page
 
+Quote Post
ChrisC
post Aug 17 2012, 03:15 PM
Post #101


Junior Member
**

Group: Members
Posts: 59
Joined: 4-July 08
Member No.: 4251



QUOTE (jmknapp @ Aug 17 2012, 09:41 AM) *
Some updates to my raw image listing app


Jim, I just wanted to thank you again for this. It's an absolutely fantastic service to the community. Every morning brings new joy, and your simple interface makes it so much easier to experience.
Go to the top of the page
 
+Quote Post
mcaplinger
post Aug 17 2012, 03:21 PM
Post #102


Senior Member
****

Group: Members
Posts: 2504
Joined: 13-September 05
Member No.: 497



QUOTE (3d_mars @ Aug 17 2012, 07:40 AM) *
The Mars landscape comes to life in 3D, and with MSL we have many different 3D image sources. Thank you again MSSS!

We appreciate the thanks but we didn't build the engineering cameras. 3D with Mastcam will be tough because of the different focal lengths. The best 3D source will likely be from MAHLI, since we can move the viewpoint around with the arm.

I've been using StereoPhoto Maker to output images in MPO format for display on an LG 3D television. This is definitely a nice technology that didn't exist back on MER.


--------------------
Disclaimer: This post is based on public information only. Any opinions are my own.
Go to the top of the page
 
+Quote Post
elakdawalla
post Aug 17 2012, 04:41 PM
Post #103


Administrator
****

Group: Admin
Posts: 5172
Joined: 4-August 05
From: Pasadena, CA, USA, Earth
Member No.: 454



I started a new thread to discuss 3D display technology; I hope people will share their experiences/recommendations over there.


--------------------
My website - My Patreon - @elakdawalla on Twitter - Please support unmannedspaceflight.com by donating here.
Go to the top of the page
 
+Quote Post
jmknapp
post Aug 17 2012, 06:34 PM
Post #104


Senior Member
****

Group: Members
Posts: 1465
Joined: 9-February 04
From: Columbus OH USA
Member No.: 13



QUOTE (fredk @ Aug 17 2012, 09:41 AM) *
This is now nearly perfect, Joe! I have one suggestion. Perhaps you could make the names in the "name" column link to the same full-size image as the thumbs do. That way the names would change colour after the image was viewed, so we could easily tell which images we've seen before, or up to what time we've viewed in the default "released" sort when we check in in the morning.


In general I'm trying to resist the urge for more bells and whistles since as ChrisC notes, simplicity is a virtue--but your suggestion actually makes makes the interface simpler. Done! As Thoreau said, "simplify, simplify, simplify!"


--------------------
Go to the top of the page
 
+Quote Post
atomoid
post Aug 18 2012, 12:09 AM
Post #105


Member
***

Group: Members
Posts: 866
Joined: 15-March 05
From: Santa Cruz, CA
Member No.: 196



nice work! this is a very handy and fun browser to poke around with, i fear if the word gets out it will be overloaded much too soon!!
i was wondering what sorting by 'thumbnail' could possibly mean.
of course it means: "Unknown column 'thumbnail' in 'order clause'" laugh.gif
Go to the top of the page
 
+Quote Post

25 Pages V  « < 5 6 7 8 9 > » 
Reply to this topicStart new topic

 



RSS Lo-Fi Version Time is now: 28th March 2024 - 09:35 AM
RULES AND GUIDELINES
Please read the Forum Rules and Guidelines before posting.

IMAGE COPYRIGHT
Images posted on UnmannedSpaceflight.com may be copyrighted. Do not reproduce without permission. Read here for further information on space images and copyright.

OPINIONS AND MODERATION
Opinions expressed on UnmannedSpaceflight.com are those of the individual posters and do not necessarily reflect the opinions of UnmannedSpaceflight.com or The Planetary Society. The all-volunteer UnmannedSpaceflight.com moderation team is wholly independent of The Planetary Society. The Planetary Society has no influence over decisions made by the UnmannedSpaceflight.com moderators.
SUPPORT THE FORUM
Unmannedspaceflight.com is funded by the Planetary Society. Please consider supporting our work and many other projects by donating to the Society or becoming a member.