IPB

Welcome Guest ( Log In | Register )

Curiosity Image Retrieval Tools, scripts and software
DEChengst
post Aug 11 2012, 09:18 AM
Post #1


Member
***

Group: Members
Posts: 270
Joined: 29-December 04
From: NLA0:
Member No.: 133



I wrote a shell script that allows you to download all images from a given sol.:

http://paranoid.dechengst.nl/files/MSLget.sh

There are two rm commands in the script to clean up the tempdir. If you're afraid my script screws up your system replace them with rm -i commands. If you want any features added please let me know and I'll see what I can do.

EDIT1:

Added leading zeros in the directory names for easy sorting after a request for it on IRC.

EDIT2:

I see a lot of people downloading the script. To be clear: This is a script for *NIX systems and won't run on a standard Windows box. To get it running under Windows you need to install a *NIX environment like Cygwin. Your other option would be to install something like Ubuntu in VirtualBox.

EDIT3:

As RoverDriver pointed out you need to have wget on your system to use this script. The script now handles this gracefully.


--------------------
PDP, VAX and Alpha fanatic ; HP-Compaq is the Satan! ; Let us pray daily while facing Maynard! ; Life starts at 150 km/h ;
Go to the top of the page
 
+Quote Post
 
Start new topic
Replies
elakdawalla
post Oct 25 2012, 03:52 PM
Post #2


Administrator
****

Group: Admin
Posts: 5172
Joined: 4-August 05
From: Pasadena, CA, USA, Earth
Member No.: 454



I tried to establish a login, but after half an hour I haven't received the confirmation email (it's not in the spam folder either). Dunno if that's a problem for everybody or just me.

I suggest you establish a controlled or at least strongly suggested vocabulary, or at the very least a way to list tags currently in use. Certain things that get imaged a lot -- the chemin inlet port, marsdial, etc -- should somehow get tagged identically.

It would be great if there were a suggested style of tag that would help collect the images taken as part of a single panorama together. For MER I'd propose the use of a combination of sol number and sequence ID; I haven't paid close enough attention to MSL image file naming to know if there's an obvious way to do this, or if we would need to develop our own naming convention, e.g. "MLsol17panSW" or whatever. We're handicapped by not having the names of targets available as we do with MER...

If this gets used, it will represent a considerable amount of effort, so I would want to ensure that it will eventually get mapped to the PDS data as it becomes available.


--------------------
My website - My Patreon - @elakdawalla on Twitter - Please support unmannedspaceflight.com by donating here.
Go to the top of the page
 
+Quote Post
jmknapp
post Oct 25 2012, 05:57 PM
Post #3


Senior Member
****

Group: Members
Posts: 1465
Joined: 9-February 04
From: Columbus OH USA
Member No.: 13



QUOTE (elakdawalla @ Oct 25 2012, 10:52 AM) *
I suggest you establish a controlled or at least strongly suggested vocabulary, or at the very least a way to list tags currently in use. Certain things that get imaged a lot -- the chemin inlet port, marsdial, etc -- should somehow get tagged identically.


That's a good idea--right now it's pretty much unconstrained, leaving to question whether the genius or madness of the crowd would prevail. Most sites like youtube, flickr, etc. suggest tags as you say. Not sure if it's my pay grade to come up with a list a priori though, so maybe a list of current tags is the way to go for a start.

Maybe if people used different tags once in a while for the same thing it wouldn't be too onerous to manually go in occasionally and merge synonymous tags and that would build up an 'approved' list more organically.

EDIT: I made a change that hopefully should make it less likely the activation email ends up in a spam folder. Hey, that's why it's called beta.


--------------------
Go to the top of the page
 
+Quote Post

Posts in this topic
- DEChengst   Curiosity Image Retrieval Tools   Aug 11 2012, 09:18 AM
- - elakdawalla   I started a new thread to discuss 3D display techn...   Aug 17 2012, 04:41 PM
- - atomoid   nice work! this is a very handy and fun browse...   Aug 18 2012, 12:09 AM
|- - jmknapp   QUOTE (atomoid @ Aug 17 2012, 08:09 PM) n...   Aug 18 2012, 12:38 AM
- - atomoid   of course its tempting to ask for more features. a...   Aug 18 2012, 01:32 AM
- - maschnitz   I was about to do this very site on a long weekend...   Aug 18 2012, 02:01 AM
|- - jmknapp   QUOTE (maschnitz @ Aug 17 2012, 09:01 PM)...   Aug 20 2012, 12:38 AM
- - Stellingwerff   And we're back! Man, someone said somethi...   Aug 19 2012, 08:40 PM
|- - jmknapp   QUOTE (Stellingwerff @ Aug 19 2012, 03:40...   Aug 20 2012, 12:16 AM
- - Stellingwerff   Ok, back to feature development: Newest version c...   Aug 20 2012, 11:53 AM
|- - elakdawalla   QUOTE (Stellingwerff @ Aug 20 2012, 04:53...   Aug 21 2012, 07:41 PM
- - maschnitz   Hi Joe - thanks for reading over my scattered note...   Aug 20 2012, 07:14 PM
|- - Stellingwerff   Hi, Thanks for the tip, I'll put it on the to...   Aug 20 2012, 09:53 PM
|- - jmknapp   QUOTE (maschnitz @ Aug 20 2012, 03:14 PM)...   Aug 22 2012, 12:52 AM
|- - maschnitz   QUOTE (jmknapp @ Aug 21 2012, 05:52 PM) I...   Aug 22 2012, 03:31 AM
- - maschnitz   Yup. HTML5's storage only works on fairly mode...   Aug 20 2012, 10:09 PM
- - fredk   It's easy to mark your last visit now - just v...   Aug 22 2012, 01:02 AM
|- - jmknapp   Whoa, sorry about that. I just tried it with my ve...   Aug 22 2012, 01:22 AM
- - Stellingwerff   Early morning release: Better IE supportSupport s...   Aug 22 2012, 05:02 AM
- - elakdawalla   Well, I know what I've been leaning toward as ...   Aug 22 2012, 05:26 AM
|- - Stellingwerff   Completely agree, less is way more. That's wh...   Aug 22 2012, 05:36 AM
- - elakdawalla   Ludo, another feature request. In the "Type...   Aug 22 2012, 08:01 PM
|- - Stellingwerff   I've a new version ready for your enjoyment, w...   Aug 22 2012, 09:35 PM
|- - walfy   QUOTE (Stellingwerff @ Aug 22 2012, 01:35...   Aug 22 2012, 09:48 PM
- - elakdawalla   Split Curiosity nicknaming posts to its own thread...   Aug 23 2012, 05:20 PM
- - Stellingwerff   Nice round image milestone: 4000! Only many 10...   Aug 24 2012, 08:28 AM
|- - jmknapp   Yes, particularly when having to depend on scrapin...   Aug 24 2012, 10:41 AM
|- - Stellingwerff   I haven't checked yet, but how about parsing t...   Aug 24 2012, 11:02 AM
|- - jmknapp   Re: checking the first page for the "OrangeRa...   Aug 24 2012, 11:47 AM
|- - Stellingwerff   Nope, the frontpage trick seems not trustworthy as...   Aug 24 2012, 03:06 PM
- - jmknapp   A couple recent changes to http://curiositymsl.com...   Aug 25 2012, 05:42 PM
|- - Pando   QUOTE (jmknapp @ Aug 25 2012, 10:42 AM) A...   Aug 26 2012, 07:18 PM
|- - Stellingwerff   They are not very consistent with the casing of th...   Aug 26 2012, 07:20 PM
|- - jmknapp   QUOTE (Pando @ Aug 26 2012, 02:18 PM) I h...   Aug 27 2012, 12:11 AM
|- - Pando   QUOTE (jmknapp @ Aug 26 2012, 04:11 PM) T...   Aug 27 2012, 03:54 AM
- - Stellingwerff   Hi All, Proud to present: Local lists of images...   Aug 26 2012, 06:58 PM
- - 3d_mars   Here's version 2.0 of my Navcam download tool,...   Aug 27 2012, 03:32 AM
- - Stellingwerff   Hi all, I've done another update to http://ms...   Aug 28 2012, 09:48 PM
- - Stellingwerff   Hi all, Remind me to never ever say anything abou...   Sep 4 2012, 08:25 PM
- - Stellingwerff   MAHLI is sending a set of new images with a slight...   Sep 12 2012, 11:35 AM
|- - mcaplinger   QUOTE (Stellingwerff @ Sep 12 2012, 04:35...   Sep 12 2012, 02:24 PM
- - fredk   Joe - I'm seeing all the latest images on your...   Sep 20 2012, 05:23 PM
|- - Joffan   QUOTE (fredk @ Sep 20 2012, 10:23 AM) Joe...   Sep 20 2012, 06:54 PM
- - jmknapp   Thanks for the heads up--I'll check it out. I...   Sep 20 2012, 07:00 PM
- - centsworth_II   Y2K strikes at last!   Sep 20 2012, 07:07 PM
|- - jmknapp   QUOTE (centsworth_II @ Sep 20 2012, 02:07...   Sep 20 2012, 07:44 PM
- - Explorer1   Will this include streamlining the page select at ...   Sep 21 2012, 05:04 AM
- - jmknapp   Here's another go at an alternative interface ...   Sep 21 2012, 12:25 PM
- - Reckless   Brilliant chemcam large is good too and many than...   Sep 21 2012, 01:47 PM
- - fredk   This looks great, Joe! One suggestion: could ...   Sep 21 2012, 02:04 PM
|- - jmknapp   QUOTE (fredk @ Sep 21 2012, 09:04 AM) Thi...   Sep 21 2012, 02:31 PM
- - Ant103   Wow ! Great great job there ! Will it be ...   Sep 21 2012, 02:52 PM
|- - jmknapp   QUOTE (Ant103 @ Sep 21 2012, 09:52 AM) Wi...   Sep 21 2012, 06:05 PM
- - Ant103   Hmm, maybe keeping some meta-info like the the fil...   Sep 21 2012, 06:28 PM
- - elakdawalla   Joe, this is really promising. I have a couple of ...   Sep 25 2012, 05:48 PM
|- - jmknapp   QUOTE (elakdawalla @ Sep 25 2012, 01:48 P...   Sep 25 2012, 06:56 PM
- - EdTruthan   I second the Wow's! Joe the search page is...   Sep 25 2012, 08:22 PM
|- - jmknapp   QUOTE (EdTruthan @ Sep 25 2012, 04:22 PM)...   Sep 25 2012, 11:33 PM
- - atomoid   it would be interesting to know how the firmware o...   Sep 26 2012, 12:47 AM
- - CosmicRocker   I'm trying to learn which method is the most e...   Sep 26 2012, 02:16 AM
|- - jmknapp   True, my web page doesn't enable bulk download...   Sep 26 2012, 10:14 AM
- - ronald   I'm getting used to Stellingwerffs http://msl-...   Sep 27 2012, 07:33 AM
|- - RoverDriver   QUOTE (ronald @ Sep 27 2012, 12:33 AM) .....   Sep 27 2012, 04:01 PM
||- - ronald   QUOTE (RoverDriver @ Sep 27 2012, 06:01 P...   Sep 27 2012, 07:04 PM
|- - Stellingwerff   QUOTE (ronald @ Sep 27 2012, 09:33 AM) Wh...   Sep 28 2012, 01:48 PM
- - Ant103   curl is fine too. Just an example, to how to down...   Sep 27 2012, 04:07 PM
- - charborob   I've been trying to use Joe's "Curios...   Sep 28 2012, 01:38 PM
|- - fredk   QUOTE (charborob @ Sep 28 2012, 01:38 PM)...   Sep 28 2012, 05:14 PM
|- - Stellingwerff   As far as I can tell no changes on the JPL site. S...   Sep 28 2012, 08:58 PM
|- - jmknapp   QUOTE (fredk @ Sep 28 2012, 12:14 PM) Not...   Sep 28 2012, 11:38 PM
- - Stellingwerff   Hi all, Time for a status update on the http://ms...   Oct 6 2012, 09:46 AM
- - maschnitz   Nice work, Ludo. Yeah, I suspect the number of pic...   Oct 6 2012, 06:15 PM
|- - jmknapp   maschnitz, are you referring to the original page ...   Oct 6 2012, 09:31 PM
- - maschnitz   Yeah, the root page. Hm. OK. I checked the root pa...   Oct 6 2012, 09:49 PM
- - jmknapp   I'm not indexing on etreleased or ettaken (may...   Oct 6 2012, 11:08 PM
|- - maschnitz   Very odd. 4 seconds is an eternity for a computer....   Oct 7 2012, 12:11 AM
|- - jmknapp   QUOTE (maschnitz @ Oct 6 2012, 08:11 PM) ...   Oct 7 2012, 10:51 AM
- - elakdawalla   Just a comment to say, carry on, guys -- I'm l...   Oct 7 2012, 04:50 PM
- - maschnitz   Excellent, glad that's helping. Here's a t...   Oct 7 2012, 05:21 PM
- - jmknapp   OK, made the et->utc conversion change & it...   Oct 7 2012, 07:01 PM
- - jmknapp   I updated the http://curiositymsl.com site last ni...   Oct 13 2012, 11:21 PM
- - EdTruthan   List by Sol with infinite scroll! (hey that rh...   Oct 14 2012, 01:23 AM
- - Joffan   Joe, if you're taking requests, I'm genera...   Oct 16 2012, 04:42 AM
|- - jmknapp   QUOTE (Joffan @ Oct 16 2012, 12:42 AM) Jo...   Oct 16 2012, 07:00 PM
|- - Joffan   QUOTE (jmknapp @ Oct 16 2012, 01:00 PM) J...   Oct 18 2012, 04:09 AM
- - ronald   Joes and Ludos pages make life so much easier...   Oct 16 2012, 07:24 PM
- - Paul Fjeld   Joe, is there a way to list by LMST as you could w...   Oct 17 2012, 09:47 PM
|- - jmknapp   QUOTE (Paul Fjeld @ Oct 17 2012, 05:47 PM...   Oct 17 2012, 10:34 PM
- - jmknapp   OK, I put in a selection to sort by local Mars tim...   Oct 18 2012, 01:02 PM
|- - Paul Fjeld   I see what you mean. In your older implementation ...   Oct 18 2012, 09:06 PM
- - jmknapp   OK, finally have a web site for tagging images rea...   Oct 25 2012, 02:55 PM
- - elakdawalla   I tried to establish a login, but after half an ho...   Oct 25 2012, 03:52 PM
|- - jmknapp   QUOTE (elakdawalla @ Oct 25 2012, 10:52 A...   Oct 25 2012, 05:57 PM
- - jmknapp   I heard from Ed Truthan that the confirmation emai...   Oct 25 2012, 05:32 PM
- - CosmicRocker   Your site keeps getting better and better. I love...   Oct 26 2012, 03:49 AM
- - maschnitz   Just an FYI, Joe - the software lingo that magical...   Oct 26 2012, 06:14 AM
- - jmknapp   Alright, I changed the tag entry page so that it u...   Oct 26 2012, 02:29 PM
- - fredk   Hi Joe - a question about your site http://curiosi...   Oct 27 2012, 04:01 PM
4 Pages V  < 1 2 3 4 >


Reply to this topicStart new topic

 



RSS Lo-Fi Version Time is now: 20th June 2024 - 02:42 PM
RULES AND GUIDELINES
Please read the Forum Rules and Guidelines before posting.

IMAGE COPYRIGHT
Images posted on UnmannedSpaceflight.com may be copyrighted. Do not reproduce without permission. Read here for further information on space images and copyright.

OPINIONS AND MODERATION
Opinions expressed on UnmannedSpaceflight.com are those of the individual posters and do not necessarily reflect the opinions of UnmannedSpaceflight.com or The Planetary Society. The all-volunteer UnmannedSpaceflight.com moderation team is wholly independent of The Planetary Society. The Planetary Society has no influence over decisions made by the UnmannedSpaceflight.com moderators.
SUPPORT THE FORUM
Unmannedspaceflight.com is funded by the Planetary Society. Please consider supporting our work and many other projects by donating to the Society or becoming a member.