IPB

Welcome Guest ( Log In | Register )

Curiosity Image Retrieval Tools, scripts and software
DEChengst
post Aug 11 2012, 09:18 AM
Post #101


Member
***

Group: Members
Posts: 270
Joined: 29-December 04
From: NLA0:
Member No.: 133



I wrote a shell script that allows you to download all images from a given sol.:

http://paranoid.dechengst.nl/files/MSLget.sh

There are two rm commands in the script to clean up the tempdir. If you're afraid my script screws up your system replace them with rm -i commands. If you want any features added please let me know and I'll see what I can do.

EDIT1:

Added leading zeros in the directory names for easy sorting after a request for it on IRC.

EDIT2:

I see a lot of people downloading the script. To be clear: This is a script for *NIX systems and won't run on a standard Windows box. To get it running under Windows you need to install a *NIX environment like Cygwin. Your other option would be to install something like Ubuntu in VirtualBox.

EDIT3:

As RoverDriver pointed out you need to have wget on your system to use this script. The script now handles this gracefully.


--------------------
PDP, VAX and Alpha fanatic ; HP-Compaq is the Satan! ; Let us pray daily while facing Maynard! ; Life starts at 150 km/h ;
Go to the top of the page
 
+Quote Post

Posts in this topic
- DEChengst   Curiosity Image Retrieval Tools   Aug 11 2012, 09:18 AM
- - elakdawalla   I started a new thread to discuss 3D display techn...   Aug 17 2012, 04:41 PM
- - atomoid   nice work! this is a very handy and fun browse...   Aug 18 2012, 12:09 AM
|- - jmknapp   QUOTE (atomoid @ Aug 17 2012, 08:09 PM) n...   Aug 18 2012, 12:38 AM
- - atomoid   of course its tempting to ask for more features. a...   Aug 18 2012, 01:32 AM
- - maschnitz   I was about to do this very site on a long weekend...   Aug 18 2012, 02:01 AM
|- - jmknapp   QUOTE (maschnitz @ Aug 17 2012, 09:01 PM)...   Aug 20 2012, 12:38 AM
- - Stellingwerff   And we're back! Man, someone said somethi...   Aug 19 2012, 08:40 PM
|- - jmknapp   QUOTE (Stellingwerff @ Aug 19 2012, 03:40...   Aug 20 2012, 12:16 AM
- - Stellingwerff   Ok, back to feature development: Newest version c...   Aug 20 2012, 11:53 AM
|- - elakdawalla   QUOTE (Stellingwerff @ Aug 20 2012, 04:53...   Aug 21 2012, 07:41 PM
- - maschnitz   Hi Joe - thanks for reading over my scattered note...   Aug 20 2012, 07:14 PM
|- - Stellingwerff   Hi, Thanks for the tip, I'll put it on the to...   Aug 20 2012, 09:53 PM
|- - jmknapp   QUOTE (maschnitz @ Aug 20 2012, 03:14 PM)...   Aug 22 2012, 12:52 AM
|- - maschnitz   QUOTE (jmknapp @ Aug 21 2012, 05:52 PM) I...   Aug 22 2012, 03:31 AM
- - maschnitz   Yup. HTML5's storage only works on fairly mode...   Aug 20 2012, 10:09 PM
- - fredk   It's easy to mark your last visit now - just v...   Aug 22 2012, 01:02 AM
|- - jmknapp   Whoa, sorry about that. I just tried it with my ve...   Aug 22 2012, 01:22 AM
- - Stellingwerff   Early morning release: Better IE supportSupport s...   Aug 22 2012, 05:02 AM
- - elakdawalla   Well, I know what I've been leaning toward as ...   Aug 22 2012, 05:26 AM
|- - Stellingwerff   Completely agree, less is way more. That's wh...   Aug 22 2012, 05:36 AM
- - elakdawalla   Ludo, another feature request. In the "Type...   Aug 22 2012, 08:01 PM
|- - Stellingwerff   I've a new version ready for your enjoyment, w...   Aug 22 2012, 09:35 PM
|- - walfy   QUOTE (Stellingwerff @ Aug 22 2012, 01:35...   Aug 22 2012, 09:48 PM
- - elakdawalla   Split Curiosity nicknaming posts to its own thread...   Aug 23 2012, 05:20 PM
- - Stellingwerff   Nice round image milestone: 4000! Only many 10...   Aug 24 2012, 08:28 AM
|- - jmknapp   Yes, particularly when having to depend on scrapin...   Aug 24 2012, 10:41 AM
|- - Stellingwerff   I haven't checked yet, but how about parsing t...   Aug 24 2012, 11:02 AM
|- - jmknapp   Re: checking the first page for the "OrangeRa...   Aug 24 2012, 11:47 AM
|- - Stellingwerff   Nope, the frontpage trick seems not trustworthy as...   Aug 24 2012, 03:06 PM
- - jmknapp   A couple recent changes to http://curiositymsl.com...   Aug 25 2012, 05:42 PM
|- - Pando   QUOTE (jmknapp @ Aug 25 2012, 10:42 AM) A...   Aug 26 2012, 07:18 PM
|- - Stellingwerff   They are not very consistent with the casing of th...   Aug 26 2012, 07:20 PM
|- - jmknapp   QUOTE (Pando @ Aug 26 2012, 02:18 PM) I h...   Aug 27 2012, 12:11 AM
|- - Pando   QUOTE (jmknapp @ Aug 26 2012, 04:11 PM) T...   Aug 27 2012, 03:54 AM
- - Stellingwerff   Hi All, Proud to present: Local lists of images...   Aug 26 2012, 06:58 PM
- - 3d_mars   Here's version 2.0 of my Navcam download tool,...   Aug 27 2012, 03:32 AM
- - Stellingwerff   Hi all, I've done another update to http://ms...   Aug 28 2012, 09:48 PM
- - Stellingwerff   Hi all, Remind me to never ever say anything abou...   Sep 4 2012, 08:25 PM
- - Stellingwerff   MAHLI is sending a set of new images with a slight...   Sep 12 2012, 11:35 AM
|- - mcaplinger   QUOTE (Stellingwerff @ Sep 12 2012, 04:35...   Sep 12 2012, 02:24 PM
- - fredk   Joe - I'm seeing all the latest images on your...   Sep 20 2012, 05:23 PM
|- - Joffan   QUOTE (fredk @ Sep 20 2012, 10:23 AM) Joe...   Sep 20 2012, 06:54 PM
- - jmknapp   Thanks for the heads up--I'll check it out. I...   Sep 20 2012, 07:00 PM
- - centsworth_II   Y2K strikes at last!   Sep 20 2012, 07:07 PM
|- - jmknapp   QUOTE (centsworth_II @ Sep 20 2012, 02:07...   Sep 20 2012, 07:44 PM
- - Explorer1   Will this include streamlining the page select at ...   Sep 21 2012, 05:04 AM
- - jmknapp   Here's another go at an alternative interface ...   Sep 21 2012, 12:25 PM
- - Reckless   Brilliant chemcam large is good too and many than...   Sep 21 2012, 01:47 PM
- - fredk   This looks great, Joe! One suggestion: could ...   Sep 21 2012, 02:04 PM
|- - jmknapp   QUOTE (fredk @ Sep 21 2012, 09:04 AM) Thi...   Sep 21 2012, 02:31 PM
- - Ant103   Wow ! Great great job there ! Will it be ...   Sep 21 2012, 02:52 PM
|- - jmknapp   QUOTE (Ant103 @ Sep 21 2012, 09:52 AM) Wi...   Sep 21 2012, 06:05 PM
- - Ant103   Hmm, maybe keeping some meta-info like the the fil...   Sep 21 2012, 06:28 PM
- - elakdawalla   Joe, this is really promising. I have a couple of ...   Sep 25 2012, 05:48 PM
|- - jmknapp   QUOTE (elakdawalla @ Sep 25 2012, 01:48 P...   Sep 25 2012, 06:56 PM
- - EdTruthan   I second the Wow's! Joe the search page is...   Sep 25 2012, 08:22 PM
|- - jmknapp   QUOTE (EdTruthan @ Sep 25 2012, 04:22 PM)...   Sep 25 2012, 11:33 PM
- - atomoid   it would be interesting to know how the firmware o...   Sep 26 2012, 12:47 AM
- - CosmicRocker   I'm trying to learn which method is the most e...   Sep 26 2012, 02:16 AM
|- - jmknapp   True, my web page doesn't enable bulk download...   Sep 26 2012, 10:14 AM
- - ronald   I'm getting used to Stellingwerffs http://msl-...   Sep 27 2012, 07:33 AM
|- - RoverDriver   QUOTE (ronald @ Sep 27 2012, 12:33 AM) .....   Sep 27 2012, 04:01 PM
||- - ronald   QUOTE (RoverDriver @ Sep 27 2012, 06:01 P...   Sep 27 2012, 07:04 PM
|- - Stellingwerff   QUOTE (ronald @ Sep 27 2012, 09:33 AM) Wh...   Sep 28 2012, 01:48 PM
- - Ant103   curl is fine too. Just an example, to how to down...   Sep 27 2012, 04:07 PM
- - charborob   I've been trying to use Joe's "Curios...   Sep 28 2012, 01:38 PM
|- - fredk   QUOTE (charborob @ Sep 28 2012, 01:38 PM)...   Sep 28 2012, 05:14 PM
|- - Stellingwerff   As far as I can tell no changes on the JPL site. S...   Sep 28 2012, 08:58 PM
|- - jmknapp   QUOTE (fredk @ Sep 28 2012, 12:14 PM) Not...   Sep 28 2012, 11:38 PM
- - Stellingwerff   Hi all, Time for a status update on the http://ms...   Oct 6 2012, 09:46 AM
- - maschnitz   Nice work, Ludo. Yeah, I suspect the number of pic...   Oct 6 2012, 06:15 PM
|- - jmknapp   maschnitz, are you referring to the original page ...   Oct 6 2012, 09:31 PM
- - maschnitz   Yeah, the root page. Hm. OK. I checked the root pa...   Oct 6 2012, 09:49 PM
- - jmknapp   I'm not indexing on etreleased or ettaken (may...   Oct 6 2012, 11:08 PM
|- - maschnitz   Very odd. 4 seconds is an eternity for a computer....   Oct 7 2012, 12:11 AM
|- - jmknapp   QUOTE (maschnitz @ Oct 6 2012, 08:11 PM) ...   Oct 7 2012, 10:51 AM
- - elakdawalla   Just a comment to say, carry on, guys -- I'm l...   Oct 7 2012, 04:50 PM
- - maschnitz   Excellent, glad that's helping. Here's a t...   Oct 7 2012, 05:21 PM
- - jmknapp   OK, made the et->utc conversion change & it...   Oct 7 2012, 07:01 PM
- - jmknapp   I updated the http://curiositymsl.com site last ni...   Oct 13 2012, 11:21 PM
- - EdTruthan   List by Sol with infinite scroll! (hey that rh...   Oct 14 2012, 01:23 AM
- - Joffan   Joe, if you're taking requests, I'm genera...   Oct 16 2012, 04:42 AM
|- - jmknapp   QUOTE (Joffan @ Oct 16 2012, 12:42 AM) Jo...   Oct 16 2012, 07:00 PM
|- - Joffan   QUOTE (jmknapp @ Oct 16 2012, 01:00 PM) J...   Oct 18 2012, 04:09 AM
- - ronald   Joes and Ludos pages make life so much easier...   Oct 16 2012, 07:24 PM
- - Paul Fjeld   Joe, is there a way to list by LMST as you could w...   Oct 17 2012, 09:47 PM
|- - jmknapp   QUOTE (Paul Fjeld @ Oct 17 2012, 05:47 PM...   Oct 17 2012, 10:34 PM
- - jmknapp   OK, I put in a selection to sort by local Mars tim...   Oct 18 2012, 01:02 PM
|- - Paul Fjeld   I see what you mean. In your older implementation ...   Oct 18 2012, 09:06 PM
- - jmknapp   OK, finally have a web site for tagging images rea...   Oct 25 2012, 02:55 PM
- - elakdawalla   I tried to establish a login, but after half an ho...   Oct 25 2012, 03:52 PM
|- - jmknapp   QUOTE (elakdawalla @ Oct 25 2012, 10:52 A...   Oct 25 2012, 05:57 PM
- - jmknapp   I heard from Ed Truthan that the confirmation emai...   Oct 25 2012, 05:32 PM
- - CosmicRocker   Your site keeps getting better and better. I love...   Oct 26 2012, 03:49 AM
- - maschnitz   Just an FYI, Joe - the software lingo that magical...   Oct 26 2012, 06:14 AM
- - jmknapp   Alright, I changed the tag entry page so that it u...   Oct 26 2012, 02:29 PM
- - fredk   Hi Joe - a question about your site http://curiosi...   Oct 27 2012, 04:01 PM
4 Pages V  < 1 2 3 4 >


Reply to this topicStart new topic

 



RSS Lo-Fi Version Time is now: 23rd May 2024 - 02:09 PM
RULES AND GUIDELINES
Please read the Forum Rules and Guidelines before posting.

IMAGE COPYRIGHT
Images posted on UnmannedSpaceflight.com may be copyrighted. Do not reproduce without permission. Read here for further information on space images and copyright.

OPINIONS AND MODERATION
Opinions expressed on UnmannedSpaceflight.com are those of the individual posters and do not necessarily reflect the opinions of UnmannedSpaceflight.com or The Planetary Society. The all-volunteer UnmannedSpaceflight.com moderation team is wholly independent of The Planetary Society. The Planetary Society has no influence over decisions made by the UnmannedSpaceflight.com moderators.
SUPPORT THE FORUM
Unmannedspaceflight.com is funded by the Planetary Society. Please consider supporting our work and many other projects by donating to the Society or becoming a member.