Curiosity Image Retrieval Tools, scripts and software |
Curiosity Image Retrieval Tools, scripts and software |
Aug 11 2012, 09:18 AM
Post
#1
|
|
Member Group: Members Posts: 270 Joined: 29-December 04 From: NLA0: Member No.: 133 |
I wrote a shell script that allows you to download all images from a given sol.:
http://paranoid.dechengst.nl/files/MSLget.sh There are two rm commands in the script to clean up the tempdir. If you're afraid my script screws up your system replace them with rm -i commands. If you want any features added please let me know and I'll see what I can do. EDIT1: Added leading zeros in the directory names for easy sorting after a request for it on IRC. EDIT2: I see a lot of people downloading the script. To be clear: This is a script for *NIX systems and won't run on a standard Windows box. To get it running under Windows you need to install a *NIX environment like Cygwin. Your other option would be to install something like Ubuntu in VirtualBox. EDIT3: As RoverDriver pointed out you need to have wget on your system to use this script. The script now handles this gracefully. -------------------- PDP, VAX and Alpha fanatic ; HP-Compaq is the Satan! ; Let us pray daily while facing Maynard! ; Life starts at 150 km/h ;
|
|
|
Aug 15 2012, 02:18 AM
Post
#2
|
|
Senior Member Group: Members Posts: 1465 Joined: 9-February 04 From: Columbus OH USA Member No.: 13 |
Hey, good news and bad news, the good outweighing the bad. It seems that just a little while ago JPL revamped their raw image website. They fixed the issue where full size "thumbnails" were being loaded. They also flag the latest images ("The 5 new images for Sol 3 are marked with a red *") as well as images grouped by camera.
The bad news is that with the changes in their html, page-scraping for my app is broken for the time being & I turned off updates until that can be fixed. Always a danger with hacks like page-scraping! Anyway, the main site is on move. -------------------- |
|
|
Aug 15 2012, 03:46 AM
Post
#3
|
|
Junior Member Group: Members Posts: 43 Joined: 7-August 12 From: The Netherlands Member No.: 6493 |
Hey, good news and bad news, the good outweighing the bad. It seems that just a little while ago JPL revamped their raw image website. They fixed the issue where full size "thumbnails" were being loaded. Anyway, the main site is on move. Good! Although following a moving target is challenging, any progress on their side is excellent. Happily they decided in this "round" to keep their old "sol-based" page largely similar, so my HTML loading still works correctly. (Largely similar doesn't mean that they didn't hasitate to put another 30.000+ empty lines in the HTML!) Let's see where they are moving towards, I hope they are reading the user-feedback on this thread as usefull input:) Greetings, Ludo. |
|
|
Aug 15 2012, 11:14 AM
Post
#4
|
|
Senior Member Group: Members Posts: 1465 Joined: 9-February 04 From: Columbus OH USA Member No.: 13 |
Happily they decided in this "round" to keep their old "sol-based" page largely similar, so my HTML loading still works correctly. My parsing was a bit more fragile--it's fixed now though and updating again curiositymsl.com. I also made a change to hide official thumbnail images where a full-frame image has also come in. Turns out that's about 10% of the total images (right now 1,998 total images). Nice app!--Google appengine, right? I guess the only thing my app adds is the ability to sort by release date and time taken. BTW, if you're interested in adding that, you can use curl to get the timestamps of the image files on the JPL site, and the time taken on Mars can be scraped from the web pages or with some of the cameras extracted from the image file name (in ephemeris seconds). Maybe some future update on the JPL site will include more metadata and in a more robust form as Emily, Paolo & others have wished for. I imagine it's a bigger problem getting accurate position and pointing info from rovers than with missions such as Cassini. At least in the latter case, Mr. Kepler is largely in control of the positioning without the added complications of terrain, slip and dead reckoning. -------------------- |
|
|
Lo-Fi Version | Time is now: 14th June 2024 - 12:03 PM |
RULES AND GUIDELINES Please read the Forum Rules and Guidelines before posting. IMAGE COPYRIGHT |
OPINIONS AND MODERATION Opinions expressed on UnmannedSpaceflight.com are those of the individual posters and do not necessarily reflect the opinions of UnmannedSpaceflight.com or The Planetary Society. The all-volunteer UnmannedSpaceflight.com moderation team is wholly independent of The Planetary Society. The Planetary Society has no influence over decisions made by the UnmannedSpaceflight.com moderators. |
SUPPORT THE FORUM Unmannedspaceflight.com is funded by the Planetary Society. Please consider supporting our work and many other projects by donating to the Society or becoming a member. |