My Assistant
Curiosity Image Retrieval Tools, scripts and software |
Aug 11 2012, 09:18 AM
Post
#1
|
|
![]() Member ![]() ![]() ![]() Group: Members Posts: 270 Joined: 29-December 04 From: NLA0: Member No.: 133 |
I wrote a shell script that allows you to download all images from a given sol.:
http://paranoid.dechengst.nl/files/MSLget.sh There are two rm commands in the script to clean up the tempdir. If you're afraid my script screws up your system replace them with rm -i commands. If you want any features added please let me know and I'll see what I can do. EDIT1: Added leading zeros in the directory names for easy sorting after a request for it on IRC. EDIT2: I see a lot of people downloading the script. To be clear: This is a script for *NIX systems and won't run on a standard Windows box. To get it running under Windows you need to install a *NIX environment like Cygwin. Your other option would be to install something like Ubuntu in VirtualBox. EDIT3: As RoverDriver pointed out you need to have wget on your system to use this script. The script now handles this gracefully. -------------------- PDP, VAX and Alpha fanatic ; HP-Compaq is the Satan! ; Let us pray daily while facing Maynard! ; Life starts at 150 km/h ;
|
|
|
|
![]() |
Aug 14 2012, 12:40 AM
Post
#2
|
|
![]() Administrator ![]() ![]() ![]() ![]() Group: Admin Posts: 5172 Joined: 4-August 05 From: Pasadena, CA, USA, Earth Member No.: 454 |
First: AWESOME!
It would be great to filter by camera. I think image dimensions would be more useful than file size. I'm amused by the "lag" column, though it's not exactly fair, since it folds in both transmission lag (when did it arrive on Earth?) and raw posting lag. I'd prefer smaller thumbnails and more images per page, but don't know if that opinion is shared. This takes more logic, but: it would be great if it did not show *both* thumbnails *and* fulls of the same image. It would be lovely if it could just show the highest-resolution one returned to Earth so far. -------------------- My website - My Patreon - @elakdawalla on Twitter - Please support unmannedspaceflight.com by donating here.
|
|
|
|
Aug 14 2012, 01:20 AM
Post
#3
|
|
![]() Senior Member ![]() ![]() ![]() ![]() Group: Members Posts: 1465 Joined: 9-February 04 From: Columbus OH USA Member No.: 13 |
I think image dimensions would be more useful than file size. True, that was just a matter of expediency. I can find out the size of the files remotely with a "curl -sI <url>" command, but to get the image dimensions I would need to download all the files as they come in. That could be done. QUOTE I'm amused by the "lag" column, though it's not exactly fair, since it folds in both transmission lag (when did it arrive on Earth?) and raw posting lag. Haha, I thought that was potentially snarky too, but still, it's of interest to know how "live" the images are. There was a press conference last week where a guy from "Nasa Watch" was insinuating that if they happened to find a picture of stromatolites they would withhold it (which Dr. Grotzinger of course denied). Anyway, looking at earth-shattering photos like NRA_397586934EDR_F0010008AUT_04096M_ which was "withheld" for almost a week, it would seem that real life is less intriguing. Thanks for the other good suggestions. -------------------- |
|
|
|
Aug 14 2012, 02:33 AM
Post
#4
|
|
|
Senior Member ![]() ![]() ![]() ![]() Group: Members Posts: 2559 Joined: 13-September 05 Member No.: 497 |
...earth-shattering photos... which was "withheld" for almost a week... In some cases the image is only partially received on the ground the first time around and retransmissions have to be commanded. That can slow things up, sometimes considerably. Also, images can be prioritized low and get stuck behind higher-priority data. I seem to recall images showing up weeks or even months after acquisition on MER. So the lag is pretty meaningless. -------------------- Disclaimer: This post is based on public information only. Any opinions are my own.
|
|
|
|
DEChengst Curiosity Image Retrieval Tools Aug 11 2012, 09:18 AM
RoverDriver QUOTE (DEChengst @ Aug 11 2012, 02:18 AM)... Aug 11 2012, 01:32 PM
RoverDriver As an example of using wget to download the HiRISE... Aug 11 2012, 01:34 PM
M_Welander I've written a small too to help me download t... Aug 11 2012, 01:52 PM
James Sorenson For windows users, I've been using Star Downlo... Aug 11 2012, 02:11 PM
Pertinax QUOTE (James Sorenson @ Aug 11 2012, 10:1... Aug 11 2012, 02:49 PM
Marc I'm also working in a phyton script that autom... Aug 11 2012, 02:26 PM
scalbers Also a shell script using wget initially mentioned... Aug 11 2012, 02:42 PM
M_Welander Hm... actually... The reason why I posted my tool ... Aug 11 2012, 03:16 PM
M_Welander QUOTE Please don't start threads for each tool... Aug 11 2012, 04:20 PM
CosmicRocker QUOTE (M_Welander @ Aug 11 2012, 08:52 AM... Aug 11 2012, 04:09 PM
CosmicRocker It seems that it might be useful to create a subfo... Aug 11 2012, 05:00 PM
Stellingwerff I'm building a webportal for easier access to ... Aug 11 2012, 07:40 PM
elakdawalla On previous missions when it's been tough to p... Aug 11 2012, 08:12 PM
M_Welander I think it'll be fairly easy to get this ... Aug 11 2012, 08:31 PM
jmknapp To simply get a list of all the raw images for a g... Aug 11 2012, 08:41 PM
elakdawalla QUOTE (jmknapp @ Aug 11 2012, 01:41 PM) T... Aug 12 2012, 04:49 AM
elakdawalla Thanks, this is great! Note that with Navcam a... Aug 11 2012, 10:28 PM
jmknapp QUOTE (elakdawalla @ Aug 11 2012, 05:28 P... Aug 12 2012, 12:51 AM
walfy Any chance that Midnight Mars Browser can be modif... Aug 12 2012, 04:37 AM
elakdawalla Believe me, Mike knows very well we want that, and... Aug 12 2012, 04:47 AM
M_Welander QUOTE (walfy @ Aug 12 2012, 06:37 AM) It ... Aug 12 2012, 05:37 AM
rtphokie Anyone had any luck decoding the filenames on the ... Aug 12 2012, 08:15 PM
jmknapp Noticed a little bug on the JPL raw images web sit... Aug 13 2012, 12:40 AM
mcaplinger QUOTE (jmknapp @ Aug 12 2012, 05:40 PM) N... Aug 13 2012, 12:56 AM
jmknapp QUOTE (mcaplinger @ Aug 12 2012, 08:56 PM... Aug 13 2012, 01:43 AM
djellison QUOTE (mcaplinger @ Aug 12 2012, 05:56 PM... Aug 13 2012, 05:03 AM
elakdawalla I reported the same to Veronica McGregor a few day... Aug 13 2012, 01:45 AM
mcaplinger QUOTE (elakdawalla @ Aug 12 2012, 06:45 P... Aug 13 2012, 02:18 AM
M_Welander QUOTE (elakdawalla @ Aug 13 2012, 03:45 A... Aug 13 2012, 10:54 AM
Astro0 Let's remember that the mission is not obliged... Aug 13 2012, 03:02 AM
mcaplinger QUOTE (Astro0 @ Aug 12 2012, 08:02 PM) It... Aug 13 2012, 03:54 AM
jmknapp QUOTE (mcaplinger @ Aug 12 2012, 10:54 PM... Aug 13 2012, 10:28 AM
CosmicRocker QUOTE (M_Welander @ Aug 11 2012, 07:52 AM... Aug 13 2012, 04:06 AM
algorimancer I have my AlgorimancerPG rangefinder/photogrammetr... Aug 13 2012, 02:28 PM
mcaplinger QUOTE (algorimancer @ Aug 13 2012, 07:28 ... Aug 13 2012, 03:14 PM
ugordan QUOTE (mcaplinger @ Aug 13 2012, 05:14 PM... Aug 13 2012, 03:41 PM
jmknapp QUOTE (mcaplinger @ Aug 13 2012, 10:14 AM... Aug 13 2012, 03:44 PM

mcaplinger QUOTE (jmknapp @ Aug 13 2012, 07:44 AM) F... Aug 13 2012, 04:18 PM

jmknapp QUOTE (mcaplinger @ Aug 13 2012, 11:18 AM... Aug 13 2012, 06:07 PM

mcaplinger QUOTE (jmknapp @ Aug 13 2012, 10:07 AM) S... Aug 13 2012, 06:28 PM
algorimancer QUOTE (mcaplinger @ Aug 13 2012, 09:14 AM... Aug 13 2012, 04:44 PM
jmknapp Trying to develop a handier web interface to the r... Aug 14 2012, 12:17 AM
RoverDriver QUOTE (jmknapp @ Aug 13 2012, 05:17 PM) T... Aug 14 2012, 01:18 AM
jmknapp QUOTE (RoverDriver @ Aug 13 2012, 08:18 P... Aug 14 2012, 01:46 AM
RoverDriver QUOTE (jmknapp @ Aug 13 2012, 06:46 PM) .... Aug 14 2012, 02:36 AM
Oersted Works great on a Samsung Galaxy Nexus smartphone, ... Aug 14 2012, 12:44 AM
volcanopele QUOTE (Oersted @ Aug 13 2012, 05:44 PM) W... Aug 14 2012, 02:29 AM
lyford Allow me to say OMAGERD THANK YOU Aug 14 2012, 12:58 AM
ChrisC Fantastic, Joe!
My one suggestion has to do w... Aug 14 2012, 02:12 AM
Cargo Cult Evening, all -
It's definitely not a fantasti... Aug 14 2012, 06:52 AM
stevesliva QUOTE (Cargo Cult @ Aug 14 2012, 01:52 AM... Aug 14 2012, 03:53 PM
Explorer1 It works on my end; good job!
It's always... Aug 14 2012, 07:52 AM
algorimancer The AlgorimancerPG (APG) rangefinder utility is up... Aug 14 2012, 03:14 PM
algorimancer QUOTE (algorimancer @ Aug 14 2012, 10:14 ... Aug 15 2012, 12:11 AM
algorimancer QUOTE (algorimancer @ Aug 14 2012, 07:11 ... Aug 16 2012, 01:08 AM
fredk Your site is already looking fantastic, Joe. I... Aug 14 2012, 03:30 PM
mhoward QUOTE (fredk @ Aug 14 2012, 09:30 AM) I a... Aug 14 2012, 04:31 PM
elakdawalla MESSENGER has a feed of sorts -- through its iPhon... Aug 14 2012, 04:44 PM
jmknapp OK, lots of good suggestions, I'll get to most... Aug 14 2012, 07:07 PM
Stellingwerff Hi all,
In the meantime my listing has also evolv... Aug 14 2012, 07:41 PM
walfy QUOTE (Stellingwerff @ Aug 14 2012, 11:41... Aug 14 2012, 09:16 PM
elakdawalla Oh, cool. Hopefully you two guys' solutions wi... Aug 14 2012, 08:44 PM
jmknapp Hey, good news and bad news, the good outweighing ... Aug 15 2012, 02:18 AM
ElkGroveDan QUOTE (jmknapp @ Aug 14 2012, 07:18 PM) I... Aug 15 2012, 02:46 AM
Stellingwerff QUOTE (jmknapp @ Aug 15 2012, 04:18 AM) H... Aug 15 2012, 03:46 AM
jmknapp QUOTE (Stellingwerff @ Aug 14 2012, 11:46... Aug 15 2012, 11:14 AM
Stellingwerff QUOTE (jmknapp @ Aug 15 2012, 01:14 PM) N... Aug 15 2012, 12:03 PM
jmknapp QUOTE (Stellingwerff @ Aug 15 2012, 08:03... Aug 15 2012, 12:25 PM
djellison Mars EPO - headed by Michelle Viotti Aug 15 2012, 03:02 AM
jcims Does anyone in here know if any metadata is availa... Aug 15 2012, 05:39 AM
elakdawalla It's a big improvement! Now we just need t... Aug 15 2012, 05:41 AM
Stellingwerff Just a quick update notice:
http://msl-raw-images... Aug 15 2012, 07:24 AM
vk3ukf Hi all,
this doc might help help those looking to... Aug 15 2012, 11:39 AM
Stellingwerff Hi all,
Another update, starting to get there:)
A... Aug 15 2012, 08:14 PM
algorimancer QUOTE (Stellingwerff @ Aug 15 2012, 03:14... Aug 16 2012, 12:58 AM
elakdawalla This is awesome. Since you asked, the "killer... Aug 15 2012, 10:05 PM
RoverDriver If I may suggest something, I think it would be cr... Aug 15 2012, 11:32 PM
jmknapp QUOTE (RoverDriver @ Aug 15 2012, 06:32 P... Aug 16 2012, 09:21 AM
MahFL My impression was they gave the task to "scie... Aug 16 2012, 10:04 AM

RoverDriver QUOTE (MahFL @ Aug 16 2012, 03:04 AM) My ... Aug 16 2012, 10:56 AM
elakdawalla QUOTE (jmknapp @ Aug 16 2012, 01:21 AM) S... Aug 16 2012, 04:03 PM

mhoward QUOTE (elakdawalla @ Aug 16 2012, 10:03 A... Aug 16 2012, 08:05 PM

elakdawalla QUOTE (mhoward @ Aug 16 2012, 01:05 PM) P... Aug 16 2012, 08:34 PM
imipak QUOTE (jmknapp @ Aug 16 2012, 10:21 AM) S... Aug 16 2012, 08:17 PM
Reckless This retrieval system is great but for me the link... Aug 15 2012, 11:53 PM
jmknapp I added an RSS feed for the latest released images... Aug 16 2012, 12:31 AM
Stellingwerff Somebody will have to talk with the MSL website pe... Aug 16 2012, 02:41 PM
maschnitz Emily, if you're in contact with Michelle, cou... Aug 16 2012, 07:47 PM
Stellingwerff Hi all,
In part due to the huge sol=0 page (curre... Aug 16 2012, 08:41 PM
Stellingwerff Ok, definitely not happy with the performance (and... Aug 16 2012, 11:22 PM
3d_mars First post. Here's a small script I wrote to ... Aug 17 2012, 03:59 AM
jmknapp QUOTE (3d_mars @ Aug 16 2012, 10:59 PM) F... Aug 17 2012, 01:36 PM
fredk QUOTE (jmknapp @ Aug 17 2012, 02:36 PM) S... Aug 17 2012, 02:07 PM
3d_mars QUOTE (jmknapp @ Aug 17 2012, 05:36 AM) I... Aug 17 2012, 02:40 PM
jmknapp Some updates to my raw image listing app:
1) resu... Aug 17 2012, 01:41 PM
fredk QUOTE (jmknapp @ Aug 17 2012, 02:41 PM) N... Aug 17 2012, 02:41 PM![]() ![]() |
|
Lo-Fi Version | Time is now: 17th December 2024 - 05:20 AM |
|
RULES AND GUIDELINES Please read the Forum Rules and Guidelines before posting. IMAGE COPYRIGHT |
OPINIONS AND MODERATION Opinions expressed on UnmannedSpaceflight.com are those of the individual posters and do not necessarily reflect the opinions of UnmannedSpaceflight.com or The Planetary Society. The all-volunteer UnmannedSpaceflight.com moderation team is wholly independent of The Planetary Society. The Planetary Society has no influence over decisions made by the UnmannedSpaceflight.com moderators. |
SUPPORT THE FORUM Unmannedspaceflight.com is funded by the Planetary Society. Please consider supporting our work and many other projects by donating to the Society or becoming a member. |
|