Degraded Access to Cassini RAW Images |
Degraded Access to Cassini RAW Images |
Apr 21 2006, 11:17 AM
Post
#1
|
|
Senior Member Group: Members Posts: 1870 Joined: 20-February 05 Member No.: 174 |
I have been using a website download manager for downloading newly posted Cassini (and MER images).
HTTrack Website Copier ( http://www.httrack.com/ ) checks what files you've already downloaded and doesn't re-download them, so it can grab anything new in short order without eating humongous amounts of bandwidth. Starting about a week ago, when I try to download all filed under http://saturn.jpl.nasa.gov/multimedia/imag.../casJPGFullS19/ (where the current orbit's raw images are being posted) I get the message: Forbidden You don't have permission to access /multimedia/images/raw/casJPGFullS19/ on this server. -------------------------------------------------------------------------------- Apache/1.3.31 Server at saturn.jpl.nasa.gov Port 80 It's easy to grab a FEW images, one at a time, from the raw image brouser on the Cassini webpage, but effectively impossible to grab more than that. Is this a policy change? A website configuration error? Is there any other way to get all the new RAW images on a more-or-less daily basis without killing a mouse and getting carpal tunnel? |
|
|
Apr 21 2006, 01:29 PM
Post
#2
|
|
IMG to PNG GOD Group: Moderator Posts: 2250 Joined: 19-February 04 From: Near fire and ice Member No.: 38 |
ARRRGGHHH!!
I regularly do something similar, i.e. download an entire directroy once it is 'full' which happens when a sequence (e.g. S18, S19 etc.) has ended. Now I cannot access these directories directly, I get the same error. Now it is impossible to download everything without getting repetitive strain injury . My guess is that this is not a website configuration error . |
|
|
Apr 21 2006, 02:02 PM
Post
#3
|
|
Senior Member Group: Members Posts: 2454 Joined: 8-July 05 From: NGC 5907 Member No.: 430 |
Has anyone asked the Cassini Web site maintainers about this problem?
-------------------- "After having some business dealings with men, I am occasionally chagrined,
and feel as if I had done some wrong, and it is hard to forget the ugly circumstance. I see that such intercourse long continued would make one thoroughly prosaic, hard, and coarse. But the longest intercourse with Nature, though in her rudest moods, does not thus harden and make coarse. A hard, sensible man whom we liken to a rock is indeed much harder than a rock. From hard, coarse, insensible men with whom I have no sympathy, I go to commune with the rocks, whose hearts are comparatively soft." - Henry David Thoreau, November 15, 1853 |
|
|
Apr 21 2006, 05:58 PM
Post
#4
|
|
Member Group: Members Posts: 688 Joined: 20-April 05 From: Sweden Member No.: 273 |
I've had somewhat similar problems in another context. I maintain a netsite with a large number of links and occasionally runs a check for dead links with Xenu.
Recently some sites (for example Proceedings of the National Academy of Science) has put in a function that locks You out if you access several files in quick succession. The reason is frankly to keep people (like us) that use automatic downloaders from using too much bandwidth. The solution is to to find out what is the minimum allowed time between accesses and set your downloader accordingly. The download will go a lot slower but you avoid mouse cramp. tty |
|
|
Guest_Richard Trigaux_* |
Apr 21 2006, 06:15 PM
Post
#5
|
Guests |
Yes there may be something like that. Webmasters don't like bots reading a whole site in a short time, as this takes bandwidth. A classical problem is with spam robots which harvest email addresses. So large professionnal sites hosted on their own servers may put limitations.
|
|
|
Apr 24 2006, 04:43 PM
Post
#6
|
|
Founder Group: Chairman Posts: 14431 Joined: 8-February 04 Member No.: 1 |
The ability to bulk-download, preferably as zipped-batches is something I insisted is an appropriate means for downloading PDS data when a gentleman who is doing a project of assesing use and formatting of the PDS spoke to me a few months ago
Doug |
|
|
Guest_Richard Trigaux_* |
Apr 24 2006, 07:47 PM
Post
#7
|
Guests |
A gentleman? Perhaps we should speak of gentlebots when software downloading bulk data are respecting some rules of "politeness" such as letting some time between two file downloads, to avoid saturating the bandwidth and hamper other users. It is in this way that most bots work, such as Googlebot.
|
|
|
Lo-Fi Version | Time is now: 19th April 2024 - 10:47 PM |
RULES AND GUIDELINES Please read the Forum Rules and Guidelines before posting. IMAGE COPYRIGHT |
OPINIONS AND MODERATION Opinions expressed on UnmannedSpaceflight.com are those of the individual posters and do not necessarily reflect the opinions of UnmannedSpaceflight.com or The Planetary Society. The all-volunteer UnmannedSpaceflight.com moderation team is wholly independent of The Planetary Society. The Planetary Society has no influence over decisions made by the UnmannedSpaceflight.com moderators. |
SUPPORT THE FORUM Unmannedspaceflight.com is funded by the Planetary Society. Please consider supporting our work and many other projects by donating to the Society or becoming a member. |