Printable Version of Topic

Posted by: jaredGalen Jun 17 2008, 10:45 AM

I created an application for searching the Phoenix raw image datasets.

It uses the metadata to calculate similarity between a query and each of the image products.

In addition to this, after providing an initial query you can refine this by selecting a particular image and asking to see 'More Like This'. I need to refine the similarity method used. I will perhaps allow users to specify which image properties are more important, this information can then be used to weight the similarity calculation.

I'm using the metadata from sol 9, thanks to Emily for posting it a while back before she went on holidays and mHoward for outputting it from MMB. The image features used are whatever are pulled from the metadata, so any changes in their there will automatically be reflected when I reload the application.

I'll update the metadata as soon as I can.

Here's the link
http://www.bediddlement.com

Posted by: mhoward Jun 17 2008, 01:06 PM

Here's the http://homepage.mac.com/michaelhoward/MidnightMarsBrowser/metadata/Phoenix_metadata.csv

Posted by: jaredGalen Jun 17 2008, 03:16 PM

Thanks for that data, that's great.

A quick question regarding the metadata, the Color, AZ_TEXT, Filter and ACTIVITY_ID are no longer present plus some of the others. Is this info available anywhere else? Looking at the text at the start of the images I can't see it. (I have MMB doing an update now so I have some of the images) Nevermind, most of it is in the image filename, sorry, completely forgot

I have generated my own thumbnails too, so I'm not using the Planetary society's bandwidth anymore.

Thanks again mhoward for the data.

Posted by: CosmicRocker Jun 18 2008, 04:56 AM

Nice work, jaredGalen. When Mike modified MMB to generate the metdadata csv file, I opened it in Excel to see what I could do with it. Not being a programmer, the best I could do was to study the datset by variously sorting and plotting the available data fields. What I would have liked to do was to sort or query the data to generate a set of links to images and their details. It appears as if that is what you have done.

Thanks,

Posted by: jaredGalen Jun 18 2008, 10:01 AM

Thanks, it is basically is a bit of a search engine.
It's still a bit messy. I'm going to try and make it a bit more intuitive, i.e. give the ID of an image and it will return others with similar properties. I might get that up later today.

Not much use perhaps but maybe handy for finding something quickly....maybe

Posted by: jamescanvin Jun 18 2008, 10:13 AM

Looks useful, I refer to the CSV file from MMB quite a bit so something that saves me sorting that file is good.

One feature request, it looks like at the moment I can only choose specific az and el values, it would be great if I was able to specify a range instead.

James

Posted by: jaredGalen Jun 18 2008, 10:58 AM

Thanks for the feedback. The feature for specifying a query is something I want to improve. For the moment I have taken it down and put up a more 'intuitive' (?) interface.

I won't be doing anything on this for the rest of the week but at the weekend I hope to tackle it again when I will do more with the querying side of things.

Just a note, it is the 'More Like This' link for each image that could really make this application useful. If I can nail a good way of calculating similarity it should get even better. I have some ideas which I can try so we'll see

In the meantime all feedback is welcome.

Oh, I've updated the dataset to sol 22 (MMB update as of yesterday evening).

Here's the link
http://www.bediddlement.com]

Edwin

Posted by: jaredGalen Jun 22 2008, 02:07 PM

Hi again,
I've made some functional changes to the site if anyone wants to give it a go.

It adds a level of personalisation to the search function, allowing you to indicate which features of an image are more important to you and by how much.

By specifying a number between 0 and 1, this then affects how images will be sorted for a given query. You could tell it to ignore everything except Azimuth when retrieving results. This way you can give it the ID of a similar image to what you want and it will only use the features your interested in.

Then using the More Like This function can give even more specific results. I might not be explaining this very well.

I added back in the ability to create a custom query. Coupled with feature importance it can help find things pretty quickly. The input is still restricted to values that occur in the data. Haven't gotten around to updating that. I'll update the dataset later today.

Here's the link again, save you looking for it . http://www.bediddlement.com

Edwin

Edit: Update dataset to Sol 26, thumbnails will be available in the morning in the meantime the data is up. Almost 3500 raw images.

Posted by: jaredGalen Jun 23 2008, 11:48 AM

Okay, last post probably on this.

Data is updated again to Sol 26 (thanks again to mhoward and MMB for the data output and image renaming)

I have set the default weighting of the retrieval method for image queries to only use Azimuth, Elevation, Intrument and Activity ID. This means returned images are all taken from very similar angles etc. These weights can still be changed for personal use on the site if you want.

I think it's pretty neat (then again I would... ). I wanted to make an animation of the TEGA doors, so I just stuck in the ID of one image with the TEGA and got all the others back.

Anyway, that's it. I'll keep it updated with the data every couple of days.

Edit: Clicking an SSI image will now link directly to the full resolution raw images provided at http://www.met.tamu.edu/mars/index.html.
Permission kindly granted to do this.

Posted by: jaredGalen Jun 24 2008, 06:29 PM

QUOTE (jaredGalen @ Jun 23 2008, 12:48 PM)

Posted by: phase4 Jun 24 2008, 07:25 PM

Hello Jared,

I'm nowhere near qualified to give a useful opinion on anything posted here on UMSF... but i feel obliged to share my experiences.
Your phoenix image browser doesn't work for me! Each click beyond the main page gives a page with the following error description;

Posted by: jaredGalen Jun 24 2008, 07:40 PM

Hi,
Thanks for the heads up. It might have been just unfortunate timing I had to restart the server after my post so maybe you hit it at that point

Checking from here via my home connection now and all is well. Hopefully it was just the timing

Thanks for venturing a look though!!

Edwin

Posted by: phase4 Jun 24 2008, 08:21 PM

Sorry, but thats not the cause. I forgot to mention that i have this problem from the initial start of your site.
Must be something wrong on my comp then.

Posted by: jaredGalen Jun 24 2008, 08:57 PM

Hi,
Thanks for letting me know again, the error above would indicate that things didn't get set up properly, perhaps you followed a bookmark or a link from your history. You computer is fine, my fault entirely I'm pretty sure

The last thing I can suggest is that you follow the following link directly and use it if you are going back to the site again later. There is something I can do to avoid your problem but I had forgotten about.

http://www.bediddlement.com

If it fails using the above link then I'd appreciate if you could let me know again as there may be another problem that I didn't think of. Thanks very much for bringing this to my attention, it could have been happening to everyone and I'd never know!

Edwin

Posted by: helvick Jun 24 2008, 09:15 PM

Just for reference I have no problems with this (or the earlier versions) accessing via Firefox V3, IE7 or Safari 3.1.1 on Windows. I'm not running any adblock\script blocking apart from the general defaults on those browsers if that's of any relevance.

It's a nice interface and fast too. Good work.

Posted by: elakdawalla Jun 24 2008, 09:22 PM

I reproduced phase4's error the first time I visited the site, when I plugged in an Image ID that still had ".jpg" on the end of it. When I took the ".jpg" off it worked just fine. It prolly wouldn't hurt to build in the ability to strip that off the end of the image ID, or put in an instruction that says to take it off the image file name.

In the starting images area it'd be nice to have one starting image for Dodo/Goldilocks and one for the Snow White area.

The search I'll probably be using this site to do most often is one for images of the DVD, so it'd be nice to see a starting image (or at least a link) for that, but others may not agree.

This site is definitely useful, and will become increasingly useful as the sols go by. Thanks!

Emily

Posted by: jaredGalen Jun 24 2008, 09:29 PM

Hi,
Thanks for the info helvick, hadn't thought about script blockers etc, but don't think they will be a problem, except for the slideshow (maybe), hopefully not.

Emily, that's just the kind of suggestion I need to hear. I'll add that it in or maybe add a requests page too. Good point about the .jpg extension too. Bug reports!! Yayyy.

Edwin

Posted by: jaredGalen Jun 26 2008, 03:50 PM

I have updated the dataset from MMB this morning.

I also added some more starting images on the start page. If there are suggestions people have maybe post the image ID here or email it to me at phoenixbrowser_at_gmail_dot_com.

And finally, if anyone creates a slide show from images on the site, you can copy the link provided (just above the show) and post it anywhere. It can be accessed by anyone via that link.
(N.B at the moment the slide show will only show SSI images. I don't have a way of serving up the others right now, sorry)

Posted by: phase4 Jun 26 2008, 06:03 PM

I'm so sorry for all the fuss. It seems that my browser(s) were set to refuse website cookies.
Once enabled... everything works as advertised.

Thanks very much for the patience. Now if you'll excuse me, i'll go hide under a very big rock...

Posted by: jaredGalen Jun 26 2008, 06:09 PM

Ahhhh, okay then. Though you did put me onto a related problem all the same, so thanks

Posted by: imipak Jun 26 2008, 08:29 PM

A wizened old hacker http://osiris.urbanna.net/tao.html on to me many years ago.

Posted by: jaredGalen Jul 1 2008, 05:27 PM

I've update the dataset to sol 35.

I also allow users to enter in their own queries, so you can enter any number for Azimuth, Elevation etc.
Finally, the slideshow feature now works with RAC images. I'll fix the image proportions once I figure out how

You can only have all SSI images or all RAC images in the slide show, if you mix them, it will only show the type that you add first.

Posted by: jmknapp Jul 11 2008, 12:34 AM

Hey, just tried this for locating sky images--nice! I searched for anything with elevation like 50 & got a number of sky shots. Very slick!

Posted by: jaredGalen Jul 11 2008, 08:57 AM

Hi,
Glad you found it of some use. I update the dataset to sol 42 actually.

There's a heap of improvements to be made, just a matter of getting around to it. One thing I was thinking about was allowing people to register a username, allowing you to login and have your own homepage.

Here you could have favorite searches/images that you commonly use to do a search etc. Also allow you to save the image property weights/importance values that you want to use. Perhaps even keep you favorite slideshows.

Might give it a go this weekend. Even if it's not used I think it's still cool to have

Thanks for the feedback!

Posted by: jaredGalen Jul 23 2008, 10:18 PM

I have moved my site to a different server, so if anyone does have a bookmark, it may be best to update it using the link in my signature below.

I updated the dataset to sol 56. 9854 raw image products. Although I think I may be missing a few....

Posted by: jaredGalen Jul 29 2008, 12:45 PM

My server will be going down for the next week if anyone is wondering or trying to access it.