Similarity Based Browsing of Phoenix Images, Metadata Data Based Similarity |
Similarity Based Browsing of Phoenix Images, Metadata Data Based Similarity |
Jun 17 2008, 10:45 AM
Post
#1
|
|
Member Group: Members Posts: 257 Joined: 18-December 04 Member No.: 123 |
I created an application for searching the Phoenix raw image datasets.
It uses the metadata to calculate similarity between a query and each of the image products. In addition to this, after providing an initial query you can refine this by selecting a particular image and asking to see 'More Like This'. I need to refine the similarity method used. I will perhaps allow users to specify which image properties are more important, this information can then be used to weight the similarity calculation. I'm using the metadata from sol 9, thanks to Emily for posting it a while back before she went on holidays and mHoward for outputting it from MMB. The image features used are whatever are pulled from the metadata, so any changes in their there will automatically be reflected when I reload the application. I'll update the metadata as soon as I can. Here's the link Phoenix Visual Image Search -------------------- Turn the middle side topwise....TOPWISE!!
|
|
|
Jun 17 2008, 01:06 PM
Post
#2
|
|
Senior Member Group: Moderator Posts: 3431 Joined: 11-August 04 From: USA Member No.: 98 |
Here's the metadata as of this morning
|
|
|
Jun 17 2008, 03:16 PM
Post
#3
|
|
Member Group: Members Posts: 257 Joined: 18-December 04 Member No.: 123 |
Thanks for that data, that's great.
A quick question regarding the metadata, the Color, AZ_TEXT, Filter and ACTIVITY_ID are no longer present plus some of the others. I have generated my own thumbnails too, so I'm not using the Planetary society's bandwidth anymore. Thanks again mhoward for the data. -------------------- Turn the middle side topwise....TOPWISE!!
|
|
|
Jun 18 2008, 04:56 AM
Post
#4
|
|
Senior Member Group: Members Posts: 2228 Joined: 1-December 04 From: Marble Falls, Texas, USA Member No.: 116 |
Nice work, jaredGalen. When Mike modified MMB to generate the metdadata csv file, I opened it in Excel to see what I could do with it. Not being a programmer, the best I could do was to study the datset by variously sorting and plotting the available data fields. What I would have liked to do was to sort or query the data to generate a set of links to images and their details. It appears as if that is what you have done.
Thanks, -------------------- ...Tom
I'm not a Space Fan, I'm a Space Exploration Enthusiast. |
|
|
Jun 18 2008, 10:01 AM
Post
#5
|
|
Member Group: Members Posts: 257 Joined: 18-December 04 Member No.: 123 |
Thanks, it is basically is a bit of a search engine.
It's still a bit messy. I'm going to try and make it a bit more intuitive, i.e. give the ID of an image and it will return others with similar properties. I might get that up later today. Not much use perhaps but maybe handy for finding something quickly....maybe -------------------- Turn the middle side topwise....TOPWISE!!
|
|
|
Jun 18 2008, 10:13 AM
Post
#6
|
|
Senior Member Group: Moderator Posts: 2262 Joined: 9-February 04 From: Melbourne - Oz Member No.: 16 |
Looks useful, I refer to the CSV file from MMB quite a bit so something that saves me sorting that file is good.
One feature request, it looks like at the moment I can only choose specific az and el values, it would be great if I was able to specify a range instead. James -------------------- |
|
|
Jun 18 2008, 10:58 AM
Post
#7
|
|
Member Group: Members Posts: 257 Joined: 18-December 04 Member No.: 123 |
Thanks for the feedback. The feature for specifying a query is something I want to improve. For the moment I have taken it down and put up a more 'intuitive' (?) interface.
I won't be doing anything on this for the rest of the week but at the weekend I hope to tackle it again when I will do more with the querying side of things. Just a note, it is the 'More Like This' link for each image that could really make this application useful. If I can nail a good way of calculating similarity it should get even better. I have some ideas which I can try so we'll see In the meantime all feedback is welcome. Oh, I've updated the dataset to sol 22 (MMB update as of yesterday evening). Here's the link Phoenix Visual Image Search] Edwin -------------------- Turn the middle side topwise....TOPWISE!!
|
|
|
Jun 22 2008, 02:07 PM
Post
#8
|
|
Member Group: Members Posts: 257 Joined: 18-December 04 Member No.: 123 |
Hi again,
I've made some functional changes to the site if anyone wants to give it a go. It adds a level of personalisation to the search function, allowing you to indicate which features of an image are more important to you and by how much. By specifying a number between 0 and 1, this then affects how images will be sorted for a given query. You could tell it to ignore everything except Azimuth when retrieving results. This way you can give it the ID of a similar image to what you want and it will only use the features your interested in. Then using the More Like This function can give even more specific results. I might not be explaining this very well. I added back in the ability to create a custom query. Coupled with feature importance it can help find things pretty quickly. The input is still restricted to values that occur in the data. Haven't gotten around to updating that. I'll update the dataset later today. Here's the link again, save you looking for it . Image Search Edwin Edit: Update dataset to Sol 26, thumbnails will be available in the morning in the meantime the data is up. Almost 3500 raw images. -------------------- Turn the middle side topwise....TOPWISE!!
|
|
|
Jun 23 2008, 11:48 AM
Post
#9
|
|
Member Group: Members Posts: 257 Joined: 18-December 04 Member No.: 123 |
Okay, last post probably on this.
Data is updated again to Sol 26 (thanks again to mhoward and MMB for the data output and image renaming) I have set the default weighting of the retrieval method for image queries to only use Azimuth, Elevation, Intrument and Activity ID. This means returned images are all taken from very similar angles etc. These weights can still be changed for personal use on the site if you want. I think it's pretty neat (then again I would... ). I wanted to make an animation of the TEGA doors, so I just stuck in the ID of one image with the TEGA and got all the others back. Anyway, that's it. I'll keep it updated with the data every couple of days. Edit: Clicking an SSI image will now link directly to the full resolution raw images provided at http://www.met.tamu.edu/mars/index.html. Permission kindly granted to do this. -------------------- Turn the middle side topwise....TOPWISE!!
|
|
|
Jun 24 2008, 06:29 PM
Post
#10
|
|
Member Group: Members Posts: 257 Joined: 18-December 04 Member No.: 123 |
Okay, last post probably on this. Famous last words. You can now create your own slide shows on the site from the images (SSI images only at the moment). Click the 'Add to Slide Show' link for the image you want. You won't see anything happen when you click, it's all in the background. Then click the 'View Slide Show' link at the top when you are ready. If you want to make another show be sure to clear the other images out first using the link at the top. It looks a bit rough right now. I intend to clean it up and let you add/remove individual images. -------------------- Turn the middle side topwise....TOPWISE!!
|
|
|
Jun 24 2008, 07:25 PM
Post
#11
|
|
Junior Member Group: Members Posts: 95 Joined: 11-January 07 From: Amsterdam Member No.: 1584 |
Hello Jared,
I'm nowhere near qualified to give a useful opinion on anything posted here on UMSF... but i feel obliged to share my experiences. Your phoenix image browser doesn't work for me! Each click beyond the main page gives a page with the following error description; CODE HTTP Status 500 - type Exception report message description The server encountered an internal error () that prevented it from fulfilling this request. exception java.lang.NullPointerException jsp.servlet.SortItems.service(SortItems.java:36) javax.servlet.http.HttpServlet.service(HttpServlet.java:802) sun.reflect.GeneratedMethodAccessor56.invoke(Unknown Source) sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) java.lang.reflect.Method.invoke(Method.java:585) org.apache.catalina.security.SecurityUtil$1.run(SecurityUtil.java:243) java.security.AccessController.doPrivileged(Native Method) javax.security.auth.Subject.doAsPrivileged(Subject.java:517) org.apache.catalina.security.SecurityUtil.execute(SecurityUtil.java:272) org.apache.catalina.security.SecurityUtil.doAsPrivilege(SecurityUtil.java:161) note The full stack trace of the root cause is available in the Apache Tomcat/5.0 logs. I'm working on a mac (osx 10.5), and both firefox and safari with default settings give me this problem. I have no clue what's going wrong, but well... at least you know now. Greetings, Rob -------------------- |
|
|
Jun 24 2008, 07:40 PM
Post
#12
|
|
Member Group: Members Posts: 257 Joined: 18-December 04 Member No.: 123 |
Hi,
Thanks for the heads up. It might have been just unfortunate timing I had to restart the server after my post so maybe you hit it at that point Checking from here via my home connection now and all is well. Hopefully it was just the timing Thanks for venturing a look though!! Edwin -------------------- Turn the middle side topwise....TOPWISE!!
|
|
|
Jun 24 2008, 08:21 PM
Post
#13
|
|
Junior Member Group: Members Posts: 95 Joined: 11-January 07 From: Amsterdam Member No.: 1584 |
Sorry, but thats not the cause. I forgot to mention that i have this problem from the initial start of your site.
Must be something wrong on my comp then. -------------------- |
|
|
Jun 24 2008, 08:57 PM
Post
#14
|
|
Member Group: Members Posts: 257 Joined: 18-December 04 Member No.: 123 |
Hi,
Thanks for letting me know again, the error above would indicate that things didn't get set up properly, perhaps you followed a bookmark or a link from your history. You computer is fine, my fault entirely I'm pretty sure The last thing I can suggest is that you follow the following link directly and use it if you are going back to the site again later. There is something I can do to avoid your problem but I had forgotten about. Phoenix Visual Image Search If it fails using the above link then I'd appreciate if you could let me know again as there may be another problem that I didn't think of. Thanks very much for bringing this to my attention, it could have been happening to everyone and I'd never know! Edwin -------------------- Turn the middle side topwise....TOPWISE!!
|
|
|
Jun 24 2008, 09:15 PM
Post
#15
|
|
Dublin Correspondent Group: Admin Posts: 1799 Joined: 28-March 05 From: Celbridge, Ireland Member No.: 220 |
Just for reference I have no problems with this (or the earlier versions) accessing via Firefox V3, IE7 or Safari 3.1.1 on Windows. I'm not running any adblock\script blocking apart from the general defaults on those browsers if that's of any relevance.
It's a nice interface and fast too. Good work. |
|
|
Lo-Fi Version | Time is now: 25th April 2024 - 05:29 PM |
RULES AND GUIDELINES Please read the Forum Rules and Guidelines before posting. IMAGE COPYRIGHT |
OPINIONS AND MODERATION Opinions expressed on UnmannedSpaceflight.com are those of the individual posters and do not necessarily reflect the opinions of UnmannedSpaceflight.com or The Planetary Society. The all-volunteer UnmannedSpaceflight.com moderation team is wholly independent of The Planetary Society. The Planetary Society has no influence over decisions made by the UnmannedSpaceflight.com moderators. |
SUPPORT THE FORUM Unmannedspaceflight.com is funded by the Planetary Society. Please consider supporting our work and many other projects by donating to the Society or becoming a member. |