IPB

Welcome Guest ( Log In | Register )

2 Pages V   1 2 >  
Reply to this topicStart new topic
Similarity Based Browsing of Phoenix Images, Metadata Data Based Similarity
jaredGalen
post Jun 17 2008, 10:45 AM
Post #1


Member
***

Group: Members
Posts: 257
Joined: 18-December 04
Member No.: 123



I created an application for searching the Phoenix raw image datasets.

It uses the metadata to calculate similarity between a query and each of the image products.

In addition to this, after providing an initial query you can refine this by selecting a particular image and asking to see 'More Like This'. I need to refine the similarity method used. I will perhaps allow users to specify which image properties are more important, this information can then be used to weight the similarity calculation.

I'm using the metadata from sol 9, thanks to Emily for posting it a while back before she went on holidays and mHoward for outputting it from MMB. The image features used are whatever are pulled from the metadata, so any changes in their there will automatically be reflected when I reload the application.

I'll update the metadata as soon as I can.

Here's the link
Phoenix Visual Image Search


--------------------
Turn the middle side topwise....TOPWISE!!
Go to the top of the page
 
+Quote Post
mhoward
post Jun 17 2008, 01:06 PM
Post #2


Senior Member
****

Group: Moderator
Posts: 3431
Joined: 11-August 04
From: USA
Member No.: 98



Here's the metadata as of this morning
Go to the top of the page
 
+Quote Post
jaredGalen
post Jun 17 2008, 03:16 PM
Post #3


Member
***

Group: Members
Posts: 257
Joined: 18-December 04
Member No.: 123



Thanks for that data, that's great.

A quick question regarding the metadata, the Color, AZ_TEXT, Filter and ACTIVITY_ID are no longer present plus some of the others. Is this info available anywhere else? Looking at the text at the start of the images I can't see it. (I have MMB doing an update now so I have some of the images) Nevermind, most of it is in the image filename, sorry, completely forgot smile.gif rolleyes.gif

I have generated my own thumbnails too, so I'm not using the Planetary society's bandwidth anymore.

Thanks again mhoward for the data.


--------------------
Turn the middle side topwise....TOPWISE!!
Go to the top of the page
 
+Quote Post
CosmicRocker
post Jun 18 2008, 04:56 AM
Post #4


Senior Member
****

Group: Members
Posts: 2226
Joined: 1-December 04
From: Marble Falls, Texas, USA
Member No.: 116



Nice work, jaredGalen. When Mike modified MMB to generate the metdadata csv file, I opened it in Excel to see what I could do with it. Not being a programmer, the best I could do was to study the datset by variously sorting and plotting the available data fields. What I would have liked to do was to sort or query the data to generate a set of links to images and their details. It appears as if that is what you have done.

Thanks,


--------------------
...Tom

I'm not a Space Fan, I'm a Space Exploration Enthusiast.
Go to the top of the page
 
+Quote Post
jaredGalen
post Jun 18 2008, 10:01 AM
Post #5


Member
***

Group: Members
Posts: 257
Joined: 18-December 04
Member No.: 123



Thanks, it is basically is a bit of a search engine.
It's still a bit messy. I'm going to try and make it a bit more intuitive, i.e. give the ID of an image and it will return others with similar properties. I might get that up later today.

Not much use perhaps but maybe handy for finding something quickly....maybe smile.gif


--------------------
Turn the middle side topwise....TOPWISE!!
Go to the top of the page
 
+Quote Post
jamescanvin
post Jun 18 2008, 10:13 AM
Post #6


Senior Member
****

Group: Moderator
Posts: 2258
Joined: 9-February 04
From: Melbourne - Oz
Member No.: 16



Looks useful, I refer to the CSV file from MMB quite a bit so something that saves me sorting that file is good. smile.gif

One feature request, it looks like at the moment I can only choose specific az and el values, it would be great if I was able to specify a range instead.

James


--------------------
My MER & MSL Imagery site - Martian Vistas ---- Twitter Feed (including sol by sol updates on Opportunity's activity)
Please support unmannedspaceflight.com by donating here
Go to the top of the page
 
+Quote Post
jaredGalen
post Jun 18 2008, 10:58 AM
Post #7


Member
***

Group: Members
Posts: 257
Joined: 18-December 04
Member No.: 123



Thanks for the feedback. The feature for specifying a query is something I want to improve. For the moment I have taken it down and put up a more 'intuitive' (?) interface.

I won't be doing anything on this for the rest of the week but at the weekend I hope to tackle it again when I will do more with the querying side of things.

Just a note, it is the 'More Like This' link for each image that could really make this application useful. If I can nail a good way of calculating similarity it should get even better. I have some ideas which I can try so we'll see

In the meantime all feedback is welcome.

Oh, I've updated the dataset to sol 22 (MMB update as of yesterday evening).

Here's the link
Phoenix Visual Image Search]

Edwin


--------------------
Turn the middle side topwise....TOPWISE!!
Go to the top of the page
 
+Quote Post
jaredGalen
post Jun 22 2008, 02:07 PM
Post #8


Member
***

Group: Members
Posts: 257
Joined: 18-December 04
Member No.: 123



Hi again,
I've made some functional changes to the site if anyone wants to give it a go.

It adds a level of personalisation to the search function, allowing you to indicate which features of an image are more important to you and by how much.

By specifying a number between 0 and 1, this then affects how images will be sorted for a given query. You could tell it to ignore everything except Azimuth when retrieving results. This way you can give it the ID of a similar image to what you want and it will only use the features your interested in.

Then using the More Like This function can give even more specific results. I might not be explaining this very well.

I added back in the ability to create a custom query. Coupled with feature importance it can help find things pretty quickly. The input is still restricted to values that occur in the data. Haven't gotten around to updating that. I'll update the dataset later today.

Here's the link again, save you looking for it smile.gif . Image Search

Edwin

Edit: Update dataset to Sol 26, thumbnails will be available in the morning in the meantime the data is up. Almost 3500 raw images.


--------------------
Turn the middle side topwise....TOPWISE!!
Go to the top of the page
 
+Quote Post
jaredGalen
post Jun 23 2008, 11:48 AM
Post #9


Member
***

Group: Members
Posts: 257
Joined: 18-December 04
Member No.: 123



Okay, last post probably on this.

Data is updated again to Sol 26 (thanks again to mhoward and MMB for the data output and image renaming)

I have set the default weighting of the retrieval method for image queries to only use Azimuth, Elevation, Intrument and Activity ID. This means returned images are all taken from very similar angles etc. These weights can still be changed for personal use on the site if you want.

I think it's pretty neat (then again I would... rolleyes.gif ). I wanted to make an animation of the TEGA doors, so I just stuck in the ID of one image with the TEGA and got all the others back.

Anyway, that's it. I'll keep it updated with the data every couple of days.

Edit: Clicking an SSI image will now link directly to the full resolution raw images provided at http://www.met.tamu.edu/mars/index.html.
Permission kindly granted to do this.


--------------------
Turn the middle side topwise....TOPWISE!!
Go to the top of the page
 
+Quote Post
jaredGalen
post Jun 24 2008, 06:29 PM
Post #10


Member
***

Group: Members
Posts: 257
Joined: 18-December 04
Member No.: 123



QUOTE (jaredGalen @ Jun 23 2008, 12:48 PM) *
Okay, last post probably on this.

Famous last words. rolleyes.gif

You can now create your own slide shows on the site from the images (SSI images only at the moment).

Click the 'Add to Slide Show' link for the image you want. You won't see anything happen when you click, it's all in the background.

Then click the 'View Slide Show' link at the top when you are ready.
If you want to make another show be sure to clear the other images out first using the link at the top.

It looks a bit rough right now. I intend to clean it up and let you add/remove individual images.



--------------------
Turn the middle side topwise....TOPWISE!!
Go to the top of the page
 
+Quote Post
phase4
post Jun 24 2008, 07:25 PM
Post #11


Junior Member
**

Group: Members
Posts: 39
Joined: 11-January 07
From: Amsterdam
Member No.: 1584



Hello Jared,

I'm nowhere near qualified to give a useful opinion on anything posted here on UMSF... but i feel obliged to share my experiences.
Your phoenix image browser doesn't work for me! unsure.gif Each click beyond the main page gives a page with the following error description;

CODE
HTTP Status 500 -
type Exception report

message
description The server encountered an internal error () that prevented it from fulfilling this request.

exception
java.lang.NullPointerException
    jsp.servlet.SortItems.service(SortItems.java:36)
    javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
    sun.reflect.GeneratedMethodAccessor56.invoke(Unknown Source)
    sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    java.lang.reflect.Method.invoke(Method.java:585)
    org.apache.catalina.security.SecurityUtil$1.run(SecurityUtil.java:243)
    java.security.AccessController.doPrivileged(Native Method)
    javax.security.auth.Subject.doAsPrivileged(Subject.java:517)
    org.apache.catalina.security.SecurityUtil.execute(SecurityUtil.java:272)
    org.apache.catalina.security.SecurityUtil.doAsPrivilege(SecurityUtil.java:161)

note The full stack trace of the root cause is available in the Apache Tomcat/5.0 logs.

I'm working on a mac (osx 10.5), and both firefox and safari with default settings give me this problem. I have no clue what's going wrong,
but well... at least you know now. smile.gif

Greetings,
Rob

Go to the top of the page
 
+Quote Post
jaredGalen
post Jun 24 2008, 07:40 PM
Post #12


Member
***

Group: Members
Posts: 257
Joined: 18-December 04
Member No.: 123



Hi,
Thanks for the heads up. It might have been just unfortunate timing smile.gif I had to restart the server after my post so maybe you hit it at that point sad.gif

Checking from here via my home connection now and all is well. Hopefully it was just the timing smile.gif

Thanks for venturing a look though!!

Edwin


--------------------
Turn the middle side topwise....TOPWISE!!
Go to the top of the page
 
+Quote Post
phase4
post Jun 24 2008, 08:21 PM
Post #13


Junior Member
**

Group: Members
Posts: 39
Joined: 11-January 07
From: Amsterdam
Member No.: 1584



Sorry, but thats not the cause. I forgot to mention that i have this problem from the initial start of your site.
Must be something wrong on my comp then. dry.gif
Go to the top of the page
 
+Quote Post
jaredGalen
post Jun 24 2008, 08:57 PM
Post #14


Member
***

Group: Members
Posts: 257
Joined: 18-December 04
Member No.: 123



Hi,
Thanks for letting me know again, the error above would indicate that things didn't get set up properly, perhaps you followed a bookmark or a link from your history. You computer is fine, my fault entirely I'm pretty sure smile.gif

The last thing I can suggest is that you follow the following link directly and use it if you are going back to the site again later. There is something I can do to avoid your problem but I had forgotten about.

Phoenix Visual Image Search

If it fails using the above link then I'd appreciate if you could let me know again as there may be another problem that I didn't think of. Thanks very much for bringing this to my attention, it could have been happening to everyone and I'd never know! unsure.gif

Edwin


--------------------
Turn the middle side topwise....TOPWISE!!
Go to the top of the page
 
+Quote Post
helvick
post Jun 24 2008, 09:15 PM
Post #15


Dublin Correspondent
****

Group: Admin
Posts: 1799
Joined: 28-March 05
From: Celbridge, Ireland
Member No.: 220



Just for reference I have no problems with this (or the earlier versions) accessing via Firefox V3, IE7 or Safari 3.1.1 on Windows. I'm not running any adblock\script blocking apart from the general defaults on those browsers if that's of any relevance.

It's a nice interface and fast too. Good work.
Go to the top of the page
 
+Quote Post

2 Pages V   1 2 >
Reply to this topicStart new topic

 



RSS Lo-Fi Version Time is now: 4th June 2020 - 12:32 AM
RULES AND GUIDELINES
Please read the Forum Rules and Guidelines before posting.

IMAGE COPYRIGHT
Images posted on UnmannedSpaceflight.com may be copyrighted. Do not reproduce without permission. Read here for further information on space images and copyright.

OPINIONS AND MODERATION
Opinions expressed on UnmannedSpaceflight.com are those of the individual posters and do not necessarily reflect the opinions of UnmannedSpaceflight.com or The Planetary Society. The all-volunteer UnmannedSpaceflight.com moderation team is wholly independent of The Planetary Society. The Planetary Society has no influence over decisions made by the UnmannedSpaceflight.com moderators.
SUPPORT THE FORUM
Unmannedspaceflight.com is a project of the Planetary Society and is funded by donations from visitors and members. Help keep this forum up and running by contributing here.