5.00
8 comments
Created by mumble 6 months ago
[ 5.00 | 0.00 ] [#1912]

So my mnist idea failed to improve my results. So that killed one avenue of improvement. I have another in mind but will have to wait till I get back from a brief holiday.

So details anyone? My code sort of goes like this:
1) convert the images into 5X5 tiles, and then use these to find a dictionary of features.
2) go over the images again, and map each 5X5 tile to the feature number of the most similar feature in our dictionary (which creates a second order image)
3) add up the feature numbers and form a superposition.
4) apply log(1 + x) to the coefficients of the kets.
5) then a type of k-nearest neighbours using my similarity metric (instead of Euclidean distance).

The idea I had was to use the training examples to find weights for features. The assumption being that some features carry more information than other features in the feature dictionary. Sounds plausible right? Anyway, I tried a couple of times, and each time the results were 1% worse. Doh! Down from 95% to 94% for 10 neighbours. Although it does mean my feature superpositions are somewhat tolerant of noise. A good thing I think.

The next idea, repeat step (1) and (2), several times. ie create third order, then fourth order etc images. And see if that improves things. I suspect/hope it will, but that has to wait until I have time to code it up.

Interestingly enough, my method is kind of unsupervised. ie no back prop. But that is probably only interesting if I can get my results much closer to other methods.

In other news it was my birthday yesterday.


[ Reply ]

1.00
Created by mumble 6 months ago
[ 1.00 | 0.00 ] [#9201]

Thanks for the birthday wishes guys! If anyone sees this?
BTW, I just got home from my brief holiday.
Mild drama about a cat, buy hey ....


[ Parent | Reply ]


2.00
Created by OrionBlastar 6 months ago
[ 2.00 | 0.00 ] [#9072]

I had a friend who did this, I think he used 100x100 tiles. Your 5x5 tiles may be too small to matter.

Happy Birthday even if you hate my posts and comments. I hope you figure it out.


[ Parent | Reply ]


1.00
Created by mumble 6 months ago
[ 1.00 | 0.00 ] [#9082]

So, the images are 28x28 so 100x100 is impossible.
But yeah, I do plan to try simple 28x28 tiles at some stage.
ie, one tile per image.


[ Parent | Reply ]


0.00
Created by OrionBlastar 6 months ago
[ 0.00 | 0.00 ] [#9088]

I think my friend worked on a different AI project than you. He had 100x100 images to work with. The less data you have, the harder it is to scan and detect. I'm not sure if 28x28 is good enough.


[ Parent | Reply ]


2.00
Created by Ouroboros 6 months ago
[ 2.00 | 0.00 ] [#9070]


[ Parent | Reply ]


1.00
Created by badvogato 6 months ago
[ 1.00 | 0.00 ] [#9095]

11 hrs ago - 24 hrs, you spawned? cool. happy B-day to mumble!


[ Parent | Reply ]


0.00
Created by kr5dit 6 months ago
[ 0.00 | 0.00 ] [#9091]

We were going to celebrate your birthday here, but hackers took the site down.

So umm, happy belated birthday dude!


[ Parent | Reply ]


0.24
Created by United_Fools 6 months ago
[ 1.24 | -1.00 ] [#9066]

sounds like MNIST can be describe by a word:

foolish


[ Parent | Reply ]