Traumwind - ContextGraph similar entries

Are here! Yes, I finally dug into the 'Contextual Network Graph' Search::ContextGraph stuff and came up with a replacement for the VectorSpace based 'similar entries' engine that was running here for some time now. It tool a lot of tweaking of parameters till it gave similar results to the VS setup I had...
The real fun part about it is this: for much the same result, it's blazingly FAST. Where my VS thingie would take about 40+ min. of CPU time to complete a scan, the CG thing takes about 23 sec. !! And that'S w/o using the cool 'store' functionality that let's you store a ContextGraph for later use (a thing tha isn't technically possible with the VS approach)... And, this Search::ContextGraph is a pure Perl module with very little dependancies... VectorSpace needs a C-based extension (PDL)

So much for now, more details when I get back to breath ;)

[update:] something is weird with it on this server... shouldn't it find VectorSpace? Posts with that word in it should be similar to this one, no? Back to the drawing board, I guess...

[update:2003-07-23] ... it appears the results for VectorSpace and ContextGraph are rather similar if the posts are rather short... but with the size of the post CG fails... digging..

[ by Martin>] [permalink] [similar entries]

similar entries (vs):

HolaryHey! (# 23%)
that reminds me (# 14%)
similar entries now working (# 14%)
Idle Words (# 13%)

similar entries (cg):

HolaryHey! (# 2%)

relevant words

Martin Spernau
© 1994-2003

Big things to come (TM) 30th Dez 2002

Lowest common denominator
Oblique Strategies, Ed.3 Brian Eno and Peter Schmidt

amazon.de Wunschliste

usefull links:
Google Graph browser
Traumwind 6-Colormatch
UAV News

vectorspace (1.2)
similar (1)
contextgraph (1)
vs (1)
the (0.9)
it (0.9)
with (0.8)
cg (0.8)
store (0.8)
posts (0.8)
results (0.8)
a (0.8)
for (0.8)
entries (0.7)
much (0.7)
update (0.7)
thing (0.7)
to (0.7)
about (0.7)
that (0.7)
back (0.7)
rather (0.7)
this (0.7)
are (0.7)
search (0.6)
of (0.6)
i (0.6)
and (0.6)
is (0.6)
here (0.6)
now (0.6)
time (0.5)
technically (0.5)
dug (0.5)
details (0.5)
w (0.5)
thingie (0.5)
pdl (0.5)
board (0.5)
replacement (0.5)
blazingly (0.5)
parameters (0.5)
word (0.5)
gave (0.5)
functionality (0.5)
isn (0.5)
pure (0.5)
dependancies (0.5)
weird (0.5)
tweaking (0.5)
result (0.5)
size (0.5)
http://search.cpan.org/author/MCEGLOWS/Search-ContextGraph-0.05/ (0.5)
module (0.5)
till (0.5)
running (0.5)
setup (0.5)
fails (0.5)
digging (0.5)
cpu (0.5)
search.cpan.org (0.5)
needs (0.5)
breath (0.5)
tha (0.5)
guess (0.5)
sec (0.5)
drawing (0.4)
later (0.4)
part (0.4)
perl (0.4)
appears (0.4)
extension (0.4)
complete (0.4)
contextual (0.4)
finally (0.4)
scan (0.4)
graph (0.4)
short (0.4)
min (0.4)
shouldn (0.4)
fun (0.4)
possible (0.4)
where (0.4)
network (0.4)
c (0.4)
fast (0.4)
yes (0.4)
take (0.4)
came (0.4)
into (0.4)
real (0.4)
stuff (0.4)
when (0.4)
same (0.4)
tool (0.4)
based (0.4)
approach (0.4)
had (0.4)
post (0.4)
takes (0.4)
more (0.4)
engine (0.4)
should (0.4)
no (0.3)
lot (0.3)
get (0.3)
using (0.3)
little (0.3)
let (0.3)
server (0.3)
find (0.3)
something (0.3)
use (0.3)
up (0.3)
cool (0.3)
would (0.3)
was (0.3)
very (0.3)
some (0.3)
one (0.3)
my (0.3)
if (0.3)
but (0.3)
so (0.3)
be (0.3)
on (0.3)
you (0.3)
in (0.2)
martin (0.2)
(0)