Traumwind - A Personal, Customizable Web Crawler

WebSPHINX ( Website-Specific Processors for HTML INformation eXtraction) is a Java class library and interactive development environment for web crawlers. A web crawler (also called a robot or spider) is a program that browses and processes Web pages automatically.

WebSPHINX consists of two parts: the Crawler Workbench and the WebSPHINX class library.

Anybody interested in crawling and info-retrieval should download and play with this a little. It's like the RegexCoach for Crawlers

[ by Martin>] [permalink] [similar entries]

similar entries (vs):

Heritrix (# 8%)

similar entries (cg):

Heritrix (# 20%)

relevant words

Big things to come (TM) 30th Dez 2002

Just carry on
Oblique Strategies, Ed.3 Brian Eno and Peter Schmidt

amazon.de Wunschliste

usefull links:
Google Graph browser
Traumwind 6-Colormatch
UAV News

websphinx (6.6)
crawler (5.5)
crawlers (5.3)
class (3.9)
web (3.3)
http://www-2.cs.cmu.edu/~rcm/websphinx/ (3.1)
consists (3.1)
workbench (3.1)
regexcoach (3.1)
browses (3.1)
library (3.1)
extraction (2.9)
crawling (2.9)
spider (2.7)
www-2.cs.cmu.edu (2.7)
processors (2.7)
robot (2.7)
customizable (2.7)
interactive (2.4)
processes (2.4)
interested (2.2)
parts (2.2)
automatically (2)
called (2)
download (1.9)
play (1.9)
environment (1.9)
anybody (1.8)
java (1.8)
info (1.8)
development (1.8)
website (1.8)
personal (1.8)
program (1.7)
information (1.6)
pages (1.6)
a (1.5)
html (1.5)
and (1.4)
two (1.4)
little (1.4)
for (1.4)
should (1.4)
also (1.1)
the (1.1)
is (1.1)
like (1)
or (0.9)
with (0.8)
this (0.7)
that (0.7)
in (0.6)
it (0.6)
of (0.6)
martin (0.3)
(0)