to ping or...


to ping or...

18.09.2002, 22:04 · Martin · Permalink

yes, papaScott, increasing numbers of sources I find interesting don't ping weblogs.com or have even heard or give a damn about it. I guess it's back to SpyOnIt and such, and I might even whip up a smal personal WebWatch.php someday, need it for my NewsTank anyway.
  • have a list of URLs to check
  • regularly go thru list, fetch each url
  • compare MD5 of return with 'last-MD5'
  • when different, mark URL as 'changed'
  • ...
  • only one problem: pages normaly 'change' very often without their 'contents' actually changing (dates, blogrolls etc.) so there needs to be a more detailed check here... a 'diff' could help, but I'd not like to rely on external programms being present (simple PHP hosting should be all that is needed) [update:] as Scott points out, a reasonable amount of said Sites have an RSS-feed which is a good thing to watch for change in content.
    I'm thinking about the MD% approach on per-item basis, so as to enable the 'n-new posts in feed' stuff for the RSS reader. (the WebWatcher would borrow code and freshness-data from the RSS reader)

  • alles Bild, Text und Tonmaterial ist © Martin Spernau, Verwendung und Reproduktion erfordert die Zustimmung des Authors

    Martin Spernau
    © 1994-2026


    amazon.de Wunschliste

    Facebook me!
    Google+

    powered by Traumtank