Fetchnews - the Noti crawler

Description

Fetchnews is the (command-line) tool used to launch the Noti Crawlers to crawl the sites and fetch the news.

It doesn't have to be run from the same machine where the Noti web interface is installed, since Fetchnews will upload (via HTTP) a XML of the gathered data to the Noti web interface.

Requirements

Fetchnews requires python 2.3 or above.

Command line arguments

These info is documented here for completeness, but you can get it running fetchnews -h

usage: fetchnews [options]

options:
  -h, --help            show this help message and exit
  -t, --test            test mode (don't submit data)
  -v, --verbose         set crawlers verbose mode. double it to enhance
  -c CRAWLER, --crawler=CRAWLER
                        Crawler to use. Repeat to add multiple crawlers.
  -d YYYYMMDD, --date=YYYYMMDD
                        Date to use when crawling. defaults to today
  -u URL, --url=URL     URL to use for uploading news XML. using '-' will
                        dump the XML to standard output
  -q, --quiet           set crawlers verbose mode. double it to enhance