Package nz.ac.waikato.mcennis.rat.crawler

Interface Summary

Crawler

Interface for accessing files via io.

Class Summary

Authenticator	Authenticator used to go through HTTP proxies.
CrawlerBase	Base class implementing basic web access capabilities.
FileListCrawler	Crawler designed to parse files from the local file system.
GZipFileCrawler
WebCrawler	Multithreaded web crawler designed to pull web pages.