nz.ac.waikato.mcennis.rat.crawler.filter
Interface CrawlerFilter

All Known Implementing Classes:

AndFilter, BlockPreviousSite, BlockPreviousSiteReference, DomainRestriction, HyperGraphSnowball, NullFilter, OrFilter, SiteMatch, SNASnowball, StopCount, XorFilter

public interface CrawlerFilter

Interface for all algorithms implementing decisions on whether or not a given site or site - parameter combination should be scheduled for retrieval. Implements the Strategy pattern for Crawler objects.

See Also:

CrawlerFilter

Method Summary

boolean	check(java.lang.String site) Should the URL this string represents be retrieved
boolean	check(java.lang.String site, Properties parameters) Should the URL this string represents be retrieved, given the parameters provided
void	load(java.lang.String site) Submit the given site to the filter chain without retrieving it.
void	load(java.lang.String site, Properties parameters) Submit the given site - parameter combination to the filter chain without retrieving it.
CrawlerFilter	prototype() Creates a new default version of this class with no common data excepting static variables

Method Detail

check

boolean check(java.lang.String site)

Should the URL this string represents be retrieved

Parameters:

site - URL of the site to be retrieved

Returns:

retrieve or not retrieve

check

boolean check(java.lang.String site,
              Properties parameters)

Should the URL this string represents be retrieved, given the parameters provided

Parameters:

site - URL to be retrieved

parameters - parameters governing the retrieval

Returns:

retrieve or not retrieve

load

void load(java.lang.String site)

Submit the given site to the filter chain without retrieving it.

Parameters:

site - URL to be added

load

void load(java.lang.String site,
          Properties parameters)

Submit the given site - parameter combination to the filter chain without retrieving it.

Parameters:

site - URL to be added

prototype

CrawlerFilter prototype()

Creates a new default version of this class with no common data excepting static variables

Returns:

new filter of the same class as the parent