org.apache.nutch.protocol
Class EmptyRobotRules

java.lang.Object
  org.apache.nutch.protocol.EmptyRobotRules

All Implemented Interfaces:

RobotRules

public class EmptyRobotRules
extends Object
implements RobotRules

Author:

Andrzej Bialecki <ab@getopt.org>

Field Summary

static RobotRules

RULES

Constructor Summary

EmptyRobotRules()

Method Summary

long	getCrawlDelay() Get Crawl-Delay, in milliseconds.
long	getExpireTime() Get expire time
boolean	isAllowed(URL url) Returns false if the robots.txt file prohibits us from accessing the given url, or true otherwise.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

RULES

public static final RobotRules RULES

Constructor Detail

EmptyRobotRules

public EmptyRobotRules()

Method Detail

getCrawlDelay

public long getCrawlDelay()

Description copied from interface: RobotRules

Get Crawl-Delay, in milliseconds. This returns -1 if not set.

Specified by:

getCrawlDelay in interface RobotRules

getExpireTime

public long getExpireTime()

Description copied from interface: RobotRules

Get expire time

Specified by:

getExpireTime in interface RobotRules

isAllowed

public boolean isAllowed(URL url)

Description copied from interface: RobotRules

Returns false if the robots.txt file prohibits us from accessing the given url, or true otherwise.

Specified by:

isAllowed in interface RobotRules