Uses of Interface
org.apache.nutch.protocol.RobotRules

Packages that use RobotRules

org.apache.nutch.protocol
org.apache.nutch.protocol.file	Protocol plugin which supports retrieving local file resources.
org.apache.nutch.protocol.ftp	Protocol plugin which supports retrieving documents via the ftp protocol.
org.apache.nutch.protocol.http.api	Common API used by HTTP plugins (http, httpclient)
org.apache.nutch.protocol.sftp	Protocol plugin which supports retrieving documents via the sftp protocol.

Uses of RobotRules in org.apache.nutch.protocol

Classes in org.apache.nutch.protocol that implement RobotRules

class

EmptyRobotRules

Fields in org.apache.nutch.protocol declared as RobotRules

static RobotRules

EmptyRobotRules.RULES

Methods in org.apache.nutch.protocol that return RobotRules

RobotRules

Protocol.getRobotRules(String url, WebPage page) Retrieve robot rules applicable for this url.

Uses of RobotRules in org.apache.nutch.protocol.file

Methods in org.apache.nutch.protocol.file that return RobotRules

RobotRules

File.getRobotRules(String url, WebPage page)

Uses of RobotRules in org.apache.nutch.protocol.ftp

Methods in org.apache.nutch.protocol.ftp that return RobotRules

RobotRules

Ftp.getRobotRules(String url, WebPage page)

Uses of RobotRules in org.apache.nutch.protocol.http.api

Classes in org.apache.nutch.protocol.http.api that implement RobotRules

static class

RobotRulesParser.RobotRuleSet This class holds the rules which were parsed from a robots.txt file, and can test paths against those rules.

Methods in org.apache.nutch.protocol.http.api that return RobotRules

RobotRules

HttpBase.getRobotRules(String url, WebPage page)

Uses of RobotRules in org.apache.nutch.protocol.sftp

Methods in org.apache.nutch.protocol.sftp that return RobotRules

RobotRules

Sftp.getRobotRules(String url, WebPage page)