org.apache.nutch.indexer.tld
Class TLDIndexingFilter

java.lang.Object
  extended by org.apache.nutch.indexer.tld.TLDIndexingFilter
All Implemented Interfaces:
Configurable, IndexingFilter, FieldPluggable, Pluggable

public class TLDIndexingFilter
extends Object
implements IndexingFilter

Adds the Top level domain extensions to the index

Author:
Enis Soztutar <enis.soz.nutch@gmail.com>

Field Summary
static org.slf4j.Logger LOG
           
 
Fields inherited from interface org.apache.nutch.indexer.IndexingFilter
X_POINT_ID
 
Constructor Summary
TLDIndexingFilter()
           
 
Method Summary
 NutchDocument filter(NutchDocument doc, String url, WebPage page)
          Adds fields or otherwise modifies the document that will be indexed for a parse.
 Configuration getConf()
           
 Collection<WebPage.Field> getFields()
           
 void setConf(Configuration conf)
           
 
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
 

Field Detail

LOG

public static final org.slf4j.Logger LOG
Constructor Detail

TLDIndexingFilter

public TLDIndexingFilter()
Method Detail

filter

public NutchDocument filter(NutchDocument doc,
                            String url,
                            WebPage page)
                     throws IndexingException
Description copied from interface: IndexingFilter
Adds fields or otherwise modifies the document that will be indexed for a parse. Unwanted documents can be removed from indexing by returning a null value.

Specified by:
filter in interface IndexingFilter
Parameters:
doc - document instance for collecting fields
url - page url
Returns:
modified (or a new) document instance, or null (meaning the document should be discarded)
Throws:
IndexingException

setConf

public void setConf(Configuration conf)
Specified by:
setConf in interface Configurable

getConf

public Configuration getConf()
Specified by:
getConf in interface Configurable

getFields

public Collection<WebPage.Field> getFields()
Specified by:
getFields in interface FieldPluggable


Copyright © 2012 The Apache Software Foundation