org.apache.nutch.indexer.subcollection: public class: SubcollectionIndexingFilter

org.apache.nutch.indexer.subcollection
public class: SubcollectionIndexingFilter [javadoc | source]

java.lang.Object
   org.apache.hadoop.conf.Configured
      org.apache.nutch.indexer.subcollection.SubcollectionIndexingFilter

All Implemented Interfaces:
IndexingFilter

Field Summary
public static final String	FIELD_NAME	Doc field name
public static final Log	LOG	Logger

Constructor:
public SubcollectionIndexingFilter() { super(NutchConfiguration.create()); }
public SubcollectionIndexingFilter(Configuration conf) { super(conf); }

Constructor:

 public SubcollectionIndexingFilter() {
    super(NutchConfiguration.create());
}

 public SubcollectionIndexingFilter(Configuration conf) {
    super(conf);
}

Method from org.apache.nutch.indexer.subcollection.SubcollectionIndexingFilter Summary:
addIndexBackendOptions, filter

Methods from java.lang.Object:
equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method from org.apache.nutch.indexer.subcollection.SubcollectionIndexingFilter Detail:
public void addIndexBackendOptions(Configuration conf) { LuceneWriter.addFieldOptions(FIELD_NAME, LuceneWriter.STORE.YES, LuceneWriter.INDEX.UNTOKENIZED, conf); }
public NutchDocument filter(NutchDocument doc, Parse parse, Text url, CrawlDatum datum, Inlinks inlinks) throws IndexingException { String sUrl = url.toString(); addSubCollectionField(doc, sUrl); return doc; }

Method from org.apache.nutch.indexer.subcollection.SubcollectionIndexingFilter Detail:

 public  void addIndexBackendOptions(Configuration conf) {
    LuceneWriter.addFieldOptions(FIELD_NAME, LuceneWriter.STORE.YES,
        LuceneWriter.INDEX.UNTOKENIZED, conf);
}

 public NutchDocument filter(NutchDocument doc,
    Parse parse,
    Text url,
    CrawlDatum datum,
    Inlinks inlinks) throws IndexingException {
    String sUrl = url.toString();
    addSubCollectionField(doc, sUrl);
    return doc;
}