org.apache.lucene.analysis.br: public final class: BrazilianAnalyzer

org.apache.lucene.analysis.br
public final class: BrazilianAnalyzer [javadoc | source]

java.lang.Object
   org.apache.lucene.analysis.Analyzer
      org.apache.lucene.analysis.br.BrazilianAnalyzer

Analyzer for Brazilian language. Supports an external list of stopwords (words that will not be indexed at all) and an external list of exclusions (word that will not be stemmed, but indexed).

author: Jo - ão Kramer

Field Summary
public static final String[]	BRAZILIAN_STOP_WORDS	List of typical Brazilian stopwords.

Constructor:
public BrazilianAnalyzer() { stoptable = StopFilter.makeStopSet( BRAZILIAN_STOP_WORDS ); } Builds an analyzer with the default stop words (#BRAZILIAN_STOP_WORDS ).
public BrazilianAnalyzer(String[] stopwords) { stoptable = StopFilter.makeStopSet( stopwords ); } Builds an analyzer with the given stop words.
public BrazilianAnalyzer(Hashtable stopwords) { stoptable = new HashSet(stopwords.keySet()); } Builds an analyzer with the given stop words.
public BrazilianAnalyzer(File stopwords) throws IOException { stoptable = WordlistLoader.getWordSet( stopwords ); } Builds an analyzer with the given stop words.

Constructor:

 public BrazilianAnalyzer() {
	          	 
		stoptable = StopFilter.makeStopSet( BRAZILIAN_STOP_WORDS );
}

Builds an analyzer with the default stop words (

#BRAZILIAN_STOP_WORDS

 public BrazilianAnalyzer(String[] stopwords) {
		stoptable = StopFilter.makeStopSet( stopwords );
}

Builds an analyzer with the given stop words.

 public BrazilianAnalyzer(Hashtable stopwords) {
		stoptable = new HashSet(stopwords.keySet());
}

Builds an analyzer with the given stop words.

 public BrazilianAnalyzer(File stopwords) throws IOException {
		stoptable = WordlistLoader.getWordSet( stopwords );
}

Builds an analyzer with the given stop words.

Method from org.apache.lucene.analysis.br.BrazilianAnalyzer Summary:
setStemExclusionTable, setStemExclusionTable, setStemExclusionTable, tokenStream

Methods from org.apache.lucene.analysis.Analyzer:
getPositionIncrementGap, getPreviousTokenStream, reusableTokenStream, setPreviousTokenStream, tokenStream

Methods from java.lang.Object:
equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method from org.apache.lucene.analysis.br.BrazilianAnalyzer Detail:
public void setStemExclusionTable(String[] exclusionlist) { excltable = StopFilter.makeStopSet( exclusionlist ); } Builds an exclusionlist from an array of Strings.
public void setStemExclusionTable(Hashtable exclusionlist) { excltable = new HashSet(exclusionlist.keySet()); } Builds an exclusionlist from a Hashtable.
public void setStemExclusionTable(File exclusionlist) throws IOException { excltable = WordlistLoader.getWordSet( exclusionlist ); } Builds an exclusionlist from the words contained in the given file.
public final TokenStream tokenStream(String fieldName, Reader reader) { TokenStream result = new StandardTokenizer( reader ); result = new StandardFilter( result ); result = new StopFilter( result, stoptable ); result = new BrazilianStemFilter( result, excltable ); // Convert to lowercase after stemming! result = new LowerCaseFilter( result ); return result; } Creates a TokenStream which tokenizes all the text in the provided Reader.

Method from org.apache.lucene.analysis.br.BrazilianAnalyzer Detail:

 public  void setStemExclusionTable(String[] exclusionlist) {
		excltable = StopFilter.makeStopSet( exclusionlist );
}

Builds an exclusionlist from an array of Strings.

 public  void setStemExclusionTable(Hashtable exclusionlist) {
		excltable = new HashSet(exclusionlist.keySet());
}

Builds an exclusionlist from a Hashtable.

 public  void setStemExclusionTable(File exclusionlist) throws IOException {
		excltable = WordlistLoader.getWordSet( exclusionlist );
}

Builds an exclusionlist from the words contained in the given file.

 public final TokenStream tokenStream(String fieldName,
    Reader reader) {
		TokenStream result = new StandardTokenizer( reader );
		result = new StandardFilter( result );
		result = new StopFilter( result, stoptable );
		result = new BrazilianStemFilter( result, excltable );
		// Convert to lowercase after stemming!
		result = new LowerCaseFilter( result );
		return result;
}

Creates a TokenStream which tokenizes all the text in the provided Reader.