Search in sources :

Example 11 with LowerCaseFilter

use of org.apache.lucene.analysis.core.LowerCaseFilter in project jena by apache.

the class LowerCaseKeywordAnalyzer method createComponents.

@Override
protected TokenStreamComponents createComponents(String fieldName) {
    KeywordTokenizer source = new KeywordTokenizer();
    LowerCaseFilter filter = new LowerCaseFilter(source);
    return new TokenStreamComponents(source, filter);
}
Also used : KeywordTokenizer(org.apache.lucene.analysis.core.KeywordTokenizer) LowerCaseFilter(org.apache.lucene.analysis.core.LowerCaseFilter)

Aggregations

LowerCaseFilter (org.apache.lucene.analysis.core.LowerCaseFilter)11 TokenStream (org.apache.lucene.analysis.TokenStream)8 Tokenizer (org.apache.lucene.analysis.Tokenizer)7 StandardFilter (org.apache.lucene.analysis.standard.StandardFilter)5 KeywordTokenizer (org.apache.lucene.analysis.core.KeywordTokenizer)4 ASCIIFoldingFilter (org.apache.lucene.analysis.miscellaneous.ASCIIFoldingFilter)4 StandardTokenizer (org.apache.lucene.analysis.standard.StandardTokenizer)4 StopFilter (org.apache.lucene.analysis.core.StopFilter)3 WhitespaceTokenizer (org.apache.lucene.analysis.core.WhitespaceTokenizer)3 WordDelimiterFilter (org.apache.lucene.analysis.miscellaneous.WordDelimiterFilter)3 Analyzer (org.apache.lucene.analysis.Analyzer)2 EnglishPossessiveFilter (org.apache.lucene.analysis.en.EnglishPossessiveFilter)2 PorterStemFilter (org.apache.lucene.analysis.en.PorterStemFilter)2 IOException (java.io.IOException)1 Reader (java.io.Reader)1 ParseException (java.text.ParseException)1 RemoveDuplicatesTokenFilter (org.apache.lucene.analysis.miscellaneous.RemoveDuplicatesTokenFilter)1 ShingleFilter (org.apache.lucene.analysis.shingle.ShingleFilter)1 StandardAnalyzer (org.apache.lucene.analysis.standard.StandardAnalyzer)1 CharTokenizer (org.apache.lucene.analysis.util.CharTokenizer)1