Examples with ClassicTokenizer org.apache.lucene.analysis.standard.ClassicTokenizer used on opensource projects

Example 1 with ClassicTokenizer

use of org.apache.lucene.analysis.standard.ClassicTokenizer in project elasticsearch by elastic.

the class ClassicTokenizerFactory method create.

@Override
public Tokenizer create() {
    ClassicTokenizer tokenizer = new ClassicTokenizer();
    tokenizer.setMaxTokenLength(maxTokenLength);
    return tokenizer;
}