Examples with FingerprintFilter org.apache.lucene.analysis.miscellaneous.FingerprintFilter used on opensource projects

Example 1 with FingerprintFilter

use of org.apache.lucene.analysis.miscellaneous.FingerprintFilter in project elasticsearch by elastic.

the class FingerprintTokenFilterFactory method create.

@Override
public TokenStream create(TokenStream tokenStream) {
    TokenStream result = tokenStream;
    result = new FingerprintFilter(result, maxOutputSize, separator);
    return result;
}

Example 2 with FingerprintFilter

use of org.apache.lucene.analysis.miscellaneous.FingerprintFilter in project elasticsearch by elastic.

the class FingerprintAnalyzer method createComponents.

@Override
protected TokenStreamComponents createComponents(String s) {
    final Tokenizer tokenizer = new StandardTokenizer();
    TokenStream stream = tokenizer;
    stream = new LowerCaseFilter(stream);
    stream = new ASCIIFoldingFilter(stream, false);
    stream = new StopFilter(stream, stopWords);
    stream = new FingerprintFilter(stream, maxOutputSize, separator);
    return new TokenStreamComponents(tokenizer, stream);
}