Examples with ILexicalData org.carrot2.text.linguistic.ILexicalData used on opensource projects

Example 1 with ILexicalData

use of org.carrot2.text.linguistic.ILexicalData in project lucene-solr by apache.

the class LexicalResourcesCheckClusteringAlgorithm method process.

@Override
public void process() throws ProcessingException {
    clusters = new ArrayList<>();
    if (wordsToCheck == null) {
        return;
    }
    // Test with Maltese so that the English clustering performed in other tests
    // is not affected by the test stopwords and stoplabels.
    ILexicalData lexicalData = preprocessing.lexicalDataFactory.getLexicalData(LanguageCode.MALTESE);
    for (String word : wordsToCheck.split(",")) {
        if (!lexicalData.isCommonWord(new MutableCharArray(word)) && !lexicalData.isStopLabel(word)) {
            clusters.add(new Cluster(word));
        }
    }
}