Example 1 with CatalanWordTokenizer
use of org.languagetool.tokenizers.ca.CatalanWordTokenizer in project languagetool by languagetool-org.
the class CatalanDisambiguationRuleTest method setUp.
@Before
public void setUp() {
tagger = new CatalanTagger();
tokenizer = new CatalanWordTokenizer();
sentenceTokenizer = new SRXSentenceTokenizer(new Catalan());
disambiguator = new MultiWordChunker("/ca/multiwords.txt", true);
}
Also used :
CatalanTagger(org.languagetool.tagging.ca.CatalanTagger)
CatalanWordTokenizer(org.languagetool.tokenizers.ca.CatalanWordTokenizer)
Catalan(org.languagetool.language.Catalan)
SRXSentenceTokenizer(org.languagetool.tokenizers.SRXSentenceTokenizer)
Before(org.junit.Before)
Aggregations
Before (org.junit.Before)1
Catalan (org.languagetool.language.Catalan)1
CatalanTagger (org.languagetool.tagging.ca.CatalanTagger)1
SRXSentenceTokenizer (org.languagetool.tokenizers.SRXSentenceTokenizer)1
CatalanWordTokenizer (org.languagetool.tokenizers.ca.CatalanWordTokenizer)1
