Search in sources :

Example 6 with SRXSentenceTokenizer

use of org.languagetool.tokenizers.SRXSentenceTokenizer in project languagetool by languagetool-org.

the class PolishDisambiguationRuleTest method setUp.

@Before
public void setUp() {
    tagger = new PolishTagger();
    tokenizer = new WordTokenizer();
    sentenceTokenizer = new SRXSentenceTokenizer(new Polish());
    disambiguator = new MultiWordChunker("/pl/multiwords.txt");
}
Also used : PolishTagger(org.languagetool.tagging.pl.PolishTagger) Polish(org.languagetool.language.Polish) WordTokenizer(org.languagetool.tokenizers.WordTokenizer) SRXSentenceTokenizer(org.languagetool.tokenizers.SRXSentenceTokenizer) Before(org.junit.Before)

Aggregations

Before (org.junit.Before)6 SRXSentenceTokenizer (org.languagetool.tokenizers.SRXSentenceTokenizer)6 DemoDisambiguator (org.languagetool.tagging.disambiguation.xx.DemoDisambiguator)4 XmlRuleDisambiguator (org.languagetool.tagging.disambiguation.rules.XmlRuleDisambiguator)3 WordTokenizer (org.languagetool.tokenizers.WordTokenizer)3 Catalan (org.languagetool.language.Catalan)1 English (org.languagetool.language.English)1 French (org.languagetool.language.French)1 Polish (org.languagetool.language.Polish)1 Romanian (org.languagetool.language.Romanian)1 Ukrainian (org.languagetool.language.Ukrainian)1 CatalanTagger (org.languagetool.tagging.ca.CatalanTagger)1 MultiWordChunker (org.languagetool.tagging.disambiguation.MultiWordChunker)1 UkrainianHybridDisambiguator (org.languagetool.tagging.disambiguation.uk.UkrainianHybridDisambiguator)1 EnglishTagger (org.languagetool.tagging.en.EnglishTagger)1 FrenchTagger (org.languagetool.tagging.fr.FrenchTagger)1 PolishTagger (org.languagetool.tagging.pl.PolishTagger)1 RomanianTagger (org.languagetool.tagging.ro.RomanianTagger)1 UkrainianTagger (org.languagetool.tagging.uk.UkrainianTagger)1 CatalanWordTokenizer (org.languagetool.tokenizers.ca.CatalanWordTokenizer)1