Examples with TokenizerAnnotator edu.stanford.nlp.pipeline.TokenizerAnnotator used on opensource projects

Example 1 with TokenizerAnnotator

use of edu.stanford.nlp.pipeline.TokenizerAnnotator in project CoreNLP by stanfordnlp.

the class SUTimeSimpleParser method makeNumericPipeline.

private static AnnotationPipeline makeNumericPipeline() {
    AnnotationPipeline pipeline = new AnnotationPipeline();
    pipeline.addAnnotator(new TokenizerAnnotator(false, "en"));
    pipeline.addAnnotator(new WordsToSentencesAnnotator(false));
    pipeline.addAnnotator(new POSTaggerAnnotator(false));
    pipeline.addAnnotator(new TimeAnnotator(true));
    return pipeline;
}