Search in sources :

Example 1 with EndingPreProcessor

use of org.deeplearning4j.text.tokenization.tokenizer.preprocessor.EndingPreProcessor in project deeplearning4j by deeplearning4j.

the class EndingPreProcessorTest method testPreProcessor.

@Test
public void testPreProcessor() {
    TokenPreProcess preProcess = new EndingPreProcessor();
    String endingTest = "ending";
    assertEquals("end", preProcess.preProcess(endingTest));
}
Also used : TokenPreProcess(org.deeplearning4j.text.tokenization.tokenizer.TokenPreProcess) EndingPreProcessor(org.deeplearning4j.text.tokenization.tokenizer.preprocessor.EndingPreProcessor) Test(org.junit.Test)

Aggregations

TokenPreProcess (org.deeplearning4j.text.tokenization.tokenizer.TokenPreProcess)1 EndingPreProcessor (org.deeplearning4j.text.tokenization.tokenizer.preprocessor.EndingPreProcessor)1 Test (org.junit.Test)1