Examples with ComplexSeg com.chenlb.mmseg4j.ComplexSeg used on opensource projects

Example 1 with ComplexSeg

use of com.chenlb.mmseg4j.ComplexSeg in project java-basic by tzuyichao.

the class TestMMSeg4J method main.

public static void main(String[] args) throws IOException {
    Dictionary dictionary = Dictionary.getInstance();
    MMSeg mmSeg = new MMSeg(new StringReader("上一堂課之後跑18km與2500rpm的挑戰"), new ComplexSeg(dictionary));
    Word word = null;
    boolean first = true;
    while ((word = mmSeg.next()) != null) {
        System.out.println(word.getString());
    }
}

Example 2 with ComplexSeg

use of com.chenlb.mmseg4j.ComplexSeg in project jstarcraft-nlp by HongZhaoHua.

the class MMSegTokenizerFactory method newSeg.

private Seg newSeg(Map<String, String> configuration) {
    Seg seg = null;
    logger.info("create new Seg ...");
    // default max-word
    String mode = configuration.get("mode");
    if ("simple".equals(mode)) {
        logger.info("use simple mode");
        seg = new SimpleSeg(dic);
    } else if ("complex".equals(mode)) {
        logger.info("use complex mode");
        seg = new ComplexSeg(dic);
    } else {
        logger.info("use max-word mode");
        seg = new MaxWordSeg(dic);
    }
    return seg;
}

Example 3 with ComplexSeg

use of com.chenlb.mmseg4j.ComplexSeg in project jstarcraft-nlp by HongZhaoHua.

the class MmsegSegmentFactory method build.

@Override
public MMSeg build(Map<String, String> configurations) {
    Dictionary dictionary;
    String dictionaryPath = get(configurations, "dictionaryPath");
    if (StringUtility.isBlank(dictionaryPath)) {
        dictionary = Dictionary.getInstance();
    } else {
        File file = new File(dictionaryPath);
        dictionary = Dictionary.getInstance(file);
    }
    String configuration = get(configurations, "mode", "MaxWord");
    Seg seg = null;
    switch(configuration) {
        case "Complex":
            seg = new ComplexSeg(dictionary);
            break;
        case "Simple":
            seg = new SimpleSeg(dictionary);
            break;
        case "MaxWord":
            seg = new MaxWordSeg(dictionary);
            break;
        default:
            throw new IllegalArgumentException();
    }
    MMSeg mmSeg = new MMSeg(new StringReader(""), seg);
    return mmSeg;
}

Example 4 with ComplexSeg

use of com.chenlb.mmseg4j.ComplexSeg in project jstarcraft-nlp by HongZhaoHua.

the class MmsegSegmenterTestCase method getSegmenter.

@Override
protected Tokenizer getSegmenter() {
    Dictionary dictionary = Dictionary.getInstance();
    ComplexSeg complex = new ComplexSeg(dictionary);
    // MMSeg mmSeg = new MMSeg(new StringReader(""), complex);
    MmsegTokenizer tokenizer = new MmsegTokenizer(complex);
    return tokenizer;
}

Example 5 with ComplexSeg

use of com.chenlb.mmseg4j.ComplexSeg in project jstarcraft-nlp by HongZhaoHua.

the class MmsegTokenizerTestCase method getTokenizer.

@Override
protected NlpTokenizer<? extends NlpToken> getTokenizer() {
    Dictionary dictionary = Dictionary.getInstance();
    ComplexSeg complex = new ComplexSeg(dictionary);
    MMSeg mmSeg = new MMSeg(new StringReader(""), complex);
    return new MmsegTokenizer(mmSeg);
}