Examples with RawSourceData ml.shifu.shifu.container.obj.RawSourceData used on opensource projects

Example 1 with RawSourceData

use of ml.shifu.shifu.container.obj.RawSourceData in project shifu by ShifuML.

the class ShifuTestProcessor method runFilterTest.

private int runFilterTest(EvalConfig evalConfig) throws IOException {
    RawSourceData dataset = evalConfig.getDataSet();
    if (StringUtils.isBlank(dataset.getFilterExpressions())) {
        LOG.warn("No filter expression set in eval-{} dataset. Skip it!", evalConfig.getName());
        return 0;
    }
    LOG.info("Start to test the filter against eval `{}` dataset.", evalConfig.getName());
    DataPurifier dataPurifier = new DataPurifier(evalConfig);
    return doFilterTest(dataPurifier, dataset.getDataPath(), dataset.getSource());
}

Example 2 with RawSourceData

use of ml.shifu.shifu.container.obj.RawSourceData in project shifu by ShifuML.

the class PerformanceEvaluatorTest method reviewTest.

@Test(expectedExceptions = FileNotFoundException.class)
public void reviewTest() throws IOException {
    ModelConfig model = ModelConfig.createInitModelConfig("test", ALGORITHM.NN, ".", false);
    EvalConfig eval = new EvalConfig();
    eval.setName("test");
    eval.setDataSet(new RawSourceData());
    model.getBasic().setRunMode(RunMode.LOCAL);
    PerformanceEvaluator actor = new PerformanceEvaluator(model, eval);
    actor.review();
}