Search in sources :

Example 31 with Config

use of edu.neu.ccs.pyramid.configuration.Config in project pyramid by cheng-li.

the class ArffFormat method writeConfigFile.

private static void writeConfigFile(RegDataSet dataSet, File arffFile) {
    File configFile = new File(arffFile, ARFF_CONFIG_FILE_NAME);
    Config config = new Config();
    config.setInt(ARFF_CONFIG_NUM_DATA_POINTS, dataSet.getNumDataPoints());
    config.setInt(ARFF_CONFIG_NUM_FEATURES, dataSet.getNumFeatures());
    try {
        config.store(configFile);
    } catch (Exception e) {
        e.printStackTrace();
    }
}
Also used : Config(edu.neu.ccs.pyramid.configuration.Config) File(java.io.File) IOException(java.io.IOException)

Example 32 with Config

use of edu.neu.ccs.pyramid.configuration.Config in project pyramid by cheng-li.

the class ArffFormat method writeConfigFile.

private static void writeConfigFile(ClfDataSet dataSet, File arffFile) {
    File configFile = new File(arffFile, ARFF_CONFIG_FILE_NAME);
    Config config = new Config();
    config.setInt(ARFF_CONFIG_NUM_DATA_POINTS, dataSet.getNumDataPoints());
    config.setInt(ARFF_CONFIG_NUM_FEATURES, dataSet.getNumFeatures());
    config.setInt(ARFF_CONFIG_NUM_CLASSES, dataSet.getNumClasses());
    try {
        config.store(configFile);
    } catch (Exception e) {
        e.printStackTrace();
    }
}
Also used : Config(edu.neu.ccs.pyramid.configuration.Config) File(java.io.File) IOException(java.io.IOException)

Example 33 with Config

use of edu.neu.ccs.pyramid.configuration.Config in project pyramid by cheng-li.

the class ArffFormat method writeConfigFile.

private static void writeConfigFile(MultiLabelClfDataSet dataSet, File arffFile) {
    File configFile = new File(arffFile, ARFF_CONFIG_FILE_NAME);
    Config config = new Config();
    config.setInt(ARFF_CONFIG_NUM_DATA_POINTS, dataSet.getNumDataPoints());
    config.setInt(ARFF_CONFIG_NUM_FEATURES, dataSet.getNumFeatures());
    config.setInt(ARFF_CONFIG_NUM_CLASSES, dataSet.getNumClasses());
    try {
        config.store(configFile);
    } catch (Exception e) {
        e.printStackTrace();
    }
}
Also used : Config(edu.neu.ccs.pyramid.configuration.Config) File(java.io.File) IOException(java.io.IOException)

Example 34 with Config

use of edu.neu.ccs.pyramid.configuration.Config in project pyramid by cheng-li.

the class IndexChecker method main.

public static void main(String[] args) throws Exception {
    if (args.length != 1) {
        throw new IllegalArgumentException("Please specify a properties file.");
    }
    Config config = new Config(args[0]);
    System.out.println(config);
    ESIndex index = loadIndex(config);
    List<String> fields = config.getStrings("fieldsToCheck");
    for (String field : fields) {
        check(index, field);
    }
    for (String field : fields) {
        checkEmpty(index, field);
    }
    index.close();
}
Also used : Config(edu.neu.ccs.pyramid.configuration.Config) ESIndex(edu.neu.ccs.pyramid.elasticsearch.ESIndex)

Example 35 with Config

use of edu.neu.ccs.pyramid.configuration.Config in project pyramid by cheng-li.

the class MLTrec2LibSvm method main.

public static void main(String[] args) throws Exception {
    Config config = new Config(args[0]);
    System.out.println(config);
    List<String> trecs = config.getStrings("trec");
    List<String> libSVMs = config.getStrings("libSVM");
    for (int i = 0; i < trecs.size(); i++) {
        MultiLabelClfDataSet trecDataset = TRECFormat.loadMultiLabelClfDataSet(new File(trecs.get(i)), DataSetType.ML_CLF_SPARSE, false);
        System.out.println(i + " -- Translating on trecs: " + trecs.get(i));
        LibSvmFormat.save(trecDataset, libSVMs.get(i));
    }
}
Also used : Config(edu.neu.ccs.pyramid.configuration.Config) File(java.io.File)

Aggregations

Config (edu.neu.ccs.pyramid.configuration.Config)59 File (java.io.File)35 Collectors (java.util.stream.Collectors)18 FileUtils (org.apache.commons.io.FileUtils)18 StopWatch (org.apache.commons.lang3.time.StopWatch)18 Serialization (edu.neu.ccs.pyramid.util.Serialization)17 BufferedWriter (java.io.BufferedWriter)17 FileWriter (java.io.FileWriter)17 Paths (java.nio.file.Paths)17 IntStream (java.util.stream.IntStream)16 Pair (edu.neu.ccs.pyramid.util.Pair)15 edu.neu.ccs.pyramid.dataset (edu.neu.ccs.pyramid.dataset)14 EarlyStopper (edu.neu.ccs.pyramid.optimization.EarlyStopper)14 java.util (java.util)14 MLMeasures (edu.neu.ccs.pyramid.eval.MLMeasures)13 PrintUtil (edu.neu.ccs.pyramid.util.PrintUtil)13 MultiLabelClassifier (edu.neu.ccs.pyramid.multilabel_classification.MultiLabelClassifier)12 edu.neu.ccs.pyramid.multilabel_classification.cbm (edu.neu.ccs.pyramid.multilabel_classification.cbm)12 ListUtil (edu.neu.ccs.pyramid.util.ListUtil)12 IOException (java.io.IOException)8