Examples with ObjectProvenance com.oracle.labs.mlrg.olcut.provenance.ObjectProvenance used on opensource projects

Example 1 with ObjectProvenance

use of com.oracle.labs.mlrg.olcut.provenance.ObjectProvenance in project tribuo by oracle.

the class Helpers method testProvenanceMarshalling.

public static void testProvenanceMarshalling(ObjectProvenance inputProvenance) {
    List<ObjectMarshalledProvenance> provenanceList = ProvenanceUtil.marshalProvenance(inputProvenance);
    ObjectProvenance unmarshalledProvenance = ProvenanceUtil.unmarshalProvenance(provenanceList);
    Assertions.assertEquals(unmarshalledProvenance, inputProvenance);
}

Example 2 with ObjectProvenance

use of com.oracle.labs.mlrg.olcut.provenance.ObjectProvenance in project tribuo by oracle.

the class CSVDataSourceTest method testBasic.

@Test
public void testBasic() {
    CSVDataSource<MockOutput> dataSource = new CSVDataSource<>(dataFile, rowProcessor, true);
    MutableDataset<MockOutput> dataset = new MutableDataset<>(dataSource);
    assertEquals(6, dataset.size(), "Found an incorrect number of rows when loading the csv.");
    DatasetProvenance prov = dataset.getProvenance();
    List<ObjectMarshalledProvenance> datasetProvenance = ProvenanceUtil.marshalProvenance(prov);
    assertFalse(datasetProvenance.isEmpty());
    ObjectProvenance unmarshalledProvenance = ProvenanceUtil.unmarshalProvenance(datasetProvenance);
    assertEquals(prov, unmarshalledProvenance);
}

Example 3 with ObjectProvenance

use of com.oracle.labs.mlrg.olcut.provenance.ObjectProvenance in project tribuo by oracle.

the class CSVDataSourceTest method testRegexExpand.

@Test
public void testRegexExpand() {
    CSVDataSource<MockOutput> dataSource = new CSVDataSource<>(regexDataFile, regexRowProcessor, true);
    MutableDataset<MockOutput> dataset = new MutableDataset<>(dataSource);
    assertEquals(6, dataset.size(), "Found an incorrect number of rows when loading the csv.");
    DatasetProvenance prov = dataset.getProvenance();
    List<ObjectMarshalledProvenance> datasetProvenance = ProvenanceUtil.marshalProvenance(prov);
    assertFalse(datasetProvenance.isEmpty());
    ObjectProvenance unmarshalledProvenance = ProvenanceUtil.unmarshalProvenance(datasetProvenance);
    assertEquals(prov, unmarshalledProvenance);
    assertEquals(13, dataset.getFeatureMap().size());
}

Example 4 with ObjectProvenance

use of com.oracle.labs.mlrg.olcut.provenance.ObjectProvenance in project tribuo by oracle.

the class JsonDataSourceTest method loadTest.

@Test
public void loadTest() throws URISyntaxException {
    URI dataFile = JsonDataSourceTest.class.getResource("/org/tribuo/json/test.json").toURI();
    RowProcessor<MockOutput> rowProcessor = buildRowProcessor();
    JsonDataSource<MockOutput> source = new JsonDataSource<>(dataFile, rowProcessor, true);
    MutableDataset<MockOutput> dataset = new MutableDataset<>(source);
    assertEquals(20, dataset.size(), "Found an incorrect number of rows when loading the json file.");
    DatasetProvenance prov = dataset.getProvenance();
    List<ObjectMarshalledProvenance> datasetProvenance = ProvenanceUtil.marshalProvenance(prov);
    assertFalse(datasetProvenance.isEmpty());
    ObjectProvenance unmarshalledProvenance = ProvenanceUtil.unmarshalProvenance(datasetProvenance);
    assertEquals(prov, unmarshalledProvenance);
}