Search in sources :

Example 1 with DatePartitionedJsonFileSource

use of org.apache.gobblin.source.DatePartitionedJsonFileSource in project incubator-gobblin by apache.

the class FileBasedSourceTest method numberOfWorkUnits.

@Test
void numberOfWorkUnits() throws IOException {
    SourceState sourceState = new SourceState();
    DatePartitionedJsonFileSource source = new DatePartitionedJsonFileSource();
    initState(sourceState);
    List<WorkUnit> workUnits = source.getWorkunits(sourceState);
    Assert.assertEquals(3, workUnits.size());
}
Also used : SourceState(org.apache.gobblin.configuration.SourceState) DatePartitionedJsonFileSource(org.apache.gobblin.source.DatePartitionedJsonFileSource) WorkUnit(org.apache.gobblin.source.workunit.WorkUnit) Test(org.testng.annotations.Test)

Aggregations

SourceState (org.apache.gobblin.configuration.SourceState)1 DatePartitionedJsonFileSource (org.apache.gobblin.source.DatePartitionedJsonFileSource)1 WorkUnit (org.apache.gobblin.source.workunit.WorkUnit)1 Test (org.testng.annotations.Test)1