Examples with FilebasedSchemaProvider org.apache.hudi.utilities.schema.FilebasedSchemaProvider used on opensource projects

Example 6 with FilebasedSchemaProvider

use of org.apache.hudi.utilities.schema.FilebasedSchemaProvider in project hudi by apache.

the class TestCsvDFSSource method setup.

@BeforeEach
public void setup() throws Exception {
    super.setup();
    this.dfsRoot = dfsBasePath + "/jsonFiles";
    this.fileSuffix = ".json";
    this.useFlattenedSchema = true;
    this.schemaProvider = new FilebasedSchemaProvider(Helpers.setupSchemaOnDFS("delta-streamer-config", "source-flattened.avsc"), jsc);
}

Example 7 with FilebasedSchemaProvider

use of org.apache.hudi.utilities.schema.FilebasedSchemaProvider in project hudi by apache.

the class TestFileDeltaInputWriter method setup.

@BeforeEach
public void setup() throws Exception {
    super.setup();
    schemaProvider = new FilebasedSchemaProvider(Helpers.setupSchemaOnDFSWithAbsoluteScope(System.getProperty("user.dir") + "/.." + COMPLEX_SOURCE_SCHEMA_DOCKER_DEMO_RELATIVE_PATH, "complex-source.avsc"), jsc);
}