Examples with FilebasedSchemaProvider org.apache.hudi.utilities.schema.FilebasedSchemaProvider used on opensource projects

Example 1 with FilebasedSchemaProvider

use of org.apache.hudi.utilities.schema.FilebasedSchemaProvider in project hudi by apache.

the class TestJsonKafkaSource method init.

@BeforeEach
public void init() throws Exception {
    String schemaFilePath = Objects.requireNonNull(SCHEMA_FILE_URL).toURI().getPath();
    TypedProperties props = new TypedProperties();
    props.put("hoodie.deltastreamer.schemaprovider.source.schema.file", schemaFilePath);
    schemaProvider = new FilebasedSchemaProvider(props, jsc());
}

Example 2 with FilebasedSchemaProvider

use of org.apache.hudi.utilities.schema.FilebasedSchemaProvider in project hudi by apache.

the class TestDFSHoodieTestSuiteWriterAdapter method setup.

@BeforeEach
public void setup() throws Exception {
    super.setup();
    schemaProvider = new FilebasedSchemaProvider(Helpers.setupSchemaOnDFSWithAbsoluteScope(System.getProperty("user.dir") + "/.." + COMPLEX_SOURCE_SCHEMA_DOCKER_DEMO_RELATIVE_PATH, "complex-source.avsc"), jsc);
}

Example 3 with FilebasedSchemaProvider

use of org.apache.hudi.utilities.schema.FilebasedSchemaProvider in project hudi by apache.

the class TestSqlSource method setup.

@BeforeEach
public void setup() throws Exception {
    dfsRoot = UtilitiesTestBase.dfsBasePath + "/parquetFiles";
    UtilitiesTestBase.dfs.mkdirs(new Path(dfsRoot));
    props = new TypedProperties();
    super.setup();
    schemaProvider = new FilebasedSchemaProvider(Helpers.setupSchemaOnDFS(), jsc);
    // Produce new data, extract new data
    generateTestTable("1", "001", 10000);
}

Example 4 with FilebasedSchemaProvider

use of org.apache.hudi.utilities.schema.FilebasedSchemaProvider in project hudi by apache.

the class AbstractCloudObjectsSourceTestBase method setup.

@BeforeEach
public void setup() throws Exception {
    super.setup();
    schemaProvider = new FilebasedSchemaProvider(Helpers.setupSchemaOnDFS(), jsc);
    MockitoAnnotations.initMocks(this);
}

Example 5 with FilebasedSchemaProvider

use of org.apache.hudi.utilities.schema.FilebasedSchemaProvider in project hudi by apache.

the class AbstractDFSSourceTestBase method setup.

@BeforeEach
public void setup() throws Exception {
    super.setup();
    schemaProvider = new FilebasedSchemaProvider(Helpers.setupSchemaOnDFS(), jsc);
}