Examples with KafkaTestUtils org.apache.spark.streaming.kafka010.KafkaTestUtils used on opensource projects

Example 1 with KafkaTestUtils

use of org.apache.spark.streaming.kafka010.KafkaTestUtils in project hudi by apache.

the class HoodieDeltaStreamerTestBase method initClass.

@BeforeAll
public static void initClass() throws Exception {
    UtilitiesTestBase.initClass(true);
    PARQUET_SOURCE_ROOT = dfsBasePath + "/parquetFiles";
    ORC_SOURCE_ROOT = dfsBasePath + "/orcFiles";
    JSON_KAFKA_SOURCE_ROOT = dfsBasePath + "/jsonKafkaFiles";
    testUtils = new KafkaTestUtils();
    testUtils.setup();
    topicName = "topic" + testNum;
    prepareInitialConfigs(dfs, dfsBasePath, testUtils.brokerAddress());
    prepareParquetDFSFiles(PARQUET_NUM_RECORDS, PARQUET_SOURCE_ROOT);
    prepareORCDFSFiles(ORC_NUM_RECORDS, ORC_SOURCE_ROOT);
}

Example 2 with KafkaTestUtils

use of org.apache.spark.streaming.kafka010.KafkaTestUtils in project hudi by apache.

the class TestKafkaOffsetGen method setup.

@BeforeEach
public void setup() throws Exception {
    testUtils = new KafkaTestUtils();
    testUtils.setup();
}

Example 3 with KafkaTestUtils

use of org.apache.spark.streaming.kafka010.KafkaTestUtils in project hudi by apache.

the class TestJsonKafkaSource method initClass.

@BeforeAll
public static void initClass() throws Exception {
    testUtils = new KafkaTestUtils();
    testUtils.setup();
}

Example 4 with KafkaTestUtils

use of org.apache.spark.streaming.kafka010.KafkaTestUtils in project hudi by apache.

the class TestAbstractDebeziumSource method setup.

@BeforeEach
public void setup() throws Exception {
    super.setup();
    testUtils = new KafkaTestUtils();
    testUtils.setup();
}