Examples with SparkBatchSourceFactory io.cdap.cdap.etl.spark.batch.SparkBatchSourceFactory used on opensource projects

Example 1 with SparkBatchSourceFactory

use of io.cdap.cdap.etl.spark.batch.SparkBatchSourceFactory in project cdap by caskdata.

the class AbstractSparkPreparer method prepare.

@Override
public List<Finisher> prepare(PhaseSpec phaseSpec) throws TransactionFailureException, InstantiationException, IOException {
    stageOperations = new HashMap<>();
    stagePartitions = new HashMap<>();
    sourceFactory = new SparkBatchSourceFactory();
    sinkFactory = new SparkBatchSinkFactory();
    return super.prepare(phaseSpec);
}