Examples with SparkStructuredStreamingPipelineOptions org.apache.beam.runners.spark.structuredstreaming.SparkStructuredStreamingPipelineOptions used on opensource projects

Example 6 with SparkStructuredStreamingPipelineOptions

use of org.apache.beam.runners.spark.structuredstreaming.SparkStructuredStreamingPipelineOptions in project beam by apache.

the class GroupByKeyTest method beforeClass.

@BeforeClass
public static void beforeClass() {
    SparkStructuredStreamingPipelineOptions options = PipelineOptionsFactory.create().as(SparkStructuredStreamingPipelineOptions.class);
    options.setRunner(SparkStructuredStreamingRunner.class);
    options.setTestMode(true);
    pipeline = Pipeline.create(options);
}

Example 7 with SparkStructuredStreamingPipelineOptions

use of org.apache.beam.runners.spark.structuredstreaming.SparkStructuredStreamingPipelineOptions in project beam by apache.

the class CombineTest method beforeClass.

@BeforeClass
public static void beforeClass() {
    SparkStructuredStreamingPipelineOptions options = PipelineOptionsFactory.create().as(SparkStructuredStreamingPipelineOptions.class);
    options.setRunner(SparkStructuredStreamingRunner.class);
    options.setTestMode(true);
    pipeline = Pipeline.create(options);
}

Example 8 with SparkStructuredStreamingPipelineOptions

use of org.apache.beam.runners.spark.structuredstreaming.SparkStructuredStreamingPipelineOptions in project beam by apache.

the class FlattenTest method beforeClass.

@BeforeClass
public static void beforeClass() {
    SparkStructuredStreamingPipelineOptions options = PipelineOptionsFactory.create().as(SparkStructuredStreamingPipelineOptions.class);
    options.setRunner(SparkStructuredStreamingRunner.class);
    options.setTestMode(true);
    pipeline = Pipeline.create(options);
}

Example 9 with SparkStructuredStreamingPipelineOptions

use of org.apache.beam.runners.spark.structuredstreaming.SparkStructuredStreamingPipelineOptions in project beam by apache.

the class WindowAssignTest method beforeClass.

@BeforeClass
public static void beforeClass() {
    SparkStructuredStreamingPipelineOptions options = PipelineOptionsFactory.create().as(SparkStructuredStreamingPipelineOptions.class);
    options.setRunner(SparkStructuredStreamingRunner.class);
    options.setTestMode(true);
    pipeline = Pipeline.create(options);
}

Example 10 with SparkStructuredStreamingPipelineOptions

use of org.apache.beam.runners.spark.structuredstreaming.SparkStructuredStreamingPipelineOptions in project beam by apache.

the class SimpleSourceTest method beforeClass.

@BeforeClass
public static void beforeClass() {
    SparkStructuredStreamingPipelineOptions options = PipelineOptionsFactory.create().as(SparkStructuredStreamingPipelineOptions.class);
    options.setRunner(SparkStructuredStreamingRunner.class);
    options.setTestMode(true);
    pipeline = Pipeline.create(options);
}