Examples with KryoCoderProvider org.apache.beam.sdk.extensions.kryo.KryoCoderProvider used on opensource projects

Example 1 with KryoCoderProvider

use of org.apache.beam.sdk.extensions.kryo.KryoCoderProvider in project beam by apache.

the class DocumentationExamplesTest method codersAndTypesSection.

@Test
public void codersAndTypesSection() {
    final PipelineOptions options = PipelineOptionsFactory.create();
    Pipeline pipeline = Pipeline.create(options);
    // Register `KryoCoderProvider` which attempt to use `KryoCoder` to every non-primitive type
    KryoCoderProvider.of().registerTo(pipeline);
    // Do not allow `KryoCoderProvider` to return `KryoCoder` for unregistered types
    options.as(KryoOptions.class).setKryoRegistrationRequired(true);
    KryoCoderProvider.of(kryo -> {
        // KryoRegistrar of your uwn
        // other may follow
        kryo.register(KryoSerializedElementType.class);
    }).registerTo(pipeline);
    PCollection<Integer> input = pipeline.apply(Create.of(1, 2, 3, 4)).setTypeDescriptor(TypeDescriptors.integers());
    MapElements.named("Int2Str").of(input).using(String::valueOf, TypeDescriptors.strings()).output();
}