Examples with Pipeline com.hazelcast.jet.pipeline.Pipeline used on opensource projects

Example 31 with Pipeline

use of com.hazelcast.jet.pipeline.Pipeline in project hazelcast-jet-reference-manual by hazelcast.

the class ImdgConnectors method s3.

static void s3() {
    // tag::s3[]
    Pipeline pipeline = Pipeline.create();
    pipeline.drawFrom(Sources.<String, Long>map("inMap")).drainTo(Sinks.mapWithMerging("outMap", Entry::getKey, Entry::getValue, (oldValue, newValue) -> oldValue + newValue));
// end::s3[]
}

Example 32 with Pipeline

use of com.hazelcast.jet.pipeline.Pipeline in project hazelcast-jet-reference-manual by hazelcast.

the class ImdgConnectors method s15.

static void s15() {
    // tag::s15[]
    ClientConfig clientConfig = new ClientConfig();
    clientConfig.getGroupConfig().setName("myGroup").setPassword("pAssw0rd");
    clientConfig.getNetworkConfig().addAddress("node1.mydomain.com", "node2.mydomain.com");
    Pipeline p = Pipeline.create();
    p.drawFrom(Sources.remoteList("inputlist", clientConfig)).drainTo(Sinks.remoteList("outputList", clientConfig));
// end::s15[]
}

Example 33 with Pipeline

use of com.hazelcast.jet.pipeline.Pipeline in project hazelcast-jet-reference-manual by hazelcast.

the class ImplementAggregation method s2.

static void s2() {
    // tag::s2[]
    Pipeline p = Pipeline.create();
    BatchStage<PageVisit> pageVisit = p.drawFrom(Sources.list("pageVisit"));
    BatchStage<AddToCart> addToCart = p.drawFrom(Sources.list("addToCart"));
    BatchStage<Payment> payment = p.drawFrom(Sources.list("payment"));
    AggregateOperation3<PageVisit, AddToCart, Payment, LongAccumulator[], long[]> aggrOp = AggregateOperation.withCreate(() -> new LongAccumulator[] { new LongAccumulator(), new LongAccumulator(), new LongAccumulator() }).<PageVisit>andAccumulate0((accs, pv) -> accs[0].add(pv.loadTime())).<AddToCart>andAccumulate1((accs, atc) -> accs[1].add(atc.quantity())).<Payment>andAccumulate2((accs, pm) -> accs[2].add(pm.amount())).andCombine((accs1, accs2) -> {
        accs1[0].add(accs2[0]);
        accs1[1].add(accs2[1]);
        accs1[2].add(accs2[2]);
    }).andFinish(accs -> new long[] { accs[0].get(), accs[1].get(), accs[2].get() });
    BatchStage<Entry<Integer, long[]>> coGrouped = pageVisit.groupingKey(PageVisit::userId).aggregate3(addToCart.groupingKey(AddToCart::userId), payment.groupingKey(Payment::userId), aggrOp);
// end::s2[]
}

Example 34 with Pipeline

use of com.hazelcast.jet.pipeline.Pipeline in project hazelcast-jet-reference-manual by hazelcast.

the class ExpertZoneDag method s0.

// end::s1[]
static void s0() {
    Pipeline pipeline = Pipeline.create();
    // tag::s0[]
    DAG dag = pipeline.toDag();
// end::s0[]
}

Example 35 with Pipeline

use of com.hazelcast.jet.pipeline.Pipeline in project hazelcast-jet-reference-manual by hazelcast.

the class FileAndSocket method s2.

static void s2() {
    // tag::s2[]
    Pipeline p = Pipeline.create();
    p.drawFrom(Sources.fileWatcher("/home/jet/input")).drainTo(Sinks.logger());
// end::s2[]
}