Search in sources :

Example 11 with Fields

use of com.twitter.heron.api.tuple.Fields in project heron by twitter.

the class OneBoltMultiTasks method buildTopology.

@Override
protected TestTopologyBuilder buildTopology(TestTopologyBuilder builder) {
    builder.setSpout("ab-spout", new ABSpout(), 1);
    builder.setBolt("identity-bolt", new IdentityBolt(new Fields("word")), 3).shuffleGrouping("ab-spout");
    return builder;
}
Also used : IdentityBolt(com.twitter.heron.integration_test.common.bolt.IdentityBolt) Fields(com.twitter.heron.api.tuple.Fields) ABSpout(com.twitter.heron.integration_test.common.spout.ABSpout)

Example 12 with Fields

use of com.twitter.heron.api.tuple.Fields in project heron by twitter.

the class OneSpoutMultiTasks method buildTopology.

@Override
protected TestTopologyBuilder buildTopology(TestTopologyBuilder builder) {
    builder.setSpout("ab-spout", new ABSpout(), 3);
    builder.setBolt("identity-bolt", new IdentityBolt(new Fields("word")), 1).shuffleGrouping("ab-spout");
    return builder;
}
Also used : IdentityBolt(com.twitter.heron.integration_test.common.bolt.IdentityBolt) Fields(com.twitter.heron.api.tuple.Fields) ABSpout(com.twitter.heron.integration_test.common.spout.ABSpout)

Example 13 with Fields

use of com.twitter.heron.api.tuple.Fields in project heron by twitter.

the class OneSpoutTwoBolts method buildTopology.

@Override
protected TestTopologyBuilder buildTopology(TestTopologyBuilder builder) {
    builder.setSpout("ab-spout", new ABSpout(), 1);
    builder.setBolt("identity-bolt-1", new IdentityBolt(new Fields("word")), 1).shuffleGrouping("ab-spout");
    builder.setBolt("identity-bolt-2", new IdentityBolt(new Fields("word")), 1).shuffleGrouping("ab-spout");
    return builder;
}
Also used : IdentityBolt(com.twitter.heron.integration_test.common.bolt.IdentityBolt) Fields(com.twitter.heron.api.tuple.Fields) ABSpout(com.twitter.heron.integration_test.common.spout.ABSpout)

Example 14 with Fields

use of com.twitter.heron.api.tuple.Fields in project heron by twitter.

the class ShuffleGrouping method buildTopology.

@Override
protected TestTopologyBuilder buildTopology(TestTopologyBuilder builder) {
    builder.setSpout("ab-spout", new ABSpout(), 1);
    builder.setBolt("identity-bolt", new IdentityBolt(new Fields("word")), 3).localOrShuffleGrouping("ab-spout");
    return builder;
}
Also used : IdentityBolt(com.twitter.heron.integration_test.common.bolt.IdentityBolt) Fields(com.twitter.heron.api.tuple.Fields) ABSpout(com.twitter.heron.integration_test.common.spout.ABSpout)

Example 15 with Fields

use of com.twitter.heron.api.tuple.Fields in project heron by twitter.

the class LocalReadWriteTopology method main.

public static void main(String[] args) throws Exception {
    if (args.length < 3 || args.length > 4) {
        throw new RuntimeException("Expects 3 or 4 arguments, topology name, " + "inputFile, outputFile and max emit count (optional)");
    }
    String topologyName = args[0];
    String inputFile = args[1];
    String outputFile = args[2];
    TestTopologyBuilder builder = new TestTopologyBuilder(outputFile);
    builder.setTerminalBoltClass(LOCAL_AGGREGATOR_BOLT_CLASS);
    if (args.length == 3) {
        builder.setSpout("paused-local-spout", new PausedLocalFileSpout(inputFile), 1);
    } else {
        int maxEmits = Integer.parseInt(args[3]);
        builder.setSpout("paused-local-spout", new PausedLocalFileSpout(inputFile), 1, maxEmits);
    }
    builder.setBolt("identity-bolt", new IdentityBolt(new Fields("line")), 1).shuffleGrouping("paused-local-spout");
    Config conf = new BasicConfig();
    HeronSubmitter.submitTopology(topologyName, conf, builder.createTopology());
}
Also used : BasicConfig(com.twitter.heron.integration_test.common.BasicConfig) IdentityBolt(com.twitter.heron.integration_test.common.bolt.IdentityBolt) Fields(com.twitter.heron.api.tuple.Fields) Config(com.twitter.heron.api.Config) BasicConfig(com.twitter.heron.integration_test.common.BasicConfig) PausedLocalFileSpout(com.twitter.heron.integration_test.common.spout.PausedLocalFileSpout) TestTopologyBuilder(com.twitter.heron.integration_test.core.TestTopologyBuilder)

Aggregations

Fields (com.twitter.heron.api.tuple.Fields)17 ABSpout (com.twitter.heron.integration_test.common.spout.ABSpout)11 IdentityBolt (com.twitter.heron.integration_test.common.bolt.IdentityBolt)10 Config (com.twitter.heron.api.Config)2 BaseBasicBolt (com.twitter.heron.api.bolt.BaseBasicBolt)2 BasicOutputCollector (com.twitter.heron.api.bolt.BasicOutputCollector)2 BaseRichSpout (com.twitter.heron.api.spout.BaseRichSpout)2 SpoutOutputCollector (com.twitter.heron.api.spout.SpoutOutputCollector)2 OutputFieldsDeclarer (com.twitter.heron.api.topology.OutputFieldsDeclarer)2 TopologyBuilder (com.twitter.heron.api.topology.TopologyBuilder)2 TopologyContext (com.twitter.heron.api.topology.TopologyContext)2 Tuple (com.twitter.heron.api.tuple.Tuple)2 HashMap (java.util.HashMap)2 Map (java.util.Map)2 HeronTopology (com.twitter.heron.api.HeronTopology)1 TopologyAPI (com.twitter.heron.api.generated.TopologyAPI)1 BoltDeclarer (com.twitter.heron.api.topology.BoltDeclarer)1 BasicConfig (com.twitter.heron.integration_test.common.BasicConfig)1 CountAggregatorBolt (com.twitter.heron.integration_test.common.bolt.CountAggregatorBolt)1 DoubleTuplesBolt (com.twitter.heron.integration_test.common.bolt.DoubleTuplesBolt)1