Search in sources :

Example 6 with Fields

use of backtype.storm.tuple.Fields in project storm by nathanmarz.

the class TransactionalSpoutCoordinator method declareOutputFields.

@Override
public void declareOutputFields(OutputFieldsDeclarer declarer) {
    // in partitioned example, in case an emitter task receives a later transaction than it's emitted so far,
    // when it sees the earlier txid it should know to emit nothing
    declarer.declareStream(TRANSACTION_BATCH_STREAM_ID, new Fields("tx", "tx-meta", "committed-txid"));
    declarer.declareStream(TRANSACTION_COMMIT_STREAM_ID, new Fields("tx"));
}
Also used : Fields(backtype.storm.tuple.Fields)

Example 7 with Fields

use of backtype.storm.tuple.Fields in project storm by nathanmarz.

the class OpaqueMemoryTransactionalSpout method declareOutputFields.

@Override
public void declareOutputFields(OutputFieldsDeclarer declarer) {
    List<String> toDeclare = new ArrayList<String>(_outFields.toList());
    toDeclare.add(0, TX_FIELD);
    declarer.declare(new Fields(toDeclare));
}
Also used : Fields(backtype.storm.tuple.Fields) ArrayList(java.util.ArrayList)

Example 8 with Fields

use of backtype.storm.tuple.Fields in project storm by nathanmarz.

the class ClojureBolt method declareOutputFields.

@Override
public void declareOutputFields(OutputFieldsDeclarer declarer) {
    for (String stream : _fields.keySet()) {
        StreamInfo info = _fields.get(stream);
        declarer.declareStream(stream, info.is_direct(), new Fields(info.get_output_fields()));
    }
}
Also used : Fields(backtype.storm.tuple.Fields) StreamInfo(backtype.storm.generated.StreamInfo)

Example 9 with Fields

use of backtype.storm.tuple.Fields in project storm by nathanmarz.

the class PrepareRequest method declareOutputFields.

public void declareOutputFields(OutputFieldsDeclarer declarer) {
    declarer.declareStream(ARGS_STREAM, new Fields("request", "args"));
    declarer.declareStream(RETURN_STREAM, new Fields("request", "return"));
    declarer.declareStream(ID_STREAM, new Fields("request"));
}
Also used : Fields(backtype.storm.tuple.Fields)

Example 10 with Fields

use of backtype.storm.tuple.Fields in project heron by twitter.

the class WordCountTopology method main.

/**
   * Main method
   */
public static void main(String[] args) throws AlreadyAliveException, InvalidTopologyException {
    if (args.length < 1) {
        throw new RuntimeException("Specify topology name");
    }
    int parallelism = 1;
    if (args.length > 1) {
        parallelism = Integer.parseInt(args[1]);
    }
    TopologyBuilder builder = new TopologyBuilder();
    builder.setSpout("word", new WordSpout(), parallelism);
    builder.setBolt("consumer", new ConsumerBolt(), parallelism).fieldsGrouping("word", new Fields("word"));
    Config conf = new Config();
    conf.setNumStmgrs(parallelism);
    /*
    Set config here
    */
    conf.setComponentRam("word", ByteAmount.fromGigabytes(2));
    conf.setComponentRam("consumer", ByteAmount.fromGigabytes(3));
    conf.setContainerCpuRequested(6);
    StormSubmitter.submitTopology(args[0], conf, builder.createTopology());
}
Also used : Fields(backtype.storm.tuple.Fields) TopologyBuilder(backtype.storm.topology.TopologyBuilder) Config(backtype.storm.Config)

Aggregations

Fields (backtype.storm.tuple.Fields)130 TopologyBuilder (backtype.storm.topology.TopologyBuilder)41 Config (backtype.storm.Config)24 TridentTopology (storm.trident.TridentTopology)21 Map (java.util.Map)20 HashMap (java.util.HashMap)18 Test (org.junit.Test)17 JStormHelper (com.alibaba.starter.utils.JStormHelper)16 Values (backtype.storm.tuple.Values)15 ArrayList (java.util.ArrayList)13 LocalCluster (backtype.storm.LocalCluster)12 Stream (storm.trident.Stream)12 StreamInfo (backtype.storm.generated.StreamInfo)10 FixedBatchSpout (storm.trident.testing.FixedBatchSpout)9 HashSet (java.util.HashSet)8 LocalDRPC (backtype.storm.LocalDRPC)7 TridentState (storm.trident.TridentState)7 Count (storm.trident.operation.builtin.Count)7 GroupedStream (storm.trident.fluent.GroupedStream)6 IAggregatableStream (storm.trident.fluent.IAggregatableStream)6