Search in sources :

Example 31 with Tuple

use of backtype.storm.tuple.Tuple in project storm-elastic-search by hmsonline.

the class ElasticSearchBatchBolt method finishBatch.

@Override
public void finishBatch() {
    List<Tuple> batch = new ArrayList<Tuple>();
    queue.drainTo(batch);
    for (Tuple tuple : batch) {
        super.execute(tuple);
    }
}
Also used : ArrayList(java.util.ArrayList) Tuple(backtype.storm.tuple.Tuple)

Example 32 with Tuple

use of backtype.storm.tuple.Tuple in project storm-elastic-search by hmsonline.

the class ElasticSearchTest method testBolt.

@Test
public void testBolt() {
    TopologyBuilder builder = new TopologyBuilder();
    ElasticSearchBolt bolt = new ElasticSearchBolt(new DefaultTupleMapper());
    builder.setBolt("TEST_BOLT", bolt);
    TopologyContext context = new MockTopologyContext(builder.createTopology());
    Config config = new Config();
    config.put(ElasticSearchBolt.ELASTIC_LOCAL_MODE, true);
    bolt.prepare(config, context, null);
    List<Object> values = new ArrayList<Object>();
    values.add("testIndex");
    values.add("entity");
    values.add("testId");
    values.add("{\"bolt\":\"lightning\"}");
    Tuple tuple = new TupleImpl(context, values, 5, "test");
    bolt.execute(tuple);
}
Also used : DefaultTupleMapper(com.hmsonline.storm.contrib.bolt.elasticsearch.mapper.DefaultTupleMapper) TopologyBuilder(backtype.storm.topology.TopologyBuilder) Config(backtype.storm.Config) ArrayList(java.util.ArrayList) TopologyContext(backtype.storm.task.TopologyContext) TupleImpl(backtype.storm.tuple.TupleImpl) Tuple(backtype.storm.tuple.Tuple) Test(org.junit.Test)

Example 33 with Tuple

use of backtype.storm.tuple.Tuple in project jstorm by alibaba.

the class SlidingWindowTestAvgBolt method execute.

@Override
public void execute(TupleWindow inputWindow) {
    int sum = 0;
    List<Tuple> tuplesInWindow = inputWindow.get();
    if (tuplesInWindow.size() > 0) {
        for (Tuple tuple : tuplesInWindow) {
            sum += (int) tuple.getValue(0);
        }
        asmCounter.update(sum / tuplesInWindow.size());
    }
}
Also used : Tuple(backtype.storm.tuple.Tuple)

Example 34 with Tuple

use of backtype.storm.tuple.Tuple in project jstorm by alibaba.

the class StatefulBoltExecutor method ack.

private void ack(List<Tuple> tuples) {
    if (!tuples.isEmpty()) {
        LOG.debug("Acking {} tuples", tuples.size());
        for (Tuple tuple : tuples) {
            collector.delegate.ack(tuple);
        }
        tuples.clear();
    }
}
Also used : Tuple(backtype.storm.tuple.Tuple)

Example 35 with Tuple

use of backtype.storm.tuple.Tuple in project jstorm by alibaba.

the class StatefulWindowedBoltExecutor method clearRecoveryState.

private void clearRecoveryState(TaskStream stream) {
    recoveryStates.remove(stream);
    if (!isRecovering()) {
        super.start();
        LOG.debug("Recovery complete, processing {} pending tuples", pendingTuples.size());
        for (Tuple tuple : pendingTuples) {
            super.execute(tuple);
        }
    }
}
Also used : Tuple(backtype.storm.tuple.Tuple)

Aggregations

Tuple (backtype.storm.tuple.Tuple)49 Values (backtype.storm.tuple.Values)11 ArrayList (java.util.ArrayList)10 MessageId (backtype.storm.tuple.MessageId)5 List (java.util.List)5 Test (org.testng.annotations.Test)5 Message (com.yahoo.pulsar.client.api.Message)4 TupleImpl (backtype.storm.tuple.TupleImpl)3 TupleImplExt (backtype.storm.tuple.TupleImplExt)3 Pair (com.alibaba.jstorm.utils.Pair)3 HashMap (java.util.HashMap)3 Map (java.util.Map)3 GlobalStreamId (backtype.storm.generated.GlobalStreamId)2 FailedException (backtype.storm.topology.FailedException)2 TupleExt (backtype.storm.tuple.TupleExt)2 TimerTrigger (com.alibaba.jstorm.daemon.worker.timer.TimerTrigger)2 TopoMasterCtrlEvent (com.alibaba.jstorm.task.master.ctrlevent.TopoMasterCtrlEvent)2 RotatingMap (com.alibaba.jstorm.utils.RotatingMap)2 Pair (com.alipay.dw.jstorm.example.sequence.bean.Pair)2 TradeCustomer (com.alipay.dw.jstorm.example.sequence.bean.TradeCustomer)2