Search in sources :

Example 1 with HBaseCountersBolt

use of backtype.storm.contrib.hbase.bolts.HBaseCountersBolt in project storm-hbase by jrkinley.

the class HBaseCountersTopology method main.

/**
   * @param args
   */
public static void main(String[] args) {
    TopologyBuilder builder = new TopologyBuilder();
    // Add test spout
    builder.setSpout("spout", new TestSpout(), 1);
    // Build TupleTableConifg
    TupleTableConfig config = new TupleTableConfig("shorturl", "shortid");
    config.setBatch(false);
    /*
     * By default the HBaseCountersBolt will use the tuple output fields value
     * to set the CQ name. For example if the 'date' output field exists in the
     * tuple then its value (e.g. "YYYYMMDD") will be used to set the counters
     * CQ. However, the 'clicks' output field does not exist in the tuple so in
     * this case the counters CQ will be set to the given field name 'clicks'.
     */
    config.addColumn("data", "clicks");
    config.addColumn("daily", "date");
    // Add HBaseBolt
    builder.setBolt("hbase-counters", new HBaseCountersBolt(config), 1).shuffleGrouping("spout");
    Config stormConf = new Config();
    stormConf.setDebug(true);
    LocalCluster cluster = new LocalCluster();
    cluster.submitTopology("hbase-example", stormConf, builder.createTopology());
    Utils.sleep(10000);
    cluster.shutdown();
}
Also used : LocalCluster(backtype.storm.LocalCluster) TopologyBuilder(backtype.storm.topology.TopologyBuilder) Config(backtype.storm.Config) TupleTableConfig(backtype.storm.contrib.hbase.utils.TupleTableConfig) HBaseCountersBolt(backtype.storm.contrib.hbase.bolts.HBaseCountersBolt) TupleTableConfig(backtype.storm.contrib.hbase.utils.TupleTableConfig)

Aggregations

Config (backtype.storm.Config)1 LocalCluster (backtype.storm.LocalCluster)1 HBaseCountersBolt (backtype.storm.contrib.hbase.bolts.HBaseCountersBolt)1 TupleTableConfig (backtype.storm.contrib.hbase.utils.TupleTableConfig)1 TopologyBuilder (backtype.storm.topology.TopologyBuilder)1